2024-09-13T21:20:50.641 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T21:20:50.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T21:20:50.796 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904186 branch: squid description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904186' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3819 sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 sleep_before_teardown: 0 subset: 43/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEFmppuviIOk64qhnhljmxlN2ZnsyE0sip1IjCmJJMszoRrCJadnuX2PcUZRJDRunOblI+lYdFAiF/TZAnN3TUU= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZF+BJiZoKSFJ2/4iVmHgmAoqrDHkRPUh3sRrMTtOQt3o0Z884Xs09T/4zwyHIk/7qNnJ5BDqKnn3+K3GjjDkk= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_21:08:03 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T21:20:50.796 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T21:20:50.797 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T21:20:50.797 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T21:20:50.799 INFO:teuthology.task.internal:Checking packages... 2024-09-13T21:20:50.822 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ecab7be58963a5bd03910cd73eef66405d7fdd50' 2024-09-13T21:20:50.822 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:20:50.822 INFO:teuthology.packaging:ref: None 2024-09-13T21:20:50.822 INFO:teuthology.packaging:tag: None 2024-09-13T21:20:50.822 INFO:teuthology.packaging:branch: squid 2024-09-13T21:20:50.822 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:20:50.823 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T21:20:51.043 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-324.gecab7be5 2024-09-13T21:20:51.045 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T21:20:51.051 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T21:20:51.051 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T21:20:51.139 INFO:teuthology.task.internal:Saving configuration 2024-09-13T21:20:51.158 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T21:20:51.169 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T21:20:51.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904186', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 21:15:16.002205', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEFmppuviIOk64qhnhljmxlN2ZnsyE0sip1IjCmJJMszoRrCJadnuX2PcUZRJDRunOblI+lYdFAiF/TZAnN3TUU='} 2024-09-13T21:20:51.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904186', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 21:15:16.000537', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZF+BJiZoKSFJ2/4iVmHgmAoqrDHkRPUh3sRrMTtOQt3o0Z884Xs09T/4zwyHIk/7qNnJ5BDqKnn3+K3GjjDkk='} 2024-09-13T21:20:51.234 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T21:20:51.240 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T21:20:51.240 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T21:20:51.240 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T21:20:51.342 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f73a3a87ac0>, signals=[15]) 2024-09-13T21:20:51.342 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T21:20:51.348 INFO:teuthology.task.internal:Opening connections... 2024-09-13T21:20:51.348 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:20:51.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:20:51.441 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-09-13T21:20:51.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:20:51.525 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T21:20:51.531 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-09-13T21:20:51.550 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-09-13T21:20:51.550 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-09-13T21:20:51.608 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-09-13T21:20:51.609 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T21:20:51.610 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T21:20:51.610 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T21:20:51.610 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-09-13T21:20:51.639 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-09-13T21:20:51.657 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-09-13T21:20:51.658 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-09-13T21:20:51.716 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T21:20:51.717 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-09-13T21:20:51.717 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T21:20:51.717 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T21:20:51.717 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T21:20:51.717 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-09-13T21:20:51.747 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T21:20:51.756 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T21:20:51.803 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T21:20:51.803 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-09-13T21:20:51.806 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-09-13T21:20:51.823 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T21:20:51.835 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T21:20:51.835 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-09-13T21:20:51.863 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-09-13T21:20:51.889 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T21:20:51.957 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T21:20:51.972 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T21:20:51.972 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T21:20:51.972 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T21:20:51.973 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T21:20:51.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:20:51.989 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-09-13T21:20:51.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:20:51.990 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-13T21:20:52.046 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-503.el9.x86_64 2024-09-13T21:20:52.046 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.14.0-503.el9.x86_64 2024-09-13T21:20:52.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2024-09-13T21:20:52.047 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-503.el9.x86_64 2024-09-13T21:20:52.048 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.14.0-503.el9.x86_64 2024-09-13T21:20:52.048 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2024-09-13T21:20:54.742 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.2 MB 00:00 2024-09-13T21:20:55.798 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-09-13T21:20:56.551 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-13T21:20:58.091 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-13T21:21:00.952 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-13T21:21:02.374 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-13T21:21:02.786 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-13T21:21:03.582 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-13T21:21:03.884 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-13T21:21:04.704 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-13T21:21:09.221 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-13T21:21:10.143 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T21:21:11.194 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T21:21:11.194 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T21:21:11.288 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:21:11.296 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:21:11.297 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-09-13T21:21:11.298 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:21:11.298 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 79 M 2024-09-13T21:21:11.298 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 126 M 2024-09-13T21:21:11.298 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:21:11.655 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 203 kB/s | 23 kB 00:00 2024-09-13T21:21:12.141 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T21:21:12.141 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T21:21:12.238 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:21:12.249 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:21:12.249 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-13T21:21:12.249 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:21:12.249 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout:Install 4 Packages 2024-09-13T21:21:12.250 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:21:12.251 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 79 M 2024-09-13T21:21:12.251 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 126 M 2024-09-13T21:21:12.251 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:21:12.364 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-13T21:21:12.511 INFO:teuthology.orchestra.run.smithi088.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 159 kB/s | 23 kB 00:00 2024-09-13T21:21:12.806 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-13T21:21:13.119 INFO:teuthology.orchestra.run.smithi088.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-13T21:21:13.348 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-13T21:21:13.348 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:21:13.348 INFO:teuthology.orchestra.run.smithi116.stdout:Total 38 MB/s | 79 MB 00:02 2024-09-13T21:21:13.744 INFO:teuthology.orchestra.run.smithi088.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 25 MB/s | 35 MB 00:01 2024-09-13T21:21:14.024 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:21:14.245 INFO:teuthology.orchestra.run.smithi088.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-13T21:21:14.245 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:21:14.245 INFO:teuthology.orchestra.run.smithi088.stdout:Total 39 MB/s | 79 MB 00:01 2024-09-13T21:21:14.365 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:21:14.365 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:21:14.926 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:21:15.291 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:21:15.291 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:21:15.329 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:21:15.332 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:21:16.264 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:21:16.264 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:21:17.774 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:21:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:21:18.589 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:21:18.711 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:21:19.437 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:21:19.521 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:21:21.377 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:21:21.510 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:21:22.336 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:21:22.466 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:21:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:21:26.443 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:21:27.314 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:21:27.366 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:21:31.288 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:21:32.240 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:22:09.576 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:22:09.615 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:22:09.946 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:22:09.946 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:22:09.946 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:22:09.946 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:22:10.163 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:22:10.202 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:22:10.500 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:22:10.500 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:22:10.500 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:22:10.500 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:22:10.801 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:22:10.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:22:10.801 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:22:10.801 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T21:22:10.801 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T21:22:10.801 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T21:22:10.801 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T21:22:10.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:22:10.801 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:22:11.173 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:22:11.261 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:22:11.264 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:22:11.264 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T21:22:11.265 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T21:22:11.265 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T21:22:11.265 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T21:22:11.265 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T21:22:11.265 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:22:11.323 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:22:11.323 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:22:11.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 82.el9 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8274670 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2024-09-13T21:22:11.355 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2024-09-13T21:22:11.356 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:22:11.357 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T21:22:11.357 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T21:22:11.357 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 5.14.0-505.el9.x86_64 2024-09-13T21:22:11.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T21:22:11.361 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:22:11.361 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:22:11.361 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:22:11.361 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T21:22:11.361 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T21:22:11.361 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T21:22:11.361 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T21:22:11.361 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:22:11.361 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:22:11.749 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:22:11.833 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:22:11.833 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:22:11.833 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T21:22:11.834 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T21:22:11.834 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T21:22:11.834 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T21:22:11.834 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T21:22:11.834 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:22:11.893 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:22:11.893 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:22:11.893 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2024-09-13T21:22:11.925 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2024-09-13T21:22:11.925 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2024-09-13T21:22:11.925 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.06 2024-09-13T21:22:11.925 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 82.el9 2024-09-13T21:22:11.925 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2024-09-13T21:22:11.925 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T21:22:11.925 INFO:teuthology.orchestra.run.smithi088.stdout:Group : Unspecified 2024-09-13T21:22:11.925 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 8274670 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : builder@centos.org 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T21:22:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T21:22:11.927 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2024-09-13T21:22:11.927 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:22:11.927 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T21:22:11.927 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T21:22:11.928 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 5.14.0-505.el9.x86_64 2024-09-13T21:22:11.928 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T21:22:12.042 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-09-13T21:22:12.527 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-09-13T21:22:13.396 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T21:22:13.430 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-09-13T21:22:13.432 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-13T21:22:13.447 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.yc3lTGd6VV 2024-09-13T21:22:13.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yc3lTGd6VV 2024-09-13T21:22:13.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.yc3lTGd6VV 2024-09-13T21:22:13.660 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.yc3lTGd6VV is 6KB 2024-09-13T21:22:13.710 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.yc3lTGd6VV 2024-09-13T21:22:13.724 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T21:22:13.787 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T21:22:13.787 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T21:22:13.787 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T21:22:13.787 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T21:22:13.788 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T21:22:13.927 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-09-13T21:22:13.975 INFO:teuthology.orchestra.run.smithi088.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T21:22:14.008 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-09-13T21:22:14.010 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-09-13T21:22:14.025 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.jVdgSECKTt 2024-09-13T21:22:14.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jVdgSECKTt 2024-09-13T21:22:14.092 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.jVdgSECKTt 2024-09-13T21:22:14.225 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.jVdgSECKTt is 6KB 2024-09-13T21:22:14.273 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.jVdgSECKTt 2024-09-13T21:22:14.288 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T21:22:14.351 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T21:22:14.351 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T21:22:14.351 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T21:22:14.351 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T21:22:14.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T21:22:14.498 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-09-13T21:22:43.959 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T21:22:43.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-13T21:22:43.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:22:44.501 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T21:22:44.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T21:22:44.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:23:18.973 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-13T21:23:27.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T21:23:27.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:23:43.985 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T21:23:52.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-13T21:23:52.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:23:53.374 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-13T21:23:53.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-13T21:23:53.834 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T21:23:53.834 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-13T21:23:53.849 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-505.el9.x86_64 2024-09-13T21:23:53.849 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T21:23:53.849 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T21:23:53.849 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T21:23:54.850 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T21:23:54.850 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T21:23:54.937 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-09-13T21:23:54.958 DEBUG:teuthology.parallel:result is None 2024-09-13T21:24:27.994 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T21:24:39.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T21:24:39.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:24:40.281 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-09-13T21:24:40.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T21:24:40.634 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T21:24:40.634 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-09-13T21:24:40.650 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-505.el9.x86_64 2024-09-13T21:24:40.651 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T21:24:40.651 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T21:24:40.651 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T21:24:41.652 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T21:24:41.652 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T21:24:41.726 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-09-13T21:24:41.742 DEBUG:teuthology.parallel:result is None 2024-09-13T21:24:41.742 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T21:24:41.751 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T21:24:41.751 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T21:24:41.754 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T21:24:41.774 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T21:24:41.791 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T21:24:41.824 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T21:24:41.824 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T21:24:41.827 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T21:24:41.860 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T21:24:41.866 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T21:24:41.866 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T21:24:41.896 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T21:24:41.927 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:24:41.939 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:24:41.963 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:24:41.975 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:24:41.977 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T21:24:41.986 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T21:24:41.986 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T21:24:41.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T21:24:42.017 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T21:24:42.026 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T21:24:42.026 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T21:24:42.057 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T21:24:42.074 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:24:42.162 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:24:42.201 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:24:42.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:24:42.325 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:24:42.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T21:24:42.391 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:24:42.445 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:24:42.494 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:24:42.587 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:24:42.621 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:24:42.621 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T21:24:42.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-09-13T21:24:42.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-09-13T21:24:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T21:24:42.772 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T21:24:43.249 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T21:24:43.256 INFO:teuthology.task.internal:Starting timer... 2024-09-13T21:24:43.256 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T21:24:43.287 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T21:24:43.319 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-13T21:24:43.319 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2024-09-13T21:24:43.366 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2024-09-13T21:24:43.368 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-09-13T21:24:43.430 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-09-13T21:24:43.432 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T21:24:43.432 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2024-09-13T21:24:43.459 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2024-09-13T21:24:43.460 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-09-13T21:24:43.481 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-09-13T21:24:43.481 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive'} 2024-09-13T21:24:43.481 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T21:24:43.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:24:43.530 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T21:24:43.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:24:43.555 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T21:24:43.556 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2024-09-13T21:24:43.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-09-13T21:24:43.643 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T21:24:43.652 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T21:24:43.666 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T21:24:43.667 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T21:28:29.105 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com')] 2024-09-13T21:28:29.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T21:28:29.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:28:29.199 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-09-13T21:28:29.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T21:28:29.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-13T21:28:29.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:28:29.374 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-13T21:28:29.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-13T21:28:29.452 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T21:28:29.463 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T21:28:29.463 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T21:28:29.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T21:28:29.466 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T21:28:29.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T21:28:29.496 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T21:28:29.511 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T21:28:29.521 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T21:28:29.535 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T21:28:29.536 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2024-09-13T21:28:29.548 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2024-09-13T21:28:29.559 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-09-13T21:28:29.562 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T21:28:29.570 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-09-13T21:28:29.576 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T21:28:29.585 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T21:28:29.599 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T21:28:29.632 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-09-13T21:28:29.635 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T21:28:29.635 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-09-13T21:28:29.636 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:28:29.636 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:28:29.636 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:28:29.636 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:28:29.652 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-13T21:28:29.655 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T21:28:29.655 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-13T21:28:29.656 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:28:29.656 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:28:29.656 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:28:29.656 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:28:29.656 INFO:teuthology.run_tasks:Running task install... 2024-09-13T21:28:29.665 DEBUG:teuthology.task.install:project ceph 2024-09-13T21:28:29.665 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}} 2024-09-13T21:28:29.665 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T21:28:29.665 INFO:teuthology.task.install:Using flavor: default 2024-09-13T21:28:29.671 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T21:28:29.671 INFO:teuthology.task.install:extra packages: [] 2024-09-13T21:28:29.671 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-13T21:28:29.671 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T21:28:29.672 INFO:teuthology.packaging:ref: None 2024-09-13T21:28:29.672 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T21:28:29.672 INFO:teuthology.packaging:branch: None 2024-09-13T21:28:29.672 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:28:30.324 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T21:28:30.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T21:28:30.327 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-13T21:28:30.327 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T21:28:30.328 INFO:teuthology.packaging:ref: None 2024-09-13T21:28:30.328 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T21:28:30.328 INFO:teuthology.packaging:branch: None 2024-09-13T21:28:30.328 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:28:30.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T21:28:30.480 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-13T21:28:30.481 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-13T21:28:30.497 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-13T21:28:30.497 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-13T21:28:30.568 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T21:28:30.568 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:28:30.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T21:28:30.572 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T21:28:30.572 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:28:30.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T21:28:30.603 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T21:28:30.603 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T21:28:30.604 INFO:teuthology.packaging:ref: None 2024-09-13T21:28:30.604 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T21:28:30.604 INFO:teuthology.packaging:branch: None 2024-09-13T21:28:30.604 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:28:30.604 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T21:28:30.605 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T21:28:30.605 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T21:28:30.605 INFO:teuthology.packaging:ref: None 2024-09-13T21:28:30.606 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T21:28:30.606 INFO:teuthology.packaging:branch: None 2024-09-13T21:28:30.606 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:28:30.606 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T21:28:30.673 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T21:28:30.675 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T21:28:30.752 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T21:28:30.754 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T21:28:30.818 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-09-13T21:28:30.820 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-09-13T21:28:30.821 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2024-09-13T21:28:30.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2024-09-13T21:28:31.050 INFO:teuthology.orchestra.run.smithi116.stdout:45 files removed 2024-09-13T21:28:31.061 INFO:teuthology.orchestra.run.smithi088.stdout:45 files removed 2024-09-13T21:28:31.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw 2024-09-13T21:28:31.088 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw 2024-09-13T21:28:31.447 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 883 kB/s | 76 kB 00:00 2024-09-13T21:28:31.457 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 875 kB/s | 76 kB 00:00 2024-09-13T21:28:31.573 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 116 kB/s | 9.3 kB 00:00 2024-09-13T21:28:31.583 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 117 kB/s | 9.3 kB 00:00 2024-09-13T21:28:31.690 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 26 kB/s | 2.2 kB 00:00 2024-09-13T21:28:31.692 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 29 kB/s | 2.2 kB 00:00 2024-09-13T21:28:33.132 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.2 MB 00:01 2024-09-13T21:28:33.408 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-13T21:28:35.143 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-13T21:28:40.352 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-13T21:28:41.952 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-13T21:28:42.299 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-13T21:28:42.748 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-13T21:28:48.050 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-13T21:28:48.162 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T21:28:49.534 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-13T21:28:50.321 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-13T21:28:50.546 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:28:50.555 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:28:50.556 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-13T21:28:50.556 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:28:50.556 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:28:50.556 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-13T21:28:50.556 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2024-09-13T21:28:50.556 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-13T21:28:50.556 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T21:28:50.557 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T21:28:50.558 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout:Install 28 Packages 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 2 Packages 2024-09-13T21:28:50.559 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:28:50.560 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 53 M 2024-09-13T21:28:50.561 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:28:50.854 INFO:teuthology.orchestra.run.smithi088.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 41 MB/s | 5.2 MB 00:00 2024-09-13T21:28:50.871 INFO:teuthology.orchestra.run.smithi088.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 1.4 MB/s | 24 kB 00:00 2024-09-13T21:28:50.921 INFO:teuthology.orchestra.run.smithi088.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 13 MB/s | 653 kB 00:00 2024-09-13T21:28:50.957 INFO:teuthology.orchestra.run.smithi088.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-13T21:28:51.065 INFO:teuthology.orchestra.run.smithi088.stdout:(5/30): librgw2-18.2.0-0.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-13T21:28:51.080 INFO:teuthology.orchestra.run.smithi088.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 2.7 MB/s | 45 kB 00:00 2024-09-13T21:28:51.106 INFO:teuthology.orchestra.run.smithi088.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 4.7 MB/s | 119 kB 00:00 2024-09-13T21:28:51.206 INFO:teuthology.orchestra.run.smithi088.stdout:(8/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 16 MB/s | 7.6 MB 00:00 2024-09-13T21:28:51.231 INFO:teuthology.orchestra.run.smithi088.stdout:(9/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 1.2 MB/s | 155 kB 00:00 2024-09-13T21:28:51.257 INFO:teuthology.orchestra.run.smithi088.stdout:(10/30): python3-rados-18.2.0-0.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2024-09-13T21:28:51.282 INFO:teuthology.orchestra.run.smithi088.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 297 kB 00:00 2024-09-13T21:28:51.307 INFO:teuthology.orchestra.run.smithi088.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-13T21:28:51.524 INFO:teuthology.orchestra.run.smithi088.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 23 MB/s | 18 MB 00:00 2024-09-13T21:28:51.575 INFO:teuthology.orchestra.run.smithi088.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 366 kB/s | 107 kB 00:00 2024-09-13T21:28:51.633 INFO:teuthology.orchestra.run.smithi088.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 492 kB/s | 160 kB 00:00 2024-09-13T21:28:51.683 INFO:teuthology.orchestra.run.smithi088.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 285 kB/s | 45 kB 00:00 2024-09-13T21:28:51.742 INFO:teuthology.orchestra.run.smithi088.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-13T21:28:51.767 INFO:teuthology.orchestra.run.smithi088.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-13T21:28:51.792 INFO:teuthology.orchestra.run.smithi088.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 388 kB/s | 42 kB 00:00 2024-09-13T21:28:51.843 INFO:teuthology.orchestra.run.smithi088.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-09-13T21:28:51.868 INFO:teuthology.orchestra.run.smithi088.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-13T21:28:51.893 INFO:teuthology.orchestra.run.smithi088.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T21:28:51.918 INFO:teuthology.orchestra.run.smithi088.stdout:(23/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.0 MB/s | 308 kB 00:00 2024-09-13T21:28:51.943 INFO:teuthology.orchestra.run.smithi088.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T21:28:51.977 INFO:teuthology.orchestra.run.smithi088.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T21:28:52.019 INFO:teuthology.orchestra.run.smithi088.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-13T21:28:52.078 INFO:teuthology.orchestra.run.smithi088.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-13T21:28:52.136 INFO:teuthology.orchestra.run.smithi088.stdout:(28/30): librados2-18.2.0-0.el9.x86_64.rpm 28 MB/s | 3.3 MB 00:00 2024-09-13T21:28:52.203 INFO:teuthology.orchestra.run.smithi088.stdout:(29/30): librbd1-18.2.0-0.el9.x86_64.rpm 24 MB/s | 3.0 MB 00:00 2024-09-13T21:28:52.262 INFO:teuthology.orchestra.run.smithi088.stdout:(30/30): libarrow-9.0.0-11.el9.x86_64.rpm 9.7 MB/s | 4.4 MB 00:00 2024-09-13T21:28:52.266 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:28:52.266 INFO:teuthology.orchestra.run.smithi088.stdout:Total 31 MB/s | 53 MB 00:01 2024-09-13T21:28:52.334 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:28:52.368 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:28:52.368 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:28:53.003 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:28:53.003 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:28:54.381 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:28:54.462 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T21:28:54.491 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T21:28:54.541 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T21:28:54.952 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T21:28:54.998 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T21:28:55.082 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T21:28:55.162 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-13T21:28:55.184 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T21:28:55.247 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T21:28:55.283 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T21:28:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-13T21:28:55.400 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-13T21:28:55.427 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T21:28:55.493 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T21:28:55.600 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T21:28:55.635 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T21:28:55.675 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T21:28:55.716 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T21:28:55.743 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T21:28:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T21:28:55.794 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-13T21:28:55.813 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T21:28:56.110 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T21:28:56.150 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-13T21:28:56.240 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-13T21:28:56.271 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-13T21:28:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T21:28:56.700 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T21:28:56.727 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-13T21:28:56.800 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-13T21:28:56.873 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-13T21:28:56.904 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-13T21:28:58.144 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:28:58.168 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:28:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-13T21:28:58.168 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T21:28:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-13T21:28:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout:Install 28 Packages 2024-09-13T21:28:58.171 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 2 Packages 2024-09-13T21:28:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:28:58.172 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 53 M 2024-09-13T21:28:58.172 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:28:58.487 INFO:teuthology.orchestra.run.smithi116.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 37 MB/s | 5.2 MB 00:00 2024-09-13T21:28:58.512 INFO:teuthology.orchestra.run.smithi116.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 971 kB/s | 24 kB 00:00 2024-09-13T21:28:58.546 INFO:teuthology.orchestra.run.smithi116.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 19 MB/s | 653 kB 00:00 2024-09-13T21:28:58.588 INFO:teuthology.orchestra.run.smithi116.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 11 MB/s | 474 kB 00:00 2024-09-13T21:28:58.696 INFO:teuthology.orchestra.run.smithi116.stdout:(5/30): librgw2-18.2.0-0.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-13T21:28:58.797 INFO:teuthology.orchestra.run.smithi116.stdout:(6/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 17 MB/s | 7.6 MB 00:00 2024-09-13T21:28:58.822 INFO:teuthology.orchestra.run.smithi116.stdout:(7/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 358 kB/s | 45 kB 00:00 2024-09-13T21:28:58.847 INFO:teuthology.orchestra.run.smithi116.stdout:(8/30): python3-ceph-common-18.2.0-0.el9.x86_64 2.3 MB/s | 119 kB 00:00 2024-09-13T21:28:58.873 INFO:teuthology.orchestra.run.smithi116.stdout:(9/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-09-13T21:28:58.898 INFO:teuthology.orchestra.run.smithi116.stdout:(10/30): python3-rados-18.2.0-0.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2024-09-13T21:28:58.914 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T21:28:58.923 INFO:teuthology.orchestra.run.smithi116.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 297 kB 00:00 2024-09-13T21:28:58.942 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T21:28:58.948 INFO:teuthology.orchestra.run.smithi116.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-13T21:28:59.182 INFO:teuthology.orchestra.run.smithi116.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 22 MB/s | 18 MB 00:00 2024-09-13T21:28:59.496 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T21:28:59.546 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-13T21:28:59.637 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-13T21:28:59.637 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T21:28:59.637 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T21:28:59.637 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:28:59.672 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T21:28:59.757 INFO:teuthology.orchestra.run.smithi116.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-13T21:28:59.799 INFO:teuthology.orchestra.run.smithi116.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 122 kB/s | 107 kB 00:00 2024-09-13T21:28:59.858 INFO:teuthology.orchestra.run.smithi116.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 176 kB/s | 160 kB 00:00 2024-09-13T21:29:00.433 INFO:teuthology.orchestra.run.smithi116.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 73 kB/s | 42 kB 00:00 2024-09-13T21:29:00.476 INFO:teuthology.orchestra.run.smithi116.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 2.6 MB/s | 111 kB 00:00 2024-09-13T21:29:00.500 INFO:teuthology.orchestra.run.smithi116.stdout:(19/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 12 MB/s | 308 kB 00:00 2024-09-13T21:29:00.609 INFO:teuthology.orchestra.run.smithi116.stdout:(20/30): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-13T21:29:00.634 INFO:teuthology.orchestra.run.smithi116.stdout:(21/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 350 kB/s | 292 kB 00:00 2024-09-13T21:29:00.659 INFO:teuthology.orchestra.run.smithi116.stdout:(22/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-13T21:29:00.693 INFO:teuthology.orchestra.run.smithi116.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T21:29:00.727 INFO:teuthology.orchestra.run.smithi116.stdout:(24/30): liboath-2.6.7-2.el9.x86_64.rpm 527 kB/s | 49 kB 00:00 2024-09-13T21:29:00.760 INFO:teuthology.orchestra.run.smithi116.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-13T21:29:00.794 INFO:teuthology.orchestra.run.smithi116.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 839 kB 00:00 2024-09-13T21:29:00.827 INFO:teuthology.orchestra.run.smithi116.stdout:(27/30): librdkafka-1.6.1-102.el9.x86_64.rpm 619 kB/s | 662 kB 00:01 2024-09-13T21:29:00.894 INFO:teuthology.orchestra.run.smithi116.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-13T21:29:00.953 INFO:teuthology.orchestra.run.smithi116.stdout:(29/30): librados2-18.2.0-0.el9.x86_64.rpm 21 MB/s | 3.3 MB 00:00 2024-09-13T21:29:01.011 INFO:teuthology.orchestra.run.smithi116.stdout:(30/30): librbd1-18.2.0-0.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-09-13T21:29:01.016 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:01.017 INFO:teuthology.orchestra.run.smithi116.stdout:Total 19 MB/s | 53 MB 00:02 2024-09-13T21:29:01.091 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:29:01.127 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:29:01.127 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:29:01.758 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:29:01.759 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:29:03.133 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:29:03.228 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T21:29:03.267 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T21:29:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T21:29:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T21:29:03.771 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T21:29:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T21:29:03.929 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-13T21:29:03.967 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T21:29:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T21:29:04.050 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T21:29:04.093 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-13T21:29:04.160 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-13T21:29:04.186 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T21:29:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T21:29:04.357 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T21:29:04.394 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T21:29:04.444 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T21:29:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T21:29:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T21:29:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T21:29:04.572 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T21:29:04.871 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T21:29:04.917 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-13T21:29:04.990 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-13T21:29:05.031 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-13T21:29:05.065 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T21:29:05.463 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T21:29:05.495 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-13T21:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-13T21:29:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-13T21:29:05.672 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-13T21:29:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T21:29:07.743 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T21:29:08.295 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T21:29:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-13T21:29:08.452 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-13T21:29:08.452 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T21:29:08.452 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T21:29:08.452 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:08.481 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T21:29:09.350 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T21:29:09.351 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2024-09-13T21:29:09.351 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2024-09-13T21:29:09.351 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2024-09-13T21:29:09.351 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2024-09-13T21:29:09.351 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2024-09-13T21:29:09.351 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /root 2024-09-13T21:29:09.351 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2024-09-13T21:29:09.351 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:10.069 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-13T21:29:10.094 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-13T21:29:10.095 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:10.095 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T21:29:10.095 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:29:10.095 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:29:10.095 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:10.097 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T21:29:10.195 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T21:29:10.195 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:29:11.343 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:29:11.343 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-13T21:29:11.344 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T21:29:11.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-13T21:29:11.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-13T21:29:11.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T21:29:11.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T21:29:11.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T21:29:11.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T21:29:11.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T21:29:11.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T21:29:11.345 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T21:29:11.346 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-13T21:29:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:29:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:12.304 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2024-09-13T21:29:12.304 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.304 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:29:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T21:29:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T21:29:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T21:29:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T21:29:12.305 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T21:29:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T21:29:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T21:29:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T21:29:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T21:29:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T21:29:12.306 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T21:29:12.307 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:12.308 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:29:12.668 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-test 2024-09-13T21:29:13.231 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:25 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:29:13.361 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:29:13.361 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:13.361 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-13T21:29:13.361 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:13.361 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:29:13.361 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-13T21:29:13.362 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-13T21:29:13.362 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-13T21:29:13.362 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T21:29:13.362 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T21:29:13.362 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:13.362 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:29:13.362 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:13.362 INFO:teuthology.orchestra.run.smithi088.stdout:Install 4 Packages 2024-09-13T21:29:13.362 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:13.363 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 40 M 2024-09-13T21:29:13.363 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 165 M 2024-09-13T21:29:13.363 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:29:13.717 INFO:teuthology.orchestra.run.smithi088.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 2.0 MB/s | 161 kB 00:00 2024-09-13T21:29:14.176 INFO:teuthology.orchestra.run.smithi088.stdout:(2/4): ceph-test-18.2.0-0.el9.x86_64.rpm 74 MB/s | 40 MB 00:00 2024-09-13T21:29:14.201 INFO:teuthology.orchestra.run.smithi088.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 132 kB/s | 64 kB 00:00 2024-09-13T21:29:14.226 INFO:teuthology.orchestra.run.smithi088.stdout:(4/4): socat-1.7.4.1-6.el9.x86_64.rpm 519 kB/s | 304 kB 00:00 2024-09-13T21:29:14.228 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:14.228 INFO:teuthology.orchestra.run.smithi088.stdout:Total 46 MB/s | 40 MB 00:00 2024-09-13T21:29:14.255 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:29:14.275 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:29:14.275 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:29:14.618 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:29:14.619 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:29:15.090 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:29:15.172 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T21:29:15.216 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T21:29:15.245 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-13T21:29:18.234 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T21:29:18.234 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-09-13T21:29:18.234 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-09-13T21:29:18.235 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-09-13T21:29:18.235 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-09-13T21:29:18.235 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-09-13T21:29:18.235 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-09-13T21:29:18.235 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-09-13T21:29:18.235 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:18.962 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-13T21:29:18.982 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-13T21:29:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-13T21:29:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T21:29:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:29:19.007 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:29:19.007 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:19.009 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T21:29:19.034 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-13T21:29:19.100 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T21:29:19.101 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:29:20.209 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-13T21:29:20.210 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T21:29:20.211 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T21:29:20.212 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T21:29:20.212 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T21:29:20.212 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T21:29:20.212 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-13T21:29:21.102 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-13T21:29:21.102 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-13T21:29:21.102 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-13T21:29:21.102 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T21:29:21.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:29:21.225 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:21.225 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-09-13T21:29:21.225 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.225 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:29:21.225 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T21:29:21.226 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.226 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.226 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.226 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.226 INFO:teuthology.orchestra.run.smithi116.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T21:29:21.227 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T21:29:21.227 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T21:29:21.227 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T21:29:21.227 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.227 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T21:29:21.227 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T21:29:21.228 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T21:29:21.228 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.228 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T21:29:21.228 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.228 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T21:29:21.229 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T21:29:21.229 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:21.230 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:29:21.397 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T21:29:21.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:21.397 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:29:21.397 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:21.397 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T21:29:21.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:21.397 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:29:21.549 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-test 2024-09-13T21:29:21.686 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph 2024-09-13T21:29:22.118 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:27 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:29:22.248 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:22.249 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:29:22.250 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:22.250 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-09-13T21:29:22.250 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:22.250 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 40 M 2024-09-13T21:29:22.250 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 165 M 2024-09-13T21:29:22.250 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:29:22.259 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:34 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:29:22.394 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:29:22.396 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-13T21:29:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T21:29:22.398 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T21:29:22.399 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T21:29:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T21:29:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T21:29:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T21:29:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:22.400 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:29:22.400 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:22.400 INFO:teuthology.orchestra.run.smithi088.stdout:Install 33 Packages 2024-09-13T21:29:22.400 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:22.401 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 30 M 2024-09-13T21:29:22.401 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 109 M 2024-09-13T21:29:22.401 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:29:22.573 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 2.4 MB/s | 161 kB 00:00 2024-09-13T21:29:22.619 INFO:teuthology.orchestra.run.smithi088.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 97 kB/s | 6.4 kB 00:00 2024-09-13T21:29:22.648 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-13T21:29:22.665 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 695 kB/s | 64 kB 00:00 2024-09-13T21:29:22.668 INFO:teuthology.orchestra.run.smithi088.stdout:(2/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 18 MB/s | 2.1 MB 00:00 2024-09-13T21:29:22.710 INFO:teuthology.orchestra.run.smithi088.stdout:(3/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 9.1 MB/s | 1.4 MB 00:00 2024-09-13T21:29:22.743 INFO:teuthology.orchestra.run.smithi088.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.0 MB/s | 240 kB 00:00 2024-09-13T21:29:22.828 INFO:teuthology.orchestra.run.smithi088.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-13T21:29:23.044 INFO:teuthology.orchestra.run.smithi088.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 47 MB/s | 18 MB 00:00 2024-09-13T21:29:23.107 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 66 MB/s | 40 MB 00:00 2024-09-13T21:29:23.109 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:23.109 INFO:teuthology.orchestra.run.smithi116.stdout:Total 47 MB/s | 40 MB 00:00 2024-09-13T21:29:23.137 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:29:23.152 INFO:teuthology.orchestra.run.smithi088.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 619 kB/s | 253 kB 00:00 2024-09-13T21:29:23.156 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:29:23.157 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:29:23.203 INFO:teuthology.orchestra.run.smithi088.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 673 kB/s | 106 kB 00:00 2024-09-13T21:29:23.228 INFO:teuthology.orchestra.run.smithi088.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-13T21:29:23.279 INFO:teuthology.orchestra.run.smithi088.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-09-13T21:29:23.312 INFO:teuthology.orchestra.run.smithi088.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-13T21:29:23.379 INFO:teuthology.orchestra.run.smithi088.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 2.2 MB/s | 1.2 MB 00:00 2024-09-13T21:29:23.404 INFO:teuthology.orchestra.run.smithi088.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-09-13T21:29:23.429 INFO:teuthology.orchestra.run.smithi088.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-13T21:29:23.463 INFO:teuthology.orchestra.run.smithi088.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-13T21:29:23.488 INFO:teuthology.orchestra.run.smithi088.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 467 kB/s | 51 kB 00:00 2024-09-13T21:29:23.491 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:29:23.491 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:29:23.521 INFO:teuthology.orchestra.run.smithi088.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 473 kB/s | 43 kB 00:00 2024-09-13T21:29:23.575 INFO:teuthology.orchestra.run.smithi088.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 238 kB/s | 11 kB 00:00 2024-09-13T21:29:23.606 INFO:teuthology.orchestra.run.smithi088.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-13T21:29:23.631 INFO:teuthology.orchestra.run.smithi088.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 329 kB/s | 18 kB 00:00 2024-09-13T21:29:23.657 INFO:teuthology.orchestra.run.smithi088.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-13T21:29:23.683 INFO:teuthology.orchestra.run.smithi088.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T21:29:23.708 INFO:teuthology.orchestra.run.smithi088.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-13T21:29:23.733 INFO:teuthology.orchestra.run.smithi088.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 926 kB/s | 46 kB 00:00 2024-09-13T21:29:23.757 INFO:teuthology.orchestra.run.smithi088.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T21:29:23.784 INFO:teuthology.orchestra.run.smithi088.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 657 kB/s | 16 kB 00:00 2024-09-13T21:29:23.816 INFO:teuthology.orchestra.run.smithi088.stdout:(27/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2024-09-13T21:29:23.842 INFO:teuthology.orchestra.run.smithi088.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-13T21:29:23.867 INFO:teuthology.orchestra.run.smithi088.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2024-09-13T21:29:23.892 INFO:teuthology.orchestra.run.smithi088.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-13T21:29:23.918 INFO:teuthology.orchestra.run.smithi088.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-13T21:29:23.943 INFO:teuthology.orchestra.run.smithi088.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-13T21:29:23.968 INFO:teuthology.orchestra.run.smithi088.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-13T21:29:23.969 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:29:23.973 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:23.973 INFO:teuthology.orchestra.run.smithi088.stdout:Total 19 MB/s | 30 MB 00:01 2024-09-13T21:29:24.060 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T21:29:24.096 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:29:24.115 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T21:29:24.134 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:29:24.134 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:29:24.142 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-13T21:29:24.537 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:29:24.538 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:29:25.800 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:29:25.862 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T21:29:25.902 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T21:29:25.936 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T21:29:26.028 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T21:29:26.121 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T21:29:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T21:29:26.198 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T21:29:26.228 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T21:29:26.262 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T21:29:26.296 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T21:29:26.331 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T21:29:26.366 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T21:29:26.400 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T21:29:26.438 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T21:29:26.511 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T21:29:26.651 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T21:29:26.733 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T21:29:26.791 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T21:29:26.839 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T21:29:26.895 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T21:29:26.960 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T21:29:27.146 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T21:29:27.192 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T21:29:27.270 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T21:29:27.359 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T21:29:27.399 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T21:29:27.513 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T21:29:27.683 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-13T21:29:27.718 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-13T21:29:27.742 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-13T21:29:27.742 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:27.742 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T21:29:27.742 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:29:27.742 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:29:27.743 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:27.850 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-13T21:29:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-13T21:29:29.322 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-13T21:29:29.351 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-13T21:29:29.352 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:29.352 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T21:29:29.352 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:29:29.352 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:29:29.352 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:29.806 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-13T21:29:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-13T21:29:29.833 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:29.833 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T21:29:29.833 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:29:29.833 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:29:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:29.953 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-13T21:29:29.953 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-13T21:29:29.953 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-13T21:29:29.953 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T21:29:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-13T21:29:30.064 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-13T21:29:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T21:29:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:29:30.064 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:29:30.064 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:30.128 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-13T21:29:30.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T21:29:30.266 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:30.266 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:29:30.266 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:30.266 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T21:29:30.267 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:30.267 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:29:30.544 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph 2024-09-13T21:29:31.111 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:29:31.249 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:29:31.251 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:31.251 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-13T21:29:31.251 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T21:29:31.252 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T21:29:31.253 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout:Install 33 Packages 2024-09-13T21:29:31.254 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:31.256 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 30 M 2024-09-13T21:29:31.256 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 109 M 2024-09-13T21:29:31.257 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:29:31.774 INFO:teuthology.orchestra.run.smithi116.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 104 kB/s | 6.4 kB 00:00 2024-09-13T21:29:31.833 INFO:teuthology.orchestra.run.smithi116.stdout:(2/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 17 MB/s | 2.1 MB 00:00 2024-09-13T21:29:31.875 INFO:teuthology.orchestra.run.smithi116.stdout:(3/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 8.9 MB/s | 1.4 MB 00:00 2024-09-13T21:29:31.900 INFO:teuthology.orchestra.run.smithi116.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.4 MB/s | 240 kB 00:00 2024-09-13T21:29:31.912 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-13T21:29:31.912 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-13T21:29:31.912 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T21:29:31.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T21:29:31.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T21:29:31.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T21:29:31.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T21:29:31.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T21:29:31.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T21:29:31.984 INFO:teuthology.orchestra.run.smithi116.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-13T21:29:32.201 INFO:teuthology.orchestra.run.smithi116.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 48 MB/s | 18 MB 00:00 2024-09-13T21:29:32.351 INFO:teuthology.orchestra.run.smithi116.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 562 kB/s | 253 kB 00:00 2024-09-13T21:29:32.376 INFO:teuthology.orchestra.run.smithi116.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 609 kB/s | 106 kB 00:00 2024-09-13T21:29:32.443 INFO:teuthology.orchestra.run.smithi116.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.8 MB/s | 125 kB 00:00 2024-09-13T21:29:32.469 INFO:teuthology.orchestra.run.smithi116.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 1.1 MB/s | 135 kB 00:00 2024-09-13T21:29:32.514 INFO:teuthology.orchestra.run.smithi116.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 3.0 MB/s | 215 kB 00:00 2024-09-13T21:29:32.556 INFO:teuthology.orchestra.run.smithi116.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 2.1 MB/s | 1.2 MB 00:00 2024-09-13T21:29:32.631 INFO:teuthology.orchestra.run.smithi116.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 297 kB/s | 35 kB 00:00 2024-09-13T21:29:32.657 INFO:teuthology.orchestra.run.smithi116.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 508 kB/s | 51 kB 00:00 2024-09-13T21:29:32.682 INFO:teuthology.orchestra.run.smithi116.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 809 kB/s | 172 kB 00:00 2024-09-13T21:29:32.715 INFO:teuthology.orchestra.run.smithi116.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-09-13T21:29:32.741 INFO:teuthology.orchestra.run.smithi116.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 519 kB/s | 43 kB 00:00 2024-09-13T21:29:32.766 INFO:teuthology.orchestra.run.smithi116.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 604 kB/s | 11 kB 00:00 2024-09-13T21:29:32.791 INFO:teuthology.orchestra.run.smithi116.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-13T21:29:32.808 INFO:teuthology.orchestra.run.smithi116.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 441 kB/s | 18 kB 00:00 2024-09-13T21:29:32.825 INFO:teuthology.orchestra.run.smithi116.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 691 kB/s | 23 kB 00:00 2024-09-13T21:29:32.850 INFO:teuthology.orchestra.run.smithi116.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 465 kB/s | 19 kB 00:00 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:32.859 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T21:29:32.860 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T21:29:32.861 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T21:29:32.862 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:32.862 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:29:32.876 INFO:teuthology.orchestra.run.smithi116.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-13T21:29:32.901 INFO:teuthology.orchestra.run.smithi116.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-13T21:29:32.926 INFO:teuthology.orchestra.run.smithi116.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T21:29:32.952 INFO:teuthology.orchestra.run.smithi116.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 661 kB/s | 16 kB 00:00 2024-09-13T21:29:32.977 INFO:teuthology.orchestra.run.smithi116.stdout:(27/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-13T21:29:33.010 INFO:teuthology.orchestra.run.smithi116.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-13T21:29:33.036 INFO:teuthology.orchestra.run.smithi116.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 611 kB/s | 36 kB 00:00 2024-09-13T21:29:33.061 INFO:teuthology.orchestra.run.smithi116.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-13T21:29:33.090 INFO:teuthology.orchestra.run.smithi116.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 807 kB/s | 20 kB 00:00 2024-09-13T21:29:33.111 INFO:teuthology.orchestra.run.smithi116.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-13T21:29:33.136 INFO:teuthology.orchestra.run.smithi116.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-13T21:29:33.141 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:33.142 INFO:teuthology.orchestra.run.smithi116.stdout:Total 16 MB/s | 30 MB 00:01 2024-09-13T21:29:33.203 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-base 2024-09-13T21:29:33.263 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:29:33.301 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:29:33.301 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:29:33.722 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:29:33.722 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:29:33.766 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:45 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:29:33.855 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:29:33.896 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:29:33.897 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-13T21:29:33.898 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:29:33.971 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install cephadm 2024-09-13T21:29:34.527 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:46 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:29:34.660 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:29:34.661 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:34.661 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-13T21:29:34.661 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:34.661 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:29:34.661 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-13T21:29:34.661 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:34.661 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:29:34.661 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:34.661 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-13T21:29:34.662 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:34.662 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 209 k 2024-09-13T21:29:34.662 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 200 k 2024-09-13T21:29:34.662 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:29:34.723 INFO:teuthology.orchestra.run.smithi088.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.4 MB/s | 209 kB 00:00 2024-09-13T21:29:34.723 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:34.724 INFO:teuthology.orchestra.run.smithi088.stdout:Total 3.3 MB/s | 209 kB 00:00 2024-09-13T21:29:34.724 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:29:34.728 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:29:34.729 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:29:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:29:34.731 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:29:34.799 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:29:34.976 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:29:35.040 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T21:29:35.072 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T21:29:35.113 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T21:29:35.206 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T21:29:35.234 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T21:29:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T21:29:35.318 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T21:29:35.341 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T21:29:35.384 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T21:29:35.422 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T21:29:35.465 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T21:29:35.498 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T21:29:35.539 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T21:29:35.582 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T21:29:35.617 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T21:29:35.655 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T21:29:35.712 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T21:29:35.729 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T21:29:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T21:29:35.969 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T21:29:35.969 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:35.969 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:29:35.969 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-13T21:29:35.970 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:35.970 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:29:35.981 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T21:29:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T21:29:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T21:29:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T21:29:36.186 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T21:29:36.202 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T21:29:36.398 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T21:29:36.451 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T21:29:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T21:29:36.618 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T21:29:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T21:29:36.758 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:29:36.774 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T21:29:36.894 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-13T21:29:36.895 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:36.896 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 142 k 2024-09-13T21:29:36.896 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 399 k 2024-09-13T21:29:36.896 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:29:36.937 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 3.4 MB/s | 142 kB 00:00 2024-09-13T21:29:36.937 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:36.937 INFO:teuthology.orchestra.run.smithi088.stdout:Total 3.3 MB/s | 142 kB 00:00 2024-09-13T21:29:36.937 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:29:36.945 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:29:36.945 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:29:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-13T21:29:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-13T21:29:37.001 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:29:37.001 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:29:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-13T21:29:37.002 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:37.002 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T21:29:37.002 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:29:37.002 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:29:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:37.152 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:29:37.238 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:29:37.262 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:29:37.263 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:37.263 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T21:29:37.263 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:38.168 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:29:38.168 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:38.168 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:29:38.168 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:38.168 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:38.168 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:29:38.381 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr 2024-09-13T21:29:38.520 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-13T21:29:38.550 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-13T21:29:38.550 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:38.550 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T21:29:38.550 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:29:38.550 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:29:38.551 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:38.954 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:29:39.029 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-13T21:29:39.050 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:29:39.054 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-13T21:29:39.054 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:39.054 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T21:29:39.054 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:29:39.054 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:29:39.054 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:39.093 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:29:39.094 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-13T21:29:39.095 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:29:39.183 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T21:29:39.273 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-13T21:29:39.296 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-13T21:29:39.296 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:39.296 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T21:29:39.296 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:29:39.296 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:29:39.296 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:39.387 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-13T21:29:39.745 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:29:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T21:29:39.879 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T21:29:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T21:29:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2024-09-13T21:29:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T21:29:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:29:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:Install 7 Packages 2024-09-13T21:29:39.880 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 2.0 M 2024-09-13T21:29:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 8.1 M 2024-09-13T21:29:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:29:39.998 INFO:teuthology.orchestra.run.smithi088.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 376 kB/s | 23 kB 00:00 2024-09-13T21:29:40.015 INFO:teuthology.orchestra.run.smithi088.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 187 kB/s | 15 kB 00:00 2024-09-13T21:29:40.048 INFO:teuthology.orchestra.run.smithi088.stdout:(3/7): python3-jwt-2.4.0-1.el9.noarch.rpm 1.2 MB/s | 41 kB 00:00 2024-09-13T21:29:40.065 INFO:teuthology.orchestra.run.smithi088.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-13T21:29:40.082 INFO:teuthology.orchestra.run.smithi088.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 961 kB/s | 31 kB 00:00 2024-09-13T21:29:40.108 INFO:teuthology.orchestra.run.smithi088.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-13T21:29:40.149 INFO:teuthology.orchestra.run.smithi088.stdout:(7/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 8.0 MB/s | 1.7 MB 00:00 2024-09-13T21:29:40.152 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:40.153 INFO:teuthology.orchestra.run.smithi088.stdout:Total 7.3 MB/s | 2.0 MB 00:00 2024-09-13T21:29:40.153 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:29:40.161 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:29:40.161 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:29:40.234 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:29:40.234 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:29:40.540 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:29:40.601 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T21:29:40.635 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T21:29:40.681 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T21:29:40.713 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T21:29:40.750 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-13T21:29:40.978 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-13T21:29:41.003 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-13T21:29:41.101 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-13T21:29:41.101 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-13T21:29:41.101 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T21:29:41.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T21:29:41.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T21:29:41.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T21:29:41.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T21:29:41.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T21:29:41.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T21:29:41.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T21:29:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-13T21:29:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-13T21:29:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-13T21:29:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-13T21:29:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T21:29:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T21:29:41.521 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T21:29:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:41.792 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:29:41.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T21:29:42.149 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T21:29:42.149 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:42.149 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:29:42.149 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:42.149 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T21:29:42.150 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T21:29:42.151 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T21:29:42.152 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T21:29:42.152 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T21:29:42.152 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T21:29:42.152 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T21:29:42.152 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T21:29:42.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:42.152 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:29:42.536 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-base 2024-09-13T21:29:42.559 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:29:42.691 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:29:42.692 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:42.693 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-13T21:29:42.693 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:42.693 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:29:42.693 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-13T21:29:42.693 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-13T21:29:42.693 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T21:29:42.693 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T21:29:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T21:29:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T21:29:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T21:29:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T21:29:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T21:29:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T21:29:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T21:29:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T21:29:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T21:29:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:42.695 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:29:42.695 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:29:42.695 INFO:teuthology.orchestra.run.smithi088.stdout:Install 12 Packages 2024-09-13T21:29:42.695 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:29:42.696 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 38 M 2024-09-13T21:29:42.696 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 212 M 2024-09-13T21:29:42.697 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:29:43.103 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:29:43.193 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:29:43.234 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:29:43.235 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-13T21:29:43.235 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:29:43.247 INFO:teuthology.orchestra.run.smithi088.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 51 MB/s | 7.4 MB 00:00 2024-09-13T21:29:43.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install cephadm 2024-09-13T21:29:43.364 INFO:teuthology.orchestra.run.smithi088.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-09-13T21:29:43.390 INFO:teuthology.orchestra.run.smithi088.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 662 kB/s | 191 kB 00:00 2024-09-13T21:29:43.498 INFO:teuthology.orchestra.run.smithi088.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-13T21:29:43.552 INFO:teuthology.orchestra.run.smithi088.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 112 kB/s | 18 kB 00:00 2024-09-13T21:29:43.583 INFO:teuthology.orchestra.run.smithi088.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 458 kB/s | 38 kB 00:00 2024-09-13T21:29:43.707 INFO:teuthology.orchestra.run.smithi088.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-13T21:29:43.864 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:29:43.995 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:29:43.996 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:43.996 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-13T21:29:43.996 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:43.996 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:29:43.996 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-13T21:29:43.996 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:43.997 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:29:43.997 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:43.997 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-13T21:29:43.997 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:43.997 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 209 k 2024-09-13T21:29:43.997 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 200 k 2024-09-13T21:29:43.997 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:29:44.056 INFO:teuthology.orchestra.run.smithi116.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.5 MB/s | 209 kB 00:00 2024-09-13T21:29:44.057 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:44.057 INFO:teuthology.orchestra.run.smithi116.stdout:Total 3.4 MB/s | 209 kB 00:00 2024-09-13T21:29:44.057 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:29:44.062 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:29:44.062 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:29:44.065 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:29:44.065 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:29:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:29:44.307 INFO:teuthology.orchestra.run.smithi088.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.2 MB/s | 3.0 MB 00:00 2024-09-13T21:29:44.449 INFO:teuthology.orchestra.run.smithi088.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-13T21:29:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T21:29:44.684 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T21:29:45.034 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T21:29:45.295 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T21:29:45.295 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:45.295 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:29:45.295 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-13T21:29:45.296 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:45.296 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:29:45.533 INFO:teuthology.orchestra.run.smithi088.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.5 MB/s | 4.9 MB 00:01 2024-09-13T21:29:45.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T21:29:45.609 INFO:teuthology.orchestra.run.smithi088.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.7 MB/s | 5.1 MB 00:01 2024-09-13T21:29:46.111 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:29:46.245 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-13T21:29:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:46.247 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 142 k 2024-09-13T21:29:46.247 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 399 k 2024-09-13T21:29:46.247 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:29:46.303 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.5 MB/s | 142 kB 00:00 2024-09-13T21:29:46.304 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:46.304 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.4 MB/s | 142 kB 00:00 2024-09-13T21:29:46.304 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:29:46.313 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:29:46.313 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:29:46.372 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:29:46.372 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:29:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:29:46.605 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:29:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:29:46.630 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:29:46.630 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T21:29:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:47.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:29:47.572 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:47.573 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:29:47.573 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-13T21:29:47.573 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:47.573 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:29:47.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr 2024-09-13T21:29:48.336 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:29:48.429 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:29:48.470 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:29:48.471 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-13T21:29:48.471 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:29:48.540 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T21:29:49.113 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:29:49.245 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:29:49.246 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:49.246 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-13T21:29:49.246 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:49.246 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:49.247 INFO:teuthology.orchestra.run.smithi116.stdout:Install 7 Packages 2024-09-13T21:29:49.248 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:49.248 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 2.0 M 2024-09-13T21:29:49.248 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 8.1 M 2024-09-13T21:29:49.248 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:29:49.516 INFO:teuthology.orchestra.run.smithi116.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 412 kB/s | 23 kB 00:00 2024-09-13T21:29:49.541 INFO:teuthology.orchestra.run.smithi116.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 180 kB/s | 15 kB 00:00 2024-09-13T21:29:49.583 INFO:teuthology.orchestra.run.smithi116.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-13T21:29:49.608 INFO:teuthology.orchestra.run.smithi116.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-13T21:29:49.640 INFO:teuthology.orchestra.run.smithi116.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 416 kB/s | 41 kB 00:00 2024-09-13T21:29:49.668 INFO:teuthology.orchestra.run.smithi116.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-13T21:29:49.710 INFO:teuthology.orchestra.run.smithi116.stdout:(7/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 6.8 MB/s | 1.7 MB 00:00 2024-09-13T21:29:49.713 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:49.713 INFO:teuthology.orchestra.run.smithi116.stdout:Total 4.3 MB/s | 2.0 MB 00:00 2024-09-13T21:29:49.713 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:29:49.721 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:29:49.721 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:29:49.791 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:29:49.791 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:29:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:29:50.194 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T21:29:50.228 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T21:29:50.282 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T21:29:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T21:29:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-13T21:29:50.581 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-13T21:29:50.613 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-13T21:29:51.154 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-13T21:29:51.154 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-13T21:29:51.154 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-13T21:29:51.154 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-13T21:29:51.154 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T21:29:51.154 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T21:29:51.155 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T21:29:51.414 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:51.415 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:29:51.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T21:29:51.991 INFO:teuthology.orchestra.run.smithi088.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-13T21:29:51.991 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:51.991 INFO:teuthology.orchestra.run.smithi088.stdout:Total 4.1 MB/s | 38 MB 00:09 2024-09-13T21:29:52.173 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:29:52.305 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:29:52.306 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:52.306 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-13T21:29:52.306 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:52.306 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:29:52.306 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-13T21:29:52.306 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T21:29:52.307 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:52.308 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:29:52.308 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:29:52.308 INFO:teuthology.orchestra.run.smithi116.stdout:Install 12 Packages 2024-09-13T21:29:52.308 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:29:52.308 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 38 M 2024-09-13T21:29:52.308 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 212 M 2024-09-13T21:29:52.309 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:29:52.350 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:29:52.376 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:29:52.376 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:29:52.592 INFO:teuthology.orchestra.run.smithi116.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 52 MB/s | 7.4 MB 00:00 2024-09-13T21:29:52.683 INFO:teuthology.orchestra.run.smithi116.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 358 kB/s | 33 kB 00:00 2024-09-13T21:29:52.867 INFO:teuthology.orchestra.run.smithi116.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-09-13T21:29:52.877 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:29:52.877 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:29:52.909 INFO:teuthology.orchestra.run.smithi116.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 452 kB/s | 18 kB 00:00 2024-09-13T21:29:52.951 INFO:teuthology.orchestra.run.smithi116.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 919 kB/s | 38 kB 00:00 2024-09-13T21:29:53.068 INFO:teuthology.orchestra.run.smithi116.stdout:(6/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 42 MB/s | 4.9 MB 00:00 2024-09-13T21:29:53.110 INFO:teuthology.orchestra.run.smithi116.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-13T21:29:53.219 INFO:teuthology.orchestra.run.smithi116.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 47 MB/s | 5.1 MB 00:00 2024-09-13T21:29:53.260 INFO:teuthology.orchestra.run.smithi116.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 5.9 MB/s | 250 kB 00:00 2024-09-13T21:29:53.519 INFO:teuthology.orchestra.run.smithi116.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 63 MB/s | 16 MB 00:00 2024-09-13T21:29:53.544 INFO:teuthology.orchestra.run.smithi116.stdout:(11/12): libquadmath-11.5.0-2.el9.x86_64.rpm 175 kB/s | 191 kB 00:01 2024-09-13T21:29:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:29:53.713 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T21:29:53.763 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:29:53.863 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:29:53.898 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T21:29:54.083 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T21:29:54.113 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T21:29:54.130 INFO:teuthology.orchestra.run.smithi116.stdout:(12/12): libgfortran-11.5.0-2.el9.x86_64.rpm 478 kB/s | 801 kB 00:01 2024-09-13T21:29:54.130 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:29:54.131 INFO:teuthology.orchestra.run.smithi116.stdout:Total 21 MB/s | 38 MB 00:01 2024-09-13T21:29:54.198 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T21:29:54.491 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:29:54.517 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:29:54.517 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:29:54.848 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T21:29:54.969 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T21:29:55.030 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:29:55.030 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:29:55.787 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:29:55.861 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T21:29:55.901 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:29:56.013 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:29:56.044 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T21:29:56.207 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:29:56.227 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T21:29:56.259 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T21:29:56.338 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T21:29:56.995 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T21:29:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T21:29:57.247 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T21:29:57.279 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-13T21:29:58.375 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:29:59.395 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T21:29:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-13T21:29:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-13T21:29:59.850 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:29:59.851 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T21:30:00.275 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T21:30:00.275 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:00.275 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:30:00.275 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-13T21:30:00.275 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T21:30:00.275 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T21:30:00.275 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:00.276 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:00.659 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-rook 2024-09-13T21:30:01.230 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:01.363 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:01.364 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:01.364 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-13T21:30:01.364 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:01.364 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:30:01.364 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-13T21:30:01.364 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-13T21:30:01.364 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T21:30:01.364 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T21:30:01.364 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout:Install 13 Packages 2024-09-13T21:30:01.365 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:01.366 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 2.2 M 2024-09-13T21:30:01.366 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 26 M 2024-09-13T21:30:01.366 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:30:01.887 INFO:teuthology.orchestra.run.smithi088.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-09-13T21:30:01.952 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-13T21:30:01.952 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-13T21:30:01.952 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:30:01.952 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:30:01.952 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T21:30:01.952 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T21:30:01.953 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T21:30:01.953 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T21:30:01.953 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T21:30:01.953 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T21:30:01.953 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:30:01.953 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T21:30:02.137 INFO:teuthology.orchestra.run.smithi088.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 90 kB/s | 26 kB 00:00 2024-09-13T21:30:02.154 INFO:teuthology.orchestra.run.smithi088.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 64 kB/s | 19 kB 00:00 2024-09-13T21:30:02.438 INFO:teuthology.orchestra.run.smithi088.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 403 kB/s | 222 kB 00:00 2024-09-13T21:30:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T21:30:02.438 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:02.438 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T21:30:02.439 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T21:30:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T21:30:02.440 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:02.440 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:02.505 INFO:teuthology.orchestra.run.smithi088.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 432 kB/s | 159 kB 00:00 2024-09-13T21:30:02.547 INFO:teuthology.orchestra.run.smithi088.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 493 kB/s | 54 kB 00:00 2024-09-13T21:30:02.572 INFO:teuthology.orchestra.run.smithi088.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 483 kB/s | 32 kB 00:00 2024-09-13T21:30:02.606 INFO:teuthology.orchestra.run.smithi088.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.2 MB/s | 220 kB 00:00 2024-09-13T21:30:02.631 INFO:teuthology.orchestra.run.smithi088.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 585 kB/s | 279 kB 00:00 2024-09-13T21:30:02.656 INFO:teuthology.orchestra.run.smithi088.stdout:(10/13): python3-certifi-2023.05.07-4.el9.noarc 129 kB/s | 14 kB 00:00 2024-09-13T21:30:02.690 INFO:teuthology.orchestra.run.smithi088.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.4 MB/s | 90 kB 00:00 2024-09-13T21:30:02.715 INFO:teuthology.orchestra.run.smithi088.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-09-13T21:30:02.748 INFO:teuthology.orchestra.run.smithi088.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-13T21:30:02.751 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:02.751 INFO:teuthology.orchestra.run.smithi088.stdout:Total 1.6 MB/s | 2.2 MB 00:01 2024-09-13T21:30:02.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-rook 2024-09-13T21:30:02.819 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:30:02.834 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:30:02.835 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:30:02.923 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:30:02.923 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:30:03.347 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:08 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:03.441 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:30:03.480 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:03.481 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-13T21:30:03.481 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:03.481 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:30:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-13T21:30:03.481 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T21:30:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T21:30:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T21:30:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T21:30:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:03.483 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:30:03.483 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:03.483 INFO:teuthology.orchestra.run.smithi116.stdout:Install 13 Packages 2024-09-13T21:30:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:03.484 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 2.2 M 2024-09-13T21:30:03.484 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 26 M 2024-09-13T21:30:03.484 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:30:03.608 INFO:teuthology.orchestra.run.smithi116.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 1.0 MB/s | 47 kB 00:00 2024-09-13T21:30:03.636 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T21:30:03.684 INFO:teuthology.orchestra.run.smithi116.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 157 kB/s | 19 kB 00:00 2024-09-13T21:30:03.690 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T21:30:03.709 INFO:teuthology.orchestra.run.smithi116.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 174 kB/s | 26 kB 00:00 2024-09-13T21:30:03.755 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T21:30:03.776 INFO:teuthology.orchestra.run.smithi116.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-09-13T21:30:03.792 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T21:30:03.801 INFO:teuthology.orchestra.run.smithi116.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-13T21:30:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T21:30:03.843 INFO:teuthology.orchestra.run.smithi116.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.0 MB/s | 279 kB 00:00 2024-09-13T21:30:03.868 INFO:teuthology.orchestra.run.smithi116.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 583 kB/s | 54 kB 00:00 2024-09-13T21:30:03.902 INFO:teuthology.orchestra.run.smithi116.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-13T21:30:03.934 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T21:30:03.935 INFO:teuthology.orchestra.run.smithi116.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-13T21:30:03.961 INFO:teuthology.orchestra.run.smithi116.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.5 MB/s | 220 kB 00:00 2024-09-13T21:30:03.986 INFO:teuthology.orchestra.run.smithi116.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-13T21:30:04.011 INFO:teuthology.orchestra.run.smithi116.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-13T21:30:04.035 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T21:30:04.053 INFO:teuthology.orchestra.run.smithi116.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-13T21:30:04.056 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:04.056 INFO:teuthology.orchestra.run.smithi116.stdout:Total 3.9 MB/s | 2.2 MB 00:00 2024-09-13T21:30:04.093 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T21:30:04.119 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:30:04.133 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:30:04.134 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:30:04.219 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:30:04.221 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:30:04.721 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:30:04.796 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T21:30:04.849 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T21:30:04.884 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T21:30:04.890 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T21:30:04.928 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T21:30:04.945 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T21:30:04.952 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-13T21:30:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T21:30:05.039 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T21:30:05.080 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T21:30:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T21:30:05.283 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T21:30:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T21:30:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-13T21:30:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T21:30:05.733 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T21:30:06.052 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T21:30:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T21:30:06.079 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:06.079 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T21:30:06.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T21:30:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T21:30:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T21:30:06.081 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:06.081 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:06.104 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T21:30:06.138 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T21:30:06.192 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T21:30:06.216 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-13T21:30:06.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T21:30:06.884 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:06.964 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-13T21:30:06.964 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-13T21:30:06.964 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T21:30:06.964 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T21:30:06.964 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T21:30:06.965 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T21:30:06.965 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T21:30:06.965 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T21:30:06.965 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T21:30:06.965 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T21:30:06.965 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T21:30:06.965 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T21:30:06.965 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T21:30:07.017 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:07.018 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:07.018 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-13T21:30:07.018 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:07.019 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:30:07.019 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-13T21:30:07.019 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-13T21:30:07.019 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T21:30:07.019 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T21:30:07.019 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T21:30:07.020 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T21:30:07.020 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T21:30:07.020 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:07.020 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:30:07.020 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:07.020 INFO:teuthology.orchestra.run.smithi088.stdout:Install 6 Packages 2024-09-13T21:30:07.020 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:07.021 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 7.0 M 2024-09-13T21:30:07.021 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 33 M 2024-09-13T21:30:07.021 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:30:07.313 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T21:30:07.313 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:07.313 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:30:07.313 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-13T21:30:07.313 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T21:30:07.313 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T21:30:07.313 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:07.314 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:07.432 INFO:teuthology.orchestra.run.smithi088.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 2.2 MB/s | 127 kB 00:00 2024-09-13T21:30:07.483 INFO:teuthology.orchestra.run.smithi088.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-13T21:30:07.509 INFO:teuthology.orchestra.run.smithi088.stdout:(3/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-13T21:30:07.531 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T21:30:07.534 INFO:teuthology.orchestra.run.smithi088.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T21:30:07.567 INFO:teuthology.orchestra.run.smithi088.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-13T21:30:08.107 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:08.247 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:08.247 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T21:30:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T21:30:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:08.249 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:30:08.249 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:08.249 INFO:teuthology.orchestra.run.smithi116.stdout:Install 6 Packages 2024-09-13T21:30:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:08.249 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 7.0 M 2024-09-13T21:30:08.250 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 33 M 2024-09-13T21:30:08.250 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:30:08.400 INFO:teuthology.orchestra.run.smithi088.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.8 MB/s | 6.0 MB 00:01 2024-09-13T21:30:08.403 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:08.403 INFO:teuthology.orchestra.run.smithi088.stdout:Total 5.1 MB/s | 7.0 MB 00:01 2024-09-13T21:30:08.447 INFO:teuthology.orchestra.run.smithi116.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 2.4 MB/s | 127 kB 00:00 2024-09-13T21:30:08.476 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:30:08.487 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:30:08.487 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:30:08.506 INFO:teuthology.orchestra.run.smithi116.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-13T21:30:08.531 INFO:teuthology.orchestra.run.smithi116.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-13T21:30:08.581 INFO:teuthology.orchestra.run.smithi116.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-13T21:30:08.586 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:30:08.587 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:30:08.606 INFO:teuthology.orchestra.run.smithi116.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-13T21:30:08.857 INFO:teuthology.orchestra.run.smithi116.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-13T21:30:08.858 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:08.859 INFO:teuthology.orchestra.run.smithi116.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-13T21:30:08.894 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:30:08.930 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:30:08.941 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:30:08.941 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:30:09.043 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:30:09.044 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:30:09.083 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T21:30:09.127 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T21:30:09.344 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:30:09.525 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T21:30:09.583 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T21:30:09.648 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T21:30:09.747 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T21:30:09.814 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T21:30:09.839 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-13T21:30:10.107 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T21:30:10.186 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T21:30:10.253 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T21:30:10.287 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-13T21:30:10.607 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-13T21:30:10.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-13T21:30:10.607 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T21:30:10.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T21:30:10.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T21:30:10.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:10.885 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:11.101 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-13T21:30:11.101 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-13T21:30:11.101 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T21:30:11.101 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T21:30:11.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T21:30:11.102 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T21:30:11.128 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-fuse 2024-09-13T21:30:11.387 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T21:30:11.387 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:11.387 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:30:11.387 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-13T21:30:11.387 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T21:30:11.387 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T21:30:11.387 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T21:30:11.387 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T21:30:11.388 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T21:30:11.388 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:11.388 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:11.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-fuse 2024-09-13T21:30:11.686 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:23 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:11.818 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout:Install 2 Packages 2024-09-13T21:30:11.819 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:11.820 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 914 k 2024-09-13T21:30:11.820 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 2.7 M 2024-09-13T21:30:11.820 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:30:11.935 INFO:teuthology.orchestra.run.smithi088.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 12 MB/s | 835 kB 00:00 2024-09-13T21:30:12.010 INFO:teuthology.orchestra.run.smithi088.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 569 kB/s | 80 kB 00:00 2024-09-13T21:30:12.010 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:12.011 INFO:teuthology.orchestra.run.smithi088.stdout:Total 4.7 MB/s | 914 kB 00:00 2024-09-13T21:30:12.022 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:30:12.043 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:30:12.043 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:30:12.125 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:30:12.126 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:30:12.210 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:12.315 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:30:12.343 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:12.344 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:12.344 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:12.344 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:12.344 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:30:12.344 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-13T21:30:12.344 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T21:30:12.344 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T21:30:12.344 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:12.344 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:30:12.345 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:12.345 INFO:teuthology.orchestra.run.smithi116.stdout:Install 2 Packages 2024-09-13T21:30:12.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:12.345 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 914 k 2024-09-13T21:30:12.345 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 2.7 M 2024-09-13T21:30:12.345 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:30:12.450 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T21:30:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 11 MB/s | 835 kB 00:00 2024-09-13T21:30:12.518 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-13T21:30:12.559 INFO:teuthology.orchestra.run.smithi116.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 488 kB/s | 80 kB 00:00 2024-09-13T21:30:12.560 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:12.560 INFO:teuthology.orchestra.run.smithi116.stdout:Total 4.2 MB/s | 914 kB 00:00 2024-09-13T21:30:12.571 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:30:12.593 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:30:12.593 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:30:12.677 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:30:12.677 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:30:12.882 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:30:13.018 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T21:30:13.091 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-13T21:30:13.192 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-13T21:30:13.193 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-13T21:30:13.444 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T21:30:13.444 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:13.444 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:30:13.444 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T21:30:13.444 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:13.444 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:13.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados-devel 2024-09-13T21:30:13.797 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-13T21:30:13.797 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-13T21:30:14.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T21:30:14.078 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:14.078 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:30:14.078 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T21:30:14.078 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:14.079 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:14.320 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:14.349 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados-devel 2024-09-13T21:30:14.458 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:14.459 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:14.459 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:14.459 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:14.459 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:30:14.459 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-13T21:30:14.459 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:14.459 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:30:14.460 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:14.460 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-13T21:30:14.460 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:14.460 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 126 k 2024-09-13T21:30:14.460 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 456 k 2024-09-13T21:30:14.460 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:30:14.516 INFO:teuthology.orchestra.run.smithi088.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.3 MB/s | 126 kB 00:00 2024-09-13T21:30:14.516 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:14.516 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.2 MB/s | 126 kB 00:00 2024-09-13T21:30:14.516 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:30:14.521 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:30:14.521 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:30:14.585 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:30:14.585 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:30:14.735 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:30:14.836 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:14.927 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:19 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:15.063 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:15.063 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:15.063 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:15.063 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:15.063 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:30:15.064 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-13T21:30:15.064 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:15.064 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:30:15.064 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:15.064 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-13T21:30:15.064 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:15.064 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 126 k 2024-09-13T21:30:15.065 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 456 k 2024-09-13T21:30:15.065 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:30:15.118 INFO:teuthology.orchestra.run.smithi116.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.5 MB/s | 126 kB 00:00 2024-09-13T21:30:15.118 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:15.118 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.4 MB/s | 126 kB 00:00 2024-09-13T21:30:15.118 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:30:15.120 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:30:15.121 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:30:15.183 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:30:15.183 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:30:15.261 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:15.335 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:30:15.435 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:15.509 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:15.509 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:15.509 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:30:15.509 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:15.510 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:15.510 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:15.757 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs2 2024-09-13T21:30:15.904 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:16.162 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:30:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:16.162 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:16.162 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:16.329 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:16.397 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs2 2024-09-13T21:30:16.420 INFO:teuthology.orchestra.run.smithi088.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:16.466 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:16.467 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-13T21:30:16.467 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:16.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs-devel 2024-09-13T21:30:16.979 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:21 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:17.070 INFO:teuthology.orchestra.run.smithi116.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:17.101 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:17.113 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:17.114 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-13T21:30:17.114 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:17.197 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs-devel 2024-09-13T21:30:17.236 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:17.237 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:17.237 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:17.237 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:17.237 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:30:17.237 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-13T21:30:17.238 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:17.238 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:30:17.238 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:17.238 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-13T21:30:17.238 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:17.238 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 30 k 2024-09-13T21:30:17.238 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 137 k 2024-09-13T21:30:17.238 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:30:17.292 INFO:teuthology.orchestra.run.smithi088.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 565 kB/s | 30 kB 00:00 2024-09-13T21:30:17.293 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:17.293 INFO:teuthology.orchestra.run.smithi088.stdout:Total 552 kB/s | 30 kB 00:00 2024-09-13T21:30:17.293 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:30:17.296 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:30:17.296 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:30:17.319 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:30:17.319 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:30:17.399 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:30:17.505 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:17.763 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:22 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:17.880 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:17.897 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:17.898 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:17.898 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:17.898 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:17.898 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:30:17.898 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-13T21:30:17.898 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:17.899 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:30:17.899 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:17.899 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-13T21:30:17.899 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:17.899 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 30 k 2024-09-13T21:30:17.899 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 137 k 2024-09-13T21:30:17.899 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:30:17.951 INFO:teuthology.orchestra.run.smithi116.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 593 kB/s | 30 kB 00:00 2024-09-13T21:30:17.951 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:17.951 INFO:teuthology.orchestra.run.smithi116.stdout:Total 578 kB/s | 30 kB 00:00 2024-09-13T21:30:17.951 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:30:17.955 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:30:17.955 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:30:17.975 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:30:17.975 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:30:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:30:18.117 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:18.118 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:18.118 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:30:18.118 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:18.118 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:18.118 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:18.172 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:18.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados2 2024-09-13T21:30:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:18.735 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:18.736 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:18.736 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:30:18.736 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:18.736 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:18.736 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:18.861 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:18.905 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados2 2024-09-13T21:30:18.950 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:18.992 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:18.993 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-13T21:30:18.993 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:19.062 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librbd1 2024-09-13T21:30:19.483 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:19.573 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:19.615 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:19.616 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-13T21:30:19.616 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:19.630 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:19.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librbd1 2024-09-13T21:30:19.720 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:19.762 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:19.763 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-13T21:30:19.763 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:19.831 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rados 2024-09-13T21:30:20.247 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:25 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:20.337 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:20.380 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:20.381 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-13T21:30:20.381 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:20.398 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:20.459 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rados 2024-09-13T21:30:20.488 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:20.530 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-13T21:30:20.531 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:20.601 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rgw 2024-09-13T21:30:21.019 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:21.107 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:21.149 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:21.150 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-13T21:30:21.150 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:21.163 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:21.222 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rgw 2024-09-13T21:30:21.253 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-13T21:30:21.297 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:21.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-cephfs 2024-09-13T21:30:21.781 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:21.872 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:21.914 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:21.915 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-13T21:30:21.915 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:21.930 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:21.988 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-cephfs 2024-09-13T21:30:22.020 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-13T21:30:22.063 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:22.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rbd 2024-09-13T21:30:22.545 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:22.636 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:22.679 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:22.680 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-13T21:30:22.680 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:22.700 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:22.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rbd 2024-09-13T21:30:22.790 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:22.832 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:22.833 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-09-13T21:30:22.833 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:22.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-fuse 2024-09-13T21:30:23.319 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:23.410 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T21:30:23.454 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:23.454 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-13T21:30:23.455 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:23.462 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:23.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-fuse 2024-09-13T21:30:23.594 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:23.595 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:23.595 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:23.595 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:30:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-13T21:30:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:23.595 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:30:23.595 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:23.596 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-13T21:30:23.596 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:23.596 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 86 k 2024-09-13T21:30:23.596 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 230 k 2024-09-13T21:30:23.596 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:30:23.673 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-09-13T21:30:23.673 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:23.673 INFO:teuthology.orchestra.run.smithi088.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-09-13T21:30:23.674 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:30:23.680 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:30:23.680 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:30:23.742 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:30:23.742 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:30:23.886 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:30:24.000 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:24.083 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:24.215 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:24.216 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:24.216 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:24.216 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:24.216 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:30:24.216 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-13T21:30:24.216 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:24.216 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:30:24.217 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:24.217 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-13T21:30:24.217 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:24.217 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 86 k 2024-09-13T21:30:24.217 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 230 k 2024-09-13T21:30:24.217 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:30:24.270 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.6 MB/s | 86 kB 00:00 2024-09-13T21:30:24.271 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:24.271 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.5 MB/s | 86 kB 00:00 2024-09-13T21:30:24.271 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:30:24.278 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:30:24.278 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:30:24.340 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:30:24.340 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:30:24.394 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:24.486 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:30:24.591 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:24.641 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:24.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:24.641 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:30:24.641 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:24.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:24.641 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:24.907 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-mirror 2024-09-13T21:30:24.990 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:25.252 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:30:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:25.252 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:25.252 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:25.445 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-mirror 2024-09-13T21:30:25.486 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:25.623 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:25.623 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:25.623 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:25.624 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:30:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-13T21:30:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:25.624 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:30:25.624 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:25.624 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-13T21:30:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:25.625 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 3.0 M 2024-09-13T21:30:25.625 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 12 M 2024-09-13T21:30:25.625 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:30:25.714 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 33 MB/s | 3.0 MB 00:00 2024-09-13T21:30:25.715 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:25.715 INFO:teuthology.orchestra.run.smithi088.stdout:Total 33 MB/s | 3.0 MB 00:00 2024-09-13T21:30:25.715 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:30:25.724 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:30:25.724 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:30:25.806 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:30:25.807 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:30:26.022 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:26.159 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:26.159 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:26.159 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:26.159 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:30:26.160 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-13T21:30:26.160 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:26.160 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:30:26.160 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:26.160 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-13T21:30:26.160 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:26.160 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 3.0 M 2024-09-13T21:30:26.160 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 12 M 2024-09-13T21:30:26.160 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:30:26.226 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:30:26.257 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 31 MB/s | 3.0 MB 00:00 2024-09-13T21:30:26.258 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:26.258 INFO:teuthology.orchestra.run.smithi116.stdout:Total 30 MB/s | 3.0 MB 00:00 2024-09-13T21:30:26.258 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:30:26.267 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:30:26.267 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:30:26.306 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:26.332 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:26.332 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:30:26.332 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T21:30:26.332 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:30:26.332 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:30:26.332 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:26.347 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:30:26.347 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:30:26.759 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:30:26.841 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:26.867 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:30:26.867 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T21:30:26.867 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:30:26.867 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:30:26.867 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:27.381 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:27.381 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:27.381 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:30:27.381 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:27.381 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:27.381 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:27.658 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-nbd 2024-09-13T21:30:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:27.970 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:30:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:27.970 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:28.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-nbd 2024-09-13T21:30:28.231 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 09:28:48 PM UTC. 2024-09-13T21:30:28.372 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-13T21:30:28.373 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:28.373 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:28.373 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 169 k 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 490 k 2024-09-13T21:30:28.374 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-13T21:30:28.417 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 3.8 MB/s | 169 kB 00:00 2024-09-13T21:30:28.418 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:28.418 INFO:teuthology.orchestra.run.smithi088.stdout:Total 3.7 MB/s | 169 kB 00:00 2024-09-13T21:30:28.418 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-13T21:30:28.426 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-13T21:30:28.426 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-13T21:30:28.489 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-13T21:30:28.490 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-13T21:30:28.660 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-13T21:30:28.758 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:28.802 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 09:28:55 PM UTC. 2024-09-13T21:30:28.934 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T21:30:28.935 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:28.935 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-13T21:30:28.935 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:28.935 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T21:30:28.935 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-13T21:30:28.936 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:28.936 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T21:30:28.936 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-13T21:30:28.936 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-13T21:30:28.936 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:28.936 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 169 k 2024-09-13T21:30:28.936 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 490 k 2024-09-13T21:30:28.936 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T21:30:28.978 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 4.0 MB/s | 169 kB 00:00 2024-09-13T21:30:28.978 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:28.978 INFO:teuthology.orchestra.run.smithi116.stdout:Total 3.9 MB/s | 169 kB 00:00 2024-09-13T21:30:28.979 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T21:30:28.986 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T21:30:28.986 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T21:30:29.050 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T21:30:29.050 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T21:30:29.186 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:29.204 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T21:30:29.300 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:29.467 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:29.467 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:29.467 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-13T21:30:29.467 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:29.467 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:29.467 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-13T21:30:29.738 DEBUG:teuthology.parallel:result is None 2024-09-13T21:30:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T21:30:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:30.017 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T21:30:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-13T21:30:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:30:30.018 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T21:30:30.258 DEBUG:teuthology.parallel:result is None 2024-09-13T21:30:30.259 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T21:30:30.259 INFO:teuthology.packaging:ref: None 2024-09-13T21:30:30.259 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T21:30:30.259 INFO:teuthology.packaging:branch: None 2024-09-13T21:30:30.259 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:30:30.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T21:30:30.418 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T21:30:30.440 INFO:teuthology.orchestra.run.smithi088.stdout:18.2.0-0.el9 2024-09-13T21:30:30.441 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-13T21:30:30.441 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-13T21:30:30.443 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T21:30:30.443 INFO:teuthology.packaging:ref: None 2024-09-13T21:30:30.443 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T21:30:30.443 INFO:teuthology.packaging:branch: None 2024-09-13T21:30:30.443 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:30:30.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T21:30:30.597 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T21:30:30.623 INFO:teuthology.orchestra.run.smithi116.stdout:18.2.0-0.el9 2024-09-13T21:30:30.623 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-13T21:30:30.623 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-13T21:30:30.627 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T21:30:30.628 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:30:30.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T21:30:30.664 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:30:30.664 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T21:30:30.696 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T21:30:30.696 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:30:30.696 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T21:30:30.734 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T21:30:30.800 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:30:30.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T21:30:30.829 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T21:30:30.897 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T21:30:30.897 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:30:30.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T21:30:30.924 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T21:30:30.989 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:30:30.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T21:30:31.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T21:30:31.094 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T21:30:31.094 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:30:31.094 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T21:30:31.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T21:30:31.184 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:30:31.184 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T21:30:31.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T21:30:31.277 INFO:teuthology.run_tasks:Running task print... 2024-09-13T21:30:31.286 INFO:teuthology.task.print:**** done install task... 2024-09-13T21:30:31.286 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T21:30:31.494 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T21:30:31.495 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-09-13T21:30:31.495 INFO:tasks.cephadm:Cluster fsid is 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:30:31.496 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T21:30:31.496 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T21:30:31.496 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi088': '172.21.15.88', 'mon.smithi116': '172.21.15.116'} 2024-09-13T21:30:31.496 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T21:30:31.496 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname $(hostname -s) 2024-09-13T21:30:31.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname $(hostname -s) 2024-09-13T21:30:31.549 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-13T21:30:31.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:30:31.698 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56074/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-324-gecab7be5', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-324.gecab7be5'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-13 18:01:03.383540', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-13T21:30:31.932 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref reef, sha1 e4e227b37858f5109138494e01e5ba1ba7b8ffe8 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-13T21:30:31.934 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm 2024-09-13T21:30:31.934 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm 2024-09-13T21:30:31.936 DEBUG:teuthology.orchestra.run.smithi088:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T21:30:32.291 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 21:30 /home/ubuntu/cephtest/cephadm 2024-09-13T21:30:32.291 DEBUG:teuthology.orchestra.run.smithi116:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T21:30:32.629 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 21:30 /home/ubuntu/cephtest/cephadm 2024-09-13T21:30:32.629 DEBUG:teuthology.orchestra.run.smithi088:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T21:30:32.649 DEBUG:teuthology.orchestra.run.smithi116:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T21:30:32.681 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-09-13T21:30:32.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-13T21:30:32.692 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-13T21:30:34.234 INFO:teuthology.orchestra.run.smithi116.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-13T21:30:34.238 INFO:teuthology.orchestra.run.smithi088.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-13T21:30:46.380 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:30:46.381 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-13T21:30:46.381 INFO:teuthology.orchestra.run.smithi088.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-13T21:30:46.381 INFO:teuthology.orchestra.run.smithi088.stdout: "repo_digests": [ 2024-09-13T21:30:46.381 INFO:teuthology.orchestra.run.smithi088.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-13T21:30:46.381 INFO:teuthology.orchestra.run.smithi088.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-13T21:30:46.381 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T21:30:46.381 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:30:46.774 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-13T21:30:46.774 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-13T21:30:46.774 INFO:teuthology.orchestra.run.smithi116.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-13T21:30:46.774 INFO:teuthology.orchestra.run.smithi116.stdout: "repo_digests": [ 2024-09-13T21:30:46.774 INFO:teuthology.orchestra.run.smithi116.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-13T21:30:46.774 INFO:teuthology.orchestra.run.smithi116.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-13T21:30:46.774 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-13T21:30:46.774 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-13T21:30:46.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph 2024-09-13T21:30:46.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph 2024-09-13T21:30:46.849 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /etc/ceph 2024-09-13T21:30:46.887 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /etc/ceph 2024-09-13T21:30:46.913 INFO:tasks.cephadm:Writing seed config... 2024-09-13T21:30:46.914 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T21:30:46.915 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T21:30:46.916 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T21:30:46.917 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T21:30:46.918 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:30:46.918 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T21:30:46.944 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 67511300-7217-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T21:30:46.945 DEBUG:teuthology.orchestra.run.smithi088:mon.smithi088> sudo journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088.service 2024-09-13T21:30:46.987 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T21:30:46.987 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid 67511300-7217-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.88 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:30:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:30:47.142 INFO:teuthology.orchestra.run.smithi088.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', '67511300-7217-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.88', '--skip-admin-label'] 2024-09-13T21:30:47.164 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 5.2.2 2024-09-13T21:30:47.164 INFO:teuthology.orchestra.run.smithi088.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T21:30:47.164 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying podman|docker is present... 2024-09-13T21:30:47.186 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 5.2.2 2024-09-13T21:30:47.187 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying lvm2 is present... 2024-09-13T21:30:47.187 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying time synchronization is in place... 2024-09-13T21:30:47.194 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T21:30:47.194 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T21:30:47.200 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T21:30:47.200 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-13T21:30:47.207 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout enabled 2024-09-13T21:30:47.213 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout active 2024-09-13T21:30:47.213 INFO:teuthology.orchestra.run.smithi088.stdout:Unit chronyd.service is enabled and running 2024-09-13T21:30:47.213 INFO:teuthology.orchestra.run.smithi088.stdout:Repeating the final host check... 2024-09-13T21:30:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 5.2.2 2024-09-13T21:30:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T21:30:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl is present 2024-09-13T21:30:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:lvcreate is present 2024-09-13T21:30:47.242 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T21:30:47.242 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T21:30:47.248 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T21:30:47.248 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-13T21:30:47.254 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout enabled 2024-09-13T21:30:47.261 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout active 2024-09-13T21:30:47.261 INFO:teuthology.orchestra.run.smithi088.stdout:Unit chronyd.service is enabled and running 2024-09-13T21:30:47.261 INFO:teuthology.orchestra.run.smithi088.stdout:Host looks OK 2024-09-13T21:30:47.261 INFO:teuthology.orchestra.run.smithi088.stdout:Cluster fsid: 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:30:47.261 INFO:teuthology.orchestra.run.smithi088.stdout:Acquiring lock 139986471974224 on /run/cephadm/67511300-7217-11ef-bceb-c7b262605968.lock 2024-09-13T21:30:47.262 INFO:teuthology.orchestra.run.smithi088.stdout:Lock 139986471974224 acquired on /run/cephadm/67511300-7217-11ef-bceb-c7b262605968.lock 2024-09-13T21:30:47.262 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying IP 172.21.15.88 port 3300 ... 2024-09-13T21:30:47.262 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying IP 172.21.15.88 port 6789 ... 2024-09-13T21:30:47.262 INFO:teuthology.orchestra.run.smithi088.stdout:Base mon IP(s) is [172.21.15.88:3300, 172.21.15.88:6789], mon addrv is [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2024-09-13T21:30:47.265 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.88 metric 100 2024-09-13T21:30:47.265 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.88 metric 100 2024-09-13T21:30:47.268 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T21:30:47.268 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T21:30:47.268 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T21:30:47.271 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T21:30:47.271 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T21:30:47.271 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T21:30:47.271 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T21:30:47.271 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link noprefixroute 2024-09-13T21:30:47.271 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T21:30:47.271 INFO:teuthology.orchestra.run.smithi088.stdout:Mon IP `172.21.15.88` is in CIDR network `172.21.0.0/20` 2024-09-13T21:30:47.271 INFO:teuthology.orchestra.run.smithi088.stdout:Mon IP `172.21.15.88` is in CIDR network `172.21.0.0/20` 2024-09-13T21:30:47.271 INFO:teuthology.orchestra.run.smithi088.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T21:30:47.272 INFO:teuthology.orchestra.run.smithi088.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T21:30:47.272 INFO:teuthology.orchestra.run.smithi088.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-13T21:30:48.101 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-13T21:30:48.101 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-09-13T21:30:48.101 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T21:30:48.101 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-09-13T21:30:48.101 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-09-13T21:30:48.101 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-13T21:30:48.101 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T21:30:49.072 INFO:teuthology.orchestra.run.smithi088.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-13T21:30:49.072 INFO:teuthology.orchestra.run.smithi088.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-13T21:30:49.072 INFO:teuthology.orchestra.run.smithi088.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T21:30:50.036 INFO:teuthology.orchestra.run.smithi088.stdout:stat: stdout 167 167 2024-09-13T21:30:50.037 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial keys... 2024-09-13T21:30:50.959 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQAKr+RmhYuiFxAAPXAcJoDLnDOJ4O6Nj1k4BA== 2024-09-13T21:30:52.024 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQALr+RmZleDEhAAFsmuOB+CCAp8VO9U4BOgwQ== 2024-09-13T21:30:53.138 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQAMr+RmInFdGBAAz+xk8qM5EDJ9jENiAkRbPg== 2024-09-13T21:30:53.139 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial monmap... 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool for smithi088 [v2:172.21.15.88:3300,v1:172.21.15.88:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = pacific 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: set fsid to 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:30:54.070 INFO:teuthology.orchestra.run.smithi088.stdout:Creating mon... 2024-09-13T21:30:56.132 INFO:teuthology.orchestra.run.smithi088.stdout:create mon.smithi088 on 2024-09-13T21:30:56.525 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T21:30:56.768 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T21:30:57.425 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-67511300-7217-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-67511300-7217-11ef-bceb-c7b262605968.target. 2024-09-13T21:30:57.426 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-67511300-7217-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-67511300-7217-11ef-bceb-c7b262605968.target. 2024-09-13T21:30:58.443 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088 2024-09-13T21:30:58.443 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to reset failed state of unit ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088.service: Unit ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088.service not loaded. 2024-09-13T21:30:58.777 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-67511300-7217-11ef-bceb-c7b262605968.target.wants/ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088.service → /etc/systemd/system/ceph-67511300-7217-11ef-bceb-c7b262605968@.service. 2024-09-13T21:30:59.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:30:59 smithi088 podman[27562]: 2024-09-13 21:30:58.913496437 +0000 UTC m=+0.016343631 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-09-13T21:31:00.038 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:30:59 smithi088 podman[27562]: 2024-09-13 21:30:59.979128026 +0000 UTC m=+1.081975208 container create 96c3461d499ee376785dadc5d10c48a60372872969390f817513650ca0d490ce (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T21:31:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:01 smithi088 podman[27562]: 2024-09-13 21:31:01.877542133 +0000 UTC m=+2.980389313 container init 96c3461d499ee376785dadc5d10c48a60372872969390f817513650ca0d490ce (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-13T21:31:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:01 smithi088 podman[27562]: 2024-09-13 21:31:01.882121397 +0000 UTC m=+2.984968578 container start 96c3461d499ee376785dadc5d10c48a60372872969390f817513650ca0d490ce (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212) 2024-09-13T21:31:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:01 smithi088 ceph-mon[27593]: mkfs 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:31:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:01 smithi088 ceph-mon[27593]: mon.smithi088 is new leader, mons smithi088 in quorum (ranks 0) 2024-09-13T21:31:02.863 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:31:02.863 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2024-09-13T21:31:02.871 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:31:02.871 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-13T21:31:02.872 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2024-09-13T21:31:02.872 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T21:31:02.872 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mon to start... 2024-09-13T21:31:02.872 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mon... 2024-09-13T21:31:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:02 smithi088 bash[27562]: 96c3461d499ee376785dadc5d10c48a60372872969390f817513650ca0d490ce 2024-09-13T21:31:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:02 smithi088 systemd[1]: Started Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:31:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:02 smithi088 ceph-mon[27593]: mon.smithi088 is new leader, mons smithi088 in quorum (ranks 0) 2024-09-13T21:31:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:02 smithi088 ceph-mon[27593]: monmap e1: 1 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0]} removed_ranks: {} 2024-09-13T21:31:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:02 smithi088 ceph-mon[27593]: fsmap 2024-09-13T21:31:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:02 smithi088 ceph-mon[27593]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T21:31:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:02 smithi088 ceph-mon[27593]: mgrmap e1: no daemons active 2024-09-13T21:31:06.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:06 smithi088 ceph-mon[27593]: from='client.? 172.21.15.88:0/640205944' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T21:31:06.766 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout id: 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout services: 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi088 (age 4s) 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout data: 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T21:31:06.767 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.164+0000 7fb207760700 1 Processor -- start 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.164+0000 7fb207760700 1 -- start start 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.165+0000 7fb207760700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.165+0000 7fb207760700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200108d00 con 0x7fb200079cc0 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.165+0000 7fb2054fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.165+0000 7fb2054fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001087c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41540/0 (socket says 172.21.15.88:41540) 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.165+0000 7fb2054fc700 1 -- 172.21.15.88:0/1643740326 learned_addr learned my addr 172.21.15.88:0/1643740326 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.165+0000 7fb2054fc700 1 -- 172.21.15.88:0/1643740326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200108e40 con 0x7fb200079cc0 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb2054fc700 1 --2- 172.21.15.88:0/1643740326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001087c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00098a0 tx=0x7fb1f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e546000918f381 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb1f7fff700 1 -- 172.21.15.88:0/1643740326 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1f0004180 con 0x7fb200079cc0 2024-09-13T21:31:06.768 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb1f7fff700 1 -- 172.21.15.88:0/1643740326 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f00042e0 con 0x7fb200079cc0 2024-09-13T21:31:06.769 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb1f7fff700 1 -- 172.21.15.88:0/1643740326 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1f00036a0 con 0x7fb200079cc0 2024-09-13T21:31:06.769 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb207760700 1 -- 172.21.15.88:0/1643740326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 msgr2=0x7fb2001087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:06.769 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb207760700 1 --2- 172.21.15.88:0/1643740326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001087c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00098a0 tx=0x7fb1f0009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:06.769 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb207760700 1 -- 172.21.15.88:0/1643740326 shutdown_connections 2024-09-13T21:31:06.769 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb207760700 1 --2- 172.21.15.88:0/1643740326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001087c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:06.769 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb207760700 1 -- 172.21.15.88:0/1643740326 >> 172.21.15.88:0/1643740326 conn(0x7fb200100130 msgr2=0x7fb200102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:06.769 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb207760700 1 -- 172.21.15.88:0/1643740326 shutdown_connections 2024-09-13T21:31:06.769 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.166+0000 7fb207760700 1 -- 172.21.15.88:0/1643740326 wait complete. 2024-09-13T21:31:06.769 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.167+0000 7fb207760700 1 Processor -- start 2024-09-13T21:31:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.167+0000 7fb207760700 1 -- start start 2024-09-13T21:31:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.167+0000 7fb207760700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.167+0000 7fb207760700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200199630 con 0x7fb200079cc0 2024-09-13T21:31:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.167+0000 7fb2054fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.167+0000 7fb2054fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41556/0 (socket says 172.21.15.88:41556) 2024-09-13T21:31:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.167+0000 7fb2054fc700 1 -- 172.21.15.88:0/640205944 learned_addr learned my addr 172.21.15.88:0/640205944 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.168+0000 7fb2054fc700 1 -- 172.21.15.88:0/640205944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0009550 con 0x7fb200079cc0 2024-09-13T21:31:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.168+0000 7fb2054fc700 1 --2- 172.21.15.88:0/640205944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001990f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0004000 tx=0x7fb1f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:06.770 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.168+0000 7fb1f67fc700 1 -- 172.21.15.88:0/640205944 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1f0003ce0 con 0x7fb200079cc0 2024-09-13T21:31:06.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.168+0000 7fb1f67fc700 1 -- 172.21.15.88:0/640205944 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0020070 con 0x7fb200079cc0 2024-09-13T21:31:06.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.168+0000 7fb1f67fc700 1 -- 172.21.15.88:0/640205944 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1f0011630 con 0x7fb200079cc0 2024-09-13T21:31:06.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.168+0000 7fb207760700 1 -- 172.21.15.88:0/640205944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb200199830 con 0x7fb200079cc0 2024-09-13T21:31:06.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.168+0000 7fb207760700 1 -- 172.21.15.88:0/640205944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb200199c50 con 0x7fb200079cc0 2024-09-13T21:31:06.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.168+0000 7fb1f67fc700 1 -- 172.21.15.88:0/640205944 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb1f0022030 con 0x7fb200079cc0 2024-09-13T21:31:06.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.168+0000 7fb1f67fc700 1 -- 172.21.15.88:0/640205944 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb1f0025d40 con 0x7fb200079cc0 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.169+0000 7fb207760700 1 -- 172.21.15.88:0/640205944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb200192eb0 con 0x7fb200079cc0 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.171+0000 7fb1f67fc700 1 -- 172.21.15.88:0/640205944 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb1f0025480 con 0x7fb200079cc0 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.242+0000 7fb207760700 1 -- 172.21.15.88:0/640205944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb200062380 con 0x7fb200079cc0 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.242+0000 7fb1f67fc700 1 -- 172.21.15.88:0/640205944 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+318 (secure 0 0 0) 0x7fb1f0011bd0 con 0x7fb200079cc0 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.243+0000 7fb207760700 1 -- 172.21.15.88:0/640205944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 msgr2=0x7fb2001990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.243+0000 7fb207760700 1 --2- 172.21.15.88:0/640205944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001990f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0004000 tx=0x7fb1f0004750 comp rx=0 tx=0).stop 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.243+0000 7fb207760700 1 -- 172.21.15.88:0/640205944 shutdown_connections 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.243+0000 7fb207760700 1 --2- 172.21.15.88:0/640205944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb200079cc0 0x7fb2001990f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.243+0000 7fb207760700 1 -- 172.21.15.88:0/640205944 >> 172.21.15.88:0/640205944 conn(0x7fb200100130 msgr2=0x7fb200101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.243+0000 7fb207760700 1 -- 172.21.15.88:0/640205944 shutdown_connections 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:06.243+0000 7fb207760700 1 -- 172.21.15.88:0/640205944 wait complete. 2024-09-13T21:31:06.772 INFO:teuthology.orchestra.run.smithi088.stdout:mon is available 2024-09-13T21:31:06.773 INFO:teuthology.orchestra.run.smithi088.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout fsid = 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T21:31:07.963 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.262+0000 7f613038d700 1 Processor -- start 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.262+0000 7f613038d700 1 -- start start 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.262+0000 7f613038d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f6128104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.262+0000 7f613038d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61281053d0 con 0x7f6128104a80 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.262+0000 7f612e129700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f6128104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:07.964 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.262+0000 7f612e129700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f6128104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41568/0 (socket says 172.21.15.88:41568) 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.262+0000 7f612e129700 1 -- 172.21.15.88:0/1713991678 learned_addr learned my addr 172.21.15.88:0/1713991678 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f612e129700 1 -- 172.21.15.88:0/1713991678 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6128105510 con 0x7f6128104a80 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f612e129700 1 --2- 172.21.15.88:0/1713991678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f6128104e90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f61240098a0 tx=0x7f6124009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4746397d09b8e4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f612d127700 1 -- 172.21.15.88:0/1713991678 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6124004180 con 0x7f6128104a80 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f612d127700 1 -- 172.21.15.88:0/1713991678 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61240042e0 con 0x7f6128104a80 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f612d127700 1 -- 172.21.15.88:0/1713991678 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61240036a0 con 0x7f6128104a80 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f613038d700 1 -- 172.21.15.88:0/1713991678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 msgr2=0x7f6128104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f613038d700 1 --2- 172.21.15.88:0/1713991678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f6128104e90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f61240098a0 tx=0x7f6124009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f613038d700 1 -- 172.21.15.88:0/1713991678 shutdown_connections 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f613038d700 1 --2- 172.21.15.88:0/1713991678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f6128104e90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.263+0000 7f613038d700 1 -- 172.21.15.88:0/1713991678 >> 172.21.15.88:0/1713991678 conn(0x7f61281000f0 msgr2=0x7f6128102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.264+0000 7f613038d700 1 -- 172.21.15.88:0/1713991678 shutdown_connections 2024-09-13T21:31:07.965 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.264+0000 7f613038d700 1 -- 172.21.15.88:0/1713991678 wait complete. 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.264+0000 7f613038d700 1 Processor -- start 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.264+0000 7f613038d700 1 -- start start 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.264+0000 7f613038d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f612818eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.264+0000 7f613038d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612818f090 con 0x7f6128104a80 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.264+0000 7f612e129700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f612818eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.264+0000 7f612e129700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f612818eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41578/0 (socket says 172.21.15.88:41578) 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.264+0000 7f612e129700 1 -- 172.21.15.88:0/1778072832 learned_addr learned my addr 172.21.15.88:0/1778072832 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.265+0000 7f612e129700 1 -- 172.21.15.88:0/1778072832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6124009550 con 0x7f6128104a80 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.265+0000 7f612e129700 1 --2- 172.21.15.88:0/1778072832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f612818eb50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f61281057b0 tx=0x7f6124004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.265+0000 7f611f7fe700 1 -- 172.21.15.88:0/1778072832 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6124003ce0 con 0x7f6128104a80 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.265+0000 7f611f7fe700 1 -- 172.21.15.88:0/1778072832 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6124020070 con 0x7f6128104a80 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.265+0000 7f611f7fe700 1 -- 172.21.15.88:0/1778072832 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6124011630 con 0x7f6128104a80 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.265+0000 7f613038d700 1 -- 172.21.15.88:0/1778072832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612818d1a0 con 0x7f6128104a80 2024-09-13T21:31:07.966 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.265+0000 7f613038d700 1 -- 172.21.15.88:0/1778072832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612818d5c0 con 0x7f6128104a80 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.265+0000 7f611f7fe700 1 -- 172.21.15.88:0/1778072832 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6124022030 con 0x7f6128104a80 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.265+0000 7f611f7fe700 1 -- 172.21.15.88:0/1778072832 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6124025d90 con 0x7f6128104a80 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.266+0000 7f613038d700 1 -- 172.21.15.88:0/1778072832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6128062380 con 0x7f6128104a80 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.268+0000 7f611f7fe700 1 -- 172.21.15.88:0/1778072832 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6124025480 con 0x7f6128104a80 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.335+0000 7f613038d700 1 -- 172.21.15.88:0/1778072832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f61281928c0 con 0x7f6128104a80 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.339+0000 7f611f7fe700 1 -- 172.21.15.88:0/1778072832 <== mon.0 v2:172.21.15.88:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6124011c70 con 0x7f6128104a80 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.339+0000 7f611f7fe700 1 -- 172.21.15.88:0/1778072832 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f612401c690 con 0x7f6128104a80 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.340+0000 7f613038d700 1 -- 172.21.15.88:0/1778072832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 msgr2=0x7f612818eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.340+0000 7f613038d700 1 --2- 172.21.15.88:0/1778072832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f612818eb50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f61281057b0 tx=0x7f6124004750 comp rx=0 tx=0).stop 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.340+0000 7f613038d700 1 -- 172.21.15.88:0/1778072832 shutdown_connections 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.340+0000 7f613038d700 1 --2- 172.21.15.88:0/1778072832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6128104a80 0x7f612818eb50 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.340+0000 7f613038d700 1 -- 172.21.15.88:0/1778072832 >> 172.21.15.88:0/1778072832 conn(0x7f61281000f0 msgr2=0x7f612818c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:07.967 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.340+0000 7f613038d700 1 -- 172.21.15.88:0/1778072832 shutdown_connections 2024-09-13T21:31:07.969 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:07.340+0000 7f613038d700 1 -- 172.21.15.88:0/1778072832 wait complete. 2024-09-13T21:31:07.969 INFO:teuthology.orchestra.run.smithi088.stdout:Generating new minimal ceph.conf... 2024-09-13T21:31:08.199 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:07 smithi088 ceph-mon[27593]: from='client.? 172.21.15.88:0/1778072832' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T21:31:08.199 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:07 smithi088 ceph-mon[27593]: from='client.? 172.21.15.88:0/1778072832' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T21:31:09.151 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:08 smithi088 ceph-mon[27593]: from='client.? 172.21.15.88:0/3776254608' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:31:09.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.420+0000 7f7912adb700 1 Processor -- start 2024-09-13T21:31:09.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.420+0000 7f7912adb700 1 -- start start 2024-09-13T21:31:09.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.420+0000 7f7912adb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c07a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:09.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.420+0000 7f7912adb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c07a860 con 0x7f790c07be20 2024-09-13T21:31:09.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.420+0000 7f7910877700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c07a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:09.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.420+0000 7f7910877700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c07a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41584/0 (socket says 172.21.15.88:41584) 2024-09-13T21:31:09.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.420+0000 7f7910877700 1 -- 172.21.15.88:0/424840215 learned_addr learned my addr 172.21.15.88:0/424840215 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:09.158 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.420+0000 7f7910877700 1 -- 172.21.15.88:0/424840215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c07a9a0 con 0x7f790c07be20 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f7910877700 1 --2- 172.21.15.88:0/424840215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c07a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79080098a0 tx=0x7f7908009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110c1a649f0161b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f79037fe700 1 -- 172.21.15.88:0/424840215 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7908004180 con 0x7f790c07be20 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f79037fe700 1 -- 172.21.15.88:0/424840215 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f79080042e0 con 0x7f790c07be20 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f79037fe700 1 -- 172.21.15.88:0/424840215 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7908011a50 con 0x7f790c07be20 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f7912adb700 1 -- 172.21.15.88:0/424840215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 msgr2=0x7f790c07a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f7912adb700 1 --2- 172.21.15.88:0/424840215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c07a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79080098a0 tx=0x7f7908009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f7912adb700 1 -- 172.21.15.88:0/424840215 shutdown_connections 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f7912adb700 1 --2- 172.21.15.88:0/424840215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c07a320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f7912adb700 1 -- 172.21.15.88:0/424840215 >> 172.21.15.88:0/424840215 conn(0x7f790c101220 msgr2=0x7f790c103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f7912adb700 1 -- 172.21.15.88:0/424840215 shutdown_connections 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.421+0000 7f7912adb700 1 -- 172.21.15.88:0/424840215 wait complete. 2024-09-13T21:31:09.159 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.422+0000 7f7912adb700 1 Processor -- start 2024-09-13T21:31:09.160 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.422+0000 7f7912adb700 1 -- start start 2024-09-13T21:31:09.160 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.422+0000 7f7912adb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:09.160 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.422+0000 7f7912adb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c19c030 con 0x7f790c07be20 2024-09-13T21:31:09.160 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.422+0000 7f7910877700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:09.160 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.422+0000 7f7910877700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c19baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41592/0 (socket says 172.21.15.88:41592) 2024-09-13T21:31:09.160 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.422+0000 7f7910877700 1 -- 172.21.15.88:0/3776254608 learned_addr learned my addr 172.21.15.88:0/3776254608 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:09.160 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.422+0000 7f7910877700 1 -- 172.21.15.88:0/3776254608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908009550 con 0x7f790c07be20 2024-09-13T21:31:09.160 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.423+0000 7f7910877700 1 --2- 172.21.15.88:0/3776254608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c19baf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7908006af0 tx=0x7f7908011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:09.160 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.423+0000 7f7901ffb700 1 -- 172.21.15.88:0/3776254608 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7908003b90 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.423+0000 7f7901ffb700 1 -- 172.21.15.88:0/3776254608 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f790801a8a0 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.423+0000 7f7912adb700 1 -- 172.21.15.88:0/3776254608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c19c230 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.423+0000 7f7901ffb700 1 -- 172.21.15.88:0/3776254608 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7908019880 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.423+0000 7f7912adb700 1 -- 172.21.15.88:0/3776254608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c19c650 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.423+0000 7f7901ffb700 1 -- 172.21.15.88:0/3776254608 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f790802d440 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.423+0000 7f7901ffb700 1 -- 172.21.15.88:0/3776254608 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7908024860 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.424+0000 7f7912adb700 1 -- 172.21.15.88:0/3776254608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c062380 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.426+0000 7f7901ffb700 1 -- 172.21.15.88:0/3776254608 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f790801aa10 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.496+0000 7f7912adb700 1 -- 172.21.15.88:0/3776254608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f790c19f180 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.497+0000 7f7901ffb700 1 -- 172.21.15.88:0/3776254608 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f790801abb0 con 0x7f790c07be20 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.498+0000 7f7912adb700 1 -- 172.21.15.88:0/3776254608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 msgr2=0x7f790c19baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:09.161 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.498+0000 7f7912adb700 1 --2- 172.21.15.88:0/3776254608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c19baf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7908006af0 tx=0x7f7908011a90 comp rx=0 tx=0).stop 2024-09-13T21:31:09.162 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.498+0000 7f7912adb700 1 -- 172.21.15.88:0/3776254608 shutdown_connections 2024-09-13T21:31:09.162 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.498+0000 7f7912adb700 1 --2- 172.21.15.88:0/3776254608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f790c07be20 0x7f790c19baf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:09.162 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.498+0000 7f7912adb700 1 -- 172.21.15.88:0/3776254608 >> 172.21.15.88:0/3776254608 conn(0x7f790c101220 msgr2=0x7f790c102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:09.163 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.498+0000 7f7912adb700 1 -- 172.21.15.88:0/3776254608 shutdown_connections 2024-09-13T21:31:09.163 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:08.498+0000 7f7912adb700 1 -- 172.21.15.88:0/3776254608 wait complete. 2024-09-13T21:31:09.163 INFO:teuthology.orchestra.run.smithi088.stdout:Restarting the monitor... 2024-09-13T21:31:09.447 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:09 smithi088 systemd[1]: Stopping Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:31:09.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:09 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088[27588]: 2024-09-13T21:31:09.444+0000 7fbc2e66a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi088 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:31:09.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:09 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088[27588]: 2024-09-13T21:31:09.444+0000 7fbc2e66a700 -1 mon.smithi088@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T21:31:09.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:09 smithi088 podman[27836]: 2024-09-13 21:31:09.547256249 +0000 UTC m=+0.222297545 container died 96c3461d499ee376785dadc5d10c48a60372872969390f817513650ca0d490ce (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0) 2024-09-13T21:31:10.209 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:09 smithi088 podman[27836]: 2024-09-13 21:31:09.919692647 +0000 UTC m=+0.594733943 container cleanup 96c3461d499ee376785dadc5d10c48a60372872969390f817513650ca0d490ce (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_CLEAN=True) 2024-09-13T21:31:10.209 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:09 smithi088 bash[27836]: ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088 2024-09-13T21:31:10.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 podman[27847]: 2024-09-13 21:31:10.208547516 +0000 UTC m=+0.655800815 container remove 96c3461d499ee376785dadc5d10c48a60372872969390f817513650ca0d490ce (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T21:31:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088.service: Deactivated successfully. 2024-09-13T21:31:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 systemd[1]: Stopped Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:31:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 systemd[1]: Starting Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:31:10.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 podman[27944]: 2024-09-13 21:31:10.4495489 +0000 UTC m=+0.016421384 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-09-13T21:31:10.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 podman[27944]: 2024-09-13 21:31:10.555059418 +0000 UTC m=+0.121931927 container create a9c74c8daaf15f4d0434c890f5ee7f9dd2faef30c7fe7661e049a0e6ea584dcd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-13T21:31:10.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 podman[27944]: 2024-09-13 21:31:10.757348086 +0000 UTC m=+0.324220562 container init a9c74c8daaf15f4d0434c890f5ee7f9dd2faef30c7fe7661e049a0e6ea584dcd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T21:31:10.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 podman[27944]: 2024-09-13 21:31:10.760444336 +0000 UTC m=+0.327316804 container start a9c74c8daaf15f4d0434c890f5ee7f9dd2faef30c7fe7661e049a0e6ea584dcd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.build-date=20231212, ceph=True) 2024-09-13T21:31:10.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T21:31:10.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-09-13T21:31:10.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: pidfile_write: ignore empty --pid-file 2024-09-13T21:31:10.798 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: load: jerasure load: lrc 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: RocksDB version: 7.9.2 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Git sha 0 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Compile date 2023-08-03 19:21:13 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: DB SUMMARY 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: DB Session ID: 3GHLY3VFV7T7X8X4L9L8 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: CURRENT file: CURRENT 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi088/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi088/store.db: 000009.log size: 99563 ; 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.error_if_exists: 0 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.create_if_missing: 0 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.paranoid_checks: 1 2024-09-13T21:31:10.799 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.env: 0x55c497c4a720 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.info_log: 0x55c4993b92c0 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.statistics: (nil) 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.use_fsync: 0 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_log_file_size: 0 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T21:31:10.800 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.allow_fallocate: 1 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.use_direct_reads: 0 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.db_log_dir: 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.wal_dir: 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T21:31:10.801 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.write_buffer_manager: 0x55c4986485a0 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T21:31:10.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.unordered_write: 0 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.row_cache: None 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.wal_filter: None 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.two_write_queues: 0 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T21:31:10.804 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.wal_compression: 0 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.atomic_flush: 0 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.log_readahead_size: 0 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T21:31:10.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_background_jobs: 2 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_background_compactions: -1 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_subcompactions: 1 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_open_files: -1 2024-09-13T21:31:10.806 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T21:31:10.807 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T21:31:10.807 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T21:31:10.807 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T21:31:10.807 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_background_flushes: -1 2024-09-13T21:31:10.807 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Compression algorithms supported: 2024-09-13T21:31:10.807 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T21:31:10.807 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: kZSTD supported: 0 2024-09-13T21:31:10.807 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: kXpressCompression supported: 0 2024-09-13T21:31:10.807 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: kZlibCompression supported: 1 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: kSnappyCompression supported: 1 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: kLZ4Compression supported: 1 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: kBZip2Compression supported: 0 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000010 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.merge_operator: 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_filter: None 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T21:31:10.808 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c4993b93c0) 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks: 1 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_top_level_index_and_filter: 1 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_type: 0 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_index_type: 0 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_shortening: 1 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: checksum: 4 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: no_block_cache: 0 2024-09-13T21:31:10.809 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache: 0x55c4986cb1f0 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_name: BinnedLRUCache 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_options: 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: capacity : 536870912 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_shard_bits : 4 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: strict_capacity_limit : 0 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: high_pri_pool_ratio: 0.000 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_compressed: (nil) 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: persistent_cache: (nil) 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size: 4096 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size_deviation: 10 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_restart_interval: 16 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_block_restart_interval: 1 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: metadata_block_size: 4096 2024-09-13T21:31:10.810 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: partition_filters: 0 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: use_delta_encoding: 1 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: filter_policy: bloomfilter 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: whole_key_filtering: 1 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: verify_compression: 0 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: read_amp_bytes_per_bit: 0 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: format_version: 5 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_index_compression: 1 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_align: 0 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_auto_readahead_size: 262144 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: prepopulate_block_cache: 0 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: initial_auto_readahead_size: 8192 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T21:31:10.811 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression: NoCompression 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.num_levels: 7 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:31:10.812 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T21:31:10.813 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T21:31:10.814 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T21:31:10.815 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.table_properties_collectors: 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.inplace_update_support: 0 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.bloom_locality: 0 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.max_successive_merges: 0 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T21:31:10.816 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.ttl: 2592000 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.enable_blob_files: false 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.min_blob_size: 0 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T21:31:10.817 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f3f6af3b-cf08-413f-939d-bd5f2dfc8574 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263070791437, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263070792446, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94417, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 331, "table_properties": {"data_size": 92423, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13747, "raw_average_key_size": 49, "raw_value_size": 84892, "raw_average_value_size": 305, "num_data_blocks": 11, "num_entries": 278, "num_filter_entries": 278, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726263070, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f3f6af3b-cf08-413f-939d-bd5f2dfc8574", "db_session_id": "3GHLY3VFV7T7X8X4L9L8", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263070792527, "job": 1, "event": "recovery_finished"} 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi088/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c498768000 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: DB pointer 0x55c498754000 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T21:31:10.818 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** DB Stats ** 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L0 2/0 94.08 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 143.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T21:31:10.819 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Sum 2/0 94.08 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 143.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 143.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 143.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T21:31:10.820 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative compaction: 0.00 GB write, 29.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval compaction: 0.00 GB write, 29.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache BinnedLRUCache@0x55c4986cb1f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: starting mon.smithi088 rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi088 fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mon.smithi088@-1(???) e1 preinit fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mon.smithi088@-1(???).mds e1 new map 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mon.smithi088@-1(???).mds e1 print_map 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: e1 2024-09-13T21:31:10.821 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: legacy client fscid: -1 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: No filesystems configured 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mon.smithi088@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mon.smithi088@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mon.smithi088@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mon.smithi088@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mon.smithi088@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta expand map: {default=false} 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta from 'false' to 'false' 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta expanded map: {default=false} 2024-09-13T21:31:10.822 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta expand map: {default=info} 2024-09-13T21:31:10.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta from 'info' to 'info' 2024-09-13T21:31:10.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta expanded map: {default=info} 2024-09-13T21:31:10.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta expand map: {default=daemon} 2024-09-13T21:31:10.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta from 'daemon' to 'daemon' 2024-09-13T21:31:10.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta expanded map: {default=daemon} 2024-09-13T21:31:10.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta expand map: {default=debug} 2024-09-13T21:31:10.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta from 'debug' to 'debug' 2024-09-13T21:31:10.823 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: expand_channel_meta expanded map: {default=debug} 2024-09-13T21:31:10.833 INFO:teuthology.orchestra.run.smithi088.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T21:31:11.087 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 bash[27944]: a9c74c8daaf15f4d0434c890f5ee7f9dd2faef30c7fe7661e049a0e6ea584dcd 2024-09-13T21:31:11.087 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 systemd[1]: Started Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:31:11.087 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mon.smithi088 is new leader, mons smithi088 in quorum (ranks 0) 2024-09-13T21:31:11.087 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: monmap e1: 1 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0]} removed_ranks: {} 2024-09-13T21:31:11.087 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: fsmap 2024-09-13T21:31:11.087 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T21:31:11.088 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:10 smithi088 ceph-mon[27963]: mgrmap e1: no daemons active 2024-09-13T21:31:12.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:12 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2289356212' entity='client.admin' 2024-09-13T21:31:13.224 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.295+0000 7fa8e6e31700 1 Processor -- start 2024-09-13T21:31:13.224 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.295+0000 7fa8e6e31700 1 -- start start 2024-09-13T21:31:13.224 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.295+0000 7fa8e6e31700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e007a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:13.224 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.295+0000 7fa8e6e31700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e007a840 con 0x7fa8e007be00 2024-09-13T21:31:13.224 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.295+0000 7fa8e4bcd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e007a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:13.224 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.295+0000 7fa8e4bcd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e007a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35244/0 (socket says 172.21.15.88:35244) 2024-09-13T21:31:13.224 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.295+0000 7fa8e4bcd700 1 -- 172.21.15.88:0/3851665166 learned_addr learned my addr 172.21.15.88:0/3851665166 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:13.224 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.296+0000 7fa8e4bcd700 1 -- 172.21.15.88:0/3851665166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e007a980 con 0x7fa8e007be00 2024-09-13T21:31:13.224 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.296+0000 7fa8e4bcd700 1 --2- 172.21.15.88:0/3851665166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e007a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40098a0 tx=0x7fa8d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db23803c830aa75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.296+0000 7fa8df7fe700 1 -- 172.21.15.88:0/3851665166 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d4004180 con 0x7fa8e007be00 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.296+0000 7fa8df7fe700 1 -- 172.21.15.88:0/3851665166 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa8d40042e0 con 0x7fa8e007be00 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.296+0000 7fa8df7fe700 1 -- 172.21.15.88:0/3851665166 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d4011a50 con 0x7fa8e007be00 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 -- 172.21.15.88:0/3851665166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 msgr2=0x7fa8e007a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 --2- 172.21.15.88:0/3851665166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e007a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40098a0 tx=0x7fa8d4009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 -- 172.21.15.88:0/3851665166 shutdown_connections 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 --2- 172.21.15.88:0/3851665166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e007a300 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 -- 172.21.15.88:0/3851665166 >> 172.21.15.88:0/3851665166 conn(0x7fa8e0101220 msgr2=0x7fa8e0103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 -- 172.21.15.88:0/3851665166 shutdown_connections 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 -- 172.21.15.88:0/3851665166 wait complete. 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 Processor -- start 2024-09-13T21:31:13.225 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 -- start start 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e019bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.297+0000 7fa8e6e31700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e019c050 con 0x7fa8e007be00 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8e4bcd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e019bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8e4bcd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e019bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35250/0 (socket says 172.21.15.88:35250) 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8e4bcd700 1 -- 172.21.15.88:0/2289356212 learned_addr learned my addr 172.21.15.88:0/2289356212 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8e4bcd700 1 -- 172.21.15.88:0/2289356212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4009550 con 0x7fa8e007be00 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8e4bcd700 1 --2- 172.21.15.88:0/2289356212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e019bb10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4006af0 tx=0x7fa8d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8ddffb700 1 -- 172.21.15.88:0/2289356212 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d4003a00 con 0x7fa8e007be00 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8ddffb700 1 -- 172.21.15.88:0/2289356212 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa8d4003b60 con 0x7fa8e007be00 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8e6e31700 1 -- 172.21.15.88:0/2289356212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e019c250 con 0x7fa8e007be00 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8ddffb700 1 -- 172.21.15.88:0/2289356212 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d4019710 con 0x7fa8e007be00 2024-09-13T21:31:13.226 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.298+0000 7fa8e6e31700 1 -- 172.21.15.88:0/2289356212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e019c670 con 0x7fa8e007be00 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.299+0000 7fa8ddffb700 1 -- 172.21.15.88:0/2289356212 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa8d4019cf0 con 0x7fa8e007be00 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.299+0000 7fa8ddffb700 1 -- 172.21.15.88:0/2289356212 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa8d4024730 con 0x7fa8e007be00 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.299+0000 7fa8e6e31700 1 -- 172.21.15.88:0/2289356212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e0062380 con 0x7fa8e007be00 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.302+0000 7fa8ddffb700 1 -- 172.21.15.88:0/2289356212 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa8d401abc0 con 0x7fa8e007be00 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.370+0000 7fa8e6e31700 1 -- 172.21.15.88:0/2289356212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fa8e019f0b0 con 0x7fa8e007be00 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.372+0000 7fa8ddffb700 1 -- 172.21.15.88:0/2289356212 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa8d40248f0 con 0x7fa8e007be00 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.373+0000 7fa8e6e31700 1 -- 172.21.15.88:0/2289356212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 msgr2=0x7fa8e019bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.373+0000 7fa8e6e31700 1 --2- 172.21.15.88:0/2289356212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e019bb10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4006af0 tx=0x7fa8d40047c0 comp rx=0 tx=0).stop 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.373+0000 7fa8e6e31700 1 -- 172.21.15.88:0/2289356212 shutdown_connections 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.373+0000 7fa8e6e31700 1 --2- 172.21.15.88:0/2289356212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e007be00 0x7fa8e019bb10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.373+0000 7fa8e6e31700 1 -- 172.21.15.88:0/2289356212 >> 172.21.15.88:0/2289356212 conn(0x7fa8e0101220 msgr2=0x7fa8e0102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:13.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.373+0000 7fa8e6e31700 1 -- 172.21.15.88:0/2289356212 shutdown_connections 2024-09-13T21:31:13.228 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:11.373+0000 7fa8e6e31700 1 -- 172.21.15.88:0/2289356212 wait complete. 2024-09-13T21:31:13.228 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T21:31:13.249 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:31:13.249 INFO:teuthology.orchestra.run.smithi088.stdout:Creating mgr... 2024-09-13T21:31:13.249 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T21:31:13.250 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T21:31:13.250 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T21:31:13.510 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-67511300-7217-11ef-bceb-c7b262605968@mgr.smithi088.scyrwy 2024-09-13T21:31:13.511 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to reset failed state of unit ceph-67511300-7217-11ef-bceb-c7b262605968@mgr.smithi088.scyrwy.service: Unit ceph-67511300-7217-11ef-bceb-c7b262605968@mgr.smithi088.scyrwy.service not loaded. 2024-09-13T21:31:13.654 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-67511300-7217-11ef-bceb-c7b262605968.target.wants/ceph-67511300-7217-11ef-bceb-c7b262605968@mgr.smithi088.scyrwy.service → /etc/systemd/system/ceph-67511300-7217-11ef-bceb-c7b262605968@.service. 2024-09-13T21:31:14.235 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:31:14.235 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2024-09-13T21:31:14.242 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:31:14.242 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-13T21:31:14.242 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2024-09-13T21:31:14.242 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T21:31:14.250 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:31:14.251 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2024-09-13T21:31:14.258 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:31:14.258 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-13T21:31:14.258 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2024-09-13T21:31:14.258 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T21:31:14.258 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr to start... 2024-09-13T21:31:14.258 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr... 2024-09-13T21:31:15.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:14 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2106181395' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T21:31:15.442 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:15.442 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:31:15.442 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "67511300-7217-11ef-bceb-c7b262605968", 2024-09-13T21:31:15.442 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T21:31:15.442 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T21:31:15.442 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T21:31:15.442 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T21:31:15.443 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T21:31:15.444 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:15.444 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T21:31:15.444 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:15.444 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T21:31:15.444 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T21:31:15.444 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T21:31:15.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T21:31:15.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T21:31:15.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T21:31:15.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:15.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T21:31:15.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T21:31:15.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T21:31:15.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T21:31:15.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T21:31:15.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T21:31:15.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T21:31:15.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T21:31:15.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T21:31:15.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:15.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T21:31:15.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:31:15.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T21:31:01.928494+0000", 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.749+0000 7f2881d7b700 1 Processor -- start 2024-09-13T21:31:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.749+0000 7f2881d7b700 1 -- start start 2024-09-13T21:31:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.750+0000 7f2881d7b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c108b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.750+0000 7f2881d7b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c079d40 con 0x7f287c106750 2024-09-13T21:31:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.750+0000 7f287b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c108b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.750+0000 7f287b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c108b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35268/0 (socket says 172.21.15.88:35268) 2024-09-13T21:31:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.750+0000 7f287b7fe700 1 -- 172.21.15.88:0/816977362 learned_addr learned my addr 172.21.15.88:0/816977362 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.750+0000 7f287b7fe700 1 -- 172.21.15.88:0/816977362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c079e80 con 0x7f287c106750 2024-09-13T21:31:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.750+0000 7f287b7fe700 1 --2- 172.21.15.88:0/816977362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c108b30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f286c0098a0 tx=0x7f286c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212fb67c822d1ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f287a7fc700 1 -- 172.21.15.88:0/816977362 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f286c004180 con 0x7f287c106750 2024-09-13T21:31:15.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f287a7fc700 1 -- 172.21.15.88:0/816977362 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f286c0042e0 con 0x7f287c106750 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f287a7fc700 1 -- 172.21.15.88:0/816977362 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f286c011a50 con 0x7f287c106750 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f2881d7b700 1 -- 172.21.15.88:0/816977362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 msgr2=0x7f287c108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f2881d7b700 1 --2- 172.21.15.88:0/816977362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c108b30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f286c0098a0 tx=0x7f286c009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f2881d7b700 1 -- 172.21.15.88:0/816977362 shutdown_connections 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f2881d7b700 1 --2- 172.21.15.88:0/816977362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c108b30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f2881d7b700 1 -- 172.21.15.88:0/816977362 >> 172.21.15.88:0/816977362 conn(0x7f287c100130 msgr2=0x7f287c102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f2881d7b700 1 -- 172.21.15.88:0/816977362 shutdown_connections 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.751+0000 7f2881d7b700 1 -- 172.21.15.88:0/816977362 wait complete. 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.752+0000 7f2881d7b700 1 Processor -- start 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.752+0000 7f2881d7b700 1 -- start start 2024-09-13T21:31:15.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.752+0000 7f2881d7b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.752+0000 7f2881d7b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c199e60 con 0x7f287c106750 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.752+0000 7f287b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f287b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35278/0 (socket says 172.21.15.88:35278) 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f287b7fe700 1 -- 172.21.15.88:0/2106181395 learned_addr learned my addr 172.21.15.88:0/2106181395 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f287b7fe700 1 -- 172.21.15.88:0/2106181395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009550 con 0x7f287c106750 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f287b7fe700 1 --2- 172.21.15.88:0/2106181395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c199920 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f286c006af0 tx=0x7f286c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f2878ff9700 1 -- 172.21.15.88:0/2106181395 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f286c003b90 con 0x7f287c106750 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f2878ff9700 1 -- 172.21.15.88:0/2106181395 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f286c01a8a0 con 0x7f287c106750 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f2878ff9700 1 -- 172.21.15.88:0/2106181395 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f286c019880 con 0x7f287c106750 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f2881d7b700 1 -- 172.21.15.88:0/2106181395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c19a060 con 0x7f287c106750 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f2881d7b700 1 -- 172.21.15.88:0/2106181395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c19a480 con 0x7f287c106750 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.753+0000 7f2878ff9700 1 -- 172.21.15.88:0/2106181395 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f286c02d440 con 0x7f287c106750 2024-09-13T21:31:15.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.754+0000 7f2878ff9700 1 -- 172.21.15.88:0/2106181395 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f286c0248e0 con 0x7f287c106750 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.754+0000 7f2881d7b700 1 -- 172.21.15.88:0/2106181395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c062380 con 0x7f287c106750 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.758+0000 7f2878ff9700 1 -- 172.21.15.88:0/2106181395 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f286c01aa10 con 0x7f287c106750 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.832+0000 7f2881d7b700 1 -- 172.21.15.88:0/2106181395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f287c19cec0 con 0x7f287c106750 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.833+0000 7f2878ff9700 1 -- 172.21.15.88:0/2106181395 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f286c01abb0 con 0x7f287c106750 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.834+0000 7f2881d7b700 1 -- 172.21.15.88:0/2106181395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 msgr2=0x7f287c199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.834+0000 7f2881d7b700 1 --2- 172.21.15.88:0/2106181395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c199920 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f286c006af0 tx=0x7f286c011a90 comp rx=0 tx=0).stop 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.834+0000 7f2881d7b700 1 -- 172.21.15.88:0/2106181395 shutdown_connections 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.834+0000 7f2881d7b700 1 --2- 172.21.15.88:0/2106181395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f287c106750 0x7f287c199920 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.834+0000 7f2881d7b700 1 -- 172.21.15.88:0/2106181395 >> 172.21.15.88:0/2106181395 conn(0x7f287c100130 msgr2=0x7f287c101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.834+0000 7f2881d7b700 1 -- 172.21.15.88:0/2106181395 shutdown_connections 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:14.834+0000 7f2881d7b700 1 -- 172.21.15.88:0/2106181395 wait complete. 2024-09-13T21:31:15.460 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (1/15)... 2024-09-13T21:31:18.143 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:18 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2636851639' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T21:31:19.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "67511300-7217-11ef-bceb-c7b262605968", 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T21:31:19.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T21:31:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T21:31:19.308 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T21:31:19.309 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T21:31:19.310 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T21:31:01.928494+0000", 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.878+0000 7f2758590700 1 Processor -- start 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.878+0000 7f2758590700 1 -- start start 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.878+0000 7f2758590700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275007a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.878+0000 7f2758590700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275007a880 con 0x7f275007be40 2024-09-13T21:31:19.311 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.879+0000 7f275632c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275007a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.879+0000 7f275632c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275007a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35294/0 (socket says 172.21.15.88:35294) 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.879+0000 7f275632c700 1 -- 172.21.15.88:0/1263691374 learned_addr learned my addr 172.21.15.88:0/1263691374 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.879+0000 7f275632c700 1 -- 172.21.15.88:0/1263691374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275007a9c0 con 0x7f275007be40 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.879+0000 7f275632c700 1 --2- 172.21.15.88:0/1263691374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275007a340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f274c0098a0 tx=0x7f274c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761706afeb18927 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.879+0000 7f275532a700 1 -- 172.21.15.88:0/1263691374 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f274c004180 con 0x7f275007be40 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.879+0000 7f275532a700 1 -- 172.21.15.88:0/1263691374 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f274c0042e0 con 0x7f275007be40 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.879+0000 7f275532a700 1 -- 172.21.15.88:0/1263691374 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f274c011a50 con 0x7f275007be40 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.880+0000 7f2758590700 1 -- 172.21.15.88:0/1263691374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 msgr2=0x7f275007a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.880+0000 7f2758590700 1 --2- 172.21.15.88:0/1263691374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275007a340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f274c0098a0 tx=0x7f274c009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.880+0000 7f2758590700 1 -- 172.21.15.88:0/1263691374 shutdown_connections 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.880+0000 7f2758590700 1 --2- 172.21.15.88:0/1263691374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275007a340 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.880+0000 7f2758590700 1 -- 172.21.15.88:0/1263691374 >> 172.21.15.88:0/1263691374 conn(0x7f2750101220 msgr2=0x7f2750103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:19.312 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.880+0000 7f2758590700 1 -- 172.21.15.88:0/1263691374 shutdown_connections 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.880+0000 7f2758590700 1 -- 172.21.15.88:0/1263691374 wait complete. 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.881+0000 7f2758590700 1 Processor -- start 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.881+0000 7f2758590700 1 -- start start 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.881+0000 7f2758590700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.881+0000 7f2758590700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275019c0c0 con 0x7f275007be40 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.881+0000 7f275632c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.881+0000 7f275632c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275019bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35296/0 (socket says 172.21.15.88:35296) 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.881+0000 7f275632c700 1 -- 172.21.15.88:0/2636851639 learned_addr learned my addr 172.21.15.88:0/2636851639 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.881+0000 7f275632c700 1 -- 172.21.15.88:0/2636851639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c009550 con 0x7f275007be40 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.881+0000 7f275632c700 1 --2- 172.21.15.88:0/2636851639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275019bb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f274c009520 tx=0x7f274c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.882+0000 7f27477fe700 1 -- 172.21.15.88:0/2636851639 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f274c003a80 con 0x7f275007be40 2024-09-13T21:31:19.313 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.882+0000 7f27477fe700 1 -- 172.21.15.88:0/2636851639 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f274c003be0 con 0x7f275007be40 2024-09-13T21:31:19.314 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.882+0000 7f2758590700 1 -- 172.21.15.88:0/2636851639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275019c2c0 con 0x7f275007be40 2024-09-13T21:31:19.314 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.882+0000 7f2758590700 1 -- 172.21.15.88:0/2636851639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275019c6e0 con 0x7f275007be40 2024-09-13T21:31:19.314 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.882+0000 7f27477fe700 1 -- 172.21.15.88:0/2636851639 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f274c0197b0 con 0x7f275007be40 2024-09-13T21:31:19.314 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.882+0000 7f27477fe700 1 -- 172.21.15.88:0/2636851639 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f274c02d440 con 0x7f275007be40 2024-09-13T21:31:19.314 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.882+0000 7f27477fe700 1 -- 172.21.15.88:0/2636851639 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f274c0247d0 con 0x7f275007be40 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.883+0000 7f2758590700 1 -- 172.21.15.88:0/2636851639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275010be80 con 0x7f275007be40 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.885+0000 7f27477fe700 1 -- 172.21.15.88:0/2636851639 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f274c01ac30 con 0x7f275007be40 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.957+0000 7f2758590700 1 -- 172.21.15.88:0/2636851639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f275019f760 con 0x7f275007be40 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.958+0000 7f27477fe700 1 -- 172.21.15.88:0/2636851639 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f274c024990 con 0x7f275007be40 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.959+0000 7f2758590700 1 -- 172.21.15.88:0/2636851639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 msgr2=0x7f275019bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.959+0000 7f2758590700 1 --2- 172.21.15.88:0/2636851639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275019bb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f274c009520 tx=0x7f274c011ab0 comp rx=0 tx=0).stop 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.959+0000 7f2758590700 1 -- 172.21.15.88:0/2636851639 shutdown_connections 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.959+0000 7f2758590700 1 --2- 172.21.15.88:0/2636851639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f275007be40 0x7f275019bb80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.959+0000 7f2758590700 1 -- 172.21.15.88:0/2636851639 >> 172.21.15.88:0/2636851639 conn(0x7f2750101220 msgr2=0x7f27501028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.959+0000 7f2758590700 1 -- 172.21.15.88:0/2636851639 shutdown_connections 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:17.959+0000 7f2758590700 1 -- 172.21.15.88:0/2636851639 wait complete. 2024-09-13T21:31:19.317 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (2/15)... 2024-09-13T21:31:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: Activating manager daemon smithi088.scyrwy 2024-09-13T21:31:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: mgrmap e2: smithi088.scyrwy(active, starting, since 0.00290744s) 2024-09-13T21:31:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:31:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:31:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:31:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:31:21.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:31:21.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: Manager daemon smithi088.scyrwy is now available 2024-09-13T21:31:21.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:31:21.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/trash_purge_schedule"}]: dispatch 2024-09-13T21:31:21.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:21.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:21.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:20 smithi088 ceph-mon[27963]: from='mgr.14100 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:22.594 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:22.594 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:31:22.594 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "67511300-7217-11ef-bceb-c7b262605968", 2024-09-13T21:31:22.594 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T21:31:22.594 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T21:31:22.594 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T21:31:22.594 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "smithi088" 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T21:31:22.595 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T21:31:22.596 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T21:31:22.597 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T21:31:01.928494+0000", 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:31:22.598 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.743+0000 7f3f115ef700 1 Processor -- start 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.743+0000 7f3f115ef700 1 -- start start 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.743+0000 7f3f115ef700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c07a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.743+0000 7f3f115ef700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c07a880 con 0x7f3f0c07be40 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.743+0000 7f3f0affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c07a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.743+0000 7f3f0affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c07a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34972/0 (socket says 172.21.15.88:34972) 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.743+0000 7f3f0affd700 1 -- 172.21.15.88:0/4074031203 learned_addr learned my addr 172.21.15.88:0/4074031203 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.744+0000 7f3f0affd700 1 -- 172.21.15.88:0/4074031203 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c07a9c0 con 0x7f3f0c07be40 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.744+0000 7f3f0affd700 1 --2- 172.21.15.88:0/4074031203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c07a340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009e80 tx=0x7f3f0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3b08c05e8b67c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.744+0000 7f3f09ffb700 1 -- 172.21.15.88:0/4074031203 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f0400e070 con 0x7f3f0c07be40 2024-09-13T21:31:22.599 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.744+0000 7f3f09ffb700 1 -- 172.21.15.88:0/4074031203 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3f04003e90 con 0x7f3f0c07be40 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.744+0000 7f3f09ffb700 1 -- 172.21.15.88:0/4074031203 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f04004380 con 0x7f3f0c07be40 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.744+0000 7f3f115ef700 1 -- 172.21.15.88:0/4074031203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 msgr2=0x7f3f0c07a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.744+0000 7f3f115ef700 1 --2- 172.21.15.88:0/4074031203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c07a340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009e80 tx=0x7f3f0400b330 comp rx=0 tx=0).stop 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.744+0000 7f3f115ef700 1 -- 172.21.15.88:0/4074031203 shutdown_connections 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.744+0000 7f3f115ef700 1 --2- 172.21.15.88:0/4074031203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c07a340 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.745+0000 7f3f115ef700 1 -- 172.21.15.88:0/4074031203 >> 172.21.15.88:0/4074031203 conn(0x7f3f0c101220 msgr2=0x7f3f0c103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.745+0000 7f3f115ef700 1 -- 172.21.15.88:0/4074031203 shutdown_connections 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.745+0000 7f3f115ef700 1 -- 172.21.15.88:0/4074031203 wait complete. 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.745+0000 7f3f115ef700 1 Processor -- start 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.745+0000 7f3f115ef700 1 -- start start 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.745+0000 7f3f115ef700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.745+0000 7f3f115ef700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c19c000 con 0x7f3f0c07be40 2024-09-13T21:31:22.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f0affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f0affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c19bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34982/0 (socket says 172.21.15.88:34982) 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f0affd700 1 -- 172.21.15.88:0/1617082101 learned_addr learned my addr 172.21.15.88:0/1617082101 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f0affd700 1 -- 172.21.15.88:0/1617082101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f04009b30 con 0x7f3f0c07be40 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f0affd700 1 --2- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c19bac0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b7b0 tx=0x7f3f04003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f03fff700 1 -- 172.21.15.88:0/1617082101 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f0400e040 con 0x7f3f0c07be40 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f03fff700 1 -- 172.21.15.88:0/1617082101 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3f04004800 con 0x7f3f0c07be40 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c19c200 con 0x7f3f0c07be40 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f03fff700 1 -- 172.21.15.88:0/1617082101 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f0401b710 con 0x7f3f0c07be40 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.746+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c19c680 con 0x7f3f0c07be40 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.747+0000 7f3f03fff700 1 -- 172.21.15.88:0/1617082101 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 2) v1 ==== 44840+0+0 (secure 0 0 0) 0x7f3f04019040 con 0x7f3f0c07be40 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.747+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c0623f0 con 0x7f3f0c07be40 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.747+0000 7f3f03fff700 1 -- 172.21.15.88:0/1617082101 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3f0404ba10 con 0x7f3f0c07be40 2024-09-13T21:31:22.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.749+0000 7f3f03fff700 1 -- 172.21.15.88:0/1617082101 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f3f0c0623f0 con 0x7f3f0c07be40 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.803+0000 7f3f03fff700 1 -- 172.21.15.88:0/1617082101 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 3) v1 ==== 44967+0+0 (secure 0 0 0) 0x7f3f04012b60 con 0x7f3f0c07be40 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.803+0000 7f3f03fff700 1 --2- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ef8038f50 0x7f3ef803b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.803+0000 7f3f0a7fc700 1 --2- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ef8038f50 0x7f3ef803b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.804+0000 7f3f0a7fc700 1 --2- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ef8038f50 0x7f3ef803b330 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4006fd0 tx=0x7f3ef4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.821+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3f0c0623f0 con 0x7f3f0c07be40 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.822+0000 7f3f03fff700 1 -- 172.21.15.88:0/1617082101 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f3f0c0623f0 con 0x7f3f0c07be40 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.822+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ef8038f50 msgr2=0x7f3ef803b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.822+0000 7f3f115ef700 1 --2- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ef8038f50 0x7f3ef803b330 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4006fd0 tx=0x7f3ef4006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.823+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 msgr2=0x7f3f0c19bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.823+0000 7f3f115ef700 1 --2- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c19bac0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b7b0 tx=0x7f3f04003d00 comp rx=0 tx=0).stop 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.823+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 shutdown_connections 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.823+0000 7f3f115ef700 1 --2- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ef8038f50 0x7f3ef803b330 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.823+0000 7f3f115ef700 1 --2- 172.21.15.88:0/1617082101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f0c07be40 0x7f3f0c19bac0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:22.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.823+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 >> 172.21.15.88:0/1617082101 conn(0x7f3f0c101220 msgr2=0x7f3f0c1028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:22.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.823+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 shutdown_connections 2024-09-13T21:31:22.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:21.823+0000 7f3f115ef700 1 -- 172.21.15.88:0/1617082101 wait complete. 2024-09-13T21:31:22.603 INFO:teuthology.orchestra.run.smithi088.stdout:mgr is available 2024-09-13T21:31:22.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:22 smithi088 ceph-mon[27963]: mgrmap e3: smithi088.scyrwy(active, since 1.00972s) 2024-09-13T21:31:22.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:22 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1617082101' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T21:31:23.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:23 smithi088 ceph-mon[27963]: mgrmap e4: smithi088.scyrwy(active, since 2s) 2024-09-13T21:31:23.907 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:23 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3275493960' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T21:31:23.915 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:23.915 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T21:31:23.915 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout fsid = 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:31:23.915 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T21:31:23.916 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.052+0000 7f71cb7bd700 1 Processor -- start 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.052+0000 7f71cb7bd700 1 -- start start 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.052+0000 7f71cb7bd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c4108b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.053+0000 7f71cb7bd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4079d60 con 0x7f71c4106730 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.053+0000 7f71c9559700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c4108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.053+0000 7f71c9559700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c4108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34986/0 (socket says 172.21.15.88:34986) 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.053+0000 7f71c9559700 1 -- 172.21.15.88:0/324768058 learned_addr learned my addr 172.21.15.88:0/324768058 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.053+0000 7f71c9559700 1 -- 172.21.15.88:0/324768058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4079ea0 con 0x7f71c4106730 2024-09-13T21:31:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.053+0000 7f71c9559700 1 --2- 172.21.15.88:0/324768058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c4108b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009e80 tx=0x7f71bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48164c7bbf969ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:23.918 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.053+0000 7f71c3fff700 1 -- 172.21.15.88:0/324768058 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71bc00e070 con 0x7f71c4106730 2024-09-13T21:31:23.918 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.053+0000 7f71c3fff700 1 -- 172.21.15.88:0/324768058 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f71bc003e90 con 0x7f71c4106730 2024-09-13T21:31:23.918 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.053+0000 7f71c3fff700 1 -- 172.21.15.88:0/324768058 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71bc004380 con 0x7f71c4106730 2024-09-13T21:31:23.918 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.054+0000 7f71cb7bd700 1 -- 172.21.15.88:0/324768058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 msgr2=0x7f71c4108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.054+0000 7f71cb7bd700 1 --2- 172.21.15.88:0/324768058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c4108b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009e80 tx=0x7f71bc00b330 comp rx=0 tx=0).stop 2024-09-13T21:31:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.054+0000 7f71cb7bd700 1 -- 172.21.15.88:0/324768058 shutdown_connections 2024-09-13T21:31:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.054+0000 7f71cb7bd700 1 --2- 172.21.15.88:0/324768058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c4108b10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.054+0000 7f71cb7bd700 1 -- 172.21.15.88:0/324768058 >> 172.21.15.88:0/324768058 conn(0x7f71c4100130 msgr2=0x7f71c4102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.054+0000 7f71cb7bd700 1 -- 172.21.15.88:0/324768058 shutdown_connections 2024-09-13T21:31:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.054+0000 7f71cb7bd700 1 -- 172.21.15.88:0/324768058 wait complete. 2024-09-13T21:31:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.054+0000 7f71cb7bd700 1 Processor -- start 2024-09-13T21:31:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71cb7bd700 1 -- start start 2024-09-13T21:31:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71cb7bd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71cb7bd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c419bfa0 con 0x7f71c4106730 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71c9559700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71c9559700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c419ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34994/0 (socket says 172.21.15.88:34994) 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71c9559700 1 -- 172.21.15.88:0/3275493960 learned_addr learned my addr 172.21.15.88:0/3275493960 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71c9559700 1 -- 172.21.15.88:0/3275493960 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc009b30 con 0x7f71c4106730 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71c9559700 1 --2- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c419ba60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71bc000f80 tx=0x7f71bc004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71c27fc700 1 -- 172.21.15.88:0/3275493960 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71bc00e040 con 0x7f71c4106730 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71c27fc700 1 -- 172.21.15.88:0/3275493960 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f71bc003cf0 con 0x7f71c4106730 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c419c1a0 con 0x7f71c4106730 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71c27fc700 1 -- 172.21.15.88:0/3275493960 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71bc01b930 con 0x7f71c4106730 2024-09-13T21:31:23.920 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.055+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c419c620 con 0x7f71c4106730 2024-09-13T21:31:23.921 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.056+0000 7f71c27fc700 1 -- 172.21.15.88:0/3275493960 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f71bc019040 con 0x7f71c4106730 2024-09-13T21:31:23.921 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.056+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c40623f0 con 0x7f71c4106730 2024-09-13T21:31:23.921 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.056+0000 7f71c27fc700 1 --2- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ac0383f0 0x7f71ac03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:23.921 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.056+0000 7f71c27fc700 1 -- 172.21.15.88:0/3275493960 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f71bc04bbc0 con 0x7f71c4106730 2024-09-13T21:31:23.921 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.056+0000 7f71c8d58700 1 --2- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ac0383f0 0x7f71ac03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:23.921 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.057+0000 7f71c8d58700 1 --2- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ac0383f0 0x7f71ac03a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006fd0 tx=0x7f71b8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:23.921 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.061+0000 7f71c27fc700 1 -- 172.21.15.88:0/3275493960 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f71c40623f0 con 0x7f71c4106730 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.248+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f71c419f520 con 0x7f71c4106730 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.249+0000 7f71c27fc700 1 -- 172.21.15.88:0/3275493960 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f71bc01fe30 con 0x7f71c4106730 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ac0383f0 msgr2=0x7f71ac03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 --2- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ac0383f0 0x7f71ac03a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006fd0 tx=0x7f71b8006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 msgr2=0x7f71c419ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 --2- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c419ba60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71bc000f80 tx=0x7f71bc004920 comp rx=0 tx=0).stop 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 shutdown_connections 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 --2- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ac0383f0 0x7f71ac03a8a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 --2- 172.21.15.88:0/3275493960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c4106730 0x7f71c419ba60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 >> 172.21.15.88:0/3275493960 conn(0x7f71c4100130 msgr2=0x7f71c4100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 shutdown_connections 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:23.251+0000 7f71cb7bd700 1 -- 172.21.15.88:0/3275493960 wait complete. 2024-09-13T21:31:23.922 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling cephadm module... 2024-09-13T21:31:24.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:24 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2571552589' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T21:31:25.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.357+0000 7fe99416d700 1 Processor -- start 2024-09-13T21:31:25.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.358+0000 7fe99416d700 1 -- start start 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.358+0000 7fe99416d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c079d20 0x7fe98c10ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.358+0000 7fe99416d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c106510 con 0x7fe98c079d20 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.358+0000 7fe991f09700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c079d20 0x7fe98c10ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.358+0000 7fe991f09700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c079d20 0x7fe98c10ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35002/0 (socket says 172.21.15.88:35002) 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.358+0000 7fe991f09700 1 -- 172.21.15.88:0/3011401922 learned_addr learned my addr 172.21.15.88:0/3011401922 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.358+0000 7fe991f09700 1 -- 172.21.15.88:0/3011401922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c10b060 con 0x7fe98c079d20 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.358+0000 7fe991f09700 1 --2- 172.21.15.88:0/3011401922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c079d20 0x7fe98c10ab20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe9880098a0 tx=0x7fe988009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63642250f8855b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe990f07700 1 -- 172.21.15.88:0/3011401922 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe988004180 con 0x7fe98c079d20 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe990f07700 1 -- 172.21.15.88:0/3011401922 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe9880042e0 con 0x7fe98c079d20 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe990f07700 1 -- 172.21.15.88:0/3011401922 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe988011a50 con 0x7fe98c079d20 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe99416d700 1 -- 172.21.15.88:0/3011401922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c079d20 msgr2=0x7fe98c10ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:25.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe99416d700 1 --2- 172.21.15.88:0/3011401922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c079d20 0x7fe98c10ab20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe9880098a0 tx=0x7fe988009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe99416d700 1 -- 172.21.15.88:0/3011401922 shutdown_connections 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe99416d700 1 --2- 172.21.15.88:0/3011401922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c079d20 0x7fe98c10ab20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe99416d700 1 -- 172.21.15.88:0/3011401922 >> 172.21.15.88:0/3011401922 conn(0x7fe98c1000f0 msgr2=0x7fe98c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe99416d700 1 -- 172.21.15.88:0/3011401922 shutdown_connections 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.359+0000 7fe99416d700 1 -- 172.21.15.88:0/3011401922 wait complete. 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.360+0000 7fe99416d700 1 Processor -- start 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.360+0000 7fe99416d700 1 -- start start 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.360+0000 7fe99416d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c19bb00 0x7fe98c19bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.360+0000 7fe99416d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c19c450 con 0x7fe98c19bb00 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.360+0000 7fe991f09700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c19bb00 0x7fe98c19bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.360+0000 7fe991f09700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c19bb00 0x7fe98c19bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35016/0 (socket says 172.21.15.88:35016) 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.360+0000 7fe991f09700 1 -- 172.21.15.88:0/2571552589 learned_addr learned my addr 172.21.15.88:0/2571552589 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:25.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.360+0000 7fe991f09700 1 -- 172.21.15.88:0/2571552589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009550 con 0x7fe98c19bb00 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.360+0000 7fe991f09700 1 --2- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c19bb00 0x7fe98c19bf10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe988006af0 tx=0x7fe988011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.361+0000 7fe982ffd700 1 -- 172.21.15.88:0/2571552589 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe988003b90 con 0x7fe98c19bb00 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.361+0000 7fe982ffd700 1 -- 172.21.15.88:0/2571552589 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe98801a8a0 con 0x7fe98c19bb00 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.361+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c19c650 con 0x7fe98c19bb00 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.361+0000 7fe982ffd700 1 -- 172.21.15.88:0/2571552589 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe988019880 con 0x7fe98c19bb00 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.361+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c19f2b0 con 0x7fe98c19bb00 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.361+0000 7fe982ffd700 1 -- 172.21.15.88:0/2571552589 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7fe988019b40 con 0x7fe98c19bb00 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.362+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c079d20 con 0x7fe98c19bb00 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.362+0000 7fe982ffd700 1 --2- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe978038360 0x7fe97803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.362+0000 7fe982ffd700 1 -- 172.21.15.88:0/2571552589 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe98804c8a0 con 0x7fe98c19bb00 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.362+0000 7fe991708700 1 --2- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe978038360 0x7fe97803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.362+0000 7fe991708700 1 --2- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe978038360 0x7fe97803a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe97c006fd0 tx=0x7fe97c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:25.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.367+0000 7fe982ffd700 1 -- 172.21.15.88:0/2571552589 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe98802b750 con 0x7fe98c19bb00 2024-09-13T21:31:25.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.609+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fe98c079f10 con 0x7fe98c19bb00 2024-09-13T21:31:25.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.810+0000 7fe982ffd700 1 -- 172.21.15.88:0/2571552589 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe98801aa10 con 0x7fe98c19bb00 2024-09-13T21:31:25.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.811+0000 7fe982ffd700 1 -- 172.21.15.88:0/2571552589 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fe988023550 con 0x7fe98c19bb00 2024-09-13T21:31:25.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe978038360 msgr2=0x7fe97803a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:25.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 --2- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe978038360 0x7fe97803a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe97c006fd0 tx=0x7fe97c006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:25.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c19bb00 msgr2=0x7fe98c19bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:25.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 --2- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c19bb00 0x7fe98c19bf10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe988006af0 tx=0x7fe988011a90 comp rx=0 tx=0).stop 2024-09-13T21:31:25.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 shutdown_connections 2024-09-13T21:31:25.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 --2- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe978038360 0x7fe97803a810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:25.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 --2- 172.21.15.88:0/2571552589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe98c19bb00 0x7fe98c19bf10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:25.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 >> 172.21.15.88:0/2571552589 conn(0x7fe98c1000f0 msgr2=0x7fe98c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:25.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 shutdown_connections 2024-09-13T21:31:25.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:24.813+0000 7fe99416d700 1 -- 172.21.15.88:0/2571552589 wait complete. 2024-09-13T21:31:26.056 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:25 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2571552589' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T21:31:26.056 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:25 smithi088 ceph-mon[27963]: mgrmap e5: smithi088.scyrwy(active, since 4s) 2024-09-13T21:31:26.760 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:31:26.760 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T21:31:26.760 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T21:31:26.760 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "active_name": "smithi088.scyrwy", 2024-09-13T21:31:26.760 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T21:31:26.760 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:31:26.760 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.848+0000 7f8e90c7b700 1 Processor -- start 2024-09-13T21:31:26.760 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.848+0000 7f8e90c7b700 1 -- start start 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.849+0000 7f8e90c7b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.849+0000 7f8e90c7b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c079d60 con 0x7f8e8c1066f0 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.849+0000 7f8e8a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.849+0000 7f8e8a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35054/0 (socket says 172.21.15.88:35054) 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.849+0000 7f8e8a59c700 1 -- 172.21.15.88:0/945625325 learned_addr learned my addr 172.21.15.88:0/945625325 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.849+0000 7f8e8a59c700 1 -- 172.21.15.88:0/945625325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c079ea0 con 0x7f8e8c1066f0 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.849+0000 7f8e8a59c700 1 --2- 172.21.15.88:0/945625325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c108ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0098a0 tx=0x7f8e7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b003648c1d717634 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.849+0000 7f8e8959a700 1 -- 172.21.15.88:0/945625325 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e7c004180 con 0x7f8e8c1066f0 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.850+0000 7f8e8959a700 1 -- 172.21.15.88:0/945625325 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8e7c0042e0 con 0x7f8e8c1066f0 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.850+0000 7f8e8959a700 1 -- 172.21.15.88:0/945625325 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e7c011a50 con 0x7f8e8c1066f0 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.850+0000 7f8e90c7b700 1 -- 172.21.15.88:0/945625325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 msgr2=0x7f8e8c108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:26.761 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.850+0000 7f8e90c7b700 1 --2- 172.21.15.88:0/945625325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c108ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0098a0 tx=0x7f8e7c009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.850+0000 7f8e90c7b700 1 -- 172.21.15.88:0/945625325 shutdown_connections 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.850+0000 7f8e90c7b700 1 --2- 172.21.15.88:0/945625325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c108ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.850+0000 7f8e90c7b700 1 -- 172.21.15.88:0/945625325 >> 172.21.15.88:0/945625325 conn(0x7f8e8c100150 msgr2=0x7f8e8c102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.850+0000 7f8e90c7b700 1 -- 172.21.15.88:0/945625325 shutdown_connections 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.850+0000 7f8e90c7b700 1 -- 172.21.15.88:0/945625325 wait complete. 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.851+0000 7f8e90c7b700 1 Processor -- start 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.851+0000 7f8e90c7b700 1 -- start start 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.851+0000 7f8e90c7b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c106050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.851+0000 7f8e90c7b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c106590 con 0x7f8e8c1066f0 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.851+0000 7f8e8a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:26.762 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.851+0000 7f8e8a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35058/0 (socket says 172.21.15.88:35058) 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.851+0000 7f8e8a59c700 1 -- 172.21.15.88:0/1783767044 learned_addr learned my addr 172.21.15.88:0/1783767044 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.852+0000 7f8e8a59c700 1 -- 172.21.15.88:0/1783767044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c009550 con 0x7f8e8c1066f0 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.852+0000 7f8e8a59c700 1 --2- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c106050 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c006af0 tx=0x7f8e7c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.852+0000 7f8e7b7fe700 1 -- 172.21.15.88:0/1783767044 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e7c003b90 con 0x7f8e8c1066f0 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.852+0000 7f8e7b7fe700 1 -- 172.21.15.88:0/1783767044 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8e7c01a8a0 con 0x7f8e8c1066f0 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.852+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c104700 con 0x7f8e8c1066f0 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.852+0000 7f8e7b7fe700 1 -- 172.21.15.88:0/1783767044 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e7c019880 con 0x7f8e8c1066f0 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.852+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c104b80 con 0x7f8e8c1066f0 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.853+0000 7f8e7b7fe700 1 -- 172.21.15.88:0/1783767044 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8e7c019b40 con 0x7f8e8c1066f0 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.853+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c109c30 con 0x7f8e8c1066f0 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.853+0000 7f8e7b7fe700 1 --2- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e740383b0 0x7f8e7403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.853+0000 7f8e7b7fe700 1 -- 172.21.15.88:0/1783767044 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8e7c04c6a0 con 0x7f8e8c1066f0 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.853+0000 7f8e89d9b700 1 -- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e740383b0 msgr2=0x7f8e7403a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.853+0000 7f8e89d9b700 1 --2- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e740383b0 0x7f8e7403a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:25.862+0000 7f8e7b7fe700 1 -- 172.21.15.88:0/1783767044 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8e7c02b340 con 0x7f8e8c1066f0 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.054+0000 7f8e89d9b700 1 -- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e740383b0 msgr2=0x7f8e7403a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.054+0000 7f8e89d9b700 1 --2- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e740383b0 0x7f8e7403a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.113+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f8e8c1051e0 con 0x7f8e8c1066f0 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.113+0000 7f8e7b7fe700 1 -- 172.21.15.88:0/1783767044 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f8e7c02b340 con 0x7f8e8c1066f0 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e740383b0 msgr2=0x7f8e7403a860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 --2- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e740383b0 0x7f8e7403a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 msgr2=0x7f8e8c106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:26.764 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 --2- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c106050 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c006af0 tx=0x7f8e7c011a90 comp rx=0 tx=0).stop 2024-09-13T21:31:26.765 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 shutdown_connections 2024-09-13T21:31:26.765 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 --2- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e740383b0 0x7f8e7403a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:26.765 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 --2- 172.21.15.88:0/1783767044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e8c1066f0 0x7f8e8c106050 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:26.765 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 >> 172.21.15.88:0/1783767044 conn(0x7f8e8c100150 msgr2=0x7f8e8c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:26.765 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 shutdown_connections 2024-09-13T21:31:26.765 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:26.115+0000 7f8e90c7b700 1 -- 172.21.15.88:0/1783767044 wait complete. 2024-09-13T21:31:26.765 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for the mgr to restart... 2024-09-13T21:31:26.765 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr epoch 5... 2024-09-13T21:31:27.018 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:26 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1783767044' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T21:31:32.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: Active manager daemon smithi088.scyrwy restarted 2024-09-13T21:31:32.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: Activating manager daemon smithi088.scyrwy 2024-09-13T21:31:32.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: mgrmap e6: smithi088.scyrwy(active, starting, since 0.00322254s) 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: Manager daemon smithi088.scyrwy is now available 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:32.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:31:32.235 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:31:32.235 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:31:32.235 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:31:32.235 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:31 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/trash_purge_schedule"}]: dispatch 2024-09-13T21:31:33.068 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:32 smithi088 ceph-mon[27963]: Found migration_current of "None". Setting to last migration. 2024-09-13T21:31:33.069 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:32 smithi088 ceph-mon[27963]: mgrmap e7: smithi088.scyrwy(active, since 1.00534s) 2024-09-13T21:31:33.070 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:31:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T21:31:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T21:31:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:31:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.249+0000 7fa5b08fc700 1 Processor -- start 2024-09-13T21:31:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.249+0000 7fa5b08fc700 1 -- start start 2024-09-13T21:31:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.249+0000 7fa5b08fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac106490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.249+0000 7fa5b08fc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1069d0 con 0x7fa5ac106080 2024-09-13T21:31:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.249+0000 7fa5aa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac106490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.249+0000 7fa5aa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac106490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35064/0 (socket says 172.21.15.88:35064) 2024-09-13T21:31:33.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.249+0000 7fa5aa59c700 1 -- 172.21.15.88:0/3640943689 learned_addr learned my addr 172.21.15.88:0/3640943689 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:33.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.249+0000 7fa5aa59c700 1 -- 172.21.15.88:0/3640943689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac106b10 con 0x7fa5ac106080 2024-09-13T21:31:33.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.250+0000 7fa5aa59c700 1 --2- 172.21.15.88:0/3640943689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac106490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0098a0 tx=0x7fa59c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39120810b9923da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:33.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.250+0000 7fa5a959a700 1 -- 172.21.15.88:0/3640943689 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa59c004180 con 0x7fa5ac106080 2024-09-13T21:31:33.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.250+0000 7fa5a959a700 1 -- 172.21.15.88:0/3640943689 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa59c0042e0 con 0x7fa5ac106080 2024-09-13T21:31:33.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.250+0000 7fa5a959a700 1 -- 172.21.15.88:0/3640943689 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa59c011a50 con 0x7fa5ac106080 2024-09-13T21:31:33.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.250+0000 7fa5b08fc700 1 -- 172.21.15.88:0/3640943689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 msgr2=0x7fa5ac106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:33.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.250+0000 7fa5b08fc700 1 --2- 172.21.15.88:0/3640943689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac106490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0098a0 tx=0x7fa59c009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:33.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.250+0000 7fa5b08fc700 1 -- 172.21.15.88:0/3640943689 shutdown_connections 2024-09-13T21:31:33.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.250+0000 7fa5b08fc700 1 --2- 172.21.15.88:0/3640943689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac106490 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:33.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.250+0000 7fa5b08fc700 1 -- 172.21.15.88:0/3640943689 >> 172.21.15.88:0/3640943689 conn(0x7fa5ac0ff880 msgr2=0x7fa5ac101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:33.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.251+0000 7fa5b08fc700 1 -- 172.21.15.88:0/3640943689 shutdown_connections 2024-09-13T21:31:33.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.251+0000 7fa5b08fc700 1 -- 172.21.15.88:0/3640943689 wait complete. 2024-09-13T21:31:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.251+0000 7fa5b08fc700 1 Processor -- start 2024-09-13T21:31:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.251+0000 7fa5b08fc700 1 -- start start 2024-09-13T21:31:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.251+0000 7fa5b08fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.251+0000 7fa5b08fc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac19c080 con 0x7fa5ac106080 2024-09-13T21:31:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa5aa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa5aa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac19bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35068/0 (socket says 172.21.15.88:35068) 2024-09-13T21:31:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa5aa59c700 1 -- 172.21.15.88:0/2217129880 learned_addr learned my addr 172.21.15.88:0/2217129880 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa5aa59c700 1 -- 172.21.15.88:0/2217129880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c009550 con 0x7fa5ac106080 2024-09-13T21:31:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa5aa59c700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac19bb40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa59c006af0 tx=0x7fa59c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa59c003a00 con 0x7fa5ac106080 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa59c003b60 con 0x7fa5ac106080 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa5b08fc700 1 -- 172.21.15.88:0/2217129880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac19c280 con 0x7fa5ac106080 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa59c019710 con 0x7fa5ac106080 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.252+0000 7fa5b08fc700 1 -- 172.21.15.88:0/2217129880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac19c6a0 con 0x7fa5ac106080 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.253+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fa59c0199d0 con 0x7fa5ac106080 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.253+0000 7fa59b7fe700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.253+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa59403af50 con 0x7fa594038390 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.253+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa59c04c610 con 0x7fa5ac106080 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.253+0000 7fa5a9d9b700 1 -- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 msgr2=0x7fa59403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.253+0000 7fa5a9d9b700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.454+0000 7fa5a9d9b700 1 -- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 msgr2=0x7fa59403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:31:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.454+0000 7fa5a9d9b700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.855+0000 7fa5a9d9b700 1 -- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 msgr2=0x7fa59403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:27.855+0000 7fa5a9d9b700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:28.656+0000 7fa5a9d9b700 1 -- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 msgr2=0x7fa59403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:28.656+0000 7fa5a9d9b700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:30.257+0000 7fa5a9d9b700 1 -- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 msgr2=0x7fa59403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:30.257+0000 7fa5a9d9b700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:31.465+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7fa59c01abc0 con 0x7fa5ac106080 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:31.465+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 msgr2=0x7fa59403a840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:31.465+0000 7fa59b7fe700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.466+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7fa59c02dce0 con 0x7fa5ac106080 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.466+0000 7fa59b7fe700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.466+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa59403af50 con 0x7fa594038390 2024-09-13T21:31:33.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.467+0000 7fa5a9d9b700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:33.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.467+0000 7fa5a9d9b700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0003a10 tx=0x7fa5a0009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:33.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.468+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fa59403af50 con 0x7fa594038390 2024-09-13T21:31:33.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.474+0000 7fa5b08fc700 1 -- 172.21.15.88:0/2217129880 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fa5ac19ce80 con 0x7fa594038390 2024-09-13T21:31:33.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa59b7fe700 1 -- 172.21.15.88:0/2217129880 <== mgr.14118 v2:172.21.15.88:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa5ac19ce80 con 0x7fa594038390 2024-09-13T21:31:33.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 -- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 msgr2=0x7fa59403a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:33.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0003a10 tx=0x7fa5a0009290 comp rx=0 tx=0).stop 2024-09-13T21:31:33.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 -- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 msgr2=0x7fa5ac19bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:33.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac19bb40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa59c006af0 tx=0x7fa59c0047c0 comp rx=0 tx=0).stop 2024-09-13T21:31:33.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 -- 172.21.15.88:0/2217129880 shutdown_connections 2024-09-13T21:31:33.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa594038390 0x7fa59403a840 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:33.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 --2- 172.21.15.88:0/2217129880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5ac106080 0x7fa5ac19bb40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:33.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 -- 172.21.15.88:0/2217129880 >> 172.21.15.88:0/2217129880 conn(0x7fa5ac0ff880 msgr2=0x7fa5ac18e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:33.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 -- 172.21.15.88:0/2217129880 shutdown_connections 2024-09-13T21:31:33.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:32.475+0000 7fa5b08fc700 1 -- 172.21.15.88:0/2217129880 wait complete. 2024-09-13T21:31:33.084 INFO:teuthology.orchestra.run.smithi088.stdout:mgr epoch 5 is available 2024-09-13T21:31:33.084 INFO:teuthology.orchestra.run.smithi088.stdout:Setting orchestrator backend to cephadm... 2024-09-13T21:31:33.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:33 smithi088 ceph-mon[27963]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T21:31:33.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:33 smithi088 ceph-mon[27963]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T21:31:33.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:33 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:33.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:33 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:33.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:33 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:33.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:33 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:31:34.368 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.480+0000 7f1972199700 1 Processor -- start 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.480+0000 7f1972199700 1 -- start start 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.480+0000 7f1972199700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c079d20 0x7f196c10ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.480+0000 7f1972199700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c106570 con 0x7f196c079d20 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.480+0000 7f196b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c079d20 0x7f196c10ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.480+0000 7f196b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c079d20 0x7f196c10ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47550/0 (socket says 172.21.15.88:47550) 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.480+0000 7f196b7fe700 1 -- 172.21.15.88:0/3394139584 learned_addr learned my addr 172.21.15.88:0/3394139584 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.480+0000 7f196b7fe700 1 -- 172.21.15.88:0/3394139584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c10b0c0 con 0x7f196c079d20 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.481+0000 7f196b7fe700 1 --2- 172.21.15.88:0/3394139584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c079d20 0x7f196c10ab80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f195c0098a0 tx=0x7f195c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e396a35fe04160 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.481+0000 7f196a7fc700 1 -- 172.21.15.88:0/3394139584 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f195c004180 con 0x7f196c079d20 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.481+0000 7f196a7fc700 1 -- 172.21.15.88:0/3394139584 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f195c0042e0 con 0x7f196c079d20 2024-09-13T21:31:34.369 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.481+0000 7f196a7fc700 1 -- 172.21.15.88:0/3394139584 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f195c011a50 con 0x7f196c079d20 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.481+0000 7f1972199700 1 -- 172.21.15.88:0/3394139584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c079d20 msgr2=0x7f196c10ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.481+0000 7f1972199700 1 --2- 172.21.15.88:0/3394139584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c079d20 0x7f196c10ab80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f195c0098a0 tx=0x7f195c009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.481+0000 7f1972199700 1 -- 172.21.15.88:0/3394139584 shutdown_connections 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.481+0000 7f1972199700 1 --2- 172.21.15.88:0/3394139584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c079d20 0x7f196c10ab80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.481+0000 7f1972199700 1 -- 172.21.15.88:0/3394139584 >> 172.21.15.88:0/3394139584 conn(0x7f196c100130 msgr2=0x7f196c102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.482+0000 7f1972199700 1 -- 172.21.15.88:0/3394139584 shutdown_connections 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.482+0000 7f1972199700 1 -- 172.21.15.88:0/3394139584 wait complete. 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.482+0000 7f1972199700 1 Processor -- start 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.482+0000 7f1972199700 1 -- start start 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.482+0000 7f1972199700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c19bab0 0x7f196c19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.482+0000 7f1972199700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c19c400 con 0x7f196c19bab0 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f196b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c19bab0 0x7f196c19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f196b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c19bab0 0x7f196c19bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47552/0 (socket says 172.21.15.88:47552) 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f196b7fe700 1 -- 172.21.15.88:0/1881135934 learned_addr learned my addr 172.21.15.88:0/1881135934 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f196b7fe700 1 -- 172.21.15.88:0/1881135934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c009550 con 0x7f196c19bab0 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f196b7fe700 1 --2- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c19bab0 0x7f196c19bec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f195c000c00 tx=0x7f195c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f1968ff9700 1 -- 172.21.15.88:0/1881135934 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f195c003b90 con 0x7f196c19bab0 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f1968ff9700 1 -- 172.21.15.88:0/1881135934 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f195c0248b0 con 0x7f196c19bab0 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c19c600 con 0x7f196c19bab0 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f1968ff9700 1 -- 172.21.15.88:0/1881135934 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f195c01a8e0 con 0x7f196c19bab0 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.483+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c19f260 con 0x7f196c19bab0 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.484+0000 7f1968ff9700 1 -- 172.21.15.88:0/1881135934 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f195c01ab50 con 0x7f196c19bab0 2024-09-13T21:31:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.484+0000 7f1968ff9700 1 --2- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1954038320 0x7f195403a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.484+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c079d20 con 0x7f196c19bab0 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.484+0000 7f1968ff9700 1 -- 172.21.15.88:0/1881135934 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f195c04c1d0 con 0x7f196c19bab0 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.484+0000 7f196affd700 1 --2- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1954038320 0x7f195403a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.485+0000 7f196affd700 1 --2- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1954038320 0x7f195403a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1960006fd0 tx=0x7f1960006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.489+0000 7f1968ff9700 1 -- 172.21.15.88:0/1881135934 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f195c0233a0 con 0x7f196c19bab0 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.694+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f196c101620 con 0x7f1954038320 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.700+0000 7f1968ff9700 1 -- 172.21.15.88:0/1881135934 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f196c101620 con 0x7f1954038320 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1954038320 msgr2=0x7f195403a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 --2- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1954038320 0x7f195403a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1960006fd0 tx=0x7f1960006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c19bab0 msgr2=0x7f196c19bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 --2- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c19bab0 0x7f196c19bec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f195c000c00 tx=0x7f195c011ab0 comp rx=0 tx=0).stop 2024-09-13T21:31:34.372 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 shutdown_connections 2024-09-13T21:31:34.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 --2- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1954038320 0x7f195403a7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:34.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 --2- 172.21.15.88:0/1881135934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f196c19bab0 0x7f196c19bec0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:34.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 >> 172.21.15.88:0/1881135934 conn(0x7f196c100130 msgr2=0x7f196c100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:34.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 shutdown_connections 2024-09-13T21:31:34.373 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:33.703+0000 7f1972199700 1 -- 172.21.15.88:0/1881135934 wait complete. 2024-09-13T21:31:34.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:34 smithi088 ceph-mon[27963]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:34.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:34 smithi088 ceph-mon[27963]: mgrmap e8: smithi088.scyrwy(active, since 2s) 2024-09-13T21:31:34.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:34 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.803+0000 7f7fa573d700 1 Processor -- start 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.803+0000 7f7fa573d700 1 -- start start 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.803+0000 7f7fa573d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0108b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.803+0000 7f7fa573d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa0079d60 con 0x7f7fa0106730 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.803+0000 7f7f9effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.803+0000 7f7f9effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47554/0 (socket says 172.21.15.88:47554) 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.803+0000 7f7f9effd700 1 -- 172.21.15.88:0/2369945074 learned_addr learned my addr 172.21.15.88:0/2369945074 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.804+0000 7f7f9effd700 1 -- 172.21.15.88:0/2369945074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0079ea0 con 0x7f7fa0106730 2024-09-13T21:31:35.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.804+0000 7f7f9effd700 1 --2- 172.21.15.88:0/2369945074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0108b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f900098a0 tx=0x7f7f90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bee948e28fe482f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.805+0000 7f7f9dffb700 1 -- 172.21.15.88:0/2369945074 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f90004180 con 0x7f7fa0106730 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.805+0000 7f7f9dffb700 1 -- 172.21.15.88:0/2369945074 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f900042e0 con 0x7f7fa0106730 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.805+0000 7f7f9dffb700 1 -- 172.21.15.88:0/2369945074 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f90011a50 con 0x7f7fa0106730 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.806+0000 7f7fa573d700 1 -- 172.21.15.88:0/2369945074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 msgr2=0x7f7fa0108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.806+0000 7f7fa573d700 1 --2- 172.21.15.88:0/2369945074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0108b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f900098a0 tx=0x7f7f90009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.806+0000 7f7fa573d700 1 -- 172.21.15.88:0/2369945074 shutdown_connections 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.806+0000 7f7fa573d700 1 --2- 172.21.15.88:0/2369945074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0108b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.806+0000 7f7fa573d700 1 -- 172.21.15.88:0/2369945074 >> 172.21.15.88:0/2369945074 conn(0x7f7fa0100130 msgr2=0x7f7fa0102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.806+0000 7f7fa573d700 1 -- 172.21.15.88:0/2369945074 shutdown_connections 2024-09-13T21:31:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.806+0000 7f7fa573d700 1 -- 172.21.15.88:0/2369945074 wait complete. 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.806+0000 7f7fa573d700 1 Processor -- start 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7fa573d700 1 -- start start 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7fa573d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0106090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7fa573d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01065d0 con 0x7f7fa0106730 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7f9effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0106090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7f9effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0106090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47560/0 (socket says 172.21.15.88:47560) 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7f9effd700 1 -- 172.21.15.88:0/2008035963 learned_addr learned my addr 172.21.15.88:0/2008035963 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7f9effd700 1 -- 172.21.15.88:0/2008035963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90009550 con 0x7f7fa0106730 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7f9effd700 1 --2- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0106090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f90006af0 tx=0x7f7f90011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7f87fff700 1 -- 172.21.15.88:0/2008035963 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f90003b90 con 0x7f7fa0106730 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa0104740 con 0x7f7fa0106730 2024-09-13T21:31:35.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7f87fff700 1 -- 172.21.15.88:0/2008035963 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f9001a8a0 con 0x7f7fa0106730 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.807+0000 7f7f87fff700 1 -- 172.21.15.88:0/2008035963 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f90019880 con 0x7f7fa0106730 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.808+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa0104bc0 con 0x7f7fa0106730 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.808+0000 7f7f87fff700 1 -- 172.21.15.88:0/2008035963 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7f90019b40 con 0x7f7fa0106730 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.808+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa0109c70 con 0x7f7fa0106730 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.808+0000 7f7f87fff700 1 --2- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7f880383b0 0x7f7f8803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.809+0000 7f7f87fff700 1 -- 172.21.15.88:0/2008035963 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7f9004c660 con 0x7f7fa0106730 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.809+0000 7f7f9e7fc700 1 --2- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7f880383b0 0x7f7f8803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.809+0000 7f7f9e7fc700 1 --2- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7f880383b0 0x7f7f8803a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f94006fd0 tx=0x7f7f94006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:34.813+0000 7f7f87fff700 1 -- 172.21.15.88:0/2008035963 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7f9002b750 con 0x7f7fa0106730 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.003+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fa0101640 con 0x7f7f880383b0 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.004+0000 7f7f87fff700 1 -- 172.21.15.88:0/2008035963 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f7fa0101640 con 0x7f7f880383b0 2024-09-13T21:31:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7f880383b0 msgr2=0x7f7f8803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 --2- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7f880383b0 0x7f7f8803a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f94006fd0 tx=0x7f7f94006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 msgr2=0x7f7fa0106090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 --2- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0106090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f90006af0 tx=0x7f7f90011a90 comp rx=0 tx=0).stop 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 shutdown_connections 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 --2- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7f880383b0 0x7f7f8803a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 --2- 172.21.15.88:0/2008035963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa0106730 0x7f7fa0106090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 >> 172.21.15.88:0/2008035963 conn(0x7f7fa0100130 msgr2=0x7f7fa0100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 shutdown_connections 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:35.006+0000 7f7fa573d700 1 -- 172.21.15.88:0/2008035963 wait complete. 2024-09-13T21:31:35.612 INFO:teuthology.orchestra.run.smithi088.stdout:Generating ssh key... 2024-09-13T21:31:35.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:35 smithi088 ceph-mon[27963]: [13/Sep/2024:21:31:33] ENGINE Bus STARTING 2024-09-13T21:31:35.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:35 smithi088 ceph-mon[27963]: [13/Sep/2024:21:31:34] ENGINE Serving on https://172.21.15.88:7150 2024-09-13T21:31:35.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:35 smithi088 ceph-mon[27963]: [13/Sep/2024:21:31:34] ENGINE Serving on http://172.21.15.88:8765 2024-09-13T21:31:35.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:35 smithi088 ceph-mon[27963]: [13/Sep/2024:21:31:34] ENGINE Bus STARTED 2024-09-13T21:31:37.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:36 smithi088 ceph-mon[27963]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:37.049 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:36 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:37.049 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:36 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.051+0000 7f7e62881700 1 Processor -- start 2024-09-13T21:31:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.051+0000 7f7e62881700 1 -- start start 2024-09-13T21:31:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.051+0000 7f7e62881700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.051+0000 7f7e62881700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c079d40 con 0x7f7e5c1066f0 2024-09-13T21:31:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.051+0000 7f7e5bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.051+0000 7f7e5bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47572/0 (socket says 172.21.15.88:47572) 2024-09-13T21:31:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.051+0000 7f7e5bfff700 1 -- 172.21.15.88:0/1271119241 learned_addr learned my addr 172.21.15.88:0/1271119241 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.051+0000 7f7e5bfff700 1 -- 172.21.15.88:0/1271119241 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c079e80 con 0x7f7e5c1066f0 2024-09-13T21:31:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.051+0000 7f7e5bfff700 1 --2- 172.21.15.88:0/1271119241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c108ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0098a0 tx=0x7f7e4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7a068bcaa360a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e5affd700 1 -- 172.21.15.88:0/1271119241 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e4c004180 con 0x7f7e5c1066f0 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e5affd700 1 -- 172.21.15.88:0/1271119241 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7e4c0042e0 con 0x7f7e5c1066f0 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e5affd700 1 -- 172.21.15.88:0/1271119241 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e4c011a50 con 0x7f7e5c1066f0 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e62881700 1 -- 172.21.15.88:0/1271119241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 msgr2=0x7f7e5c108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e62881700 1 --2- 172.21.15.88:0/1271119241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c108ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0098a0 tx=0x7f7e4c009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e62881700 1 -- 172.21.15.88:0/1271119241 shutdown_connections 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e62881700 1 --2- 172.21.15.88:0/1271119241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c108ad0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e62881700 1 -- 172.21.15.88:0/1271119241 >> 172.21.15.88:0/1271119241 conn(0x7f7e5c1000f0 msgr2=0x7f7e5c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e62881700 1 -- 172.21.15.88:0/1271119241 shutdown_connections 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.052+0000 7f7e62881700 1 -- 172.21.15.88:0/1271119241 wait complete. 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.053+0000 7f7e62881700 1 Processor -- start 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.053+0000 7f7e62881700 1 -- start start 2024-09-13T21:31:37.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.053+0000 7f7e62881700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.053+0000 7f7e62881700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c199e20 con 0x7f7e5c1066f0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.053+0000 7f7e5bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.053+0000 7f7e5bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c1998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47578/0 (socket says 172.21.15.88:47578) 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.053+0000 7f7e5bfff700 1 -- 172.21.15.88:0/2288437142 learned_addr learned my addr 172.21.15.88:0/2288437142 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.053+0000 7f7e5bfff700 1 -- 172.21.15.88:0/2288437142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c009550 con 0x7f7e5c1066f0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.053+0000 7f7e5bfff700 1 --2- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c1998e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c000c00 tx=0x7f7e4c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.054+0000 7f7e597fa700 1 -- 172.21.15.88:0/2288437142 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e4c003b90 con 0x7f7e5c1066f0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.054+0000 7f7e597fa700 1 -- 172.21.15.88:0/2288437142 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7e4c0248b0 con 0x7f7e5c1066f0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.054+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5c19a020 con 0x7f7e5c1066f0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.054+0000 7f7e597fa700 1 -- 172.21.15.88:0/2288437142 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e4c01a8e0 con 0x7f7e5c1066f0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.054+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c19a440 con 0x7f7e5c1066f0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.054+0000 7f7e597fa700 1 -- 172.21.15.88:0/2288437142 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7e4c01ab50 con 0x7f7e5c1066f0 2024-09-13T21:31:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.055+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5c062380 con 0x7f7e5c1066f0 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.055+0000 7f7e597fa700 1 --2- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e48038440 0x7f7e4803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.055+0000 7f7e597fa700 1 -- 172.21.15.88:0/2288437142 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7e4c04c380 con 0x7f7e5c1066f0 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.055+0000 7f7e5b7fe700 1 --2- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e48038440 0x7f7e4803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.055+0000 7f7e5b7fe700 1 --2- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e48038440 0x7f7e4803a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7e44006fd0 tx=0x7f7e44006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.059+0000 7f7e597fa700 1 -- 172.21.15.88:0/2288437142 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7e4c0233a0 con 0x7f7e5c1066f0 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.248+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e5c1023b0 con 0x7f7e48038440 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.411+0000 7f7e597fa700 1 -- 172.21.15.88:0/2288437142 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7e5c1023b0 con 0x7f7e48038440 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.413+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e48038440 msgr2=0x7f7e4803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.413+0000 7f7e62881700 1 --2- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e48038440 0x7f7e4803a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7e44006fd0 tx=0x7f7e44006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.413+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 msgr2=0x7f7e5c1998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.413+0000 7f7e62881700 1 --2- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c1998e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c000c00 tx=0x7f7e4c011ab0 comp rx=0 tx=0).stop 2024-09-13T21:31:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.414+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 shutdown_connections 2024-09-13T21:31:37.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.414+0000 7f7e62881700 1 --2- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e48038440 0x7f7e4803a8f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:37.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.414+0000 7f7e62881700 1 --2- 172.21.15.88:0/2288437142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5c1066f0 0x7f7e5c1998e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:37.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.414+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 >> 172.21.15.88:0/2288437142 conn(0x7f7e5c1000f0 msgr2=0x7f7e5c101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:37.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.414+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 shutdown_connections 2024-09-13T21:31:37.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:36.414+0000 7f7e62881700 1 -- 172.21.15.88:0/2288437142 wait complete. 2024-09-13T21:31:37.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:37 smithi088 ceph-mon[27963]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:37.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:37 smithi088 ceph-mon[27963]: Generating ssh key... 2024-09-13T21:31:38.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcMZxxpCyHyxx8jjEnVf7O6IgGa1QHzvT2w1V+MVZJdJ2kP0BFdkNpxiy5R6rz8VYwRjf4FgDm3/ForXH23y59cW1UVYnDWwFxsXPgCiLHawXZ0oyxO0Qc8Hstrtl8qRL8SbWomoWUBRHQ+ERSrMfMnnNm+DSiUp8VqMOTNVC+Av8UeU6g4kGts+SZkZDRcKp8QzYz+rzYSxWgt8/0DVf4jksQgBGY2s+9Z+PVQebXQ/ZqoGcLwmEJ3Z6p2KiIv4bki7+XYkMOQ6aYIobJw6GHCt/M5fELgNlBHkZjeJvIGkrTjXLAqKsjyxhzCNODPMD9i6ga5dxdwAAApdvTII8TWST1elEENl/mw6/wBrW25Fz104dbAEFxl0fbN/91U98GuKBuFPKYEEjDJzoQNPnJmaaQo3sTbf8euQHDc6aGamKyObS2gorqr5VNU62d1NRAR4jWVSU6QEdePehidTGRaG+ZoSUpfT8bZx9phSIfQpvxQxkGT1EabRQZa2BFC+8= ceph-67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:31:38.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.499+0000 7f9c6130c700 1 Processor -- start 2024-09-13T21:31:38.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.499+0000 7f9c6130c700 1 -- start start 2024-09-13T21:31:38.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.499+0000 7f9c6130c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:38.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.499+0000 7f9c6130c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c105430 con 0x7f9c5c104ae0 2024-09-13T21:31:38.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.499+0000 7f9c5affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:38.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.499+0000 7f9c5affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47588/0 (socket says 172.21.15.88:47588) 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.499+0000 7f9c5affd700 1 -- 172.21.15.88:0/3920022311 learned_addr learned my addr 172.21.15.88:0/3920022311 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.499+0000 7f9c5affd700 1 -- 172.21.15.88:0/3920022311 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c105570 con 0x7f9c5c104ae0 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c5affd700 1 --2- 172.21.15.88:0/3920022311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c104ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0098a0 tx=0x7f9c4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b56a41c3d0d91a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c59ffb700 1 -- 172.21.15.88:0/3920022311 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c4c004180 con 0x7f9c5c104ae0 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c59ffb700 1 -- 172.21.15.88:0/3920022311 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9c4c0042e0 con 0x7f9c5c104ae0 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c59ffb700 1 -- 172.21.15.88:0/3920022311 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c4c011a50 con 0x7f9c5c104ae0 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c6130c700 1 -- 172.21.15.88:0/3920022311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 msgr2=0x7f9c5c104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c6130c700 1 --2- 172.21.15.88:0/3920022311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c104ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0098a0 tx=0x7f9c4c009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c6130c700 1 -- 172.21.15.88:0/3920022311 shutdown_connections 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c6130c700 1 --2- 172.21.15.88:0/3920022311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c104ef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c6130c700 1 -- 172.21.15.88:0/3920022311 >> 172.21.15.88:0/3920022311 conn(0x7f9c5c100130 msgr2=0x7f9c5c102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:38.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c6130c700 1 -- 172.21.15.88:0/3920022311 shutdown_connections 2024-09-13T21:31:38.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.500+0000 7f9c6130c700 1 -- 172.21.15.88:0/3920022311 wait complete. 2024-09-13T21:31:38.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.501+0000 7f9c6130c700 1 Processor -- start 2024-09-13T21:31:38.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.501+0000 7f9c6130c700 1 -- start start 2024-09-13T21:31:38.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.501+0000 7f9c6130c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:38.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.501+0000 7f9c6130c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c199e40 con 0x7f9c5c104ae0 2024-09-13T21:31:38.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.501+0000 7f9c5affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:38.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.502+0000 7f9c5affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47596/0 (socket says 172.21.15.88:47596) 2024-09-13T21:31:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.502+0000 7f9c5affd700 1 -- 172.21.15.88:0/103203301 learned_addr learned my addr 172.21.15.88:0/103203301 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.502+0000 7f9c5affd700 1 -- 172.21.15.88:0/103203301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009550 con 0x7f9c5c104ae0 2024-09-13T21:31:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.502+0000 7f9c5affd700 1 --2- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c199900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c000c00 tx=0x7f9c4c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.502+0000 7f9c43fff700 1 -- 172.21.15.88:0/103203301 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c4c003b90 con 0x7f9c5c104ae0 2024-09-13T21:31:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.502+0000 7f9c43fff700 1 -- 172.21.15.88:0/103203301 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9c4c0248b0 con 0x7f9c5c104ae0 2024-09-13T21:31:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.502+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c19a040 con 0x7f9c5c104ae0 2024-09-13T21:31:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.502+0000 7f9c43fff700 1 -- 172.21.15.88:0/103203301 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c4c01a8e0 con 0x7f9c5c104ae0 2024-09-13T21:31:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.502+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c19a460 con 0x7f9c5c104ae0 2024-09-13T21:31:38.353 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.503+0000 7f9c43fff700 1 -- 172.21.15.88:0/103203301 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9c4c01aba0 con 0x7f9c5c104ae0 2024-09-13T21:31:38.353 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.503+0000 7f9c43fff700 1 --2- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9c440383f0 0x7f9c4403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:38.353 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.503+0000 7f9c43fff700 1 -- 172.21.15.88:0/103203301 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9c4c04c420 con 0x7f9c5c104ae0 2024-09-13T21:31:38.353 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.503+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c062380 con 0x7f9c5c104ae0 2024-09-13T21:31:38.353 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.503+0000 7f9c5a7fc700 1 --2- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9c440383f0 0x7f9c4403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:38.353 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.504+0000 7f9c5a7fc700 1 --2- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9c440383f0 0x7f9c4403a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006fd0 tx=0x7f9c50006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:38.354 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.508+0000 7f9c43fff700 1 -- 172.21.15.88:0/103203301 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9c4c048080 con 0x7f9c5c104ae0 2024-09-13T21:31:38.354 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.698+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c5c1022c0 con 0x7f9c440383f0 2024-09-13T21:31:38.354 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.699+0000 7f9c43fff700 1 -- 172.21.15.88:0/103203301 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f9c5c1022c0 con 0x7f9c440383f0 2024-09-13T21:31:38.354 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9c440383f0 msgr2=0x7f9c4403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:38.354 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 --2- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9c440383f0 0x7f9c4403a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006fd0 tx=0x7f9c50006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:38.354 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 msgr2=0x7f9c5c199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:38.354 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 --2- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c199900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c000c00 tx=0x7f9c4c011ab0 comp rx=0 tx=0).stop 2024-09-13T21:31:38.354 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 shutdown_connections 2024-09-13T21:31:38.354 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 --2- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9c440383f0 0x7f9c4403a8a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:38.355 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 --2- 172.21.15.88:0/103203301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c5c104ae0 0x7f9c5c199900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:38.355 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 >> 172.21.15.88:0/103203301 conn(0x7f9c5c100130 msgr2=0x7f9c5c079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:38.355 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 shutdown_connections 2024-09-13T21:31:38.355 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:37.701+0000 7f9c6130c700 1 -- 172.21.15.88:0/103203301 wait complete. 2024-09-13T21:31:38.355 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T21:31:38.355 INFO:teuthology.orchestra.run.smithi088.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T21:31:38.355 INFO:teuthology.orchestra.run.smithi088.stdout:Adding host smithi088... 2024-09-13T21:31:38.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:38 smithi088 ceph-mon[27963]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:40.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:39 smithi088 ceph-mon[27963]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi088", "addr": "172.21.15.88", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:40.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:39 smithi088 ceph-mon[27963]: Deploying cephadm binary to smithi088 2024-09-13T21:31:41.987 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Added host 'smithi088' with addr '172.21.15.88' 2024-09-13T21:31:41.987 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.783+0000 7f86fab41700 1 Processor -- start 2024-09-13T21:31:41.987 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.783+0000 7f86fab41700 1 -- start start 2024-09-13T21:31:41.987 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.783+0000 7f86fab41700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f4106470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:41.987 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.783+0000 7f86fab41700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41069b0 con 0x7f86f4106060 2024-09-13T21:31:41.988 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.783+0000 7f86f88dd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f4106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:41.988 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.783+0000 7f86f88dd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f4106470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47612/0 (socket says 172.21.15.88:47612) 2024-09-13T21:31:41.988 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.783+0000 7f86f88dd700 1 -- 172.21.15.88:0/1954600745 learned_addr learned my addr 172.21.15.88:0/1954600745 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:41.988 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.783+0000 7f86f88dd700 1 -- 172.21.15.88:0/1954600745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f4106af0 con 0x7f86f4106060 2024-09-13T21:31:41.988 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86f88dd700 1 --2- 172.21.15.88:0/1954600745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f4106470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86e80098a0 tx=0x7f86e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ed0500b8167def server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:41.988 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86f37fe700 1 -- 172.21.15.88:0/1954600745 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86e8004180 con 0x7f86f4106060 2024-09-13T21:31:41.988 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86f37fe700 1 -- 172.21.15.88:0/1954600745 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f86e80042e0 con 0x7f86f4106060 2024-09-13T21:31:41.988 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86f37fe700 1 -- 172.21.15.88:0/1954600745 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86e8011a50 con 0x7f86f4106060 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86fab41700 1 -- 172.21.15.88:0/1954600745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 msgr2=0x7f86f4106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86fab41700 1 --2- 172.21.15.88:0/1954600745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f4106470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86e80098a0 tx=0x7f86e8009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86fab41700 1 -- 172.21.15.88:0/1954600745 shutdown_connections 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86fab41700 1 --2- 172.21.15.88:0/1954600745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f4106470 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86fab41700 1 -- 172.21.15.88:0/1954600745 >> 172.21.15.88:0/1954600745 conn(0x7f86f40ff870 msgr2=0x7f86f4101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86fab41700 1 -- 172.21.15.88:0/1954600745 shutdown_connections 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.784+0000 7f86fab41700 1 -- 172.21.15.88:0/1954600745 wait complete. 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.785+0000 7f86fab41700 1 Processor -- start 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.785+0000 7f86fab41700 1 -- start start 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.785+0000 7f86fab41700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f41998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.785+0000 7f86fab41700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4199e10 con 0x7f86f4106060 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.785+0000 7f86f88dd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f41998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:41.989 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.785+0000 7f86f88dd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f41998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47618/0 (socket says 172.21.15.88:47618) 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.785+0000 7f86f88dd700 1 -- 172.21.15.88:0/3647880023 learned_addr learned my addr 172.21.15.88:0/3647880023 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.786+0000 7f86f88dd700 1 -- 172.21.15.88:0/3647880023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e8009550 con 0x7f86f4106060 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.786+0000 7f86f88dd700 1 --2- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f41998d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f86e80119e0 tx=0x7f86e8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.786+0000 7f86f1ffb700 1 -- 172.21.15.88:0/3647880023 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86e8003b90 con 0x7f86f4106060 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.786+0000 7f86f1ffb700 1 -- 172.21.15.88:0/3647880023 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f86e801a8a0 con 0x7f86f4106060 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.786+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f419a010 con 0x7f86f4106060 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.786+0000 7f86f1ffb700 1 -- 172.21.15.88:0/3647880023 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86e8019930 con 0x7f86f4106060 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.786+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f419a430 con 0x7f86f4106060 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.787+0000 7f86f1ffb700 1 -- 172.21.15.88:0/3647880023 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f86e801aa10 con 0x7f86f4106060 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.787+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f4108f10 con 0x7f86f4106060 2024-09-13T21:31:41.990 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.787+0000 7f86f1ffb700 1 --2- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f86e4038400 0x7f86e403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.787+0000 7f86f1ffb700 1 -- 172.21.15.88:0/3647880023 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f86e804c680 con 0x7f86f4106060 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.787+0000 7f86f3fff700 1 --2- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f86e4038400 0x7f86e403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.788+0000 7f86f3fff700 1 --2- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f86e4038400 0x7f86e403a8b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86e0006fd0 tx=0x7f86e0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.792+0000 7f86f1ffb700 1 -- 172.21.15.88:0/3647880023 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f86e8018530 con 0x7f86f4106060 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:38.992+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi088", "addr": "172.21.15.88", "target": ["mon-mgr", ""]}) v1 -- 0x7f86f4101a10 con 0x7f86e4038400 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.314+0000 7f86f1ffb700 1 -- 172.21.15.88:0/3647880023 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f86f4101a10 con 0x7f86e4038400 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f86e4038400 msgr2=0x7f86e403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 --2- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f86e4038400 0x7f86e403a8b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86e0006fd0 tx=0x7f86e0006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 msgr2=0x7f86f41998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:41.991 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 --2- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f41998d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f86e80119e0 tx=0x7f86e8011ac0 comp rx=0 tx=0).stop 2024-09-13T21:31:41.992 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 shutdown_connections 2024-09-13T21:31:41.992 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 --2- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f86e4038400 0x7f86e403a8b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:41.992 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 --2- 172.21.15.88:0/3647880023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f4106060 0x7f86f41998d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:41.992 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 >> 172.21.15.88:0/3647880023 conn(0x7f86f40ff870 msgr2=0x7f86f4104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:41.992 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 shutdown_connections 2024-09-13T21:31:41.992 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:41.317+0000 7f86fab41700 1 -- 172.21.15.88:0/3647880023 wait complete. 2024-09-13T21:31:41.992 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying mon service with default placement... 2024-09-13T21:31:42.599 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:42 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:42.599 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:42 smithi088 ceph-mon[27963]: Added host smithi088 2024-09-13T21:31:42.599 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:42 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:31:43.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:43 smithi088 ceph-mon[27963]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:43.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:43 smithi088 ceph-mon[27963]: Saving service mon spec with placement count:5 2024-09-13T21:31:43.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:43 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:43.999 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T21:31:43.999 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.432+0000 7f7513102700 1 Processor -- start 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.432+0000 7f7513102700 1 -- start start 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.432+0000 7f7513102700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.432+0000 7f7513102700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c1053d0 con 0x7f750c104a80 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.432+0000 7f7510e9e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.432+0000 7f7510e9e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38404/0 (socket says 172.21.15.88:38404) 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.432+0000 7f7510e9e700 1 -- 172.21.15.88:0/2788548116 learned_addr learned my addr 172.21.15.88:0/2788548116 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.432+0000 7f7510e9e700 1 -- 172.21.15.88:0/2788548116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c105510 con 0x7f750c104a80 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.432+0000 7f7510e9e700 1 --2- 172.21.15.88:0/2788548116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c104e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75040098a0 tx=0x7f7504009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cf1675e45eb176 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f750b7fe700 1 -- 172.21.15.88:0/2788548116 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7504004180 con 0x7f750c104a80 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f750b7fe700 1 -- 172.21.15.88:0/2788548116 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f75040042e0 con 0x7f750c104a80 2024-09-13T21:31:44.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f750b7fe700 1 -- 172.21.15.88:0/2788548116 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7504011a50 con 0x7f750c104a80 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f7513102700 1 -- 172.21.15.88:0/2788548116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 msgr2=0x7f750c104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f7513102700 1 --2- 172.21.15.88:0/2788548116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c104e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75040098a0 tx=0x7f7504009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f7513102700 1 -- 172.21.15.88:0/2788548116 shutdown_connections 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f7513102700 1 --2- 172.21.15.88:0/2788548116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c104e90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f7513102700 1 -- 172.21.15.88:0/2788548116 >> 172.21.15.88:0/2788548116 conn(0x7f750c1000f0 msgr2=0x7f750c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f7513102700 1 -- 172.21.15.88:0/2788548116 shutdown_connections 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.433+0000 7f7513102700 1 -- 172.21.15.88:0/2788548116 wait complete. 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.434+0000 7f7513102700 1 Processor -- start 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.434+0000 7f7513102700 1 -- start start 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.434+0000 7f7513102700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c079b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.434+0000 7f7513102700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c19c620 con 0x7f750c104a80 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.434+0000 7f7510e9e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c079b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.434+0000 7f7510e9e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c079b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38418/0 (socket says 172.21.15.88:38418) 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.434+0000 7f7510e9e700 1 -- 172.21.15.88:0/2293637914 learned_addr learned my addr 172.21.15.88:0/2293637914 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.434+0000 7f7510e9e700 1 -- 172.21.15.88:0/2293637914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504009550 con 0x7f750c104a80 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.435+0000 7f7510e9e700 1 --2- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c079b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75040119e0 tx=0x7f7504011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.435+0000 7f7509ffb700 1 -- 172.21.15.88:0/2293637914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7504003b90 con 0x7f750c104a80 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.435+0000 7f7509ffb700 1 -- 172.21.15.88:0/2293637914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f750401a8a0 con 0x7f750c104a80 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.435+0000 7f7509ffb700 1 -- 172.21.15.88:0/2293637914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7504019930 con 0x7f750c104a80 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.435+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c19c760 con 0x7f750c104a80 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.435+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c19cb80 con 0x7f750c104a80 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.436+0000 7f7509ffb700 1 -- 172.21.15.88:0/2293637914 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f750401aa10 con 0x7f750c104a80 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.436+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c062380 con 0x7f750c104a80 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.436+0000 7f7509ffb700 1 --2- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f74f8038400 0x7f74f803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.436+0000 7f7509ffb700 1 -- 172.21.15.88:0/2293637914 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f750404c680 con 0x7f750c104a80 2024-09-13T21:31:44.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.436+0000 7f750bfff700 1 --2- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f74f8038400 0x7f74f803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.436+0000 7f750bfff700 1 --2- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f74f8038400 0x7f74f803a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00ad30 tx=0x7f74fc0093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.441+0000 7f7509ffb700 1 -- 172.21.15.88:0/2293637914 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7504018530 con 0x7f750c104a80 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.653+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f750c102390 con 0x7f74f8038400 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.660+0000 7f7509ffb700 1 -- 172.21.15.88:0/2293637914 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f750c102390 con 0x7f74f8038400 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f74f8038400 msgr2=0x7f74f803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 --2- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f74f8038400 0x7f74f803a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00ad30 tx=0x7f74fc0093f0 comp rx=0 tx=0).stop 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 msgr2=0x7f750c079b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 --2- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c079b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75040119e0 tx=0x7f7504011ac0 comp rx=0 tx=0).stop 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 shutdown_connections 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 --2- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f74f8038400 0x7f74f803a8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 --2- 172.21.15.88:0/2293637914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f750c104a80 0x7f750c079b50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 >> 172.21.15.88:0/2293637914 conn(0x7f750c1000f0 msgr2=0x7f750c101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:44.004 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 shutdown_connections 2024-09-13T21:31:44.004 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:42.663+0000 7f7513102700 1 -- 172.21.15.88:0/2293637914 wait complete. 2024-09-13T21:31:44.004 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying mgr service with default placement... 2024-09-13T21:31:44.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:44 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:44.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:44 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:45.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:45 smithi088 ceph-mon[27963]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:45.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:45 smithi088 ceph-mon[27963]: Saving service mgr spec with placement count:2 2024-09-13T21:31:45.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:45 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:45.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:45 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.451+0000 7f1514ffb700 1 Processor -- start 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.451+0000 7f1514ffb700 1 -- start start 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.451+0000 7f1514ffb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.451+0000 7f1514ffb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510106590 con 0x7f1510105c40 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.451+0000 7f150e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.451+0000 7f150e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38428/0 (socket says 172.21.15.88:38428) 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.451+0000 7f150e59c700 1 -- 172.21.15.88:0/1698674406 learned_addr learned my addr 172.21.15.88:0/1698674406 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.452+0000 7f150e59c700 1 -- 172.21.15.88:0/1698674406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15101066d0 con 0x7f1510105c40 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.452+0000 7f150e59c700 1 --2- 172.21.15.88:0/1698674406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510106050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f15000098a0 tx=0x7f1500009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b367d74bff8e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:45.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.452+0000 7f150d59a700 1 -- 172.21.15.88:0/1698674406 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1500004180 con 0x7f1510105c40 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.452+0000 7f150d59a700 1 -- 172.21.15.88:0/1698674406 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f15000042e0 con 0x7f1510105c40 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.452+0000 7f150d59a700 1 -- 172.21.15.88:0/1698674406 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1500011af0 con 0x7f1510105c40 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.453+0000 7f1514ffb700 1 -- 172.21.15.88:0/1698674406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 msgr2=0x7f1510106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.453+0000 7f1514ffb700 1 --2- 172.21.15.88:0/1698674406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510106050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f15000098a0 tx=0x7f1500009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.453+0000 7f1514ffb700 1 -- 172.21.15.88:0/1698674406 shutdown_connections 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.453+0000 7f1514ffb700 1 --2- 172.21.15.88:0/1698674406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510106050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.453+0000 7f1514ffb700 1 -- 172.21.15.88:0/1698674406 >> 172.21.15.88:0/1698674406 conn(0x7f15101012b0 msgr2=0x7f15101036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.453+0000 7f1514ffb700 1 -- 172.21.15.88:0/1698674406 shutdown_connections 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.453+0000 7f1514ffb700 1 -- 172.21.15.88:0/1698674406 wait complete. 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.454+0000 7f1514ffb700 1 Processor -- start 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.454+0000 7f1514ffb700 1 -- start start 2024-09-13T21:31:45.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.454+0000 7f1514ffb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.454+0000 7f1514ffb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510199ea0 con 0x7f1510105c40 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.454+0000 7f150e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.454+0000 7f150e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38440/0 (socket says 172.21.15.88:38440) 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.454+0000 7f150e59c700 1 -- 172.21.15.88:0/1252564327 learned_addr learned my addr 172.21.15.88:0/1252564327 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.454+0000 7f150e59c700 1 -- 172.21.15.88:0/1252564327 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500009550 con 0x7f1510105c40 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.455+0000 7f150e59c700 1 --2- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510199960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1500011670 tx=0x7f1500011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.455+0000 7f14ff7fe700 1 -- 172.21.15.88:0/1252564327 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1500003a40 con 0x7f1510105c40 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.455+0000 7f14ff7fe700 1 -- 172.21.15.88:0/1252564327 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1500003ba0 con 0x7f1510105c40 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.455+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151019a0a0 con 0x7f1510105c40 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.455+0000 7f14ff7fe700 1 -- 172.21.15.88:0/1252564327 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1500024820 con 0x7f1510105c40 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.455+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151019a4c0 con 0x7f1510105c40 2024-09-13T21:31:45.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.456+0000 7f14ff7fe700 1 -- 172.21.15.88:0/1252564327 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1500024ae0 con 0x7f1510105c40 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.456+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1510062380 con 0x7f1510105c40 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.456+0000 7f14ff7fe700 1 --2- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f14f80383b0 0x7f14f803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.456+0000 7f14ff7fe700 1 -- 172.21.15.88:0/1252564327 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f150001ac70 con 0x7f1510105c40 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.456+0000 7f150dd9b700 1 --2- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f14f80383b0 0x7f14f803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.457+0000 7f150dd9b700 1 --2- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f14f80383b0 0x7f14f803a860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1504006fd0 tx=0x7f1504006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.461+0000 7f14ff7fe700 1 -- 172.21.15.88:0/1252564327 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1500022310 con 0x7f1510105c40 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.685+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f15101035e0 con 0x7f14f80383b0 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.689+0000 7f14ff7fe700 1 -- 172.21.15.88:0/1252564327 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f15101035e0 con 0x7f14f80383b0 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f14f80383b0 msgr2=0x7f14f803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 --2- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f14f80383b0 0x7f14f803a860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1504006fd0 tx=0x7f1504006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 msgr2=0x7f1510199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:45.912 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 --2- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510199960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1500011670 tx=0x7f1500011aa0 comp rx=0 tx=0).stop 2024-09-13T21:31:45.913 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 shutdown_connections 2024-09-13T21:31:45.913 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 --2- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f14f80383b0 0x7f14f803a860 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:45.913 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 --2- 172.21.15.88:0/1252564327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1510105c40 0x7f1510199960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:45.913 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 >> 172.21.15.88:0/1252564327 conn(0x7f15101012b0 msgr2=0x7f15101029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:45.913 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 shutdown_connections 2024-09-13T21:31:45.913 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:44.691+0000 7f1514ffb700 1 -- 172.21.15.88:0/1252564327 wait complete. 2024-09-13T21:31:45.913 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying crash service with default placement... 2024-09-13T21:31:47.233 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T21:31:47.233 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.366+0000 7f54ac0f2700 1 Processor -- start 2024-09-13T21:31:47.233 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.366+0000 7f54ac0f2700 1 -- start start 2024-09-13T21:31:47.233 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.366+0000 7f54ac0f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:47.233 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.366+0000 7f54ac0f2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a41047f0 con 0x7f54a4103ea0 2024-09-13T21:31:47.234 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.367+0000 7f54a9e8e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:47.234 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.367+0000 7f54a9e8e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38452/0 (socket says 172.21.15.88:38452) 2024-09-13T21:31:47.234 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.367+0000 7f54a9e8e700 1 -- 172.21.15.88:0/2955229802 learned_addr learned my addr 172.21.15.88:0/2955229802 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:47.234 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.367+0000 7f54a9e8e700 1 -- 172.21.15.88:0/2955229802 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a4104930 con 0x7f54a4103ea0 2024-09-13T21:31:47.234 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.367+0000 7f54a9e8e700 1 --2- 172.21.15.88:0/2955229802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41042b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f549c009e80 tx=0x7f549c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76b8db46e9d0c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:47.234 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.368+0000 7f54a8e8c700 1 -- 172.21.15.88:0/2955229802 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f549c00e070 con 0x7f54a4103ea0 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.368+0000 7f54a8e8c700 1 -- 172.21.15.88:0/2955229802 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f549c00b8c0 con 0x7f54a4103ea0 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.368+0000 7f54a8e8c700 1 -- 172.21.15.88:0/2955229802 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f549c0044d0 con 0x7f54a4103ea0 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.368+0000 7f54ac0f2700 1 -- 172.21.15.88:0/2955229802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 msgr2=0x7f54a41042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.368+0000 7f54ac0f2700 1 --2- 172.21.15.88:0/2955229802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41042b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f549c009e80 tx=0x7f549c00b330 comp rx=0 tx=0).stop 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.368+0000 7f54ac0f2700 1 -- 172.21.15.88:0/2955229802 shutdown_connections 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.368+0000 7f54ac0f2700 1 --2- 172.21.15.88:0/2955229802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41042b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.368+0000 7f54ac0f2700 1 -- 172.21.15.88:0/2955229802 >> 172.21.15.88:0/2955229802 conn(0x7f54a40ff880 msgr2=0x7f54a4101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.369+0000 7f54ac0f2700 1 -- 172.21.15.88:0/2955229802 shutdown_connections 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.369+0000 7f54ac0f2700 1 -- 172.21.15.88:0/2955229802 wait complete. 2024-09-13T21:31:47.235 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.369+0000 7f54ac0f2700 1 Processor -- start 2024-09-13T21:31:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.369+0000 7f54ac0f2700 1 -- start start 2024-09-13T21:31:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.369+0000 7f54ac0f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.369+0000 7f54ac0f2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4199e30 con 0x7f54a4103ea0 2024-09-13T21:31:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.369+0000 7f54a9e8e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.369+0000 7f54a9e8e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38462/0 (socket says 172.21.15.88:38462) 2024-09-13T21:31:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.370+0000 7f54a9e8e700 1 -- 172.21.15.88:0/931488825 learned_addr learned my addr 172.21.15.88:0/931488825 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.370+0000 7f54a9e8e700 1 -- 172.21.15.88:0/931488825 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c009b30 con 0x7f54a4103ea0 2024-09-13T21:31:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.370+0000 7f54a9e8e700 1 --2- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41998f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f549c0072a0 tx=0x7f549c0049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:47.236 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.370+0000 7f54a2ffd700 1 -- 172.21.15.88:0/931488825 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f549c00e040 con 0x7f54a4103ea0 2024-09-13T21:31:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.370+0000 7f54a2ffd700 1 -- 172.21.15.88:0/931488825 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f549c00bd80 con 0x7f54a4103ea0 2024-09-13T21:31:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.370+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a419a030 con 0x7f54a4103ea0 2024-09-13T21:31:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.370+0000 7f54a2ffd700 1 -- 172.21.15.88:0/931488825 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f549c0126c0 con 0x7f54a4103ea0 2024-09-13T21:31:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.370+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a419a4b0 con 0x7f54a4103ea0 2024-09-13T21:31:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.371+0000 7f54a2ffd700 1 -- 172.21.15.88:0/931488825 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f549c019040 con 0x7f54a4103ea0 2024-09-13T21:31:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.371+0000 7f54a2ffd700 1 --2- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f548c0383b0 0x7f548c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.371+0000 7f54a2ffd700 1 -- 172.21.15.88:0/931488825 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f549c04cd80 con 0x7f54a4103ea0 2024-09-13T21:31:47.237 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.371+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a4062380 con 0x7f54a4103ea0 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.372+0000 7f54a968d700 1 --2- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f548c0383b0 0x7f548c03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.372+0000 7f54a968d700 1 --2- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f548c0383b0 0x7f548c03a860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5498006fd0 tx=0x7f5498006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.376+0000 7f54a2ffd700 1 -- 172.21.15.88:0/931488825 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f549c01f080 con 0x7f54a4103ea0 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.589+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f54a4100d50 con 0x7f548c0383b0 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.595+0000 7f54a2ffd700 1 -- 172.21.15.88:0/931488825 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f54a4100d50 con 0x7f548c0383b0 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f548c0383b0 msgr2=0x7f548c03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 --2- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f548c0383b0 0x7f548c03a860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5498006fd0 tx=0x7f5498006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 msgr2=0x7f54a41998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 --2- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41998f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f549c0072a0 tx=0x7f549c0049f0 comp rx=0 tx=0).stop 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 shutdown_connections 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 --2- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f548c0383b0 0x7f548c03a860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 --2- 172.21.15.88:0/931488825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54a4103ea0 0x7f54a41998f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:47.238 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 >> 172.21.15.88:0/931488825 conn(0x7f54a40ff880 msgr2=0x7f54a4100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:47.239 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 shutdown_connections 2024-09-13T21:31:47.239 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:46.597+0000 7f54ac0f2700 1 -- 172.21.15.88:0/931488825 wait complete. 2024-09-13T21:31:47.239 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying ceph-exporter service with default placement... 2024-09-13T21:31:47.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:47 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:47 smithi088 ceph-mon[27963]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:47 smithi088 ceph-mon[27963]: Saving service crash spec with placement * 2024-09-13T21:31:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:47 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:48.925 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-13T21:31:48.925 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.685+0000 7f3489883700 1 Processor -- start 2024-09-13T21:31:48.925 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.685+0000 7f3489883700 1 -- start start 2024-09-13T21:31:48.925 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3489883700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:48.925 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3489883700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484074460 con 0x7f34841066d0 2024-09-13T21:31:48.925 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3482ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3482ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38464/0 (socket says 172.21.15.88:38464) 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3482ffd700 1 -- 172.21.15.88:0/1877941515 learned_addr learned my addr 172.21.15.88:0/1877941515 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3482ffd700 1 -- 172.21.15.88:0/1877941515 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840745a0 con 0x7f34841066d0 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3482ffd700 1 --2- 172.21.15.88:0/1877941515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484108ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34740098a0 tx=0x7f3474009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487df22d67569a9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3481ffb700 1 -- 172.21.15.88:0/1877941515 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3474004180 con 0x7f34841066d0 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3481ffb700 1 -- 172.21.15.88:0/1877941515 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f34740042e0 con 0x7f34841066d0 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.686+0000 7f3481ffb700 1 -- 172.21.15.88:0/1877941515 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3474011af0 con 0x7f34841066d0 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.687+0000 7f3489883700 1 -- 172.21.15.88:0/1877941515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 msgr2=0x7f3484108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.687+0000 7f3489883700 1 --2- 172.21.15.88:0/1877941515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484108ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34740098a0 tx=0x7f3474009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.687+0000 7f3489883700 1 -- 172.21.15.88:0/1877941515 shutdown_connections 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.687+0000 7f3489883700 1 --2- 172.21.15.88:0/1877941515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484108ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.687+0000 7f3489883700 1 -- 172.21.15.88:0/1877941515 >> 172.21.15.88:0/1877941515 conn(0x7f3484100110 msgr2=0x7f3484102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.687+0000 7f3489883700 1 -- 172.21.15.88:0/1877941515 shutdown_connections 2024-09-13T21:31:48.926 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.687+0000 7f3489883700 1 -- 172.21.15.88:0/1877941515 wait complete. 2024-09-13T21:31:48.927 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.688+0000 7f3489883700 1 Processor -- start 2024-09-13T21:31:48.927 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.688+0000 7f3489883700 1 -- start start 2024-09-13T21:31:48.927 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.688+0000 7f3489883700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:48.927 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.688+0000 7f3489883700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484199e50 con 0x7f34841066d0 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.688+0000 7f3482ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.688+0000 7f3482ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38468/0 (socket says 172.21.15.88:38468) 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.688+0000 7f3482ffd700 1 -- 172.21.15.88:0/2610838840 learned_addr learned my addr 172.21.15.88:0/2610838840 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.688+0000 7f3482ffd700 1 -- 172.21.15.88:0/2610838840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474009550 con 0x7f34841066d0 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.689+0000 7f3482ffd700 1 --2- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484199910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3474000c00 tx=0x7f3474011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.689+0000 7f3488881700 1 -- 172.21.15.88:0/2610838840 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3474003a70 con 0x7f34841066d0 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.689+0000 7f3488881700 1 -- 172.21.15.88:0/2610838840 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3474003bd0 con 0x7f34841066d0 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.689+0000 7f3488881700 1 -- 172.21.15.88:0/2610838840 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34740238c0 con 0x7f34841066d0 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.689+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348419a0b0 con 0x7f34841066d0 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.689+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348419a530 con 0x7f34841066d0 2024-09-13T21:31:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.690+0000 7f3488881700 1 -- 172.21.15.88:0/2610838840 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f347401a430 con 0x7f34841066d0 2024-09-13T21:31:48.929 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.690+0000 7f3488881700 1 --2- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3470038440 0x7f347003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:48.929 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.690+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3484109bf0 con 0x7f34841066d0 2024-09-13T21:31:48.929 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.690+0000 7f3488881700 1 -- 172.21.15.88:0/2610838840 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f347404c190 con 0x7f34841066d0 2024-09-13T21:31:48.929 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.690+0000 7f34827fc700 1 --2- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3470038440 0x7f347003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:48.929 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.690+0000 7f34827fc700 1 --2- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3470038440 0x7f347003a8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f346c006fd0 tx=0x7f346c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.695+0000 7f3488881700 1 -- 172.21.15.88:0/2610838840 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3474010560 con 0x7f34841066d0 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.910+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f3484102400 con 0x7f3470038440 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.914+0000 7f3488881700 1 -- 172.21.15.88:0/2610838840 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f3484102400 con 0x7f3470038440 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.916+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3470038440 msgr2=0x7f347003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.916+0000 7f3489883700 1 --2- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3470038440 0x7f347003a8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f346c006fd0 tx=0x7f346c006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.916+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 msgr2=0x7f3484199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.916+0000 7f3489883700 1 --2- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484199910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3474000c00 tx=0x7f3474011b50 comp rx=0 tx=0).stop 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.916+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 shutdown_connections 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.916+0000 7f3489883700 1 --2- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3470038440 0x7f347003a8f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.916+0000 7f3489883700 1 --2- 172.21.15.88:0/2610838840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34841066d0 0x7f3484199910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.916+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 >> 172.21.15.88:0/2610838840 conn(0x7f3484100110 msgr2=0x7f34841017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:48.930 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.917+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 shutdown_connections 2024-09-13T21:31:48.931 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:47.917+0000 7f3489883700 1 -- 172.21.15.88:0/2610838840 wait complete. 2024-09-13T21:31:48.931 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying prometheus service with default placement... 2024-09-13T21:31:49.126 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:48 smithi088 ceph-mon[27963]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:49.126 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:48 smithi088 ceph-mon[27963]: Saving service ceph-exporter spec with placement * 2024-09-13T21:31:49.126 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:48 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:50.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T21:31:50.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.364+0000 7fc3bcd59700 1 Processor -- start 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.364+0000 7fc3bcd59700 1 -- start start 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.364+0000 7fc3bcd59700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.364+0000 7fc3bcd59700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b81053d0 con 0x7fc3b8104a80 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.364+0000 7fc3b659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.365+0000 7fc3b659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38472/0 (socket says 172.21.15.88:38472) 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.365+0000 7fc3b659c700 1 -- 172.21.15.88:0/1253530874 learned_addr learned my addr 172.21.15.88:0/1253530874 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.365+0000 7fc3b659c700 1 -- 172.21.15.88:0/1253530874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8105510 con 0x7fc3b8104a80 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.365+0000 7fc3b659c700 1 --2- 172.21.15.88:0/1253530874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8104e90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80098a0 tx=0x7fc3a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a72b299968fbe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.365+0000 7fc3b5d9b700 1 -- 172.21.15.88:0/1253530874 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3a8004180 con 0x7fc3b8104a80 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.365+0000 7fc3b5d9b700 1 -- 172.21.15.88:0/1253530874 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3a80042e0 con 0x7fc3b8104a80 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.365+0000 7fc3b5d9b700 1 -- 172.21.15.88:0/1253530874 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3a8011af0 con 0x7fc3b8104a80 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.366+0000 7fc3bcd59700 1 -- 172.21.15.88:0/1253530874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 msgr2=0x7fc3b8104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:50.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.366+0000 7fc3bcd59700 1 --2- 172.21.15.88:0/1253530874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8104e90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80098a0 tx=0x7fc3a8009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.366+0000 7fc3bcd59700 1 -- 172.21.15.88:0/1253530874 shutdown_connections 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.366+0000 7fc3bcd59700 1 --2- 172.21.15.88:0/1253530874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8104e90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.366+0000 7fc3bcd59700 1 -- 172.21.15.88:0/1253530874 >> 172.21.15.88:0/1253530874 conn(0x7fc3b81000f0 msgr2=0x7fc3b8102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.366+0000 7fc3bcd59700 1 -- 172.21.15.88:0/1253530874 shutdown_connections 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.366+0000 7fc3bcd59700 1 -- 172.21.15.88:0/1253530874 wait complete. 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.366+0000 7fc3bcd59700 1 Processor -- start 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.367+0000 7fc3bcd59700 1 -- start start 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.367+0000 7fc3bcd59700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.367+0000 7fc3bcd59700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b8199e50 con 0x7fc3b8104a80 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.367+0000 7fc3b659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.367+0000 7fc3b659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38484/0 (socket says 172.21.15.88:38484) 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.367+0000 7fc3b659c700 1 -- 172.21.15.88:0/2195740448 learned_addr learned my addr 172.21.15.88:0/2195740448 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.367+0000 7fc3b659c700 1 -- 172.21.15.88:0/2195740448 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8009550 con 0x7fc3b8104a80 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.367+0000 7fc3b659c700 1 --2- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8199910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8006ba0 tx=0x7fc3a8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.367+0000 7fc3affff700 1 -- 172.21.15.88:0/2195740448 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3a8003b00 con 0x7fc3b8104a80 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.368+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b819a050 con 0x7fc3b8104a80 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.368+0000 7fc3affff700 1 -- 172.21.15.88:0/2195740448 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3a801a8e0 con 0x7fc3b8104a80 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.368+0000 7fc3affff700 1 -- 172.21.15.88:0/2195740448 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3a80199c0 con 0x7fc3b8104a80 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.368+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b819a470 con 0x7fc3b8104a80 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.368+0000 7fc3affff700 1 -- 172.21.15.88:0/2195740448 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc3a8019c80 con 0x7fc3b8104a80 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.368+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b8062380 con 0x7fc3b8104a80 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.369+0000 7fc3affff700 1 --2- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3a40383a0 0x7fc3a403a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.369+0000 7fc3affff700 1 -- 172.21.15.88:0/2195740448 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc3a804c5f0 con 0x7fc3b8104a80 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.369+0000 7fc3add9b700 1 --2- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3a40383a0 0x7fc3a403a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.369+0000 7fc3add9b700 1 --2- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3a40383a0 0x7fc3a403a850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0006fd0 tx=0x7fc3a0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.373+0000 7fc3affff700 1 -- 172.21.15.88:0/2195740448 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc3a802b700 con 0x7fc3b8104a80 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.579+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3b8108f10 con 0x7fc3a40383a0 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.584+0000 7fc3affff700 1 -- 172.21.15.88:0/2195740448 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fc3b8108f10 con 0x7fc3a40383a0 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3a40383a0 msgr2=0x7fc3a403a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 --2- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3a40383a0 0x7fc3a403a850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0006fd0 tx=0x7fc3a0006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 msgr2=0x7fc3b8199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 --2- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8199910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8006ba0 tx=0x7fc3a8011b50 comp rx=0 tx=0).stop 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 shutdown_connections 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 --2- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3a40383a0 0x7fc3a403a850 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 --2- 172.21.15.88:0/2195740448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b8104a80 0x7fc3b8199910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 >> 172.21.15.88:0/2195740448 conn(0x7fc3b81000f0 msgr2=0x7fc3b8079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 shutdown_connections 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:49.586+0000 7fc3bcd59700 1 -- 172.21.15.88:0/2195740448 wait complete. 2024-09-13T21:31:50.413 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying grafana service with default placement... 2024-09-13T21:31:50.705 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:50 smithi088 ceph-mon[27963]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:50.705 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:50 smithi088 ceph-mon[27963]: Saving service prometheus spec with placement count:1 2024-09-13T21:31:50.705 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:50 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:51.657 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T21:31:51.657 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.810+0000 7fc31c483700 1 Processor -- start 2024-09-13T21:31:51.657 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.810+0000 7fc31c483700 1 -- start start 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.810+0000 7fc31c483700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc314105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.810+0000 7fc31c483700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141064c0 con 0x7fc314105b70 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.810+0000 7fc31a21f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc314105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.810+0000 7fc31a21f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc314105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58886/0 (socket says 172.21.15.88:58886) 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.810+0000 7fc31a21f700 1 -- 172.21.15.88:0/1444724036 learned_addr learned my addr 172.21.15.88:0/1444724036 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.810+0000 7fc31a21f700 1 -- 172.21.15.88:0/1444724036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314106600 con 0x7fc314105b70 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.811+0000 7fc31a21f700 1 --2- 172.21.15.88:0/1444724036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc314105f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3100098a0 tx=0x7fc310009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bd6386f2b273d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.811+0000 7fc31921d700 1 -- 172.21.15.88:0/1444724036 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc310004180 con 0x7fc314105b70 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.811+0000 7fc31921d700 1 -- 172.21.15.88:0/1444724036 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3100042e0 con 0x7fc314105b70 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.811+0000 7fc31921d700 1 -- 172.21.15.88:0/1444724036 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc310011af0 con 0x7fc314105b70 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.811+0000 7fc31c483700 1 -- 172.21.15.88:0/1444724036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 msgr2=0x7fc314105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:51.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.811+0000 7fc31c483700 1 --2- 172.21.15.88:0/1444724036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc314105f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3100098a0 tx=0x7fc310009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.811+0000 7fc31c483700 1 -- 172.21.15.88:0/1444724036 shutdown_connections 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.811+0000 7fc31c483700 1 --2- 172.21.15.88:0/1444724036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc314105f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.811+0000 7fc31c483700 1 -- 172.21.15.88:0/1444724036 >> 172.21.15.88:0/1444724036 conn(0x7fc314101220 msgr2=0x7fc314103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.812+0000 7fc31c483700 1 -- 172.21.15.88:0/1444724036 shutdown_connections 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.812+0000 7fc31c483700 1 -- 172.21.15.88:0/1444724036 wait complete. 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.812+0000 7fc31c483700 1 Processor -- start 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.812+0000 7fc31c483700 1 -- start start 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.812+0000 7fc31c483700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc3141998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.812+0000 7fc31c483700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc314199e30 con 0x7fc314105b70 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.812+0000 7fc31a21f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc3141998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.812+0000 7fc31a21f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc3141998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58898/0 (socket says 172.21.15.88:58898) 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.812+0000 7fc31a21f700 1 -- 172.21.15.88:0/4041176822 learned_addr learned my addr 172.21.15.88:0/4041176822 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:51.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.813+0000 7fc31a21f700 1 -- 172.21.15.88:0/4041176822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310009550 con 0x7fc314105b70 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.813+0000 7fc31a21f700 1 --2- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc3141998f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc310006ba0 tx=0x7fc310011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.813+0000 7fc30b7fe700 1 -- 172.21.15.88:0/4041176822 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc310003b00 con 0x7fc314105b70 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.813+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31419a030 con 0x7fc314105b70 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.813+0000 7fc30b7fe700 1 -- 172.21.15.88:0/4041176822 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc31001a8e0 con 0x7fc314105b70 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.813+0000 7fc30b7fe700 1 -- 172.21.15.88:0/4041176822 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3100199c0 con 0x7fc314105b70 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.813+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31419a450 con 0x7fc314105b70 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.814+0000 7fc30b7fe700 1 -- 172.21.15.88:0/4041176822 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc310019c80 con 0x7fc314105b70 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.814+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31410a000 con 0x7fc314105b70 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.814+0000 7fc30b7fe700 1 --2- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3000383a0 0x7fc30003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.814+0000 7fc30b7fe700 1 -- 172.21.15.88:0/4041176822 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc31004c600 con 0x7fc314105b70 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.814+0000 7fc319a1e700 1 --2- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3000383a0 0x7fc30003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:51.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.815+0000 7fc319a1e700 1 --2- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3000383a0 0x7fc30003a850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc304006fd0 tx=0x7fc304006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:50.819+0000 7fc30b7fe700 1 -- 172.21.15.88:0/4041176822 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc31002d960 con 0x7fc314105b70 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.023+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fc314102700 con 0x7fc3000383a0 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.029+0000 7fc30b7fe700 1 -- 172.21.15.88:0/4041176822 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fc314102700 con 0x7fc3000383a0 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3000383a0 msgr2=0x7fc30003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 --2- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3000383a0 0x7fc30003a850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc304006fd0 tx=0x7fc304006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 msgr2=0x7fc3141998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 --2- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc3141998f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc310006ba0 tx=0x7fc310011b50 comp rx=0 tx=0).stop 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 shutdown_connections 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 --2- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc3000383a0 0x7fc30003a850 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 --2- 172.21.15.88:0/4041176822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc314105b70 0x7fc3141998f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 >> 172.21.15.88:0/4041176822 conn(0x7fc314101220 msgr2=0x7fc314101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 shutdown_connections 2024-09-13T21:31:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:51.031+0000 7fc31c483700 1 -- 172.21.15.88:0/4041176822 wait complete. 2024-09-13T21:31:51.662 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying node-exporter service with default placement... 2024-09-13T21:31:52.307 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:52 smithi088 ceph-mon[27963]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:52.307 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:52 smithi088 ceph-mon[27963]: Saving service grafana spec with placement count:1 2024-09-13T21:31:52.307 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:52 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:52.307 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:52 smithi088 ceph-mon[27963]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:31:52.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T21:31:52.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.096+0000 7fcbb42c0700 1 Processor -- start 2024-09-13T21:31:52.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.096+0000 7fcbb42c0700 1 -- start start 2024-09-13T21:31:52.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.096+0000 7fcbb42c0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:52.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.096+0000 7fcbb42c0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac1064c0 con 0x7fcbac105b70 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.096+0000 7fcbb205c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.096+0000 7fcbb205c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58902/0 (socket says 172.21.15.88:58902) 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.096+0000 7fcbb205c700 1 -- 172.21.15.88:0/1519437788 learned_addr learned my addr 172.21.15.88:0/1519437788 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.096+0000 7fcbb205c700 1 -- 172.21.15.88:0/1519437788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac106600 con 0x7fcbac105b70 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb205c700 1 --2- 172.21.15.88:0/1519437788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac105f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcba80098a0 tx=0x7fcba8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7000f15adbc91070 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb105a700 1 -- 172.21.15.88:0/1519437788 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcba8004180 con 0x7fcbac105b70 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb105a700 1 -- 172.21.15.88:0/1519437788 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcba80042e0 con 0x7fcbac105b70 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb105a700 1 -- 172.21.15.88:0/1519437788 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcba8011af0 con 0x7fcbac105b70 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb42c0700 1 -- 172.21.15.88:0/1519437788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 msgr2=0x7fcbac105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb42c0700 1 --2- 172.21.15.88:0/1519437788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac105f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcba80098a0 tx=0x7fcba8009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb42c0700 1 -- 172.21.15.88:0/1519437788 shutdown_connections 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb42c0700 1 --2- 172.21.15.88:0/1519437788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac105f80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb42c0700 1 -- 172.21.15.88:0/1519437788 >> 172.21.15.88:0/1519437788 conn(0x7fcbac101220 msgr2=0x7fcbac103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb42c0700 1 -- 172.21.15.88:0/1519437788 shutdown_connections 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.097+0000 7fcbb42c0700 1 -- 172.21.15.88:0/1519437788 wait complete. 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.098+0000 7fcbb42c0700 1 Processor -- start 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.098+0000 7fcbb42c0700 1 -- start start 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.098+0000 7fcbb42c0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.098+0000 7fcbb42c0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac199e30 con 0x7fcbac105b70 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.098+0000 7fcbb205c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.098+0000 7fcbb205c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac1998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58912/0 (socket says 172.21.15.88:58912) 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.098+0000 7fcbb205c700 1 -- 172.21.15.88:0/193773091 learned_addr learned my addr 172.21.15.88:0/193773091 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.099+0000 7fcbb205c700 1 -- 172.21.15.88:0/193773091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8009550 con 0x7fcbac105b70 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.099+0000 7fcbb205c700 1 --2- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac1998f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcba8006ba0 tx=0x7fcba8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.099+0000 7fcb9f7fe700 1 -- 172.21.15.88:0/193773091 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcba8003b00 con 0x7fcbac105b70 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.099+0000 7fcb9f7fe700 1 -- 172.21.15.88:0/193773091 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcba801a8e0 con 0x7fcbac105b70 2024-09-13T21:31:52.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.099+0000 7fcb9f7fe700 1 -- 172.21.15.88:0/193773091 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcba80199c0 con 0x7fcbac105b70 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.099+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac19a030 con 0x7fcbac105b70 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.099+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac19a450 con 0x7fcbac105b70 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.100+0000 7fcb9f7fe700 1 -- 172.21.15.88:0/193773091 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fcba8019c30 con 0x7fcbac105b70 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.100+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac10a000 con 0x7fcbac105b70 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.100+0000 7fcb9f7fe700 1 --2- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fcb980383f0 0x7fcb9803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.100+0000 7fcb9f7fe700 1 -- 172.21.15.88:0/193773091 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcba804c580 con 0x7fcbac105b70 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.100+0000 7fcbb185b700 1 --2- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fcb980383f0 0x7fcb9803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.100+0000 7fcbb185b700 1 --2- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fcb980383f0 0x7fcb9803a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcba0006fd0 tx=0x7fcba0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.105+0000 7fcb9f7fe700 1 -- 172.21.15.88:0/193773091 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcba801a430 con 0x7fcbac105b70 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.305+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbac102700 con 0x7fcb980383f0 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.310+0000 7fcb9f7fe700 1 -- 172.21.15.88:0/193773091 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fcbac102700 con 0x7fcb980383f0 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fcb980383f0 msgr2=0x7fcb9803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 --2- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fcb980383f0 0x7fcb9803a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcba0006fd0 tx=0x7fcba0006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:52.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 msgr2=0x7fcbac1998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:52.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 --2- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac1998f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcba8006ba0 tx=0x7fcba8011b50 comp rx=0 tx=0).stop 2024-09-13T21:31:52.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 shutdown_connections 2024-09-13T21:31:52.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 --2- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fcb980383f0 0x7fcb9803a8a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:52.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 --2- 172.21.15.88:0/193773091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbac105b70 0x7fcbac1998f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:52.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 >> 172.21.15.88:0/193773091 conn(0x7fcbac101220 msgr2=0x7fcbac101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:52.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 shutdown_connections 2024-09-13T21:31:52.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:52.312+0000 7fcbb42c0700 1 -- 172.21.15.88:0/193773091 wait complete. 2024-09-13T21:31:52.909 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying alertmanager service with default placement... 2024-09-13T21:31:53.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:53 smithi088 ceph-mon[27963]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:53.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:53 smithi088 ceph-mon[27963]: Saving service node-exporter spec with placement * 2024-09-13T21:31:53.566 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:53 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:54.120 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T21:31:54.120 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.352+0000 7fbb05fc7700 1 Processor -- start 2024-09-13T21:31:54.120 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.352+0000 7fbb05fc7700 1 -- start start 2024-09-13T21:31:54.120 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.352+0000 7fbb05fc7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb00106470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:54.120 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.352+0000 7fbb05fc7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb001069b0 con 0x7fbb00106060 2024-09-13T21:31:54.120 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.352+0000 7fbaff7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb00106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:54.120 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.352+0000 7fbaff7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb00106470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58924/0 (socket says 172.21.15.88:58924) 2024-09-13T21:31:54.120 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.353+0000 7fbaff7fe700 1 -- 172.21.15.88:0/1170740431 learned_addr learned my addr 172.21.15.88:0/1170740431 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.353+0000 7fbaff7fe700 1 -- 172.21.15.88:0/1170740431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00106af0 con 0x7fbb00106060 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.353+0000 7fbaff7fe700 1 --2- 172.21.15.88:0/1170740431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb00106470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009e80 tx=0x7fbaf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ab1421f6c3a0ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.353+0000 7fbafe7fc700 1 -- 172.21.15.88:0/1170740431 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf000e070 con 0x7fbb00106060 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.353+0000 7fbafe7fc700 1 -- 172.21.15.88:0/1170740431 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbaf000b8c0 con 0x7fbb00106060 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.353+0000 7fbafe7fc700 1 -- 172.21.15.88:0/1170740431 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf00044d0 con 0x7fbb00106060 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.354+0000 7fbb05fc7700 1 -- 172.21.15.88:0/1170740431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 msgr2=0x7fbb00106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.354+0000 7fbb05fc7700 1 --2- 172.21.15.88:0/1170740431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb00106470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009e80 tx=0x7fbaf000b330 comp rx=0 tx=0).stop 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.354+0000 7fbb05fc7700 1 -- 172.21.15.88:0/1170740431 shutdown_connections 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.354+0000 7fbb05fc7700 1 --2- 172.21.15.88:0/1170740431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb00106470 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.354+0000 7fbb05fc7700 1 -- 172.21.15.88:0/1170740431 >> 172.21.15.88:0/1170740431 conn(0x7fbb000ff870 msgr2=0x7fbb00101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.354+0000 7fbb05fc7700 1 -- 172.21.15.88:0/1170740431 shutdown_connections 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.354+0000 7fbb05fc7700 1 -- 172.21.15.88:0/1170740431 wait complete. 2024-09-13T21:31:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.354+0000 7fbb05fc7700 1 Processor -- start 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.354+0000 7fbb05fc7700 1 -- start start 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbb05fc7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb001998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbb05fc7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb00199df0 con 0x7fbb00106060 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbaff7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb001998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbaff7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb001998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58938/0 (socket says 172.21.15.88:58938) 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbaff7fe700 1 -- 172.21.15.88:0/3901766795 learned_addr learned my addr 172.21.15.88:0/3901766795 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbaff7fe700 1 -- 172.21.15.88:0/3901766795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf0009b30 con 0x7fbb00106060 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbaff7fe700 1 --2- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb001998b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00072a0 tx=0x7fbaf00049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbafcff9700 1 -- 172.21.15.88:0/3901766795 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf000e040 con 0x7fbb00106060 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb00199ff0 con 0x7fbb00106060 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbafcff9700 1 -- 172.21.15.88:0/3901766795 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbaf000bd80 con 0x7fbb00106060 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbafcff9700 1 -- 172.21.15.88:0/3901766795 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf00126c0 con 0x7fbb00106060 2024-09-13T21:31:54.122 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.355+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0019a470 con 0x7fbb00106060 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.356+0000 7fbafcff9700 1 -- 172.21.15.88:0/3901766795 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fbaf0019040 con 0x7fbb00106060 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.356+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb00062380 con 0x7fbb00106060 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.356+0000 7fbafcff9700 1 --2- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbae80383b0 0x7fbae803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.356+0000 7fbafcff9700 1 -- 172.21.15.88:0/3901766795 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbaf004bde0 con 0x7fbb00106060 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.356+0000 7fbafeffd700 1 --2- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbae80383b0 0x7fbae803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.357+0000 7fbafeffd700 1 --2- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbae80383b0 0x7fbae803a860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4006fd0 tx=0x7fbaf4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.361+0000 7fbafcff9700 1 -- 172.21.15.88:0/3901766795 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbaf001abc0 con 0x7fbb00106060 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.564+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb001019d0 con 0x7fbae80383b0 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.569+0000 7fbafcff9700 1 -- 172.21.15.88:0/3901766795 <== mgr.14118 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fbb001019d0 con 0x7fbae80383b0 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbae80383b0 msgr2=0x7fbae803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 --2- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbae80383b0 0x7fbae803a860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4006fd0 tx=0x7fbaf4006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:54.123 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 msgr2=0x7fbb001998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:54.124 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 --2- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb001998b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00072a0 tx=0x7fbaf00049f0 comp rx=0 tx=0).stop 2024-09-13T21:31:54.124 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 shutdown_connections 2024-09-13T21:31:54.124 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 --2- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbae80383b0 0x7fbae803a860 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:54.124 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 --2- 172.21.15.88:0/3901766795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb00106060 0x7fbb001998b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:54.124 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 >> 172.21.15.88:0/3901766795 conn(0x7fbb000ff870 msgr2=0x7fbb00104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:54.124 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 shutdown_connections 2024-09-13T21:31:54.124 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:53.571+0000 7fbb05fc7700 1 -- 172.21.15.88:0/3901766795 wait complete. 2024-09-13T21:31:54.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:54 smithi088 ceph-mon[27963]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:31:54.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:54 smithi088 ceph-mon[27963]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:31:54.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:54 smithi088 ceph-mon[27963]: Saving service alertmanager spec with placement count:1 2024-09-13T21:31:54.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:54 smithi088 ceph-mon[27963]: from='mgr.14118 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:31:55.342 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.540+0000 7f1e9a1cd700 1 Processor -- start 2024-09-13T21:31:55.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.540+0000 7f1e9a1cd700 1 -- start start 2024-09-13T21:31:55.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.540+0000 7f1e9a1cd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94104280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:55.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.540+0000 7f1e9a1cd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e941047c0 con 0x7f1e94103e70 2024-09-13T21:31:55.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.540+0000 7f1e937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:55.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.540+0000 7f1e937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94104280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58954/0 (socket says 172.21.15.88:58954) 2024-09-13T21:31:55.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.540+0000 7f1e937fe700 1 -- 172.21.15.88:0/4072841316 learned_addr learned my addr 172.21.15.88:0/4072841316 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.540+0000 7f1e937fe700 1 -- 172.21.15.88:0/4072841316 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e94104900 con 0x7f1e94103e70 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e937fe700 1 --2- 172.21.15.88:0/4072841316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94104280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e840098a0 tx=0x7f1e84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4598a7293be383 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e927fc700 1 -- 172.21.15.88:0/4072841316 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e84004180 con 0x7f1e94103e70 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e927fc700 1 -- 172.21.15.88:0/4072841316 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e840042e0 con 0x7f1e94103e70 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e927fc700 1 -- 172.21.15.88:0/4072841316 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e84011af0 con 0x7f1e94103e70 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/4072841316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 msgr2=0x7f1e94104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e9a1cd700 1 --2- 172.21.15.88:0/4072841316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94104280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e840098a0 tx=0x7f1e84009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/4072841316 shutdown_connections 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e9a1cd700 1 --2- 172.21.15.88:0/4072841316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94104280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/4072841316 >> 172.21.15.88:0/4072841316 conn(0x7f1e940ff870 msgr2=0x7f1e94101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:55.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/4072841316 shutdown_connections 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.541+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/4072841316 wait complete. 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.542+0000 7f1e9a1cd700 1 Processor -- start 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.542+0000 7f1e9a1cd700 1 -- start start 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.542+0000 7f1e9a1cd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.542+0000 7f1e9a1cd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94199e90 con 0x7f1e94103e70 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.542+0000 7f1e937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.542+0000 7f1e937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58966/0 (socket says 172.21.15.88:58966) 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.542+0000 7f1e937fe700 1 -- 172.21.15.88:0/913849109 learned_addr learned my addr 172.21.15.88:0/913849109 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.543+0000 7f1e937fe700 1 -- 172.21.15.88:0/913849109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84009550 con 0x7f1e94103e70 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.543+0000 7f1e937fe700 1 --2- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94199950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e84000c00 tx=0x7f1e84011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.543+0000 7f1e90ff9700 1 -- 172.21.15.88:0/913849109 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e84003a70 con 0x7f1e94103e70 2024-09-13T21:31:55.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.543+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9419a090 con 0x7f1e94103e70 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.543+0000 7f1e90ff9700 1 -- 172.21.15.88:0/913849109 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e84003bd0 con 0x7f1e94103e70 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.543+0000 7f1e90ff9700 1 -- 172.21.15.88:0/913849109 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e840238c0 con 0x7f1e94103e70 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.543+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9419a4b0 con 0x7f1e94103e70 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.544+0000 7f1e90ff9700 1 -- 172.21.15.88:0/913849109 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1e84023b80 con 0x7f1e94103e70 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.544+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e94062380 con 0x7f1e94103e70 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.544+0000 7f1e90ff9700 1 --2- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1e7c0383f0 0x7f1e7c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.544+0000 7f1e90ff9700 1 -- 172.21.15.88:0/913849109 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1e8404c280 con 0x7f1e94103e70 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.544+0000 7f1e92ffd700 1 --2- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1e7c0383f0 0x7f1e7c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.545+0000 7f1e92ffd700 1 --2- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1e7c0383f0 0x7f1e7c03a8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e88006fd0 tx=0x7f1e88006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.549+0000 7f1e90ff9700 1 -- 172.21.15.88:0/913849109 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1e84010d10 con 0x7f1e94103e70 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.744+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f1e9419d650 con 0x7f1e94103e70 2024-09-13T21:31:55.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.747+0000 7f1e90ff9700 1 -- 172.21.15.88:0/913849109 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1e84010b30 con 0x7f1e94103e70 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1e7c0383f0 msgr2=0x7f1e7c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 --2- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1e7c0383f0 0x7f1e7c03a8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e88006fd0 tx=0x7f1e88006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 msgr2=0x7f1e94199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 --2- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94199950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e84000c00 tx=0x7f1e84011b50 comp rx=0 tx=0).stop 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 shutdown_connections 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 --2- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f1e7c0383f0 0x7f1e7c03a8a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 --2- 172.21.15.88:0/913849109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e94103e70 0x7f1e94199950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 >> 172.21.15.88:0/913849109 conn(0x7f1e940ff870 msgr2=0x7f1e94100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 shutdown_connections 2024-09-13T21:31:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:54.750+0000 7f1e9a1cd700 1 -- 172.21.15.88:0/913849109 wait complete. 2024-09-13T21:31:55.976 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:55 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/913849109' entity='client.admin' 2024-09-13T21:31:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.776+0000 7f60716c3700 1 Processor -- start 2024-09-13T21:31:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.776+0000 7f60716c3700 1 -- start start 2024-09-13T21:31:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.776+0000 7f60716c3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c0791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.776+0000 7f60716c3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c079730 con 0x7f606c07acf0 2024-09-13T21:31:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.776+0000 7f606affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c0791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.777+0000 7f606affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c0791f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58976/0 (socket says 172.21.15.88:58976) 2024-09-13T21:31:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.777+0000 7f606affd700 1 -- 172.21.15.88:0/1273813371 learned_addr learned my addr 172.21.15.88:0/1273813371 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.777+0000 7f606affd700 1 -- 172.21.15.88:0/1273813371 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c079870 con 0x7f606c07acf0 2024-09-13T21:31:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.777+0000 7f606affd700 1 --2- 172.21.15.88:0/1273813371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c0791f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f605c0098a0 tx=0x7f605c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b14820572771594 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.777+0000 7f6069ffb700 1 -- 172.21.15.88:0/1273813371 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f605c004180 con 0x7f606c07acf0 2024-09-13T21:31:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.777+0000 7f6069ffb700 1 -- 172.21.15.88:0/1273813371 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f605c0042e0 con 0x7f606c07acf0 2024-09-13T21:31:56.554 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.777+0000 7f6069ffb700 1 -- 172.21.15.88:0/1273813371 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f605c011af0 con 0x7f606c07acf0 2024-09-13T21:31:56.554 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.778+0000 7f60716c3700 1 -- 172.21.15.88:0/1273813371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 msgr2=0x7f606c0791f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:56.554 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.778+0000 7f60716c3700 1 --2- 172.21.15.88:0/1273813371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c0791f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f605c0098a0 tx=0x7f605c009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:56.554 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.778+0000 7f60716c3700 1 -- 172.21.15.88:0/1273813371 shutdown_connections 2024-09-13T21:31:56.554 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.778+0000 7f60716c3700 1 --2- 172.21.15.88:0/1273813371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c0791f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:56.554 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.778+0000 7f60716c3700 1 -- 172.21.15.88:0/1273813371 >> 172.21.15.88:0/1273813371 conn(0x7f606c1011f0 msgr2=0x7f606c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:56.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.778+0000 7f60716c3700 1 -- 172.21.15.88:0/1273813371 shutdown_connections 2024-09-13T21:31:56.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.778+0000 7f60716c3700 1 -- 172.21.15.88:0/1273813371 wait complete. 2024-09-13T21:31:56.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.778+0000 7f60716c3700 1 Processor -- start 2024-09-13T21:31:56.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.778+0000 7f60716c3700 1 -- start start 2024-09-13T21:31:56.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f60716c3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:56.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f60716c3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c19c090 con 0x7f606c07acf0 2024-09-13T21:31:56.555 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f606affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:56.556 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f606affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c19bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58986/0 (socket says 172.21.15.88:58986) 2024-09-13T21:31:56.556 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f606affd700 1 -- 172.21.15.88:0/3839544453 learned_addr learned my addr 172.21.15.88:0/3839544453 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:56.556 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f606affd700 1 -- 172.21.15.88:0/3839544453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c009550 con 0x7f606c07acf0 2024-09-13T21:31:56.556 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f606affd700 1 --2- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c19bb50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f605c000c00 tx=0x7f605c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:56.556 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f6053fff700 1 -- 172.21.15.88:0/3839544453 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f605c003a70 con 0x7f606c07acf0 2024-09-13T21:31:56.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f6053fff700 1 -- 172.21.15.88:0/3839544453 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f605c003bd0 con 0x7f606c07acf0 2024-09-13T21:31:56.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606c19c290 con 0x7f606c07acf0 2024-09-13T21:31:56.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f6053fff700 1 -- 172.21.15.88:0/3839544453 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f605c0238c0 con 0x7f606c07acf0 2024-09-13T21:31:56.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.779+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c19c6b0 con 0x7f606c07acf0 2024-09-13T21:31:56.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.780+0000 7f6053fff700 1 -- 172.21.15.88:0/3839544453 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f605c023b30 con 0x7f606c07acf0 2024-09-13T21:31:56.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.780+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606c10bed0 con 0x7f606c07acf0 2024-09-13T21:31:56.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.780+0000 7f6053fff700 1 --2- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6054038440 0x7f605403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:56.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.780+0000 7f6053fff700 1 -- 172.21.15.88:0/3839544453 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f605c04c1d0 con 0x7f606c07acf0 2024-09-13T21:31:56.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.781+0000 7f606a7fc700 1 --2- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6054038440 0x7f605403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:56.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.781+0000 7f606a7fc700 1 --2- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6054038440 0x7f605403a8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6060006fd0 tx=0x7f6060006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:56.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.785+0000 7f6053fff700 1 -- 172.21.15.88:0/3839544453 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f605c010c20 con 0x7f606c07acf0 2024-09-13T21:31:56.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.973+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f606c19f510 con 0x7f606c07acf0 2024-09-13T21:31:56.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.978+0000 7f6053fff700 1 -- 172.21.15.88:0/3839544453 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f605c010830 con 0x7f606c07acf0 2024-09-13T21:31:56.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.980+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6054038440 msgr2=0x7f605403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:56.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.980+0000 7f60716c3700 1 --2- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6054038440 0x7f605403a8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6060006fd0 tx=0x7f6060006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:56.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.980+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 msgr2=0x7f606c19bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:56.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.980+0000 7f60716c3700 1 --2- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c19bb50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f605c000c00 tx=0x7f605c011b50 comp rx=0 tx=0).stop 2024-09-13T21:31:56.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.981+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 shutdown_connections 2024-09-13T21:31:56.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.981+0000 7f60716c3700 1 --2- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6054038440 0x7f605403a8f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:56.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.981+0000 7f60716c3700 1 --2- 172.21.15.88:0/3839544453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f606c07acf0 0x7f606c19bb50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:56.560 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.981+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 >> 172.21.15.88:0/3839544453 conn(0x7f606c1011f0 msgr2=0x7f606c102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:56.560 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.981+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 shutdown_connections 2024-09-13T21:31:56.560 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:55.981+0000 7f60716c3700 1 -- 172.21.15.88:0/3839544453 wait complete. 2024-09-13T21:31:56.560 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling the dashboard module... 2024-09-13T21:31:57.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:56 smithi088 ceph-mon[27963]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:31:57.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:56 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3839544453' entity='client.admin' 2024-09-13T21:31:57.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:57 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3712043514' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T21:31:58.423 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.046+0000 7f4ef73a5700 1 Processor -- start 2024-09-13T21:31:58.423 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.047+0000 7f4ef73a5700 1 -- start start 2024-09-13T21:31:58.423 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.047+0000 7f4ef73a5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:58.423 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.047+0000 7f4ef73a5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0079da0 con 0x7f4ef0106690 2024-09-13T21:31:58.423 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.047+0000 7f4ef5141700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:58.423 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.047+0000 7f4ef5141700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58992/0 (socket says 172.21.15.88:58992) 2024-09-13T21:31:58.423 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.047+0000 7f4ef5141700 1 -- 172.21.15.88:0/327746462 learned_addr learned my addr 172.21.15.88:0/327746462 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:58.423 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.047+0000 7f4ef5141700 1 -- 172.21.15.88:0/327746462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0079ee0 con 0x7f4ef0106690 2024-09-13T21:31:58.423 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.047+0000 7f4ef5141700 1 --2- 172.21.15.88:0/327746462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0108a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0098a0 tx=0x7f4eec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e497a241ac0493 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:58.424 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ee3fff700 1 -- 172.21.15.88:0/327746462 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4eec004180 con 0x7f4ef0106690 2024-09-13T21:31:58.424 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ee3fff700 1 -- 172.21.15.88:0/327746462 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4eec0042e0 con 0x7f4ef0106690 2024-09-13T21:31:58.424 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ee3fff700 1 -- 172.21.15.88:0/327746462 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4eec011af0 con 0x7f4ef0106690 2024-09-13T21:31:58.424 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ef73a5700 1 -- 172.21.15.88:0/327746462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 msgr2=0x7f4ef0108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:58.424 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ef73a5700 1 --2- 172.21.15.88:0/327746462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0108a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0098a0 tx=0x7f4eec009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:58.424 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ef73a5700 1 -- 172.21.15.88:0/327746462 shutdown_connections 2024-09-13T21:31:58.424 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ef73a5700 1 --2- 172.21.15.88:0/327746462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0108a70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:58.424 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ef73a5700 1 -- 172.21.15.88:0/327746462 >> 172.21.15.88:0/327746462 conn(0x7f4ef01000f0 msgr2=0x7f4ef0102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:58.424 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ef73a5700 1 -- 172.21.15.88:0/327746462 shutdown_connections 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.048+0000 7f4ef73a5700 1 -- 172.21.15.88:0/327746462 wait complete. 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.049+0000 7f4ef73a5700 1 Processor -- start 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.049+0000 7f4ef73a5700 1 -- start start 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.049+0000 7f4ef73a5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0105ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.049+0000 7f4ef73a5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0106530 con 0x7f4ef0106690 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.049+0000 7f4ef5141700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0105ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.049+0000 7f4ef5141700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0105ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58994/0 (socket says 172.21.15.88:58994) 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.049+0000 7f4ef5141700 1 -- 172.21.15.88:0/3712043514 learned_addr learned my addr 172.21.15.88:0/3712043514 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.049+0000 7f4ef5141700 1 -- 172.21.15.88:0/3712043514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec009550 con 0x7f4ef0106690 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.050+0000 7f4ef5141700 1 --2- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0105ff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4eec000c00 tx=0x7f4eec011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.050+0000 7f4ee27fc700 1 -- 172.21.15.88:0/3712043514 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4eec003a70 con 0x7f4ef0106690 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.050+0000 7f4ee27fc700 1 -- 172.21.15.88:0/3712043514 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4eec003bd0 con 0x7f4ef0106690 2024-09-13T21:31:58.425 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.050+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef0104640 con 0x7f4ef0106690 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.050+0000 7f4ee27fc700 1 -- 172.21.15.88:0/3712043514 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4eec0238c0 con 0x7f4ef0106690 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.050+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef0104a60 con 0x7f4ef0106690 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.051+0000 7f4ee27fc700 1 -- 172.21.15.88:0/3712043514 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f4eec023b30 con 0x7f4ef0106690 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.051+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef00623f0 con 0x7f4ef0106690 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.051+0000 7f4ee27fc700 1 --2- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4edc038440 0x7f4edc03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.051+0000 7f4ee27fc700 1 -- 172.21.15.88:0/3712043514 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4eec04c3a0 con 0x7f4ef0106690 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.051+0000 7f4ef4940700 1 --2- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4edc038440 0x7f4edc03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.051+0000 7f4ef4940700 1 --2- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4edc038440 0x7f4edc03a8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4006fd0 tx=0x7f4ee4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.056+0000 7f4ee27fc700 1 -- 172.21.15.88:0/3712043514 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4ef00623f0 con 0x7f4ef0106690 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.302+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f4ef00623f0 con 0x7f4ef0106690 2024-09-13T21:31:58.426 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.812+0000 7f4ee27fc700 1 -- 172.21.15.88:0/3712043514 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f4eec019930 con 0x7f4ef0106690 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.814+0000 7f4ee27fc700 1 -- 172.21.15.88:0/3712043514 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f4eec010dd0 con 0x7f4ef0106690 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.817+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4edc038440 msgr2=0x7f4edc03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.817+0000 7f4ef73a5700 1 --2- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4edc038440 0x7f4edc03a8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4006fd0 tx=0x7f4ee4006e40 comp rx=0 tx=0).stop 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.817+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 msgr2=0x7f4ef0105ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.817+0000 7f4ef73a5700 1 --2- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0105ff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4eec000c00 tx=0x7f4eec011b50 comp rx=0 tx=0).stop 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.818+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 shutdown_connections 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.818+0000 7f4ef73a5700 1 --2- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4edc038440 0x7f4edc03a8f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.818+0000 7f4ef73a5700 1 --2- 172.21.15.88:0/3712043514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ef0106690 0x7f4ef0105ff0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.818+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 >> 172.21.15.88:0/3712043514 conn(0x7f4ef01000f0 msgr2=0x7f4ef0101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.818+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 shutdown_connections 2024-09-13T21:31:58.427 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:57.818+0000 7f4ef73a5700 1 -- 172.21.15.88:0/3712043514 wait complete. 2024-09-13T21:31:59.122 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:58 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3712043514' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T21:31:59.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:58 smithi088 ceph-mon[27963]: mgrmap e9: smithi088.scyrwy(active, since 26s) 2024-09-13T21:31:59.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:31:59.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "active_name": "smithi088.scyrwy", 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.917+0000 7f97143b7700 1 Processor -- start 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.917+0000 7f97143b7700 1 -- start start 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.917+0000 7f97143b7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c1042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.917+0000 7f97143b7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c1047f0 con 0x7f970c103ea0 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.917+0000 7f9712153700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c1042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.917+0000 7f9712153700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c1042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59030/0 (socket says 172.21.15.88:59030) 2024-09-13T21:31:59.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.917+0000 7f9712153700 1 -- 172.21.15.88:0/2930889978 learned_addr learned my addr 172.21.15.88:0/2930889978 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:59.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.918+0000 7f9712153700 1 -- 172.21.15.88:0/2930889978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c104930 con 0x7f970c103ea0 2024-09-13T21:31:59.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.918+0000 7f9712153700 1 --2- 172.21.15.88:0/2930889978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c1042b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97080098a0 tx=0x7f9708009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ea3b0b3fec46d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:59.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.918+0000 7f9711151700 1 -- 172.21.15.88:0/2930889978 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9708004180 con 0x7f970c103ea0 2024-09-13T21:31:59.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.918+0000 7f9711151700 1 -- 172.21.15.88:0/2930889978 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f97080042e0 con 0x7f970c103ea0 2024-09-13T21:31:59.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.918+0000 7f9711151700 1 -- 172.21.15.88:0/2930889978 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9708011af0 con 0x7f970c103ea0 2024-09-13T21:31:59.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.919+0000 7f97143b7700 1 -- 172.21.15.88:0/2930889978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 msgr2=0x7f970c1042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:59.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.919+0000 7f97143b7700 1 --2- 172.21.15.88:0/2930889978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c1042b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97080098a0 tx=0x7f9708009bb0 comp rx=0 tx=0).stop 2024-09-13T21:31:59.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.919+0000 7f97143b7700 1 -- 172.21.15.88:0/2930889978 shutdown_connections 2024-09-13T21:31:59.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.919+0000 7f97143b7700 1 --2- 172.21.15.88:0/2930889978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c1042b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:59.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.919+0000 7f97143b7700 1 -- 172.21.15.88:0/2930889978 >> 172.21.15.88:0/2930889978 conn(0x7f970c0ff880 msgr2=0x7f970c101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:59.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.919+0000 7f97143b7700 1 -- 172.21.15.88:0/2930889978 shutdown_connections 2024-09-13T21:31:59.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.919+0000 7f97143b7700 1 -- 172.21.15.88:0/2930889978 wait complete. 2024-09-13T21:31:59.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.919+0000 7f97143b7700 1 Processor -- start 2024-09-13T21:31:59.792 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.919+0000 7f97143b7700 1 -- start start 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f97143b7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f97143b7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c199e80 con 0x7f970c103ea0 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f9712153700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f9712153700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59040/0 (socket says 172.21.15.88:59040) 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f9712153700 1 -- 172.21.15.88:0/1603235836 learned_addr learned my addr 172.21.15.88:0/1603235836 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f9712153700 1 -- 172.21.15.88:0/1603235836 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9708009550 con 0x7f970c103ea0 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f9712153700 1 --2- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c199940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9708006ba0 tx=0x7f9708011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f97037fe700 1 -- 172.21.15.88:0/1603235836 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9708003b00 con 0x7f970c103ea0 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c19a080 con 0x7f970c103ea0 2024-09-13T21:31:59.793 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f97037fe700 1 -- 172.21.15.88:0/1603235836 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f970801a8e0 con 0x7f970c103ea0 2024-09-13T21:31:59.794 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f97037fe700 1 -- 172.21.15.88:0/1603235836 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9708019990 con 0x7f970c103ea0 2024-09-13T21:31:59.794 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.920+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c19a4a0 con 0x7f970c103ea0 2024-09-13T21:31:59.794 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.921+0000 7f97037fe700 1 -- 172.21.15.88:0/1603235836 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f9708019c00 con 0x7f970c103ea0 2024-09-13T21:31:59.794 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.921+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c062380 con 0x7f970c103ea0 2024-09-13T21:31:59.794 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.922+0000 7f97037fe700 1 --2- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f96f8038440 0x7f96f803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:31:59.794 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.922+0000 7f97037fe700 1 -- 172.21.15.88:0/1603235836 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f970804c670 con 0x7f970c103ea0 2024-09-13T21:31:59.794 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.922+0000 7f9711952700 1 -- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f96f8038440 msgr2=0x7f96f803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:31:59.794 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.922+0000 7f9711952700 1 --2- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f96f8038440 0x7f96f803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:31:59.795 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:58.930+0000 7f97037fe700 1 -- 172.21.15.88:0/1603235836 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f970801aa50 con 0x7f970c103ea0 2024-09-13T21:31:59.795 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.123+0000 7f9711952700 1 -- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f96f8038440 msgr2=0x7f96f803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:31:59.795 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.123+0000 7f9711952700 1 --2- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f96f8038440 0x7f96f803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:31:59.795 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.183+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f970c107ad0 con 0x7f970c103ea0 2024-09-13T21:31:59.795 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.184+0000 7f97037fe700 1 -- 172.21.15.88:0/1603235836 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f9708018350 con 0x7f970c103ea0 2024-09-13T21:31:59.795 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f96f8038440 msgr2=0x7f96f803a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:31:59.795 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 --2- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f96f8038440 0x7f96f803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:59.796 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 msgr2=0x7f970c199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:31:59.796 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 --2- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c199940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9708006ba0 tx=0x7f9708011b50 comp rx=0 tx=0).stop 2024-09-13T21:31:59.796 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 shutdown_connections 2024-09-13T21:31:59.796 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 --2- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f96f8038440 0x7f96f803a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:59.796 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 --2- 172.21.15.88:0/1603235836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f970c103ea0 0x7f970c199940 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:31:59.796 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 >> 172.21.15.88:0/1603235836 conn(0x7f970c0ff880 msgr2=0x7f970c100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:31:59.796 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 shutdown_connections 2024-09-13T21:31:59.796 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:31:59.187+0000 7f97143b7700 1 -- 172.21.15.88:0/1603235836 wait complete. 2024-09-13T21:31:59.796 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for the mgr to restart... 2024-09-13T21:31:59.797 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr epoch 9... 2024-09-13T21:32:00.032 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:31:59 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1603235836' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T21:32:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: Active manager daemon smithi088.scyrwy restarted 2024-09-13T21:32:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: Activating manager daemon smithi088.scyrwy 2024-09-13T21:32:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T21:32:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: mgrmap e10: smithi088.scyrwy(active, starting, since 0.00381442s) 2024-09-13T21:32:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:32:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:32:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:32:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:32:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:32:04.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: Manager daemon smithi088.scyrwy is now available 2024-09-13T21:32:04.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:32:04.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:32:04.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:32:04.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/trash_purge_schedule"}]: dispatch 2024-09-13T21:32:06.374 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:32:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T21:32:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T21:32:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:32:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.257+0000 7f2581ba7700 1 Processor -- start 2024-09-13T21:32:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.257+0000 7f2581ba7700 1 -- start start 2024-09-13T21:32:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.258+0000 7f2581ba7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.258+0000 7f2581ba7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c074460 con 0x7f257c1066d0 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.258+0000 7f257b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.258+0000 7f257b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56840/0 (socket says 172.21.15.88:56840) 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.258+0000 7f257b7fe700 1 -- 172.21.15.88:0/142460822 learned_addr learned my addr 172.21.15.88:0/142460822 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.258+0000 7f257b7fe700 1 -- 172.21.15.88:0/142460822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0745a0 con 0x7f257c1066d0 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.258+0000 7f257b7fe700 1 --2- 172.21.15.88:0/142460822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c108ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f256c0098a0 tx=0x7f256c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfc1830d742df2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.258+0000 7f257a7fc700 1 -- 172.21.15.88:0/142460822 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f256c004180 con 0x7f257c1066d0 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.259+0000 7f257a7fc700 1 -- 172.21.15.88:0/142460822 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f256c0042e0 con 0x7f257c1066d0 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.259+0000 7f257a7fc700 1 -- 172.21.15.88:0/142460822 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f256c011af0 con 0x7f257c1066d0 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.259+0000 7f2581ba7700 1 -- 172.21.15.88:0/142460822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 msgr2=0x7f257c108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.259+0000 7f2581ba7700 1 --2- 172.21.15.88:0/142460822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c108ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f256c0098a0 tx=0x7f256c009bb0 comp rx=0 tx=0).stop 2024-09-13T21:32:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.259+0000 7f2581ba7700 1 -- 172.21.15.88:0/142460822 shutdown_connections 2024-09-13T21:32:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.259+0000 7f2581ba7700 1 --2- 172.21.15.88:0/142460822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c108ab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.259+0000 7f2581ba7700 1 -- 172.21.15.88:0/142460822 >> 172.21.15.88:0/142460822 conn(0x7f257c100110 msgr2=0x7f257c102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.259+0000 7f2581ba7700 1 -- 172.21.15.88:0/142460822 shutdown_connections 2024-09-13T21:32:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.259+0000 7f2581ba7700 1 -- 172.21.15.88:0/142460822 wait complete. 2024-09-13T21:32:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.260+0000 7f2581ba7700 1 Processor -- start 2024-09-13T21:32:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.260+0000 7f2581ba7700 1 -- start start 2024-09-13T21:32:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.260+0000 7f2581ba7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.260+0000 7f2581ba7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c199e50 con 0x7f257c1066d0 2024-09-13T21:32:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.260+0000 7f257b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.260+0000 7f257b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56844/0 (socket says 172.21.15.88:56844) 2024-09-13T21:32:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.260+0000 7f257b7fe700 1 -- 172.21.15.88:0/1613675169 learned_addr learned my addr 172.21.15.88:0/1613675169 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.261+0000 7f257b7fe700 1 -- 172.21.15.88:0/1613675169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c009550 con 0x7f257c1066d0 2024-09-13T21:32:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.261+0000 7f257b7fe700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c199910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f256c006ba0 tx=0x7f256c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.261+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f256c003b00 con 0x7f257c1066d0 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.261+0000 7f2581ba7700 1 -- 172.21.15.88:0/1613675169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c19a0b0 con 0x7f257c1066d0 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.261+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f256c01a8e0 con 0x7f257c1066d0 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.261+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f256c019990 con 0x7f257c1066d0 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.261+0000 7f2581ba7700 1 -- 172.21.15.88:0/1613675169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c19a530 con 0x7f257c1066d0 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.262+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f256c019c00 con 0x7f257c1066d0 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.262+0000 7f2578ff9700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.262+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f256403b000 con 0x7f2564038440 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.262+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f256c04c5a0 con 0x7f257c1066d0 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.262+0000 7f257affd700 1 -- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 msgr2=0x7f256403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.262+0000 7f257affd700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:32:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.463+0000 7f257affd700 1 -- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 msgr2=0x7f256403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.463+0000 7f257affd700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.864+0000 7f257affd700 1 -- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 msgr2=0x7f256403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:00.864+0000 7f257affd700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:01.665+0000 7f257affd700 1 -- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 msgr2=0x7f256403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:01.665+0000 7f257affd700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:03.266+0000 7f257affd700 1 -- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 msgr2=0x7f256403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:03.266+0000 7f257affd700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:04.519+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7f256c02d620 con 0x7f257c1066d0 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:04.519+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 msgr2=0x7f256403a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:04.519+0000 7f2578ff9700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.520+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7f256c02d9a0 con 0x7f257c1066d0 2024-09-13T21:32:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.520+0000 7f2578ff9700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.520+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f256403b000 con 0x7f2564038440 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.521+0000 7f257affd700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.521+0000 7f257affd700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2570003a10 tx=0x7f2570009270 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.522+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 <== mgr.14162 v2:172.21.15.88:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f256403b000 con 0x7f2564038440 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.528+0000 7f2581ba7700 1 -- 172.21.15.88:0/1613675169 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f257c19ac50 con 0x7f2564038440 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.528+0000 7f2578ff9700 1 -- 172.21.15.88:0/1613675169 <== mgr.14162 v2:172.21.15.88:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f257c19ac50 con 0x7f2564038440 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 -- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 msgr2=0x7f256403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2570003a10 tx=0x7f2570009270 comp rx=0 tx=0).stop 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 -- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 msgr2=0x7f257c199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c199910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f256c006ba0 tx=0x7f256c011b50 comp rx=0 tx=0).stop 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 -- 172.21.15.88:0/1613675169 shutdown_connections 2024-09-13T21:32:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f2564038440 0x7f256403a8f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 --2- 172.21.15.88:0/1613675169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f257c1066d0 0x7f257c199910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 -- 172.21.15.88:0/1613675169 >> 172.21.15.88:0/1613675169 conn(0x7f257c100110 msgr2=0x7f257c1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 -- 172.21.15.88:0/1613675169 shutdown_connections 2024-09-13T21:32:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:05.529+0000 7f2581ba7700 1 -- 172.21.15.88:0/1613675169 wait complete. 2024-09-13T21:32:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:mgr epoch 9 is available 2024-09-13T21:32:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:Generating a dashboard self-signed certificate... 2024-09-13T21:32:06.647 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:06 smithi088 ceph-mon[27963]: [13/Sep/2024:21:32:05] ENGINE Bus STARTING 2024-09-13T21:32:06.647 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:06 smithi088 ceph-mon[27963]: [13/Sep/2024:21:32:05] ENGINE Serving on http://172.21.15.88:8765 2024-09-13T21:32:06.648 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:06 smithi088 ceph-mon[27963]: [13/Sep/2024:21:32:05] ENGINE Serving on https://172.21.15.88:7150 2024-09-13T21:32:06.648 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:06 smithi088 ceph-mon[27963]: [13/Sep/2024:21:32:05] ENGINE Bus STARTED 2024-09-13T21:32:06.648 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:06 smithi088 ceph-mon[27963]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T21:32:06.648 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:06 smithi088 ceph-mon[27963]: mgrmap e11: smithi088.scyrwy(active, since 1.00587s) 2024-09-13T21:32:06.648 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:06 smithi088 ceph-mon[27963]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T21:32:06.648 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:06 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:07.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:07 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:07.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:07 smithi088 ceph-mon[27963]: mgrmap e12: smithi088.scyrwy(active, since 2s) 2024-09-13T21:32:07.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:07 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:07.805 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:07 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:07.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T21:32:07.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.886+0000 7ffb6a6bb700 1 Processor -- start 2024-09-13T21:32:07.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.886+0000 7ffb6a6bb700 1 -- start start 2024-09-13T21:32:07.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.886+0000 7ffb6a6bb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb64106470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:07.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.886+0000 7ffb6a6bb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb641069b0 con 0x7ffb64106060 2024-09-13T21:32:07.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.886+0000 7ffb63fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb64106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.886+0000 7ffb63fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb64106470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56906/0 (socket says 172.21.15.88:56906) 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.886+0000 7ffb63fff700 1 -- 172.21.15.88:0/1675915264 learned_addr learned my addr 172.21.15.88:0/1675915264 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.887+0000 7ffb63fff700 1 -- 172.21.15.88:0/1675915264 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64106af0 con 0x7ffb64106060 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.887+0000 7ffb63fff700 1 --2- 172.21.15.88:0/1675915264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb64106470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb540098a0 tx=0x7ffb54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed8e7ac8941f74f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.887+0000 7ffb62ffd700 1 -- 172.21.15.88:0/1675915264 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb54004180 con 0x7ffb64106060 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.887+0000 7ffb62ffd700 1 -- 172.21.15.88:0/1675915264 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb540042e0 con 0x7ffb64106060 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.887+0000 7ffb62ffd700 1 -- 172.21.15.88:0/1675915264 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb54011af0 con 0x7ffb64106060 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.888+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/1675915264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 msgr2=0x7ffb64106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.888+0000 7ffb6a6bb700 1 --2- 172.21.15.88:0/1675915264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb64106470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb540098a0 tx=0x7ffb54009bb0 comp rx=0 tx=0).stop 2024-09-13T21:32:07.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.888+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/1675915264 shutdown_connections 2024-09-13T21:32:07.815 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.888+0000 7ffb6a6bb700 1 --2- 172.21.15.88:0/1675915264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb64106470 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:07.815 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.888+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/1675915264 >> 172.21.15.88:0/1675915264 conn(0x7ffb640ff880 msgr2=0x7ffb64101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:07.815 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.888+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/1675915264 shutdown_connections 2024-09-13T21:32:07.815 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.888+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/1675915264 wait complete. 2024-09-13T21:32:07.815 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.888+0000 7ffb6a6bb700 1 Processor -- start 2024-09-13T21:32:07.815 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.888+0000 7ffb6a6bb700 1 -- start start 2024-09-13T21:32:07.815 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb6a6bb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb6410ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:07.815 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb6a6bb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6410b050 con 0x7ffb64106060 2024-09-13T21:32:07.815 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb63fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb6410ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb63fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb6410ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56920/0 (socket says 172.21.15.88:56920) 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb63fff700 1 -- 172.21.15.88:0/3173393806 learned_addr learned my addr 172.21.15.88:0/3173393806 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb63fff700 1 -- 172.21.15.88:0/3173393806 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54009550 con 0x7ffb64106060 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb63fff700 1 --2- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb6410ab10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb54006ba0 tx=0x7ffb540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb617fa700 1 -- 172.21.15.88:0/3173393806 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb54003a00 con 0x7ffb64106060 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb617fa700 1 -- 172.21.15.88:0/3173393806 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb54003b60 con 0x7ffb64106060 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.889+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb64109160 con 0x7ffb64106060 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.890+0000 7ffb617fa700 1 -- 172.21.15.88:0/3173393806 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb54019920 con 0x7ffb64106060 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.890+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb64109580 con 0x7ffb64106060 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.890+0000 7ffb617fa700 1 -- 172.21.15.88:0/3173393806 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7ffb54019be0 con 0x7ffb64106060 2024-09-13T21:32:07.816 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.891+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb64109f90 con 0x7ffb64106060 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.891+0000 7ffb617fa700 1 --2- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb4c0382c0 0x7ffb4c03a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.891+0000 7ffb617fa700 1 -- 172.21.15.88:0/3173393806 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ffb5404c410 con 0x7ffb64106060 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.891+0000 7ffb637fe700 1 --2- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb4c0382c0 0x7ffb4c03a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.891+0000 7ffb637fe700 1 --2- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb4c0382c0 0x7ffb4c03a770 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb58006fd0 tx=0x7ffb58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.899+0000 7ffb617fa700 1 -- 172.21.15.88:0/3173393806 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffb5402b700 con 0x7ffb64106060 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:06.970+0000 7ffb617fa700 1 -- 172.21.15.88:0/3173393806 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7ffb5402c3a0 con 0x7ffb64106060 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.105+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb641097c0 con 0x7ffb4c0382c0 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.157+0000 7ffb617fa700 1 -- 172.21.15.88:0/3173393806 <== mgr.14162 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7ffb641097c0 con 0x7ffb4c0382c0 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb4c0382c0 msgr2=0x7ffb4c03a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 --2- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb4c0382c0 0x7ffb4c03a770 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb58006fd0 tx=0x7ffb58006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:07.817 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 msgr2=0x7ffb6410ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:07.818 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 --2- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb6410ab10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb54006ba0 tx=0x7ffb540047c0 comp rx=0 tx=0).stop 2024-09-13T21:32:07.818 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 shutdown_connections 2024-09-13T21:32:07.818 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 --2- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb4c0382c0 0x7ffb4c03a770 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:07.818 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 --2- 172.21.15.88:0/3173393806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64106060 0x7ffb6410ab10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:07.818 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 >> 172.21.15.88:0/3173393806 conn(0x7ffb640ff880 msgr2=0x7ffb64100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:07.818 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 shutdown_connections 2024-09-13T21:32:07.818 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:07.160+0000 7ffb6a6bb700 1 -- 172.21.15.88:0/3173393806 wait complete. 2024-09-13T21:32:07.818 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial admin user... 2024-09-13T21:32:08.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:08 smithi088 ceph-mon[27963]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:32:09.808 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$AYyMk.ekUsyAPtQqcEXmkutQwhHhgzhUkJLA6gkMJVl3YU20LxP9G", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726263129, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T21:32:09.808 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.704+0000 7f44b41d5700 1 Processor -- start 2024-09-13T21:32:09.808 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.704+0000 7f44b41d5700 1 -- start start 2024-09-13T21:32:09.808 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b41d5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:09.808 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b41d5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac079d60 con 0x7f44ac1066f0 2024-09-13T21:32:09.808 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b1f71700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:09.808 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b1f71700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56932/0 (socket says 172.21.15.88:56932) 2024-09-13T21:32:09.808 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b1f71700 1 -- 172.21.15.88:0/2673780858 learned_addr learned my addr 172.21.15.88:0/2673780858 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b1f71700 1 -- 172.21.15.88:0/2673780858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac079ea0 con 0x7f44ac1066f0 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b1f71700 1 --2- 172.21.15.88:0/2673780858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac108ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009e80 tx=0x7f44a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336ea5ee7ce5ba7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b0f6f700 1 -- 172.21.15.88:0/2673780858 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44a400e070 con 0x7f44ac1066f0 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b0f6f700 1 -- 172.21.15.88:0/2673780858 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44a400b8c0 con 0x7f44ac1066f0 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.705+0000 7f44b0f6f700 1 -- 172.21.15.88:0/2673780858 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44a40044d0 con 0x7f44ac1066f0 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.706+0000 7f44b41d5700 1 -- 172.21.15.88:0/2673780858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 msgr2=0x7f44ac108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.706+0000 7f44b41d5700 1 --2- 172.21.15.88:0/2673780858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac108ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009e80 tx=0x7f44a400b330 comp rx=0 tx=0).stop 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.706+0000 7f44b41d5700 1 -- 172.21.15.88:0/2673780858 shutdown_connections 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.706+0000 7f44b41d5700 1 --2- 172.21.15.88:0/2673780858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac108ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.706+0000 7f44b41d5700 1 -- 172.21.15.88:0/2673780858 >> 172.21.15.88:0/2673780858 conn(0x7f44ac100150 msgr2=0x7f44ac102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.706+0000 7f44b41d5700 1 -- 172.21.15.88:0/2673780858 shutdown_connections 2024-09-13T21:32:09.809 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.706+0000 7f44b41d5700 1 -- 172.21.15.88:0/2673780858 wait complete. 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.707+0000 7f44b41d5700 1 Processor -- start 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.707+0000 7f44b41d5700 1 -- start start 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.707+0000 7f44b41d5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.707+0000 7f44b41d5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac199e20 con 0x7f44ac1066f0 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.707+0000 7f44b1f71700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.707+0000 7f44b1f71700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac1998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56944/0 (socket says 172.21.15.88:56944) 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.707+0000 7f44b1f71700 1 -- 172.21.15.88:0/760042895 learned_addr learned my addr 172.21.15.88:0/760042895 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.707+0000 7f44b1f71700 1 -- 172.21.15.88:0/760042895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a4009b30 con 0x7f44ac1066f0 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.707+0000 7f44b1f71700 1 --2- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac1998e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44a4004070 tx=0x7f44a40049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.708+0000 7f44aaffd700 1 -- 172.21.15.88:0/760042895 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44a400e040 con 0x7f44ac1066f0 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.708+0000 7f44aaffd700 1 -- 172.21.15.88:0/760042895 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44a400be00 con 0x7f44ac1066f0 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.708+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac19a020 con 0x7f44ac1066f0 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.708+0000 7f44aaffd700 1 -- 172.21.15.88:0/760042895 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44a4012770 con 0x7f44ac1066f0 2024-09-13T21:32:09.810 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.708+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac19a4a0 con 0x7f44ac1066f0 2024-09-13T21:32:09.811 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.708+0000 7f44aaffd700 1 -- 172.21.15.88:0/760042895 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f44a4019040 con 0x7f44ac1066f0 2024-09-13T21:32:09.811 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.709+0000 7f44aaffd700 1 --2- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4494038440 0x7f449403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:09.811 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.709+0000 7f44aaffd700 1 -- 172.21.15.88:0/760042895 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f44a404be10 con 0x7f44ac1066f0 2024-09-13T21:32:09.811 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.709+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac0623f0 con 0x7f44ac1066f0 2024-09-13T21:32:09.811 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.709+0000 7f44b1770700 1 --2- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4494038440 0x7f449403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:09.811 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.709+0000 7f44b1770700 1 --2- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4494038440 0x7f449403a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f44a0006fd0 tx=0x7f44a0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:09.811 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.713+0000 7f44aaffd700 1 -- 172.21.15.88:0/760042895 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f44ac0623f0 con 0x7f44ac1066f0 2024-09-13T21:32:09.811 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:08.923+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f44ac0621a0 con 0x7f4494038440 2024-09-13T21:32:09.811 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.147+0000 7f44aaffd700 1 -- 172.21.15.88:0/760042895 <== mgr.14162 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f44ac0621a0 con 0x7f4494038440 2024-09-13T21:32:09.812 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4494038440 msgr2=0x7f449403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:09.812 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 --2- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4494038440 0x7f449403a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f44a0006fd0 tx=0x7f44a0006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:09.812 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 msgr2=0x7f44ac1998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:09.812 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 --2- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac1998e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44a4004070 tx=0x7f44a40049f0 comp rx=0 tx=0).stop 2024-09-13T21:32:09.812 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 shutdown_connections 2024-09-13T21:32:09.812 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 --2- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4494038440 0x7f449403a8f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:09.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 --2- 172.21.15.88:0/760042895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ac1066f0 0x7f44ac1998e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:09.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 >> 172.21.15.88:0/760042895 conn(0x7f44ac100150 msgr2=0x7f44ac1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:09.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 shutdown_connections 2024-09-13T21:32:09.813 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:09.149+0000 7f44b41d5700 1 -- 172.21.15.88:0/760042895 wait complete. 2024-09-13T21:32:09.813 INFO:teuthology.orchestra.run.smithi088.stdout:Fetching dashboard port number... 2024-09-13T21:32:10.320 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:10 smithi088 ceph-mon[27963]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:32:10.320 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:10 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:11.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T21:32:11.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.318+0000 7fe6fd5dd700 1 Processor -- start 2024-09-13T21:32:11.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.318+0000 7fe6fd5dd700 1 -- start start 2024-09-13T21:32:11.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6fd5dd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81075f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:11.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6fd5dd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8107b30 con 0x7fe6f81071e0 2024-09-13T21:32:11.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6f6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:11.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6f6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81075f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46984/0 (socket says 172.21.15.88:46984) 2024-09-13T21:32:11.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6f6ffd700 1 -- 172.21.15.88:0/718559275 learned_addr learned my addr 172.21.15.88:0/718559275 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:11.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6f6ffd700 1 -- 172.21.15.88:0/718559275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8107c70 con 0x7fe6f81071e0 2024-09-13T21:32:11.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6f6ffd700 1 --2- 172.21.15.88:0/718559275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81075f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009e80 tx=0x7fe6f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c2dc5bef17cdf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:11.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6f5ffb700 1 -- 172.21.15.88:0/718559275 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f000e070 con 0x7fe6f81071e0 2024-09-13T21:32:11.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6f5ffb700 1 -- 172.21.15.88:0/718559275 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe6f000b8c0 con 0x7fe6f81071e0 2024-09-13T21:32:11.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.319+0000 7fe6f5ffb700 1 -- 172.21.15.88:0/718559275 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f00044d0 con 0x7fe6f81071e0 2024-09-13T21:32:11.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.320+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/718559275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 msgr2=0x7fe6f81075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:11.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.320+0000 7fe6fd5dd700 1 --2- 172.21.15.88:0/718559275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81075f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009e80 tx=0x7fe6f000b330 comp rx=0 tx=0).stop 2024-09-13T21:32:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.320+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/718559275 shutdown_connections 2024-09-13T21:32:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.320+0000 7fe6fd5dd700 1 --2- 172.21.15.88:0/718559275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81075f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.320+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/718559275 >> 172.21.15.88:0/718559275 conn(0x7fe6f80ff870 msgr2=0x7fe6f8101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.320+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/718559275 shutdown_connections 2024-09-13T21:32:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.320+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/718559275 wait complete. 2024-09-13T21:32:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.321+0000 7fe6fd5dd700 1 Processor -- start 2024-09-13T21:32:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.321+0000 7fe6fd5dd700 1 -- start start 2024-09-13T21:32:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.321+0000 7fe6fd5dd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.321+0000 7fe6fd5dd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8199de0 con 0x7fe6f81071e0 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.321+0000 7fe6f6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.321+0000 7fe6f6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46986/0 (socket says 172.21.15.88:46986) 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.321+0000 7fe6f6ffd700 1 -- 172.21.15.88:0/2032703360 learned_addr learned my addr 172.21.15.88:0/2032703360 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.321+0000 7fe6f6ffd700 1 -- 172.21.15.88:0/2032703360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0009b30 con 0x7fe6f81071e0 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.321+0000 7fe6f6ffd700 1 --2- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81998a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00072a0 tx=0x7fe6f00049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.322+0000 7fe6effff700 1 -- 172.21.15.88:0/2032703360 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f000e040 con 0x7fe6f81071e0 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.322+0000 7fe6effff700 1 -- 172.21.15.88:0/2032703360 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe6f000bd80 con 0x7fe6f81071e0 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.322+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f8199fe0 con 0x7fe6f81071e0 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.322+0000 7fe6effff700 1 -- 172.21.15.88:0/2032703360 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f00126c0 con 0x7fe6f81071e0 2024-09-13T21:32:11.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.322+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f819a460 con 0x7fe6f81071e0 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.322+0000 7fe6effff700 1 -- 172.21.15.88:0/2032703360 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fe6f0019040 con 0x7fe6f81071e0 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.323+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f80623f0 con 0x7fe6f81071e0 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.323+0000 7fe6effff700 1 --2- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe6e4038400 0x7fe6e403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.323+0000 7fe6effff700 1 -- 172.21.15.88:0/2032703360 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fe6f004bea0 con 0x7fe6f81071e0 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.323+0000 7fe6f67fc700 1 --2- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe6e4038400 0x7fe6e403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.323+0000 7fe6f67fc700 1 --2- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe6e4038400 0x7fe6e403a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0006fd0 tx=0x7fe6e0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.327+0000 7fe6effff700 1 -- 172.21.15.88:0/2032703360 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe6f80623f0 con 0x7fe6f81071e0 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.518+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fe6f819ce40 con 0x7fe6f81071e0 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.518+0000 7fe6effff700 1 -- 172.21.15.88:0/2032703360 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fe6f001f020 con 0x7fe6f81071e0 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe6e4038400 msgr2=0x7fe6e403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 --2- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe6e4038400 0x7fe6e403a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0006fd0 tx=0x7fe6e0006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 msgr2=0x7fe6f81998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:11.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 --2- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81998a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00072a0 tx=0x7fe6f00049f0 comp rx=0 tx=0).stop 2024-09-13T21:32:11.110 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 shutdown_connections 2024-09-13T21:32:11.110 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 --2- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe6e4038400 0x7fe6e403a8b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:11.110 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 --2- 172.21.15.88:0/2032703360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f81071e0 0x7fe6f81998a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:11.110 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 >> 172.21.15.88:0/2032703360 conn(0x7fe6f80ff870 msgr2=0x7fe6f8100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:11.110 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 shutdown_connections 2024-09-13T21:32:11.110 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:10.521+0000 7fe6fd5dd700 1 -- 172.21.15.88:0/2032703360 wait complete. 2024-09-13T21:32:11.111 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:32:11.111 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2024-09-13T21:32:11.118 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:32:11.118 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2024-09-13T21:32:11.119 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2024-09-13T21:32:11.119 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T21:32:11.120 INFO:teuthology.orchestra.run.smithi088.stdout:Ceph Dashboard is now available at: 2024-09-13T21:32:11.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:11.120 INFO:teuthology.orchestra.run.smithi088.stdout: URL: https://smithi088.front.sepia.ceph.com:8443/ 2024-09-13T21:32:11.120 INFO:teuthology.orchestra.run.smithi088.stdout: User: admin 2024-09-13T21:32:11.120 INFO:teuthology.orchestra.run.smithi088.stdout: Password: ekixg7aba2 2024-09-13T21:32:11.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:11.121 INFO:teuthology.orchestra.run.smithi088.stdout:Saving cluster configuration to /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config directory 2024-09-13T21:32:11.121 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling autotune for osd_memory_target 2024-09-13T21:32:11.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:11 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2032703360' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T21:32:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.602+0000 7f0a04f4d700 1 Processor -- start 2024-09-13T21:32:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.602+0000 7f0a04f4d700 1 -- start start 2024-09-13T21:32:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.602+0000 7f0a04f4d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.602+0000 7f0a04f4d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00079d60 con 0x7f0a001066d0 2024-09-13T21:32:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.602+0000 7f09fe59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.602+0000 7f09fe59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46992/0 (socket says 172.21.15.88:46992) 2024-09-13T21:32:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.602+0000 7f09fe59c700 1 -- 172.21.15.88:0/2083263754 learned_addr learned my addr 172.21.15.88:0/2083263754 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.602+0000 7f09fe59c700 1 -- 172.21.15.88:0/2083263754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00079ea0 con 0x7f0a001066d0 2024-09-13T21:32:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.603+0000 7f09fe59c700 1 --2- 172.21.15.88:0/2083263754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00108ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f09f00098a0 tx=0x7f09f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4e2d0839a626bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.603+0000 7f09fd59a700 1 -- 172.21.15.88:0/2083263754 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f0004180 con 0x7f0a001066d0 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.603+0000 7f09fd59a700 1 -- 172.21.15.88:0/2083263754 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09f00042e0 con 0x7f0a001066d0 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.603+0000 7f09fd59a700 1 -- 172.21.15.88:0/2083263754 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f0011af0 con 0x7f0a001066d0 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.603+0000 7f0a04f4d700 1 -- 172.21.15.88:0/2083263754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 msgr2=0x7f0a00108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.603+0000 7f0a04f4d700 1 --2- 172.21.15.88:0/2083263754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00108ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f09f00098a0 tx=0x7f09f0009bb0 comp rx=0 tx=0).stop 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.603+0000 7f0a04f4d700 1 -- 172.21.15.88:0/2083263754 shutdown_connections 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.603+0000 7f0a04f4d700 1 --2- 172.21.15.88:0/2083263754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00108ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.603+0000 7f0a04f4d700 1 -- 172.21.15.88:0/2083263754 >> 172.21.15.88:0/2083263754 conn(0x7f0a001000f0 msgr2=0x7f0a00102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.604+0000 7f0a04f4d700 1 -- 172.21.15.88:0/2083263754 shutdown_connections 2024-09-13T21:32:12.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.604+0000 7f0a04f4d700 1 -- 172.21.15.88:0/2083263754 wait complete. 2024-09-13T21:32:12.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.604+0000 7f0a04f4d700 1 Processor -- start 2024-09-13T21:32:12.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.604+0000 7f0a04f4d700 1 -- start start 2024-09-13T21:32:12.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.604+0000 7f0a04f4d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:12.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.604+0000 7f0a04f4d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00199e50 con 0x7f0a001066d0 2024-09-13T21:32:12.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f09fe59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f09fe59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46994/0 (socket says 172.21.15.88:46994) 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f09fe59c700 1 -- 172.21.15.88:0/3702958914 learned_addr learned my addr 172.21.15.88:0/3702958914 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f09fe59c700 1 -- 172.21.15.88:0/3702958914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0009550 con 0x7f0a001066d0 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f09fe59c700 1 --2- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00199910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f09f0006ba0 tx=0x7f09f0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f09ef7fe700 1 -- 172.21.15.88:0/3702958914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f0003b00 con 0x7f0a001066d0 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f09ef7fe700 1 -- 172.21.15.88:0/3702958914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09f001a8e0 con 0x7f0a001066d0 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0019a0b0 con 0x7f0a001066d0 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f09ef7fe700 1 -- 172.21.15.88:0/3702958914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f0019990 con 0x7f0a001066d0 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.605+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0019a530 con 0x7f0a001066d0 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.606+0000 7f09ef7fe700 1 -- 172.21.15.88:0/3702958914 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f09f0019c50 con 0x7f0a001066d0 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.606+0000 7f09ef7fe700 1 --2- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f09e8038490 0x7f09e803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:12.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.606+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a000623f0 con 0x7f0a001066d0 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.606+0000 7f09ef7fe700 1 -- 172.21.15.88:0/3702958914 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f09f004ca70 con 0x7f0a001066d0 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.606+0000 7f09fdd9b700 1 --2- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f09e8038490 0x7f09e803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.607+0000 7f09fdd9b700 1 --2- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f09e8038490 0x7f09e803a940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f09f4006fd0 tx=0x7f09f4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.611+0000 7f09ef7fe700 1 -- 172.21.15.88:0/3702958914 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0a000623f0 con 0x7f0a001066d0 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.801+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f0a00062380 con 0x7f0a001066d0 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.801+0000 7f09ef7fe700 1 -- 172.21.15.88:0/3702958914 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f09f002b930 con 0x7f0a001066d0 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f09e8038490 msgr2=0x7f09e803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 --2- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f09e8038490 0x7f09e803a940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f09f4006fd0 tx=0x7f09f4006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 msgr2=0x7f0a00199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 --2- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00199910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f09f0006ba0 tx=0x7f09f0011b50 comp rx=0 tx=0).stop 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 shutdown_connections 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 --2- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f09e8038490 0x7f09e803a940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:12.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 --2- 172.21.15.88:0/3702958914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a001066d0 0x7f0a00199910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:12.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 >> 172.21.15.88:0/3702958914 conn(0x7f0a001000f0 msgr2=0x7f0a00101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:12.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 shutdown_connections 2024-09-13T21:32:12.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:11.804+0000 7f0a04f4d700 1 -- 172.21.15.88:0/3702958914 wait complete. 2024-09-13T21:32:12.462 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:12 smithi088 ceph-mon[27963]: mgrmap e13: smithi088.scyrwy(active, since 6s) 2024-09-13T21:32:13.694 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.789+0000 7f4178626700 1 Processor -- start 2024-09-13T21:32:13.694 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.789+0000 7f4178626700 1 -- start start 2024-09-13T21:32:13.694 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.789+0000 7f4178626700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170104280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:13.694 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.789+0000 7f4178626700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41701047c0 con 0x7f4170103e70 2024-09-13T21:32:13.694 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.789+0000 7f41763c2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:13.694 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.789+0000 7f41763c2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170104280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47008/0 (socket says 172.21.15.88:47008) 2024-09-13T21:32:13.694 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.789+0000 7f41763c2700 1 -- 172.21.15.88:0/3552733465 learned_addr learned my addr 172.21.15.88:0/3552733465 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:13.694 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.789+0000 7f41763c2700 1 -- 172.21.15.88:0/3552733465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170104900 con 0x7f4170103e70 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f41763c2700 1 --2- 172.21.15.88:0/3552733465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170104280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41640098a0 tx=0x7f4164009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529c6ac2ebda00b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f41753c0700 1 -- 172.21.15.88:0/3552733465 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4164004180 con 0x7f4170103e70 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f41753c0700 1 -- 172.21.15.88:0/3552733465 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f41640042e0 con 0x7f4170103e70 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f41753c0700 1 -- 172.21.15.88:0/3552733465 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4164011af0 con 0x7f4170103e70 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f4178626700 1 -- 172.21.15.88:0/3552733465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 msgr2=0x7f4170104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f4178626700 1 --2- 172.21.15.88:0/3552733465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170104280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41640098a0 tx=0x7f4164009bb0 comp rx=0 tx=0).stop 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f4178626700 1 -- 172.21.15.88:0/3552733465 shutdown_connections 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f4178626700 1 --2- 172.21.15.88:0/3552733465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170104280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f4178626700 1 -- 172.21.15.88:0/3552733465 >> 172.21.15.88:0/3552733465 conn(0x7f41700ff870 msgr2=0x7f4170101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f4178626700 1 -- 172.21.15.88:0/3552733465 shutdown_connections 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.790+0000 7f4178626700 1 -- 172.21.15.88:0/3552733465 wait complete. 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.791+0000 7f4178626700 1 Processor -- start 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.791+0000 7f4178626700 1 -- start start 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.791+0000 7f4178626700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.791+0000 7f4178626700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4170199e70 con 0x7f4170103e70 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.791+0000 7f41763c2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.791+0000 7f41763c2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47010/0 (socket says 172.21.15.88:47010) 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.791+0000 7f41763c2700 1 -- 172.21.15.88:0/2111386949 learned_addr learned my addr 172.21.15.88:0/2111386949 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.791+0000 7f41763c2700 1 -- 172.21.15.88:0/2111386949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4164009550 con 0x7f4170103e70 2024-09-13T21:32:13.696 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.792+0000 7f41763c2700 1 --2- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170199930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4164006ba0 tx=0x7f4164011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:13.697 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.792+0000 7f41637fe700 1 -- 172.21.15.88:0/2111386949 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4164003b00 con 0x7f4170103e70 2024-09-13T21:32:13.697 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.792+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417019a070 con 0x7f4170103e70 2024-09-13T21:32:13.697 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.792+0000 7f41637fe700 1 -- 172.21.15.88:0/2111386949 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f416401a8e0 con 0x7f4170103e70 2024-09-13T21:32:13.697 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.792+0000 7f41637fe700 1 -- 172.21.15.88:0/2111386949 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4164019990 con 0x7f4170103e70 2024-09-13T21:32:13.697 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.792+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417019a490 con 0x7f4170103e70 2024-09-13T21:32:13.697 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.793+0000 7f41637fe700 1 -- 172.21.15.88:0/2111386949 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f4164019c50 con 0x7f4170103e70 2024-09-13T21:32:13.697 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.793+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4170062380 con 0x7f4170103e70 2024-09-13T21:32:13.697 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.793+0000 7f41637fe700 1 --2- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f415c038490 0x7f415c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:13.697 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.793+0000 7f41637fe700 1 -- 172.21.15.88:0/2111386949 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f416404c9b0 con 0x7f4170103e70 2024-09-13T21:32:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.793+0000 7f4175bc1700 1 --2- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f415c038490 0x7f415c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.793+0000 7f4175bc1700 1 --2- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f415c038490 0x7f415c03a940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f416c006fd0 tx=0x7f416c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:12.798+0000 7f41637fe700 1 -- 172.21.15.88:0/2111386949 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f416402d440 con 0x7f4170103e70 2024-09-13T21:32:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.094+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f417019d2f0 con 0x7f4170103e70 2024-09-13T21:32:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.096+0000 7f41637fe700 1 -- 172.21.15.88:0/2111386949 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f416402b340 con 0x7f4170103e70 2024-09-13T21:32:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.098+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f415c038490 msgr2=0x7f415c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.098+0000 7f4178626700 1 --2- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f415c038490 0x7f415c03a940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f416c006fd0 tx=0x7f416c006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.098+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 msgr2=0x7f4170199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.098+0000 7f4178626700 1 --2- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170199930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4164006ba0 tx=0x7f4164011b50 comp rx=0 tx=0).stop 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.098+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 shutdown_connections 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.098+0000 7f4178626700 1 --2- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f415c038490 0x7f415c03a940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.098+0000 7f4178626700 1 --2- 172.21.15.88:0/2111386949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4170103e70 0x7f4170199930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.098+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 >> 172.21.15.88:0/2111386949 conn(0x7f41700ff870 msgr2=0x7f4170100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.098+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 shutdown_connections 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2024-09-13T21:32:13.099+0000 7f4178626700 1 -- 172.21.15.88:0/2111386949 wait complete. 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:32:13.699 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: ceph telemetry on 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout:For more information see: 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T21:32:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:13.701 INFO:teuthology.orchestra.run.smithi088.stdout:Bootstrap complete. 2024-09-13T21:32:13.724 INFO:tasks.cephadm:Fetching config... 2024-09-13T21:32:13.724 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:32:13.724 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T21:32:13.780 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T21:32:13.780 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:32:13.780 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T21:32:13.836 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T21:32:13.836 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:32:13.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/keyring of=/dev/stdout 2024-09-13T21:32:13.900 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T21:32:13.901 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:32:13.901 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T21:32:13.955 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T21:32:13.956 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcMZxxpCyHyxx8jjEnVf7O6IgGa1QHzvT2w1V+MVZJdJ2kP0BFdkNpxiy5R6rz8VYwRjf4FgDm3/ForXH23y59cW1UVYnDWwFxsXPgCiLHawXZ0oyxO0Qc8Hstrtl8qRL8SbWomoWUBRHQ+ERSrMfMnnNm+DSiUp8VqMOTNVC+Av8UeU6g4kGts+SZkZDRcKp8QzYz+rzYSxWgt8/0DVf4jksQgBGY2s+9Z+PVQebXQ/ZqoGcLwmEJ3Z6p2KiIv4bki7+XYkMOQ6aYIobJw6GHCt/M5fELgNlBHkZjeJvIGkrTjXLAqKsjyxhzCNODPMD9i6ga5dxdwAAApdvTII8TWST1elEENl/mw6/wBrW25Fz104dbAEFxl0fbN/91U98GuKBuFPKYEEjDJzoQNPnJmaaQo3sTbf8euQHDc6aGamKyObS2gorqr5VNU62d1NRAR4jWVSU6QEdePehidTGRaG+ZoSUpfT8bZx9phSIfQpvxQxkGT1EabRQZa2BFC+8= ceph-67511300-7217-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T21:32:14.035 INFO:teuthology.orchestra.run.smithi088.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcMZxxpCyHyxx8jjEnVf7O6IgGa1QHzvT2w1V+MVZJdJ2kP0BFdkNpxiy5R6rz8VYwRjf4FgDm3/ForXH23y59cW1UVYnDWwFxsXPgCiLHawXZ0oyxO0Qc8Hstrtl8qRL8SbWomoWUBRHQ+ERSrMfMnnNm+DSiUp8VqMOTNVC+Av8UeU6g4kGts+SZkZDRcKp8QzYz+rzYSxWgt8/0DVf4jksQgBGY2s+9Z+PVQebXQ/ZqoGcLwmEJ3Z6p2KiIv4bki7+XYkMOQ6aYIobJw6GHCt/M5fELgNlBHkZjeJvIGkrTjXLAqKsjyxhzCNODPMD9i6ga5dxdwAAApdvTII8TWST1elEENl/mw6/wBrW25Fz104dbAEFxl0fbN/91U98GuKBuFPKYEEjDJzoQNPnJmaaQo3sTbf8euQHDc6aGamKyObS2gorqr5VNU62d1NRAR4jWVSU6QEdePehidTGRaG+ZoSUpfT8bZx9phSIfQpvxQxkGT1EabRQZa2BFC+8= ceph-67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:32:14.046 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcMZxxpCyHyxx8jjEnVf7O6IgGa1QHzvT2w1V+MVZJdJ2kP0BFdkNpxiy5R6rz8VYwRjf4FgDm3/ForXH23y59cW1UVYnDWwFxsXPgCiLHawXZ0oyxO0Qc8Hstrtl8qRL8SbWomoWUBRHQ+ERSrMfMnnNm+DSiUp8VqMOTNVC+Av8UeU6g4kGts+SZkZDRcKp8QzYz+rzYSxWgt8/0DVf4jksQgBGY2s+9Z+PVQebXQ/ZqoGcLwmEJ3Z6p2KiIv4bki7+XYkMOQ6aYIobJw6GHCt/M5fELgNlBHkZjeJvIGkrTjXLAqKsjyxhzCNODPMD9i6ga5dxdwAAApdvTII8TWST1elEENl/mw6/wBrW25Fz104dbAEFxl0fbN/91U98GuKBuFPKYEEjDJzoQNPnJmaaQo3sTbf8euQHDc6aGamKyObS2gorqr5VNU62d1NRAR4jWVSU6QEdePehidTGRaG+ZoSUpfT8bZx9phSIfQpvxQxkGT1EabRQZa2BFC+8= ceph-67511300-7217-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T21:32:14.170 INFO:teuthology.orchestra.run.smithi116.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcMZxxpCyHyxx8jjEnVf7O6IgGa1QHzvT2w1V+MVZJdJ2kP0BFdkNpxiy5R6rz8VYwRjf4FgDm3/ForXH23y59cW1UVYnDWwFxsXPgCiLHawXZ0oyxO0Qc8Hstrtl8qRL8SbWomoWUBRHQ+ERSrMfMnnNm+DSiUp8VqMOTNVC+Av8UeU6g4kGts+SZkZDRcKp8QzYz+rzYSxWgt8/0DVf4jksQgBGY2s+9Z+PVQebXQ/ZqoGcLwmEJ3Z6p2KiIv4bki7+XYkMOQ6aYIobJw6GHCt/M5fELgNlBHkZjeJvIGkrTjXLAqKsjyxhzCNODPMD9i6ga5dxdwAAApdvTII8TWST1elEENl/mw6/wBrW25Fz104dbAEFxl0fbN/91U98GuKBuFPKYEEjDJzoQNPnJmaaQo3sTbf8euQHDc6aGamKyObS2gorqr5VNU62d1NRAR4jWVSU6QEdePehidTGRaG+ZoSUpfT8bZx9phSIfQpvxQxkGT1EabRQZa2BFC+8= ceph-67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:32:14.182 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T21:32:14.263 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:14 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2111386949' entity='client.admin' 2024-09-13T21:32:14.376 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:32:16.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.022+0000 7f3be6861700 1 -- 172.21.15.88:0/4091942513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 msgr2=0x7f3be00fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:16.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.022+0000 7f3be6861700 1 --2- 172.21.15.88:0/4091942513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 0x7f3be00fdfc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009910 tx=0x7f3bd0009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:16.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.022+0000 7f3be6861700 1 -- 172.21.15.88:0/4091942513 shutdown_connections 2024-09-13T21:32:16.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.022+0000 7f3be6861700 1 --2- 172.21.15.88:0/4091942513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 0x7f3be00fdfc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:16.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.022+0000 7f3be6861700 1 -- 172.21.15.88:0/4091942513 >> 172.21.15.88:0/4091942513 conn(0x7f3be00f9600 msgr2=0x7f3be00fba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.022+0000 7f3be6861700 1 -- 172.21.15.88:0/4091942513 shutdown_connections 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.022+0000 7f3be6861700 1 -- 172.21.15.88:0/4091942513 wait complete. 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.022+0000 7f3be6861700 1 Processor -- start 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3be6861700 1 -- start start 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3be6861700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 0x7f3be0194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3be6861700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be0195500 con 0x7f3be00fdbb0 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3bdffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 0x7f3be0194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3bdffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 0x7f3be0194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47030/0 (socket says 172.21.15.88:47030) 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3bdffff700 1 -- 172.21.15.88:0/2511160838 learned_addr learned my addr 172.21.15.88:0/2511160838 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3bdffff700 1 -- 172.21.15.88:0/2511160838 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd00095f0 con 0x7f3be00fdbb0 2024-09-13T21:32:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3bdffff700 1 --2- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 0x7f3be0194fc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0005b40 tx=0x7f3bd0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:16.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3bddffb700 1 -- 172.21.15.88:0/2511160838 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bd001d070 con 0x7f3be00fdbb0 2024-09-13T21:32:16.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3bddffb700 1 -- 172.21.15.88:0/2511160838 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3bd000be10 con 0x7f3be00fdbb0 2024-09-13T21:32:16.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.023+0000 7f3bddffb700 1 -- 172.21.15.88:0/2511160838 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bd000f460 con 0x7f3be00fdbb0 2024-09-13T21:32:16.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.024+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be0195700 con 0x7f3be00fdbb0 2024-09-13T21:32:16.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.024+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be0195ba0 con 0x7f3be00fdbb0 2024-09-13T21:32:16.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.025+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be018eb10 con 0x7f3be00fdbb0 2024-09-13T21:32:16.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.025+0000 7f3bddffb700 1 -- 172.21.15.88:0/2511160838 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f3bd00227e0 con 0x7f3be00fdbb0 2024-09-13T21:32:16.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.025+0000 7f3bddffb700 1 --2- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3bcc038490 0x7f3bcc03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:16.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.025+0000 7f3bddffb700 1 -- 172.21.15.88:0/2511160838 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f3bd004c3d0 con 0x7f3be00fdbb0 2024-09-13T21:32:16.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.026+0000 7f3bd7fff700 1 --2- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3bcc038490 0x7f3bcc03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:16.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.026+0000 7f3bd7fff700 1 --2- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3bcc038490 0x7f3bcc03a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8006fd0 tx=0x7f3bc8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:16.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.030+0000 7f3bddffb700 1 -- 172.21.15.88:0/2511160838 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3bd002bba0 con 0x7f3be00fdbb0 2024-09-13T21:32:16.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.227+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f3be002cc30 con 0x7f3be00fdbb0 2024-09-13T21:32:16.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.233+0000 7f3bddffb700 1 -- 172.21.15.88:0/2511160838 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3bd0027020 con 0x7f3be00fdbb0 2024-09-13T21:32:16.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3bcc038490 msgr2=0x7f3bcc03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:16.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 --2- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3bcc038490 0x7f3bcc03a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8006fd0 tx=0x7f3bc8006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:16.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 msgr2=0x7f3be0194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:16.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 --2- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 0x7f3be0194fc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0005b40 tx=0x7f3bd0004740 comp rx=0 tx=0).stop 2024-09-13T21:32:16.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 shutdown_connections 2024-09-13T21:32:16.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 --2- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3bcc038490 0x7f3bcc03a940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:16.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 --2- 172.21.15.88:0/2511160838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3be00fdbb0 0x7f3be0194fc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:16.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 >> 172.21.15.88:0/2511160838 conn(0x7f3be00f9600 msgr2=0x7f3be00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:16.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 shutdown_connections 2024-09-13T21:32:16.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:16.235+0000 7f3be6861700 1 -- 172.21.15.88:0/2511160838 wait complete. 2024-09-13T21:32:17.143 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T21:32:17.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T21:32:17.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:17 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2511160838' entity='client.admin' 2024-09-13T21:32:17.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:17 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:17.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:17 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:17.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:17 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:32:17.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:17 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:17.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:17 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:32:17.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:17 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T21:32:17.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:17 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:32:17.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:17 smithi088 ceph-mon[27963]: Deploying daemon ceph-exporter.smithi088 on smithi088 2024-09-13T21:32:17.651 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:32:19.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.374+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/3443078784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 msgr2=0x7fb7c4100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.374+0000 7fb7c9c5e700 1 --2- 172.21.15.88:0/3443078784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 0x7fb7c4100230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009910 tx=0x7fb7b4009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.375+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/3443078784 shutdown_connections 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.375+0000 7fb7c9c5e700 1 --2- 172.21.15.88:0/3443078784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 0x7fb7c4100230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.375+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/3443078784 >> 172.21.15.88:0/3443078784 conn(0x7fb7c40fb3d0 msgr2=0x7fb7c40fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.375+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/3443078784 shutdown_connections 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.375+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/3443078784 wait complete. 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.375+0000 7fb7c9c5e700 1 Processor -- start 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.375+0000 7fb7c9c5e700 1 -- start start 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c9c5e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 0x7fb7c4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c9c5e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c4075030 con 0x7fb7c40ffe20 2024-09-13T21:32:19.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 0x7fb7c4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:19.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 0x7fb7c4074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47040/0 (socket says 172.21.15.88:47040) 2024-09-13T21:32:19.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c37fe700 1 -- 172.21.15.88:0/2890146197 learned_addr learned my addr 172.21.15.88:0/2890146197 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:19.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c37fe700 1 -- 172.21.15.88:0/2890146197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40095f0 con 0x7fb7c40ffe20 2024-09-13T21:32:19.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c37fe700 1 --2- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 0x7fb7c4074af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4005b40 tx=0x7fb7b4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c17fa700 1 -- 172.21.15.88:0/2890146197 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7b401d070 con 0x7fb7c40ffe20 2024-09-13T21:32:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c17fa700 1 -- 172.21.15.88:0/2890146197 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb7b400be10 con 0x7fb7c40ffe20 2024-09-13T21:32:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c4073140 con 0x7fb7c40ffe20 2024-09-13T21:32:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c17fa700 1 -- 172.21.15.88:0/2890146197 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7b400f460 con 0x7fb7c40ffe20 2024-09-13T21:32:19.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.376+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c40735e0 con 0x7fb7c40ffe20 2024-09-13T21:32:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.377+0000 7fb7c17fa700 1 -- 172.21.15.88:0/2890146197 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fb7b400f6d0 con 0x7fb7c40ffe20 2024-09-13T21:32:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.377+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c4062380 con 0x7fb7c40ffe20 2024-09-13T21:32:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.377+0000 7fb7c17fa700 1 --2- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb7b0038490 0x7fb7b003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.377+0000 7fb7c17fa700 1 -- 172.21.15.88:0/2890146197 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fb7b404c200 con 0x7fb7c40ffe20 2024-09-13T21:32:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.378+0000 7fb7bbfff700 1 --2- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb7b0038490 0x7fb7b003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:19.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.378+0000 7fb7bbfff700 1 --2- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb7b0038490 0x7fb7b003a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac006fd0 tx=0x7fb7ac006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:19.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.382+0000 7fb7c17fa700 1 -- 172.21.15.88:0/2890146197 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb7b4020730 con 0x7fb7c40ffe20 2024-09-13T21:32:19.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.580+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7c4073820 con 0x7fb7b0038490 2024-09-13T21:32:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.583+0000 7fb7c17fa700 1 -- 172.21.15.88:0/2890146197 <== mgr.14162 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb7c4073820 con 0x7fb7b0038490 2024-09-13T21:32:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb7b0038490 msgr2=0x7fb7b003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 --2- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb7b0038490 0x7fb7b003a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac006fd0 tx=0x7fb7ac006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 msgr2=0x7fb7c4074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:19.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 --2- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 0x7fb7c4074af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4005b40 tx=0x7fb7b4004740 comp rx=0 tx=0).stop 2024-09-13T21:32:19.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 shutdown_connections 2024-09-13T21:32:19.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 --2- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb7b0038490 0x7fb7b003a940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:19.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 --2- 172.21.15.88:0/2890146197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7c40ffe20 0x7fb7c4074af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:19.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 >> 172.21.15.88:0/2890146197 conn(0x7fb7c40fb3d0 msgr2=0x7fb7c40fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:19.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 shutdown_connections 2024-09-13T21:32:19.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:19.585+0000 7fb7c9c5e700 1 -- 172.21.15.88:0/2890146197 wait complete. 2024-09-13T21:32:20.396 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi116 2024-09-13T21:32:20.396 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:32:20.396 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.conf 2024-09-13T21:32:20.416 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:32:20.416 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:32:20.474 INFO:tasks.cephadm:Adding host smithi116 to orchestrator... 2024-09-13T21:32:20.474 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch host add smithi116 2024-09-13T21:32:20.702 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:20 smithi088 ceph-mon[27963]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:32:20.702 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:20 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.368+0000 7f47a0afd700 1 -- 172.21.15.88:0/3184968845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 msgr2=0x7f479c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.368+0000 7f47a0afd700 1 --2- 172.21.15.88:0/3184968845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 0x7f479c0ff130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f478c009910 tx=0x7f478c009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.368+0000 7f47a0afd700 1 -- 172.21.15.88:0/3184968845 shutdown_connections 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.368+0000 7f47a0afd700 1 --2- 172.21.15.88:0/3184968845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 0x7f479c0ff130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.368+0000 7f47a0afd700 1 -- 172.21.15.88:0/3184968845 >> 172.21.15.88:0/3184968845 conn(0x7f479c0fa2b0 msgr2=0x7f479c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.368+0000 7f47a0afd700 1 -- 172.21.15.88:0/3184968845 shutdown_connections 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.368+0000 7f47a0afd700 1 -- 172.21.15.88:0/3184968845 wait complete. 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f47a0afd700 1 Processor -- start 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f47a0afd700 1 -- start start 2024-09-13T21:32:23.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f47a0afd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 0x7f479c194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f47a0afd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c1954f0 con 0x7f479c0fed20 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f479a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 0x7f479c194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f479a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 0x7f479c194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44026/0 (socket says 172.21.15.88:44026) 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f479a59c700 1 -- 172.21.15.88:0/3857218225 learned_addr learned my addr 172.21.15.88:0/3857218225 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f479a59c700 1 -- 172.21.15.88:0/3857218225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c0095f0 con 0x7f479c0fed20 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f479a59c700 1 --2- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 0x7f479c194fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f478c005b40 tx=0x7f478c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.369+0000 7f478b7fe700 1 -- 172.21.15.88:0/3857218225 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f478c01d070 con 0x7f479c0fed20 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.370+0000 7f478b7fe700 1 -- 172.21.15.88:0/3857218225 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f478c00be10 con 0x7f479c0fed20 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.370+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c1956f0 con 0x7f479c0fed20 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.370+0000 7f478b7fe700 1 -- 172.21.15.88:0/3857218225 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f478c00f460 con 0x7f479c0fed20 2024-09-13T21:32:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.370+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c195b90 con 0x7f479c0fed20 2024-09-13T21:32:23.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.370+0000 7f478b7fe700 1 -- 172.21.15.88:0/3857218225 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f478c00f6d0 con 0x7f479c0fed20 2024-09-13T21:32:23.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.371+0000 7f478b7fe700 1 --2- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4784038490 0x7f478403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:23.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.371+0000 7f478b7fe700 1 -- 172.21.15.88:0/3857218225 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f478c0227e0 con 0x7f479c0fed20 2024-09-13T21:32:23.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.371+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c18ea10 con 0x7f479c0fed20 2024-09-13T21:32:23.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.371+0000 7f4799d9b700 1 --2- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4784038490 0x7f478403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.371+0000 7f4799d9b700 1 --2- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4784038490 0x7f478403a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4790006fd0 tx=0x7f4790006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.375+0000 7f478b7fe700 1 -- 172.21.15.88:0/3857218225 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f478c027030 con 0x7f479c0fed20 2024-09-13T21:32:23.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:23.575+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}) v1 -- 0x7f479c061190 con 0x7f4784038490 2024-09-13T21:32:24.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:32:24.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:24.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:24.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:24.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:24.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:32:24.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T21:32:24.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:32:24.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: Deploying daemon crash.smithi088 on smithi088 2024-09-13T21:32:24.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:24 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:25.936 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:25 smithi088 ceph-mon[27963]: Deploying cephadm binary to smithi116 2024-09-13T21:32:25.937 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:25 smithi088 ceph-mon[27963]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.039+0000 7f478b7fe700 1 -- 172.21.15.88:0/3857218225 <== mgr.14162 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f479c061190 con 0x7f4784038490 2024-09-13T21:32:26.042 INFO:teuthology.orchestra.run.smithi088.stdout:Added host 'smithi116' with addr '172.21.15.116' 2024-09-13T21:32:26.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4784038490 msgr2=0x7f478403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:26.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 --2- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4784038490 0x7f478403a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4790006fd0 tx=0x7f4790006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:26.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 msgr2=0x7f479c194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:26.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 --2- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 0x7f479c194fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f478c005b40 tx=0x7f478c004740 comp rx=0 tx=0).stop 2024-09-13T21:32:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 shutdown_connections 2024-09-13T21:32:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 --2- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4784038490 0x7f478403a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 --2- 172.21.15.88:0/3857218225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479c0fed20 0x7f479c194fb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 >> 172.21.15.88:0/3857218225 conn(0x7f479c0fa2b0 msgr2=0x7f479c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 shutdown_connections 2024-09-13T21:32:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:26.043+0000 7f47a0afd700 1 -- 172.21.15.88:0/3857218225 wait complete. 2024-09-13T21:32:26.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T21:32:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:32:27.292 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:27 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:27.293 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:27 smithi088 ceph-mon[27963]: Added host smithi116 2024-09-13T21:32:27.293 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:27 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:27.293 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:27 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:27.293 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:27 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:27.293 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:27 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:27.293 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:27 smithi088 ceph-mon[27963]: Deploying daemon node-exporter.smithi088 on smithi088 2024-09-13T21:32:27.294 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:27 smithi088 ceph-mon[27963]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.582+0000 7fa51a2ad700 1 -- 172.21.15.88:0/2250293556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 msgr2=0x7fa5140ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.582+0000 7fa51a2ad700 1 --2- 172.21.15.88:0/2250293556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 0x7fa5140ff140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa504009910 tx=0x7fa504009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.582+0000 7fa51a2ad700 1 -- 172.21.15.88:0/2250293556 shutdown_connections 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.582+0000 7fa51a2ad700 1 --2- 172.21.15.88:0/2250293556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 0x7fa5140ff140 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.582+0000 7fa51a2ad700 1 -- 172.21.15.88:0/2250293556 >> 172.21.15.88:0/2250293556 conn(0x7fa5140fa2c0 msgr2=0x7fa5140fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.582+0000 7fa51a2ad700 1 -- 172.21.15.88:0/2250293556 shutdown_connections 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.582+0000 7fa51a2ad700 1 -- 172.21.15.88:0/2250293556 wait complete. 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.582+0000 7fa51a2ad700 1 Processor -- start 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.582+0000 7fa51a2ad700 1 -- start start 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa51a2ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 0x7fa514069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa51a2ad700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514197d00 con 0x7fa5140fed30 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa513fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 0x7fa514069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa513fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 0x7fa514069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44066/0 (socket says 172.21.15.88:44066) 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa513fff700 1 -- 172.21.15.88:0/269616137 learned_addr learned my addr 172.21.15.88:0/269616137 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa513fff700 1 -- 172.21.15.88:0/269616137 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040095f0 con 0x7fa5140fed30 2024-09-13T21:32:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa513fff700 1 --2- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 0x7fa514069360 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa504005b40 tx=0x7fa504004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa511ffb700 1 -- 172.21.15.88:0/269616137 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa50401d070 con 0x7fa5140fed30 2024-09-13T21:32:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa514197e40 con 0x7fa5140fed30 2024-09-13T21:32:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa511ffb700 1 -- 172.21.15.88:0/269616137 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa50400be10 con 0x7fa5140fed30 2024-09-13T21:32:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa511ffb700 1 -- 172.21.15.88:0/269616137 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa50400f460 con 0x7fa5140fed30 2024-09-13T21:32:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.583+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5141982e0 con 0x7fa5140fed30 2024-09-13T21:32:28.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.585+0000 7fa511ffb700 1 -- 172.21.15.88:0/269616137 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fa50400b960 con 0x7fa5140fed30 2024-09-13T21:32:28.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.585+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51418da10 con 0x7fa5140fed30 2024-09-13T21:32:28.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.585+0000 7fa511ffb700 1 --2- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa500038490 0x7fa50003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:28.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.585+0000 7fa511ffb700 1 -- 172.21.15.88:0/269616137 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fa50404c390 con 0x7fa5140fed30 2024-09-13T21:32:28.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.585+0000 7fa50bfff700 1 --2- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa500038490 0x7fa50003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:28.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.585+0000 7fa50bfff700 1 --2- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa500038490 0x7fa50003a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc006fd0 tx=0x7fa4fc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:28.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.590+0000 7fa511ffb700 1 -- 172.21.15.88:0/269616137 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa50402a360 con 0x7fa5140fed30 2024-09-13T21:32:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.811+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa514061190 con 0x7fa500038490 2024-09-13T21:32:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.813+0000 7fa511ffb700 1 -- 172.21.15.88:0/269616137 <== mgr.14162 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fa514061190 con 0x7fa500038490 2024-09-13T21:32:28.814 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:32:28.815 INFO:teuthology.orchestra.run.smithi088.stdout:[{"addr": "172.21.15.88", "hostname": "smithi088", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}] 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa500038490 msgr2=0x7fa50003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 --2- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa500038490 0x7fa50003a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc006fd0 tx=0x7fa4fc006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 msgr2=0x7fa514069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 --2- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 0x7fa514069360 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa504005b40 tx=0x7fa504004740 comp rx=0 tx=0).stop 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 shutdown_connections 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 --2- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa500038490 0x7fa50003a940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 --2- 172.21.15.88:0/269616137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5140fed30 0x7fa514069360 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 >> 172.21.15.88:0/269616137 conn(0x7fa5140fa2c0 msgr2=0x7fa5140faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 shutdown_connections 2024-09-13T21:32:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:28.815+0000 7fa51a2ad700 1 -- 172.21.15.88:0/269616137 wait complete. 2024-09-13T21:32:29.490 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T21:32:29.490 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T21:32:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:32:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:29 smithi088 ceph-mon[27963]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:29 smithi088 ceph-mon[27963]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:32:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:29 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:32.081 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:31 smithi088 ceph-mon[27963]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:32.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 -- 172.21.15.88:0/3709800408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 msgr2=0x7f5b300fe510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:32.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 --2- 172.21.15.88:0/3709800408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 0x7f5b300fe510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009910 tx=0x7f5b2c009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 -- 172.21.15.88:0/3709800408 shutdown_connections 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 --2- 172.21.15.88:0/3709800408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 0x7f5b300fe510 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 -- 172.21.15.88:0/3709800408 >> 172.21.15.88:0/3709800408 conn(0x7f5b300f9a50 msgr2=0x7f5b300fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 -- 172.21.15.88:0/3709800408 shutdown_connections 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 -- 172.21.15.88:0/3709800408 wait complete. 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 Processor -- start 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 -- start start 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 0x7f5b30100ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.666+0000 7f5b3821b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b30101020 con 0x7f5b300fe100 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b35fb7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 0x7f5b30100ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b35fb7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 0x7f5b30100ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41512/0 (socket says 172.21.15.88:41512) 2024-09-13T21:32:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b35fb7700 1 -- 172.21.15.88:0/546421166 learned_addr learned my addr 172.21.15.88:0/546421166 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:32:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b35fb7700 1 -- 172.21.15.88:0/546421166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0095f0 con 0x7f5b300fe100 2024-09-13T21:32:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b35fb7700 1 --2- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 0x7f5b30100ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005b40 tx=0x7f5b2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b26ffd700 1 -- 172.21.15.88:0/546421166 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b2c01d070 con 0x7f5b300fe100 2024-09-13T21:32:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b300ff130 con 0x7f5b300fe100 2024-09-13T21:32:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b26ffd700 1 -- 172.21.15.88:0/546421166 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b2c00be10 con 0x7f5b300fe100 2024-09-13T21:32:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b26ffd700 1 -- 172.21.15.88:0/546421166 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b2c00f460 con 0x7f5b300fe100 2024-09-13T21:32:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.667+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b300ff5d0 con 0x7f5b300fe100 2024-09-13T21:32:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.668+0000 7f5b26ffd700 1 -- 172.21.15.88:0/546421166 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f5b2c00f6d0 con 0x7f5b300fe100 2024-09-13T21:32:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.668+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b30062380 con 0x7f5b300fe100 2024-09-13T21:32:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.668+0000 7f5b26ffd700 1 --2- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b1c038490 0x7f5b1c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.668+0000 7f5b26ffd700 1 -- 172.21.15.88:0/546421166 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f5b2c04d410 con 0x7f5b300fe100 2024-09-13T21:32:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.669+0000 7f5b357b6700 1 --2- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b1c038490 0x7f5b1c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.669+0000 7f5b357b6700 1 --2- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b1c038490 0x7f5b1c03a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b20006fd0 tx=0x7f5b20006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:32.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.673+0000 7f5b26ffd700 1 -- 172.21.15.88:0/546421166 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5b2c02a360 con 0x7f5b300fe100 2024-09-13T21:32:32.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:32.898+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5b3018e4f0 con 0x7f5b300fe100 2024-09-13T21:32:33.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.297+0000 7f5b26ffd700 1 -- 172.21.15.88:0/546421166 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5b2c027070 con 0x7f5b300fe100 2024-09-13T21:32:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b1c038490 msgr2=0x7f5b1c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 --2- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b1c038490 0x7f5b1c03a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b20006fd0 tx=0x7f5b20006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 msgr2=0x7f5b30100ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 --2- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 0x7f5b30100ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005b40 tx=0x7f5b2c004740 comp rx=0 tx=0).stop 2024-09-13T21:32:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 shutdown_connections 2024-09-13T21:32:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 --2- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b1c038490 0x7f5b1c03a940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 --2- 172.21.15.88:0/546421166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300fe100 0x7f5b30100ae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 >> 172.21.15.88:0/546421166 conn(0x7f5b300f9a50 msgr2=0x7f5b300fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 shutdown_connections 2024-09-13T21:32:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:32:33.299+0000 7f5b3821b700 1 -- 172.21.15.88:0/546421166 wait complete. 2024-09-13T21:32:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2024-09-13T21:32:33.516 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:33 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:33.517 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:33 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:33.517 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:33 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:33.517 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:33 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:33.517 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:33 smithi088 ceph-mon[27963]: Deploying daemon alertmanager.smithi088 on smithi088 2024-09-13T21:32:33.517 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:33 smithi088 ceph-mon[27963]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:33.517 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:33 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/546421166' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T21:32:34.364 INFO:tasks.cephadm:Adding mon.smithi088 on smithi088 2024-09-13T21:32:34.364 INFO:tasks.cephadm:Adding mon.smithi116 on smithi116 2024-09-13T21:32:34.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi088:172.21.15.88=smithi088;smithi116:172.21.15.116=smithi116' 2024-09-13T21:32:34.650 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:34.693 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:34.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:34 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/546421166' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T21:32:34.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:34 smithi088 ceph-mon[27963]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T21:32:35.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:35 smithi088 ceph-mon[27963]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:35.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:35 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:36.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.199+0000 7fc8399dc700 1 -- 172.21.15.116:0/2941846722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 msgr2=0x7fc8340ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:36.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.199+0000 7fc8399dc700 1 --2- 172.21.15.116:0/2941846722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 0x7fc8340ff140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc824009910 tx=0x7fc824009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:36.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.199+0000 7fc8399dc700 1 -- 172.21.15.116:0/2941846722 shutdown_connections 2024-09-13T21:32:36.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.199+0000 7fc8399dc700 1 --2- 172.21.15.116:0/2941846722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 0x7fc8340ff140 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:36.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.199+0000 7fc8399dc700 1 -- 172.21.15.116:0/2941846722 >> 172.21.15.116:0/2941846722 conn(0x7fc8340fa2c0 msgr2=0x7fc8340fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.199+0000 7fc8399dc700 1 -- 172.21.15.116:0/2941846722 shutdown_connections 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.199+0000 7fc8399dc700 1 -- 172.21.15.116:0/2941846722 wait complete. 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.199+0000 7fc8399dc700 1 Processor -- start 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.199+0000 7fc8399dc700 1 -- start start 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc8399dc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 0x7fc834069340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc8399dc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834197d20 con 0x7fc8340fed30 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc832ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 0x7fc834069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc832ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 0x7fc834069340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:58948/0 (socket says 172.21.15.116:58948) 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc832ffd700 1 -- 172.21.15.116:0/2058140555 learned_addr learned my addr 172.21.15.116:0/2058140555 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:32:36.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc832ffd700 1 -- 172.21.15.116:0/2058140555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8240095f0 con 0x7fc8340fed30 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc832ffd700 1 --2- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 0x7fc834069340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc824005b40 tx=0x7fc824004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc8389da700 1 -- 172.21.15.116:0/2058140555 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc82401d070 con 0x7fc8340fed30 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc8389da700 1 -- 172.21.15.116:0/2058140555 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc82400be10 con 0x7fc8340fed30 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc8389da700 1 -- 172.21.15.116:0/2058140555 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc82400f460 con 0x7fc8340fed30 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.200+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc834197e60 con 0x7fc8340fed30 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.201+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8341982a0 con 0x7fc8340fed30 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.201+0000 7fc8389da700 1 -- 172.21.15.116:0/2058140555 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fc82400b960 con 0x7fc8340fed30 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.201+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83418da10 con 0x7fc8340fed30 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.201+0000 7fc8389da700 1 --2- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc81c0384e0 0x7fc81c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.202+0000 7fc8389da700 1 -- 172.21.15.116:0/2058140555 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fc82404c3a0 con 0x7fc8340fed30 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.202+0000 7fc8327fc700 1 --2- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc81c0384e0 0x7fc81c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:36.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.202+0000 7fc8327fc700 1 --2- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc81c0384e0 0x7fc81c03a990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc828006fd0 tx=0x7fc828006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:36.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.207+0000 7fc8389da700 1 -- 172.21.15.116:0/2058140555 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc82402bb60 con 0x7fc8340fed30 2024-09-13T21:32:36.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.409+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi088:172.21.15.88=smithi088;smithi116:172.21.15.116=smithi116", "target": ["mon-mgr", ""]}) v1 -- 0x7fc834061300 con 0x7fc81c0384e0 2024-09-13T21:32:36.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.415+0000 7fc8389da700 1 -- 172.21.15.116:0/2058140555 <== mgr.14162 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc834061300 con 0x7fc81c0384e0 2024-09-13T21:32:36.416 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mon update... 2024-09-13T21:32:36.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc81c0384e0 msgr2=0x7fc81c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:36.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 --2- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc81c0384e0 0x7fc81c03a990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc828006fd0 tx=0x7fc828006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:36.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 msgr2=0x7fc834069340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:36.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 --2- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 0x7fc834069340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc824005b40 tx=0x7fc824004740 comp rx=0 tx=0).stop 2024-09-13T21:32:36.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 shutdown_connections 2024-09-13T21:32:36.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 --2- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc81c0384e0 0x7fc81c03a990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:36.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 --2- 172.21.15.116:0/2058140555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340fed30 0x7fc834069340 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:36.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 >> 172.21.15.116:0/2058140555 conn(0x7fc8340fa2c0 msgr2=0x7fc8340faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:36.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 shutdown_connections 2024-09-13T21:32:36.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:36.417+0000 7fc8399dc700 1 -- 172.21.15.116:0/2058140555 wait complete. 2024-09-13T21:32:36.970 DEBUG:teuthology.orchestra.run.smithi116:mon.smithi116> sudo journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi116.service 2024-09-13T21:32:36.972 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:32:36.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:32:37.193 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:37 smithi088 ceph-mon[27963]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi088:172.21.15.88=smithi088;smithi116:172.21.15.116=smithi116", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:32:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:37 smithi088 ceph-mon[27963]: Saving service mon spec with placement smithi088:172.21.15.88=smithi088;smithi116:172.21.15.116=smithi116;count:2 2024-09-13T21:32:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:37 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:37 smithi088 ceph-mon[27963]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.723+0000 7f7204bee700 1 -- 172.21.15.116:0/2600395000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 msgr2=0x7f72000fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.723+0000 7f7204bee700 1 --2- 172.21.15.116:0/2600395000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 0x7f72000fe4f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009910 tx=0x7f71f8009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.723+0000 7f7204bee700 1 -- 172.21.15.116:0/2600395000 shutdown_connections 2024-09-13T21:32:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.723+0000 7f7204bee700 1 --2- 172.21.15.116:0/2600395000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 0x7f72000fe4f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.723+0000 7f7204bee700 1 -- 172.21.15.116:0/2600395000 >> 172.21.15.116:0/2600395000 conn(0x7f72000f9a50 msgr2=0x7f72000fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:38.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.723+0000 7f7204bee700 1 -- 172.21.15.116:0/2600395000 shutdown_connections 2024-09-13T21:32:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.723+0000 7f7204bee700 1 -- 172.21.15.116:0/2600395000 wait complete. 2024-09-13T21:32:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.724+0000 7f7204bee700 1 Processor -- start 2024-09-13T21:32:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.724+0000 7f7204bee700 1 -- start start 2024-09-13T21:32:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.724+0000 7f7204bee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 0x7f7200194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.724+0000 7f7204bee700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72001954f0 con 0x7f72000fe0e0 2024-09-13T21:32:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.725+0000 7f71fe59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 0x7f7200194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.725+0000 7f71fe59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 0x7f7200194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:56858/0 (socket says 172.21.15.116:56858) 2024-09-13T21:32:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.725+0000 7f71fe59c700 1 -- 172.21.15.116:0/592107409 learned_addr learned my addr 172.21.15.116:0/592107409 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:32:38.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.725+0000 7f71fe59c700 1 -- 172.21.15.116:0/592107409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80095f0 con 0x7f72000fe0e0 2024-09-13T21:32:38.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.725+0000 7f71fe59c700 1 --2- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 0x7f7200194fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71f8005b40 tx=0x7f71f8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.725+0000 7f71f77fe700 1 -- 172.21.15.116:0/592107409 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71f801d070 con 0x7f72000fe0e0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.725+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72001956f0 con 0x7f72000fe0e0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.725+0000 7f71f77fe700 1 -- 172.21.15.116:0/592107409 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f71f800be10 con 0x7f72000fe0e0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.725+0000 7f71f77fe700 1 -- 172.21.15.116:0/592107409 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71f800f460 con 0x7f72000fe0e0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.726+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7200195b90 con 0x7f72000fe0e0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.726+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720018eb00 con 0x7f72000fe0e0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.726+0000 7f71f77fe700 1 -- 172.21.15.116:0/592107409 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f71f800b960 con 0x7f72000fe0e0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.727+0000 7f71f77fe700 1 --2- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ec038490 0x7f71ec03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.727+0000 7f71f77fe700 1 -- 172.21.15.116:0/592107409 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f71f804c410 con 0x7f72000fe0e0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.727+0000 7f71fdd9b700 1 --2- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ec038490 0x7f71ec03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:38.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.727+0000 7f71fdd9b700 1 --2- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ec038490 0x7f71ec03a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f71e8006fd0 tx=0x7f71e8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:38.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.732+0000 7f71f77fe700 1 -- 172.21.15.116:0/592107409 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f71f802a360 con 0x7f72000fe0e0 2024-09-13T21:32:38.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.998+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f720002cc30 con 0x7f72000fe0e0 2024-09-13T21:32:39.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:38.999+0000 7f71f77fe700 1 -- 172.21.15.116:0/592107409 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f71f8027030 con 0x7f72000fe0e0 2024-09-13T21:32:39.000 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:32:39.000 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:32:39.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ec038490 msgr2=0x7f71ec03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:39.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 --2- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ec038490 0x7f71ec03a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f71e8006fd0 tx=0x7f71e8006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:39.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 msgr2=0x7f7200194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:39.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 --2- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 0x7f7200194fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71f8005b40 tx=0x7f71f8004740 comp rx=0 tx=0).stop 2024-09-13T21:32:39.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 shutdown_connections 2024-09-13T21:32:39.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 --2- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71ec038490 0x7f71ec03a940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:39.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 --2- 172.21.15.116:0/592107409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72000fe0e0 0x7f7200194fb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:39.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 >> 172.21.15.116:0/592107409 conn(0x7f72000f9a50 msgr2=0x7f72000fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:39.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 shutdown_connections 2024-09-13T21:32:39.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:39.001+0000 7f7204bee700 1 -- 172.21.15.116:0/592107409 wait complete. 2024-09-13T21:32:39.003 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:32:39.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:39 smithi088 ceph-mon[27963]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:39.979 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:39 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/592107409' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:32:40.552 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:32:40.553 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:32:40.747 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:40.792 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:41.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:41.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:41.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:41.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:41.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:41.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-13T21:32:41.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:41.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:41.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T21:32:41.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:41 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:42.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.322+0000 7f5561847700 1 -- 172.21.15.116:0/2859396506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 msgr2=0x7f555c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.322+0000 7f5561847700 1 --2- 172.21.15.116:0/2859396506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 0x7f555c100230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f554c009910 tx=0x7f554c009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.323+0000 7f5561847700 1 -- 172.21.15.116:0/2859396506 shutdown_connections 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.323+0000 7f5561847700 1 --2- 172.21.15.116:0/2859396506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 0x7f555c100230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.323+0000 7f5561847700 1 -- 172.21.15.116:0/2859396506 >> 172.21.15.116:0/2859396506 conn(0x7f555c0fb3d0 msgr2=0x7f555c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.323+0000 7f5561847700 1 -- 172.21.15.116:0/2859396506 shutdown_connections 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.323+0000 7f5561847700 1 -- 172.21.15.116:0/2859396506 wait complete. 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.323+0000 7f5561847700 1 Processor -- start 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.323+0000 7f5561847700 1 -- start start 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.323+0000 7f5561847700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 0x7f555c197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.323+0000 7f5561847700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c1976a0 con 0x7f555c0ffe20 2024-09-13T21:32:42.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f555affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 0x7f555c197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:42.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f555affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 0x7f555c197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:56868/0 (socket says 172.21.15.116:56868) 2024-09-13T21:32:42.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f555affd700 1 -- 172.21.15.116:0/1858437572 learned_addr learned my addr 172.21.15.116:0/1858437572 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:32:42.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f555affd700 1 -- 172.21.15.116:0/1858437572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0095f0 con 0x7f555c0ffe20 2024-09-13T21:32:42.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f555affd700 1 --2- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 0x7f555c197160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f554c005b40 tx=0x7f554c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:42.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f5560845700 1 -- 172.21.15.116:0/1858437572 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f554c01d070 con 0x7f555c0ffe20 2024-09-13T21:32:42.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c1978a0 con 0x7f555c0ffe20 2024-09-13T21:32:42.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f5560845700 1 -- 172.21.15.116:0/1858437572 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f554c00be10 con 0x7f555c0ffe20 2024-09-13T21:32:42.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c197d40 con 0x7f555c0ffe20 2024-09-13T21:32:42.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.324+0000 7f5560845700 1 -- 172.21.15.116:0/1858437572 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f554c00f460 con 0x7f555c0ffe20 2024-09-13T21:32:42.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.325+0000 7f5560845700 1 -- 172.21.15.116:0/1858437572 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f554c00b960 con 0x7f555c0ffe20 2024-09-13T21:32:42.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.325+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c1911f0 con 0x7f555c0ffe20 2024-09-13T21:32:42.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.325+0000 7f5560845700 1 --2- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5544038490 0x7f554403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:42.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.325+0000 7f5560845700 1 -- 172.21.15.116:0/1858437572 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f554c04c2e0 con 0x7f555c0ffe20 2024-09-13T21:32:42.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.326+0000 7f555a7fc700 1 --2- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5544038490 0x7f554403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:42.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.326+0000 7f555a7fc700 1 --2- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5544038490 0x7f554403a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5550006fd0 tx=0x7f5550006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:42.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.332+0000 7f5560845700 1 -- 172.21.15.116:0/1858437572 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f554c02bba0 con 0x7f555c0ffe20 2024-09-13T21:32:42.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.596+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f555c1008b0 con 0x7f555c0ffe20 2024-09-13T21:32:42.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.596+0000 7f5560845700 1 -- 172.21.15.116:0/1858437572 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f555c1008b0 con 0x7f555c0ffe20 2024-09-13T21:32:42.598 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:32:42.598 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.598+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5544038490 msgr2=0x7f554403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.598+0000 7f5561847700 1 --2- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5544038490 0x7f554403a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5550006fd0 tx=0x7f5550006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.598+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 msgr2=0x7f555c197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.598+0000 7f5561847700 1 --2- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 0x7f555c197160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f554c005b40 tx=0x7f554c004740 comp rx=0 tx=0).stop 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.598+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 shutdown_connections 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.598+0000 7f5561847700 1 --2- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5544038490 0x7f554403a940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.598+0000 7f5561847700 1 --2- 172.21.15.116:0/1858437572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f555c0ffe20 0x7f555c197160 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.598+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 >> 172.21.15.116:0/1858437572 conn(0x7f555c0fb3d0 msgr2=0x7f555c0fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.598+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 shutdown_connections 2024-09-13T21:32:42.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:42.599+0000 7f5561847700 1 -- 172.21.15.116:0/1858437572 wait complete. 2024-09-13T21:32:42.601 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:32:42.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:42 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T21:32:42.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:42 smithi088 ceph-mon[27963]: Deploying daemon grafana.smithi088 on smithi088 2024-09-13T21:32:42.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:42 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/1858437572' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:32:43.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:43 smithi088 ceph-mon[27963]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:44.145 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:32:44.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:32:44.347 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:44.398 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:45.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.891+0000 7f7e439df700 1 -- 172.21.15.116:0/2800603773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 msgr2=0x7f7e3c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:45.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.891+0000 7f7e439df700 1 --2- 172.21.15.116:0/2800603773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 0x7f7e3c0ff130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009910 tx=0x7f7e2c009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:45.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.891+0000 7f7e439df700 1 -- 172.21.15.116:0/2800603773 shutdown_connections 2024-09-13T21:32:45.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.891+0000 7f7e439df700 1 --2- 172.21.15.116:0/2800603773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 0x7f7e3c0ff130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.891+0000 7f7e439df700 1 -- 172.21.15.116:0/2800603773 >> 172.21.15.116:0/2800603773 conn(0x7f7e3c0fa2b0 msgr2=0x7f7e3c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.891+0000 7f7e439df700 1 -- 172.21.15.116:0/2800603773 shutdown_connections 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.891+0000 7f7e439df700 1 -- 172.21.15.116:0/2800603773 wait complete. 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.892+0000 7f7e439df700 1 Processor -- start 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.892+0000 7f7e439df700 1 -- start start 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.892+0000 7f7e439df700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 0x7f7e3c068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.892+0000 7f7e439df700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c197d10 con 0x7f7e3c0fed20 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.892+0000 7f7e4177b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 0x7f7e3c068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.892+0000 7f7e4177b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 0x7f7e3c068ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:56886/0 (socket says 172.21.15.116:56886) 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.892+0000 7f7e4177b700 1 -- 172.21.15.116:0/3660726823 learned_addr learned my addr 172.21.15.116:0/3660726823 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.893+0000 7f7e4177b700 1 -- 172.21.15.116:0/3660726823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0095f0 con 0x7f7e3c0fed20 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.893+0000 7f7e4177b700 1 --2- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 0x7f7e3c068ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c005b40 tx=0x7f7e2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:45.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.893+0000 7f7e327fc700 1 -- 172.21.15.116:0/3660726823 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e2c01d070 con 0x7f7e3c0fed20 2024-09-13T21:32:45.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.893+0000 7f7e327fc700 1 -- 172.21.15.116:0/3660726823 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e2c00be10 con 0x7f7e3c0fed20 2024-09-13T21:32:45.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.893+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c197e50 con 0x7f7e3c0fed20 2024-09-13T21:32:45.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.893+0000 7f7e327fc700 1 -- 172.21.15.116:0/3660726823 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e2c00f460 con 0x7f7e3c0fed20 2024-09-13T21:32:45.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.893+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c1982f0 con 0x7f7e3c0fed20 2024-09-13T21:32:45.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.894+0000 7f7e327fc700 1 -- 172.21.15.116:0/3660726823 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f7e2c00b960 con 0x7f7e3c0fed20 2024-09-13T21:32:45.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.894+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c0623f0 con 0x7f7e3c0fed20 2024-09-13T21:32:45.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.894+0000 7f7e327fc700 1 --2- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e28038490 0x7f7e2803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:45.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.894+0000 7f7e327fc700 1 -- 172.21.15.116:0/3660726823 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f7e2c04c450 con 0x7f7e3c0fed20 2024-09-13T21:32:45.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.894+0000 7f7e40f7a700 1 --2- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e28038490 0x7f7e2803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:45.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.895+0000 7f7e40f7a700 1 --2- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e28038490 0x7f7e2803a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7e38006fd0 tx=0x7f7e38006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:45.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:45.900+0000 7f7e327fc700 1 -- 172.21.15.116:0/3660726823 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7e3c0623f0 con 0x7f7e3c0fed20 2024-09-13T21:32:45.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:45 smithi088 ceph-mon[27963]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:45.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:45 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:46.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.172+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7e3c18da00 con 0x7f7e3c0fed20 2024-09-13T21:32:46.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.172+0000 7f7e327fc700 1 -- 172.21.15.116:0/3660726823 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f7e2c027070 con 0x7f7e3c0fed20 2024-09-13T21:32:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:32:46.174 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e28038490 msgr2=0x7f7e2803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 --2- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e28038490 0x7f7e2803a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7e38006fd0 tx=0x7f7e38006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 msgr2=0x7f7e3c068ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 --2- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 0x7f7e3c068ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c005b40 tx=0x7f7e2c004740 comp rx=0 tx=0).stop 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 shutdown_connections 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 --2- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7e28038490 0x7f7e2803a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 --2- 172.21.15.116:0/3660726823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3c0fed20 0x7f7e3c068ad0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 >> 172.21.15.116:0/3660726823 conn(0x7f7e3c0fa2b0 msgr2=0x7f7e3c0faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 shutdown_connections 2024-09-13T21:32:46.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:46.174+0000 7f7e439df700 1 -- 172.21.15.116:0/3660726823 wait complete. 2024-09-13T21:32:46.177 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:32:47.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:46 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/3660726823' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:32:47.792 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:32:47.792 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:32:47.990 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:48.034 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:48.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:47 smithi088 ceph-mon[27963]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:49.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.477+0000 7f964252c700 1 -- 172.21.15.116:0/531710472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 msgr2=0x7f963c100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:49.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.477+0000 7f964252c700 1 --2- 172.21.15.116:0/531710472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 0x7f963c100240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f962c009910 tx=0x7f962c009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:49.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.477+0000 7f964252c700 1 -- 172.21.15.116:0/531710472 shutdown_connections 2024-09-13T21:32:49.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.477+0000 7f964252c700 1 --2- 172.21.15.116:0/531710472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 0x7f963c100240 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:49.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.477+0000 7f964252c700 1 -- 172.21.15.116:0/531710472 >> 172.21.15.116:0/531710472 conn(0x7f963c0fb3c0 msgr2=0x7f963c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:49.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.477+0000 7f964252c700 1 -- 172.21.15.116:0/531710472 shutdown_connections 2024-09-13T21:32:49.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.477+0000 7f964252c700 1 -- 172.21.15.116:0/531710472 wait complete. 2024-09-13T21:32:49.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.478+0000 7f964252c700 1 Processor -- start 2024-09-13T21:32:49.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.478+0000 7f964252c700 1 -- start start 2024-09-13T21:32:49.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.478+0000 7f964252c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 0x7f963c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:49.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.478+0000 7f964252c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c075030 con 0x7f963c0ffe30 2024-09-13T21:32:49.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.478+0000 7f963bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 0x7f963c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:49.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.478+0000 7f963bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 0x7f963c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:57858/0 (socket says 172.21.15.116:57858) 2024-09-13T21:32:49.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.478+0000 7f963bfff700 1 -- 172.21.15.116:0/3623157114 learned_addr learned my addr 172.21.15.116:0/3623157114 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:32:49.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.479+0000 7f963bfff700 1 -- 172.21.15.116:0/3623157114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0095f0 con 0x7f963c0ffe30 2024-09-13T21:32:49.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.479+0000 7f963bfff700 1 --2- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 0x7f963c074af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f962c005b40 tx=0x7f962c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:49.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.479+0000 7f96397fa700 1 -- 172.21.15.116:0/3623157114 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962c01d070 con 0x7f963c0ffe30 2024-09-13T21:32:49.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.479+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963c073140 con 0x7f963c0ffe30 2024-09-13T21:32:49.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.479+0000 7f96397fa700 1 -- 172.21.15.116:0/3623157114 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f962c00be10 con 0x7f963c0ffe30 2024-09-13T21:32:49.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.479+0000 7f96397fa700 1 -- 172.21.15.116:0/3623157114 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962c00f460 con 0x7f963c0ffe30 2024-09-13T21:32:49.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.479+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963c0735e0 con 0x7f963c0ffe30 2024-09-13T21:32:49.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.480+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963c062380 con 0x7f963c0ffe30 2024-09-13T21:32:49.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.480+0000 7f96397fa700 1 -- 172.21.15.116:0/3623157114 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f962c0227e0 con 0x7f963c0ffe30 2024-09-13T21:32:49.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.480+0000 7f96397fa700 1 --2- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9624038490 0x7f962403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:49.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.480+0000 7f96397fa700 1 -- 172.21.15.116:0/3623157114 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f962c04c300 con 0x7f963c0ffe30 2024-09-13T21:32:49.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.481+0000 7f963b7fe700 1 --2- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9624038490 0x7f962403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:49.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.481+0000 7f963b7fe700 1 --2- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9624038490 0x7f962403a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9630006fd0 tx=0x7f9630006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:49.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.485+0000 7f96397fa700 1 -- 172.21.15.116:0/3623157114 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f962c02b590 con 0x7f963c0ffe30 2024-09-13T21:32:49.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.753+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f963c18e470 con 0x7f963c0ffe30 2024-09-13T21:32:49.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.753+0000 7f96397fa700 1 -- 172.21.15.116:0/3623157114 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f962c027070 con 0x7f963c0ffe30 2024-09-13T21:32:49.756 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:32:49.756 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:32:49.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9624038490 msgr2=0x7f962403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:49.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 --2- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9624038490 0x7f962403a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9630006fd0 tx=0x7f9630006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:49.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 msgr2=0x7f963c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:49.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 --2- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 0x7f963c074af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f962c005b40 tx=0x7f962c004740 comp rx=0 tx=0).stop 2024-09-13T21:32:49.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 shutdown_connections 2024-09-13T21:32:49.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 --2- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9624038490 0x7f962403a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:49.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 --2- 172.21.15.116:0/3623157114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f963c0ffe30 0x7f963c074af0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:49.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 >> 172.21.15.116:0/3623157114 conn(0x7f963c0fb3c0 msgr2=0x7f963c0fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:49.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 shutdown_connections 2024-09-13T21:32:49.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:49.756+0000 7f964252c700 1 -- 172.21.15.116:0/3623157114 wait complete. 2024-09-13T21:32:49.759 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:32:50.091 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:49 smithi088 ceph-mon[27963]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:50.091 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:49 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/3623157114' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:32:51.372 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:32:51.372 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:32:51.567 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:51.610 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:52.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:51 smithi088 ceph-mon[27963]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:52.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:51 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:52.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:51 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:52.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:51 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:52.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:51 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:52.009 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:51 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:52.009 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:51 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.996+0000 7f5d11bda700 1 -- 172.21.15.116:0/1788163158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 msgr2=0x7f5d0c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.996+0000 7f5d11bda700 1 --2- 172.21.15.116:0/1788163158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 0x7f5d0c100230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009910 tx=0x7f5cfc009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.996+0000 7f5d11bda700 1 -- 172.21.15.116:0/1788163158 shutdown_connections 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.996+0000 7f5d11bda700 1 --2- 172.21.15.116:0/1788163158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 0x7f5d0c100230 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.996+0000 7f5d11bda700 1 -- 172.21.15.116:0/1788163158 >> 172.21.15.116:0/1788163158 conn(0x7f5d0c0fb3d0 msgr2=0x7f5d0c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.996+0000 7f5d11bda700 1 -- 172.21.15.116:0/1788163158 shutdown_connections 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.996+0000 7f5d11bda700 1 -- 172.21.15.116:0/1788163158 wait complete. 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.996+0000 7f5d11bda700 1 Processor -- start 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d11bda700 1 -- start start 2024-09-13T21:32:53.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d11bda700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 0x7f5d0c194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d11bda700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c1954a0 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d0b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 0x7f5d0c194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d0b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 0x7f5d0c194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:57874/0 (socket says 172.21.15.116:57874) 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d0b7fe700 1 -- 172.21.15.116:0/1870591710 learned_addr learned my addr 172.21.15.116:0/1870591710 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d0b7fe700 1 -- 172.21.15.116:0/1870591710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0095f0 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d0b7fe700 1 --2- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 0x7f5d0c194f60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc005b40 tx=0x7f5cfc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d08ff9700 1 -- 172.21.15.116:0/1870591710 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cfc01d070 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d08ff9700 1 -- 172.21.15.116:0/1870591710 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5cfc00be10 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d08ff9700 1 -- 172.21.15.116:0/1870591710 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cfc00f460 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.997+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c1956a0 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.998+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c195b40 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.998+0000 7f5d08ff9700 1 -- 172.21.15.116:0/1870591710 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f5cfc00b960 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.998+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c18ea80 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.999+0000 7f5d08ff9700 1 --2- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5cf8038490 0x7f5cf803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:53.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.999+0000 7f5d08ff9700 1 -- 172.21.15.116:0/1870591710 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f5cfc04c2e0 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.999+0000 7f5d0affd700 1 --2- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5cf8038490 0x7f5cf803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:53.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:52.999+0000 7f5d0affd700 1 --2- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5cf8038490 0x7f5cf803a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4006fd0 tx=0x7f5cf4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:53.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.003+0000 7f5d08ff9700 1 -- 172.21.15.116:0/1870591710 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5cfc02bba0 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.268+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5d0c02cc30 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.269+0000 7f5d08ff9700 1 -- 172.21.15.116:0/1870591710 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f5cfc027070 con 0x7f5d0c0ffe20 2024-09-13T21:32:53.271 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:32:53.271 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:32:53.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5cf8038490 msgr2=0x7f5cf803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:53.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 --2- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5cf8038490 0x7f5cf803a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4006fd0 tx=0x7f5cf4006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:53.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 msgr2=0x7f5d0c194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:53.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 --2- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 0x7f5d0c194f60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc005b40 tx=0x7f5cfc004740 comp rx=0 tx=0).stop 2024-09-13T21:32:53.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 shutdown_connections 2024-09-13T21:32:53.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 --2- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5cf8038490 0x7f5cf803a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:53.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 --2- 172.21.15.116:0/1870591710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d0c0ffe20 0x7f5d0c194f60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:53.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 >> 172.21.15.116:0/1870591710 conn(0x7f5d0c0fb3d0 msgr2=0x7f5d0c0fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:53.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 shutdown_connections 2024-09-13T21:32:53.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:53.271+0000 7f5d11bda700 1 -- 172.21.15.116:0/1870591710 wait complete. 2024-09-13T21:32:53.274 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:32:54.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:53 smithi088 ceph-mon[27963]: Deploying daemon prometheus.smithi088 on smithi088 2024-09-13T21:32:54.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:53 smithi088 ceph-mon[27963]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:54.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:53 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/1870591710' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:32:54.858 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:32:54.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:32:55.080 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:55.124 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:55.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:55 smithi088 ceph-mon[27963]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:55.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:55 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:32:56.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.642+0000 7fec82bdd700 1 -- 172.21.15.116:0/3033384561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 msgr2=0x7fec7c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:56.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.642+0000 7fec82bdd700 1 --2- 172.21.15.116:0/3033384561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 0x7fec7c0ff140 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec70009910 tx=0x7fec70009c20 comp rx=0 tx=0).stop 2024-09-13T21:32:56.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.642+0000 7fec82bdd700 1 -- 172.21.15.116:0/3033384561 shutdown_connections 2024-09-13T21:32:56.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.642+0000 7fec82bdd700 1 --2- 172.21.15.116:0/3033384561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 0x7fec7c0ff140 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:56.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.642+0000 7fec82bdd700 1 -- 172.21.15.116:0/3033384561 >> 172.21.15.116:0/3033384561 conn(0x7fec7c0fa2c0 msgr2=0x7fec7c0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:56.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.642+0000 7fec82bdd700 1 -- 172.21.15.116:0/3033384561 shutdown_connections 2024-09-13T21:32:56.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.642+0000 7fec82bdd700 1 -- 172.21.15.116:0/3033384561 wait complete. 2024-09-13T21:32:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.643+0000 7fec82bdd700 1 Processor -- start 2024-09-13T21:32:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.643+0000 7fec82bdd700 1 -- start start 2024-09-13T21:32:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.643+0000 7fec82bdd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 0x7fec7c193ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.643+0000 7fec82bdd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c194410 con 0x7fec7c0fed30 2024-09-13T21:32:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.643+0000 7fec80979700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 0x7fec7c193ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.643+0000 7fec80979700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 0x7fec7c193ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:35556/0 (socket says 172.21.15.116:35556) 2024-09-13T21:32:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.643+0000 7fec80979700 1 -- 172.21.15.116:0/2243333969 learned_addr learned my addr 172.21.15.116:0/2243333969 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:32:56.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.644+0000 7fec80979700 1 -- 172.21.15.116:0/2243333969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700095f0 con 0x7fec7c0fed30 2024-09-13T21:32:56.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.644+0000 7fec80979700 1 --2- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 0x7fec7c193ed0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fec70005b40 tx=0x7fec70004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:56.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.644+0000 7fec79ffb700 1 -- 172.21.15.116:0/2243333969 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec7001f070 con 0x7fec7c0fed30 2024-09-13T21:32:56.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.644+0000 7fec79ffb700 1 -- 172.21.15.116:0/2243333969 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec7000be10 con 0x7fec7c0fed30 2024-09-13T21:32:56.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.644+0000 7fec79ffb700 1 -- 172.21.15.116:0/2243333969 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec70024620 con 0x7fec7c0fed30 2024-09-13T21:32:56.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.644+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c194610 con 0x7fec7c0fed30 2024-09-13T21:32:56.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.644+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c194ab0 con 0x7fec7c0fed30 2024-09-13T21:32:56.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.645+0000 7fec79ffb700 1 -- 172.21.15.116:0/2243333969 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fec700199c0 con 0x7fec7c0fed30 2024-09-13T21:32:56.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.645+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c104b60 con 0x7fec7c0fed30 2024-09-13T21:32:56.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.645+0000 7fec79ffb700 1 --2- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec6c0384e0 0x7fec6c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:32:56.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.645+0000 7fec79ffb700 1 -- 172.21.15.116:0/2243333969 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fec7004e5b0 con 0x7fec7c0fed30 2024-09-13T21:32:56.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.646+0000 7fec7bfff700 1 --2- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec6c0384e0 0x7fec6c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:32:56.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.646+0000 7fec7bfff700 1 --2- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec6c0384e0 0x7fec6c03a990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec68006fd0 tx=0x7fec68006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:32:56.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.650+0000 7fec79ffb700 1 -- 172.21.15.116:0/2243333969 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fec7002c540 con 0x7fec7c0fed30 2024-09-13T21:32:56.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.916+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fec7c104d50 con 0x7fec7c0fed30 2024-09-13T21:32:56.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.916+0000 7fec79ffb700 1 -- 172.21.15.116:0/2243333969 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fec70029020 con 0x7fec7c0fed30 2024-09-13T21:32:56.919 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:32:56.919 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:32:56.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec6c0384e0 msgr2=0x7fec6c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:56.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 --2- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec6c0384e0 0x7fec6c03a990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec68006fd0 tx=0x7fec68006e40 comp rx=0 tx=0).stop 2024-09-13T21:32:56.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 msgr2=0x7fec7c193ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:32:56.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 --2- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 0x7fec7c193ed0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fec70005b40 tx=0x7fec70004740 comp rx=0 tx=0).stop 2024-09-13T21:32:56.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 shutdown_connections 2024-09-13T21:32:56.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 --2- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec6c0384e0 0x7fec6c03a990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:56.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 --2- 172.21.15.116:0/2243333969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec7c0fed30 0x7fec7c193ed0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:32:56.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 >> 172.21.15.116:0/2243333969 conn(0x7fec7c0fa2c0 msgr2=0x7fec7c0faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:32:56.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 shutdown_connections 2024-09-13T21:32:56.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:32:56.919+0000 7fec82bdd700 1 -- 172.21.15.116:0/2243333969 wait complete. 2024-09-13T21:32:56.922 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:32:58.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:57 smithi088 ceph-mon[27963]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:32:58.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:57 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/2243333969' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:32:58.486 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:32:58.487 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:32:58.683 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:32:58.727 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:00.051 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:32:59 smithi088 ceph-mon[27963]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:00.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.160+0000 7f34ad76d700 1 -- 172.21.15.116:0/4234678362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 msgr2=0x7f34a80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:00.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.160+0000 7f34ad76d700 1 --2- 172.21.15.116:0/4234678362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 0x7f34a80ff140 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f349800b0a0 tx=0x7f349800b3b0 comp rx=0 tx=0).stop 2024-09-13T21:33:00.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.160+0000 7f34ad76d700 1 -- 172.21.15.116:0/4234678362 shutdown_connections 2024-09-13T21:33:00.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.160+0000 7f34ad76d700 1 --2- 172.21.15.116:0/4234678362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 0x7f34a80ff140 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:00.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.160+0000 7f34ad76d700 1 -- 172.21.15.116:0/4234678362 >> 172.21.15.116:0/4234678362 conn(0x7f34a80fa2c0 msgr2=0x7f34a80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:00.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.161+0000 7f34ad76d700 1 -- 172.21.15.116:0/4234678362 shutdown_connections 2024-09-13T21:33:00.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.161+0000 7f34ad76d700 1 -- 172.21.15.116:0/4234678362 wait complete. 2024-09-13T21:33:00.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.161+0000 7f34ad76d700 1 Processor -- start 2024-09-13T21:33:00.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.161+0000 7f34ad76d700 1 -- start start 2024-09-13T21:33:00.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.161+0000 7f34ad76d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 0x7f34a8069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:00.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.161+0000 7f34ad76d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8197d00 con 0x7f34a80fed30 2024-09-13T21:33:00.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f34a6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 0x7f34a8069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:00.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f34a6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 0x7f34a8069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:35578/0 (socket says 172.21.15.116:35578) 2024-09-13T21:33:00.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f34a6ffd700 1 -- 172.21.15.116:0/559035764 learned_addr learned my addr 172.21.15.116:0/559035764 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:00.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f34a6ffd700 1 -- 172.21.15.116:0/559035764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3498009d00 con 0x7f34a80fed30 2024-09-13T21:33:00.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f34a6ffd700 1 --2- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 0x7f34a8069360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f349800b830 tx=0x7f349800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:00.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f349ffff700 1 -- 172.21.15.116:0/559035764 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f349800e040 con 0x7f34a80fed30 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a8197e40 con 0x7f34a80fed30 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f349ffff700 1 -- 172.21.15.116:0/559035764 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3498012af0 con 0x7f34a80fed30 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f349ffff700 1 -- 172.21.15.116:0/559035764 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f349801d9f0 con 0x7f34a80fed30 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.162+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a8198260 con 0x7f34a80fed30 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.163+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a80623f0 con 0x7f34a80fed30 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.163+0000 7f349ffff700 1 -- 172.21.15.116:0/559035764 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f3498012c60 con 0x7f34a80fed30 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.164+0000 7f349ffff700 1 --2- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3494038490 0x7f349403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.164+0000 7f349ffff700 1 -- 172.21.15.116:0/559035764 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f349804c930 con 0x7f34a80fed30 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.164+0000 7f34a67fc700 1 --2- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3494038490 0x7f349403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:00.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.164+0000 7f34a67fc700 1 --2- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3494038490 0x7f349403a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3490006fd0 tx=0x7f3490006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:00.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.169+0000 7f349ffff700 1 -- 172.21.15.116:0/559035764 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f34a80623f0 con 0x7f34a80fed30 2024-09-13T21:33:00.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.434+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f34a818da10 con 0x7f34a80fed30 2024-09-13T21:33:00.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.434+0000 7f349ffff700 1 -- 172.21.15.116:0/559035764 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f349801c5c0 con 0x7f34a80fed30 2024-09-13T21:33:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:00.437 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:00.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.436+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3494038490 msgr2=0x7f349403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:00.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.436+0000 7f34ad76d700 1 --2- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3494038490 0x7f349403a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3490006fd0 tx=0x7f3490006e40 comp rx=0 tx=0).stop 2024-09-13T21:33:00.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.437+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 msgr2=0x7f34a8069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:00.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.437+0000 7f34ad76d700 1 --2- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 0x7f34a8069360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f349800b830 tx=0x7f349800bd40 comp rx=0 tx=0).stop 2024-09-13T21:33:00.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.437+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 shutdown_connections 2024-09-13T21:33:00.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.437+0000 7f34ad76d700 1 --2- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3494038490 0x7f349403a940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:00.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.437+0000 7f34ad76d700 1 --2- 172.21.15.116:0/559035764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34a80fed30 0x7f34a8069360 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:00.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.437+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 >> 172.21.15.116:0/559035764 conn(0x7f34a80fa2c0 msgr2=0x7f34a80faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:00.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.437+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 shutdown_connections 2024-09-13T21:33:00.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:00.437+0000 7f34ad76d700 1 -- 172.21.15.116:0/559035764 wait complete. 2024-09-13T21:33:00.440 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:01.223 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:00 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/559035764' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:02.097 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:02.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:02.151 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:01 smithi088 ceph-mon[27963]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:02.304 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:02.347 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:03.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:03 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:03.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:03 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:03.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:03 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:03.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:03 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T21:33:03.607 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:03 smithi088 ceph-mon[27963]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:03.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.733+0000 7fc63eaa4700 1 -- 172.21.15.116:0/3903970529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 msgr2=0x7fc6380fe8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:03.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.733+0000 7fc63eaa4700 1 --2- 172.21.15.116:0/3903970529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 0x7fc6380fe8b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009910 tx=0x7fc62c009c20 comp rx=0 tx=0).stop 2024-09-13T21:33:03.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.733+0000 7fc63eaa4700 1 -- 172.21.15.116:0/3903970529 shutdown_connections 2024-09-13T21:33:03.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.733+0000 7fc63eaa4700 1 --2- 172.21.15.116:0/3903970529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 0x7fc6380fe8b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:03.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.733+0000 7fc63eaa4700 1 -- 172.21.15.116:0/3903970529 >> 172.21.15.116:0/3903970529 conn(0x7fc6380f9a50 msgr2=0x7fc6380fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:03.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.733+0000 7fc63eaa4700 1 -- 172.21.15.116:0/3903970529 shutdown_connections 2024-09-13T21:33:03.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.733+0000 7fc63eaa4700 1 -- 172.21.15.116:0/3903970529 wait complete. 2024-09-13T21:33:03.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.734+0000 7fc63eaa4700 1 Processor -- start 2024-09-13T21:33:03.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.734+0000 7fc63eaa4700 1 -- start start 2024-09-13T21:33:03.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.734+0000 7fc63eaa4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 0x7fc638194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.734+0000 7fc63eaa4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6381954d0 con 0x7fc6380fe4a0 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.734+0000 7fc63c840700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 0x7fc638194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.734+0000 7fc63c840700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 0x7fc638194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:35586/0 (socket says 172.21.15.116:35586) 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.734+0000 7fc63c840700 1 -- 172.21.15.116:0/4066794305 learned_addr learned my addr 172.21.15.116:0/4066794305 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.735+0000 7fc63c840700 1 -- 172.21.15.116:0/4066794305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0095f0 con 0x7fc6380fe4a0 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.735+0000 7fc63c840700 1 --2- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 0x7fc638194f90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005b40 tx=0x7fc62c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.735+0000 7fc635ffb700 1 -- 172.21.15.116:0/4066794305 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc62c01d070 con 0x7fc6380fe4a0 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.735+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6381956d0 con 0x7fc6380fe4a0 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.735+0000 7fc635ffb700 1 -- 172.21.15.116:0/4066794305 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc62c00be10 con 0x7fc6380fe4a0 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.735+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc638195b70 con 0x7fc6380fe4a0 2024-09-13T21:33:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.735+0000 7fc635ffb700 1 -- 172.21.15.116:0/4066794305 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc62c00f460 con 0x7fc6380fe4a0 2024-09-13T21:33:03.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.736+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63818f390 con 0x7fc6380fe4a0 2024-09-13T21:33:03.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.736+0000 7fc635ffb700 1 -- 172.21.15.116:0/4066794305 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7fc62c0227e0 con 0x7fc6380fe4a0 2024-09-13T21:33:03.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.736+0000 7fc635ffb700 1 --2- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc6280384e0 0x7fc62803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:03.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.736+0000 7fc635ffb700 1 -- 172.21.15.116:0/4066794305 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fc62c04c300 con 0x7fc6380fe4a0 2024-09-13T21:33:03.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.737+0000 7fc637fff700 1 -- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc6280384e0 msgr2=0x7fc62803a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:33:03.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.737+0000 7fc637fff700 1 --2- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc6280384e0 0x7fc62803a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:33:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.745+0000 7fc635ffb700 1 -- 172.21.15.116:0/4066794305 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc62c00f5c0 con 0x7fc6380fe4a0 2024-09-13T21:33:03.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.938+0000 7fc637fff700 1 -- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc6280384e0 msgr2=0x7fc62803a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:33:03.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:03.938+0000 7fc637fff700 1 --2- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc6280384e0 0x7fc62803a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:33:04.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.009+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc63802cc30 con 0x7fc6380fe4a0 2024-09-13T21:33:04.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.010+0000 7fc635ffb700 1 -- 172.21.15.116:0/4066794305 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc62c027030 con 0x7fc6380fe4a0 2024-09-13T21:33:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:04.012 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:04.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc6280384e0 msgr2=0x7fc62803a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:33:04.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 --2- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc6280384e0 0x7fc62803a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:04.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 msgr2=0x7fc638194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:04.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 --2- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 0x7fc638194f90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005b40 tx=0x7fc62c004740 comp rx=0 tx=0).stop 2024-09-13T21:33:04.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 shutdown_connections 2024-09-13T21:33:04.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 --2- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc6280384e0 0x7fc62803a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:04.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 --2- 172.21.15.116:0/4066794305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6380fe4a0 0x7fc638194f90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:04.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 >> 172.21.15.116:0/4066794305 conn(0x7fc6380f9a50 msgr2=0x7fc6380fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:04.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 shutdown_connections 2024-09-13T21:33:04.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:04.012+0000 7fc63eaa4700 1 -- 172.21.15.116:0/4066794305 wait complete. 2024-09-13T21:33:04.015 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:04.556 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:04 smithi088 ceph-mon[27963]: from='mgr.14162 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T21:33:04.556 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:04 smithi088 ceph-mon[27963]: mgrmap e14: smithi088.scyrwy(active, since 58s) 2024-09-13T21:33:04.556 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:04 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/4066794305' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:05.592 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:05.593 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:05.789 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:05.838 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:07.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.211+0000 7f6f839cf700 1 -- 172.21.15.116:0/1531544091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 msgr2=0x7f6f7c102d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:07.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.211+0000 7f6f839cf700 1 --2- 172.21.15.116:0/1531544091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 0x7f6f7c102d50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800b0a0 tx=0x7f6f7800b3b0 comp rx=0 tx=0).stop 2024-09-13T21:33:07.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.211+0000 7f6f839cf700 1 -- 172.21.15.116:0/1531544091 shutdown_connections 2024-09-13T21:33:07.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.211+0000 7f6f839cf700 1 --2- 172.21.15.116:0/1531544091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 0x7f6f7c102d50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:07.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.211+0000 7f6f839cf700 1 -- 172.21.15.116:0/1531544091 >> 172.21.15.116:0/1531544091 conn(0x7f6f7c0fa2b0 msgr2=0x7f6f7c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:07.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.211+0000 7f6f839cf700 1 -- 172.21.15.116:0/1531544091 shutdown_connections 2024-09-13T21:33:07.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.211+0000 7f6f839cf700 1 -- 172.21.15.116:0/1531544091 wait complete. 2024-09-13T21:33:07.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.212+0000 7f6f839cf700 1 Processor -- start 2024-09-13T21:33:07.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.212+0000 7f6f839cf700 1 -- start start 2024-09-13T21:33:07.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.212+0000 7f6f839cf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 0x7f6f7c194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:07.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.212+0000 7f6f839cf700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c1954d0 con 0x7f6f7c100970 2024-09-13T21:33:07.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.212+0000 7f6f8176b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 0x7f6f7c194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:07.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.212+0000 7f6f8176b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 0x7f6f7c194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:42110/0 (socket says 172.21.15.116:42110) 2024-09-13T21:33:07.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.212+0000 7f6f8176b700 1 -- 172.21.15.116:0/148473429 learned_addr learned my addr 172.21.15.116:0/148473429 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:07.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.213+0000 7f6f8176b700 1 -- 172.21.15.116:0/148473429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78009d00 con 0x7f6f7c100970 2024-09-13T21:33:07.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.213+0000 7f6f8176b700 1 --2- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 0x7f6f7c194f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f78015040 tx=0x7f6f7800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:07.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.213+0000 7f6f727fc700 1 -- 172.21.15.116:0/148473429 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f7800e040 con 0x7f6f7c100970 2024-09-13T21:33:07.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.213+0000 7f6f727fc700 1 -- 172.21.15.116:0/148473429 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f7801d930 con 0x7f6f7c100970 2024-09-13T21:33:07.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.213+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c1956d0 con 0x7f6f7c100970 2024-09-13T21:33:07.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.213+0000 7f6f727fc700 1 -- 172.21.15.116:0/148473429 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f780129d0 con 0x7f6f7c100970 2024-09-13T21:33:07.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.213+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c195af0 con 0x7f6f7c100970 2024-09-13T21:33:07.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.214+0000 7f6f727fc700 1 -- 172.21.15.116:0/148473429 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f6f78012c90 con 0x7f6f7c100970 2024-09-13T21:33:07.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.214+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c18eb10 con 0x7f6f7c100970 2024-09-13T21:33:07.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.214+0000 7f6f727fc700 1 --2- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6f680384e0 0x7f6f6803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:07.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.214+0000 7f6f727fc700 1 -- 172.21.15.116:0/148473429 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f6f7804c950 con 0x7f6f7c100970 2024-09-13T21:33:07.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.214+0000 7f6f80f6a700 1 -- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6f680384e0 msgr2=0x7f6f6803a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:33:07.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.214+0000 7f6f80f6a700 1 --2- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6f680384e0 0x7f6f6803a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:33:07.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.219+0000 7f6f727fc700 1 -- 172.21.15.116:0/148473429 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6f7801c3e0 con 0x7f6f7c100970 2024-09-13T21:33:07.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.415+0000 7f6f80f6a700 1 -- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6f680384e0 msgr2=0x7f6f6803a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2 2024-09-13T21:33:07.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.415+0000 7f6f80f6a700 1 --2- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6f680384e0 0x7f6f6803a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:33:07.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.483+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6f7c02cc30 con 0x7f6f7c100970 2024-09-13T21:33:07.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.484+0000 7f6f727fc700 1 -- 172.21.15.116:0/148473429 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f6f7801c3e0 con 0x7f6f7c100970 2024-09-13T21:33:07.487 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:07.487 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:07.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6f680384e0 msgr2=0x7f6f6803a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:33:07.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 --2- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6f680384e0 0x7f6f6803a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:07.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 msgr2=0x7f6f7c194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:07.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 --2- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 0x7f6f7c194f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f78015040 tx=0x7f6f7800bb10 comp rx=0 tx=0).stop 2024-09-13T21:33:07.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 shutdown_connections 2024-09-13T21:33:07.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 --2- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6f680384e0 0x7f6f6803a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:07.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 --2- 172.21.15.116:0/148473429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f7c100970 0x7f6f7c194f90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:07.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 >> 172.21.15.116:0/148473429 conn(0x7f6f7c0fa2b0 msgr2=0x7f6f7c0faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:07.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 shutdown_connections 2024-09-13T21:33:07.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:07.486+0000 7f6f839cf700 1 -- 172.21.15.116:0/148473429 wait complete. 2024-09-13T21:33:07.489 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:07.596 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:07 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/148473429' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:09.113 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:09.114 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:09.307 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:09.357 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: Active manager daemon smithi088.scyrwy restarted 2024-09-13T21:33:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: Activating manager daemon smithi088.scyrwy 2024-09-13T21:33:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T21:33:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: mgrmap e15: smithi088.scyrwy(active, starting, since 0.00539885s) 2024-09-13T21:33:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:33:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:33:10.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:33:10.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:33:10.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:33:10.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: Manager daemon smithi088.scyrwy is now available 2024-09-13T21:33:10.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:33:10.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:33:10.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:10.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:33:10.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.933+0000 7ff5ca285700 1 -- 172.21.15.116:0/2025120735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 msgr2=0x7ff5c41006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.933+0000 7ff5ca285700 1 --2- 172.21.15.116:0/2025120735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 0x7ff5c41006c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009910 tx=0x7ff5b4009c20 comp rx=0 tx=0).stop 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.933+0000 7ff5ca285700 1 -- 172.21.15.116:0/2025120735 shutdown_connections 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.933+0000 7ff5ca285700 1 --2- 172.21.15.116:0/2025120735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 0x7ff5c41006c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.933+0000 7ff5ca285700 1 -- 172.21.15.116:0/2025120735 >> 172.21.15.116:0/2025120735 conn(0x7ff5c40f9a50 msgr2=0x7ff5c40fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.933+0000 7ff5ca285700 1 -- 172.21.15.116:0/2025120735 shutdown_connections 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.933+0000 7ff5ca285700 1 -- 172.21.15.116:0/2025120735 wait complete. 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.933+0000 7ff5ca285700 1 Processor -- start 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.934+0000 7ff5ca285700 1 -- start start 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.934+0000 7ff5ca285700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 0x7ff5c40fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.934+0000 7ff5ca285700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4197ca0 con 0x7ff5c41002b0 2024-09-13T21:33:10.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.934+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 0x7ff5c40fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:10.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.934+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 0x7ff5c40fea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:42120/0 (socket says 172.21.15.116:42120) 2024-09-13T21:33:10.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.934+0000 7ff5c3fff700 1 -- 172.21.15.116:0/4171072218 learned_addr learned my addr 172.21.15.116:0/4171072218 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:10.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.934+0000 7ff5c3fff700 1 -- 172.21.15.116:0/4171072218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40095f0 con 0x7ff5c41002b0 2024-09-13T21:33:10.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.934+0000 7ff5c3fff700 1 --2- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 0x7ff5c40fea60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005b40 tx=0x7ff5b4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:10.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.935+0000 7ff5c17fa700 1 -- 172.21.15.116:0/4171072218 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5b401d070 con 0x7ff5c41002b0 2024-09-13T21:33:10.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.935+0000 7ff5c17fa700 1 -- 172.21.15.116:0/4171072218 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5b400be10 con 0x7ff5c41002b0 2024-09-13T21:33:10.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.935+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c4197de0 con 0x7ff5c41002b0 2024-09-13T21:33:10.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.935+0000 7ff5c17fa700 1 -- 172.21.15.116:0/4171072218 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5b400f460 con 0x7ff5c41002b0 2024-09-13T21:33:10.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.935+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c4198280 con 0x7ff5c41002b0 2024-09-13T21:33:10.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.936+0000 7ff5c17fa700 1 -- 172.21.15.116:0/4171072218 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 15) v1 ==== 44878+0+0 (secure 0 0 0) 0x7ff5b400f6d0 con 0x7ff5c41002b0 2024-09-13T21:33:10.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.936+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c418da00 con 0x7ff5c41002b0 2024-09-13T21:33:10.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.936+0000 7ff5c17fa700 1 -- 172.21.15.116:0/4171072218 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7ff5b404c1b0 con 0x7ff5c41002b0 2024-09-13T21:33:10.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:10.941+0000 7ff5c17fa700 1 -- 172.21.15.116:0/4171072218 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff5b402a360 con 0x7ff5c41002b0 2024-09-13T21:33:11.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.017+0000 7ff5c17fa700 1 -- 172.21.15.116:0/4171072218 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 16) v1 ==== 45005+0+0 (secure 0 0 0) 0x7ff5b40227e0 con 0x7ff5c41002b0 2024-09-13T21:33:11.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.017+0000 7ff5c17fa700 1 --2- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff5ac039440 0x7ff5ac03b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:11.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.018+0000 7ff5c37fe700 1 --2- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff5ac039440 0x7ff5ac03b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:11.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.018+0000 7ff5c37fe700 1 --2- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff5ac039440 0x7ff5ac03b820 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8006fd0 tx=0x7ff5b8006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:11.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.220+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff5c402cc30 con 0x7ff5c41002b0 2024-09-13T21:33:11.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.220+0000 7ff5c17fa700 1 -- 172.21.15.116:0/4171072218 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff5b4027020 con 0x7ff5c41002b0 2024-09-13T21:33:11.223 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:11.223 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:11.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff5ac039440 msgr2=0x7ff5ac03b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:11.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 --2- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff5ac039440 0x7ff5ac03b820 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8006fd0 tx=0x7ff5b8006e40 comp rx=0 tx=0).stop 2024-09-13T21:33:11.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 msgr2=0x7ff5c40fea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:11.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 --2- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 0x7ff5c40fea60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005b40 tx=0x7ff5b4004740 comp rx=0 tx=0).stop 2024-09-13T21:33:11.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 shutdown_connections 2024-09-13T21:33:11.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 --2- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff5ac039440 0x7ff5ac03b820 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:11.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 --2- 172.21.15.116:0/4171072218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5c41002b0 0x7ff5c40fea60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:11.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 >> 172.21.15.116:0/4171072218 conn(0x7ff5c40f9a50 msgr2=0x7ff5c40fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:11.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 shutdown_connections 2024-09-13T21:33:11.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:11.223+0000 7ff5ca285700 1 -- 172.21.15.116:0/4171072218 wait complete. 2024-09-13T21:33:11.226 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:11.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:33:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/trash_purge_schedule"}]: dispatch 2024-09-13T21:33:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:11 smithi088 ceph-mon[27963]: [13/Sep/2024:21:33:10] ENGINE Bus STARTING 2024-09-13T21:33:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:11 smithi088 ceph-mon[27963]: mgrmap e16: smithi088.scyrwy(active, since 1.00559s) 2024-09-13T21:33:12.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:12 smithi088 ceph-mon[27963]: [13/Sep/2024:21:33:10] ENGINE Serving on https://172.21.15.88:7150 2024-09-13T21:33:12.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:12 smithi088 ceph-mon[27963]: [13/Sep/2024:21:33:10] ENGINE Serving on http://172.21.15.88:8765 2024-09-13T21:33:12.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:12 smithi088 ceph-mon[27963]: [13/Sep/2024:21:33:10] ENGINE Bus STARTED 2024-09-13T21:33:12.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:12 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:12.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:12 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/4171072218' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:12.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:12 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:12.759 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:12.759 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:13.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:13 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:13.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:13 smithi088 ceph-mon[27963]: mgrmap e17: smithi088.scyrwy(active, since 2s) 2024-09-13T21:33:14.390 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:14.444 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:16.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.558+0000 7f773a6ce700 1 -- 172.21.15.116:0/3904437229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 msgr2=0x7f77340ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:16.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.558+0000 7f773a6ce700 1 --2- 172.21.15.116:0/3904437229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 0x7f77340ff130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7724009910 tx=0x7f7724009c20 comp rx=0 tx=0).stop 2024-09-13T21:33:16.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.558+0000 7f773a6ce700 1 -- 172.21.15.116:0/3904437229 shutdown_connections 2024-09-13T21:33:16.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.558+0000 7f773a6ce700 1 --2- 172.21.15.116:0/3904437229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 0x7f77340ff130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:16.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.558+0000 7f773a6ce700 1 -- 172.21.15.116:0/3904437229 >> 172.21.15.116:0/3904437229 conn(0x7f77340fa2b0 msgr2=0x7f77340fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:16.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.558+0000 7f773a6ce700 1 -- 172.21.15.116:0/3904437229 shutdown_connections 2024-09-13T21:33:16.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.558+0000 7f773a6ce700 1 -- 172.21.15.116:0/3904437229 wait complete. 2024-09-13T21:33:16.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.559+0000 7f773a6ce700 1 Processor -- start 2024-09-13T21:33:16.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.559+0000 7f773a6ce700 1 -- start start 2024-09-13T21:33:16.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.559+0000 7f773a6ce700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 0x7f7734194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:16.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.559+0000 7f773a6ce700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77341954f0 con 0x7f77340fed20 2024-09-13T21:33:16.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.559+0000 7f7733fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 0x7f7734194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:16.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.559+0000 7f7733fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 0x7f7734194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:60988/0 (socket says 172.21.15.116:60988) 2024-09-13T21:33:16.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.559+0000 7f7733fff700 1 -- 172.21.15.116:0/3318406443 learned_addr learned my addr 172.21.15.116:0/3318406443 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:16.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.560+0000 7f7733fff700 1 -- 172.21.15.116:0/3318406443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240095f0 con 0x7f77340fed20 2024-09-13T21:33:16.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.560+0000 7f7733fff700 1 --2- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 0x7f7734194fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7724005b40 tx=0x7f7724004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.560+0000 7f77317fa700 1 -- 172.21.15.116:0/3318406443 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f772401d070 con 0x7f77340fed20 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.560+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77341956f0 con 0x7f77340fed20 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.560+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7734195b90 con 0x7f77340fed20 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.560+0000 7f77317fa700 1 -- 172.21.15.116:0/3318406443 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f772400be10 con 0x7f77340fed20 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.560+0000 7f77317fa700 1 -- 172.21.15.116:0/3318406443 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f772400f460 con 0x7f77340fed20 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.561+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773418ea10 con 0x7f77340fed20 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.561+0000 7f77317fa700 1 -- 172.21.15.116:0/3318406443 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f772400b960 con 0x7f77340fed20 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.561+0000 7f77317fa700 1 --2- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f771c038580 0x7f771c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.561+0000 7f77317fa700 1 -- 172.21.15.116:0/3318406443 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f772404c510 con 0x7f77340fed20 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.562+0000 7f77337fe700 1 --2- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f771c038580 0x7f771c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:16.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.562+0000 7f77337fe700 1 --2- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f771c038580 0x7f771c03aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7728006fd0 tx=0x7f7728006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:16.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.567+0000 7f77317fa700 1 -- 172.21.15.116:0/3318406443 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f77240227c0 con 0x7f77340fed20 2024-09-13T21:33:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:33:16.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.830+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f773402cc30 con 0x7f77340fed20 2024-09-13T21:33:16.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.830+0000 7f77317fa700 1 -- 172.21.15.116:0/3318406443 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f7724027020 con 0x7f77340fed20 2024-09-13T21:33:16.833 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:16.833 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:16.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.832+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f771c038580 msgr2=0x7f771c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:16.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.832+0000 7f773a6ce700 1 --2- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f771c038580 0x7f771c03aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7728006fd0 tx=0x7f7728006e40 comp rx=0 tx=0).stop 2024-09-13T21:33:16.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.832+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 msgr2=0x7f7734194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:16.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.832+0000 7f773a6ce700 1 --2- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 0x7f7734194fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7724005b40 tx=0x7f7724004740 comp rx=0 tx=0).stop 2024-09-13T21:33:16.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.832+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 shutdown_connections 2024-09-13T21:33:16.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.833+0000 7f773a6ce700 1 --2- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f771c038580 0x7f771c03aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:16.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.833+0000 7f773a6ce700 1 --2- 172.21.15.116:0/3318406443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77340fed20 0x7f7734194fb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:16.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.833+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 >> 172.21.15.116:0/3318406443 conn(0x7f77340fa2b0 msgr2=0x7f77340690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:16.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.833+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 shutdown_connections 2024-09-13T21:33:16.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:16.833+0000 7f773a6ce700 1 -- 172.21.15.116:0/3318406443 wait complete. 2024-09-13T21:33:16.836 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:17.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:17 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/3318406443' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:18.421 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:18.422 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:18.618 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:18.661 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:33:20.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.144+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3043066220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 msgr2=0x7f39e8100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:20.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.144+0000 7f39ee4c7700 1 --2- 172.21.15.116:0/3043066220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 0x7f39e8100280 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009910 tx=0x7f39d8009c20 comp rx=0 tx=0).stop 2024-09-13T21:33:20.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.144+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3043066220 shutdown_connections 2024-09-13T21:33:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.144+0000 7f39ee4c7700 1 --2- 172.21.15.116:0/3043066220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 0x7f39e8100280 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.144+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3043066220 >> 172.21.15.116:0/3043066220 conn(0x7f39e80fb470 msgr2=0x7f39e80fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.144+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3043066220 shutdown_connections 2024-09-13T21:33:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.144+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3043066220 wait complete. 2024-09-13T21:33:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.145+0000 7f39ee4c7700 1 Processor -- start 2024-09-13T21:33:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.145+0000 7f39ee4c7700 1 -- start start 2024-09-13T21:33:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.145+0000 7f39ee4c7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 0x7f39e8194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.145+0000 7f39ee4c7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e81954e0 con 0x7f39e80ffe70 2024-09-13T21:33:20.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39e7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 0x7f39e8194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:20.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39e7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 0x7f39e8194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:32770/0 (socket says 172.21.15.116:32770) 2024-09-13T21:33:20.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39e7fff700 1 -- 172.21.15.116:0/3391046962 learned_addr learned my addr 172.21.15.116:0/3391046962 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:20.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39e7fff700 1 -- 172.21.15.116:0/3391046962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d80095f0 con 0x7f39e80ffe70 2024-09-13T21:33:20.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39e7fff700 1 --2- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 0x7f39e8194fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39d8005b40 tx=0x7f39d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:20.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39e57fa700 1 -- 172.21.15.116:0/3391046962 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39d801d070 con 0x7f39e80ffe70 2024-09-13T21:33:20.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e81956e0 con 0x7f39e80ffe70 2024-09-13T21:33:20.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39e57fa700 1 -- 172.21.15.116:0/3391046962 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f39d800be10 con 0x7f39e80ffe70 2024-09-13T21:33:20.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39e57fa700 1 -- 172.21.15.116:0/3391046962 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39d800f460 con 0x7f39e80ffe70 2024-09-13T21:33:20.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.146+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e8195b80 con 0x7f39e80ffe70 2024-09-13T21:33:20.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.147+0000 7f39e57fa700 1 -- 172.21.15.116:0/3391046962 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f39d800f5c0 con 0x7f39e80ffe70 2024-09-13T21:33:20.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.147+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e818ea70 con 0x7f39e80ffe70 2024-09-13T21:33:20.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.147+0000 7f39e57fa700 1 --2- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f39d40385d0 0x7f39d403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:20.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.147+0000 7f39e57fa700 1 -- 172.21.15.116:0/3391046962 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f39d804c790 con 0x7f39e80ffe70 2024-09-13T21:33:20.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.148+0000 7f39e77fe700 1 --2- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f39d40385d0 0x7f39d403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:20.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.148+0000 7f39e77fe700 1 --2- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f39d40385d0 0x7f39d403aa80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39d0006fd0 tx=0x7f39d0006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:20.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.153+0000 7f39e57fa700 1 -- 172.21.15.116:0/3391046962 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f39d802a360 con 0x7f39e80ffe70 2024-09-13T21:33:20.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.418+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f39e802cc30 con 0x7f39e80ffe70 2024-09-13T21:33:20.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.419+0000 7f39e57fa700 1 -- 172.21.15.116:0/3391046962 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f39d8027030 con 0x7f39e80ffe70 2024-09-13T21:33:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:20.422 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:20.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f39d40385d0 msgr2=0x7f39d403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:20.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 --2- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f39d40385d0 0x7f39d403aa80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39d0006fd0 tx=0x7f39d0006e40 comp rx=0 tx=0).stop 2024-09-13T21:33:20.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 msgr2=0x7f39e8194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:20.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 --2- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 0x7f39e8194fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39d8005b40 tx=0x7f39d8004740 comp rx=0 tx=0).stop 2024-09-13T21:33:20.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 shutdown_connections 2024-09-13T21:33:20.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 --2- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f39d40385d0 0x7f39d403aa80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:20.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 --2- 172.21.15.116:0/3391046962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39e80ffe70 0x7f39e8194fa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:20.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 >> 172.21.15.116:0/3391046962 conn(0x7f39e80fb470 msgr2=0x7f39e80fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:20.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 shutdown_connections 2024-09-13T21:33:20.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:20.422+0000 7f39ee4c7700 1 -- 172.21.15.116:0/3391046962 wait complete. 2024-09-13T21:33:20.425 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:20.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:20 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/3391046962' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:22.062 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:22.063 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:33:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:33:22.250 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:23.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-13T21:33:23.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T21:33:23.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:23.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:23.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T21:33:23.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:24.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:23 smithi088 ceph-mon[27963]: Deploying daemon ceph-exporter.smithi116 on smithi116 2024-09-13T21:33:24.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.900+0000 7f4a54f26700 1 -- 172.21.15.116:0/500691511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 msgr2=0x7f4a50104890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:24.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.900+0000 7f4a54f26700 1 --2- 172.21.15.116:0/500691511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 0x7f4a50104890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009910 tx=0x7f4a40009c20 comp rx=0 tx=0).stop 2024-09-13T21:33:24.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.900+0000 7f4a54f26700 1 -- 172.21.15.116:0/500691511 shutdown_connections 2024-09-13T21:33:24.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.900+0000 7f4a54f26700 1 --2- 172.21.15.116:0/500691511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 0x7f4a50104890 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.900+0000 7f4a54f26700 1 -- 172.21.15.116:0/500691511 >> 172.21.15.116:0/500691511 conn(0x7f4a50075750 msgr2=0x7f4a50075b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.900+0000 7f4a54f26700 1 -- 172.21.15.116:0/500691511 shutdown_connections 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.900+0000 7f4a54f26700 1 -- 172.21.15.116:0/500691511 wait complete. 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.901+0000 7f4a54f26700 1 Processor -- start 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.901+0000 7f4a54f26700 1 -- start start 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.902+0000 7f4a54f26700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 0x7f4a50196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.902+0000 7f4a54f26700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50196650 con 0x7f4a501044c0 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.902+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 0x7f4a50196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.902+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 0x7f4a50196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:32784/0 (socket says 172.21.15.116:32784) 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.902+0000 7f4a4e59c700 1 -- 172.21.15.116:0/2004503765 learned_addr learned my addr 172.21.15.116:0/2004503765 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.902+0000 7f4a4e59c700 1 -- 172.21.15.116:0/2004503765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400095f0 con 0x7f4a501044c0 2024-09-13T21:33:24.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.902+0000 7f4a4e59c700 1 --2- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 0x7f4a50196110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a40005b40 tx=0x7f4a40004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.903+0000 7f4a3f7fe700 1 -- 172.21.15.116:0/2004503765 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a4001d070 con 0x7f4a501044c0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.903+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a50196850 con 0x7f4a501044c0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.903+0000 7f4a3f7fe700 1 -- 172.21.15.116:0/2004503765 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4a400044d0 con 0x7f4a501044c0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.903+0000 7f4a3f7fe700 1 -- 172.21.15.116:0/2004503765 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a400038f0 con 0x7f4a501044c0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.903+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a50196cd0 con 0x7f4a501044c0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.904+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a50062380 con 0x7f4a501044c0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.904+0000 7f4a3f7fe700 1 -- 172.21.15.116:0/2004503765 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f4a40003bb0 con 0x7f4a501044c0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.904+0000 7f4a3f7fe700 1 --2- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4a38038580 0x7f4a3803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.904+0000 7f4a3f7fe700 1 -- 172.21.15.116:0/2004503765 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f4a4004c230 con 0x7f4a501044c0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.904+0000 7f4a4dd9b700 1 --2- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4a38038580 0x7f4a3803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:24.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.904+0000 7f4a4dd9b700 1 --2- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4a38038580 0x7f4a3803aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a44006fd0 tx=0x7f4a44006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:24.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:24.909+0000 7f4a3f7fe700 1 -- 172.21.15.116:0/2004503765 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4a4002a540 con 0x7f4a501044c0 2024-09-13T21:33:25.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.193+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4a50196ec0 con 0x7f4a501044c0 2024-09-13T21:33:25.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.193+0000 7f4a3f7fe700 1 -- 172.21.15.116:0/2004503765 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f4a4002a360 con 0x7f4a501044c0 2024-09-13T21:33:25.195 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:25.195 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4a38038580 msgr2=0x7f4a3803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 --2- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4a38038580 0x7f4a3803aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a44006fd0 tx=0x7f4a44006e40 comp rx=0 tx=0).stop 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 msgr2=0x7f4a50196110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 --2- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 0x7f4a50196110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a40005b40 tx=0x7f4a40004c80 comp rx=0 tx=0).stop 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 shutdown_connections 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 --2- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4a38038580 0x7f4a3803aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 --2- 172.21.15.116:0/2004503765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a501044c0 0x7f4a50196110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 >> 172.21.15.116:0/2004503765 conn(0x7f4a50075750 msgr2=0x7f4a500fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 shutdown_connections 2024-09-13T21:33:25.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:25.195+0000 7f4a54f26700 1 -- 172.21.15.116:0/2004503765 wait complete. 2024-09-13T21:33:25.198 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:33:26.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:26 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/2004503765' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:26.767 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:26.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:27.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:27.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:27.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:27.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:27.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi116", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:33:27.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi116", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T21:33:27.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:27.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:27 smithi088 ceph-mon[27963]: Deploying daemon crash.smithi116 on smithi116 2024-09-13T21:33:27.785 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:29.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.743+0000 7fd464cf2700 1 -- 172.21.15.116:0/1547793591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 msgr2=0x7fd4600ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:29.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.743+0000 7fd464cf2700 1 --2- 172.21.15.116:0/1547793591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 0x7fd4600ff060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd450009910 tx=0x7fd450009c20 comp rx=0 tx=0).stop 2024-09-13T21:33:29.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.743+0000 7fd464cf2700 1 -- 172.21.15.116:0/1547793591 shutdown_connections 2024-09-13T21:33:29.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.743+0000 7fd464cf2700 1 --2- 172.21.15.116:0/1547793591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 0x7fd4600ff060 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:29.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.743+0000 7fd464cf2700 1 -- 172.21.15.116:0/1547793591 >> 172.21.15.116:0/1547793591 conn(0x7fd460075750 msgr2=0x7fd460075b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:29.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.743+0000 7fd464cf2700 1 -- 172.21.15.116:0/1547793591 shutdown_connections 2024-09-13T21:33:29.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.743+0000 7fd464cf2700 1 -- 172.21.15.116:0/1547793591 wait complete. 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.744+0000 7fd464cf2700 1 Processor -- start 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.744+0000 7fd464cf2700 1 -- start start 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.744+0000 7fd464cf2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 0x7fd460195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.744+0000 7fd464cf2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd460195880 con 0x7fd4600fec90 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 0x7fd460195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 0x7fd460195340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:56908/0 (socket says 172.21.15.116:56908) 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd45e59c700 1 -- 172.21.15.116:0/469256499 learned_addr learned my addr 172.21.15.116:0/469256499 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd45e59c700 1 -- 172.21.15.116:0/469256499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500095f0 con 0x7fd4600fec90 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd45e59c700 1 --2- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 0x7fd460195340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd450005b40 tx=0x7fd450004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd44f7fe700 1 -- 172.21.15.116:0/469256499 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd45001d070 con 0x7fd4600fec90 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd44f7fe700 1 -- 172.21.15.116:0/469256499 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4500044d0 con 0x7fd4600fec90 2024-09-13T21:33:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd460195a80 con 0x7fd4600fec90 2024-09-13T21:33:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd44f7fe700 1 -- 172.21.15.116:0/469256499 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd450003930 con 0x7fd4600fec90 2024-09-13T21:33:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.745+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd460195e40 con 0x7fd4600fec90 2024-09-13T21:33:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.746+0000 7fd44f7fe700 1 -- 172.21.15.116:0/469256499 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fd450003bf0 con 0x7fd4600fec90 2024-09-13T21:33:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.746+0000 7fd44f7fe700 1 --2- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd448038580 0x7fd44803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.746+0000 7fd44f7fe700 1 -- 172.21.15.116:0/469256499 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fd45004d400 con 0x7fd4600fec90 2024-09-13T21:33:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.746+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd460062380 con 0x7fd4600fec90 2024-09-13T21:33:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.747+0000 7fd45dd9b700 1 --2- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd448038580 0x7fd44803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.747+0000 7fd45dd9b700 1 --2- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd448038580 0x7fd44803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd454006fd0 tx=0x7fd454006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:29.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:29.751+0000 7fd44f7fe700 1 -- 172.21.15.116:0/469256499 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd45002a950 con 0x7fd4600fec90 2024-09-13T21:33:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.050+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd460106e90 con 0x7fd4600fec90 2024-09-13T21:33:30.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.050+0000 7fd44f7fe700 1 -- 172.21.15.116:0/469256499 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd45002a360 con 0x7fd4600fec90 2024-09-13T21:33:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:30.053 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:30.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd448038580 msgr2=0x7fd44803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:30.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 --2- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd448038580 0x7fd44803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd454006fd0 tx=0x7fd454006e40 comp rx=0 tx=0).stop 2024-09-13T21:33:30.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 msgr2=0x7fd460195340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:30.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 --2- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 0x7fd460195340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd450005b40 tx=0x7fd450004c80 comp rx=0 tx=0).stop 2024-09-13T21:33:30.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 shutdown_connections 2024-09-13T21:33:30.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 --2- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd448038580 0x7fd44803aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:30.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 --2- 172.21.15.116:0/469256499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4600fec90 0x7fd460195340 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:30.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 >> 172.21.15.116:0/469256499 conn(0x7fd460075750 msgr2=0x7fd4601045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:30.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 shutdown_connections 2024-09-13T21:33:30.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:30.053+0000 7fd464cf2700 1 -- 172.21.15.116:0/469256499 wait complete. 2024-09-13T21:33:30.055 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:30.736 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:30 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:30.736 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:30 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:30.736 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:30 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:30.736 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:30 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:30.736 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:30 smithi088 ceph-mon[27963]: Deploying daemon node-exporter.smithi116 on smithi116 2024-09-13T21:33:30.736 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:30 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/469256499' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:30.736 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:30 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:31.675 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:31.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:31 smithi088 ceph-mon[27963]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:32.606 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:33.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:33 smithi088 ceph-mon[27963]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:34.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.853+0000 7f0f59631700 1 -- 172.21.15.116:0/3170712119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 msgr2=0x7f0f541013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:34.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.853+0000 7f0f59631700 1 --2- 172.21.15.116:0/3170712119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 0x7f0f541013c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009910 tx=0x7f0f44009c20 comp rx=0 tx=0).stop 2024-09-13T21:33:34.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.853+0000 7f0f59631700 1 -- 172.21.15.116:0/3170712119 shutdown_connections 2024-09-13T21:33:34.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.853+0000 7f0f59631700 1 --2- 172.21.15.116:0/3170712119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 0x7f0f541013c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:34.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.853+0000 7f0f59631700 1 -- 172.21.15.116:0/3170712119 >> 172.21.15.116:0/3170712119 conn(0x7f0f540fa850 msgr2=0x7f0f540fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:34.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.853+0000 7f0f59631700 1 -- 172.21.15.116:0/3170712119 shutdown_connections 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.853+0000 7f0f59631700 1 -- 172.21.15.116:0/3170712119 wait complete. 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.853+0000 7f0f59631700 1 Processor -- start 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.853+0000 7f0f59631700 1 -- start start 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.854+0000 7f0f59631700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 0x7f0f541953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.854+0000 7f0f59631700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f541958e0 con 0x7f0f54100ff0 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.854+0000 7f0f52ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 0x7f0f541953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.854+0000 7f0f52ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 0x7f0f541953a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:56926/0 (socket says 172.21.15.116:56926) 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.854+0000 7f0f52ffd700 1 -- 172.21.15.116:0/2619605698 learned_addr learned my addr 172.21.15.116:0/2619605698 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.854+0000 7f0f52ffd700 1 -- 172.21.15.116:0/2619605698 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f440095f0 con 0x7f0f54100ff0 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.854+0000 7f0f52ffd700 1 --2- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 0x7f0f541953a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f44005b40 tx=0x7f0f44004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.854+0000 7f0f3bfff700 1 -- 172.21.15.116:0/2619605698 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f4401d070 con 0x7f0f54100ff0 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.855+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f54195ae0 con 0x7f0f54100ff0 2024-09-13T21:33:34.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.855+0000 7f0f3bfff700 1 -- 172.21.15.116:0/2619605698 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f440044d0 con 0x7f0f54100ff0 2024-09-13T21:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.855+0000 7f0f3bfff700 1 -- 172.21.15.116:0/2619605698 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f44003930 con 0x7f0f54100ff0 2024-09-13T21:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.855+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f54195ea0 con 0x7f0f54100ff0 2024-09-13T21:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.856+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f54062380 con 0x7f0f54100ff0 2024-09-13T21:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.856+0000 7f0f3bfff700 1 -- 172.21.15.116:0/2619605698 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f0f44003bf0 con 0x7f0f54100ff0 2024-09-13T21:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.856+0000 7f0f3bfff700 1 --2- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f0f3c038580 0x7f0f3c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.856+0000 7f0f3bfff700 1 -- 172.21.15.116:0/2619605698 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f0f4404c340 con 0x7f0f54100ff0 2024-09-13T21:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.856+0000 7f0f527fc700 1 --2- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f0f3c038580 0x7f0f3c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.857+0000 7f0f527fc700 1 --2- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f0f3c038580 0x7f0f3c03aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0f48006fd0 tx=0x7f0f48006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:34.861+0000 7f0f3bfff700 1 -- 172.21.15.116:0/2619605698 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0f4402a950 con 0x7f0f54100ff0 2024-09-13T21:33:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.159+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0f54196700 con 0x7f0f54100ff0 2024-09-13T21:33:35.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.160+0000 7f0f3bfff700 1 -- 172.21.15.116:0/2619605698 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f0f4402a360 con 0x7f0f54100ff0 2024-09-13T21:33:35.162 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:35.162 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.162+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f0f3c038580 msgr2=0x7f0f3c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.162+0000 7f0f59631700 1 --2- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f0f3c038580 0x7f0f3c03aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0f48006fd0 tx=0x7f0f48006e40 comp rx=0 tx=0).stop 2024-09-13T21:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.162+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 msgr2=0x7f0f541953a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.162+0000 7f0f59631700 1 --2- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 0x7f0f541953a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f44005b40 tx=0x7f0f44004c80 comp rx=0 tx=0).stop 2024-09-13T21:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.162+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 shutdown_connections 2024-09-13T21:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.162+0000 7f0f59631700 1 --2- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f0f3c038580 0x7f0f3c03aa30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.163+0000 7f0f59631700 1 --2- 172.21.15.116:0/2619605698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f54100ff0 0x7f0f541953a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.163+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 >> 172.21.15.116:0/2619605698 conn(0x7f0f540fa850 msgr2=0x7f0f54104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.163+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 shutdown_connections 2024-09-13T21:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:35.163+0000 7f0f59631700 1 -- 172.21.15.116:0/2619605698 wait complete. 2024-09-13T21:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:35.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:35.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:35.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:35.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:35.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:35.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:33:35.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T21:33:35.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:33:35.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:35.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:35.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:35 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/2619605698' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:36 smithi088 ceph-mon[27963]: Deploying daemon mgr.smithi116.bqnvtn on smithi116 2024-09-13T21:33:37.713 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:37.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:37 smithi088 ceph-mon[27963]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:37 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:37 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:38.391 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:38.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:38 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:38.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:38 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:38.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:38 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:33:38.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:38 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:38.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:38 smithi088 ceph-mon[27963]: Deploying daemon mon.smithi116 on smithi116 2024-09-13T21:33:39.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:39 smithi088 ceph-mon[27963]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:40.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:33:40.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:41.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.556+0000 7fca8f6f7700 1 -- 172.21.15.116:0/2814359091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 msgr2=0x7fca880ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:41.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.556+0000 7fca8f6f7700 1 --2- 172.21.15.116:0/2814359091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 0x7fca880ff390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fca84009910 tx=0x7fca84009c20 comp rx=0 tx=0).stop 2024-09-13T21:33:41.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.556+0000 7fca8f6f7700 1 -- 172.21.15.116:0/2814359091 shutdown_connections 2024-09-13T21:33:41.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.556+0000 7fca8f6f7700 1 --2- 172.21.15.116:0/2814359091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 0x7fca880ff390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:41.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.556+0000 7fca8f6f7700 1 -- 172.21.15.116:0/2814359091 >> 172.21.15.116:0/2814359091 conn(0x7fca88074af0 msgr2=0x7fca88074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:41.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.556+0000 7fca8f6f7700 1 -- 172.21.15.116:0/2814359091 shutdown_connections 2024-09-13T21:33:41.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.556+0000 7fca8f6f7700 1 -- 172.21.15.116:0/2814359091 wait complete. 2024-09-13T21:33:41.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.557+0000 7fca8f6f7700 1 Processor -- start 2024-09-13T21:33:41.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.557+0000 7fca8f6f7700 1 -- start start 2024-09-13T21:33:41.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.557+0000 7fca8f6f7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 0x7fca88196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:41.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.557+0000 7fca8f6f7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca881967a0 con 0x7fca880fefc0 2024-09-13T21:33:41.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.558+0000 7fca8d493700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 0x7fca88196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:41.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.558+0000 7fca8d493700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 0x7fca88196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.116:43282/0 (socket says 172.21.15.116:43282) 2024-09-13T21:33:41.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.558+0000 7fca8d493700 1 -- 172.21.15.116:0/845026242 learned_addr learned my addr 172.21.15.116:0/845026242 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:41.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.558+0000 7fca8d493700 1 -- 172.21.15.116:0/845026242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca840095f0 con 0x7fca880fefc0 2024-09-13T21:33:41.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.558+0000 7fca8d493700 1 --2- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 0x7fca88196260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca84005b40 tx=0x7fca84004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:41.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.558+0000 7fca7e7fc700 1 -- 172.21.15.116:0/845026242 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca8401d070 con 0x7fca880fefc0 2024-09-13T21:33:41.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.558+0000 7fca7e7fc700 1 -- 172.21.15.116:0/845026242 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca840044d0 con 0x7fca880fefc0 2024-09-13T21:33:41.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.558+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca881969a0 con 0x7fca880fefc0 2024-09-13T21:33:41.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.559+0000 7fca7e7fc700 1 -- 172.21.15.116:0/845026242 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca84003930 con 0x7fca880fefc0 2024-09-13T21:33:41.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.559+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca88196d60 con 0x7fca880fefc0 2024-09-13T21:33:41.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.560+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca88107240 con 0x7fca880fefc0 2024-09-13T21:33:41.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.560+0000 7fca7e7fc700 1 -- 172.21.15.116:0/845026242 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fca84003ba0 con 0x7fca880fefc0 2024-09-13T21:33:41.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.560+0000 7fca7e7fc700 1 --2- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fca740385d0 0x7fca7403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:41.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.560+0000 7fca7e7fc700 1 -- 172.21.15.116:0/845026242 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fca840213d0 con 0x7fca880fefc0 2024-09-13T21:33:41.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.560+0000 7fca8cc92700 1 --2- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fca740385d0 0x7fca7403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:41.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.561+0000 7fca8cc92700 1 --2- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fca740385d0 0x7fca7403aa80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca78006fd0 tx=0x7fca78006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:41.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.566+0000 7fca7e7fc700 1 -- 172.21.15.116:0/845026242 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fca8400f660 con 0x7fca880fefc0 2024-09-13T21:33:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:41 smithi088 ceph-mon[27963]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:41.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.851+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fca880685a0 con 0x7fca880fefc0 2024-09-13T21:33:41.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.852+0000 7fca7e7fc700 1 -- 172.21.15.116:0/845026242 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fca8400f800 con 0x7fca880fefc0 2024-09-13T21:33:41.854 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:41.854 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:30:53.455498Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fca740385d0 msgr2=0x7fca7403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 --2- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fca740385d0 0x7fca7403aa80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca78006fd0 tx=0x7fca78006e40 comp rx=0 tx=0).stop 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 msgr2=0x7fca88196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 --2- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 0x7fca88196260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca84005b40 tx=0x7fca84004c80 comp rx=0 tx=0).stop 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 shutdown_connections 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 --2- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fca740385d0 0x7fca7403aa80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 --2- 172.21.15.116:0/845026242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca880fefc0 0x7fca88196260 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 >> 172.21.15.116:0/845026242 conn(0x7fca88074af0 msgr2=0x7fca881031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 shutdown_connections 2024-09-13T21:33:41.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:41.854+0000 7fca8f6f7700 1 -- 172.21.15.116:0/845026242 wait complete. 2024-09-13T21:33:41.857 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T21:33:43.847 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:33:43.847 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:33:44.047 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi116/config 2024-09-13T21:33:47.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.095+0000 7f107fbed700 1 -- 172.21.15.116:0/97074590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10780ff0e0 msgr2=0x7f10780ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:47.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.095+0000 7f107fbed700 1 --2- 172.21.15.116:0/97074590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10780ff0e0 0x7f10780ff4b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1074005fa0 tx=0x7f107400fe80 comp rx=0 tx=0).stop 2024-09-13T21:33:47.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.095+0000 7f107fbed700 1 -- 172.21.15.116:0/97074590 shutdown_connections 2024-09-13T21:33:47.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.095+0000 7f107fbed700 1 --2- 172.21.15.116:0/97074590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10780ff0e0 0x7f10780ff4b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:47.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.095+0000 7f107fbed700 1 -- 172.21.15.116:0/97074590 >> 172.21.15.116:0/97074590 conn(0x7f10780fa9a0 msgr2=0x7f10780fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:47.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.095+0000 7f107fbed700 1 -- 172.21.15.116:0/97074590 shutdown_connections 2024-09-13T21:33:47.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.095+0000 7f107fbed700 1 -- 172.21.15.116:0/97074590 wait complete. 2024-09-13T21:33:47.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.096+0000 7f107fbed700 1 Processor -- start 2024-09-13T21:33:47.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.096+0000 7f107fbed700 1 -- start start 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.096+0000 7f107fbed700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10780ff0e0 0x7f1078195570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.096+0000 7f107fbed700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 0x7f1078199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.096+0000 7f107fbed700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10781960c0 con 0x7f10780ff0e0 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.096+0000 7f107fbed700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1078196230 con 0x7f1078195ab0 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.096+0000 7f107d188700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 0x7f1078199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.096+0000 7f107d188700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 0x7f1078199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40204/0 (socket says 172.21.15.116:40204) 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.096+0000 7f107d188700 1 -- 172.21.15.116:0/114789128 learned_addr learned my addr 172.21.15.116:0/114789128 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107d989700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10780ff0e0 0x7f1078195570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107d188700 1 -- 172.21.15.116:0/114789128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 msgr2=0x7f1078199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107d188700 1 -- 172.21.15.116:0/114789128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 msgr2=0x7f1078199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T21:33:47.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107d188700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 0x7f1078199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107d188700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 0x7f1078199f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107d989700 1 -- 172.21.15.116:0/114789128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 msgr2=0x7f1078199f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107d989700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 0x7f1078199f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107d989700 1 -- 172.21.15.116:0/114789128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107400f880 con 0x7f10780ff0e0 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107d989700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10780ff0e0 0x7f1078195570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1074000c00 tx=0x7f1074003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f106effd700 1 -- 172.21.15.116:0/114789128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1074021070 con 0x7f10780ff0e0 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f106effd700 1 -- 172.21.15.116:0/114789128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1074003e80 con 0x7f10780ff0e0 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107819a4c0 con 0x7f10780ff0e0 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.097+0000 7f106effd700 1 -- 172.21.15.116:0/114789128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1074012ea0 con 0x7f10780ff0e0 2024-09-13T21:33:47.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.098+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107819aa10 con 0x7f10780ff0e0 2024-09-13T21:33:47.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.098+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1078062380 con 0x7f10780ff0e0 2024-09-13T21:33:47.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.099+0000 7f106effd700 1 -- 172.21.15.116:0/114789128 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f10740126e0 con 0x7f10780ff0e0 2024-09-13T21:33:47.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.099+0000 7f106effd700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f106406c750 0x7f106406ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:47.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.100+0000 7f106effd700 1 -- 172.21.15.116:0/114789128 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f1074018070 con 0x7f10780ff0e0 2024-09-13T21:33:47.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.100+0000 7f107d188700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f106406c750 0x7f106406ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:47.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.100+0000 7f107d188700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f106406c750 0x7f106406ec00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1068009180 tx=0x7f1068008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:47.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.104+0000 7f106effd700 1 -- 172.21.15.116:0/114789128 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1074057af0 con 0x7f10780ff0e0 2024-09-13T21:33:47.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.383+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f10781a01c0 con 0x7f10780ff0e0 2024-09-13T21:33:47.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.384+0000 7f106effd700 1 -- 172.21.15.116:0/114789128 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7f107402a090 con 0x7f10780ff0e0 2024-09-13T21:33:47.386 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:33:47.386 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":2,"fsid":"67511300-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:33:41.967632Z","created":"2024-09-13T21:30:53.455498Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi088","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi116","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T21:33:47.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f106406c750 msgr2=0x7f106406ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:47.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f106406c750 0x7f106406ec00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1068009180 tx=0x7f1068008040 comp rx=0 tx=0).stop 2024-09-13T21:33:47.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10780ff0e0 msgr2=0x7f1078195570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:47.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10780ff0e0 0x7f1078195570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1074000c00 tx=0x7f1074003c60 comp rx=0 tx=0).stop 2024-09-13T21:33:47.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 shutdown_connections 2024-09-13T21:33:47.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f106406c750 0x7f106406ec00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:47.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10780ff0e0 0x7f1078195570 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:47.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 --2- 172.21.15.116:0/114789128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1078195ab0 0x7f1078199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:47.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 >> 172.21.15.116:0/114789128 conn(0x7f10780fa9a0 msgr2=0x7f1078068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:47.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 shutdown_connections 2024-09-13T21:33:47.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:33:47.386+0000 7f107fbed700 1 -- 172.21.15.116:0/114789128 wait complete. 2024-09-13T21:33:47.390 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 2 2024-09-13T21:33:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:33:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: mon.smithi088 calling monitor election 2024-09-13T21:33:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:33:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:33:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:33:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: mon.smithi116 calling monitor election 2024-09-13T21:33:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/1443520208' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/crt"}]: dispatch 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: mon.smithi088 is new leader, mons smithi088,smithi116 in quorum (ranks 0,1) 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: monmap e2: 2 mons at {smithi088=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],smithi116=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: fsmap 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: mgrmap e17: smithi088.scyrwy(active, since 36s) 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: Standby manager daemon smithi116.bqnvtn started 2024-09-13T21:33:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/1443520208' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:33:47.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: overall HEALTH_OK 2024-09-13T21:33:47.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/1443520208' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/key"}]: dispatch 2024-09-13T21:33:47.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:47.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/1443520208' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:33:47.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:47.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:47.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:47.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:48.026 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T21:33:48.026 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T21:33:48.239 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:33:48.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:48 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:33:48.359 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:48 smithi088 ceph-mon[27963]: mgrmap e18: smithi088.scyrwy(active, since 37s), standbys: smithi116.bqnvtn 2024-09-13T21:33:48.359 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:48 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi116.bqnvtn", "id": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:33:48.359 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:48 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:33:48.359 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:48 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/114789128' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:33:48.359 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:48 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:33:49.334 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:49 smithi116 ceph-mon[33391]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:49.337 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:49 smithi088 ceph-mon[27963]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.681+0000 7f24f1238700 1 -- 172.21.15.88:0/4159853610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 msgr2=0x7f24ec0ff360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.681+0000 7f24f1238700 1 --2- 172.21.15.88:0/4159853610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 0x7f24ec0ff360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f24dc009910 tx=0x7f24dc009c20 comp rx=0 tx=0).stop 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.681+0000 7f24f1238700 1 -- 172.21.15.88:0/4159853610 shutdown_connections 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.681+0000 7f24f1238700 1 --2- 172.21.15.88:0/4159853610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 0x7f24ec0ff360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.681+0000 7f24f1238700 1 -- 172.21.15.88:0/4159853610 >> 172.21.15.88:0/4159853610 conn(0x7f24ec0fa850 msgr2=0x7f24ec0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.681+0000 7f24f1238700 1 -- 172.21.15.88:0/4159853610 shutdown_connections 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.681+0000 7f24f1238700 1 -- 172.21.15.88:0/4159853610 wait complete. 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.682+0000 7f24f1238700 1 Processor -- start 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.682+0000 7f24f1238700 1 -- start start 2024-09-13T21:33:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.682+0000 7f24f1238700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 0x7f24ec196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.682+0000 7f24f1238700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24ec196840 0x7f24ec196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.682+0000 7f24f1238700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec19f400 con 0x7f24ec0fef90 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.682+0000 7f24f1238700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec19f540 con 0x7f24ec196840 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.682+0000 7f24ead9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 0x7f24ec196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.682+0000 7f24ead9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 0x7f24ec196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37366/0 (socket says 172.21.15.88:37366) 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.682+0000 7f24ead9d700 1 -- 172.21.15.88:0/431554522 learned_addr learned my addr 172.21.15.88:0/431554522 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24ea59c700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24ec196840 0x7f24ec196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24ea59c700 1 -- 172.21.15.88:0/431554522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24ec196840 msgr2=0x7f24ec196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24ea59c700 1 -- 172.21.15.88:0/431554522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24ec196840 msgr2=0x7f24ec196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T21:33:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24ea59c700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24ec196840 0x7f24ec196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24ea59c700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24ec196840 0x7f24ec196c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24ead9d700 1 -- 172.21.15.88:0/431554522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24ec196840 msgr2=0x7f24ec196c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24ead9d700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24ec196840 0x7f24ec196c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24ead9d700 1 -- 172.21.15.88:0/431554522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc0095f0 con 0x7f24ec0fef90 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24ead9d700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 0x7f24ec196300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f24dc005b40 tx=0x7f24dc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24d3fff700 1 -- 172.21.15.88:0/431554522 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24dc01d070 con 0x7f24ec0fef90 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24d3fff700 1 -- 172.21.15.88:0/431554522 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24dc005140 con 0x7f24ec0fef90 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ec19f740 con 0x7f24ec0fef90 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24d3fff700 1 -- 172.21.15.88:0/431554522 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24dc017440 con 0x7f24ec0fef90 2024-09-13T21:33:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.683+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ec19fc00 con 0x7f24ec0fef90 2024-09-13T21:33:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.684+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ec062380 con 0x7f24ec0fef90 2024-09-13T21:33:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.685+0000 7f24d3fff700 1 -- 172.21.15.88:0/431554522 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f24dc003a60 con 0x7f24ec0fef90 2024-09-13T21:33:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.685+0000 7f24d3fff700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f24d406c760 0x7f24d406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:33:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.685+0000 7f24d3fff700 1 -- 172.21.15.88:0/431554522 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f24dc08bae0 con 0x7f24ec0fef90 2024-09-13T21:33:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.685+0000 7f24ea59c700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f24d406c760 0x7f24d406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:33:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.686+0000 7f24ea59c700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f24d406c760 0x7f24d406ec10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009850 tx=0x7f24e0008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:33:49.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.690+0000 7f24d3fff700 1 -- 172.21.15.88:0/431554522 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f24dc0573d0 con 0x7f24ec0fef90 2024-09-13T21:33:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.942+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f24ec19ff30 con 0x7f24ec0fef90 2024-09-13T21:33:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.943+0000 7f24d3fff700 1 -- 172.21.15.88:0/431554522 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f24dc026090 con 0x7f24ec0fef90 2024-09-13T21:33:49.945 INFO:teuthology.orchestra.run.smithi088.stdout:# minimal ceph.conf for 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:33:49.945 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-09-13T21:33:49.945 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:33:49.945 INFO:teuthology.orchestra.run.smithi088.stdout: mon_host = [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-13T21:33:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f24d406c760 msgr2=0x7f24d406ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f24d406c760 0x7f24d406ec10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009850 tx=0x7f24e0008040 comp rx=0 tx=0).stop 2024-09-13T21:33:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 msgr2=0x7f24ec196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:33:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 0x7f24ec196300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f24dc005b40 tx=0x7f24dc00bda0 comp rx=0 tx=0).stop 2024-09-13T21:33:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 shutdown_connections 2024-09-13T21:33:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f24d406c760 0x7f24d406ec10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ec0fef90 0x7f24ec196300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:49.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 --2- 172.21.15.88:0/431554522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24ec196840 0x7f24ec196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:33:49.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 >> 172.21.15.88:0/431554522 conn(0x7f24ec0fa850 msgr2=0x7f24ec104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:33:49.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 shutdown_connections 2024-09-13T21:33:49.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:33:49.945+0000 7f24f1238700 1 -- 172.21.15.88:0/431554522 wait complete. 2024-09-13T21:33:50.738 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T21:33:50.738 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:33:50.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T21:33:50.769 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:33:50.769 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:33:50.836 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:33:50.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T21:33:50.865 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:33:50.865 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:33:50.931 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T21:33:50.931 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:33:50.931 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T21:33:50.947 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T21:33:50.947 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-09-13T21:33:50.968 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:50.968 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:50.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:50.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:33:50.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-13T21:33:50.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T21:33:50.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/431554522' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:50.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:50.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:50.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:50.969 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:50.970 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:50.970 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:50.970 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:50.970 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:50.970 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:50.970 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:33:50.970 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:33:50.970 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:50.985 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T21:33:50.986 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:33:50.986 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T21:33:50.986 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:33:50.986 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:33:50.986 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-13 21:33:01.674739086 +0000 2024-09-13T21:33:50.986 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 21:28:07.502923425 +0000 2024-09-13T21:33:50.986 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 21:28:07.502923425 +0000 2024-09-13T21:33:50.986 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-13 21:28:07.502923425 +0000 2024-09-13T21:33:50.986 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T21:33:51.052 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-13T21:33:51.052 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-13T21:33:51.052 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000206226 s, 2.5 MB/s 2024-09-13T21:33:51.053 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T21:33:51.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:51.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:51.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/431554522' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:51.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:51.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:33:51.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:33:51.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:51.111 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-09-13T21:33:51.167 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T21:33:51.167 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:33:51.167 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T21:33:51.167 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:33:51.167 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:33:51.168 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-13 21:33:01.675739067 +0000 2024-09-13T21:33:51.168 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 21:28:07.843916991 +0000 2024-09-13T21:33:51.168 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 21:28:07.843916991 +0000 2024-09-13T21:33:51.168 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-13 21:28:07.843916991 +0000 2024-09-13T21:33:51.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T21:33:51.231 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-13T21:33:51.231 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-13T21:33:51.231 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000218024 s, 2.3 MB/s 2024-09-13T21:33:51.233 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T21:33:51.289 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-09-13T21:33:51.345 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T21:33:51.345 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:33:51.345 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T21:33:51.345 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:33:51.345 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:33:51.346 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-13 21:33:01.675739067 +0000 2024-09-13T21:33:51.346 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 21:28:08.163910952 +0000 2024-09-13T21:33:51.346 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 21:28:08.163910952 +0000 2024-09-13T21:33:51.346 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-13 21:28:08.163910952 +0000 2024-09-13T21:33:51.346 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T21:33:51.409 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-13T21:33:51.409 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-13T21:33:51.409 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000214399 s, 2.4 MB/s 2024-09-13T21:33:51.410 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T21:33:51.467 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-09-13T21:33:51.522 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T21:33:51.523 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:33:51.523 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T21:33:51.523 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:33:51.523 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:33:51.523 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-13 21:33:01.675739067 +0000 2024-09-13T21:33:51.523 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 21:28:08.483904914 +0000 2024-09-13T21:33:51.523 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 21:28:08.483904914 +0000 2024-09-13T21:33:51.523 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-13 21:28:08.483904914 +0000 2024-09-13T21:33:51.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T21:33:51.586 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-13T21:33:51.586 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-13T21:33:51.586 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000190059 s, 2.7 MB/s 2024-09-13T21:33:51.587 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T21:33:51.645 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:33:51.645 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T21:33:51.664 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T21:33:51.665 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-09-13T21:33:51.723 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T21:33:51.723 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:33:51.723 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-13T21:33:51.723 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:33:51.723 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:33:51.723 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-13 21:33:40.872126363 +0000 2024-09-13T21:33:51.723 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-13 21:28:08.100126895 +0000 2024-09-13T21:33:51.724 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-13 21:28:08.100126895 +0000 2024-09-13T21:33:51.724 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-13 21:28:08.100126895 +0000 2024-09-13T21:33:51.724 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T21:33:51.790 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-13T21:33:51.791 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-13T21:33:51.791 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00031146 s, 1.6 MB/s 2024-09-13T21:33:51.792 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T21:33:51.853 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-09-13T21:33:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T21:33:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:33:51.938 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-13T21:33:51.938 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:33:51.938 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:33:51.938 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-13 21:33:40.873126346 +0000 2024-09-13T21:33:51.938 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-13 21:28:08.435121508 +0000 2024-09-13T21:33:51.938 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-13 21:28:08.435121508 +0000 2024-09-13T21:33:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-13 21:28:08.435121508 +0000 2024-09-13T21:33:51.938 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T21:33:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-13T21:33:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-13T21:33:52.006 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000213325 s, 2.4 MB/s 2024-09-13T21:33:52.007 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T21:33:52.071 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-09-13T21:33:52.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:51 smithi116 ceph-mon[33391]: Reconfiguring mon.smithi088 (unknown last config time)... 2024-09-13T21:33:52.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:51 smithi116 ceph-mon[33391]: Reconfiguring daemon mon.smithi088 on smithi088 2024-09-13T21:33:52.115 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T21:33:52.115 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:33:52.115 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-13T21:33:52.116 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:33:52.116 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:33:52.116 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-13 21:33:40.873126346 +0000 2024-09-13T21:33:52.116 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-13 21:28:08.777116008 +0000 2024-09-13T21:33:52.116 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-13 21:28:08.777116008 +0000 2024-09-13T21:33:52.116 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-13 21:28:08.777116008 +0000 2024-09-13T21:33:52.117 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T21:33:52.183 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-13T21:33:52.183 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-13T21:33:52.183 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000236143 s, 2.2 MB/s 2024-09-13T21:33:52.184 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T21:33:52.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:51 smithi088 ceph-mon[27963]: Reconfiguring mon.smithi088 (unknown last config time)... 2024-09-13T21:33:52.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:51 smithi088 ceph-mon[27963]: Reconfiguring daemon mon.smithi088 on smithi088 2024-09-13T21:33:52.244 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-09-13T21:33:52.303 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T21:33:52.303 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:33:52.303 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T21:33:52.303 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:33:52.303 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:33:52.304 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-13 21:33:40.873126346 +0000 2024-09-13T21:33:52.304 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-13 21:28:09.100110815 +0000 2024-09-13T21:33:52.304 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-13 21:28:09.100110815 +0000 2024-09-13T21:33:52.304 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-13 21:28:09.100110815 +0000 2024-09-13T21:33:52.304 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T21:33:52.367 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-13T21:33:52.368 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-13T21:33:52.368 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000248333 s, 2.1 MB/s 2024-09-13T21:33:52.369 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T21:33:52.426 INFO:tasks.cephadm:Deploying osd.0 on smithi088 with /dev/vg_nvme/lv_4... 2024-09-13T21:33:52.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T21:33:52.931 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:33:53.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:52 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:53.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:52 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:53.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:52 smithi088 ceph-mon[27963]: Reconfiguring mgr.smithi088.scyrwy (unknown last config time)... 2024-09-13T21:33:53.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:52 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.scyrwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:33:53.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:52 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:33:53.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:52 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:53.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:52 smithi088 ceph-mon[27963]: Reconfiguring daemon mgr.smithi088.scyrwy on smithi088 2024-09-13T21:33:53.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:52 smithi088 ceph-mon[27963]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:53.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:52 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:53.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:52 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:53.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:52 smithi116 ceph-mon[33391]: Reconfiguring mgr.smithi088.scyrwy (unknown last config time)... 2024-09-13T21:33:53.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:52 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.scyrwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:33:53.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:52 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:33:53.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:52 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:53.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:52 smithi116 ceph-mon[33391]: Reconfiguring daemon mgr.smithi088.scyrwy on smithi088 2024-09-13T21:33:53.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:52 smithi116 ceph-mon[33391]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:54.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:54 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:54.695 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:54 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:54.695 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:54 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:33:54.695 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:54 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:54.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:54 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:54.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:54 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:54.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:54 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:33:54.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:54 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:55.463 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:55 smithi088 ceph-mon[27963]: Reconfiguring ceph-exporter.smithi088 (monmap changed)... 2024-09-13T21:33:55.464 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:55 smithi088 ceph-mon[27963]: Reconfiguring daemon ceph-exporter.smithi088 on smithi088 2024-09-13T21:33:55.464 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:55 smithi088 ceph-mon[27963]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:55.464 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:55 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:33:55.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:55 smithi116 ceph-mon[33391]: Reconfiguring ceph-exporter.smithi088 (monmap changed)... 2024-09-13T21:33:55.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:55 smithi116 ceph-mon[33391]: Reconfiguring daemon ceph-exporter.smithi088 on smithi088 2024-09-13T21:33:55.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:55 smithi116 ceph-mon[33391]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:55.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:55 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:33:56.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:56 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:56.718 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:56 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:56.718 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:56 smithi088 ceph-mon[27963]: Reconfiguring crash.smithi088 (monmap changed)... 2024-09-13T21:33:56.718 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:56 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:33:56.718 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:56 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:56.718 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:56 smithi088 ceph-mon[27963]: Reconfiguring daemon crash.smithi088 on smithi088 2024-09-13T21:33:56.718 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:56 smithi088 ceph-mon[27963]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:56.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:56 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:56.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:56 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:56.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:56 smithi116 ceph-mon[33391]: Reconfiguring crash.smithi088 (monmap changed)... 2024-09-13T21:33:56.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:56 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:33:56.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:56 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:33:56.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:56 smithi116 ceph-mon[33391]: Reconfiguring daemon crash.smithi088 on smithi088 2024-09-13T21:33:56.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:56 smithi116 ceph-mon[33391]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:56.958 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:33:56.978 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_4 2024-09-13T21:33:58.023 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:33:59.152 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:59.152 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:59.152 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:58 smithi088 ceph-mon[27963]: Reconfiguring alertmanager.smithi088 (dependencies changed)... 2024-09-13T21:33:59.152 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:58 smithi088 ceph-mon[27963]: Reconfiguring daemon alertmanager.smithi088 on smithi088 2024-09-13T21:33:59.152 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:33:58 smithi088 ceph-mon[27963]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:33:59.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:59.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:33:59.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:58 smithi116 ceph-mon[33391]: Reconfiguring alertmanager.smithi088 (dependencies changed)... 2024-09-13T21:33:59.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:58 smithi116 ceph-mon[33391]: Reconfiguring daemon alertmanager.smithi088 on smithi088 2024-09-13T21:33:59.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:33:58 smithi116 ceph-mon[33391]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:01.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:01 smithi088 ceph-mon[27963]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:01.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:01 smithi116 ceph-mon[33391]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:02.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.173+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/1495193292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 msgr2=0x7fa7a4103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:34:02.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.173+0000 7fa7aa5d3700 1 --2- 172.21.15.88:0/1495193292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 0x7fa7a4103140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa798009910 tx=0x7fa798009c20 comp rx=0 tx=0).stop 2024-09-13T21:34:02.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.173+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/1495193292 shutdown_connections 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.173+0000 7fa7aa5d3700 1 --2- 172.21.15.88:0/1495193292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a4103680 0x7fa7a4105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.173+0000 7fa7aa5d3700 1 --2- 172.21.15.88:0/1495193292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 0x7fa7a4103140 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.173+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/1495193292 >> 172.21.15.88:0/1495193292 conn(0x7fa7a40fa780 msgr2=0x7fa7a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.173+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/1495193292 shutdown_connections 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.173+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/1495193292 wait complete. 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7aa5d3700 1 Processor -- start 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7aa5d3700 1 -- start start 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7aa5d3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7aa5d3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a4103680 0x7fa7a4195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7aa5d3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4196580 con 0x7fa7a4100d60 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7aa5d3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a41966c0 con 0x7fa7a4103680 2024-09-13T21:34:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7a3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7a3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35894/0 (socket says 172.21.15.88:35894) 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7a3fff700 1 -- 172.21.15.88:0/741020374 learned_addr learned my addr 172.21.15.88:0/741020374 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.174+0000 7fa7a37fe700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a4103680 0x7fa7a4195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.175+0000 7fa7a3fff700 1 -- 172.21.15.88:0/741020374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a4103680 msgr2=0x7fa7a4195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.175+0000 7fa7a3fff700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a4103680 0x7fa7a4195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.175+0000 7fa7a3fff700 1 -- 172.21.15.88:0/741020374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7980095f0 con 0x7fa7a4100d60 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.175+0000 7fa7a3fff700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa79800bda0 tx=0x7fa79800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.175+0000 7fa7a17fa700 1 -- 172.21.15.88:0/741020374 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79801d070 con 0x7fa7a4100d60 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.175+0000 7fa7a17fa700 1 -- 172.21.15.88:0/741020374 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa798022470 con 0x7fa7a4100d60 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.175+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a419b120 con 0x7fa7a4100d60 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.175+0000 7fa7a17fa700 1 -- 172.21.15.88:0/741020374 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79800f670 con 0x7fa7a4100d60 2024-09-13T21:34:02.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.175+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a419b5e0 con 0x7fa7a4100d60 2024-09-13T21:34:02.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.176+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a418fbc0 con 0x7fa7a4100d60 2024-09-13T21:34:02.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.176+0000 7fa7a17fa700 1 -- 172.21.15.88:0/741020374 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fa798004af0 con 0x7fa7a4100d60 2024-09-13T21:34:02.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.177+0000 7fa7a17fa700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa78c06c600 0x7fa78c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:34:02.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.177+0000 7fa7a17fa700 1 -- 172.21.15.88:0/741020374 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fa79808bca0 con 0x7fa7a4100d60 2024-09-13T21:34:02.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.177+0000 7fa7a37fe700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa78c06c600 0x7fa78c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:34:02.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.177+0000 7fa7a37fe700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa78c06c600 0x7fa78c06eab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa79400ac50 tx=0x7fa79400a380 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:34:02.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.182+0000 7fa7a17fa700 1 -- 172.21.15.88:0/741020374 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa79805b050 con 0x7fa7a4100d60 2024-09-13T21:34:02.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:02.389+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7a4061190 con 0x7fa78c06c600 2024-09-13T21:34:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:03 smithi088 ceph-mon[27963]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:03 smithi088 ceph-mon[27963]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:34:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:34:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:34:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:03.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:03 smithi116 ceph-mon[33391]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:03.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:03 smithi116 ceph-mon[33391]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:34:03.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:34:03.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:34:03.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:05.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:05 smithi088 ceph-mon[27963]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:05.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:05 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:05.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:05 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:05.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:05 smithi116 ceph-mon[33391]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:05.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:05 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:05.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:05 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:06.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:06 smithi116 ceph-mon[33391]: Reconfiguring grafana.smithi088 (dependencies changed)... 2024-09-13T21:34:06.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:06 smithi116 ceph-mon[33391]: Reconfiguring daemon grafana.smithi088 on smithi088 2024-09-13T21:34:06.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:06 smithi088 ceph-mon[27963]: Reconfiguring grafana.smithi088 (dependencies changed)... 2024-09-13T21:34:06.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:06 smithi088 ceph-mon[27963]: Reconfiguring daemon grafana.smithi088 on smithi088 2024-09-13T21:34:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:07 smithi088 ceph-mon[27963]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:07 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2173799867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fc64bc8-3edd-41fd-9fb3-739af88e3c15"}]: dispatch 2024-09-13T21:34:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:07 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2173799867' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fc64bc8-3edd-41fd-9fb3-739af88e3c15"}]': finished 2024-09-13T21:34:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:07 smithi088 ceph-mon[27963]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T21:34:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:07 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:07 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2694655485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:34:07.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:07 smithi116 ceph-mon[33391]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:07.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:07 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2173799867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fc64bc8-3edd-41fd-9fb3-739af88e3c15"}]: dispatch 2024-09-13T21:34:07.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:07 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2173799867' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fc64bc8-3edd-41fd-9fb3-739af88e3c15"}]': finished 2024-09-13T21:34:07.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:07 smithi116 ceph-mon[33391]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T21:34:07.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:07 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:07.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:07 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2694655485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:34:09.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:09 smithi088 ceph-mon[27963]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:09.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:09 smithi116 ceph-mon[33391]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:10.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:34:10.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:34:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:11 smithi088 ceph-mon[27963]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:11 smithi116 ceph-mon[33391]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:13.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:13 smithi088 ceph-mon[27963]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:13 smithi116 ceph-mon[33391]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:15.230 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:15 smithi088 ceph-mon[27963]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:15.398 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:15 smithi116 ceph-mon[33391]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:16.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:16 smithi116 ceph-mon[33391]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-13T21:34:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:16 smithi116 ceph-mon[33391]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-13T21:34:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:16 smithi116 ceph-mon[33391]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:16 smithi088 ceph-mon[27963]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-13T21:34:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:16 smithi088 ceph-mon[27963]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-13T21:34:16.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:16 smithi088 ceph-mon[27963]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:17 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:34:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:17 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:17 smithi116 ceph-mon[33391]: Deploying daemon osd.0 on smithi088 2024-09-13T21:34:18.120 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:17 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:34:18.121 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:17 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:18.121 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:17 smithi088 ceph-mon[27963]: Deploying daemon osd.0 on smithi088 2024-09-13T21:34:18.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:18 smithi088 ceph-mon[27963]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:19.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:18 smithi116 ceph-mon[33391]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:21.155 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:21 smithi088 ceph-mon[27963]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:21.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:21 smithi116 ceph-mon[33391]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:22.452 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:22.452 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:22.452 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:22 smithi088 ceph-mon[27963]: Reconfiguring ceph-exporter.smithi116 (monmap changed)... 2024-09-13T21:34:22.452 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:34:22.452 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:22.452 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:22 smithi088 ceph-mon[27963]: Reconfiguring daemon ceph-exporter.smithi116 on smithi116 2024-09-13T21:34:22.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:22 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:22.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:22 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:22.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:22 smithi116 ceph-mon[33391]: Reconfiguring ceph-exporter.smithi116 (monmap changed)... 2024-09-13T21:34:22.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:22 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:34:22.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:22 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:22.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:22 smithi116 ceph-mon[33391]: Reconfiguring daemon ceph-exporter.smithi116 on smithi116 2024-09-13T21:34:23.519 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:23 smithi116 ceph-mon[33391]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:23.519 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:23.519 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:23.519 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi116", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:34:23.519 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:23.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:23 smithi088 ceph-mon[27963]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:23.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:23.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:23.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi116", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:34:23.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:24.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:24 smithi116 ceph-mon[33391]: Reconfiguring crash.smithi116 (monmap changed)... 2024-09-13T21:34:24.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:24 smithi116 ceph-mon[33391]: Reconfiguring daemon crash.smithi116 on smithi116 2024-09-13T21:34:24.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:24 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:24.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:24 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:24.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:24 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:34:24.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:24 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:34:24.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:24 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:24.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:24 smithi088 ceph-mon[27963]: Reconfiguring crash.smithi116 (monmap changed)... 2024-09-13T21:34:24.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:24 smithi088 ceph-mon[27963]: Reconfiguring daemon crash.smithi116 on smithi116 2024-09-13T21:34:24.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:24 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:24.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:24 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:24.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:24 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:34:24.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:24 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:34:24.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:24 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:25 smithi088 ceph-mon[27963]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:25 smithi088 ceph-mon[27963]: Reconfiguring mgr.smithi116.bqnvtn (monmap changed)... 2024-09-13T21:34:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:25 smithi088 ceph-mon[27963]: Reconfiguring daemon mgr.smithi116.bqnvtn on smithi116 2024-09-13T21:34:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:34:25.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:25 smithi116 ceph-mon[33391]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:25.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:25 smithi116 ceph-mon[33391]: Reconfiguring mgr.smithi116.bqnvtn (monmap changed)... 2024-09-13T21:34:25.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:25 smithi116 ceph-mon[33391]: Reconfiguring daemon mgr.smithi116.bqnvtn on smithi116 2024-09-13T21:34:25.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:34:26.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:26.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:26.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: Reconfiguring mon.smithi116 (monmap changed)... 2024-09-13T21:34:26.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:34:26.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:34:26.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:26.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: Reconfiguring daemon mon.smithi116 on smithi116 2024-09-13T21:34:26.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:26.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:26.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:26.873 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:26.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:26.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: Reconfiguring mon.smithi116 (monmap changed)... 2024-09-13T21:34:26.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:34:26.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:34:26.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:26.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: Reconfiguring daemon mon.smithi116 on smithi116 2024-09-13T21:34:26.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:26.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:26.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.104 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:34:28.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:34:28.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T21:34:28.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T21:34:28.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.106 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:27 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:34:28.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:34:28.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:34:28.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi088.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi088.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:28.349 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:27 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:34:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:28 smithi116 ceph-mon[33391]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:28 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:28 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:29.429 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:28 smithi088 ceph-mon[27963]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:29.429 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:28 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:29.429 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:28 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:30.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.550+0000 7fa7a17fa700 1 -- 172.21.15.88:0/741020374 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa7a4061190 con 0x7fa78c06c600 2024-09-13T21:34:30.553 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 0 on host 'smithi088' 2024-09-13T21:34:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa78c06c600 msgr2=0x7fa78c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:34:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa78c06c600 0x7fa78c06eab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa79400ac50 tx=0x7fa79400a380 comp rx=0 tx=0).stop 2024-09-13T21:34:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 msgr2=0x7fa7a4195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:34:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa79800bda0 tx=0x7fa79800bdd0 comp rx=0 tx=0).stop 2024-09-13T21:34:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 shutdown_connections 2024-09-13T21:34:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa78c06c600 0x7fa78c06eab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 --2- 172.21.15.88:0/741020374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a4103680 0x7fa7a4195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 >> 172.21.15.88:0/741020374 conn(0x7fa7a40fa780 msgr2=0x7fa7a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:34:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 shutdown_connections 2024-09-13T21:34:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:30.553+0000 7fa7aa5d3700 1 -- 172.21.15.88:0/741020374 wait complete. 2024-09-13T21:34:31.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:31 smithi116 ceph-mon[33391]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:31.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:31 smithi116 ceph-mon[33391]: from='osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T21:34:31.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:31.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:31.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:31 smithi088 ceph-mon[27963]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:31.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:31 smithi088 ceph-mon[27963]: from='osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T21:34:31.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:31.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:31.739 DEBUG:teuthology.orchestra.run.smithi088:osd.0> sudo journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T21:34:31.742 INFO:tasks.cephadm:Deploying osd.1 on smithi088 with /dev/vg_nvme/lv_3... 2024-09-13T21:34:31.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T21:34:32.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:32 smithi116 ceph-mon[33391]: from='osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T21:34:32.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:32 smithi116 ceph-mon[33391]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T21:34:32.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:32 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:32.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:32 smithi116 ceph-mon[33391]: from='osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:34:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:32 smithi088 ceph-mon[27963]: from='osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T21:34:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:32 smithi088 ceph-mon[27963]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T21:34:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:32 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:32 smithi088 ceph-mon[27963]: from='osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:34:32.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:34:32 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[42819]: 2024-09-13T21:34:32.095+0000 7fe37d34d700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T21:34:32.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:34:32 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[42819]: 2024-09-13T21:34:32.099+0000 7fe37693d700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:34:32.523 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:34:33.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:33 smithi088 ceph-mon[27963]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:33.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:33 smithi088 ceph-mon[27963]: from='osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-13T21:34:33.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:33 smithi088 ceph-mon[27963]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T21:34:33.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:33 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:33.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:33 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:33 smithi116 ceph-mon[33391]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:33 smithi116 ceph-mon[33391]: from='osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-13T21:34:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:33 smithi116 ceph-mon[33391]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T21:34:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:33 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:33.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:33 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:34.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:34 smithi088 ceph-mon[27963]: purged_snaps scrub starts 2024-09-13T21:34:34.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:34 smithi088 ceph-mon[27963]: purged_snaps scrub ok 2024-09-13T21:34:34.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:34.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:34 smithi088 ceph-mon[27963]: osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] boot 2024-09-13T21:34:34.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:34 smithi088 ceph-mon[27963]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T21:34:34.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:34.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:34.363 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:34.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:34 smithi116 ceph-mon[33391]: purged_snaps scrub starts 2024-09-13T21:34:34.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:34 smithi116 ceph-mon[33391]: purged_snaps scrub ok 2024-09-13T21:34:34.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:34.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:34 smithi116 ceph-mon[33391]: osd.0 [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] boot 2024-09-13T21:34:34.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:34 smithi116 ceph-mon[33391]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T21:34:34.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:34:34.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:34.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:35 smithi088 ceph-mon[27963]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:35 smithi088 ceph-mon[27963]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T21:34:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:35 smithi116 ceph-mon[33391]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:34:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:35 smithi116 ceph-mon[33391]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T21:34:36.638 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:34:36.661 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_3 2024-09-13T21:34:36.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:36 smithi088 ceph-mon[27963]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:37.225 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:34:37.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:36 smithi116 ceph-mon[33391]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:39.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:39 smithi088 ceph-mon[27963]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:39.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:39.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:39.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:34:39.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:39.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:39.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:34:39.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:39.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:34:39.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:39 smithi116 ceph-mon[33391]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:39.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:39.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:39.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:34:39.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:39.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:39.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:34:39.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:39.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:34:39.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.537+0000 7f8ca7624700 1 -- 172.21.15.88:0/767802042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca00ff130 msgr2=0x7f8ca00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:34:39.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.537+0000 7f8ca7624700 1 --2- 172.21.15.88:0/767802042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca00ff130 0x7f8ca00ff540 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009910 tx=0x7f8c9c009c20 comp rx=0 tx=0).stop 2024-09-13T21:34:39.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.537+0000 7f8ca7624700 1 -- 172.21.15.88:0/767802042 shutdown_connections 2024-09-13T21:34:39.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.537+0000 7f8ca7624700 1 --2- 172.21.15.88:0/767802042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ca01003d0 0x7f8ca0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:39.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.537+0000 7f8ca7624700 1 --2- 172.21.15.88:0/767802042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca00ff130 0x7f8ca00ff540 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:39.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.537+0000 7f8ca7624700 1 -- 172.21.15.88:0/767802042 >> 172.21.15.88:0/767802042 conn(0x7f8ca00fa780 msgr2=0x7f8ca00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:34:39.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.537+0000 7f8ca7624700 1 -- 172.21.15.88:0/767802042 shutdown_connections 2024-09-13T21:34:39.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.537+0000 7f8ca7624700 1 -- 172.21.15.88:0/767802042 wait complete. 2024-09-13T21:34:39.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca7624700 1 Processor -- start 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca7624700 1 -- start start 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca7624700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ca00ff130 0x7f8ca0069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca7624700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca01003d0 0x7f8ca019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca7624700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca019ae20 con 0x7f8ca01003d0 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca7624700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca019af60 con 0x7f8ca00ff130 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca4bbf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca01003d0 0x7f8ca019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca4bbf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca01003d0 0x7f8ca019a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54356/0 (socket says 172.21.15.88:54356) 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca4bbf700 1 -- 172.21.15.88:0/81984873 learned_addr learned my addr 172.21.15.88:0/81984873 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca53c0700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ca00ff130 0x7f8ca0069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca4bbf700 1 -- 172.21.15.88:0/81984873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ca00ff130 msgr2=0x7f8ca0069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca4bbf700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ca00ff130 0x7f8ca0069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.538+0000 7f8ca4bbf700 1 -- 172.21.15.88:0/81984873 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0095f0 con 0x7f8ca01003d0 2024-09-13T21:34:39.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.539+0000 7f8ca4bbf700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca01003d0 0x7f8ca019a800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000b4b0 tx=0x7f8c9000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:34:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.539+0000 7f8c967fc700 1 -- 172.21.15.88:0/81984873 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c90011800 con 0x7f8ca01003d0 2024-09-13T21:34:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.539+0000 7f8c967fc700 1 -- 172.21.15.88:0/81984873 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c90011e10 con 0x7f8ca01003d0 2024-09-13T21:34:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.539+0000 7f8c967fc700 1 -- 172.21.15.88:0/81984873 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9000f2e0 con 0x7f8ca01003d0 2024-09-13T21:34:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.539+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca019b240 con 0x7f8ca01003d0 2024-09-13T21:34:39.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.539+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca019b790 con 0x7f8ca01003d0 2024-09-13T21:34:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.540+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca0107c90 con 0x7f8ca01003d0 2024-09-13T21:34:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.540+0000 7f8c967fc700 1 -- 172.21.15.88:0/81984873 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f8c90010380 con 0x7f8ca01003d0 2024-09-13T21:34:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.541+0000 7f8c967fc700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8c8c06c600 0x7f8c8c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:34:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.541+0000 7f8ca53c0700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8c8c06c600 0x7f8c8c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:34:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.541+0000 7f8c967fc700 1 -- 172.21.15.88:0/81984873 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1810+0+0 (secure 0 0 0) 0x7f8c9008a3e0 con 0x7f8ca01003d0 2024-09-13T21:34:39.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.541+0000 7f8ca53c0700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8c8c06c600 0x7f8c8c06eab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c006010 tx=0x7f8c9c00b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:34:39.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.546+0000 7f8c967fc700 1 -- 172.21.15.88:0/81984873 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8c900594f0 con 0x7f8ca01003d0 2024-09-13T21:34:39.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:39.747+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ca0104d20 con 0x7f8c8c06c600 2024-09-13T21:34:40.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:40 smithi116 ceph-mon[33391]: Detected new or changed devices on smithi088 2024-09-13T21:34:40.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:40 smithi116 ceph-mon[33391]: Adjusting osd_memory_target on smithi088 to 11840M 2024-09-13T21:34:40.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:34:40.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:34:40.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:40.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:34:40.402 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:40 smithi088 ceph-mon[27963]: Detected new or changed devices on smithi088 2024-09-13T21:34:40.403 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:40 smithi088 ceph-mon[27963]: Adjusting osd_memory_target on smithi088 to 11840M 2024-09-13T21:34:40.403 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:34:40.403 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:34:40.403 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:40.403 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:34:41.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:41 smithi088 ceph-mon[27963]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:34:41.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:41 smithi088 ceph-mon[27963]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:41.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:41 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:41.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:41 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:41 smithi116 ceph-mon[33391]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:34:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:41 smithi116 ceph-mon[33391]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:41 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:41 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:43.412 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:43 smithi088 ceph-mon[27963]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:43 smithi116 ceph-mon[33391]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:44.437 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:44 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2533333794' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8aa036b6-0acd-400a-88d2-13989c325da7"}]: dispatch 2024-09-13T21:34:44.437 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:44 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2533333794' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8aa036b6-0acd-400a-88d2-13989c325da7"}]': finished 2024-09-13T21:34:44.437 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:44 smithi088 ceph-mon[27963]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T21:34:44.437 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:44 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:34:44.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:44 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2533333794' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8aa036b6-0acd-400a-88d2-13989c325da7"}]: dispatch 2024-09-13T21:34:44.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:44 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2533333794' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8aa036b6-0acd-400a-88d2-13989c325da7"}]': finished 2024-09-13T21:34:44.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:44 smithi116 ceph-mon[33391]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T21:34:44.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:44 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:34:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:45 smithi088 ceph-mon[27963]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:45 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2733924709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:34:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:34:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:45.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:45 smithi116 ceph-mon[33391]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:45.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:45 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2733924709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:34:45.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:45.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:45.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:45.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:34:45.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:47.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:46 smithi116 ceph-mon[33391]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:47.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:46 smithi088 ceph-mon[27963]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:49.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:49 smithi116 ceph-mon[33391]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:49.401 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:49 smithi088 ceph-mon[27963]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:51.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:51 smithi116 ceph-mon[33391]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:51.402 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:51 smithi088 ceph-mon[27963]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:52.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:52 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:34:52.135 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:52 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:52.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:52 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:34:52.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:52 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:34:53.403 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:53 smithi088 ceph-mon[27963]: Deploying daemon osd.1 on smithi088 2024-09-13T21:34:53.403 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:53 smithi088 ceph-mon[27963]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:53 smithi116 ceph-mon[33391]: Deploying daemon osd.1 on smithi088 2024-09-13T21:34:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:53 smithi116 ceph-mon[33391]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:55 smithi088 ceph-mon[27963]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:55 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:34:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:55 smithi116 ceph-mon[33391]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:55 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:34:57.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:56 smithi116 ceph-mon[33391]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:57.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:56 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:57.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:56 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:57.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:56 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:34:57.203 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:56 smithi088 ceph-mon[27963]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:57.204 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:56 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:57.204 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:56 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:57.204 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:56 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:34:59.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:59 smithi116 ceph-mon[33391]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:59.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:59.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:34:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:59 smithi088 ceph-mon[27963]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:34:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:34:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:34:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.653+0000 7f8c967fc700 1 -- 172.21.15.88:0/81984873 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8ca0104d20 con 0x7f8c8c06c600 2024-09-13T21:34:59.656 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 1 on host 'smithi088' 2024-09-13T21:34:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.655+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8c8c06c600 msgr2=0x7f8c8c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:34:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.655+0000 7f8ca7624700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8c8c06c600 0x7f8c8c06eab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c006010 tx=0x7f8c9c00b540 comp rx=0 tx=0).stop 2024-09-13T21:34:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.656+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca01003d0 msgr2=0x7f8ca019a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:34:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.656+0000 7f8ca7624700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca01003d0 0x7f8ca019a800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000b4b0 tx=0x7f8c9000b7c0 comp rx=0 tx=0).stop 2024-09-13T21:34:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.656+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 shutdown_connections 2024-09-13T21:34:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.656+0000 7f8ca7624700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8c8c06c600 0x7f8c8c06eab0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.656+0000 7f8ca7624700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ca00ff130 0x7f8ca0069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.656+0000 7f8ca7624700 1 --2- 172.21.15.88:0/81984873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca01003d0 0x7f8ca019a800 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:34:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.656+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 >> 172.21.15.88:0/81984873 conn(0x7f8ca00fa780 msgr2=0x7f8ca0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:34:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.656+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 shutdown_connections 2024-09-13T21:34:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:34:59.656+0000 7f8ca7624700 1 -- 172.21.15.88:0/81984873 wait complete. 2024-09-13T21:35:00.635 DEBUG:teuthology.orchestra.run.smithi088:osd.1> sudo journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T21:35:00.638 INFO:tasks.cephadm:Deploying osd.2 on smithi088 with /dev/vg_nvme/lv_2... 2024-09-13T21:35:00.638 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T21:35:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:00 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:00 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:00 smithi088 ceph-mon[27963]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:35:00.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:00 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[48360]: 2024-09-13T21:35:00.668+0000 7f4766118640 -1 osd.1 0 log_to_monitors true 2024-09-13T21:35:01.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:00 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:01.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:00 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:01.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:00 smithi116 ceph-mon[33391]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:35:01.542 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:35:01.968 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:01 smithi088 ceph-mon[27963]: from='osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T21:35:02.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:01 smithi116 ceph-mon[33391]: from='osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T21:35:02.941 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:02 smithi088 ceph-mon[27963]: from='osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T21:35:02.942 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:02 smithi088 ceph-mon[27963]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T21:35:02.942 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:02 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:35:02.942 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:02 smithi088 ceph-mon[27963]: from='osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:35:02.942 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:02 smithi088 ceph-mon[27963]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:35:02.942 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:02 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[48360]: 2024-09-13T21:35:02.659+0000 7f475af8e700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T21:35:02.942 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:02 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[48360]: 2024-09-13T21:35:02.663+0000 7f4754d7f700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:35:03.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:02 smithi116 ceph-mon[33391]: from='osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T21:35:03.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:02 smithi116 ceph-mon[33391]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T21:35:03.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:02 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:35:03.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:02 smithi116 ceph-mon[33391]: from='osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:35:03.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:02 smithi116 ceph-mon[33391]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:35:03.849 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:03 smithi088 ceph-mon[27963]: from='osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-13T21:35:03.849 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:03 smithi088 ceph-mon[27963]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T21:35:03.849 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:35:03.850 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:35:04.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:03 smithi116 ceph-mon[33391]: from='osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-13T21:35:04.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:03 smithi116 ceph-mon[33391]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T21:35:04.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:35:04.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:35:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:04 smithi088 ceph-mon[27963]: purged_snaps scrub starts 2024-09-13T21:35:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:04 smithi088 ceph-mon[27963]: purged_snaps scrub ok 2024-09-13T21:35:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:04 smithi088 ceph-mon[27963]: osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] boot 2024-09-13T21:35:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:04 smithi088 ceph-mon[27963]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T21:35:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:04 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:35:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:04 smithi088 ceph-mon[27963]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:35:05.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:04 smithi116 ceph-mon[33391]: purged_snaps scrub starts 2024-09-13T21:35:05.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:04 smithi116 ceph-mon[33391]: purged_snaps scrub ok 2024-09-13T21:35:05.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:04 smithi116 ceph-mon[33391]: osd.1 [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] boot 2024-09-13T21:35:05.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:04 smithi116 ceph-mon[33391]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T21:35:05.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:04 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:35:05.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:04 smithi116 ceph-mon[33391]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:35:05.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:35:05.310 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_2 2024-09-13T21:35:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:35:05.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:05 smithi088 ceph-mon[27963]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T21:35:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:05 smithi116 ceph-mon[33391]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T21:35:06.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:06 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:06.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:06 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:06.975 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:06 smithi088 ceph-mon[27963]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:06 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:06 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:06 smithi116 ceph-mon[33391]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.211+0000 7fef28f0f700 1 -- 172.21.15.88:0/3836095000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 msgr2=0x7fef24100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.211+0000 7fef28f0f700 1 --2- 172.21.15.88:0/3836095000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 0x7fef24100650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fef14009910 tx=0x7fef14009c20 comp rx=0 tx=0).stop 2024-09-13T21:35:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.211+0000 7fef28f0f700 1 -- 172.21.15.88:0/3836095000 shutdown_connections 2024-09-13T21:35:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.211+0000 7fef28f0f700 1 --2- 172.21.15.88:0/3836095000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef24101440 0x7fef24101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.211+0000 7fef28f0f700 1 --2- 172.21.15.88:0/3836095000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 0x7fef24100650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.211+0000 7fef28f0f700 1 -- 172.21.15.88:0/3836095000 >> 172.21.15.88:0/3836095000 conn(0x7fef240fb7f0 msgr2=0x7fef240fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.211+0000 7fef28f0f700 1 -- 172.21.15.88:0/3836095000 shutdown_connections 2024-09-13T21:35:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.211+0000 7fef28f0f700 1 -- 172.21.15.88:0/3836095000 wait complete. 2024-09-13T21:35:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.212+0000 7fef28f0f700 1 Processor -- start 2024-09-13T21:35:07.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.212+0000 7fef28f0f700 1 -- start start 2024-09-13T21:35:07.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.212+0000 7fef28f0f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 0x7fef24197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:07.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.212+0000 7fef28f0f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef24101440 0x7fef24198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:07.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.212+0000 7fef28f0f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24198850 con 0x7fef24100240 2024-09-13T21:35:07.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.212+0000 7fef28f0f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2419d260 con 0x7fef24101440 2024-09-13T21:35:07.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.212+0000 7fef2259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 0x7fef24197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:07.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.212+0000 7fef2259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 0x7fef24197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57656/0 (socket says 172.21.15.88:57656) 2024-09-13T21:35:07.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef2259c700 1 -- 172.21.15.88:0/3056587997 learned_addr learned my addr 172.21.15.88:0/3056587997 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:35:07.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef21d9b700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef24101440 0x7fef24198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:07.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef2259c700 1 -- 172.21.15.88:0/3056587997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef24101440 msgr2=0x7fef24198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:07.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef2259c700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef24101440 0x7fef24198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:07.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef2259c700 1 -- 172.21.15.88:0/3056587997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef140095f0 con 0x7fef24100240 2024-09-13T21:35:07.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef2259c700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 0x7fef24197cf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fef1400bda0 tx=0x7fef1400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:07.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef137fe700 1 -- 172.21.15.88:0/3056587997 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef1401d070 con 0x7fef24100240 2024-09-13T21:35:07.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef137fe700 1 -- 172.21.15.88:0/3056587997 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fef1400f460 con 0x7fef24100240 2024-09-13T21:35:07.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef137fe700 1 -- 172.21.15.88:0/3056587997 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef14021640 con 0x7fef24100240 2024-09-13T21:35:07.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2419d400 con 0x7fef24100240 2024-09-13T21:35:07.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.213+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2419d8c0 con 0x7fef24100240 2024-09-13T21:35:07.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.214+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef24105520 con 0x7fef24100240 2024-09-13T21:35:07.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.215+0000 7fef137fe700 1 -- 172.21.15.88:0/3056587997 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fef1400f5d0 con 0x7fef24100240 2024-09-13T21:35:07.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.215+0000 7fef137fe700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fef0c06c600 0x7fef0c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:07.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.216+0000 7fef137fe700 1 -- 172.21.15.88:0/3056587997 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2242+0+0 (secure 0 0 0) 0x7fef1408bd40 con 0x7fef24100240 2024-09-13T21:35:07.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.216+0000 7fef21d9b700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fef0c06c600 0x7fef0c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:07.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.216+0000 7fef21d9b700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fef0c06c600 0x7fef0c06eab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fef18005950 tx=0x7fef1800b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:07.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.220+0000 7fef137fe700 1 -- 172.21.15.88:0/3056587997 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fef14057210 con 0x7fef24100240 2024-09-13T21:35:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:07.440+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fef24061190 con 0x7fef0c06c600 2024-09-13T21:35:07.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:07 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:35:07.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:07 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:35:07.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:07 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:08.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:07 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:35:08.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:07 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:35:08.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:07 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:09.082 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:08 smithi088 ceph-mon[27963]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:35:09.082 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:08 smithi088 ceph-mon[27963]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:08 smithi116 ceph-mon[33391]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:35:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:08 smithi116 ceph-mon[33391]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:10.417 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:35:10.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:35:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:11.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:11.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:11.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:11 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:11.489 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:11 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:12.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:12 smithi088 ceph-mon[27963]: Detected new or changed devices on smithi088 2024-09-13T21:35:12.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:12 smithi088 ceph-mon[27963]: Adjusting osd_memory_target on smithi088 to 5920M 2024-09-13T21:35:12.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:12 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3962638887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "014e6ebe-af5c-462b-9024-9824b6f2fad7"}]: dispatch 2024-09-13T21:35:12.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:12 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3962638887' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "014e6ebe-af5c-462b-9024-9824b6f2fad7"}]': finished 2024-09-13T21:35:12.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:12 smithi088 ceph-mon[27963]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T21:35:12.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:12 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:12.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:12 smithi116 ceph-mon[33391]: Detected new or changed devices on smithi088 2024-09-13T21:35:12.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:12 smithi116 ceph-mon[33391]: Adjusting osd_memory_target on smithi088 to 5920M 2024-09-13T21:35:12.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:12 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3962638887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "014e6ebe-af5c-462b-9024-9824b6f2fad7"}]: dispatch 2024-09-13T21:35:12.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:12 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3962638887' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "014e6ebe-af5c-462b-9024-9824b6f2fad7"}]': finished 2024-09-13T21:35:12.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:12 smithi116 ceph-mon[33391]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T21:35:12.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:12 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:13.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:13 smithi088 ceph-mon[27963]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:13.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:13 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2783906699' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:35:13.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:13 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:13.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:13 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:13 smithi116 ceph-mon[33391]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:13 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2783906699' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:35:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:13 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:13 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:15.397 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:15 smithi116 ceph-mon[33391]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:15 smithi088 ceph-mon[27963]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:16.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:16.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:16.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:16.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:16.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:16.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:16.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:16.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:17.519 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:17 smithi088 ceph-mon[27963]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:17 smithi116 ceph-mon[33391]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:19 smithi116 ceph-mon[33391]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:19 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:35:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:19 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:19.628 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:19 smithi088 ceph-mon[27963]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:19.628 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:19 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:35:19.628 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:19 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:20.559 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:20 smithi088 ceph-mon[27963]: Deploying daemon osd.2 on smithi088 2024-09-13T21:35:20.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:20 smithi116 ceph-mon[33391]: Deploying daemon osd.2 on smithi088 2024-09-13T21:35:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:21 smithi116 ceph-mon[33391]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:21.605 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:21 smithi088 ceph-mon[27963]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:23.479 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:23 smithi088 ceph-mon[27963]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:23.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:23 smithi116 ceph-mon[33391]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:25.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:25.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:25.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:25 smithi088 ceph-mon[27963]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:25.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:25.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:25.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:25.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:25 smithi116 ceph-mon[33391]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:25.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:26.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:35:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:35:27.183 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:27 smithi088 ceph-mon[27963]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:27 smithi116 ceph-mon[33391]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:27.501 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 2 on host 'smithi088' 2024-09-13T21:35:27.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.498+0000 7fef137fe700 1 -- 172.21.15.88:0/3056587997 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fef24061190 con 0x7fef0c06c600 2024-09-13T21:35:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fef0c06c600 msgr2=0x7fef0c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fef0c06c600 0x7fef0c06eab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fef18005950 tx=0x7fef1800b410 comp rx=0 tx=0).stop 2024-09-13T21:35:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 msgr2=0x7fef24197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 0x7fef24197cf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fef1400bda0 tx=0x7fef1400bdd0 comp rx=0 tx=0).stop 2024-09-13T21:35:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 shutdown_connections 2024-09-13T21:35:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fef0c06c600 0x7fef0c06eab0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef24100240 0x7fef24197cf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 --2- 172.21.15.88:0/3056587997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fef24101440 0x7fef24198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 >> 172.21.15.88:0/3056587997 conn(0x7fef240fb7f0 msgr2=0x7fef24102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 shutdown_connections 2024-09-13T21:35:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:35:27.500+0000 7fef28f0f700 1 -- 172.21.15.88:0/3056587997 wait complete. 2024-09-13T21:35:28.225 DEBUG:teuthology.orchestra.run.smithi088:osd.2> sudo journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T21:35:28.228 INFO:tasks.cephadm:Deploying osd.3 on smithi116 with /dev/vg_nvme/lv_4... 2024-09-13T21:35:28.228 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T21:35:28.437 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi116/config 2024-09-13T21:35:28.558 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:28 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:28.559 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:28 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:28.559 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:28 smithi116 ceph-mon[33391]: from='osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T21:35:28.559 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:28 smithi116 ceph-mon[33391]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:28.942 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:28 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:28.942 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:28 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:28.942 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:28 smithi088 ceph-mon[27963]: from='osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T21:35:28.942 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:28 smithi088 ceph-mon[27963]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:29.792 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:29 smithi116 ceph-mon[33391]: from='osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T21:35:29.793 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:29 smithi116 ceph-mon[33391]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T21:35:29.793 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:29 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:29.793 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:29 smithi116 ceph-mon[33391]: from='osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:35:29.835 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:29 smithi088 ceph-mon[27963]: from='osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T21:35:29.835 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:29 smithi088 ceph-mon[27963]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T21:35:29.835 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:29 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:29.836 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:29 smithi088 ceph-mon[27963]: from='osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:35:29.836 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:29 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[53739]: 2024-09-13T21:35:29.495+0000 7f89a4f9e700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T21:35:29.836 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:29 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[53739]: 2024-09-13T21:35:29.500+0000 7f899d58c700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:35:30.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:30 smithi088 ceph-mon[27963]: from='osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-13T21:35:30.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:30 smithi088 ceph-mon[27963]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T21:35:30.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:30 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:30.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:30 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:30.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:30 smithi088 ceph-mon[27963]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:30.802 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:30 smithi116 ceph-mon[33391]: from='osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-13T21:35:30.802 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:30 smithi116 ceph-mon[33391]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T21:35:30.802 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:30 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:30.802 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:30 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:30.802 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:30 smithi116 ceph-mon[33391]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T21:35:31.138 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:35:31.157 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_4 2024-09-13T21:35:31.360 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi116/config 2024-09-13T21:35:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:31 smithi088 ceph-mon[27963]: purged_snaps scrub starts 2024-09-13T21:35:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:31 smithi088 ceph-mon[27963]: purged_snaps scrub ok 2024-09-13T21:35:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:31 smithi088 ceph-mon[27963]: osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] boot 2024-09-13T21:35:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:31 smithi088 ceph-mon[27963]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T21:35:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:31.805 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:31 smithi116 ceph-mon[33391]: purged_snaps scrub starts 2024-09-13T21:35:31.805 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:31 smithi116 ceph-mon[33391]: purged_snaps scrub ok 2024-09-13T21:35:31.805 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:31.805 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:31 smithi116 ceph-mon[33391]: osd.2 [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] boot 2024-09-13T21:35:31.805 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:31 smithi116 ceph-mon[33391]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T21:35:31.805 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:35:31.805 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:31.806 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:32.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.942+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3412835290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 msgr2=0x7fd4d00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:32.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.942+0000 7fd4d5a06700 1 --2- 172.21.15.116:0/3412835290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 0x7fd4d00ff540 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009910 tx=0x7fd4b8009c20 comp rx=0 tx=0).stop 2024-09-13T21:35:32.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.942+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3412835290 shutdown_connections 2024-09-13T21:35:32.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.942+0000 7fd4d5a06700 1 --2- 172.21.15.116:0/3412835290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4d01003d0 0x7fd4d0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:32.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.942+0000 7fd4d5a06700 1 --2- 172.21.15.116:0/3412835290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 0x7fd4d00ff540 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.942+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3412835290 >> 172.21.15.116:0/3412835290 conn(0x7fd4d00fa780 msgr2=0x7fd4d00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.942+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3412835290 shutdown_connections 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.942+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3412835290 wait complete. 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.942+0000 7fd4d5a06700 1 Processor -- start 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4d5a06700 1 -- start start 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4d5a06700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 0x7fd4d0103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4d5a06700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4d01003d0 0x7fd4d01017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4d5a06700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d0101cf0 con 0x7fd4d01003d0 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4d5a06700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d0101e30 con 0x7fd4d00ff130 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4ceffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 0x7fd4d0103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4ceffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 0x7fd4d0103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34416/0 (socket says 172.21.15.116:34416) 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4ceffd700 1 -- 172.21.15.116:0/3149690076 learned_addr learned my addr 172.21.15.116:0/3149690076 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:35:32.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4ce7fc700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4d01003d0 0x7fd4d01017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:32.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4ceffd700 1 -- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4d01003d0 msgr2=0x7fd4d01017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:32.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4ceffd700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4d01003d0 0x7fd4d01017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:32.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4ceffd700 1 -- 172.21.15.116:0/3149690076 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b80095f0 con 0x7fd4d00ff130 2024-09-13T21:35:32.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4ceffd700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 0x7fd4d0103160 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800bd70 tx=0x7fd4b800bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:32.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.943+0000 7fd4d4a04700 1 -- 172.21.15.116:0/3149690076 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b801d070 con 0x7fd4d00ff130 2024-09-13T21:35:32.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.944+0000 7fd4d4a04700 1 -- 172.21.15.116:0/3149690076 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4b8005dc0 con 0x7fd4d00ff130 2024-09-13T21:35:32.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.944+0000 7fd4d4a04700 1 -- 172.21.15.116:0/3149690076 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b8021410 con 0x7fd4d00ff130 2024-09-13T21:35:32.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.944+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d01020b0 con 0x7fd4d00ff130 2024-09-13T21:35:32.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.944+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d01025a0 con 0x7fd4d00ff130 2024-09-13T21:35:32.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.944+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d0107c10 con 0x7fd4d00ff130 2024-09-13T21:35:32.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.945+0000 7fd4d4a04700 1 -- 172.21.15.116:0/3149690076 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fd4b800f7d0 con 0x7fd4d00ff130 2024-09-13T21:35:32.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.945+0000 7fd4d4a04700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd4bc06c600 0x7fd4bc06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:32.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.945+0000 7fd4d4a04700 1 -- 172.21.15.116:0/3149690076 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3049+0+0 (secure 0 0 0) 0x7fd4b808c020 con 0x7fd4d00ff130 2024-09-13T21:35:32.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.946+0000 7fd4ce7fc700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd4bc06c600 0x7fd4bc06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:32.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.946+0000 7fd4ce7fc700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd4bc06c600 0x7fd4bc06eab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005950 tx=0x7fd4c000b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:32.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:32.950+0000 7fd4d4a04700 1 -- 172.21.15.116:0/3149690076 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd4b805abe0 con 0x7fd4d00ff130 2024-09-13T21:35:32.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:32 smithi088 ceph-mon[27963]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T21:35:32.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:32 smithi088 ceph-mon[27963]: pgmap v79: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:32.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:32 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T21:35:33.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:32 smithi116 ceph-mon[33391]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T21:35:33.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:32 smithi116 ceph-mon[33391]: pgmap v79: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:33.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:32 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T21:35:33.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:33.147+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4d0068c50 con 0x7fd4bc06c600 2024-09-13T21:35:33.900 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:33 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T21:35:33.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:33 smithi088 ceph-mon[27963]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T21:35:33.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:33 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T21:35:33.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:33 smithi088 ceph-mon[27963]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:35:33.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:33 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:35:33.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:33 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:35:33.901 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:33 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:34.245 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:33 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T21:35:34.245 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:33 smithi116 ceph-mon[33391]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T21:35:34.245 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:33 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T21:35:34.245 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:33 smithi116 ceph-mon[33391]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:35:34.245 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:33 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:35:34.245 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:33 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:35:34.245 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:33 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:34.815 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:35:34 smithi088 sudo[56123]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:35:34.815 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:35:34 smithi088 sudo[56123]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:34.815 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:35:34 smithi088 sudo[56123]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:34.815 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:35:34 smithi088 sudo[56123]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:35.039 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: Detected new or changed devices on smithi088 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: Adjusting osd_memory_target on smithi088 to 3946M 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:35.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:35.041 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:34 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.091 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:35:34 smithi088 sudo[56144]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:35:35.091 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:35:34 smithi088 sudo[56144]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:35.091 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:35:34 smithi088 sudo[56144]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:35.091 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:35:34 smithi088 sudo[56144]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: Detected new or changed devices on smithi088 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: Adjusting osd_memory_target on smithi088 to 3946M 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:35.092 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:35.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:35.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:34 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:35.363 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56161]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:35:35.364 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:35.364 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56161]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:35.364 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56161]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:35.619 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56223]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:35:35.619 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56223]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:35.620 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56223]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:35.620 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56223]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:35.881 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56276]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:35:35.881 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56276]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:35.881 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56276]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:35.881 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56276]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:36.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56293]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:35:36.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:36.138 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56293]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:36.139 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:35:35 smithi088 sudo[56293]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:36.399 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 sudo[56333]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:35:36.399 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 sudo[56333]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:36.399 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 sudo[56333]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:36.399 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 sudo[56333]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:36.724 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 ceph-mon[33391]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T21:35:36.724 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 ceph-mon[33391]: from='client.? 172.21.15.116:0/1373794264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76489d88-1fe1-4d01-b7f0-3056a95af473"}]: dispatch 2024-09-13T21:35:36.724 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 ceph-mon[33391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76489d88-1fe1-4d01-b7f0-3056a95af473"}]: dispatch 2024-09-13T21:35:36.724 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 ceph-mon[33391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76489d88-1fe1-4d01-b7f0-3056a95af473"}]': finished 2024-09-13T21:35:36.724 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 ceph-mon[33391]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T21:35:36.724 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:36.724 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 ceph-mon[33391]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 sudo[56368]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 sudo[56368]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 sudo[56368]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 sudo[56368]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 ceph-mon[27963]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/1373794264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76489d88-1fe1-4d01-b7f0-3056a95af473"}]: dispatch 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 ceph-mon[27963]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76489d88-1fe1-4d01-b7f0-3056a95af473"}]: dispatch 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 ceph-mon[27963]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76489d88-1fe1-4d01-b7f0-3056a95af473"}]': finished 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 ceph-mon[27963]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:36 smithi088 ceph-mon[27963]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T21:35:36.987 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 sudo[37423]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:35:36.987 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 sudo[37423]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:36.987 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 sudo[37423]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:36.987 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 sudo[37423]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:36.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:36.996+0000 7fd4d4a04700 1 -- 172.21.15.116:0/3149690076 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd4b8057520 con 0x7fd4d00ff130 2024-09-13T21:35:37.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 sudo[37427]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:35:37.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 sudo[37427]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:35:37.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 sudo[37427]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T21:35:37.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:36 smithi116 sudo[37427]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:35:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: pgmap v85: 1 pgs: 1 active+clean; 449 KiB data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/263560286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:35:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T21:35:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:35:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:35:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T21:35:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:35:37.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:35:37.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T21:35:37.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: mgrmap e19: smithi088.scyrwy(active, since 2m), standbys: smithi116.bqnvtn 2024-09-13T21:35:37.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:37 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:37.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: pgmap v85: 1 pgs: 1 active+clean; 449 KiB data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:37.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: from='client.? 172.21.15.116:0/263560286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:35:37.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T21:35:37.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:35:37.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:35:37.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T21:35:37.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:35:37.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:35:37.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T21:35:37.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: mgrmap e19: smithi088.scyrwy(active, since 2m), standbys: smithi116.bqnvtn 2024-09-13T21:35:37.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:37 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:39.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:39 smithi088 ceph-mon[27963]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:39.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:39.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:39.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:39.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:39.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:39 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:39.777 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:39 smithi116 ceph-mon[33391]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:39.777 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:39.777 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:39.777 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:39.777 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:39.777 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:39 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:40.705 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:35:40.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:35:41.584 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:41 smithi116 ceph-mon[33391]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 257 KiB/s wr, 17 op/s 2024-09-13T21:35:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:41 smithi088 ceph-mon[27963]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 257 KiB/s wr, 17 op/s 2024-09-13T21:35:42.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:42 smithi116 ceph-mon[33391]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 184 KiB/s wr, 12 op/s 2024-09-13T21:35:42.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:42 smithi088 ceph-mon[27963]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 184 KiB/s wr, 12 op/s 2024-09-13T21:35:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:43 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:35:43.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:43 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:43.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:43 smithi116 ceph-mon[33391]: Deploying daemon osd.3 on smithi116 2024-09-13T21:35:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:43 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:35:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:43 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:43 smithi088 ceph-mon[27963]: Deploying daemon osd.3 on smithi116 2024-09-13T21:35:44.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:44 smithi116 ceph-mon[33391]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 144 KiB/s wr, 9 op/s 2024-09-13T21:35:44.695 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:44 smithi088 ceph-mon[27963]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 144 KiB/s wr, 9 op/s 2024-09-13T21:35:47.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:46 smithi088 ceph-mon[27963]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 125 KiB/s wr, 8 op/s 2024-09-13T21:35:47.310 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:46 smithi116 ceph-mon[33391]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 125 KiB/s wr, 8 op/s 2024-09-13T21:35:49.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:49 smithi116 ceph-mon[33391]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-13T21:35:49.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:49 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:49.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:49 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:49.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:49 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:49 smithi088 ceph-mon[27963]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-13T21:35:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:49 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:49 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:49 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:51.488 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:51 smithi116 ceph-mon[33391]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-13T21:35:51.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.559+0000 7fd4d4a04700 1 -- 172.21.15.116:0/3149690076 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd4d0068c50 con 0x7fd4bc06c600 2024-09-13T21:35:51.562 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 3 on host 'smithi116' 2024-09-13T21:35:51.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.561+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd4bc06c600 msgr2=0x7fd4bc06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:51.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.561+0000 7fd4d5a06700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd4bc06c600 0x7fd4bc06eab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005950 tx=0x7fd4c000b410 comp rx=0 tx=0).stop 2024-09-13T21:35:51.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.561+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 msgr2=0x7fd4d0103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:51.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.561+0000 7fd4d5a06700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 0x7fd4d0103160 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800bd70 tx=0x7fd4b800bda0 comp rx=0 tx=0).stop 2024-09-13T21:35:51.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.562+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 shutdown_connections 2024-09-13T21:35:51.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.562+0000 7fd4d5a06700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd4bc06c600 0x7fd4bc06eab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:51.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.562+0000 7fd4d5a06700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4d00ff130 0x7fd4d0103160 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:51.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.562+0000 7fd4d5a06700 1 --2- 172.21.15.116:0/3149690076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4d01003d0 0x7fd4d01017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:51.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.562+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 >> 172.21.15.116:0/3149690076 conn(0x7fd4d00fa780 msgr2=0x7fd4d0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:51.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.562+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 shutdown_connections 2024-09-13T21:35:51.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:51.562+0000 7fd4d5a06700 1 -- 172.21.15.116:0/3149690076 wait complete. 2024-09-13T21:35:51.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:51 smithi088 ceph-mon[27963]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-13T21:35:52.414 DEBUG:teuthology.orchestra.run.smithi116:osd.3> sudo journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T21:35:52.417 INFO:tasks.cephadm:Deploying osd.4 on smithi116 with /dev/vg_nvme/lv_3... 2024-09-13T21:35:52.417 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T21:35:52.711 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:52 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:52.711 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:52 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:52.711 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:52 smithi116 ceph-mon[33391]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:52.712 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:52 smithi116 ceph-mon[33391]: from='osd.3 [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:35:52.712 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:52 smithi116 ceph-mon[33391]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:35:52.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:52 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:52.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:52 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:52.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:52 smithi088 ceph-mon[27963]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:52.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:52 smithi088 ceph-mon[27963]: from='osd.3 [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:35:52.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:52 smithi088 ceph-mon[27963]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:35:53.003 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi116/config 2024-09-13T21:35:53.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:53 smithi116 ceph-mon[33391]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T21:35:53.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:53 smithi116 ceph-mon[33391]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T21:35:53.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:53 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:53.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:53 smithi116 ceph-mon[33391]: from='osd.3 [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:35:53.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:53 smithi116 ceph-mon[33391]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:35:53.847 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:35:53 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[39405]: 2024-09-13T21:35:53.535+0000 7f278330d700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T21:35:53.847 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:35:53 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[39405]: 2024-09-13T21:35:53.542+0000 7f277b8fb700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:35:53.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:53 smithi088 ceph-mon[27963]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T21:35:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:53 smithi088 ceph-mon[27963]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T21:35:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:53 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:53 smithi088 ceph-mon[27963]: from='osd.3 [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:35:53.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:53 smithi088 ceph-mon[27963]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:35:54.786 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T21:35:54.786 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T21:35:54.786 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:54.786 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:54.786 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:54.786 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:54.786 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:54.786 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: osd.3 [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] boot 2024-09-13T21:35:54.787 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T21:35:54.787 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:54 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: osd.3 [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] boot 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T21:35:54.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:54 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:35:56.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:55 smithi116 ceph-mon[33391]: purged_snaps scrub starts 2024-09-13T21:35:56.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:55 smithi116 ceph-mon[33391]: purged_snaps scrub ok 2024-09-13T21:35:56.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:55 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:35:56.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:55 smithi116 ceph-mon[33391]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T21:35:56.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:55 smithi088 ceph-mon[27963]: purged_snaps scrub starts 2024-09-13T21:35:56.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:55 smithi088 ceph-mon[27963]: purged_snaps scrub ok 2024-09-13T21:35:56.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:55 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:35:56.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:55 smithi088 ceph-mon[27963]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T21:35:56.410 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:35:56.434 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_3 2024-09-13T21:35:57.001 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi116/config 2024-09-13T21:35:57.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:56 smithi116 ceph-mon[33391]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:35:57.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:56 smithi116 ceph-mon[33391]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T21:35:57.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:56 smithi088 ceph-mon[27963]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:35:57.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:56 smithi088 ceph-mon[27963]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T21:35:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:58 smithi116 ceph-mon[33391]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T21:35:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:58 smithi116 ceph-mon[33391]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:35:58.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:58 smithi088 ceph-mon[27963]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T21:35:58.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:58 smithi088 ceph-mon[27963]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:35:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.209+0000 7fb52dcb9700 1 -- 172.21.15.116:0/1425604815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528100d40 msgr2=0x7fb528103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.209+0000 7fb52dcb9700 1 --2- 172.21.15.116:0/1425604815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528100d40 0x7fb528103120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb518009910 tx=0x7fb518009c20 comp rx=0 tx=0).stop 2024-09-13T21:35:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.210+0000 7fb52dcb9700 1 -- 172.21.15.116:0/1425604815 shutdown_connections 2024-09-13T21:35:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.210+0000 7fb52dcb9700 1 --2- 172.21.15.116:0/1425604815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb528103660 0x7fb528105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.210+0000 7fb52dcb9700 1 --2- 172.21.15.116:0/1425604815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528100d40 0x7fb528103120 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.210+0000 7fb52dcb9700 1 -- 172.21.15.116:0/1425604815 >> 172.21.15.116:0/1425604815 conn(0x7fb5280fa700 msgr2=0x7fb5280fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.210+0000 7fb52dcb9700 1 -- 172.21.15.116:0/1425604815 shutdown_connections 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.210+0000 7fb52dcb9700 1 -- 172.21.15.116:0/1425604815 wait complete. 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.210+0000 7fb52dcb9700 1 Processor -- start 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.210+0000 7fb52dcb9700 1 -- start start 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb52dcb9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb528100d40 0x7fb5281006a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb52dcb9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528103660 0x7fb5280fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb52dcb9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280ff230 con 0x7fb528100d40 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb52dcb9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280ff370 con 0x7fb528103660 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb526ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528103660 0x7fb5280fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb526ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528103660 0x7fb5280fecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:44810/0 (socket says 172.21.15.116:44810) 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb526ffd700 1 -- 172.21.15.116:0/106633502 learned_addr learned my addr 172.21.15.116:0/106633502 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:35:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb5277fe700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb528100d40 0x7fb5281006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb526ffd700 1 -- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb528100d40 msgr2=0x7fb5281006a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb526ffd700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb528100d40 0x7fb5281006a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb526ffd700 1 -- 172.21.15.116:0/106633502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180095f0 con 0x7fb528103660 2024-09-13T21:35:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb526ffd700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528103660 0x7fb5280fecf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00e920 tx=0x7fb51c00ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb524ff9700 1 -- 172.21.15.116:0/106633502 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb51c00c9d0 con 0x7fb528103660 2024-09-13T21:35:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb524ff9700 1 -- 172.21.15.116:0/106633502 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb51c010430 con 0x7fb528103660 2024-09-13T21:35:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5280ff650 con 0x7fb528103660 2024-09-13T21:35:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb524ff9700 1 -- 172.21.15.116:0/106633502 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb51c018650 con 0x7fb528103660 2024-09-13T21:35:59.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.211+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52819dab0 con 0x7fb528103660 2024-09-13T21:35:59.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.213+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52818fc70 con 0x7fb528103660 2024-09-13T21:35:59.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.213+0000 7fb524ff9700 1 -- 172.21.15.116:0/106633502 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb51c0105a0 con 0x7fb528103660 2024-09-13T21:35:59.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.213+0000 7fb524ff9700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb51006c680 0x7fb51006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:59.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.214+0000 7fb524ff9700 1 -- 172.21.15.116:0/106633502 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3602+0+0 (secure 0 0 0) 0x7fb51c014070 con 0x7fb528103660 2024-09-13T21:35:59.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.214+0000 7fb5277fe700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb51006c680 0x7fb51006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:59.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.214+0000 7fb5277fe700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb51006c680 0x7fb51006eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb51800b6f0 tx=0x7fb518005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:59.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.218+0000 7fb524ff9700 1 -- 172.21.15.116:0/106633502 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb51c051720 con 0x7fb528103660 2024-09-13T21:35:59.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:35:59.422+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb528061190 con 0x7fb51006c680 2024-09-13T21:35:59.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: osdmap e31: 4 total, 4 up, 4 in 2024-09-13T21:35:59.906 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: Detected new or changed devices on smithi116 2024-09-13T21:35:59.906 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.906 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.906 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:59.906 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: Adjusting osd_memory_target on smithi116 to 14912M 2024-09-13T21:35:59.906 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.906 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:59.906 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:59.907 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.907 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:59.907 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:59.907 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:59.907 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.907 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:35:59.907 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:35:59.907 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:35:59.907 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:35:59 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:59.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: osdmap e31: 4 total, 4 up, 4 in 2024-09-13T21:35:59.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: Detected new or changed devices on smithi116 2024-09-13T21:35:59.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:35:59.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: Adjusting osd_memory_target on smithi116 to 14912M 2024-09-13T21:35:59.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:59.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:59.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:35:59.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:59.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:35:59.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:35:59.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:35:59.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:35:59.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:35:59.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:35:59 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:00.820 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:00 smithi116 ceph-mon[33391]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-13T21:36:00.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:00 smithi088 ceph-mon[27963]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-13T21:36:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:01 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/3303908981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1f43a3b-669f-4788-a374-85f2d8fc1fa4"}]: dispatch 2024-09-13T21:36:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:01 smithi088 ceph-mon[27963]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1f43a3b-669f-4788-a374-85f2d8fc1fa4"}]: dispatch 2024-09-13T21:36:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:01 smithi088 ceph-mon[27963]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1f43a3b-669f-4788-a374-85f2d8fc1fa4"}]': finished 2024-09-13T21:36:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:01 smithi088 ceph-mon[27963]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T21:36:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:01 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:02.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:01 smithi116 ceph-mon[33391]: from='client.? 172.21.15.116:0/3303908981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1f43a3b-669f-4788-a374-85f2d8fc1fa4"}]: dispatch 2024-09-13T21:36:02.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:01 smithi116 ceph-mon[33391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1f43a3b-669f-4788-a374-85f2d8fc1fa4"}]: dispatch 2024-09-13T21:36:02.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:01 smithi116 ceph-mon[33391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1f43a3b-669f-4788-a374-85f2d8fc1fa4"}]': finished 2024-09-13T21:36:02.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:01 smithi116 ceph-mon[33391]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T21:36:02.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:01 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:03.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:02 smithi116 ceph-mon[33391]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-13T21:36:03.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:02 smithi116 ceph-mon[33391]: from='client.? 172.21.15.116:0/64543473' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:36:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:02 smithi088 ceph-mon[27963]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-13T21:36:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:02 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/64543473' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:36:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:05 smithi088 ceph-mon[27963]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-13T21:36:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:05 smithi116 ceph-mon[33391]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-13T21:36:07.120 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:06 smithi116 ceph-mon[33391]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T21:36:07.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:06 smithi088 ceph-mon[27963]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T21:36:09.208 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:09 smithi116 ceph-mon[33391]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-13T21:36:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:09 smithi088 ceph-mon[27963]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-13T21:36:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:36:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:10 smithi116 ceph-mon[33391]: Deploying daemon osd.4 on smithi116 2024-09-13T21:36:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:36:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:36:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:10 smithi088 ceph-mon[27963]: Deploying daemon osd.4 on smithi116 2024-09-13T21:36:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:36:11.306 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:11 smithi116 ceph-mon[33391]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:11.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:11 smithi088 ceph-mon[27963]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:13.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:13 smithi116 ceph-mon[33391]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:13.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:13 smithi088 ceph-mon[27963]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:15.366 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:15 smithi116 ceph-mon[33391]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:15.367 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:15 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:15.367 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:15 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:15.367 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:15 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:15 smithi088 ceph-mon[27963]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:15 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:15 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:15 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:17.001 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:16 smithi116 ceph-mon[33391]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:17.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:16 smithi088 ceph-mon[27963]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:18.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.131+0000 7fb524ff9700 1 -- 172.21.15.116:0/106633502 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb528061190 con 0x7fb51006c680 2024-09-13T21:36:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 4 on host 'smithi116' 2024-09-13T21:36:18.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb51006c680 msgr2=0x7fb51006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:18.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb51006c680 0x7fb51006eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb51800b6f0 tx=0x7fb518005a90 comp rx=0 tx=0).stop 2024-09-13T21:36:18.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528103660 msgr2=0x7fb5280fecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:18.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528103660 0x7fb5280fecf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00e920 tx=0x7fb51c00ec30 comp rx=0 tx=0).stop 2024-09-13T21:36:18.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 shutdown_connections 2024-09-13T21:36:18.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb51006c680 0x7fb51006eb30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:18.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb528100d40 0x7fb5281006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:18.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 --2- 172.21.15.116:0/106633502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528103660 0x7fb5280fecf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:18.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 >> 172.21.15.116:0/106633502 conn(0x7fb5280fa700 msgr2=0x7fb5280fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:18.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 shutdown_connections 2024-09-13T21:36:18.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:18.133+0000 7fb52dcb9700 1 -- 172.21.15.116:0/106633502 wait complete. 2024-09-13T21:36:19.116 DEBUG:teuthology.orchestra.run.smithi116:osd.4> sudo journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T21:36:19.118 INFO:tasks.cephadm:Deploying osd.5 on smithi116 with /dev/vg_nvme/lv_2... 2024-09-13T21:36:19.119 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T21:36:19.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:19 smithi116 ceph-mon[33391]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:19.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:19 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:19.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:19 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:19.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:19 smithi116 ceph-mon[33391]: from='osd.4 [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:36:19.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:19 smithi116 ceph-mon[33391]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:36:19.367 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi116/config 2024-09-13T21:36:19.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:19 smithi088 ceph-mon[27963]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:19.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:19 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:19.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:19 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:19.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:19 smithi088 ceph-mon[27963]: from='osd.4 [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:36:19.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:19 smithi088 ceph-mon[27963]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:36:20.468 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:20 smithi116 ceph-mon[33391]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T21:36:20.469 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:20 smithi116 ceph-mon[33391]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T21:36:20.469 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:20 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:20.469 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:20 smithi116 ceph-mon[33391]: from='osd.4 [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:36:20.469 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:20 smithi116 ceph-mon[33391]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:36:20.469 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:20 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:20.469 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:20 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:20.469 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:36:20 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[44051]: 2024-09-13T21:36:20.142+0000 7f7dd420b700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T21:36:20.469 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:36:20 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[44051]: 2024-09-13T21:36:20.149+0000 7f7dceffe700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:36:20.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:20 smithi088 ceph-mon[27963]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T21:36:20.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:20 smithi088 ceph-mon[27963]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T21:36:20.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:20 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:20.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:20 smithi088 ceph-mon[27963]: from='osd.4 [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:36:20.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:20 smithi088 ceph-mon[27963]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:36:20.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:20 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:20.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:20 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:21.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:21 smithi116 ceph-mon[33391]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:21.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:21 smithi116 ceph-mon[33391]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T21:36:21.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:21 smithi116 ceph-mon[33391]: osdmap e34: 5 total, 4 up, 5 in 2024-09-13T21:36:21.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:21 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:21.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:21 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:21.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:21 smithi116 ceph-mon[33391]: osd.4 [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] boot 2024-09-13T21:36:21.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:21 smithi088 ceph-mon[27963]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T21:36:21.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:21 smithi088 ceph-mon[27963]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T21:36:21.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:21 smithi088 ceph-mon[27963]: osdmap e34: 5 total, 4 up, 5 in 2024-09-13T21:36:21.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:21.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:21.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:21 smithi088 ceph-mon[27963]: osd.4 [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] boot 2024-09-13T21:36:22.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:22 smithi088 ceph-mon[27963]: purged_snaps scrub starts 2024-09-13T21:36:22.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:22 smithi088 ceph-mon[27963]: purged_snaps scrub ok 2024-09-13T21:36:22.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:22 smithi088 ceph-mon[27963]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T21:36:22.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:22 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:22.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:22 smithi116 ceph-mon[33391]: purged_snaps scrub starts 2024-09-13T21:36:22.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:22 smithi116 ceph-mon[33391]: purged_snaps scrub ok 2024-09-13T21:36:22.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:22 smithi116 ceph-mon[33391]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T21:36:22.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:22 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:36:22.917 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T21:36:22.936 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_2 2024-09-13T21:36:23.248 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:23 smithi116 ceph-mon[33391]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:23.248 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:23 smithi116 ceph-mon[33391]: osdmap e36: 5 total, 5 up, 5 in 2024-09-13T21:36:23.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:23 smithi088 ceph-mon[27963]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:23.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:23 smithi088 ceph-mon[27963]: osdmap e36: 5 total, 5 up, 5 in 2024-09-13T21:36:23.546 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi116/config 2024-09-13T21:36:25.310 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:25.310 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.310 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.310 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:25.310 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:25.310 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.310 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:25.311 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:36:25.311 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.311 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:25.311 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:25.311 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:36:25.311 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.311 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:36:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:25.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:36:25.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:25.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:25.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:36:25.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:25.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:36:25.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.853+0000 7f06b34ec700 1 -- 172.21.15.116:0/3963323615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 msgr2=0x7f06ac101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:25.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.853+0000 7f06b34ec700 1 --2- 172.21.15.116:0/3963323615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 0x7f06ac101580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009910 tx=0x7f06a8009c20 comp rx=0 tx=0).stop 2024-09-13T21:36:25.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.853+0000 7f06b34ec700 1 -- 172.21.15.116:0/3963323615 shutdown_connections 2024-09-13T21:36:25.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.853+0000 7f06b34ec700 1 --2- 172.21.15.116:0/3963323615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 0x7f06ac101580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.853+0000 7f06b34ec700 1 --2- 172.21.15.116:0/3963323615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06ac0fe500 0x7f06ac0fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.853+0000 7f06b34ec700 1 -- 172.21.15.116:0/3963323615 >> 172.21.15.116:0/3963323615 conn(0x7f06ac0f9f10 msgr2=0x7f06ac0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.853+0000 7f06b34ec700 1 -- 172.21.15.116:0/3963323615 shutdown_connections 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.853+0000 7f06b34ec700 1 -- 172.21.15.116:0/3963323615 wait complete. 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b34ec700 1 Processor -- start 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b34ec700 1 -- start start 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b34ec700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06ac0fe500 0x7f06ac100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b34ec700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 0x7f06ac0ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b34ec700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0ffa70 con 0x7f06ac0fe500 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b34ec700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0ffbb0 con 0x7f06ac0fee50 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b0a87700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 0x7f06ac0ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:25.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b0a87700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 0x7f06ac0ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60366/0 (socket says 172.21.15.116:60366) 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b0a87700 1 -- 172.21.15.116:0/1114985548 learned_addr learned my addr 172.21.15.116:0/1114985548 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b1288700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06ac0fe500 0x7f06ac100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b0a87700 1 -- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06ac0fe500 msgr2=0x7f06ac100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b0a87700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06ac0fe500 0x7f06ac100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.854+0000 7f06b0a87700 1 -- 172.21.15.116:0/1114985548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80095f0 con 0x7f06ac0fee50 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.855+0000 7f06b0a87700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 0x7f06ac0ff530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f06a800bd70 tx=0x7f06a800be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.855+0000 7f069e7fc700 1 -- 172.21.15.116:0/1114985548 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a801d070 con 0x7f06ac0fee50 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.855+0000 7f069e7fc700 1 -- 172.21.15.116:0/1114985548 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06a8022470 con 0x7f06ac0fee50 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.855+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac0ffe30 con 0x7f06ac0fee50 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.855+0000 7f069e7fc700 1 -- 172.21.15.116:0/1114985548 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a800f670 con 0x7f06ac0fee50 2024-09-13T21:36:25.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.855+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac100320 con 0x7f06ac0fee50 2024-09-13T21:36:25.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.856+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac108d90 con 0x7f06ac0fee50 2024-09-13T21:36:25.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.856+0000 7f069e7fc700 1 -- 172.21.15.116:0/1114985548 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f06a8022a80 con 0x7f06ac0fee50 2024-09-13T21:36:25.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.857+0000 7f069e7fc700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f069806c680 0x7f069806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:25.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.857+0000 7f069e7fc700 1 -- 172.21.15.116:0/1114985548 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4034+0+0 (secure 0 0 0) 0x7f06a808c920 con 0x7f06ac0fee50 2024-09-13T21:36:25.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.857+0000 7f06b1288700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f069806c680 0x7f069806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:25.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.857+0000 7f06b1288700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f069806c680 0x7f069806eb30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06a0006fd0 tx=0x7f06a0008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:25.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:25.861+0000 7f069e7fc700 1 -- 172.21.15.116:0/1114985548 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f06a805b0d0 con 0x7f06ac0fee50 2024-09-13T21:36:26.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:26.059+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f06ac19e030 con 0x7f069806c680 2024-09-13T21:36:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:26 smithi116 ceph-mon[33391]: Detected new or changed devices on smithi116 2024-09-13T21:36:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:26 smithi116 ceph-mon[33391]: Adjusting osd_memory_target on smithi116 to 7456M 2024-09-13T21:36:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:36:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:36:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:26.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:26 smithi088 ceph-mon[27963]: Detected new or changed devices on smithi116 2024-09-13T21:36:26.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:26 smithi088 ceph-mon[27963]: Adjusting osd_memory_target on smithi116 to 7456M 2024-09-13T21:36:26.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:36:26.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:36:26.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:27.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:27 smithi088 ceph-mon[27963]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:27.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:27 smithi088 ceph-mon[27963]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:27.502 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:27 smithi116 ceph-mon[33391]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:27.502 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:27 smithi116 ceph-mon[33391]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:29.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:29 smithi088 ceph-mon[27963]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:29.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:29 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/2126147611' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bce63c57-85a5-4b7e-bf82-4a42d05e31c5"}]: dispatch 2024-09-13T21:36:29.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:29 smithi088 ceph-mon[27963]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bce63c57-85a5-4b7e-bf82-4a42d05e31c5"}]: dispatch 2024-09-13T21:36:29.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:29 smithi088 ceph-mon[27963]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bce63c57-85a5-4b7e-bf82-4a42d05e31c5"}]': finished 2024-09-13T21:36:29.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:29 smithi088 ceph-mon[27963]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T21:36:29.421 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:29 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:29 smithi116 ceph-mon[33391]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:29 smithi116 ceph-mon[33391]: from='client.? 172.21.15.116:0/2126147611' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bce63c57-85a5-4b7e-bf82-4a42d05e31c5"}]: dispatch 2024-09-13T21:36:29.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:29 smithi116 ceph-mon[33391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bce63c57-85a5-4b7e-bf82-4a42d05e31c5"}]: dispatch 2024-09-13T21:36:29.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:29 smithi116 ceph-mon[33391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bce63c57-85a5-4b7e-bf82-4a42d05e31c5"}]': finished 2024-09-13T21:36:29.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:29 smithi116 ceph-mon[33391]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T21:36:29.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:29 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:30.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:30 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/404701917' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:36:30.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:30 smithi116 ceph-mon[33391]: from='client.? 172.21.15.116:0/404701917' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:36:31.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:31 smithi088 ceph-mon[27963]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:31.565 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:31 smithi116 ceph-mon[33391]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:33.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:33 smithi116 ceph-mon[33391]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:33.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:33 smithi088 ceph-mon[27963]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:35.269 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:35 smithi116 ceph-mon[33391]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:35.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:35 smithi088 ceph-mon[27963]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:36.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:36 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:36:36.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:36 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:36.511 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:36 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:36:36.511 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:36 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:37 smithi088 ceph-mon[27963]: Deploying daemon osd.5 on smithi116 2024-09-13T21:36:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:37 smithi088 ceph-mon[27963]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:37.517 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:37 smithi116 ceph-mon[33391]: Deploying daemon osd.5 on smithi116 2024-09-13T21:36:37.518 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:37 smithi116 ceph-mon[33391]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:39.412 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:39 smithi116 ceph-mon[33391]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:39.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:39 smithi088 ceph-mon[27963]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:40.479 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:36:40.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:36:41.446 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:41 smithi116 ceph-mon[33391]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:41.446 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:41 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:41.447 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:41 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:41.447 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:41 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:41.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:41 smithi088 ceph-mon[27963]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:41.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:41 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:41.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:41 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:41.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:41 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:43.466 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:43 smithi116 ceph-mon[33391]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:43.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:43 smithi088 ceph-mon[27963]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:44.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.972+0000 7f069e7fc700 1 -- 172.21.15.116:0/1114985548 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f06ac19e030 con 0x7f069806c680 2024-09-13T21:36:44.974 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 5 on host 'smithi116' 2024-09-13T21:36:44.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f069806c680 msgr2=0x7f069806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:44.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f069806c680 0x7f069806eb30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06a0006fd0 tx=0x7f06a0008040 comp rx=0 tx=0).stop 2024-09-13T21:36:44.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 msgr2=0x7f06ac0ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:44.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 0x7f06ac0ff530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f06a800bd70 tx=0x7f06a800be50 comp rx=0 tx=0).stop 2024-09-13T21:36:44.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 shutdown_connections 2024-09-13T21:36:44.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f069806c680 0x7f069806eb30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:44.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06ac0fe500 0x7f06ac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:44.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 --2- 172.21.15.116:0/1114985548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06ac0fee50 0x7f06ac0ff530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:44.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 >> 172.21.15.116:0/1114985548 conn(0x7f06ac0f9f10 msgr2=0x7f06ac1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:44.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 shutdown_connections 2024-09-13T21:36:44.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:44.974+0000 7f06b34ec700 1 -- 172.21.15.116:0/1114985548 wait complete. 2024-09-13T21:36:45.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:45 smithi088 ceph-mon[27963]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:45 smithi088 ceph-mon[27963]: from='osd.5 [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:36:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:45 smithi088 ceph-mon[27963]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:36:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:45 smithi116 ceph-mon[33391]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:45 smithi116 ceph-mon[33391]: from='osd.5 [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:36:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:45 smithi116 ceph-mon[33391]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:36:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:45.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:45.636 DEBUG:teuthology.orchestra.run.smithi116:osd.5> sudo journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T21:36:45.638 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T21:36:45.639 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T21:36:45.852 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:46 smithi088 ceph-mon[27963]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T21:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:46 smithi088 ceph-mon[27963]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T21:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:46 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:46.226 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:46 smithi088 ceph-mon[27963]: from='osd.5 [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:36:46.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:46 smithi088 ceph-mon[27963]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:36:46.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:46 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:46.227 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:46 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:46.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:46 smithi116 ceph-mon[33391]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T21:36:46.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:46 smithi116 ceph-mon[33391]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T21:36:46.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:46 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:46.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:46 smithi116 ceph-mon[33391]: from='osd.5 [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:36:46.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:46 smithi116 ceph-mon[33391]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:36:46.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:46 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:46.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:46 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:46.597 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:36:46 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[48690]: 2024-09-13T21:36:46.209+0000 7f117e426700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T21:36:46.597 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:36:46 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[48690]: 2024-09-13T21:36:46.217+0000 7f1178217700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:36:47.308 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:47 smithi088 ceph-mon[27963]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:47.308 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:47 smithi088 ceph-mon[27963]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T21:36:47.308 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:47 smithi088 ceph-mon[27963]: osdmap e39: 6 total, 5 up, 6 in 2024-09-13T21:36:47.309 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:47.309 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:47 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:47 smithi116 ceph-mon[33391]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:47 smithi116 ceph-mon[33391]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T21:36:47.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:47 smithi116 ceph-mon[33391]: osdmap e39: 6 total, 5 up, 6 in 2024-09-13T21:36:47.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:47 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:47.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:47 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:47.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.515+0000 7fc69f02c700 1 -- 172.21.15.88:0/2793618316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 msgr2=0x7fc6980fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:47.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.515+0000 7fc69f02c700 1 --2- 172.21.15.88:0/2793618316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 0x7fc6980fe910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009910 tx=0x7fc68c009c20 comp rx=0 tx=0).stop 2024-09-13T21:36:47.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.515+0000 7fc69f02c700 1 -- 172.21.15.88:0/2793618316 shutdown_connections 2024-09-13T21:36:47.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.515+0000 7fc69f02c700 1 --2- 172.21.15.88:0/2793618316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6980fee50 0x7fc698101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:47.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.515+0000 7fc69f02c700 1 --2- 172.21.15.88:0/2793618316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 0x7fc6980fe910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:47.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.515+0000 7fc69f02c700 1 -- 172.21.15.88:0/2793618316 >> 172.21.15.88:0/2793618316 conn(0x7fc6980f9f10 msgr2=0x7fc6980fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:47.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.515+0000 7fc69f02c700 1 -- 172.21.15.88:0/2793618316 shutdown_connections 2024-09-13T21:36:47.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.515+0000 7fc69f02c700 1 -- 172.21.15.88:0/2793618316 wait complete. 2024-09-13T21:36:47.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc69f02c700 1 Processor -- start 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc69f02c700 1 -- start start 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc69f02c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 0x7fc698195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc69f02c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6980fee50 0x7fc698196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc69f02c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc698196660 con 0x7fc6980fe500 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc69f02c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6981967a0 con 0x7fc6980fee50 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc69cdc8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 0x7fc698195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc69cdc8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 0x7fc698195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46178/0 (socket says 172.21.15.88:46178) 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc69cdc8700 1 -- 172.21.15.88:0/583436956 learned_addr learned my addr 172.21.15.88:0/583436956 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.516+0000 7fc697fff700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6980fee50 0x7fc698196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.517+0000 7fc69cdc8700 1 -- 172.21.15.88:0/583436956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6980fee50 msgr2=0x7fc698196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.517+0000 7fc69cdc8700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6980fee50 0x7fc698196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.517+0000 7fc69cdc8700 1 -- 172.21.15.88:0/583436956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0095f0 con 0x7fc6980fe500 2024-09-13T21:36:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.517+0000 7fc69cdc8700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 0x7fc698195b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc68c000c00 tx=0x7fc68c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.517+0000 7fc695ffb700 1 -- 172.21.15.88:0/583436956 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68c01d070 con 0x7fc6980fe500 2024-09-13T21:36:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.517+0000 7fc695ffb700 1 -- 172.21.15.88:0/583436956 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc68c005dc0 con 0x7fc6980fe500 2024-09-13T21:36:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.517+0000 7fc695ffb700 1 -- 172.21.15.88:0/583436956 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68c0226a0 con 0x7fc6980fe500 2024-09-13T21:36:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.517+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69819b1f0 con 0x7fc6980fe500 2024-09-13T21:36:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.517+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69819b6e0 con 0x7fc6980fe500 2024-09-13T21:36:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.518+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc698108d50 con 0x7fc6980fe500 2024-09-13T21:36:47.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.519+0000 7fc695ffb700 1 -- 172.21.15.88:0/583436956 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc68c0038f0 con 0x7fc6980fe500 2024-09-13T21:36:47.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.519+0000 7fc695ffb700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc68806c680 0x7fc68806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:47.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.519+0000 7fc695ffb700 1 -- 172.21.15.88:0/583436956 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc68c08c870 con 0x7fc6980fe500 2024-09-13T21:36:47.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.519+0000 7fc697fff700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc68806c680 0x7fc68806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:47.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.519+0000 7fc697fff700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc68806c680 0x7fc68806eb30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc698068a90 tx=0x7fc684009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:47.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.524+0000 7fc695ffb700 1 -- 172.21.15.88:0/583436956 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc68c05ae40 con 0x7fc6980fe500 2024-09-13T21:36:47.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.724+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc698108f10 con 0x7fc6980fe500 2024-09-13T21:36:47.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.724+0000 7fc695ffb700 1 -- 172.21.15.88:0/583436956 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7fc68c003680 con 0x7fc6980fe500 2024-09-13T21:36:47.726 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:36:47.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.727+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc68806c680 msgr2=0x7fc68806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:47.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.727+0000 7fc69f02c700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc68806c680 0x7fc68806eb30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc698068a90 tx=0x7fc684009260 comp rx=0 tx=0).stop 2024-09-13T21:36:47.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.727+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 msgr2=0x7fc698195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:47.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.727+0000 7fc69f02c700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 0x7fc698195b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc68c000c00 tx=0x7fc68c00f690 comp rx=0 tx=0).stop 2024-09-13T21:36:47.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.727+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 shutdown_connections 2024-09-13T21:36:47.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.727+0000 7fc69f02c700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc68806c680 0x7fc68806eb30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:47.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.727+0000 7fc69f02c700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6980fe500 0x7fc698195b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:47.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.727+0000 7fc69f02c700 1 --2- 172.21.15.88:0/583436956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6980fee50 0x7fc698196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:47.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.727+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 >> 172.21.15.88:0/583436956 conn(0x7fc6980f9f10 msgr2=0x7fc6981047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:47.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.728+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 shutdown_connections 2024-09-13T21:36:47.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:47.728+0000 7fc69f02c700 1 -- 172.21.15.88:0/583436956 wait complete. 2024-09-13T21:36:48.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:48 smithi116 ceph-mon[33391]: purged_snaps scrub starts 2024-09-13T21:36:48.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:48 smithi116 ceph-mon[33391]: purged_snaps scrub ok 2024-09-13T21:36:48.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:48 smithi116 ceph-mon[33391]: osd.5 [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] boot 2024-09-13T21:36:48.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:48 smithi116 ceph-mon[33391]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T21:36:48.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:48 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:48.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:48 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/583436956' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T21:36:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726263407,"num_in_osds":6,"osd_in_since":1726263388,"num_remapped_pgs":0} 2024-09-13T21:36:48.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T21:36:48.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:48 smithi088 ceph-mon[27963]: purged_snaps scrub starts 2024-09-13T21:36:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:48 smithi088 ceph-mon[27963]: purged_snaps scrub ok 2024-09-13T21:36:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:48 smithi088 ceph-mon[27963]: osd.5 [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] boot 2024-09-13T21:36:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:48 smithi088 ceph-mon[27963]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T21:36:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:48 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:36:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:48 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/583436956' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T21:36:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:36:49.453 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:49 smithi088 ceph-mon[27963]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:49.453 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:49 smithi088 ceph-mon[27963]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T21:36:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:49 smithi116 ceph-mon[33391]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T21:36:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:49 smithi116 ceph-mon[33391]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T21:36:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.408+0000 7f5b2b71b700 1 -- 172.21.15.88:0/1834491754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 msgr2=0x7f5b240ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.408+0000 7f5b2b71b700 1 --2- 172.21.15.88:0/1834491754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 0x7f5b240ff790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00b0a0 tx=0x7f5b1c00b3b0 comp rx=0 tx=0).stop 2024-09-13T21:36:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.408+0000 7f5b2b71b700 1 -- 172.21.15.88:0/1834491754 shutdown_connections 2024-09-13T21:36:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.408+0000 7f5b2b71b700 1 --2- 172.21.15.88:0/1834491754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b240ffd60 0x7f5b24103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.408+0000 7f5b2b71b700 1 --2- 172.21.15.88:0/1834491754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 0x7f5b240ff790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.408+0000 7f5b2b71b700 1 -- 172.21.15.88:0/1834491754 >> 172.21.15.88:0/1834491754 conn(0x7f5b240fac60 msgr2=0x7f5b240fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.408+0000 7f5b2b71b700 1 -- 172.21.15.88:0/1834491754 shutdown_connections 2024-09-13T21:36:50.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.408+0000 7f5b2b71b700 1 -- 172.21.15.88:0/1834491754 wait complete. 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b2b71b700 1 Processor -- start 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b2b71b700 1 -- start start 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b2b71b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 0x7f5b24100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b2b71b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b240ffd60 0x7f5b24101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b2b71b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24101850 con 0x7f5b240ff3c0 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b2b71b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24101990 con 0x7f5b240ffd60 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b294b7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 0x7f5b24100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b294b7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 0x7f5b24100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41612/0 (socket says 172.21.15.88:41612) 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b294b7700 1 -- 172.21.15.88:0/4238155890 learned_addr learned my addr 172.21.15.88:0/4238155890 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b28cb6700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b240ffd60 0x7f5b24101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b294b7700 1 -- 172.21.15.88:0/4238155890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b240ffd60 msgr2=0x7f5b24101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b294b7700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b240ffd60 0x7f5b24101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.409+0000 7f5b294b7700 1 -- 172.21.15.88:0/4238155890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c009d00 con 0x7f5b240ff3c0 2024-09-13T21:36:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.410+0000 7f5b294b7700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 0x7f5b24100dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c000f80 tx=0x7f5b1c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.410+0000 7f5b227fc700 1 -- 172.21.15.88:0/4238155890 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c00e040 con 0x7f5b240ff3c0 2024-09-13T21:36:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.410+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b24101c10 con 0x7f5b240ff3c0 2024-09-13T21:36:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.410+0000 7f5b227fc700 1 -- 172.21.15.88:0/4238155890 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b1c003de0 con 0x7f5b240ff3c0 2024-09-13T21:36:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.410+0000 7f5b227fc700 1 -- 172.21.15.88:0/4238155890 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c01d9a0 con 0x7f5b240ff3c0 2024-09-13T21:36:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.410+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b241a2450 con 0x7f5b240ff3c0 2024-09-13T21:36:50.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.411+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b24067980 con 0x7f5b240ff3c0 2024-09-13T21:36:50.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.411+0000 7f5b227fc700 1 -- 172.21.15.88:0/4238155890 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5b1c004040 con 0x7f5b240ff3c0 2024-09-13T21:36:50.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.412+0000 7f5b227fc700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b0c06c680 0x7f5b0c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:50.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.412+0000 7f5b227fc700 1 -- 172.21.15.88:0/4238155890 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f5b1c08ce30 con 0x7f5b240ff3c0 2024-09-13T21:36:50.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.412+0000 7f5b28cb6700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b0c06c680 0x7f5b0c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:50.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.412+0000 7f5b28cb6700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b0c06c680 0x7f5b0c06eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b241025c0 tx=0x7f5b18009190 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:50.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.416+0000 7f5b227fc700 1 -- 172.21.15.88:0/4238155890 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5b1c0578f0 con 0x7f5b240ff3c0 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: Detected new or changed devices on smithi116 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: Adjusting osd_memory_target on smithi116 to 4970M 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:50.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:36:50.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:50.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:50.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:36:50.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:50 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: Detected new or changed devices on smithi116 2024-09-13T21:36:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: Adjusting osd_memory_target on smithi116 to 4970M 2024-09-13T21:36:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:50.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:36:50.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:50.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:50.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:36:50.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:50 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:36:50.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.610+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b241a2730 con 0x7f5b240ff3c0 2024-09-13T21:36:50.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.611+0000 7f5b227fc700 1 -- 172.21.15.88:0/4238155890 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11059 (secure 0 0 0) 0x7f5b1c05af10 con 0x7f5b240ff3c0 2024-09-13T21:36:50.613 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:36:50.613 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":41,"fsid":"67511300-7217-11ef-bceb-c7b262605968","created":"2024-09-13T21:31:01.927981+0000","modified":"2024-09-13T21:36:48.212171+0000","last_up_change":"2024-09-13T21:36:47.206709+0000","last_in_change":"2024-09-13T21:36:28.556173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T21:35:32.330283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fc64bc8-3edd-41fd-9fb3-739af88e3c15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6803","nonce":2872339292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6805","nonce":2872339292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6809","nonce":2872339292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6807","nonce":2872339292}]},"public_addr":"172.21.15.88:6803/2872339292","cluster_addr":"172.21.15.88:6805/2872339292","heartbeat_back_addr":"172.21.15.88:6809/2872339292","heartbeat_front_addr":"172.21.15.88:6807/2872339292","state":["exists","up"]},{"osd":1,"uuid":"8aa036b6-0acd-400a-88d2-13989c325da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6811","nonce":2600311836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6813","nonce":2600311836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6817","nonce":2600311836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6815","nonce":2600311836}]},"public_addr":"172.21.15.88:6811/2600311836","cluster_addr":"172.21.15.88:6813/2600311836","heartbeat_back_addr":"172.21.15.88:6817/2600311836","heartbeat_front_addr":"172.21.15.88:6815/2600311836","state":["exists","up"]},{"osd":2,"uuid":"014e6ebe-af5c-462b-9024-9824b6f2fad7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6819","nonce":3497738838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6821","nonce":3497738838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6825","nonce":3497738838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6823","nonce":3497738838}]},"public_addr":"172.21.15.88:6819/3497738838","cluster_addr":"172.21.15.88:6821/3497738838","heartbeat_back_addr":"172.21.15.88:6825/3497738838","heartbeat_front_addr":"172.21.15.88:6823/3497738838","state":["exists","up"]},{"osd":3,"uuid":"76489d88-1fe1-4d01-b7f0-3056a95af473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6801","nonce":1627285017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6803","nonce":1627285017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6807","nonce":1627285017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6805","nonce":1627285017}]},"public_addr":"172.21.15.116:6801/1627285017","cluster_addr":"172.21.15.116:6803/1627285017","heartbeat_back_addr":"172.21.15.116:6807/1627285017","heartbeat_front_addr":"172.21.15.116:6805/1627285017","state":["exists","up"]},{"osd":4,"uuid":"a1f43a3b-669f-4788-a374-85f2d8fc1fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6809","nonce":1515540380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6811","nonce":1515540380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6815","nonce":1515540380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6813","nonce":1515540380}]},"public_addr":"172.21.15.116:6809/1515540380","cluster_addr":"172.21.15.116:6811/1515540380","heartbeat_back_addr":"172.21.15.116:6815/1515540380","heartbeat_front_addr":"172.21.15.116:6813/1515540380","state":["exists","up"]},{"osd":5,"uuid":"bce63c57-85a5-4b7e-bf82-4a42d05e31c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6817","nonce":765762154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6819","nonce":765762154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6823","nonce":765762154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6821","nonce":765762154}]},"public_addr":"172.21.15.116:6817/765762154","cluster_addr":"172.21.15.116:6819/765762154","heartbeat_back_addr":"172.21.15.116:6823/765762154","heartbeat_front_addr":"172.21.15.116:6821/765762154","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:34:31.298874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:35:01.713251+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:35:28.980704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:35:53.224629+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:36:19.382753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:36:45.970734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:0/1718413431":"2024-09-14T21:33:10.015143+0000","172.21.15.88:0/672735579":"2024-09-14T21:33:10.015143+0000","172.21.15.88:0/1989360438":"2024-09-14T21:33:10.015143+0000","172.21.15.88:0/2418246833":"2024-09-14T21:32:04.517540+0000","172.21.15.88:6801/2":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/3497040883":"2024-09-14T21:32:04.517540+0000","172.21.15.88:6800/2":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/250890518":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/1136159910":"2024-09-14T21:32:04.517540+0000","172.21.15.88:0/3319424547":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/3401436245":"2024-09-14T21:31:31.464307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T21:36:50.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b0c06c680 msgr2=0x7f5b0c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:50.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b0c06c680 0x7f5b0c06eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b241025c0 tx=0x7f5b18009190 comp rx=0 tx=0).stop 2024-09-13T21:36:50.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 msgr2=0x7f5b24100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:50.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 0x7f5b24100dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c000f80 tx=0x7f5b1c00cd00 comp rx=0 tx=0).stop 2024-09-13T21:36:50.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 shutdown_connections 2024-09-13T21:36:50.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5b0c06c680 0x7f5b0c06eb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:50.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b240ff3c0 0x7f5b24100dd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:50.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 --2- 172.21.15.88:0/4238155890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b240ffd60 0x7f5b24101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:50.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 >> 172.21.15.88:0/4238155890 conn(0x7f5b240fac60 msgr2=0x7f5b241034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:50.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 shutdown_connections 2024-09-13T21:36:50.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:50.613+0000 7f5b2b71b700 1 -- 172.21.15.88:0/4238155890 wait complete. 2024-09-13T21:36:51.342 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T21:35:32.330283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T21:36:51.342 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T21:36:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:36:51.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:51 smithi088 ceph-mon[27963]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:51.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:51 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/4238155890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:36:51.692 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:51 smithi116 ceph-mon[33391]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:51.692 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:51 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/4238155890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:36:53.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.192+0000 7fb396844700 1 -- 172.21.15.88:0/2134538364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100460 msgr2=0x7fb390100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:53.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.192+0000 7fb396844700 1 --2- 172.21.15.88:0/2134538364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100460 0x7fb390100830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb380009910 tx=0x7fb380009c20 comp rx=0 tx=0).stop 2024-09-13T21:36:53.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.192+0000 7fb396844700 1 -- 172.21.15.88:0/2134538364 shutdown_connections 2024-09-13T21:36:53.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.192+0000 7fb396844700 1 --2- 172.21.15.88:0/2134538364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb390100d70 0x7fb3901094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:53.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.192+0000 7fb396844700 1 --2- 172.21.15.88:0/2134538364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100460 0x7fb390100830 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:53.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.192+0000 7fb396844700 1 -- 172.21.15.88:0/2134538364 >> 172.21.15.88:0/2134538364 conn(0x7fb3900748b0 msgr2=0x7fb390074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:53.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.192+0000 7fb396844700 1 -- 172.21.15.88:0/2134538364 shutdown_connections 2024-09-13T21:36:53.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.192+0000 7fb396844700 1 -- 172.21.15.88:0/2134538364 wait complete. 2024-09-13T21:36:53.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb396844700 1 Processor -- start 2024-09-13T21:36:53.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb396844700 1 -- start start 2024-09-13T21:36:53.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb396844700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb390100460 0x7fb390196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:53.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb396844700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100d70 0x7fb3901972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb396844700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901978d0 con 0x7fb390100d70 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb396844700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390197a10 con 0x7fb390100460 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb390100460 0x7fb390196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb38f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100d70 0x7fb3901972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb38f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100d70 0x7fb3901972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41628/0 (socket says 172.21.15.88:41628) 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb390100460 0x7fb390196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:60450/0 (socket says 172.21.15.88:60450) 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.193+0000 7fb38f7fe700 1 -- 172.21.15.88:0/3627968764 learned_addr learned my addr 172.21.15.88:0/3627968764 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.194+0000 7fb38f7fe700 1 -- 172.21.15.88:0/3627968764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb390100460 msgr2=0x7fb390196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.194+0000 7fb38f7fe700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb390100460 0x7fb390196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.194+0000 7fb38f7fe700 1 -- 172.21.15.88:0/3627968764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3800095f0 con 0x7fb390100d70 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.194+0000 7fb38f7fe700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100d70 0x7fb3901972b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb38400d8d0 tx=0x7fb38400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.194+0000 7fb38d7fa700 1 -- 172.21.15.88:0/3627968764 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3840098a0 con 0x7fb390100d70 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.194+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39019fde0 con 0x7fb390100d70 2024-09-13T21:36:53.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.194+0000 7fb38d7fa700 1 -- 172.21.15.88:0/3627968764 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb384010460 con 0x7fb390100d70 2024-09-13T21:36:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.194+0000 7fb38d7fa700 1 -- 172.21.15.88:0/3627968764 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb38400f5f0 con 0x7fb390100d70 2024-09-13T21:36:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.194+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3901a02a0 con 0x7fb390100d70 2024-09-13T21:36:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.195+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb390106bd0 con 0x7fb390100d70 2024-09-13T21:36:53.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.196+0000 7fb38d7fa700 1 -- 172.21.15.88:0/3627968764 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb384009a00 con 0x7fb390100d70 2024-09-13T21:36:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.196+0000 7fb38d7fa700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb37806c680 0x7fb37806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.196+0000 7fb38ffff700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb37806c680 0x7fb37806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.196+0000 7fb38d7fa700 1 -- 172.21.15.88:0/3627968764 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb38408b350 con 0x7fb390100d70 2024-09-13T21:36:53.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.197+0000 7fb38ffff700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb37806c680 0x7fb37806eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb380006010 tx=0x7fb38001a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:53.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.201+0000 7fb38d7fa700 1 -- 172.21.15.88:0/3627968764 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb384055e10 con 0x7fb390100d70 2024-09-13T21:36:53.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.389+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3900ffa00 con 0x7fb390100d70 2024-09-13T21:36:53.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.389+0000 7fb38d7fa700 1 -- 172.21.15.88:0/3627968764 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb38408b070 con 0x7fb390100d70 2024-09-13T21:36:53.391 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-13T21:36:53.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb37806c680 msgr2=0x7fb37806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:53.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb37806c680 0x7fb37806eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb380006010 tx=0x7fb38001a040 comp rx=0 tx=0).stop 2024-09-13T21:36:53.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100d70 msgr2=0x7fb3901972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:53.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100d70 0x7fb3901972b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb38400d8d0 tx=0x7fb38400dbe0 comp rx=0 tx=0).stop 2024-09-13T21:36:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 shutdown_connections 2024-09-13T21:36:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb37806c680 0x7fb37806eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb390100460 0x7fb390196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 --2- 172.21.15.88:0/3627968764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb390100d70 0x7fb3901972b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 >> 172.21.15.88:0/3627968764 conn(0x7fb3900748b0 msgr2=0x7fb390103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 shutdown_connections 2024-09-13T21:36:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:53.391+0000 7fb396844700 1 -- 172.21.15.88:0/3627968764 wait complete. 2024-09-13T21:36:53.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:53 smithi088 ceph-mon[27963]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:53.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:53 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3627968764' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T21:36:53.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:53 smithi116 ceph-mon[33391]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:53.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:53 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3627968764' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T21:36:54.090 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T21:36:54.090 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T21:36:54.290 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:36:55.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:55 smithi088 ceph-mon[27963]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:55.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:55 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:36:55.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:55 smithi116 ceph-mon[33391]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:55.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:55 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:36:55.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.958+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3091080174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0ff130 msgr2=0x7f71dc0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:55.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.958+0000 7f71e3fb1700 1 --2- 172.21.15.88:0/3091080174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0ff130 0x7f71dc0ff540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009910 tx=0x7f71d8009c20 comp rx=0 tx=0).stop 2024-09-13T21:36:55.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.958+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3091080174 shutdown_connections 2024-09-13T21:36:55.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.958+0000 7f71e3fb1700 1 --2- 172.21.15.88:0/3091080174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71dc1003d0 0x7f71dc100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:55.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.958+0000 7f71e3fb1700 1 --2- 172.21.15.88:0/3091080174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc0ff130 0x7f71dc0ff540 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:55.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.958+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3091080174 >> 172.21.15.88:0/3091080174 conn(0x7f71dc0fa780 msgr2=0x7f71dc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:55.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.958+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3091080174 shutdown_connections 2024-09-13T21:36:55.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.958+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3091080174 wait complete. 2024-09-13T21:36:55.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e3fb1700 1 Processor -- start 2024-09-13T21:36:55.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e3fb1700 1 -- start start 2024-09-13T21:36:55.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e3fb1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71dc0ff130 0x7f71dc0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:55.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e3fb1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc1003d0 0x7f71dc19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e3fb1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1966d0 con 0x7f71dc1003d0 2024-09-13T21:36:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e3fb1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc19d1a0 con 0x7f71dc0ff130 2024-09-13T21:36:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e154c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc1003d0 0x7f71dc19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e154c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc1003d0 0x7f71dc19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41656/0 (socket says 172.21.15.88:41656) 2024-09-13T21:36:55.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e154c700 1 -- 172.21.15.88:0/3305263820 learned_addr learned my addr 172.21.15.88:0/3305263820 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:36:55.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e1d4d700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71dc0ff130 0x7f71dc0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:55.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e154c700 1 -- 172.21.15.88:0/3305263820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71dc0ff130 msgr2=0x7f71dc0690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:55.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e154c700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71dc0ff130 0x7f71dc0690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:55.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e154c700 1 -- 172.21.15.88:0/3305263820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80095f0 con 0x7f71dc1003d0 2024-09-13T21:36:55.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e1d4d700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71dc0ff130 0x7f71dc0690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:36:55.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71e154c700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc1003d0 0x7f71dc19cc60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00b4e0 tx=0x7f71cc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:55.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.959+0000 7f71d2ffd700 1 -- 172.21.15.88:0/3305263820 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71cc011800 con 0x7f71dc1003d0 2024-09-13T21:36:55.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.960+0000 7f71d2ffd700 1 -- 172.21.15.88:0/3305263820 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f71cc011e10 con 0x7f71dc1003d0 2024-09-13T21:36:55.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.960+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc19d450 con 0x7f71dc1003d0 2024-09-13T21:36:55.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.960+0000 7f71d2ffd700 1 -- 172.21.15.88:0/3305263820 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71cc00f2e0 con 0x7f71dc1003d0 2024-09-13T21:36:55.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.960+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc19d9a0 con 0x7f71dc1003d0 2024-09-13T21:36:55.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.961+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc107c90 con 0x7f71dc1003d0 2024-09-13T21:36:55.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.961+0000 7f71d2ffd700 1 -- 172.21.15.88:0/3305263820 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f71cc010380 con 0x7f71dc1003d0 2024-09-13T21:36:55.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.961+0000 7f71d2ffd700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71c806c680 0x7f71c806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:55.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.962+0000 7f71e1d4d700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71c806c680 0x7f71c806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:55.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.962+0000 7f71d2ffd700 1 -- 172.21.15.88:0/3305263820 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f71cc08b0e0 con 0x7f71dc1003d0 2024-09-13T21:36:55.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.962+0000 7f71e1d4d700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71c806c680 0x7f71c806eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71d800b5c0 tx=0x7f71d8005e20 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:55.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:55.966+0000 7f71d2ffd700 1 -- 172.21.15.88:0/3305263820 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f71cc059630 con 0x7f71dc1003d0 2024-09-13T21:36:56.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.229+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f71dc107e80 con 0x7f71dc1003d0 2024-09-13T21:36:56.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.234+0000 7f71d2ffd700 1 -- 172.21.15.88:0/3305263820 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f71cc0591c0 con 0x7f71dc1003d0 2024-09-13T21:36:56.236 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-09-13T21:36:56.236 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB4sORmaLrGDRAAxkHBDOrEvgBcXEURqffo8g== 2024-09-13T21:36:56.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71c806c680 msgr2=0x7f71c806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:56.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71c806c680 0x7f71c806eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71d800b5c0 tx=0x7f71d8005e20 comp rx=0 tx=0).stop 2024-09-13T21:36:56.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc1003d0 msgr2=0x7f71dc19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:56.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc1003d0 0x7f71dc19cc60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00b4e0 tx=0x7f71cc00b8a0 comp rx=0 tx=0).stop 2024-09-13T21:36:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 shutdown_connections 2024-09-13T21:36:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f71c806c680 0x7f71c806eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71dc0ff130 0x7f71dc0690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 --2- 172.21.15.88:0/3305263820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71dc1003d0 0x7f71dc19cc60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 >> 172.21.15.88:0/3305263820 conn(0x7f71dc0fa780 msgr2=0x7f71dc103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.236+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 shutdown_connections 2024-09-13T21:36:56.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:36:56.237+0000 7f71e3fb1700 1 -- 172.21.15.88:0/3305263820 wait complete. 2024-09-13T21:36:56.862 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:36:56.862 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T21:36:56.862 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T21:36:56.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:56 smithi088 ceph-mon[27963]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:56.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:56 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3305263820' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:36:56.888 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:56 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3305263820' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T21:36:56.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T21:36:57.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:56 smithi116 ceph-mon[33391]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:57.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:56 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3305263820' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:36:57.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:56 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3305263820' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T21:36:57.109 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi116/config 2024-09-13T21:36:58.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.720+0000 7fd890228700 1 -- 172.21.15.116:0/414879237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 msgr2=0x7fd8880ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:58.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.720+0000 7fd890228700 1 --2- 172.21.15.116:0/414879237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 0x7fd8880ff4b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd878009910 tx=0x7fd878009c20 comp rx=0 tx=0).stop 2024-09-13T21:36:58.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.720+0000 7fd890228700 1 -- 172.21.15.116:0/414879237 shutdown_connections 2024-09-13T21:36:58.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.720+0000 7fd890228700 1 --2- 172.21.15.116:0/414879237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 0x7fd8880ff4b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:58.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.720+0000 7fd890228700 1 --2- 172.21.15.116:0/414879237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd888100750 0x7fd888100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:58.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.720+0000 7fd890228700 1 -- 172.21.15.116:0/414879237 >> 172.21.15.116:0/414879237 conn(0x7fd8880f9f10 msgr2=0x7fd8880fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:58.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd890228700 1 -- 172.21.15.116:0/414879237 shutdown_connections 2024-09-13T21:36:58.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd890228700 1 -- 172.21.15.116:0/414879237 wait complete. 2024-09-13T21:36:58.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd890228700 1 Processor -- start 2024-09-13T21:36:58.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd890228700 1 -- start start 2024-09-13T21:36:58.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd890228700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd888100750 0x7fd8881949d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:58.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd890228700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 0x7fd888194f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:58.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd890228700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd888195530 con 0x7fd888100750 2024-09-13T21:36:58.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd890228700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd888195670 con 0x7fd8881010a0 2024-09-13T21:36:58.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd88d7c3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 0x7fd888194f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:58.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd88d7c3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 0x7fd888194f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:59508/0 (socket says 172.21.15.116:59508) 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.721+0000 7fd88d7c3700 1 -- 172.21.15.116:0/3795436709 learned_addr learned my addr 172.21.15.116:0/3795436709 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd88dfc4700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd888100750 0x7fd8881949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd88d7c3700 1 -- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd888100750 msgr2=0x7fd8881949d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd88d7c3700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd888100750 0x7fd8881949d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd88d7c3700 1 -- 172.21.15.116:0/3795436709 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780095f0 con 0x7fd8881010a0 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd88d7c3700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 0x7fd888194f10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd878006010 tx=0x7fd87800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd87effd700 1 -- 172.21.15.116:0/3795436709 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87801d070 con 0x7fd8881010a0 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88819a0c0 con 0x7fd8881010a0 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88819a5b0 con 0x7fd8881010a0 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd87effd700 1 -- 172.21.15.116:0/3795436709 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd87800f460 con 0x7fd8881010a0 2024-09-13T21:36:58.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.722+0000 7fd87effd700 1 -- 172.21.15.116:0/3795436709 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd878021640 con 0x7fd8881010a0 2024-09-13T21:36:58.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.723+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd888107c00 con 0x7fd8881010a0 2024-09-13T21:36:58.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.723+0000 7fd87effd700 1 -- 172.21.15.116:0/3795436709 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd87800fab0 con 0x7fd8881010a0 2024-09-13T21:36:58.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.724+0000 7fd87effd700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd87406c680 0x7fd87406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:58.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.724+0000 7fd87effd700 1 -- 172.21.15.116:0/3795436709 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fd87808c5f0 con 0x7fd8881010a0 2024-09-13T21:36:58.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.724+0000 7fd88dfc4700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd87406c680 0x7fd87406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:58.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.725+0000 7fd88dfc4700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd87406c680 0x7fd87406eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd888068da0 tx=0x7fd88400b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:58.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.728+0000 7fd87effd700 1 -- 172.21.15.116:0/3795436709 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd87805abc0 con 0x7fd8881010a0 2024-09-13T21:36:58.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:58.997+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd888107dc0 con 0x7fd8881010a0 2024-09-13T21:36:59.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.003+0000 7fd87effd700 1 -- 172.21.15.116:0/3795436709 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd87805a750 con 0x7fd8881010a0 2024-09-13T21:36:59.005 INFO:teuthology.orchestra.run.smithi116.stdout:[client.1] 2024-09-13T21:36:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQB7sORmodcBABAAiS5zGzhmbI7vpzX5SUVH3A== 2024-09-13T21:36:59.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd87406c680 msgr2=0x7fd87406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:59.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd87406c680 0x7fd87406eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd888068da0 tx=0x7fd88400b410 comp rx=0 tx=0).stop 2024-09-13T21:36:59.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 msgr2=0x7fd888194f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:59.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 0x7fd888194f10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd878006010 tx=0x7fd87800bd70 comp rx=0 tx=0).stop 2024-09-13T21:36:59.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 shutdown_connections 2024-09-13T21:36:59.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd87406c680 0x7fd87406eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:59.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd888100750 0x7fd8881949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:59.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 --2- 172.21.15.116:0/3795436709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881010a0 0x7fd888194f10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:59.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 >> 172.21.15.116:0/3795436709 conn(0x7fd8880f9f10 msgr2=0x7fd888103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:59.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 shutdown_connections 2024-09-13T21:36:59.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:36:59.005+0000 7fd890228700 1 -- 172.21.15.116:0/3795436709 wait complete. 2024-09-13T21:36:59.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:59 smithi116 ceph-mon[33391]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:59.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:59 smithi116 ceph-mon[33391]: from='client.? 172.21.15.116:0/3795436709' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:36:59.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:59 smithi116 ceph-mon[33391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:36:59.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:36:59 smithi116 ceph-mon[33391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T21:36:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:59 smithi088 ceph-mon[27963]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:36:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:59 smithi088 ceph-mon[27963]: from='client.? 172.21.15.116:0/3795436709' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:36:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:59 smithi088 ceph-mon[27963]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:36:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:36:59 smithi088 ceph-mon[27963]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T21:36:59.646 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:36:59.646 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T21:36:59.646 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T21:36:59.685 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T21:36:59.685 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T21:36:59.685 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T21:36:59.891 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:01.459 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:01 smithi088 ceph-mon[27963]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:01 smithi116 ceph-mon[33391]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.682+0000 7f6092971700 1 -- 172.21.15.88:0/4204640541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 msgr2=0x7f608c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.682+0000 7f6092971700 1 --2- 172.21.15.88:0/4204640541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 0x7f608c0ff720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f607c009910 tx=0x7f607c009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.682+0000 7f6092971700 1 -- 172.21.15.88:0/4204640541 shutdown_connections 2024-09-13T21:37:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.682+0000 7f6092971700 1 --2- 172.21.15.88:0/4204640541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f608c0ffc60 0x7f608c10a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.682+0000 7f6092971700 1 --2- 172.21.15.88:0/4204640541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 0x7f608c0ff720 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.682+0000 7f6092971700 1 -- 172.21.15.88:0/4204640541 >> 172.21.15.88:0/4204640541 conn(0x7f608c0748b0 msgr2=0x7f608c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.682+0000 7f6092971700 1 -- 172.21.15.88:0/4204640541 shutdown_connections 2024-09-13T21:37:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.682+0000 7f6092971700 1 -- 172.21.15.88:0/4204640541 wait complete. 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.683+0000 7f6092971700 1 Processor -- start 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.683+0000 7f6092971700 1 -- start start 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.683+0000 7f6092971700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 0x7f608c100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.683+0000 7f6092971700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f608c0ffc60 0x7f608c100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.683+0000 7f6092971700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c100fb0 con 0x7f608c0ff350 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.683+0000 7f6092971700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c1010f0 con 0x7f608c0ffc60 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.683+0000 7f608bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 0x7f608c100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.683+0000 7f608bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 0x7f608c100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54118/0 (socket says 172.21.15.88:54118) 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.683+0000 7f608bfff700 1 -- 172.21.15.88:0/2032747427 learned_addr learned my addr 172.21.15.88:0/2032747427 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f608b7fe700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f608c0ffc60 0x7f608c100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:01.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f608bfff700 1 -- 172.21.15.88:0/2032747427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f608c0ffc60 msgr2=0x7f608c100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f608bfff700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f608c0ffc60 0x7f608c100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f608bfff700 1 -- 172.21.15.88:0/2032747427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c0095f0 con 0x7f608c0ff350 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f608b7fe700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f608c0ffc60 0x7f608c100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f608bfff700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 0x7f608c100530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f607c006010 tx=0x7f607c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f60897fa700 1 -- 172.21.15.88:0/2032747427 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f607c01d070 con 0x7f608c0ff350 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c101370 con 0x7f608c0ff350 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f60897fa700 1 -- 172.21.15.88:0/2032747427 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f607c00f460 con 0x7f608c0ff350 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f60897fa700 1 -- 172.21.15.88:0/2032747427 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f607c021640 con 0x7f608c0ff350 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.684+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c1a2400 con 0x7f608c0ff350 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.685+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c107dd0 con 0x7f608c0ff350 2024-09-13T21:37:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.685+0000 7f60897fa700 1 -- 172.21.15.88:0/2032747427 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f607c00faf0 con 0x7f608c0ff350 2024-09-13T21:37:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.686+0000 7f60897fa700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f607406c680 0x7f607406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.686+0000 7f60897fa700 1 -- 172.21.15.88:0/2032747427 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f607c08c870 con 0x7f608c0ff350 2024-09-13T21:37:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.686+0000 7f608b7fe700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f607406c680 0x7f607406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.686+0000 7f608b7fe700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f607406c680 0x7f607406eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f608c101d20 tx=0x7f6080008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:01.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.690+0000 7f60897fa700 1 -- 172.21.15.88:0/2032747427 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f607c057330 con 0x7f608c0ff350 2024-09-13T21:37:01.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.934+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f608c101b00 con 0x7f608c0ff350 2024-09-13T21:37:01.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.937+0000 7f60897fa700 1 -- 172.21.15.88:0/2032747427 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172827 (secure 0 0 0) 0x7f607c026090 con 0x7f608c0ff350 2024-09-13T21:37:01.942 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f607406c680 msgr2=0x7f607406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f607406c680 0x7f607406eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f608c101d20 tx=0x7f6080008040 comp rx=0 tx=0).stop 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 msgr2=0x7f608c100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 0x7f608c100530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f607c006010 tx=0x7f607c00be20 comp rx=0 tx=0).stop 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 shutdown_connections 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f607406c680 0x7f607406eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f608c0ff350 0x7f608c100530 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 --2- 172.21.15.88:0/2032747427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f608c0ffc60 0x7f608c100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 >> 172.21.15.88:0/2032747427 conn(0x7f608c0748b0 msgr2=0x7f608c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 shutdown_connections 2024-09-13T21:37:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:01.940+0000 7f6092971700 1 -- 172.21.15.88:0/2032747427 wait complete. 2024-09-13T21:37:02.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:02 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2032747427' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T21:37:02.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:02 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2032747427' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T21:37:02.606 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"active_gid":14211,"active_name":"smithi088.scyrwy","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2},{"type":"v1","addr":"172.21.15.88:6801","nonce":2}]},"active_addr":"172.21.15.88:6801/2","active_change":"2024-09-13T21:33:10.015252+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14236,"name":"smithi116.bqnvtn","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.88:8443/","prometheus":"http://172.21.15.88:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":4216662499}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":916622427}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3898470340}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1962190543}]}]} 2024-09-13T21:37:02.611 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T21:37:02.611 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T21:37:02.611 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T21:37:02.810 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:03.198 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:03 smithi088 ceph-mon[27963]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:03 smithi116 ceph-mon[33391]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:04.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.413+0000 7f08eb199700 1 -- 172.21.15.88:0/233854568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e40730f0 msgr2=0x7f08e40734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:04.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.413+0000 7f08eb199700 1 --2- 172.21.15.88:0/233854568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e40730f0 0x7f08e40734c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009910 tx=0x7f08e0009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:04.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.413+0000 7f08eb199700 1 -- 172.21.15.88:0/233854568 shutdown_connections 2024-09-13T21:37:04.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.413+0000 7f08eb199700 1 --2- 172.21.15.88:0/233854568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08e4073a00 0x7f08e4110d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:04.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.413+0000 7f08eb199700 1 --2- 172.21.15.88:0/233854568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e40730f0 0x7f08e40734c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:04.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.413+0000 7f08eb199700 1 -- 172.21.15.88:0/233854568 >> 172.21.15.88:0/233854568 conn(0x7f08e40fbda0 msgr2=0x7f08e40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:04.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.413+0000 7f08eb199700 1 -- 172.21.15.88:0/233854568 shutdown_connections 2024-09-13T21:37:04.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.413+0000 7f08eb199700 1 -- 172.21.15.88:0/233854568 wait complete. 2024-09-13T21:37:04.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08eb199700 1 Processor -- start 2024-09-13T21:37:04.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08eb199700 1 -- start start 2024-09-13T21:37:04.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08eb199700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08e40730f0 0x7f08e419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:04.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08eb199700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e4073a00 0x7f08e419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:04.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08eb199700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e419d0f0 con 0x7f08e4073a00 2024-09-13T21:37:04.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08eb199700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e41a0e80 con 0x7f08e40730f0 2024-09-13T21:37:04.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08dbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e4073a00 0x7f08e419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:04.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08dbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e4073a00 0x7f08e419ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54130/0 (socket says 172.21.15.88:54130) 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08dbfff700 1 -- 172.21.15.88:0/955232920 learned_addr learned my addr 172.21.15.88:0/955232920 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08e8f35700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08e40730f0 0x7f08e419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08dbfff700 1 -- 172.21.15.88:0/955232920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08e40730f0 msgr2=0x7f08e419c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08dbfff700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08e40730f0 0x7f08e419c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08dbfff700 1 -- 172.21.15.88:0/955232920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00095f0 con 0x7f08e4073a00 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.414+0000 7f08e8f35700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08e40730f0 0x7f08e419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.415+0000 7f08dbfff700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e4073a00 0x7f08e419ca10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f08d400b4b0 tx=0x7f08d400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.415+0000 7f08d9ffb700 1 -- 172.21.15.88:0/955232920 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d4011800 con 0x7f08e4073a00 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.415+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e41a1160 con 0x7f08e4073a00 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.415+0000 7f08d9ffb700 1 -- 172.21.15.88:0/955232920 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08d4011e10 con 0x7f08e4073a00 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.415+0000 7f08d9ffb700 1 -- 172.21.15.88:0/955232920 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d400f2e0 con 0x7f08e4073a00 2024-09-13T21:37:04.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.415+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e41a16b0 con 0x7f08e4073a00 2024-09-13T21:37:04.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.416+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e410e4d0 con 0x7f08e4073a00 2024-09-13T21:37:04.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.416+0000 7f08d9ffb700 1 -- 172.21.15.88:0/955232920 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f08d4010380 con 0x7f08e4073a00 2024-09-13T21:37:04.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.417+0000 7f08d9ffb700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f08cc06c680 0x7f08cc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:04.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.417+0000 7f08d9ffb700 1 -- 172.21.15.88:0/955232920 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f08d408b110 con 0x7f08e4073a00 2024-09-13T21:37:04.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.417+0000 7f08e8f35700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f08cc06c680 0x7f08cc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:04.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.417+0000 7f08e8f35700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f08cc06c680 0x7f08cc06eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08e000b5c0 tx=0x7f08e001a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:04.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.421+0000 7f08d9ffb700 1 -- 172.21.15.88:0/955232920 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f08d4055bd0 con 0x7f08e4073a00 2024-09-13T21:37:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.617+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e404f2a0 con 0x7f08e4073a00 2024-09-13T21:37:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.618+0000 7f08d9ffb700 1 -- 172.21.15.88:0/955232920 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11059 (secure 0 0 0) 0x7f08d40591f0 con 0x7f08e4073a00 2024-09-13T21:37:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:37:04.620 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":41,"fsid":"67511300-7217-11ef-bceb-c7b262605968","created":"2024-09-13T21:31:01.927981+0000","modified":"2024-09-13T21:36:48.212171+0000","last_up_change":"2024-09-13T21:36:47.206709+0000","last_in_change":"2024-09-13T21:36:28.556173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T21:35:32.330283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fc64bc8-3edd-41fd-9fb3-739af88e3c15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6803","nonce":2872339292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6805","nonce":2872339292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6809","nonce":2872339292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6807","nonce":2872339292}]},"public_addr":"172.21.15.88:6803/2872339292","cluster_addr":"172.21.15.88:6805/2872339292","heartbeat_back_addr":"172.21.15.88:6809/2872339292","heartbeat_front_addr":"172.21.15.88:6807/2872339292","state":["exists","up"]},{"osd":1,"uuid":"8aa036b6-0acd-400a-88d2-13989c325da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6811","nonce":2600311836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6813","nonce":2600311836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6817","nonce":2600311836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6815","nonce":2600311836}]},"public_addr":"172.21.15.88:6811/2600311836","cluster_addr":"172.21.15.88:6813/2600311836","heartbeat_back_addr":"172.21.15.88:6817/2600311836","heartbeat_front_addr":"172.21.15.88:6815/2600311836","state":["exists","up"]},{"osd":2,"uuid":"014e6ebe-af5c-462b-9024-9824b6f2fad7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6819","nonce":3497738838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6821","nonce":3497738838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6825","nonce":3497738838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6823","nonce":3497738838}]},"public_addr":"172.21.15.88:6819/3497738838","cluster_addr":"172.21.15.88:6821/3497738838","heartbeat_back_addr":"172.21.15.88:6825/3497738838","heartbeat_front_addr":"172.21.15.88:6823/3497738838","state":["exists","up"]},{"osd":3,"uuid":"76489d88-1fe1-4d01-b7f0-3056a95af473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6801","nonce":1627285017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6803","nonce":1627285017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6807","nonce":1627285017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6805","nonce":1627285017}]},"public_addr":"172.21.15.116:6801/1627285017","cluster_addr":"172.21.15.116:6803/1627285017","heartbeat_back_addr":"172.21.15.116:6807/1627285017","heartbeat_front_addr":"172.21.15.116:6805/1627285017","state":["exists","up"]},{"osd":4,"uuid":"a1f43a3b-669f-4788-a374-85f2d8fc1fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6809","nonce":1515540380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6811","nonce":1515540380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6815","nonce":1515540380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6813","nonce":1515540380}]},"public_addr":"172.21.15.116:6809/1515540380","cluster_addr":"172.21.15.116:6811/1515540380","heartbeat_back_addr":"172.21.15.116:6815/1515540380","heartbeat_front_addr":"172.21.15.116:6813/1515540380","state":["exists","up"]},{"osd":5,"uuid":"bce63c57-85a5-4b7e-bf82-4a42d05e31c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6817","nonce":765762154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6819","nonce":765762154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6823","nonce":765762154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6821","nonce":765762154}]},"public_addr":"172.21.15.116:6817/765762154","cluster_addr":"172.21.15.116:6819/765762154","heartbeat_back_addr":"172.21.15.116:6823/765762154","heartbeat_front_addr":"172.21.15.116:6821/765762154","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:34:31.298874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:35:01.713251+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:35:28.980704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:35:53.224629+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:36:19.382753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:36:45.970734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:0/1718413431":"2024-09-14T21:33:10.015143+0000","172.21.15.88:0/672735579":"2024-09-14T21:33:10.015143+0000","172.21.15.88:0/1989360438":"2024-09-14T21:33:10.015143+0000","172.21.15.88:0/2418246833":"2024-09-14T21:32:04.517540+0000","172.21.15.88:6801/2":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/3497040883":"2024-09-14T21:32:04.517540+0000","172.21.15.88:6800/2":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/250890518":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/1136159910":"2024-09-14T21:32:04.517540+0000","172.21.15.88:0/3319424547":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/3401436245":"2024-09-14T21:31:31.464307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T21:37:04.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.620+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f08cc06c680 msgr2=0x7f08cc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:04.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.620+0000 7f08eb199700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f08cc06c680 0x7f08cc06eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08e000b5c0 tx=0x7f08e001a040 comp rx=0 tx=0).stop 2024-09-13T21:37:04.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.620+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e4073a00 msgr2=0x7f08e419ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.620+0000 7f08eb199700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e4073a00 0x7f08e419ca10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f08d400b4b0 tx=0x7f08d400b870 comp rx=0 tx=0).stop 2024-09-13T21:37:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.620+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 shutdown_connections 2024-09-13T21:37:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.620+0000 7f08eb199700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f08cc06c680 0x7f08cc06eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.620+0000 7f08eb199700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08e40730f0 0x7f08e419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.620+0000 7f08eb199700 1 --2- 172.21.15.88:0/955232920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08e4073a00 0x7f08e419ca10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.620+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 >> 172.21.15.88:0/955232920 conn(0x7f08e40fbda0 msgr2=0x7f08e4102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.621+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 shutdown_connections 2024-09-13T21:37:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:04.621+0000 7f08eb199700 1 -- 172.21.15.88:0/955232920 wait complete. 2024-09-13T21:37:05.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:05 smithi088 ceph-mon[27963]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:05.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:05 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/955232920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:37:05.324 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T21:37:05.324 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T21:37:05.524 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:05 smithi116 ceph-mon[33391]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:05 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/955232920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.078+0000 7fba50f15700 1 -- 172.21.15.88:0/841378051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100460 msgr2=0x7fba4c100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.078+0000 7fba50f15700 1 --2- 172.21.15.88:0/841378051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100460 0x7fba4c100830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009940 tx=0x7fba3c009c50 comp rx=0 tx=0).stop 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.078+0000 7fba50f15700 1 -- 172.21.15.88:0/841378051 shutdown_connections 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.078+0000 7fba50f15700 1 --2- 172.21.15.88:0/841378051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba4c100d70 0x7fba4c1094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.078+0000 7fba50f15700 1 --2- 172.21.15.88:0/841378051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100460 0x7fba4c100830 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.078+0000 7fba50f15700 1 -- 172.21.15.88:0/841378051 >> 172.21.15.88:0/841378051 conn(0x7fba4c0748b0 msgr2=0x7fba4c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.078+0000 7fba50f15700 1 -- 172.21.15.88:0/841378051 shutdown_connections 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.078+0000 7fba50f15700 1 -- 172.21.15.88:0/841378051 wait complete. 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba50f15700 1 Processor -- start 2024-09-13T21:37:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba50f15700 1 -- start start 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba50f15700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba4c100460 0x7fba4c196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba50f15700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100d70 0x7fba4c197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba50f15700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c197730 con 0x7fba4c100d70 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba50f15700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c197870 con 0x7fba4c100460 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba49d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100d70 0x7fba4c197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba49d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100d70 0x7fba4c197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54142/0 (socket says 172.21.15.88:54142) 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba49d9b700 1 -- 172.21.15.88:0/1675149275 learned_addr learned my addr 172.21.15.88:0/1675149275 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba4a59c700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba4c100460 0x7fba4c196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba49d9b700 1 -- 172.21.15.88:0/1675149275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba4c100460 msgr2=0x7fba4c196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba49d9b700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba4c100460 0x7fba4c196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.079+0000 7fba49d9b700 1 -- 172.21.15.88:0/1675149275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c0095f0 con 0x7fba4c100d70 2024-09-13T21:37:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.080+0000 7fba49d9b700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100d70 0x7fba4c197110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c8a0 tx=0x7fba4000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:07.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.080+0000 7fba3b7fe700 1 -- 172.21.15.88:0/1675149275 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba4000cea0 con 0x7fba4c100d70 2024-09-13T21:37:07.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.080+0000 7fba3b7fe700 1 -- 172.21.15.88:0/1675149275 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba40004830 con 0x7fba4c100d70 2024-09-13T21:37:07.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.080+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c19fc40 con 0x7fba4c100d70 2024-09-13T21:37:07.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.080+0000 7fba3b7fe700 1 -- 172.21.15.88:0/1675149275 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba400055b0 con 0x7fba4c100d70 2024-09-13T21:37:07.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.080+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c1a0100 con 0x7fba4c100d70 2024-09-13T21:37:07.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.081+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c106bd0 con 0x7fba4c100d70 2024-09-13T21:37:07.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.081+0000 7fba3b7fe700 1 -- 172.21.15.88:0/1675149275 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fba40007ad0 con 0x7fba4c100d70 2024-09-13T21:37:07.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.082+0000 7fba3b7fe700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fba3406c680 0x7fba3406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:07.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.082+0000 7fba4a59c700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fba3406c680 0x7fba3406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:07.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.082+0000 7fba3b7fe700 1 -- 172.21.15.88:0/1675149275 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fba4008b1c0 con 0x7fba4c100d70 2024-09-13T21:37:07.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.082+0000 7fba4a59c700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fba3406c680 0x7fba3406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0059d0 tx=0x7fba3c005960 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:07.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.086+0000 7fba3b7fe700 1 -- 172.21.15.88:0/1675149275 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fba40055c80 con 0x7fba4c100d70 2024-09-13T21:37:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:06 smithi116 ceph-mon[33391]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:06 smithi088 ceph-mon[27963]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:07.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.278+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba4c04f2a0 con 0x7fba4c100d70 2024-09-13T21:37:07.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.279+0000 7fba3b7fe700 1 -- 172.21.15.88:0/1675149275 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11059 (secure 0 0 0) 0x7fba400592a0 con 0x7fba4c100d70 2024-09-13T21:37:07.281 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:37:07.281 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":41,"fsid":"67511300-7217-11ef-bceb-c7b262605968","created":"2024-09-13T21:31:01.927981+0000","modified":"2024-09-13T21:36:48.212171+0000","last_up_change":"2024-09-13T21:36:47.206709+0000","last_in_change":"2024-09-13T21:36:28.556173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T21:35:32.330283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fc64bc8-3edd-41fd-9fb3-739af88e3c15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6803","nonce":2872339292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6805","nonce":2872339292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6809","nonce":2872339292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2872339292},{"type":"v1","addr":"172.21.15.88:6807","nonce":2872339292}]},"public_addr":"172.21.15.88:6803/2872339292","cluster_addr":"172.21.15.88:6805/2872339292","heartbeat_back_addr":"172.21.15.88:6809/2872339292","heartbeat_front_addr":"172.21.15.88:6807/2872339292","state":["exists","up"]},{"osd":1,"uuid":"8aa036b6-0acd-400a-88d2-13989c325da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6811","nonce":2600311836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6813","nonce":2600311836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6817","nonce":2600311836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2600311836},{"type":"v1","addr":"172.21.15.88:6815","nonce":2600311836}]},"public_addr":"172.21.15.88:6811/2600311836","cluster_addr":"172.21.15.88:6813/2600311836","heartbeat_back_addr":"172.21.15.88:6817/2600311836","heartbeat_front_addr":"172.21.15.88:6815/2600311836","state":["exists","up"]},{"osd":2,"uuid":"014e6ebe-af5c-462b-9024-9824b6f2fad7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6819","nonce":3497738838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6821","nonce":3497738838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6825","nonce":3497738838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3497738838},{"type":"v1","addr":"172.21.15.88:6823","nonce":3497738838}]},"public_addr":"172.21.15.88:6819/3497738838","cluster_addr":"172.21.15.88:6821/3497738838","heartbeat_back_addr":"172.21.15.88:6825/3497738838","heartbeat_front_addr":"172.21.15.88:6823/3497738838","state":["exists","up"]},{"osd":3,"uuid":"76489d88-1fe1-4d01-b7f0-3056a95af473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6801","nonce":1627285017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6803","nonce":1627285017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6807","nonce":1627285017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1627285017},{"type":"v1","addr":"172.21.15.116:6805","nonce":1627285017}]},"public_addr":"172.21.15.116:6801/1627285017","cluster_addr":"172.21.15.116:6803/1627285017","heartbeat_back_addr":"172.21.15.116:6807/1627285017","heartbeat_front_addr":"172.21.15.116:6805/1627285017","state":["exists","up"]},{"osd":4,"uuid":"a1f43a3b-669f-4788-a374-85f2d8fc1fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6809","nonce":1515540380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6811","nonce":1515540380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6815","nonce":1515540380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1515540380},{"type":"v1","addr":"172.21.15.116:6813","nonce":1515540380}]},"public_addr":"172.21.15.116:6809/1515540380","cluster_addr":"172.21.15.116:6811/1515540380","heartbeat_back_addr":"172.21.15.116:6815/1515540380","heartbeat_front_addr":"172.21.15.116:6813/1515540380","state":["exists","up"]},{"osd":5,"uuid":"bce63c57-85a5-4b7e-bf82-4a42d05e31c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6817","nonce":765762154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6819","nonce":765762154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6823","nonce":765762154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":765762154},{"type":"v1","addr":"172.21.15.116:6821","nonce":765762154}]},"public_addr":"172.21.15.116:6817/765762154","cluster_addr":"172.21.15.116:6819/765762154","heartbeat_back_addr":"172.21.15.116:6823/765762154","heartbeat_front_addr":"172.21.15.116:6821/765762154","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:34:31.298874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:35:01.713251+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:35:28.980704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:35:53.224629+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:36:19.382753+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:36:45.970734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:0/1718413431":"2024-09-14T21:33:10.015143+0000","172.21.15.88:0/672735579":"2024-09-14T21:33:10.015143+0000","172.21.15.88:0/1989360438":"2024-09-14T21:33:10.015143+0000","172.21.15.88:0/2418246833":"2024-09-14T21:32:04.517540+0000","172.21.15.88:6801/2":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/3497040883":"2024-09-14T21:32:04.517540+0000","172.21.15.88:6800/2":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/250890518":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/1136159910":"2024-09-14T21:32:04.517540+0000","172.21.15.88:0/3319424547":"2024-09-14T21:31:31.464307+0000","172.21.15.88:0/3401436245":"2024-09-14T21:31:31.464307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T21:37:07.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fba3406c680 msgr2=0x7fba3406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fba3406c680 0x7fba3406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0059d0 tx=0x7fba3c005960 comp rx=0 tx=0).stop 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100d70 msgr2=0x7fba4c197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100d70 0x7fba4c197110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c8a0 tx=0x7fba4000cc60 comp rx=0 tx=0).stop 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 shutdown_connections 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fba3406c680 0x7fba3406eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba4c100460 0x7fba4c196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 --2- 172.21.15.88:0/1675149275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba4c100d70 0x7fba4c197110 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 >> 172.21.15.88:0/1675149275 conn(0x7fba4c0748b0 msgr2=0x7fba4c103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 shutdown_connections 2024-09-13T21:37:07.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:07.281+0000 7fba50f15700 1 -- 172.21.15.88:0/1675149275 wait complete. 2024-09-13T21:37:07.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:07 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1675149275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:37:08.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T21:37:08.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T21:37:08.019 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T21:37:08.019 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T21:37:08.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T21:37:08.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T21:37:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:08.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:07 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/1675149275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:37:08.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:08 smithi088 ceph-mon[27963]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:08 smithi116 ceph-mon[33391]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:09.397 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:09.398 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:09.404 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:10.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:10.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:10.981 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:11.453 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:11 smithi088 ceph-mon[27963]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:11 smithi116 ceph-mon[33391]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.665+0000 7fa65fd01700 1 -- 172.21.15.88:0/2074899591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6581004e0 msgr2=0x7fa6581008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.665+0000 7fa65fd01700 1 --2- 172.21.15.88:0/2074899591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6581004e0 0x7fa6581008b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa654009910 tx=0x7fa654009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.665+0000 7fa65fd01700 1 -- 172.21.15.88:0/2074899591 shutdown_connections 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.665+0000 7fa65fd01700 1 --2- 172.21.15.88:0/2074899591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa658100e80 0x7fa658104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.665+0000 7fa65fd01700 1 --2- 172.21.15.88:0/2074899591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6581004e0 0x7fa6581008b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.665+0000 7fa65fd01700 1 -- 172.21.15.88:0/2074899591 >> 172.21.15.88:0/2074899591 conn(0x7fa6580fbda0 msgr2=0x7fa6580fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.665+0000 7fa65fd01700 1 -- 172.21.15.88:0/2074899591 shutdown_connections 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.665+0000 7fa65fd01700 1 -- 172.21.15.88:0/2074899591 wait complete. 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.666+0000 7fa65fd01700 1 Processor -- start 2024-09-13T21:37:11.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.666+0000 7fa65fd01700 1 -- start start 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.666+0000 7fa65fd01700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6581004e0 0x7fa658073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.666+0000 7fa65fd01700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa658100e80 0x7fa658073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.666+0000 7fa65fd01700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658073ad0 con 0x7fa658100e80 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.666+0000 7fa65fd01700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658073c10 con 0x7fa6581004e0 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.666+0000 7fa65d29c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa658100e80 0x7fa658073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.666+0000 7fa65d29c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa658100e80 0x7fa658073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60852/0 (socket says 172.21.15.88:60852) 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.666+0000 7fa65d29c700 1 -- 172.21.15.88:0/591286333 learned_addr learned my addr 172.21.15.88:0/591286333 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa65da9d700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6581004e0 0x7fa658073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa65d29c700 1 -- 172.21.15.88:0/591286333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6581004e0 msgr2=0x7fa658073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa65d29c700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6581004e0 0x7fa658073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa65d29c700 1 -- 172.21.15.88:0/591286333 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540095f0 con 0x7fa658100e80 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa65d29c700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa658100e80 0x7fa658073590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa64800b480 tx=0x7fa64800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:11.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa64effd700 1 -- 172.21.15.88:0/591286333 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6480118c0 con 0x7fa658100e80 2024-09-13T21:37:11.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa64effd700 1 -- 172.21.15.88:0/591286333 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa648010380 con 0x7fa658100e80 2024-09-13T21:37:11.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6581a2140 con 0x7fa658100e80 2024-09-13T21:37:11.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa64effd700 1 -- 172.21.15.88:0/591286333 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64800f4f0 con 0x7fa658100e80 2024-09-13T21:37:11.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.667+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6581a2550 con 0x7fa658100e80 2024-09-13T21:37:11.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.668+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa65810d6f0 con 0x7fa658100e80 2024-09-13T21:37:11.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.669+0000 7fa64effd700 1 -- 172.21.15.88:0/591286333 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa6480104f0 con 0x7fa658100e80 2024-09-13T21:37:11.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.669+0000 7fa64effd700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa64406c680 0x7fa64406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:11.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.669+0000 7fa64effd700 1 -- 172.21.15.88:0/591286333 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa64808b690 con 0x7fa658100e80 2024-09-13T21:37:11.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.669+0000 7fa65da9d700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa64406c680 0x7fa64406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:11.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.669+0000 7fa64effd700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] conn(0x7fa644072210 0x7fa644074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:11.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.669+0000 7fa64effd700 1 -- 172.21.15.88:0/591286333 --> [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa644074cd0 con 0x7fa644072210 2024-09-13T21:37:11.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.669+0000 7fa64effd700 1 -- 172.21.15.88:0/591286333 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa64808baf0 con 0x7fa658100e80 2024-09-13T21:37:11.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.669+0000 7fa65e29e700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] conn(0x7fa644072210 0x7fa644074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:11.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.669+0000 7fa65da9d700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa64406c680 0x7fa64406eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b5c0 tx=0x7fa65401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:11.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.670+0000 7fa65e29e700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] conn(0x7fa644072210 0x7fa644074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:11.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.670+0000 7fa64effd700 1 -- 172.21.15.88:0/591286333 <== osd.1 v2:172.21.15.88:6810/2600311836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa644074cd0 con 0x7fa644072210 2024-09-13T21:37:11.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 --> [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa65804f2a0 con 0x7fa644072210 2024-09-13T21:37:11.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa64effd700 1 -- 172.21.15.88:0/591286333 <== osd.1 v2:172.21.15.88:6810/2600311836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa65804f2a0 con 0x7fa644072210 2024-09-13T21:37:11.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] conn(0x7fa644072210 msgr2=0x7fa644074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:11.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] conn(0x7fa644072210 0x7fa644074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:11.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa64406c680 msgr2=0x7fa64406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:11.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa64406c680 0x7fa64406eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b5c0 tx=0x7fa65401a040 comp rx=0 tx=0).stop 2024-09-13T21:37:11.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa658100e80 msgr2=0x7fa658073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:11.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa658100e80 0x7fa658073590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa64800b480 tx=0x7fa64800b840 comp rx=0 tx=0).stop 2024-09-13T21:37:11.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 shutdown_connections 2024-09-13T21:37:11.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6810/2600311836,v1:172.21.15.88:6811/2600311836] conn(0x7fa644072210 0x7fa644074620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:11.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fa64406c680 0x7fa64406eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:11.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6581004e0 0x7fa658073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:11.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 --2- 172.21.15.88:0/591286333 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa658100e80 0x7fa658073590 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:11.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.686+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 >> 172.21.15.88:0/591286333 conn(0x7fa6580fbda0 msgr2=0x7fa6580fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:11.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.687+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 shutdown_connections 2024-09-13T21:37:11.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:11.687+0000 7fa65fd01700 1 -- 172.21.15.88:0/591286333 wait complete. 2024-09-13T21:37:13.396 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:13 smithi088 ceph-mon[27963]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:13 smithi116 ceph-mon[33391]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.629+0000 7f0945044700 1 -- 172.21.15.88:0/4018260324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0940100e80 msgr2=0x7f0940104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.629+0000 7f0945044700 1 --2- 172.21.15.88:0/4018260324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0940100e80 0x7f0940104e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0928009910 tx=0x7f0928009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.629+0000 7f0945044700 1 -- 172.21.15.88:0/4018260324 shutdown_connections 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.629+0000 7f0945044700 1 --2- 172.21.15.88:0/4018260324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0940100e80 0x7f0940104e50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.629+0000 7f0945044700 1 --2- 172.21.15.88:0/4018260324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09401004e0 0x7f09401008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.629+0000 7f0945044700 1 -- 172.21.15.88:0/4018260324 >> 172.21.15.88:0/4018260324 conn(0x7f09400fbda0 msgr2=0x7f09400fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.629+0000 7f0945044700 1 -- 172.21.15.88:0/4018260324 shutdown_connections 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.629+0000 7f0945044700 1 -- 172.21.15.88:0/4018260324 wait complete. 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f0945044700 1 Processor -- start 2024-09-13T21:37:14.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f0945044700 1 -- start start 2024-09-13T21:37:14.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f0945044700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09401004e0 0x7f0940073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:14.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f0945044700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0940100e80 0x7f0940073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:14.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f0945044700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940073ad0 con 0x7f09401004e0 2024-09-13T21:37:14.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f0945044700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940073c10 con 0x7f0940100e80 2024-09-13T21:37:14.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f093ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09401004e0 0x7f0940073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f093ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09401004e0 0x7f0940073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60860/0 (socket says 172.21.15.88:60860) 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f093ed9d700 1 -- 172.21.15.88:0/1481449020 learned_addr learned my addr 172.21.15.88:0/1481449020 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.630+0000 7f0937fff700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0940100e80 0x7f0940073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.631+0000 7f093ed9d700 1 -- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0940100e80 msgr2=0x7f0940073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.631+0000 7f093ed9d700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0940100e80 0x7f0940073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.631+0000 7f093ed9d700 1 -- 172.21.15.88:0/1481449020 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09280095f0 con 0x7f09401004e0 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.631+0000 7f093ed9d700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09401004e0 0x7f0940073050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f093000b4b0 tx=0x7f093000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.631+0000 7f093cd99700 1 -- 172.21.15.88:0/1481449020 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0930011800 con 0x7f09401004e0 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.631+0000 7f093cd99700 1 -- 172.21.15.88:0/1481449020 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0930011e10 con 0x7f09401004e0 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.631+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09401a2160 con 0x7f09401004e0 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.631+0000 7f093cd99700 1 -- 172.21.15.88:0/1481449020 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093000f2e0 con 0x7f09401004e0 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.631+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09401a2570 con 0x7f09401004e0 2024-09-13T21:37:14.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.632+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f094010d6d0 con 0x7f09401004e0 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.632+0000 7f093cd99700 1 -- 172.21.15.88:0/1481449020 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0930010380 con 0x7f09401004e0 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.633+0000 7f093cd99700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f092c06c680 0x7f092c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.633+0000 7f093cd99700 1 -- 172.21.15.88:0/1481449020 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f093008b110 con 0x7f09401004e0 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.633+0000 7f0937fff700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f092c06c680 0x7f092c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.633+0000 7f093cd99700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] conn(0x7f092c072210 0x7f092c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.633+0000 7f093cd99700 1 -- 172.21.15.88:0/1481449020 --> [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f092c074cd0 con 0x7f092c072210 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.633+0000 7f093cd99700 1 -- 172.21.15.88:0/1481449020 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f093008d7e0 con 0x7f09401004e0 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.633+0000 7f093f59e700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] conn(0x7f092c072210 0x7f092c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.633+0000 7f0937fff700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f092c06c680 0x7f092c06eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0940074840 tx=0x7f092801a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.634+0000 7f093f59e700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] conn(0x7f092c072210 0x7f092c074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.634+0000 7f093cd99700 1 -- 172.21.15.88:0/1481449020 <== osd.4 v2:172.21.15.116:6808/1515540380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f092c074cd0 con 0x7f092c072210 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 --> [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f094004f2a0 con 0x7f092c072210 2024-09-13T21:37:14.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f093cd99700 1 -- 172.21.15.88:0/1481449020 <== osd.4 v2:172.21.15.116:6808/1515540380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f094004f2a0 con 0x7f092c072210 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] conn(0x7f092c072210 msgr2=0x7f092c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] conn(0x7f092c072210 0x7f092c074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f092c06c680 msgr2=0x7f092c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f092c06c680 0x7f092c06eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0940074840 tx=0x7f092801a040 comp rx=0 tx=0).stop 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09401004e0 msgr2=0x7f0940073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09401004e0 0x7f0940073050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f093000b4b0 tx=0x7f093000b870 comp rx=0 tx=0).stop 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 shutdown_connections 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:6808/1515540380,v1:172.21.15.116:6809/1515540380] conn(0x7f092c072210 0x7f092c074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f092c06c680 0x7f092c06eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09401004e0 0x7f0940073050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 --2- 172.21.15.88:0/1481449020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0940100e80 0x7f0940073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.650+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 >> 172.21.15.88:0/1481449020 conn(0x7f09400fbda0 msgr2=0x7f09400fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:14.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.651+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 shutdown_connections 2024-09-13T21:37:14.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:12.651+0000 7f0945044700 1 -- 172.21.15.88:0/1481449020 wait complete. 2024-09-13T21:37:14.677 INFO:teuthology.orchestra.run.smithi088.stdout:150323855373 2024-09-13T21:37:14.678 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T21:37:14.719 INFO:teuthology.orchestra.run.smithi088.stdout:60129542171 2024-09-13T21:37:14.720 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T21:37:15.399 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:15 smithi116 ceph-mon[33391]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:15 smithi088 ceph-mon[27963]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:17.154 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:16 smithi088 ceph-mon[27963]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.255+0000 7f6e42ab1700 1 -- 172.21.15.88:0/2599106443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c1004e0 msgr2=0x7f6e3c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.255+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/2599106443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c1004e0 0x7f6e3c1008b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009940 tx=0x7f6e30009c50 comp rx=0 tx=0).stop 2024-09-13T21:37:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.255+0000 7f6e42ab1700 1 -- 172.21.15.88:0/2599106443 shutdown_connections 2024-09-13T21:37:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.255+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/2599106443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e3c100df0 0x7f6e3c109550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.255+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/2599106443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c1004e0 0x7f6e3c1008b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.255+0000 7f6e42ab1700 1 -- 172.21.15.88:0/2599106443 >> 172.21.15.88:0/2599106443 conn(0x7f6e3c074930 msgr2=0x7f6e3c074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.255+0000 7f6e42ab1700 1 -- 172.21.15.88:0/2599106443 shutdown_connections 2024-09-13T21:37:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.255+0000 7f6e42ab1700 1 -- 172.21.15.88:0/2599106443 wait complete. 2024-09-13T21:37:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.256+0000 7f6e42ab1700 1 Processor -- start 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.256+0000 7f6e42ab1700 1 -- start start 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.256+0000 7f6e42ab1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e3c1004e0 0x7f6e3c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.256+0000 7f6e42ab1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c100df0 0x7f6e3c19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.256+0000 7f6e42ab1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c19b610 con 0x7f6e3c100df0 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.256+0000 7f6e42ab1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c194ac0 con 0x7f6e3c1004e0 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.256+0000 7f6e3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c100df0 0x7f6e3c19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.256+0000 7f6e3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c100df0 0x7f6e3c19af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60884/0 (socket says 172.21.15.88:60884) 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.256+0000 7f6e3bfff700 1 -- 172.21.15.88:0/4231709355 learned_addr learned my addr 172.21.15.88:0/4231709355 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e4084d700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e3c1004e0 0x7f6e3c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e3bfff700 1 -- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e3c1004e0 msgr2=0x7f6e3c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e3bfff700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e3c1004e0 0x7f6e3c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e3bfff700 1 -- 172.21.15.88:0/4231709355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300095f0 con 0x7f6e3c100df0 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e3bfff700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c100df0 0x7f6e3c19af80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c8a0 tx=0x7f6e2800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e39ffb700 1 -- 172.21.15.88:0/4231709355 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e280078e0 con 0x7f6e3c100df0 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e39ffb700 1 -- 172.21.15.88:0/4231709355 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e2800f450 con 0x7f6e3c100df0 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3c194da0 con 0x7f6e3c100df0 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e39ffb700 1 -- 172.21.15.88:0/4231709355 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e2800e5e0 con 0x7f6e3c100df0 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.257+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c1952f0 con 0x7f6e3c100df0 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.258+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e3c10c5e0 con 0x7f6e3c100df0 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.259+0000 7f6e39ffb700 1 -- 172.21.15.88:0/4231709355 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6e2800f5c0 con 0x7f6e3c100df0 2024-09-13T21:37:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.259+0000 7f6e39ffb700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6e2c06c680 0x7f6e2c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.259+0000 7f6e39ffb700 1 -- 172.21.15.88:0/4231709355 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f6e2808b4a0 con 0x7f6e3c100df0 2024-09-13T21:37:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.259+0000 7f6e4084d700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6e2c06c680 0x7f6e2c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.259+0000 7f6e39ffb700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] conn(0x7f6e2c072210 0x7f6e2c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.259+0000 7f6e39ffb700 1 -- 172.21.15.88:0/4231709355 --> [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e2c074cd0 con 0x7f6e2c072210 2024-09-13T21:37:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.259+0000 7f6e39ffb700 1 -- 172.21.15.88:0/4231709355 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e2808db70 con 0x7f6e3c100df0 2024-09-13T21:37:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.260+0000 7f6e4084d700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6e2c06c680 0x7f6e2c06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6e30005f50 tx=0x7f6e30005dc0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.260+0000 7f6e4104e700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] conn(0x7f6e2c072210 0x7f6e2c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.260+0000 7f6e4104e700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] conn(0x7f6e2c072210 0x7f6e2c074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.261+0000 7f6e39ffb700 1 -- 172.21.15.88:0/4231709355 <== osd.3 v2:172.21.15.116:6800/1627285017 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6e2c074cd0 con 0x7f6e2c072210 2024-09-13T21:37:17.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.277+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 --> [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e3c195830 con 0x7f6e2c072210 2024-09-13T21:37:17.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.277+0000 7f6e39ffb700 1 -- 172.21.15.88:0/4231709355 <== osd.3 v2:172.21.15.116:6800/1627285017 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6e3c195830 con 0x7f6e2c072210 2024-09-13T21:37:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.277+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] conn(0x7f6e2c072210 msgr2=0x7f6e2c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.277+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] conn(0x7f6e2c072210 0x7f6e2c074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6e2c06c680 msgr2=0x7f6e2c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6e2c06c680 0x7f6e2c06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6e30005f50 tx=0x7f6e30005dc0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c100df0 msgr2=0x7f6e3c19af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c100df0 0x7f6e3c19af80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c8a0 tx=0x7f6e2800cbb0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 shutdown_connections 2024-09-13T21:37:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:6800/1627285017,v1:172.21.15.116:6801/1627285017] conn(0x7f6e2c072210 0x7f6e2c074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6e2c06c680 0x7f6e2c06eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e3c1004e0 0x7f6e3c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 --2- 172.21.15.88:0/4231709355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e3c100df0 0x7f6e3c19af80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 >> 172.21.15.88:0/4231709355 conn(0x7f6e3c074930 msgr2=0x7f6e3c103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 shutdown_connections 2024-09-13T21:37:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.278+0000 7f6e42ab1700 1 -- 172.21.15.88:0/4231709355 wait complete. 2024-09-13T21:37:17.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:16 smithi116 ceph-mon[33391]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:17.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.475+0000 7fea28ab5700 1 -- 172.21.15.88:0/1647346311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea240687a0 msgr2=0x7fea24068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.475+0000 7fea28ab5700 1 --2- 172.21.15.88:0/1647346311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea240687a0 0x7fea24068b70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea14009910 tx=0x7fea14009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:17.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.475+0000 7fea28ab5700 1 -- 172.21.15.88:0/1647346311 shutdown_connections 2024-09-13T21:37:17.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.475+0000 7fea28ab5700 1 --2- 172.21.15.88:0/1647346311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea24069140 0x7fea24104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.475+0000 7fea28ab5700 1 --2- 172.21.15.88:0/1647346311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea240687a0 0x7fea24068b70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.475+0000 7fea28ab5700 1 -- 172.21.15.88:0/1647346311 >> 172.21.15.88:0/1647346311 conn(0x7fea24075130 msgr2=0x7fea24075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:17.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.475+0000 7fea28ab5700 1 -- 172.21.15.88:0/1647346311 shutdown_connections 2024-09-13T21:37:17.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.475+0000 7fea28ab5700 1 -- 172.21.15.88:0/1647346311 wait complete. 2024-09-13T21:37:17.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.475+0000 7fea28ab5700 1 Processor -- start 2024-09-13T21:37:17.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea28ab5700 1 -- start start 2024-09-13T21:37:17.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea28ab5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea240687a0 0x7fea24195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea28ab5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24069140 0x7fea24196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea28ab5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea24196b00 con 0x7fea24069140 2024-09-13T21:37:17.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea28ab5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2419a890 con 0x7fea240687a0 2024-09-13T21:37:17.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea19d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24069140 0x7fea24196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea19d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24069140 0x7fea24196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60916/0 (socket says 172.21.15.88:60916) 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea19d9b700 1 -- 172.21.15.88:0/3245878368 learned_addr learned my addr 172.21.15.88:0/3245878368 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea2259c700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea240687a0 0x7fea24195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea19d9b700 1 -- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea240687a0 msgr2=0x7fea24195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea19d9b700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea240687a0 0x7fea24195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.476+0000 7fea19d9b700 1 -- 172.21.15.88:0/3245878368 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140095f0 con 0x7fea24069140 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.477+0000 7fea19d9b700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24069140 0x7fea24196420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00d8d0 tx=0x7fea0c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.477+0000 7fea1bfff700 1 -- 172.21.15.88:0/3245878368 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0c0041f0 con 0x7fea24069140 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.477+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2419ab70 con 0x7fea24069140 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.477+0000 7fea1bfff700 1 -- 172.21.15.88:0/3245878368 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fea0c007620 con 0x7fea24069140 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.477+0000 7fea1bfff700 1 -- 172.21.15.88:0/3245878368 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0c0056b0 con 0x7fea24069140 2024-09-13T21:37:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.477+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2419b0c0 con 0x7fea24069140 2024-09-13T21:37:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.477+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea2410d670 con 0x7fea24069140 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.478+0000 7fea1bfff700 1 -- 172.21.15.88:0/3245878368 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fea0c004750 con 0x7fea24069140 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.479+0000 7fea1bfff700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fea1006c680 0x7fea1006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.479+0000 7fea1bfff700 1 -- 172.21.15.88:0/3245878368 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fea0c08b380 con 0x7fea24069140 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.479+0000 7fea2259c700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fea1006c680 0x7fea1006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.479+0000 7fea1bfff700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] conn(0x7fea10072210 0x7fea10074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.479+0000 7fea1bfff700 1 -- 172.21.15.88:0/3245878368 --> [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea10074cd0 con 0x7fea10072210 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.479+0000 7fea1bfff700 1 -- 172.21.15.88:0/3245878368 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea0c08d9f0 con 0x7fea24069140 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.479+0000 7fea22d9d700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] conn(0x7fea10072210 0x7fea10074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.479+0000 7fea2259c700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fea1006c680 0x7fea1006eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea14006010 tx=0x7fea1401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.479+0000 7fea22d9d700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] conn(0x7fea10072210 0x7fea10074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.480+0000 7fea1bfff700 1 -- 172.21.15.88:0/3245878368 <== osd.5 v2:172.21.15.116:6816/765762154 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fea10074cd0 con 0x7fea10072210 2024-09-13T21:37:17.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.496+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 --> [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea2404f2a0 con 0x7fea10072210 2024-09-13T21:37:17.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.496+0000 7fea1bfff700 1 -- 172.21.15.88:0/3245878368 <== osd.5 v2:172.21.15.116:6816/765762154 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fea2404f2a0 con 0x7fea10072210 2024-09-13T21:37:17.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] conn(0x7fea10072210 msgr2=0x7fea10074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] conn(0x7fea10072210 0x7fea10074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fea1006c680 msgr2=0x7fea1006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fea1006c680 0x7fea1006eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea14006010 tx=0x7fea1401a040 comp rx=0 tx=0).stop 2024-09-13T21:37:17.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24069140 msgr2=0x7fea24196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24069140 0x7fea24196420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00d8d0 tx=0x7fea0c00dbe0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 shutdown_connections 2024-09-13T21:37:17.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:6816/765762154,v1:172.21.15.116:6817/765762154] conn(0x7fea10072210 0x7fea10074620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fea1006c680 0x7fea1006eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea240687a0 0x7fea24195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 --2- 172.21.15.88:0/3245878368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24069140 0x7fea24196420 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 >> 172.21.15.88:0/3245878368 conn(0x7fea24075130 msgr2=0x7fea240fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:17.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 shutdown_connections 2024-09-13T21:37:17.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.497+0000 7fea28ab5700 1 -- 172.21.15.88:0/3245878368 wait complete. 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.896+0000 7fde239a6700 1 -- 172.21.15.88:0/3868240551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 msgr2=0x7fde1c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.896+0000 7fde239a6700 1 --2- 172.21.15.88:0/3868240551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 0x7fde1c100040 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fde0c009910 tx=0x7fde0c009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.896+0000 7fde239a6700 1 -- 172.21.15.88:0/3868240551 shutdown_connections 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.896+0000 7fde239a6700 1 --2- 172.21.15.88:0/3868240551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 0x7fde1c100040 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.896+0000 7fde239a6700 1 --2- 172.21.15.88:0/3868240551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde1c104130 0x7fde1c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.896+0000 7fde239a6700 1 -- 172.21.15.88:0/3868240551 >> 172.21.15.88:0/3868240551 conn(0x7fde1c075130 msgr2=0x7fde1c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.896+0000 7fde239a6700 1 -- 172.21.15.88:0/3868240551 shutdown_connections 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.896+0000 7fde239a6700 1 -- 172.21.15.88:0/3868240551 wait complete. 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde239a6700 1 Processor -- start 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde239a6700 1 -- start start 2024-09-13T21:37:17.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde239a6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 0x7fde1c195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde239a6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde1c104130 0x7fde1c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde239a6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c196a90 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde239a6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c19a820 con 0x7fde1c104130 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde21742700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 0x7fde1c195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde21742700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 0x7fde1c195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60938/0 (socket says 172.21.15.88:60938) 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde21742700 1 -- 172.21.15.88:0/1667655717 learned_addr learned my addr 172.21.15.88:0/1667655717 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde20f41700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde1c104130 0x7fde1c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde21742700 1 -- 172.21.15.88:0/1667655717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde1c104130 msgr2=0x7fde1c1963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde21742700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde1c104130 0x7fde1c1963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde21742700 1 -- 172.21.15.88:0/1667655717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0095f0 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde20f41700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde1c104130 0x7fde1c1963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:37:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde21742700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 0x7fde1c195e70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde1800d8d0 tx=0x7fde1800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde127fc700 1 -- 172.21.15.88:0/1667655717 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde18009940 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1c19ab00 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.897+0000 7fde127fc700 1 -- 172.21.15.88:0/1667655717 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fde18010460 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.898+0000 7fde127fc700 1 -- 172.21.15.88:0/1667655717 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde1800f5f0 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.898+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c19b050 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.898+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde1c10c5c0 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.899+0000 7fde127fc700 1 -- 172.21.15.88:0/1667655717 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fde180105d0 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.899+0000 7fde127fc700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fde0806c680 0x7fde0806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.899+0000 7fde20f41700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fde0806c680 0x7fde0806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.899+0000 7fde127fc700 1 -- 172.21.15.88:0/1667655717 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fde1808b4a0 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.900+0000 7fde127fc700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] conn(0x7fde08072210 0x7fde08074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.900+0000 7fde127fc700 1 -- 172.21.15.88:0/1667655717 --> [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde08074cd0 con 0x7fde08072210 2024-09-13T21:37:17.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.900+0000 7fde127fc700 1 -- 172.21.15.88:0/1667655717 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde1808db70 con 0x7fde1c0ffbd0 2024-09-13T21:37:17.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.900+0000 7fde21f43700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] conn(0x7fde08072210 0x7fde08074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.900+0000 7fde20f41700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fde0806c680 0x7fde0806eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde0c005f50 tx=0x7fde0c005dc0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.900+0000 7fde21f43700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] conn(0x7fde08072210 0x7fde08074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.901+0000 7fde127fc700 1 -- 172.21.15.88:0/1667655717 <== osd.0 v2:172.21.15.88:6802/2872339292 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fde08074cd0 con 0x7fde08072210 2024-09-13T21:37:17.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.916+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 --> [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde1c04f2a0 con 0x7fde08072210 2024-09-13T21:37:17.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.916+0000 7fde127fc700 1 -- 172.21.15.88:0/1667655717 <== osd.0 v2:172.21.15.88:6802/2872339292 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fde1c04f2a0 con 0x7fde08072210 2024-09-13T21:37:17.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] conn(0x7fde08072210 msgr2=0x7fde08074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] conn(0x7fde08072210 0x7fde08074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fde0806c680 msgr2=0x7fde0806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fde0806c680 0x7fde0806eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde0c005f50 tx=0x7fde0c005dc0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 msgr2=0x7fde1c195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 0x7fde1c195e70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde1800d8d0 tx=0x7fde1800dc90 comp rx=0 tx=0).stop 2024-09-13T21:37:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 shutdown_connections 2024-09-13T21:37:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6802/2872339292,v1:172.21.15.88:6803/2872339292] conn(0x7fde08072210 0x7fde08074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fde0806c680 0x7fde0806eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde1c0ffbd0 0x7fde1c195e70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 --2- 172.21.15.88:0/1667655717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde1c104130 0x7fde1c1963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 >> 172.21.15.88:0/1667655717 conn(0x7fde1c075130 msgr2=0x7fde1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 shutdown_connections 2024-09-13T21:37:17.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:17.917+0000 7fde239a6700 1 -- 172.21.15.88:0/1667655717 wait complete. 2024-09-13T21:37:19.028 INFO:teuthology.orchestra.run.smithi088.stdout:171798691848 2024-09-13T21:37:19.028 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T21:37:19.326 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:19 smithi088 ceph-mon[27963]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:19 smithi116 ceph-mon[33391]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:19.723 INFO:teuthology.orchestra.run.smithi088.stdout:38654705699 2024-09-13T21:37:19.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T21:37:20.210 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:20.213 INFO:teuthology.orchestra.run.smithi088.stdout:115964117011 2024-09-13T21:37:20.214 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T21:37:20.994 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:21.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.019+0000 7fe9b0da3700 1 -- 172.21.15.88:0/1440143952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 msgr2=0x7fe9ac0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:21.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.019+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/1440143952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 0x7fe9ac0ff790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009910 tx=0x7fe99c009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:21.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.019+0000 7fe9b0da3700 1 -- 172.21.15.88:0/1440143952 shutdown_connections 2024-09-13T21:37:21.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.019+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/1440143952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9ac0ffd60 0x7fe9ac103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:21.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.019+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/1440143952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 0x7fe9ac0ff790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:21.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.019+0000 7fe9b0da3700 1 -- 172.21.15.88:0/1440143952 >> 172.21.15.88:0/1440143952 conn(0x7fe9ac0fac60 msgr2=0x7fe9ac0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:21.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.019+0000 7fe9b0da3700 1 -- 172.21.15.88:0/1440143952 shutdown_connections 2024-09-13T21:37:21.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.019+0000 7fe9b0da3700 1 -- 172.21.15.88:0/1440143952 wait complete. 2024-09-13T21:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.020+0000 7fe9b0da3700 1 Processor -- start 2024-09-13T21:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.020+0000 7fe9b0da3700 1 -- start start 2024-09-13T21:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.020+0000 7fe9b0da3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 0x7fe9ac196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.020+0000 7fe9b0da3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9ac0ffd60 0x7fe9ac197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.020+0000 7fe9b0da3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac197960 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.020+0000 7fe9b0da3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac197aa0 con 0x7fe9ac0ffd60 2024-09-13T21:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.020+0000 7fe9aa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 0x7fe9ac196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.020+0000 7fe9aa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 0x7fe9ac196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58112/0 (socket says 172.21.15.88:58112) 2024-09-13T21:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.020+0000 7fe9aa59c700 1 -- 172.21.15.88:0/4269151326 learned_addr learned my addr 172.21.15.88:0/4269151326 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe9a9d9b700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9ac0ffd60 0x7fe9ac197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe9aa59c700 1 -- 172.21.15.88:0/4269151326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9ac0ffd60 msgr2=0x7fe9ac197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe9aa59c700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9ac0ffd60 0x7fe9ac197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe9aa59c700 1 -- 172.21.15.88:0/4269151326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0095f0 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe9aa59c700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 0x7fe9ac196e00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe99c006010 tx=0x7fe99c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe99b7fe700 1 -- 172.21.15.88:0/4269151326 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99c01d070 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac19fe70 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac1a0280 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe99b7fe700 1 -- 172.21.15.88:0/4269151326 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe99c00f460 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.021+0000 7fe99b7fe700 1 -- 172.21.15.88:0/4269151326 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99c021640 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.022+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe98c000ff0 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.023+0000 7fe99b7fe700 1 -- 172.21.15.88:0/4269151326 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe99c004b70 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.023+0000 7fe99b7fe700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe99406c680 0x7fe99406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.023+0000 7fe99b7fe700 1 -- 172.21.15.88:0/4269151326 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe99c08d0d0 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.023+0000 7fe9a9d9b700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe99406c680 0x7fe99406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.023+0000 7fe99b7fe700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] conn(0x7fe994072210 0x7fe994074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.023+0000 7fe99b7fe700 1 -- 172.21.15.88:0/4269151326 --> [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe994074cd0 con 0x7fe994072210 2024-09-13T21:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.023+0000 7fe99b7fe700 1 -- 172.21.15.88:0/4269151326 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe99c08d530 con 0x7fe9ac0ff3c0 2024-09-13T21:37:21.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.024+0000 7fe9aad9d700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] conn(0x7fe994072210 0x7fe994074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:21.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.024+0000 7fe9a9d9b700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe99406c680 0x7fe99406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0006fd0 tx=0x7fe9a0008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:21.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.024+0000 7fe9aad9d700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] conn(0x7fe994072210 0x7fe994074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:21.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.025+0000 7fe99b7fe700 1 -- 172.21.15.88:0/4269151326 <== osd.2 v2:172.21.15.88:6818/3497738838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe994074cd0 con 0x7fe994072210 2024-09-13T21:37:21.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.041+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 --> [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe98c002ce0 con 0x7fe994072210 2024-09-13T21:37:21.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.041+0000 7fe99b7fe700 1 -- 172.21.15.88:0/4269151326 <== osd.2 v2:172.21.15.88:6818/3497738838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe98c002ce0 con 0x7fe994072210 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.041+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] conn(0x7fe994072210 msgr2=0x7fe994074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.041+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] conn(0x7fe994072210 0x7fe994074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe99406c680 msgr2=0x7fe99406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe99406c680 0x7fe99406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0006fd0 tx=0x7fe9a0008040 comp rx=0 tx=0).stop 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 msgr2=0x7fe9ac196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 0x7fe9ac196e00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe99c006010 tx=0x7fe99c00be20 comp rx=0 tx=0).stop 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 shutdown_connections 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6818/3497738838,v1:172.21.15.88:6819/3497738838] conn(0x7fe994072210 0x7fe994074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fe99406c680 0x7fe99406eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac0ff3c0 0x7fe9ac196e00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 --2- 172.21.15.88:0/4269151326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9ac0ffd60 0x7fe9ac197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:21.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 >> 172.21.15.88:0/4269151326 conn(0x7fe9ac0fac60 msgr2=0x7fe9ac0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 shutdown_connections 2024-09-13T21:37:21.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:21.042+0000 7fe9b0da3700 1 -- 172.21.15.88:0/4269151326 wait complete. 2024-09-13T21:37:21.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:21 smithi088 ceph-mon[27963]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:21.592 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:21 smithi116 ceph-mon[33391]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:22.080 INFO:teuthology.orchestra.run.smithi088.stdout:81604378648 2024-09-13T21:37:22.081 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T21:37:22.552 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:22.593 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:23.427 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:23 smithi088 ceph-mon[27963]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:23.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:23 smithi116 ceph-mon[33391]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:25.210 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:25.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:25 smithi088 ceph-mon[27963]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:25 smithi116 ceph-mon[33391]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:26.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.168+0000 7f7068df0700 1 -- 172.21.15.88:0/2021889463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7064100e80 msgr2=0x7f7064104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:26.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.168+0000 7f7068df0700 1 --2- 172.21.15.88:0/2021889463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7064100e80 0x7f7064104e50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f704c009910 tx=0x7f704c009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:26.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.168+0000 7f7068df0700 1 -- 172.21.15.88:0/2021889463 shutdown_connections 2024-09-13T21:37:26.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.168+0000 7f7068df0700 1 --2- 172.21.15.88:0/2021889463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7064100e80 0x7f7064104e50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:26.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.168+0000 7f7068df0700 1 --2- 172.21.15.88:0/2021889463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70641004e0 0x7f70641008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:26.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.168+0000 7f7068df0700 1 -- 172.21.15.88:0/2021889463 >> 172.21.15.88:0/2021889463 conn(0x7f70640fbda0 msgr2=0x7f70640fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:26.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.168+0000 7f7068df0700 1 -- 172.21.15.88:0/2021889463 shutdown_connections 2024-09-13T21:37:26.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.168+0000 7f7068df0700 1 -- 172.21.15.88:0/2021889463 wait complete. 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.168+0000 7f7068df0700 1 Processor -- start 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f7068df0700 1 -- start start 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f7068df0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70641004e0 0x7f7064195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f7068df0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7064100e80 0x7f7064196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f7068df0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7064196b50 con 0x7f70641004e0 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f7068df0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706419a8e0 con 0x7f7064100e80 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f706259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70641004e0 0x7f7064195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f706259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70641004e0 0x7f7064195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58144/0 (socket says 172.21.15.88:58144) 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f706259c700 1 -- 172.21.15.88:0/3862846094 learned_addr learned my addr 172.21.15.88:0/3862846094 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f7059d9b700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7064100e80 0x7f7064196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:26.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f706259c700 1 -- 172.21.15.88:0/3862846094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7064100e80 msgr2=0x7f7064196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:26.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f706259c700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7064100e80 0x7f7064196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:26.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f706259c700 1 -- 172.21.15.88:0/3862846094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c0095f0 con 0x7f70641004e0 2024-09-13T21:37:26.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.169+0000 7f706259c700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70641004e0 0x7f7064195f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f705400ada0 tx=0x7f705400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:26.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.170+0000 7f705bfff700 1 -- 172.21.15.88:0/3862846094 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705400f070 con 0x7f70641004e0 2024-09-13T21:37:26.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.170+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706419abc0 con 0x7f70641004e0 2024-09-13T21:37:26.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.170+0000 7f705bfff700 1 -- 172.21.15.88:0/3862846094 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7054007bf0 con 0x7f70641004e0 2024-09-13T21:37:26.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.170+0000 7f705bfff700 1 -- 172.21.15.88:0/3862846094 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7054005670 con 0x7f70641004e0 2024-09-13T21:37:26.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.170+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706419b110 con 0x7f70641004e0 2024-09-13T21:37:26.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.171+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7064108850 con 0x7f70641004e0 2024-09-13T21:37:26.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.171+0000 7f705bfff700 1 -- 172.21.15.88:0/3862846094 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f70540058e0 con 0x7f70641004e0 2024-09-13T21:37:26.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.172+0000 7f705bfff700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f705006c680 0x7f705006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:26.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.172+0000 7f7059d9b700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f705006c680 0x7f705006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:26.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.172+0000 7f705bfff700 1 -- 172.21.15.88:0/3862846094 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f705408aea0 con 0x7f70641004e0 2024-09-13T21:37:26.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.172+0000 7f7059d9b700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f705006c680 0x7f705006eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7064197550 tx=0x7f704c01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:26.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.176+0000 7f705bfff700 1 -- 172.21.15.88:0/3862846094 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7054055a10 con 0x7f70641004e0 2024-09-13T21:37:26.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.375+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7064197390 con 0x7f70641004e0 2024-09-13T21:37:26.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.375+0000 7f705bfff700 1 -- 172.21.15.88:0/3862846094 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7054059030 con 0x7f70641004e0 2024-09-13T21:37:26.377 INFO:teuthology.orchestra.run.smithi088.stdout:60129542173 2024-09-13T21:37:26.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f705006c680 msgr2=0x7f705006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:26.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f705006c680 0x7f705006eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7064197550 tx=0x7f704c01a040 comp rx=0 tx=0).stop 2024-09-13T21:37:26.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70641004e0 msgr2=0x7f7064195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70641004e0 0x7f7064195f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f705400ada0 tx=0x7f705400c330 comp rx=0 tx=0).stop 2024-09-13T21:37:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 shutdown_connections 2024-09-13T21:37:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f705006c680 0x7f705006eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70641004e0 0x7f7064195f30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 --2- 172.21.15.88:0/3862846094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7064100e80 0x7f7064196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 >> 172.21.15.88:0/3862846094 conn(0x7f70640fbda0 msgr2=0x7f70640fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 shutdown_connections 2024-09-13T21:37:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:26.377+0000 7f7068df0700 1 -- 172.21.15.88:0/3862846094 wait complete. 2024-09-13T21:37:26.956 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:26 smithi116 ceph-mon[33391]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:26.956 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:26 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3862846094' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T21:37:27.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:26 smithi088 ceph-mon[27963]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:27.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:26 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3862846094' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T21:37:27.471 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542171 got 60129542173 for osd.1 2024-09-13T21:37:27.471 DEBUG:teuthology.parallel:result is None 2024-09-13T21:37:28.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.022+0000 7fec69e7c700 1 -- 172.21.15.88:0/1232336455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ffc60 msgr2=0x7fec6410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:28.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.022+0000 7fec69e7c700 1 --2- 172.21.15.88:0/1232336455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ffc60 0x7fec6410a6d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec58009910 tx=0x7fec58009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:28.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.022+0000 7fec69e7c700 1 -- 172.21.15.88:0/1232336455 shutdown_connections 2024-09-13T21:37:28.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.022+0000 7fec69e7c700 1 --2- 172.21.15.88:0/1232336455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ffc60 0x7fec6410a6d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.022+0000 7fec69e7c700 1 --2- 172.21.15.88:0/1232336455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec640ff350 0x7fec640ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.022+0000 7fec69e7c700 1 -- 172.21.15.88:0/1232336455 >> 172.21.15.88:0/1232336455 conn(0x7fec640748b0 msgr2=0x7fec64074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:28.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.022+0000 7fec69e7c700 1 -- 172.21.15.88:0/1232336455 shutdown_connections 2024-09-13T21:37:28.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.022+0000 7fec69e7c700 1 -- 172.21.15.88:0/1232336455 wait complete. 2024-09-13T21:37:28.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.023+0000 7fec69e7c700 1 Processor -- start 2024-09-13T21:37:28.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.023+0000 7fec69e7c700 1 -- start start 2024-09-13T21:37:28.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.023+0000 7fec69e7c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ff350 0x7fec64100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:28.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.023+0000 7fec69e7c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec640ffc60 0x7fec64100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:28.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.023+0000 7fec69e7c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec64100fb0 con 0x7fec640ff350 2024-09-13T21:37:28.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.023+0000 7fec69e7c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec641010f0 con 0x7fec640ffc60 2024-09-13T21:37:28.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.023+0000 7fec637fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ff350 0x7fec64100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:28.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.023+0000 7fec637fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ff350 0x7fec64100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58168/0 (socket says 172.21.15.88:58168) 2024-09-13T21:37:28.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.023+0000 7fec637fe700 1 -- 172.21.15.88:0/2957846794 learned_addr learned my addr 172.21.15.88:0/2957846794 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec62ffd700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec640ffc60 0x7fec64100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec637fe700 1 -- 172.21.15.88:0/2957846794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec640ffc60 msgr2=0x7fec64100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec637fe700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec640ffc60 0x7fec64100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec637fe700 1 -- 172.21.15.88:0/2957846794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec580095f0 con 0x7fec640ff350 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec62ffd700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec640ffc60 0x7fec64100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec637fe700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ff350 0x7fec64100530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c8a0 tx=0x7fec5400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec60ff9700 1 -- 172.21.15.88:0/2957846794 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5400cea0 con 0x7fec640ff350 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec641a20e0 con 0x7fec640ff350 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec60ff9700 1 -- 172.21.15.88:0/2957846794 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec54004830 con 0x7fec640ff350 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec60ff9700 1 -- 172.21.15.88:0/2957846794 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec540055b0 con 0x7fec640ff350 2024-09-13T21:37:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.024+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec641a24f0 con 0x7fec640ff350 2024-09-13T21:37:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.025+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec64107dd0 con 0x7fec640ff350 2024-09-13T21:37:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.025+0000 7fec60ff9700 1 -- 172.21.15.88:0/2957846794 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fec54007ad0 con 0x7fec640ff350 2024-09-13T21:37:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.026+0000 7fec60ff9700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec4c06c680 0x7fec4c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.026+0000 7fec60ff9700 1 -- 172.21.15.88:0/2957846794 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fec5408b200 con 0x7fec640ff350 2024-09-13T21:37:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.026+0000 7fec62ffd700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec4c06c680 0x7fec4c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.026+0000 7fec62ffd700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec4c06c680 0x7fec4c06eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec5800b5c0 tx=0x7fec58005480 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:28.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.030+0000 7fec60ff9700 1 -- 172.21.15.88:0/2957846794 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fec54055cc0 con 0x7fec640ff350 2024-09-13T21:37:28.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.225+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec641077b0 con 0x7fec640ff350 2024-09-13T21:37:28.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.225+0000 7fec60ff9700 1 -- 172.21.15.88:0/2957846794 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec540592e0 con 0x7fec640ff350 2024-09-13T21:37:28.227 INFO:teuthology.orchestra.run.smithi088.stdout:38654705701 2024-09-13T21:37:28.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec4c06c680 msgr2=0x7fec4c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:28.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec4c06c680 0x7fec4c06eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec5800b5c0 tx=0x7fec58005480 comp rx=0 tx=0).stop 2024-09-13T21:37:28.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ff350 msgr2=0x7fec64100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:28.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ff350 0x7fec64100530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c8a0 tx=0x7fec5400cc60 comp rx=0 tx=0).stop 2024-09-13T21:37:28.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 shutdown_connections 2024-09-13T21:37:28.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fec4c06c680 0x7fec4c06eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec640ff350 0x7fec64100530 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 --2- 172.21.15.88:0/2957846794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec640ffc60 0x7fec64100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 >> 172.21.15.88:0/2957846794 conn(0x7fec640748b0 msgr2=0x7fec64104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:28.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 shutdown_connections 2024-09-13T21:37:28.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:28.227+0000 7fec69e7c700 1 -- 172.21.15.88:0/2957846794 wait complete. 2024-09-13T21:37:29.299 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:29 smithi088 ceph-mon[27963]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:29.299 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:29 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2957846794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T21:37:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.399+0000 7f32c944e700 1 -- 172.21.15.88:0/4272510490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ffd60 msgr2=0x7f32c4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.399+0000 7f32c944e700 1 --2- 172.21.15.88:0/4272510490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ffd60 0x7f32c4103d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009910 tx=0x7f32ac009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.399+0000 7f32c944e700 1 -- 172.21.15.88:0/4272510490 shutdown_connections 2024-09-13T21:37:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.399+0000 7f32c944e700 1 --2- 172.21.15.88:0/4272510490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ffd60 0x7f32c4103d30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.399+0000 7f32c944e700 1 --2- 172.21.15.88:0/4272510490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c40ff3c0 0x7f32c40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.399+0000 7f32c944e700 1 -- 172.21.15.88:0/4272510490 >> 172.21.15.88:0/4272510490 conn(0x7f32c40fac60 msgr2=0x7f32c40fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.399+0000 7f32c944e700 1 -- 172.21.15.88:0/4272510490 shutdown_connections 2024-09-13T21:37:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.399+0000 7f32c944e700 1 -- 172.21.15.88:0/4272510490 wait complete. 2024-09-13T21:37:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.400+0000 7f32c944e700 1 Processor -- start 2024-09-13T21:37:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.400+0000 7f32c944e700 1 -- start start 2024-09-13T21:37:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.400+0000 7f32c944e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ff3c0 0x7f32c4194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.400+0000 7f32c944e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c40ffd60 0x7f32c4195410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.400+0000 7f32c944e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4195af0 con 0x7f32c40ff3c0 2024-09-13T21:37:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.400+0000 7f32c944e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4199880 con 0x7f32c40ffd60 2024-09-13T21:37:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.400+0000 7f32c2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ff3c0 0x7f32c4194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.400+0000 7f32c2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ff3c0 0x7f32c4194ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58192/0 (socket says 172.21.15.88:58192) 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.400+0000 7f32c2ffd700 1 -- 172.21.15.88:0/665023187 learned_addr learned my addr 172.21.15.88:0/665023187 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32c27fc700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c40ffd60 0x7f32c4195410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32c2ffd700 1 -- 172.21.15.88:0/665023187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c40ffd60 msgr2=0x7f32c4195410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32c2ffd700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c40ffd60 0x7f32c4195410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32c2ffd700 1 -- 172.21.15.88:0/665023187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac0095f0 con 0x7f32c40ff3c0 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32c2ffd700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ff3c0 0x7f32c4194ed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00b4b0 tx=0x7f32bc00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32bbfff700 1 -- 172.21.15.88:0/665023187 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32bc011800 con 0x7f32c40ff3c0 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32bbfff700 1 -- 172.21.15.88:0/665023187 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32bc011e10 con 0x7f32c40ff3c0 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c4199b60 con 0x7f32c40ff3c0 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32bbfff700 1 -- 172.21.15.88:0/665023187 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32bc00f2e0 con 0x7f32c40ff3c0 2024-09-13T21:37:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.401+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c419a0b0 con 0x7f32c40ff3c0 2024-09-13T21:37:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.402+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c4107660 con 0x7f32c40ff3c0 2024-09-13T21:37:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.403+0000 7f32bbfff700 1 -- 172.21.15.88:0/665023187 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f32bc010380 con 0x7f32c40ff3c0 2024-09-13T21:37:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.403+0000 7f32bbfff700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f32b006c680 0x7f32b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.403+0000 7f32c27fc700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f32b006c680 0x7f32b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.403+0000 7f32bbfff700 1 -- 172.21.15.88:0/665023187 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f32bc08b070 con 0x7f32c40ff3c0 2024-09-13T21:37:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.404+0000 7f32c27fc700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f32b006c680 0x7f32b006eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32c41964f0 tx=0x7f32ac01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:29.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.408+0000 7f32bbfff700 1 -- 172.21.15.88:0/665023187 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f32bc055b30 con 0x7f32c40ff3c0 2024-09-13T21:37:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:29 smithi116 ceph-mon[33391]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:29 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2957846794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T21:37:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.601+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f32c404f2a0 con 0x7f32c40ff3c0 2024-09-13T21:37:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.601+0000 7f32bbfff700 1 -- 172.21.15.88:0/665023187 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32bc059150 con 0x7f32c40ff3c0 2024-09-13T21:37:29.603 INFO:teuthology.orchestra.run.smithi088.stdout:115964117013 2024-09-13T21:37:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f32b006c680 msgr2=0x7f32b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f32b006c680 0x7f32b006eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32c41964f0 tx=0x7f32ac01a040 comp rx=0 tx=0).stop 2024-09-13T21:37:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ff3c0 msgr2=0x7f32c4194ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ff3c0 0x7f32c4194ed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00b4b0 tx=0x7f32bc00b7c0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 shutdown_connections 2024-09-13T21:37:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f32b006c680 0x7f32b006eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32c40ff3c0 0x7f32c4194ed0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 --2- 172.21.15.88:0/665023187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c40ffd60 0x7f32c4195410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 >> 172.21.15.88:0/665023187 conn(0x7f32c40fac60 msgr2=0x7f32c40fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 shutdown_connections 2024-09-13T21:37:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.604+0000 7f32c944e700 1 -- 172.21.15.88:0/665023187 wait complete. 2024-09-13T21:37:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.785+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/1690922430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100d70 msgr2=0x7ffa841094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.785+0000 7ffa8ab6a700 1 --2- 172.21.15.88:0/1690922430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100d70 0x7ffa841094d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009910 tx=0x7ffa70009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.785+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/1690922430 shutdown_connections 2024-09-13T21:37:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.785+0000 7ffa8ab6a700 1 --2- 172.21.15.88:0/1690922430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100d70 0x7ffa841094d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.785+0000 7ffa8ab6a700 1 --2- 172.21.15.88:0/1690922430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa84100460 0x7ffa84100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.785+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/1690922430 >> 172.21.15.88:0/1690922430 conn(0x7ffa840748b0 msgr2=0x7ffa84074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.785+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/1690922430 shutdown_connections 2024-09-13T21:37:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.785+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/1690922430 wait complete. 2024-09-13T21:37:29.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.786+0000 7ffa8ab6a700 1 Processor -- start 2024-09-13T21:37:29.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.786+0000 7ffa8ab6a700 1 -- start start 2024-09-13T21:37:29.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.786+0000 7ffa8ab6a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100460 0x7ffa84195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:29.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.786+0000 7ffa8ab6a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa84100d70 0x7ffa84196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:29.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.786+0000 7ffa8ab6a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84196ae0 con 0x7ffa84100460 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.786+0000 7ffa8ab6a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8419a870 con 0x7ffa84100d70 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.786+0000 7ffa88906700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100460 0x7ffa84195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.786+0000 7ffa88906700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100460 0x7ffa84195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58238/0 (socket says 172.21.15.88:58238) 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.786+0000 7ffa88906700 1 -- 172.21.15.88:0/2381970947 learned_addr learned my addr 172.21.15.88:0/2381970947 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa83fff700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa84100d70 0x7ffa84196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa88906700 1 -- 172.21.15.88:0/2381970947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa84100d70 msgr2=0x7ffa84196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa88906700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa84100d70 0x7ffa84196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa88906700 1 -- 172.21.15.88:0/2381970947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa700095f0 con 0x7ffa84100460 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa88906700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100460 0x7ffa84195ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c8a0 tx=0x7ffa7800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa81ffb700 1 -- 172.21.15.88:0/2381970947 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7800cea0 con 0x7ffa84100460 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8419ab50 con 0x7ffa84100460 2024-09-13T21:37:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa81ffb700 1 -- 172.21.15.88:0/2381970947 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa78004830 con 0x7ffa84100460 2024-09-13T21:37:29.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa81ffb700 1 -- 172.21.15.88:0/2381970947 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa780055b0 con 0x7ffa84100460 2024-09-13T21:37:29.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.787+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8419b0a0 con 0x7ffa84100460 2024-09-13T21:37:29.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.789+0000 7ffa81ffb700 1 -- 172.21.15.88:0/2381970947 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ffa78007ad0 con 0x7ffa84100460 2024-09-13T21:37:29.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.789+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa84107e40 con 0x7ffa84100460 2024-09-13T21:37:29.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.789+0000 7ffa81ffb700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffa7406c680 0x7ffa7406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:29.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.789+0000 7ffa81ffb700 1 -- 172.21.15.88:0/2381970947 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ffa7808b200 con 0x7ffa84100460 2024-09-13T21:37:29.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.789+0000 7ffa83fff700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffa7406c680 0x7ffa7406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:29.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.789+0000 7ffa83fff700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffa7406c680 0x7ffa7406eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffa841974e0 tx=0x7ffa7001a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:29.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.793+0000 7ffa81ffb700 1 -- 172.21.15.88:0/2381970947 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffa78055cc0 con 0x7ffa84100460 2024-09-13T21:37:30.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.004+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ffa8404f2a0 con 0x7ffa84100460 2024-09-13T21:37:30.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.005+0000 7ffa81ffb700 1 -- 172.21.15.88:0/2381970947 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa780592e0 con 0x7ffa84100460 2024-09-13T21:37:30.007 INFO:teuthology.orchestra.run.smithi088.stdout:171798691850 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffa7406c680 msgr2=0x7ffa7406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffa7406c680 0x7ffa7406eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffa841974e0 tx=0x7ffa7001a040 comp rx=0 tx=0).stop 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100460 msgr2=0x7ffa84195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100460 0x7ffa84195ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c8a0 tx=0x7ffa7800cc60 comp rx=0 tx=0).stop 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 shutdown_connections 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffa7406c680 0x7ffa7406eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa84100460 0x7ffa84195ec0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 --2- 172.21.15.88:0/2381970947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa84100d70 0x7ffa84196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 >> 172.21.15.88:0/2381970947 conn(0x7ffa840748b0 msgr2=0x7ffa840fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 shutdown_connections 2024-09-13T21:37:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:30.007+0000 7ffa8ab6a700 1 -- 172.21.15.88:0/2381970947 wait complete. 2024-09-13T21:37:30.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:30 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/665023187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T21:37:30.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:30 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1410401640' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T21:37:30.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:30 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2381970947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T21:37:30.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:30 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/665023187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T21:37:30.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:30 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/1410401640' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T21:37:30.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:30 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2381970947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T21:37:30.998 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705701 for osd.0 2024-09-13T21:37:30.998 DEBUG:teuthology.parallel:result is None 2024-09-13T21:37:31.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:31 smithi088 ceph-mon[27963]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:31 smithi116 ceph-mon[33391]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:31.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.627+0000 7f6b41ea3700 1 -- 172.21.15.88:0/2494853895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ff3c0 msgr2=0x7f6b3c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:31.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.627+0000 7f6b41ea3700 1 --2- 172.21.15.88:0/2494853895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ff3c0 0x7f6b3c0ff790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00b0a0 tx=0x7f6b2c00b3b0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.627+0000 7f6b41ea3700 1 -- 172.21.15.88:0/2494853895 shutdown_connections 2024-09-13T21:37:31.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.627+0000 7f6b41ea3700 1 --2- 172.21.15.88:0/2494853895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b3c0ffd60 0x7f6b3c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.627+0000 7f6b41ea3700 1 --2- 172.21.15.88:0/2494853895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ff3c0 0x7f6b3c0ff790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.627+0000 7f6b41ea3700 1 -- 172.21.15.88:0/2494853895 >> 172.21.15.88:0/2494853895 conn(0x7f6b3c0fac80 msgr2=0x7f6b3c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.627+0000 7f6b41ea3700 1 -- 172.21.15.88:0/2494853895 shutdown_connections 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.627+0000 7f6b41ea3700 1 -- 172.21.15.88:0/2494853895 wait complete. 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b41ea3700 1 Processor -- start 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b41ea3700 1 -- start start 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b41ea3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b3c0ff3c0 0x7f6b3c196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b41ea3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ffd60 0x7f6b3c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b41ea3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c197850 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b41ea3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c197990 con 0x7f6b3c0ff3c0 2024-09-13T21:37:31.637 INFO:teuthology.orchestra.run.smithi088.stdout:150323855376 2024-09-13T21:37:31.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b3affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ffd60 0x7f6b3c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:31.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b3affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ffd60 0x7f6b3c197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58220/0 (socket says 172.21.15.88:58220) 2024-09-13T21:37:31.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b3affd700 1 -- 172.21.15.88:0/1410401640 learned_addr learned my addr 172.21.15.88:0/1410401640 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:31.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.628+0000 7f6b3b7fe700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b3c0ff3c0 0x7f6b3c196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:31.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.629+0000 7f6b3affd700 1 -- 172.21.15.88:0/1410401640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b3c0ff3c0 msgr2=0x7f6b3c196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:31.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.629+0000 7f6b3affd700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b3c0ff3c0 0x7f6b3c196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.629+0000 7f6b3affd700 1 -- 172.21.15.88:0/1410401640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c009d00 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.629+0000 7f6b3affd700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ffd60 0x7f6b3c197230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400d900 tx=0x7f6b2400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.629+0000 7f6b38ff9700 1 -- 172.21.15.88:0/1410401640 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b24009900 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.629+0000 7f6b38ff9700 1 -- 172.21.15.88:0/1410401640 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6b24010460 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.629+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3c19fd60 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.629+0000 7f6b38ff9700 1 -- 172.21.15.88:0/1410401640 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b2400f5f0 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.629+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c1a0220 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.630+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c1076d0 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.631+0000 7f6b38ff9700 1 -- 172.21.15.88:0/1410401640 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6b240105d0 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.631+0000 7f6b38ff9700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6b2806c680 0x7f6b2806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.631+0000 7f6b38ff9700 1 -- 172.21.15.88:0/1410401640 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f6b2408afe0 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.631+0000 7f6b3b7fe700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6b2806c680 0x7f6b2806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.632+0000 7f6b3b7fe700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6b2806c680 0x7f6b2806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c000f80 tx=0x7f6b2c0060c0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.638+0000 7f6b38ff9700 1 -- 172.21.15.88:0/1410401640 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6b24055aa0 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.854+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6b3c04f2a0 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.854+0000 7f6b38ff9700 1 -- 172.21.15.88:0/1410401640 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b240590c0 con 0x7f6b3c0ffd60 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.856+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6b2806c680 msgr2=0x7f6b2806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.856+0000 7f6b41ea3700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6b2806c680 0x7f6b2806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c000f80 tx=0x7f6b2c0060c0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.856+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ffd60 msgr2=0x7f6b3c197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.856+0000 7f6b41ea3700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ffd60 0x7f6b3c197230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400d900 tx=0x7f6b2400dc10 comp rx=0 tx=0).stop 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.856+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 shutdown_connections 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.856+0000 7f6b41ea3700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f6b2806c680 0x7f6b2806eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.856+0000 7f6b41ea3700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b3c0ff3c0 0x7f6b3c196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.856+0000 7f6b41ea3700 1 --2- 172.21.15.88:0/1410401640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b3c0ffd60 0x7f6b3c197230 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.856+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 >> 172.21.15.88:0/1410401640 conn(0x7f6b3c0fac80 msgr2=0x7f6b3c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:31.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.857+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 shutdown_connections 2024-09-13T21:37:31.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:29.857+0000 7f6b41ea3700 1 -- 172.21.15.88:0/1410401640 wait complete. 2024-09-13T21:37:32.545 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117013 for osd.3 2024-09-13T21:37:32.545 DEBUG:teuthology.parallel:result is None 2024-09-13T21:37:32.898 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691848 got 171798691850 for osd.5 2024-09-13T21:37:32.898 DEBUG:teuthology.parallel:result is None 2024-09-13T21:37:33.415 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:33 smithi088 ceph-mon[27963]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:33.584 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855373 got 150323855376 for osd.4 2024-09-13T21:37:33.584 DEBUG:teuthology.parallel:result is None 2024-09-13T21:37:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:33 smithi116 ceph-mon[33391]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:34.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.006+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/1612031934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 msgr2=0x7f7fe410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.006+0000 7f7fe8b7e700 1 --2- 172.21.15.88:0/1612031934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 0x7f7fe410a6d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009910 tx=0x7f7fcc009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.006+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/1612031934 shutdown_connections 2024-09-13T21:37:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.006+0000 7f7fe8b7e700 1 --2- 172.21.15.88:0/1612031934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 0x7f7fe410a6d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.006+0000 7f7fe8b7e700 1 --2- 172.21.15.88:0/1612031934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fe40ff350 0x7f7fe40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.006+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/1612031934 >> 172.21.15.88:0/1612031934 conn(0x7f7fe40748b0 msgr2=0x7f7fe4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.006+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/1612031934 shutdown_connections 2024-09-13T21:37:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.006+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/1612031934 wait complete. 2024-09-13T21:37:34.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.006+0000 7f7fe8b7e700 1 Processor -- start 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fe8b7e700 1 -- start start 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fe8b7e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fe40ff350 0x7f7fe4195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fe8b7e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 0x7f7fe41963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fe8b7e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4196ad0 con 0x7f7fe40ffc60 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fe8b7e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe419a860 con 0x7f7fe40ff350 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fd9d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 0x7f7fe41963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fd9d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 0x7f7fe41963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35018/0 (socket says 172.21.15.88:35018) 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fd9d9b700 1 -- 172.21.15.88:0/3365308740 learned_addr learned my addr 172.21.15.88:0/3365308740 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fe259c700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fe40ff350 0x7f7fe4195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fd9d9b700 1 -- 172.21.15.88:0/3365308740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fe40ff350 msgr2=0x7f7fe4195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:34.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fd9d9b700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fe40ff350 0x7f7fe4195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fd9d9b700 1 -- 172.21.15.88:0/3365308740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0095f0 con 0x7f7fe40ffc60 2024-09-13T21:37:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.007+0000 7f7fd9d9b700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 0x7f7fe41963f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00b5c0 tx=0x7f7fcc00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.008+0000 7f7fdbfff700 1 -- 172.21.15.88:0/3365308740 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc01d070 con 0x7f7fe40ffc60 2024-09-13T21:37:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.008+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe419aae0 con 0x7f7fe40ffc60 2024-09-13T21:37:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.008+0000 7f7fdbfff700 1 -- 172.21.15.88:0/3365308740 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7fcc00f460 con 0x7f7fe40ffc60 2024-09-13T21:37:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.008+0000 7f7fdbfff700 1 -- 172.21.15.88:0/3365308740 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc017630 con 0x7f7fe40ffc60 2024-09-13T21:37:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.008+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe419afd0 con 0x7f7fe40ffc60 2024-09-13T21:37:34.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.009+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe4107dd0 con 0x7f7fe40ffc60 2024-09-13T21:37:34.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.009+0000 7f7fdbfff700 1 -- 172.21.15.88:0/3365308740 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7fcc0178f0 con 0x7f7fe40ffc60 2024-09-13T21:37:34.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.010+0000 7f7fdbfff700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7fd006c680 0x7f7fd006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:34.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.010+0000 7f7fe259c700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7fd006c680 0x7f7fd006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:34.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.010+0000 7f7fdbfff700 1 -- 172.21.15.88:0/3365308740 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f7fcc08ca20 con 0x7f7fe40ffc60 2024-09-13T21:37:34.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.010+0000 7f7fe259c700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7fd006c680 0x7f7fd006eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7fe406a640 tx=0x7f7fd400a380 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:34.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.014+0000 7f7fdbfff700 1 -- 172.21.15.88:0/3365308740 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7fcc0574e0 con 0x7f7fe40ffc60 2024-09-13T21:37:34.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.209+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7fe402cc30 con 0x7f7fe40ffc60 2024-09-13T21:37:34.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.209+0000 7f7fdbfff700 1 -- 172.21.15.88:0/3365308740 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fcc029340 con 0x7f7fe40ffc60 2024-09-13T21:37:34.211 INFO:teuthology.orchestra.run.smithi088.stdout:81604378651 2024-09-13T21:37:34.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.211+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7fd006c680 msgr2=0x7f7fd006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:34.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.211+0000 7f7fe8b7e700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7fd006c680 0x7f7fd006eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7fe406a640 tx=0x7f7fd400a380 comp rx=0 tx=0).stop 2024-09-13T21:37:34.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.211+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 msgr2=0x7f7fe41963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:34.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.211+0000 7f7fe8b7e700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 0x7f7fe41963f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00b5c0 tx=0x7f7fcc00bd50 comp rx=0 tx=0).stop 2024-09-13T21:37:34.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.211+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 shutdown_connections 2024-09-13T21:37:34.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.211+0000 7f7fe8b7e700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7fd006c680 0x7f7fd006eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:34.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.211+0000 7f7fe8b7e700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fe40ff350 0x7f7fe4195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:34.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.211+0000 7f7fe8b7e700 1 --2- 172.21.15.88:0/3365308740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40ffc60 0x7f7fe41963f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:34.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.211+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 >> 172.21.15.88:0/3365308740 conn(0x7f7fe40748b0 msgr2=0x7f7fe4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:34.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.212+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 shutdown_connections 2024-09-13T21:37:34.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:34.212+0000 7f7fe8b7e700 1 -- 172.21.15.88:0/3365308740 wait complete. 2024-09-13T21:37:34.806 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378651 for osd.2 2024-09-13T21:37:34.806 DEBUG:teuthology.parallel:result is None 2024-09-13T21:37:34.806 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T21:37:34.806 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T21:37:35.009 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:35.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:35 smithi088 ceph-mon[27963]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:35.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:35 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3365308740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T21:37:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:35 smithi116 ceph-mon[33391]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:35 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3365308740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T21:37:36.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.495+0000 7f48c9982700 1 -- 172.21.15.88:0/3003548907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c40ffbd0 msgr2=0x7f48c4100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.495+0000 7f48c9982700 1 --2- 172.21.15.88:0/3003548907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c40ffbd0 0x7f48c4100040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009910 tx=0x7f48b4009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.495+0000 7f48c9982700 1 -- 172.21.15.88:0/3003548907 shutdown_connections 2024-09-13T21:37:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.495+0000 7f48c9982700 1 --2- 172.21.15.88:0/3003548907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c40ffbd0 0x7f48c4100040 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.495+0000 7f48c9982700 1 --2- 172.21.15.88:0/3003548907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48c4104130 0x7f48c4104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.495+0000 7f48c9982700 1 -- 172.21.15.88:0/3003548907 >> 172.21.15.88:0/3003548907 conn(0x7f48c4075130 msgr2=0x7f48c4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.495+0000 7f48c9982700 1 -- 172.21.15.88:0/3003548907 shutdown_connections 2024-09-13T21:37:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.495+0000 7f48c9982700 1 -- 172.21.15.88:0/3003548907 wait complete. 2024-09-13T21:37:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c9982700 1 Processor -- start 2024-09-13T21:37:36.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c9982700 1 -- start start 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c9982700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48c40ffbd0 0x7f48c4195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c9982700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c4104130 0x7f48c4196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c9982700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4196a20 con 0x7f48c4104130 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c9982700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c419a7b0 con 0x7f48c40ffbd0 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c27fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c4104130 0x7f48c4196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c27fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c4104130 0x7f48c4196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35040/0 (socket says 172.21.15.88:35040) 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c27fc700 1 -- 172.21.15.88:0/605465779 learned_addr learned my addr 172.21.15.88:0/605465779 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c2ffd700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48c40ffbd0 0x7f48c4195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c27fc700 1 -- 172.21.15.88:0/605465779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48c40ffbd0 msgr2=0x7f48c4195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c27fc700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48c40ffbd0 0x7f48c4195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.496+0000 7f48c27fc700 1 -- 172.21.15.88:0/605465779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40095f0 con 0x7f48c4104130 2024-09-13T21:37:36.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.497+0000 7f48c27fc700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c4104130 0x7f48c4196340 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f48b4006010 tx=0x7f48b400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:36.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.497+0000 7f48c8980700 1 -- 172.21.15.88:0/605465779 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b401d070 con 0x7f48c4104130 2024-09-13T21:37:36.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.497+0000 7f48c8980700 1 -- 172.21.15.88:0/605465779 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f48b400f460 con 0x7f48c4104130 2024-09-13T21:37:36.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.497+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c419aa30 con 0x7f48c4104130 2024-09-13T21:37:36.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.497+0000 7f48c8980700 1 -- 172.21.15.88:0/605465779 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b4017630 con 0x7f48c4104130 2024-09-13T21:37:36.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.497+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c419af20 con 0x7f48c4104130 2024-09-13T21:37:36.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.498+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c404f2a0 con 0x7f48c4104130 2024-09-13T21:37:36.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.498+0000 7f48c8980700 1 -- 172.21.15.88:0/605465779 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f48b400f5d0 con 0x7f48c4104130 2024-09-13T21:37:36.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.499+0000 7f48c8980700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f48b006c680 0x7f48b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:36.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.499+0000 7f48c8980700 1 -- 172.21.15.88:0/605465779 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f48b408c840 con 0x7f48c4104130 2024-09-13T21:37:36.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.499+0000 7f48c2ffd700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f48b006c680 0x7f48b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:36.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.499+0000 7f48c2ffd700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f48b006c680 0x7f48b006eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007be0 tx=0x7f48ac0073d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:36.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.503+0000 7f48c8980700 1 -- 172.21.15.88:0/605465779 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f48b4057440 con 0x7f48c4104130 2024-09-13T21:37:36.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.690+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48c419b220 con 0x7f48b006c680 2024-09-13T21:37:36.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.692+0000 7f48c8980700 1 -- 172.21.15.88:0/605465779 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27926 (secure 0 0 0) 0x7f48c419b220 con 0x7f48b006c680 2024-09-13T21:37:36.695 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:37:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.694+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f48b006c680 msgr2=0x7f48b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.694+0000 7f48c9982700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f48b006c680 0x7f48b006eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007be0 tx=0x7f48ac0073d0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.694+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c4104130 msgr2=0x7f48c4196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:36.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.694+0000 7f48c9982700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c4104130 0x7f48c4196340 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f48b4006010 tx=0x7f48b400bd70 comp rx=0 tx=0).stop 2024-09-13T21:37:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.694+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 shutdown_connections 2024-09-13T21:37:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.694+0000 7f48c9982700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f48b006c680 0x7f48b006eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.694+0000 7f48c9982700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48c40ffbd0 0x7f48c4195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.694+0000 7f48c9982700 1 --2- 172.21.15.88:0/605465779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48c4104130 0x7f48c4196340 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.694+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 >> 172.21.15.88:0/605465779 conn(0x7f48c4075130 msgr2=0x7f48c40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.695+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 shutdown_connections 2024-09-13T21:37:36.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:36.695+0000 7f48c9982700 1 -- 172.21.15.88:0/605465779 wait complete. 2024-09-13T21:37:36.698 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T21:37:36.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:36 smithi088 ceph-mon[27963]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:37.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:36 smithi116 ceph-mon[33391]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:37.373 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-13T21:37:36.064545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002240"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":185,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T21:36:47.210039+0000","last_change":"2024-09-13T21:36:21.141490+0000","last_active":"2024-09-13T21:36:47.210039+0000","last_peered":"2024-09-13T21:36:47.210039+0000","last_clean":"2024-09-13T21:36:47.210039+0000","last_became_active":"2024-09-13T21:36:21.141170+0000","last_became_peered":"2024-09-13T21:36:21.141170+0000","last_unstale":"2024-09-13T21:36:47.210039+0000","last_undegraded":"2024-09-13T21:36:47.210039+0000","last_fullsized":"2024-09-13T21:36:47.210039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T21:35:32.856823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T21:35:32.856823+0000","last_clean_scrub_stamp":"2024-09-13T21:35:32.856823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:49.109913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Sep 13 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":12.699999999999999,"5min":12.699999999999999,"15min":12.699999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Sep 13 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Sep 13 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.30099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Sep 13 21:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.441}]},{"osd":2,"last update":"Fri Sep 13 21:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.505}]},{"osd":4,"last update":"Fri Sep 13 21:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Sep 13 21:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.245},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Sep 13 21:36:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.496},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58899999999999997}]},{"osd":4,"last update":"Fri Sep 13 21:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 21:37:12 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.30499999999999999,"15min":0.30099999999999999},"min":{"1min":0.22700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.314,"15min":0.308},"min":{"1min":0.25800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Sep 13 21:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35499999999999998,"15min":0.35899999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Sep 13 21:36:58 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Sep 13 21:37:22 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:37:06 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32600000000000001,"15min":0.32300000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.223}]},{"osd":2,"last update":"Fri Sep 13 21:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.246}]},{"osd":3,"last update":"Fri Sep 13 21:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Sep 13 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.443},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T21:37:37.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T21:37:37.573 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:37.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:37 smithi088 ceph-mon[27963]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:37:38.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:37 smithi116 ceph-mon[33391]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:37:38.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:38 smithi088 ceph-mon[27963]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.280+0000 7fee2a136700 1 -- 172.21.15.88:0/1730562896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ff350 msgr2=0x7fee240ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.280+0000 7fee2a136700 1 --2- 172.21.15.88:0/1730562896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ff350 0x7fee240ff720 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fee14009910 tx=0x7fee14009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.281+0000 7fee2a136700 1 -- 172.21.15.88:0/1730562896 shutdown_connections 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.281+0000 7fee2a136700 1 --2- 172.21.15.88:0/1730562896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee240ffc60 0x7fee2410a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.281+0000 7fee2a136700 1 --2- 172.21.15.88:0/1730562896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ff350 0x7fee240ff720 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.281+0000 7fee2a136700 1 -- 172.21.15.88:0/1730562896 >> 172.21.15.88:0/1730562896 conn(0x7fee240748b0 msgr2=0x7fee24074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.281+0000 7fee2a136700 1 -- 172.21.15.88:0/1730562896 shutdown_connections 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.281+0000 7fee2a136700 1 -- 172.21.15.88:0/1730562896 wait complete. 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.281+0000 7fee2a136700 1 Processor -- start 2024-09-13T21:37:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.281+0000 7fee2a136700 1 -- start start 2024-09-13T21:37:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee2a136700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee240ff350 0x7fee24100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee2a136700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ffc60 0x7fee24100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee2a136700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee24100fb0 con 0x7fee240ffc60 2024-09-13T21:37:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee2a136700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee241010f0 con 0x7fee240ff350 2024-09-13T21:37:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee22ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ffc60 0x7fee24100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:39.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee22ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ffc60 0x7fee24100a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35046/0 (socket says 172.21.15.88:35046) 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee22ffd700 1 -- 172.21.15.88:0/594358937 learned_addr learned my addr 172.21.15.88:0/594358937 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee237fe700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee240ff350 0x7fee24100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee22ffd700 1 -- 172.21.15.88:0/594358937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee240ff350 msgr2=0x7fee24100530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee22ffd700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee240ff350 0x7fee24100530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee22ffd700 1 -- 172.21.15.88:0/594358937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140095f0 con 0x7fee240ffc60 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee22ffd700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ffc60 0x7fee24100a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fee1800d8d0 tx=0x7fee1800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee20ff9700 1 -- 172.21.15.88:0/594358937 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee180098a0 con 0x7fee240ffc60 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee20ff9700 1 -- 172.21.15.88:0/594358937 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fee18010460 con 0x7fee240ffc60 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee20ff9700 1 -- 172.21.15.88:0/594358937 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1800f5f0 con 0x7fee240ffc60 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee241a2070 con 0x7fee240ffc60 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.282+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee241a2480 con 0x7fee240ffc60 2024-09-13T21:37:39.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.283+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee24107dd0 con 0x7fee240ffc60 2024-09-13T21:37:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.284+0000 7fee20ff9700 1 -- 172.21.15.88:0/594358937 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fee18009a00 con 0x7fee240ffc60 2024-09-13T21:37:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.284+0000 7fee20ff9700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fee0c06c680 0x7fee0c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.285+0000 7fee237fe700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fee0c06c680 0x7fee0c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.285+0000 7fee20ff9700 1 -- 172.21.15.88:0/594358937 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fee1808b2d0 con 0x7fee240ffc60 2024-09-13T21:37:39.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.285+0000 7fee237fe700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fee0c06c680 0x7fee0c06eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee14006010 tx=0x7fee1401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.289+0000 7fee20ff9700 1 -- 172.21.15.88:0/594358937 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fee18055e10 con 0x7fee240ffc60 2024-09-13T21:37:39.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:38 smithi116 ceph-mon[33391]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:39.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.475+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee24061190 con 0x7fee0c06c680 2024-09-13T21:37:39.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.476+0000 7fee20ff9700 1 -- 172.21.15.88:0/594358937 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27855 (secure 0 0 0) 0x7fee24061190 con 0x7fee0c06c680 2024-09-13T21:37:39.479 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:37:39.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fee0c06c680 msgr2=0x7fee0c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fee0c06c680 0x7fee0c06eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee14006010 tx=0x7fee1401a040 comp rx=0 tx=0).stop 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ffc60 msgr2=0x7fee24100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ffc60 0x7fee24100a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fee1800d8d0 tx=0x7fee1800dbe0 comp rx=0 tx=0).stop 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 shutdown_connections 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fee0c06c680 0x7fee0c06eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee240ff350 0x7fee24100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 --2- 172.21.15.88:0/594358937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee240ffc60 0x7fee24100a70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 >> 172.21.15.88:0/594358937 conn(0x7fee240748b0 msgr2=0x7fee24104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 shutdown_connections 2024-09-13T21:37:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:39.479+0000 7fee2a136700 1 -- 172.21.15.88:0/594358937 wait complete. 2024-09-13T21:37:39.482 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T21:37:40.121 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-13T21:37:38.064930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002203"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":185,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T21:36:47.210039+0000","last_change":"2024-09-13T21:36:21.141490+0000","last_active":"2024-09-13T21:36:47.210039+0000","last_peered":"2024-09-13T21:36:47.210039+0000","last_clean":"2024-09-13T21:36:47.210039+0000","last_became_active":"2024-09-13T21:36:21.141170+0000","last_became_peered":"2024-09-13T21:36:21.141170+0000","last_unstale":"2024-09-13T21:36:47.210039+0000","last_undegraded":"2024-09-13T21:36:47.210039+0000","last_fullsized":"2024-09-13T21:36:47.210039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T21:35:32.856823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T21:35:32.856823+0000","last_clean_scrub_stamp":"2024-09-13T21:35:32.856823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:49.109913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.495}]},{"osd":1,"last update":"Fri Sep 13 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.433},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":12.699999999999999,"5min":12.699999999999999,"15min":12.699999999999999},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Sep 13 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Sep 13 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Sep 13 21:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.441}]},{"osd":2,"last update":"Fri Sep 13 21:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.505}]},{"osd":4,"last update":"Fri Sep 13 21:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.36799999999999999,"15min":0.374},"min":{"1min":0.247,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.433,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.29099999999999998}]},{"osd":1,"last update":"Fri Sep 13 21:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.245,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47099999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.253},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.38500000000000001,"15min":0.39300000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.45700000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.317}]},{"osd":3,"last update":"Fri Sep 13 21:36:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.497},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Sep 13 21:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 21:37:12 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.30499999999999999,"15min":0.30099999999999999},"min":{"1min":0.22700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.314,"15min":0.308},"min":{"1min":0.25800000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Sep 13 21:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35499999999999998,"15min":0.35899999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Sep 13 21:36:58 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Sep 13 21:37:22 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:37:06 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32600000000000001,"15min":0.32300000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.223}]},{"osd":2,"last update":"Fri Sep 13 21:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.246}]},{"osd":3,"last update":"Fri Sep 13 21:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Sep 13 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.443},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T21:37:40.123 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T21:37:40.123 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T21:37:40.123 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T21:37:40.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T21:37:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:40.443 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:40.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:41.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:41 smithi088 ceph-mon[27963]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:37:41.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:41 smithi088 ceph-mon[27963]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:41 smithi116 ceph-mon[33391]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:37:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:41 smithi116 ceph-mon[33391]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:41.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.884+0000 7f8ddd665700 1 -- 172.21.15.88:0/578507545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 msgr2=0x7f8dd80ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:41.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.884+0000 7f8ddd665700 1 --2- 172.21.15.88:0/578507545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 0x7f8dd80ff7c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009910 tx=0x7f8dc0009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.884+0000 7f8ddd665700 1 -- 172.21.15.88:0/578507545 shutdown_connections 2024-09-13T21:37:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.884+0000 7f8ddd665700 1 --2- 172.21.15.88:0/578507545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 0x7f8dd80ff7c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.884+0000 7f8ddd665700 1 --2- 172.21.15.88:0/578507545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd81038b0 0x7f8dd8103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.884+0000 7f8ddd665700 1 -- 172.21.15.88:0/578507545 >> 172.21.15.88:0/578507545 conn(0x7f8dd80748b0 msgr2=0x7f8dd8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.885+0000 7f8ddd665700 1 -- 172.21.15.88:0/578507545 shutdown_connections 2024-09-13T21:37:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.885+0000 7f8ddd665700 1 -- 172.21.15.88:0/578507545 wait complete. 2024-09-13T21:37:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.885+0000 7f8ddd665700 1 Processor -- start 2024-09-13T21:37:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8ddd665700 1 -- start start 2024-09-13T21:37:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8ddd665700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 0x7f8dd8194dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8ddd665700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd81038b0 0x7f8dd8195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8ddd665700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd81959e0 con 0x7f8dd80ff350 2024-09-13T21:37:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8ddd665700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd8199770 con 0x7f8dd81038b0 2024-09-13T21:37:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 0x7f8dd8194dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 0x7f8dd8194dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43342/0 (socket says 172.21.15.88:43342) 2024-09-13T21:37:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd6ffd700 1 -- 172.21.15.88:0/1498104331 learned_addr learned my addr 172.21.15.88:0/1498104331 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd6ffd700 1 -- 172.21.15.88:0/1498104331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd81038b0 msgr2=0x7f8dd8195300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dce7fc700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd81038b0 0x7f8dd8195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd6ffd700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd81038b0 0x7f8dd8195300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd6ffd700 1 -- 172.21.15.88:0/1498104331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc00095f0 con 0x7f8dd80ff350 2024-09-13T21:37:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd6ffd700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 0x7f8dd8194dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800d960 tx=0x7f8dc800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd4ff9700 1 -- 172.21.15.88:0/1498104331 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dc800ec20 con 0x7f8dd80ff350 2024-09-13T21:37:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd4ff9700 1 -- 172.21.15.88:0/1498104331 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8dc800ed80 con 0x7f8dd80ff350 2024-09-13T21:37:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd81999f0 con 0x7f8dd80ff350 2024-09-13T21:37:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.886+0000 7f8dd4ff9700 1 -- 172.21.15.88:0/1498104331 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dc80147b0 con 0x7f8dd80ff350 2024-09-13T21:37:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.887+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd8199f40 con 0x7f8dd80ff350 2024-09-13T21:37:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.887+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd804f2a0 con 0x7f8dd80ff350 2024-09-13T21:37:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.888+0000 7f8dd4ff9700 1 -- 172.21.15.88:0/1498104331 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8dc8014950 con 0x7f8dd80ff350 2024-09-13T21:37:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.888+0000 7f8dd4ff9700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8dc406c680 0x7f8dc406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.889+0000 7f8dd4ff9700 1 -- 172.21.15.88:0/1498104331 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f8dc808ce80 con 0x7f8dd80ff350 2024-09-13T21:37:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.889+0000 7f8dce7fc700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8dc406c680 0x7f8dc406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.889+0000 7f8dce7fc700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8dc406c680 0x7f8dc406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0006010 tx=0x7f8dc000b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:41.893+0000 7f8dd4ff9700 1 -- 172.21.15.88:0/1498104331 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8dc80579f0 con 0x7f8dd80ff350 2024-09-13T21:37:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.126+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8dd8196120 con 0x7f8dd80ff350 2024-09-13T21:37:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.126+0000 7f8dd4ff9700 1 -- 172.21.15.88:0/1498104331 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8dc805b010 con 0x7f8dd80ff350 2024-09-13T21:37:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:37:42.128 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T21:37:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8dc406c680 msgr2=0x7f8dc406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8dc406c680 0x7f8dc406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0006010 tx=0x7f8dc000b540 comp rx=0 tx=0).stop 2024-09-13T21:37:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 msgr2=0x7f8dd8194dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 0x7f8dd8194dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800d960 tx=0x7f8dc800dd20 comp rx=0 tx=0).stop 2024-09-13T21:37:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 shutdown_connections 2024-09-13T21:37:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8dc406c680 0x7f8dc406eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dd80ff350 0x7f8dd8194dc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 --2- 172.21.15.88:0/1498104331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd81038b0 0x7f8dd8195300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 >> 172.21.15.88:0/1498104331 conn(0x7f8dd80748b0 msgr2=0x7f8dd8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:42.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 shutdown_connections 2024-09-13T21:37:42.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:42.128+0000 7f8ddd665700 1 -- 172.21.15.88:0/1498104331 wait complete. 2024-09-13T21:37:42.728 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T21:37:42.729 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T21:37:42.729 INFO:teuthology.run_tasks:Running task print... 2024-09-13T21:37:42.742 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-09-13T21:37:42.742 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:37:42.787 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:37:42.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T21:37:42.984 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:43.411 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:43 smithi088 ceph-mon[27963]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:43.411 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:43 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1498104331' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T21:37:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:43 smithi116 ceph-mon[33391]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:43 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/1498104331' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T21:37:44.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.539+0000 7f8f72dd8700 1 -- 172.21.15.88:0/3366786838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 msgr2=0x7f8f6c100ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.539+0000 7f8f72dd8700 1 --2- 172.21.15.88:0/3366786838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 0x7f8f6c100ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800b0a0 tx=0x7f8f6800b3b0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.539+0000 7f8f72dd8700 1 -- 172.21.15.88:0/3366786838 shutdown_connections 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.539+0000 7f8f72dd8700 1 --2- 172.21.15.88:0/3366786838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f6c0ff410 0x7f8f6c0ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.539+0000 7f8f72dd8700 1 --2- 172.21.15.88:0/3366786838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 0x7f8f6c100ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.539+0000 7f8f72dd8700 1 -- 172.21.15.88:0/3366786838 >> 172.21.15.88:0/3366786838 conn(0x7f8f6c0f9e50 msgr2=0x7f8f6c0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.539+0000 7f8f72dd8700 1 -- 172.21.15.88:0/3366786838 shutdown_connections 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.539+0000 7f8f72dd8700 1 -- 172.21.15.88:0/3366786838 wait complete. 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f72dd8700 1 Processor -- start 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f72dd8700 1 -- start start 2024-09-13T21:37:44.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f72dd8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f6c0ff410 0x7f8f6c1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f72dd8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 0x7f8f6c101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f72dd8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c101d40 con 0x7f8f6c1006d0 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f72dd8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c101e80 con 0x7f8f6c0ff410 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f63fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 0x7f8f6c101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f63fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 0x7f8f6c101800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43364/0 (socket says 172.21.15.88:43364) 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f63fff700 1 -- 172.21.15.88:0/2480144559 learned_addr learned my addr 172.21.15.88:0/2480144559 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f70b74700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f6c0ff410 0x7f8f6c1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f63fff700 1 -- 172.21.15.88:0/2480144559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f6c0ff410 msgr2=0x7f8f6c1031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f63fff700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f6c0ff410 0x7f8f6c1031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f63fff700 1 -- 172.21.15.88:0/2480144559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68009d00 con 0x7f8f6c1006d0 2024-09-13T21:37:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f63fff700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 0x7f8f6c101800 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00c8a0 tx=0x7f8f5c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f61ffb700 1 -- 172.21.15.88:0/2480144559 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f5c00cea0 con 0x7f8f6c1006d0 2024-09-13T21:37:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f61ffb700 1 -- 172.21.15.88:0/2480144559 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f5c004830 con 0x7f8f6c1006d0 2024-09-13T21:37:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c102160 con 0x7f8f6c1006d0 2024-09-13T21:37:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.540+0000 7f8f61ffb700 1 -- 172.21.15.88:0/2480144559 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f5c0055b0 con 0x7f8f6c1006d0 2024-09-13T21:37:44.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.541+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c19db00 con 0x7f8f6c1006d0 2024-09-13T21:37:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.542+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c107c80 con 0x7f8f6c1006d0 2024-09-13T21:37:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.542+0000 7f8f61ffb700 1 -- 172.21.15.88:0/2480144559 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8f5c007ad0 con 0x7f8f6c1006d0 2024-09-13T21:37:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.543+0000 7f8f61ffb700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8f5406c680 0x7f8f5406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.543+0000 7f8f61ffb700 1 -- 172.21.15.88:0/2480144559 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f8f5c08b200 con 0x7f8f6c1006d0 2024-09-13T21:37:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.543+0000 7f8f70b74700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8f5406c680 0x7f8f5406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:44.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.543+0000 7f8f70b74700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8f5406c680 0x7f8f5406eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f68000f80 tx=0x7f8f6800b7b0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:44.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.547+0000 7f8f61ffb700 1 -- 172.21.15.88:0/2480144559 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8f5c059750 con 0x7f8f6c1006d0 2024-09-13T21:37:44.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.740+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f8f6c107e40 con 0x7f8f6c1006d0 2024-09-13T21:37:44.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.744+0000 7f8f61ffb700 1 -- 172.21.15.88:0/2480144559 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8f6c107e40 con 0x7f8f6c1006d0 2024-09-13T21:37:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.746+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8f5406c680 msgr2=0x7f8f5406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.746+0000 7f8f72dd8700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8f5406c680 0x7f8f5406eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f68000f80 tx=0x7f8f6800b7b0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.746+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 msgr2=0x7f8f6c101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.746+0000 7f8f72dd8700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 0x7f8f6c101800 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00c8a0 tx=0x7f8f5c00cc60 comp rx=0 tx=0).stop 2024-09-13T21:37:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.746+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 shutdown_connections 2024-09-13T21:37:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.746+0000 7f8f72dd8700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8f5406c680 0x7f8f5406eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.746+0000 7f8f72dd8700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f6c0ff410 0x7f8f6c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.746+0000 7f8f72dd8700 1 --2- 172.21.15.88:0/2480144559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f6c1006d0 0x7f8f6c101800 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.746+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 >> 172.21.15.88:0/2480144559 conn(0x7f8f6c0f9e50 msgr2=0x7f8f6c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.747+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 shutdown_connections 2024-09-13T21:37:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:44.747+0000 7f8f72dd8700 1 -- 172.21.15.88:0/2480144559 wait complete. 2024-09-13T21:37:45.338 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:45 smithi088 ceph-mon[27963]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:45.338 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:45 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2480144559' entity='client.admin' 2024-09-13T21:37:45.338 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:37:45.358 INFO:teuthology.run_tasks:Running task print... 2024-09-13T21:37:45.367 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T21:37:45.367 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:37:45.408 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:37:45.408 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T21:37:45.409 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:45 smithi116 ceph-mon[33391]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:45.409 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:45 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2480144559' entity='client.admin' 2024-09-13T21:37:45.409 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:37:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:46.412 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:46 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:37:46.412 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:46 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:37:46.412 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:46 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:37:46.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:46 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:37:46.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:46 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:37:46.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:46 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:37:47.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.116+0000 7f400212d700 1 -- 172.21.15.88:0/2000821027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc100750 msgr2=0x7f3ffc100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:47.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.116+0000 7f400212d700 1 --2- 172.21.15.88:0/2000821027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc100750 0x7f3ffc100b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009910 tx=0x7f3ff0009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:47.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.116+0000 7f400212d700 1 -- 172.21.15.88:0/2000821027 shutdown_connections 2024-09-13T21:37:47.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.116+0000 7f400212d700 1 --2- 172.21.15.88:0/2000821027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ffc1010a0 0x7f3ffc0ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:47.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.116+0000 7f400212d700 1 --2- 172.21.15.88:0/2000821027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc100750 0x7f3ffc100b60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:47.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.116+0000 7f400212d700 1 -- 172.21.15.88:0/2000821027 >> 172.21.15.88:0/2000821027 conn(0x7f3ffc0f9f10 msgr2=0x7f3ffc0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:47.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.116+0000 7f400212d700 1 -- 172.21.15.88:0/2000821027 shutdown_connections 2024-09-13T21:37:47.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.116+0000 7f400212d700 1 -- 172.21.15.88:0/2000821027 wait complete. 2024-09-13T21:37:47.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f400212d700 1 Processor -- start 2024-09-13T21:37:47.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f400212d700 1 -- start start 2024-09-13T21:37:47.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f400212d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ffc100750 0x7f3ffc0feec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:47.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f400212d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc1010a0 0x7f3ffc19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:47.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f400212d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc19adf0 con 0x7f3ffc1010a0 2024-09-13T21:37:47.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f400212d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc19af60 con 0x7f3ffc100750 2024-09-13T21:37:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f3ffaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc1010a0 0x7f3ffc19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f3ffaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc1010a0 0x7f3ffc19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43386/0 (socket says 172.21.15.88:43386) 2024-09-13T21:37:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f3ffaffd700 1 -- 172.21.15.88:0/391825077 learned_addr learned my addr 172.21.15.88:0/391825077 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f3ffb7fe700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ffc100750 0x7f3ffc0feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f3ffaffd700 1 -- 172.21.15.88:0/391825077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ffc100750 msgr2=0x7f3ffc0feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f3ffaffd700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ffc100750 0x7f3ffc0feec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f3ffaffd700 1 -- 172.21.15.88:0/391825077 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff00095f0 con 0x7f3ffc1010a0 2024-09-13T21:37:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.117+0000 7f3ffb7fe700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ffc100750 0x7f3ffc0feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:37:47.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.118+0000 7f3ffaffd700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc1010a0 0x7f3ffc19a820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00e920 tx=0x7f3fec00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.118+0000 7f3ff8ff9700 1 -- 172.21.15.88:0/391825077 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fec00c9d0 con 0x7f3ffc1010a0 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.118+0000 7f3ff8ff9700 1 -- 172.21.15.88:0/391825077 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3fec010430 con 0x7f3ffc1010a0 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.118+0000 7f3ff8ff9700 1 -- 172.21.15.88:0/391825077 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fec018650 con 0x7f3ffc1010a0 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.118+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc19b240 con 0x7f3ffc1010a0 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.118+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc19b790 con 0x7f3ffc1010a0 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.119+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc107c00 con 0x7f3ffc1010a0 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.119+0000 7f3ff8ff9700 1 -- 172.21.15.88:0/391825077 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3fec0105a0 con 0x7f3ffc1010a0 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.120+0000 7f3ff8ff9700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3fe406c680 0x7f3fe406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.120+0000 7f3ffb7fe700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3fe406c680 0x7f3fe406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:47.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.120+0000 7f3ff8ff9700 1 -- 172.21.15.88:0/391825077 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f3fec014070 con 0x7f3ffc1010a0 2024-09-13T21:37:47.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.120+0000 7f3ffb7fe700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3fe406c680 0x7f3fe406eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000b6f0 tx=0x7f3ff0005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:47.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.124+0000 7f3ff8ff9700 1 -- 172.21.15.88:0/391825077 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3fec051720 con 0x7f3ffc1010a0 2024-09-13T21:37:47.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:47 smithi088 ceph-mon[27963]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:47.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.329+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ffc104db0 con 0x7f3fe406c680 2024-09-13T21:37:47.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.330+0000 7f3ff8ff9700 1 -- 172.21.15.88:0/391825077 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3ffc104db0 con 0x7f3fe406c680 2024-09-13T21:37:47.366 INFO:teuthology.orchestra.run.smithi088.stdout:Backend: cephadm 2024-09-13T21:37:47.367 INFO:teuthology.orchestra.run.smithi088.stdout:Available: Yes 2024-09-13T21:37:47.367 INFO:teuthology.orchestra.run.smithi088.stdout:Paused: No 2024-09-13T21:37:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3fe406c680 msgr2=0x7f3fe406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3fe406c680 0x7f3fe406eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000b6f0 tx=0x7f3ff0005940 comp rx=0 tx=0).stop 2024-09-13T21:37:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc1010a0 msgr2=0x7f3ffc19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc1010a0 0x7f3ffc19a820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00e920 tx=0x7f3fec00ec30 comp rx=0 tx=0).stop 2024-09-13T21:37:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 shutdown_connections 2024-09-13T21:37:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3fe406c680 0x7f3fe406eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ffc100750 0x7f3ffc0feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 --2- 172.21.15.88:0/391825077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ffc1010a0 0x7f3ffc19a820 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 >> 172.21.15.88:0/391825077 conn(0x7f3ffc0f9f10 msgr2=0x7f3ffc103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 shutdown_connections 2024-09-13T21:37:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:47.332+0000 7f400212d700 1 -- 172.21.15.88:0/391825077 wait complete. 2024-09-13T21:37:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:47 smithi116 ceph-mon[33391]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:47.916 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T21:37:48.114 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:48.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:48 smithi088 ceph-mon[27963]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:48 smithi116 ceph-mon[33391]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:49.452 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:49 smithi088 ceph-mon[27963]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:49 smithi116 ceph-mon[33391]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.780+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2700270236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf100ff130 msgr2=0x7fbf100ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.780+0000 7fbf16ff0700 1 --2- 172.21.15.88:0/2700270236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf100ff130 0x7fbf100ff540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009910 tx=0x7fbf04009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.780+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2700270236 shutdown_connections 2024-09-13T21:37:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.780+0000 7fbf16ff0700 1 --2- 172.21.15.88:0/2700270236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf101003d0 0x7fbf10100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.780+0000 7fbf16ff0700 1 --2- 172.21.15.88:0/2700270236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf100ff130 0x7fbf100ff540 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.780+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2700270236 >> 172.21.15.88:0/2700270236 conn(0x7fbf100fa780 msgr2=0x7fbf100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.780+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2700270236 shutdown_connections 2024-09-13T21:37:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.780+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2700270236 wait complete. 2024-09-13T21:37:49.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf16ff0700 1 Processor -- start 2024-09-13T21:37:49.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf16ff0700 1 -- start start 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf16ff0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf100ff130 0x7fbf101949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf16ff0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf101003d0 0x7fbf10194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf16ff0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10195510 con 0x7fbf101003d0 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf16ff0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10195650 con 0x7fbf100ff130 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf0ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf101003d0 0x7fbf10194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf0ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf101003d0 0x7fbf10194ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43396/0 (socket says 172.21.15.88:43396) 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf0ffff700 1 -- 172.21.15.88:0/2523782411 learned_addr learned my addr 172.21.15.88:0/2523782411 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf14d8c700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf100ff130 0x7fbf101949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf0ffff700 1 -- 172.21.15.88:0/2523782411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf100ff130 msgr2=0x7fbf101949b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf0ffff700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf100ff130 0x7fbf101949b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf0ffff700 1 -- 172.21.15.88:0/2523782411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf040095f0 con 0x7fbf101003d0 2024-09-13T21:37:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.781+0000 7fbf14d8c700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf100ff130 0x7fbf101949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:37:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.782+0000 7fbf0ffff700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf101003d0 0x7fbf10194ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c8a0 tx=0x7fbefc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.782+0000 7fbf0dffb700 1 -- 172.21.15.88:0/2523782411 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbefc00cea0 con 0x7fbf101003d0 2024-09-13T21:37:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.782+0000 7fbf0dffb700 1 -- 172.21.15.88:0/2523782411 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbefc004830 con 0x7fbf101003d0 2024-09-13T21:37:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.782+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1019a100 con 0x7fbf101003d0 2024-09-13T21:37:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.782+0000 7fbf0dffb700 1 -- 172.21.15.88:0/2523782411 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbefc0055b0 con 0x7fbf101003d0 2024-09-13T21:37:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.782+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1019a650 con 0x7fbf101003d0 2024-09-13T21:37:49.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.783+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf10107c10 con 0x7fbf101003d0 2024-09-13T21:37:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.783+0000 7fbf0dffb700 1 -- 172.21.15.88:0/2523782411 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbefc007ad0 con 0x7fbf101003d0 2024-09-13T21:37:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.784+0000 7fbf0dffb700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbf0006c680 0x7fbf0006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.784+0000 7fbf0dffb700 1 -- 172.21.15.88:0/2523782411 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fbefc08b200 con 0x7fbf101003d0 2024-09-13T21:37:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.784+0000 7fbf14d8c700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbf0006c680 0x7fbf0006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:49.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.784+0000 7fbf14d8c700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbf0006c680 0x7fbf0006eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbf040059d0 tx=0x7fbf04005920 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:49.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.788+0000 7fbf0dffb700 1 -- 172.21.15.88:0/2523782411 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbefc059750 con 0x7fbf101003d0 2024-09-13T21:37:49.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.985+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf10104d20 con 0x7fbf0006c680 2024-09-13T21:37:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.993+0000 7fbf0dffb700 1 -- 172.21.15.88:0/2523782411 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7fbf10104d20 con 0x7fbf0006c680 2024-09-13T21:37:49.995 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:37:49.995 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (3m) 2m ago 5m 25.8M - 0.25.0 c8568f914cd2 c82eca12b874 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (5m) 2m ago 5m 7063k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (4m) 64s ago 4m 6941k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (5m) 2m ago 5m 6665k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (4m) 64s ago 4m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (3m) 2m ago 4m 80.9M - 9.4.7 954c08fa6188 aa2cd07a9c2d 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:9283,8765,8443 running (6m) 2m ago 6m 480M - 18.2.0 dc2bc1663786 9fc04dc2c4a7 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (4m) 64s ago 4m 437M - 18.2.0 dc2bc1663786 3d98303b8a6d 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (6m) 2m ago 6m 43.5M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (4m) 64s ago 4m 40.3M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (5m) 2m ago 5m 15.6M - 1.5.0 0da6a335fe13 71ce2b0df304 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (4m) 64s ago 4m 16.1M - 1.5.0 0da6a335fe13 6d3c62590d98 2024-09-13T21:37:49.996 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (3m) 2m ago 3m 44.0M 3946M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:37:49.997 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (2m) 2m ago 2m 42.7M 3946M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:37:49.997 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (2m) 2m ago 2m 39.9M 3946M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:37:49.997 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (2m) 64s ago 2m 40.9M 4970M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:37:49.997 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (96s) 64s ago 95s 41.0M 4970M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:37:49.997 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (69s) 64s ago 68s 10.9M 4970M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:37:49.997 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 2m ago 4m 40.4M - 2.43.0 a07b618ecd1d 85cb356d6671 2024-09-13T21:37:49.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbf0006c680 msgr2=0x7fbf0006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:49.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbf0006c680 0x7fbf0006eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbf040059d0 tx=0x7fbf04005920 comp rx=0 tx=0).stop 2024-09-13T21:37:49.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf101003d0 msgr2=0x7fbf10194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:49.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf101003d0 0x7fbf10194ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c8a0 tx=0x7fbefc00cc60 comp rx=0 tx=0).stop 2024-09-13T21:37:49.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 shutdown_connections 2024-09-13T21:37:49.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbf0006c680 0x7fbf0006eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf100ff130 0x7fbf101949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 --2- 172.21.15.88:0/2523782411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf101003d0 0x7fbf10194ef0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 >> 172.21.15.88:0/2523782411 conn(0x7fbf100fa780 msgr2=0x7fbf10103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 shutdown_connections 2024-09-13T21:37:49.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:49.996+0000 7fbf16ff0700 1 -- 172.21.15.88:0/2523782411 wait complete. 2024-09-13T21:37:50.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T21:37:50.926 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:51.297 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:51 smithi088 ceph-mon[27963]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:51.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:51 smithi088 ceph-mon[27963]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:51 smithi116 ceph-mon[33391]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:51 smithi116 ceph-mon[33391]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:52.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.459+0000 7f8eadcf4700 1 -- 172.21.15.88:0/1304809784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea8100340 msgr2=0x7f8ea8100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:52.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.459+0000 7f8eadcf4700 1 --2- 172.21.15.88:0/1304809784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea8100340 0x7f8ea8100790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009910 tx=0x7f8e9c009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:52.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.460+0000 7f8eadcf4700 1 -- 172.21.15.88:0/1304809784 shutdown_connections 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.460+0000 7f8eadcf4700 1 --2- 172.21.15.88:0/1304809784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea8100340 0x7f8ea8100790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.460+0000 7f8eadcf4700 1 --2- 172.21.15.88:0/1304809784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea80ff140 0x7f8ea80ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.460+0000 7f8eadcf4700 1 -- 172.21.15.88:0/1304809784 >> 172.21.15.88:0/1304809784 conn(0x7f8ea80fa6d0 msgr2=0x7f8ea80fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.460+0000 7f8eadcf4700 1 -- 172.21.15.88:0/1304809784 shutdown_connections 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.460+0000 7f8eadcf4700 1 -- 172.21.15.88:0/1304809784 wait complete. 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.460+0000 7f8eadcf4700 1 Processor -- start 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.460+0000 7f8eadcf4700 1 -- start start 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8eadcf4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea80ff140 0x7f8ea8194a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8eadcf4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea8100340 0x7f8ea8194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8eadcf4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81955b0 con 0x7f8ea80ff140 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8eadcf4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81956f0 con 0x7f8ea8100340 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea80ff140 0x7f8ea8194a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea80ff140 0x7f8ea8194a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47344/0 (socket says 172.21.15.88:47344) 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea77fe700 1 -- 172.21.15.88:0/2382868546 learned_addr learned my addr 172.21.15.88:0/2382868546 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea6ffd700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea8100340 0x7f8ea8194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea77fe700 1 -- 172.21.15.88:0/2382868546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea8100340 msgr2=0x7f8ea8194f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea77fe700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea8100340 0x7f8ea8194f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea77fe700 1 -- 172.21.15.88:0/2382868546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0095f0 con 0x7f8ea80ff140 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea6ffd700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea8100340 0x7f8ea8194f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:37:52.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea77fe700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea80ff140 0x7f8ea8194a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800b9c0 tx=0x7f8e9800bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea4ff9700 1 -- 172.21.15.88:0/2382868546 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e9800c980 con 0x7f8ea80ff140 2024-09-13T21:37:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea4ff9700 1 -- 172.21.15.88:0/2382868546 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e98014440 con 0x7f8ea80ff140 2024-09-13T21:37:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea819a1a0 con 0x7f8ea80ff140 2024-09-13T21:37:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8ea4ff9700 1 -- 172.21.15.88:0/2382868546 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e98012550 con 0x7f8ea80ff140 2024-09-13T21:37:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.461+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea819a6f0 con 0x7f8ea80ff140 2024-09-13T21:37:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.462+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8107d30 con 0x7f8ea80ff140 2024-09-13T21:37:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.463+0000 7f8ea4ff9700 1 -- 172.21.15.88:0/2382868546 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8e980145b0 con 0x7f8ea80ff140 2024-09-13T21:37:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.463+0000 7f8ea4ff9700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e9006c680 0x7f8e9006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.464+0000 7f8ea6ffd700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e9006c680 0x7f8e9006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.464+0000 7f8ea4ff9700 1 -- 172.21.15.88:0/2382868546 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f8e98006e40 con 0x7f8ea80ff140 2024-09-13T21:37:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.464+0000 7f8ea6ffd700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e9006c680 0x7f8e9006eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005b40 tx=0x7f8e9c005ab0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:52.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.468+0000 7f8ea4ff9700 1 -- 172.21.15.88:0/2382868546 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8e9804e720 con 0x7f8ea80ff140 2024-09-13T21:37:52.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.667+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ea819ade0 con 0x7f8e9006c680 2024-09-13T21:37:52.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.672+0000 7f8ea4ff9700 1 -- 172.21.15.88:0/2382868546 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f8ea819ade0 con 0x7f8e9006c680 2024-09-13T21:37:52.674 INFO:teuthology.orchestra.run.smithi088.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T21:37:52.674 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T21:37:52.674 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter 2/2 2m ago 6m * 2024-09-13T21:37:52.674 INFO:teuthology.orchestra.run.smithi088.stdout:crash 2/2 2m ago 6m * 2024-09-13T21:37:52.675 INFO:teuthology.orchestra.run.smithi088.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-09-13T21:37:52.675 INFO:teuthology.orchestra.run.smithi088.stdout:mgr 2/2 2m ago 6m count:2 2024-09-13T21:37:52.675 INFO:teuthology.orchestra.run.smithi088.stdout:mon 2/2 2m ago 5m smithi088:172.21.15.88=smithi088;smithi116:172.21.15.116=smithi116;count:2 2024-09-13T21:37:52.675 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-09-13T21:37:52.675 INFO:teuthology.orchestra.run.smithi088.stdout:osd 6 2m ago - 2024-09-13T21:37:52.675 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.674+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e9006c680 msgr2=0x7f8e9006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.674+0000 7f8eadcf4700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e9006c680 0x7f8e9006eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005b40 tx=0x7f8e9c005ab0 comp rx=0 tx=0).stop 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.675+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea80ff140 msgr2=0x7f8ea8194a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.675+0000 7f8eadcf4700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea80ff140 0x7f8ea8194a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800b9c0 tx=0x7f8e9800bd80 comp rx=0 tx=0).stop 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.675+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 shutdown_connections 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.675+0000 7f8eadcf4700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f8e9006c680 0x7f8e9006eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.675+0000 7f8eadcf4700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ea80ff140 0x7f8ea8194a50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.675+0000 7f8eadcf4700 1 --2- 172.21.15.88:0/2382868546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea8100340 0x7f8ea8194f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.675+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 >> 172.21.15.88:0/2382868546 conn(0x7f8ea80fa6d0 msgr2=0x7f8ea8103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.675+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 shutdown_connections 2024-09-13T21:37:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:52.675+0000 7f8eadcf4700 1 -- 172.21.15.88:0/2382868546 wait complete. 2024-09-13T21:37:53.321 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:53 smithi088 ceph-mon[27963]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:53.342 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T21:37:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:53 smithi116 ceph-mon[33391]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:54.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:54 smithi088 ceph-mon[27963]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:54 smithi116 ceph-mon[33391]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:55.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.131+0000 7f7c93de7700 1 -- 172.21.15.88:0/225228436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c0ff430 msgr2=0x7f7c8c0ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:55.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.131+0000 7f7c93de7700 1 --2- 172.21.15.88:0/225228436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c0ff430 0x7f7c8c0ff8a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009910 tx=0x7f7c80009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:55.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.131+0000 7f7c93de7700 1 -- 172.21.15.88:0/225228436 shutdown_connections 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.131+0000 7f7c93de7700 1 --2- 172.21.15.88:0/225228436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c0ff430 0x7f7c8c0ff8a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.131+0000 7f7c93de7700 1 --2- 172.21.15.88:0/225228436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c8c100730 0x7f7c8c100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.131+0000 7f7c93de7700 1 -- 172.21.15.88:0/225228436 >> 172.21.15.88:0/225228436 conn(0x7f7c8c0f9f10 msgr2=0x7f7c8c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.131+0000 7f7c93de7700 1 -- 172.21.15.88:0/225228436 shutdown_connections 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.131+0000 7f7c93de7700 1 -- 172.21.15.88:0/225228436 wait complete. 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c93de7700 1 Processor -- start 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c93de7700 1 -- start start 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c93de7700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c8c0ff430 0x7f7c8c0fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c93de7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c100730 0x7f7c8c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c93de7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c19adf0 con 0x7f7c8c100730 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c93de7700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c19af30 con 0x7f7c8c0ff430 2024-09-13T21:37:55.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c91382700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c100730 0x7f7c8c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c91382700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c100730 0x7f7c8c19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47368/0 (socket says 172.21.15.88:47368) 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c91382700 1 -- 172.21.15.88:0/2471357514 learned_addr learned my addr 172.21.15.88:0/2471357514 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c91b83700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c8c0ff430 0x7f7c8c0fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c91382700 1 -- 172.21.15.88:0/2471357514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c8c0ff430 msgr2=0x7f7c8c0fee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c91382700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c8c0ff430 0x7f7c8c0fee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.132+0000 7f7c91382700 1 -- 172.21.15.88:0/2471357514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800095f0 con 0x7f7c8c100730 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.133+0000 7f7c91382700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c100730 0x7f7c8c19a820 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c80006010 tx=0x7f7c8000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.133+0000 7f7c7effd700 1 -- 172.21.15.88:0/2471357514 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c8001d070 con 0x7f7c8c100730 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.133+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8c19b1b0 con 0x7f7c8c100730 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.133+0000 7f7c7effd700 1 -- 172.21.15.88:0/2471357514 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7c8000f460 con 0x7f7c8c100730 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.133+0000 7f7c7effd700 1 -- 172.21.15.88:0/2471357514 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c80021640 con 0x7f7c8c100730 2024-09-13T21:37:55.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.133+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8c19b6a0 con 0x7f7c8c100730 2024-09-13T21:37:55.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.134+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8c107bf0 con 0x7f7c8c100730 2024-09-13T21:37:55.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.134+0000 7f7c7effd700 1 -- 172.21.15.88:0/2471357514 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7c80003a60 con 0x7f7c8c100730 2024-09-13T21:37:55.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.135+0000 7f7c7effd700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c7806c680 0x7f7c7806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:55.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.135+0000 7f7c7effd700 1 -- 172.21.15.88:0/2471357514 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f7c8008c6d0 con 0x7f7c8c100730 2024-09-13T21:37:55.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.135+0000 7f7c91b83700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c7806c680 0x7f7c7806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:55.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.135+0000 7f7c91b83700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c7806c680 0x7f7c7806eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c88005950 tx=0x7f7c8800b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:55.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.139+0000 7f7c7effd700 1 -- 172.21.15.88:0/2471357514 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7c8005ac20 con 0x7f7c8c100730 2024-09-13T21:37:55.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.334+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c8c104d90 con 0x7f7c7806c680 2024-09-13T21:37:55.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.336+0000 7f7c7effd700 1 -- 172.21.15.88:0/2471357514 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f7c8c104d90 con 0x7f7c7806c680 2024-09-13T21:37:55.337 INFO:teuthology.orchestra.run.smithi088.stdout:HOST ADDR LABELS STATUS 2024-09-13T21:37:55.337 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088 172.21.15.88 2024-09-13T21:37:55.338 INFO:teuthology.orchestra.run.smithi088.stdout:smithi116 172.21.15.116 2024-09-13T21:37:55.338 INFO:teuthology.orchestra.run.smithi088.stdout:2 hosts in cluster 2024-09-13T21:37:55.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c7806c680 msgr2=0x7f7c7806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:55.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c7806c680 0x7f7c7806eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c88005950 tx=0x7f7c8800b410 comp rx=0 tx=0).stop 2024-09-13T21:37:55.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c100730 msgr2=0x7f7c8c19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:55.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c100730 0x7f7c8c19a820 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c80006010 tx=0x7f7c8000bd70 comp rx=0 tx=0).stop 2024-09-13T21:37:55.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 shutdown_connections 2024-09-13T21:37:55.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c7806c680 0x7f7c7806eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:55.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c8c0ff430 0x7f7c8c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:55.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 --2- 172.21.15.88:0/2471357514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c8c100730 0x7f7c8c19a820 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:55.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 >> 172.21.15.88:0/2471357514 conn(0x7f7c8c0f9f10 msgr2=0x7f7c8c103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:55.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 shutdown_connections 2024-09-13T21:37:55.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:55.338+0000 7f7c93de7700 1 -- 172.21.15.88:0/2471357514 wait complete. 2024-09-13T21:37:55.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:55 smithi088 ceph-mon[27963]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:55 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:55 smithi116 ceph-mon[33391]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:55 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:55.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T21:37:56.097 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:56.462 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:56 smithi088 ceph-mon[27963]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:56.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:56 smithi116 ceph-mon[33391]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:57.166 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:57 smithi088 ceph-mon[27963]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:57.179 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:57 smithi116 ceph-mon[33391]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3731614160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 msgr2=0x7f3edc100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 --2- 172.21.15.88:0/3731614160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 0x7f3edc100860 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009910 tx=0x7f3ec8009c20 comp rx=0 tx=0).stop 2024-09-13T21:37:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3731614160 shutdown_connections 2024-09-13T21:37:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 --2- 172.21.15.88:0/3731614160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 0x7f3edc100860 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 --2- 172.21.15.88:0/3731614160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3edc0ff150 0x7f3edc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3731614160 >> 172.21.15.88:0/3731614160 conn(0x7f3edc0fa7a0 msgr2=0x7f3edc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3731614160 shutdown_connections 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3731614160 wait complete. 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 Processor -- start 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 -- start start 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3edc0ff150 0x7f3edc195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 0x7f3edc196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc196920 con 0x7f3edc1003f0 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.689+0000 7f3ee2e9a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc196a60 con 0x7f3edc0ff150 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 0x7f3edc196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 0x7f3edc196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47384/0 (socket says 172.21.15.88:47384) 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3edbfff700 1 -- 172.21.15.88:0/3547486191 learned_addr learned my addr 172.21.15.88:0/3547486191 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3ee0c36700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3edc0ff150 0x7f3edc195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3edbfff700 1 -- 172.21.15.88:0/3547486191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3edc0ff150 msgr2=0x7f3edc195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3edbfff700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3edc0ff150 0x7f3edc195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3edbfff700 1 -- 172.21.15.88:0/3547486191 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80095f0 con 0x7f3edc1003f0 2024-09-13T21:37:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3edbfff700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 0x7f3edc196300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8006010 tx=0x7f3ec800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3ed9ffb700 1 -- 172.21.15.88:0/3547486191 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec801d070 con 0x7f3edc1003f0 2024-09-13T21:37:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3ed9ffb700 1 -- 172.21.15.88:0/3547486191 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ec800f460 con 0x7f3edc1003f0 2024-09-13T21:37:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc19b4b0 con 0x7f3edc1003f0 2024-09-13T21:37:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3ed9ffb700 1 -- 172.21.15.88:0/3547486191 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec8021640 con 0x7f3edc1003f0 2024-09-13T21:37:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.690+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc19b9a0 con 0x7f3edc1003f0 2024-09-13T21:37:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.691+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc068ab0 con 0x7f3edc1003f0 2024-09-13T21:37:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.692+0000 7f3ed9ffb700 1 -- 172.21.15.88:0/3547486191 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3ec800fab0 con 0x7f3edc1003f0 2024-09-13T21:37:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.692+0000 7f3ed9ffb700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ecc06c680 0x7f3ecc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.693+0000 7f3ee0c36700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ecc06c680 0x7f3ecc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:57.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.693+0000 7f3ed9ffb700 1 -- 172.21.15.88:0/3547486191 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f3ec808c720 con 0x7f3edc1003f0 2024-09-13T21:37:57.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.693+0000 7f3ee0c36700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ecc06c680 0x7f3ecc06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0005950 tx=0x7f3ed000b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.697+0000 7f3ed9ffb700 1 -- 172.21.15.88:0/3547486191 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3ec805ac70 con 0x7f3edc1003f0 2024-09-13T21:37:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.899+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3edc0694e0 con 0x7f3ecc06c680 2024-09-13T21:37:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.900+0000 7f3ed9ffb700 1 -- 172.21.15.88:0/3547486191 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3edc0694e0 con 0x7f3ecc06c680 2024-09-13T21:37:57.902 INFO:teuthology.orchestra.run.smithi088.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T21:37:57.902 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400XD400BGN 372G No 2m ago LVM detected, locked 2024-09-13T21:37:57.902 INFO:teuthology.orchestra.run.smithi088.stdout:smithi116 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN 372G No 68s ago LVM detected, locked 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.902+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ecc06c680 msgr2=0x7f3ecc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ecc06c680 0x7f3ecc06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0005950 tx=0x7f3ed000b410 comp rx=0 tx=0).stop 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 msgr2=0x7f3edc196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 0x7f3edc196300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8006010 tx=0x7f3ec800bd70 comp rx=0 tx=0).stop 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 shutdown_connections 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3ecc06c680 0x7f3ecc06eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3edc0ff150 0x7f3edc195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 --2- 172.21.15.88:0/3547486191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3edc1003f0 0x7f3edc196300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 >> 172.21.15.88:0/3547486191 conn(0x7f3edc0fa7a0 msgr2=0x7f3edc068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 shutdown_connections 2024-09-13T21:37:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:37:57.903+0000 7f3ee2e9a700 1 -- 172.21.15.88:0/3547486191 wait complete. 2024-09-13T21:37:58.487 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:37:58.497 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:37:58.497 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T21:37:58.698 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:37:59.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:59 smithi088 ceph-mon[27963]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:59.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:37:59 smithi088 ceph-mon[27963]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:37:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:59 smithi116 ceph-mon[33391]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:37:59 smithi116 ceph-mon[33391]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:00.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.436+0000 7fc0f8924700 1 -- 172.21.15.88:0/826549945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fe500 msgr2=0x7fc0f40fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.436+0000 7fc0f8924700 1 --2- 172.21.15.88:0/826549945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fe500 0x7fc0f40fe910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009910 tx=0x7fc0dc009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.436+0000 7fc0f8924700 1 -- 172.21.15.88:0/826549945 shutdown_connections 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.436+0000 7fc0f8924700 1 --2- 172.21.15.88:0/826549945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f40fee50 0x7fc0f4101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.436+0000 7fc0f8924700 1 --2- 172.21.15.88:0/826549945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fe500 0x7fc0f40fe910 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.436+0000 7fc0f8924700 1 -- 172.21.15.88:0/826549945 >> 172.21.15.88:0/826549945 conn(0x7fc0f40f9f10 msgr2=0x7fc0f40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.437+0000 7fc0f8924700 1 -- 172.21.15.88:0/826549945 shutdown_connections 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.437+0000 7fc0f8924700 1 -- 172.21.15.88:0/826549945 wait complete. 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.437+0000 7fc0f8924700 1 Processor -- start 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.437+0000 7fc0f8924700 1 -- start start 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f8924700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f40fe500 0x7fc0f4195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f8924700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fee50 0x7fc0f4196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f8924700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f4196660 con 0x7fc0f40fee50 2024-09-13T21:38:00.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f8924700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f41967a0 con 0x7fc0f40fe500 2024-09-13T21:38:00.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f1d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fee50 0x7fc0f4196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:00.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f1d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fee50 0x7fc0f4196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55566/0 (socket says 172.21.15.88:55566) 2024-09-13T21:38:00.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f1d9b700 1 -- 172.21.15.88:0/4178914655 learned_addr learned my addr 172.21.15.88:0/4178914655 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:00.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f259c700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f40fe500 0x7fc0f4195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:00.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f1d9b700 1 -- 172.21.15.88:0/4178914655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f40fe500 msgr2=0x7fc0f4195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:00.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f1d9b700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f40fe500 0x7fc0f4195b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:00.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f1d9b700 1 -- 172.21.15.88:0/4178914655 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc0095f0 con 0x7fc0f40fee50 2024-09-13T21:38:00.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f1d9b700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fee50 0x7fc0f4196040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400d8d0 tx=0x7fc0e400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:00.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0eb7fe700 1 -- 172.21.15.88:0/4178914655 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e400f860 con 0x7fc0f40fee50 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f419b250 con 0x7fc0f40fee50 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0eb7fe700 1 -- 172.21.15.88:0/4178914655 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0e400fe70 con 0x7fc0f40fee50 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0eb7fe700 1 -- 172.21.15.88:0/4178914655 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e400e5e0 con 0x7fc0f40fee50 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.438+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f419b7a0 con 0x7fc0f40fee50 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.439+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f4108d50 con 0x7fc0f40fee50 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.440+0000 7fc0eb7fe700 1 -- 172.21.15.88:0/4178914655 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc0e400e810 con 0x7fc0f40fee50 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.440+0000 7fc0eb7fe700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc0e006c680 0x7fc0e006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.440+0000 7fc0eb7fe700 1 -- 172.21.15.88:0/4178914655 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc0e408b090 con 0x7fc0f40fee50 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.440+0000 7fc0f259c700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc0e006c680 0x7fc0e006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:00.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.441+0000 7fc0f259c700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc0e006c680 0x7fc0e006eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc006010 tx=0x7fc0dc00b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:00.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.445+0000 7fc0eb7fe700 1 -- 172.21.15.88:0/4178914655 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc0e40596c0 con 0x7fc0f40fee50 2024-09-13T21:38:00.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:00.662+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0f4105ed0 con 0x7fc0e006c680 2024-09-13T21:38:01.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:01 smithi088 ceph-mon[27963]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:01.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:01 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T21:38:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:01 smithi116 ceph-mon[33391]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:01.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:01 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T21:38:02.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.196+0000 7fc0eb7fe700 1 -- 172.21.15.88:0/4178914655 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc0f4105ed0 con 0x7fc0e006c680 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc0e006c680 msgr2=0x7fc0e006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc0e006c680 0x7fc0e006eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc006010 tx=0x7fc0dc00b540 comp rx=0 tx=0).stop 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fee50 msgr2=0x7fc0f4196040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fee50 0x7fc0f4196040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400d8d0 tx=0x7fc0e400dbe0 comp rx=0 tx=0).stop 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 shutdown_connections 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fc0e006c680 0x7fc0e006eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f40fe500 0x7fc0f4195b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 --2- 172.21.15.88:0/4178914655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0f40fee50 0x7fc0f4196040 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 >> 172.21.15.88:0/4178914655 conn(0x7fc0f40f9f10 msgr2=0x7fc0f41047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:02.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 shutdown_connections 2024-09-13T21:38:02.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:02.199+0000 7fc0f8924700 1 -- 172.21.15.88:0/4178914655 wait complete. 2024-09-13T21:38:02.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:02 smithi088 ceph-mon[27963]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:38:02.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:02 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T21:38:02.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:02 smithi088 ceph-mon[27963]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T21:38:02.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:02 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T21:38:02.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:02 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088[27959]: 2024-09-13T21:38:02.176+0000 7ff3a3bb4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:38:02.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:02 smithi116 ceph-mon[33391]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:38:02.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:02 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T21:38:02.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:02 smithi116 ceph-mon[33391]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T21:38:02.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:02 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T21:38:02.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T21:38:03.424 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: pgmap v176: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:03.424 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T21:38:03.424 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T21:38:03.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T21:38:03.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:38:03.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:38:03.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T21:38:03.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T21:38:03.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: fsmap cephfs:0 2024-09-13T21:38:03.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: Saving service mds.cephfs spec with placement count:4 2024-09-13T21:38:03.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:03.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:03.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:03.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:03.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:03.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.yszliw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:38:03.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.yszliw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:38:03.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:03 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: pgmap v176: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: fsmap cephfs:0 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: Saving service mds.cephfs spec with placement count:4 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:03.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:03.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:03.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.yszliw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:38:03.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.yszliw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:38:03.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:03 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:04.157 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:04.279 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:04 smithi088 ceph-mon[27963]: Deploying daemon mds.cephfs.smithi088.yszliw on smithi088 2024-09-13T21:38:04.279 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:04 smithi088 ceph-mon[27963]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T21:38:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:04 smithi116 ceph-mon[33391]: Deploying daemon mds.cephfs.smithi088.yszliw on smithi088 2024-09-13T21:38:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:04 smithi116 ceph-mon[33391]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T21:38:05.284 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:05 smithi088 ceph-mon[27963]: pgmap v180: 65 pgs: 5 creating+peering, 14 active+clean, 46 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:05.284 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:05 smithi088 ceph-mon[27963]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T21:38:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:05 smithi116 ceph-mon[33391]: pgmap v180: 65 pgs: 5 creating+peering, 14 active+clean, 46 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:05 smithi116 ceph-mon[33391]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T21:38:06.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.023+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3715288328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 msgr2=0x7f9a840ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:06.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.023+0000 7f9a8aaa9700 1 --2- 172.21.15.88:0/3715288328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 0x7f9a840ff560 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000b0a0 tx=0x7f9a8000b3b0 comp rx=0 tx=0).stop 2024-09-13T21:38:06.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.023+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3715288328 shutdown_connections 2024-09-13T21:38:06.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.023+0000 7f9a8aaa9700 1 --2- 172.21.15.88:0/3715288328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a84100350 0x7f9a841007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:06.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.023+0000 7f9a8aaa9700 1 --2- 172.21.15.88:0/3715288328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 0x7f9a840ff560 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:06.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.023+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3715288328 >> 172.21.15.88:0/3715288328 conn(0x7f9a840fa700 msgr2=0x7f9a840fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:06.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.023+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3715288328 shutdown_connections 2024-09-13T21:38:06.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.023+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3715288328 wait complete. 2024-09-13T21:38:06.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.023+0000 7f9a8aaa9700 1 Processor -- start 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a8aaa9700 1 -- start start 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a8aaa9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 0x7f9a84194b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a8aaa9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a84100350 0x7f9a84195040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a8aaa9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84195660 con 0x7f9a840ff150 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a8aaa9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a841957a0 con 0x7f9a84100350 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a88845700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 0x7f9a84194b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a88845700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 0x7f9a84194b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55586/0 (socket says 172.21.15.88:55586) 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a88845700 1 -- 172.21.15.88:0/3944173780 learned_addr learned my addr 172.21.15.88:0/3944173780 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a88845700 1 -- 172.21.15.88:0/3944173780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a84100350 msgr2=0x7f9a84195040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a7bfff700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a84100350 0x7f9a84195040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a88845700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a84100350 0x7f9a84195040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a88845700 1 -- 172.21.15.88:0/3944173780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009d00 con 0x7f9a840ff150 2024-09-13T21:38:06.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a7bfff700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a84100350 0x7f9a84195040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:38:06.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a88845700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 0x7f9a84194b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a800077b0 tx=0x7f9a80003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:06.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.024+0000 7f9a79ffb700 1 -- 172.21.15.88:0/3944173780 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8000e040 con 0x7f9a840ff150 2024-09-13T21:38:06.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.025+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8419a1f0 con 0x7f9a840ff150 2024-09-13T21:38:06.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.025+0000 7f9a79ffb700 1 -- 172.21.15.88:0/3944173780 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9a8000ce60 con 0x7f9a840ff150 2024-09-13T21:38:06.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.025+0000 7f9a79ffb700 1 -- 172.21.15.88:0/3944173780 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8001db10 con 0x7f9a840ff150 2024-09-13T21:38:06.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.025+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8419a6e0 con 0x7f9a840ff150 2024-09-13T21:38:06.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.026+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a84107d20 con 0x7f9a840ff150 2024-09-13T21:38:06.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.026+0000 7f9a79ffb700 1 -- 172.21.15.88:0/3944173780 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9a8001dc90 con 0x7f9a840ff150 2024-09-13T21:38:06.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.027+0000 7f9a79ffb700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9a6c06c680 0x7f9a6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:06.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.027+0000 7f9a79ffb700 1 -- 172.21.15.88:0/3944173780 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9a8008d280 con 0x7f9a840ff150 2024-09-13T21:38:06.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.027+0000 7f9a7bfff700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9a6c06c680 0x7f9a6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:06.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.027+0000 7f9a7bfff700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9a6c06c680 0x7f9a6c06eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a74007900 tx=0x7f9a74008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:06.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.031+0000 7f9a79ffb700 1 -- 172.21.15.88:0/3944173780 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9a8005b4a0 con 0x7f9a840ff150 2024-09-13T21:38:06.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.268+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9a8419ade0 con 0x7f9a840ff150 2024-09-13T21:38:06.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.268+0000 7f9a79ffb700 1 -- 172.21.15.88:0/3944173780 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7f9a8419ade0 con 0x7f9a840ff150 2024-09-13T21:38:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:e2 2024-09-13T21:38:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:38:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 2 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:38:02.177022+0000 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:38:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 0 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 1 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:in 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:up {} 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:38:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:38:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data disabled 2024-09-13T21:38:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:38:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:38:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 0 2024-09-13T21:38:06.274 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:38:06.274 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.270+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9a6c06c680 msgr2=0x7f9a6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.270+0000 7f9a8aaa9700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9a6c06c680 0x7f9a6c06eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a74007900 tx=0x7f9a74008040 comp rx=0 tx=0).stop 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.270+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 msgr2=0x7f9a84194b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.270+0000 7f9a8aaa9700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 0x7f9a84194b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a800077b0 tx=0x7f9a80003ce0 comp rx=0 tx=0).stop 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.270+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 shutdown_connections 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.270+0000 7f9a8aaa9700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f9a6c06c680 0x7f9a6c06eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.270+0000 7f9a8aaa9700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a840ff150 0x7f9a84194b00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.270+0000 7f9a8aaa9700 1 --2- 172.21.15.88:0/3944173780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a84100350 0x7f9a84195040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.270+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 >> 172.21.15.88:0/3944173780 conn(0x7f9a840fa700 msgr2=0x7f9a84103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.271+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 shutdown_connections 2024-09-13T21:38:06.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:06.271+0000 7f9a8aaa9700 1 -- 172.21.15.88:0/3944173780 wait complete. 2024-09-13T21:38:06.276 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2024-09-13T21:38:06.849 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:38:06.858 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:38:06.859 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-13T21:38:07.068 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:06 smithi116 ceph-mon[33391]: pgmap v182: 65 pgs: 5 creating+peering, 50 active+clean, 10 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:06 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3944173780' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:38:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:06 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:06 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:07.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:06 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:07.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:06 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.rwfayz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:38:07.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:06 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.rwfayz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:38:07.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:06 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:07.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:06 smithi116 ceph-mon[33391]: Deploying daemon mds.cephfs.smithi116.rwfayz on smithi116 2024-09-13T21:38:07.187 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:06 smithi088 ceph-mon[27963]: pgmap v182: 65 pgs: 5 creating+peering, 50 active+clean, 10 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:07.187 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:06 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3944173780' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:38:07.187 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:06 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:07.187 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:06 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:07.187 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:06 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:07.187 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:06 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.rwfayz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:38:07.187 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:06 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.rwfayz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:38:07.188 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:06 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:07.188 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:06 smithi088 ceph-mon[27963]: Deploying daemon mds.cephfs.smithi116.rwfayz on smithi116 2024-09-13T21:38:08.116 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:07 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.88:6826/2645824326,v1:172.21.15.88:6827/2645824326] up:boot 2024-09-13T21:38:08.116 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:07 smithi116 ceph-mon[33391]: daemon mds.cephfs.smithi088.yszliw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T21:38:08.116 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:07 smithi116 ceph-mon[33391]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:38:08.116 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:07 smithi116 ceph-mon[33391]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:38:08.116 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:07 smithi116 ceph-mon[33391]: Cluster is now healthy 2024-09-13T21:38:08.116 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:07 smithi116 ceph-mon[33391]: fsmap cephfs:0 1 up:standby 2024-09-13T21:38:08.116 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:07 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:38:08.117 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:07 smithi116 ceph-mon[33391]: fsmap cephfs:1 {0=cephfs.smithi088.yszliw=up:creating} 2024-09-13T21:38:08.117 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:07 smithi116 ceph-mon[33391]: daemon mds.cephfs.smithi088.yszliw is now active in filesystem cephfs as rank 0 2024-09-13T21:38:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:07 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.88:6826/2645824326,v1:172.21.15.88:6827/2645824326] up:boot 2024-09-13T21:38:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:07 smithi088 ceph-mon[27963]: daemon mds.cephfs.smithi088.yszliw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T21:38:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:07 smithi088 ceph-mon[27963]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:38:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:07 smithi088 ceph-mon[27963]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:38:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:07 smithi088 ceph-mon[27963]: Cluster is now healthy 2024-09-13T21:38:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:07 smithi088 ceph-mon[27963]: fsmap cephfs:0 1 up:standby 2024-09-13T21:38:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:07 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:38:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:07 smithi088 ceph-mon[27963]: fsmap cephfs:1 {0=cephfs.smithi088.yszliw=up:creating} 2024-09-13T21:38:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:07 smithi088 ceph-mon[27963]: daemon mds.cephfs.smithi088.yszliw is now active in filesystem cephfs as rank 0 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.591+0000 7f3c918f7700 1 -- 172.21.15.88:0/568596304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c0ff150 msgr2=0x7f3c8c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.591+0000 7f3c918f7700 1 --2- 172.21.15.88:0/568596304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c0ff150 0x7f3c8c0ff560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009910 tx=0x7f3c74009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.591+0000 7f3c918f7700 1 -- 172.21.15.88:0/568596304 shutdown_connections 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.591+0000 7f3c918f7700 1 --2- 172.21.15.88:0/568596304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c1003f0 0x7f3c8c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.591+0000 7f3c918f7700 1 --2- 172.21.15.88:0/568596304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c0ff150 0x7f3c8c0ff560 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.591+0000 7f3c918f7700 1 -- 172.21.15.88:0/568596304 >> 172.21.15.88:0/568596304 conn(0x7f3c8c0fa7a0 msgr2=0x7f3c8c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.591+0000 7f3c918f7700 1 -- 172.21.15.88:0/568596304 shutdown_connections 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.591+0000 7f3c918f7700 1 -- 172.21.15.88:0/568596304 wait complete. 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c918f7700 1 Processor -- start 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c918f7700 1 -- start start 2024-09-13T21:38:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c918f7700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c0ff150 0x7f3c8c195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c918f7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c1003f0 0x7f3c8c196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c918f7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c196970 con 0x7f3c8c1003f0 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c918f7700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c196ab0 con 0x7f3c8c0ff150 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c8a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c1003f0 0x7f3c8c196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c8a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c1003f0 0x7f3c8c196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55632/0 (socket says 172.21.15.88:55632) 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c8a7fc700 1 -- 172.21.15.88:0/1990227381 learned_addr learned my addr 172.21.15.88:0/1990227381 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.592+0000 7f3c8affd700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c0ff150 0x7f3c8c195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.593+0000 7f3c8a7fc700 1 -- 172.21.15.88:0/1990227381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c0ff150 msgr2=0x7f3c8c195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.593+0000 7f3c8a7fc700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c0ff150 0x7f3c8c195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.593+0000 7f3c8a7fc700 1 -- 172.21.15.88:0/1990227381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c740095f0 con 0x7f3c8c1003f0 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.593+0000 7f3c8a7fc700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c1003f0 0x7f3c8c196350 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00d8d0 tx=0x7f3c7c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:08.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.593+0000 7f3c908f5700 1 -- 172.21.15.88:0/1990227381 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c7c0098a0 con 0x7f3c8c1003f0 2024-09-13T21:38:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.593+0000 7f3c908f5700 1 -- 172.21.15.88:0/1990227381 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3c7c010460 con 0x7f3c8c1003f0 2024-09-13T21:38:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.593+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c19b560 con 0x7f3c8c1003f0 2024-09-13T21:38:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.593+0000 7f3c908f5700 1 -- 172.21.15.88:0/1990227381 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c7c00f5f0 con 0x7f3c8c1003f0 2024-09-13T21:38:08.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.593+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c19bab0 con 0x7f3c8c1003f0 2024-09-13T21:38:08.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.594+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c068ab0 con 0x7f3c8c1003f0 2024-09-13T21:38:08.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.595+0000 7f3c908f5700 1 -- 172.21.15.88:0/1990227381 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3c7c009a00 con 0x7f3c8c1003f0 2024-09-13T21:38:08.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.595+0000 7f3c908f5700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3c7806c680 0x7f3c7806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:08.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.595+0000 7f3c8affd700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3c7806c680 0x7f3c7806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:08.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.595+0000 7f3c908f5700 1 -- 172.21.15.88:0/1990227381 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3c7c08b6b0 con 0x7f3c8c1003f0 2024-09-13T21:38:08.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.595+0000 7f3c8affd700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3c7806c680 0x7f3c7806eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400b5c0 tx=0x7f3c74005ee0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:08.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.599+0000 7f3c908f5700 1 -- 172.21.15.88:0/1990227381 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3c7c0598d0 con 0x7f3c8c1003f0 2024-09-13T21:38:08.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.833+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f3c8c19bcd0 con 0x7f3c8c1003f0 2024-09-13T21:38:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.923+0000 7f3c908f5700 1 -- 172.21.15.88:0/1990227381 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3c7c059460 con 0x7f3c8c1003f0 2024-09-13T21:38:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.925+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3c7806c680 msgr2=0x7f3c7806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.925+0000 7f3c918f7700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3c7806c680 0x7f3c7806eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400b5c0 tx=0x7f3c74005ee0 comp rx=0 tx=0).stop 2024-09-13T21:38:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.925+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c1003f0 msgr2=0x7f3c8c196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.925+0000 7f3c918f7700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c1003f0 0x7f3c8c196350 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00d8d0 tx=0x7f3c7c00dbe0 comp rx=0 tx=0).stop 2024-09-13T21:38:08.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.926+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 shutdown_connections 2024-09-13T21:38:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.926+0000 7f3c918f7700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f3c7806c680 0x7f3c7806eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.926+0000 7f3c918f7700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c0ff150 0x7f3c8c195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.926+0000 7f3c918f7700 1 --2- 172.21.15.88:0/1990227381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c8c1003f0 0x7f3c8c196350 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.926+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 >> 172.21.15.88:0/1990227381 conn(0x7f3c8c0fa7a0 msgr2=0x7f3c8c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.926+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 shutdown_connections 2024-09-13T21:38:08.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:08.926+0000 7f3c918f7700 1 -- 172.21.15.88:0/1990227381 wait complete. 2024-09-13T21:38:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:08 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.88:6826/2645824326,v1:172.21.15.88:6827/2645824326] up:active 2024-09-13T21:38:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:08 smithi116 ceph-mon[33391]: fsmap cephfs:1 {0=cephfs.smithi088.yszliw=up:active} 2024-09-13T21:38:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:08 smithi116 ceph-mon[33391]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:08 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/1990227381' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T21:38:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:08 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:08 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:09.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:08 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.88:6826/2645824326,v1:172.21.15.88:6827/2645824326] up:active 2024-09-13T21:38:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:08 smithi088 ceph-mon[27963]: fsmap cephfs:1 {0=cephfs.smithi088.yszliw=up:active} 2024-09-13T21:38:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:08 smithi088 ceph-mon[27963]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:08 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1990227381' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T21:38:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:08 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:08 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:09.554 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:38:09.564 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:38:09.564 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-13T21:38:10.189 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:38:10.189 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] up:boot 2024-09-13T21:38:10.189 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1990227381' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T21:38:10.189 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: daemon mds.cephfs.smithi116.rwfayz assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: fsmap cephfs:1 {0=cephfs.smithi088.yszliw=up:active} 1 up:standby 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:creating} 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: daemon mds.cephfs.smithi116.rwfayz is now active in filesystem cephfs as rank 1 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.vqfqko", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.vqfqko", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:10.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:09 smithi088 ceph-mon[27963]: Deploying daemon mds.cephfs.smithi088.vqfqko on smithi088 2024-09-13T21:38:10.340 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:38:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] up:boot 2024-09-13T21:38:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/1990227381' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T21:38:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: daemon mds.cephfs.smithi116.rwfayz assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: fsmap cephfs:1 {0=cephfs.smithi088.yszliw=up:active} 1 up:standby 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:creating} 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: daemon mds.cephfs.smithi116.rwfayz is now active in filesystem cephfs as rank 1 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.vqfqko", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.vqfqko", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:09 smithi116 ceph-mon[33391]: Deploying daemon mds.cephfs.smithi088.vqfqko on smithi088 2024-09-13T21:38:10.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:10 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] up:active 2024-09-13T21:38:10.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:10 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:active} 2024-09-13T21:38:10.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:10 smithi088 ceph-mon[27963]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-13T21:38:10.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:10.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:11.146 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:10 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] up:active 2024-09-13T21:38:11.146 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:10 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:active} 2024-09-13T21:38:11.146 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:10 smithi116 ceph-mon[33391]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-13T21:38:11.147 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:11.147 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.447+0000 7ff35182b700 1 -- 172.21.15.88:0/3146786784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 msgr2=0x7ff34c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.447+0000 7ff35182b700 1 --2- 172.21.15.88:0/3146786784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 0x7ff34c100650 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009910 tx=0x7ff33c009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.447+0000 7ff35182b700 1 -- 172.21.15.88:0/3146786784 shutdown_connections 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.447+0000 7ff35182b700 1 --2- 172.21.15.88:0/3146786784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff34c101440 0x7ff34c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.447+0000 7ff35182b700 1 --2- 172.21.15.88:0/3146786784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 0x7ff34c100650 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.447+0000 7ff35182b700 1 -- 172.21.15.88:0/3146786784 >> 172.21.15.88:0/3146786784 conn(0x7ff34c0fb7f0 msgr2=0x7ff34c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.447+0000 7ff35182b700 1 -- 172.21.15.88:0/3146786784 shutdown_connections 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.447+0000 7ff35182b700 1 -- 172.21.15.88:0/3146786784 wait complete. 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.448+0000 7ff35182b700 1 Processor -- start 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.448+0000 7ff35182b700 1 -- start start 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.448+0000 7ff35182b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 0x7ff34c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:12.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.448+0000 7ff35182b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff34c101440 0x7ff34c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.448+0000 7ff35182b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c196630 con 0x7ff34c100240 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.448+0000 7ff35182b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c196770 con 0x7ff34c101440 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.448+0000 7ff34affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 0x7ff34c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.448+0000 7ff34affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 0x7ff34c195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45386/0 (socket says 172.21.15.88:45386) 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.448+0000 7ff34affd700 1 -- 172.21.15.88:0/2389137118 learned_addr learned my addr 172.21.15.88:0/2389137118 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff34a7fc700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff34c101440 0x7ff34c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff34affd700 1 -- 172.21.15.88:0/2389137118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff34c101440 msgr2=0x7ff34c196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff34affd700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff34c101440 0x7ff34c196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff34affd700 1 -- 172.21.15.88:0/2389137118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0095f0 con 0x7ff34c100240 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff34a7fc700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff34c101440 0x7ff34c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:38:12.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff34affd700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 0x7ff34c195ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff33c000c00 tx=0x7ff33c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:12.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff350829700 1 -- 172.21.15.88:0/2389137118 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff33c01d070 con 0x7ff34c100240 2024-09-13T21:38:12.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c19b1c0 con 0x7ff34c100240 2024-09-13T21:38:12.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff350829700 1 -- 172.21.15.88:0/2389137118 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff33c005dc0 con 0x7ff34c100240 2024-09-13T21:38:12.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff350829700 1 -- 172.21.15.88:0/2389137118 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff33c022470 con 0x7ff34c100240 2024-09-13T21:38:12.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.449+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c19b6b0 con 0x7ff34c100240 2024-09-13T21:38:12.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.450+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c108d90 con 0x7ff34c100240 2024-09-13T21:38:12.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.451+0000 7ff350829700 1 -- 172.21.15.88:0/2389137118 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff33c017400 con 0x7ff34c100240 2024-09-13T21:38:12.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.451+0000 7ff350829700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff33406c680 0x7ff33406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:12.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.451+0000 7ff34a7fc700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff33406c680 0x7ff33406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:12.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.451+0000 7ff350829700 1 -- 172.21.15.88:0/2389137118 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff33c08cc10 con 0x7ff34c100240 2024-09-13T21:38:12.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.452+0000 7ff34a7fc700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff33406c680 0x7ff33406eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff340011490 tx=0x7ff340009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:12.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.456+0000 7ff350829700 1 -- 172.21.15.88:0/2389137118 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff33c05aeb0 con 0x7ff34c100240 2024-09-13T21:38:12.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:12.691+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff34c108f50 con 0x7ff34c100240 2024-09-13T21:38:13.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.132+0000 7ff350829700 1 -- 172.21.15.88:0/2389137118 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff33c05aa40 con 0x7ff34c100240 2024-09-13T21:38:13.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.134+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff33406c680 msgr2=0x7ff33406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:13.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.134+0000 7ff35182b700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff33406c680 0x7ff33406eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff340011490 tx=0x7ff340009260 comp rx=0 tx=0).stop 2024-09-13T21:38:13.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.134+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 msgr2=0x7ff34c195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:13.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.134+0000 7ff35182b700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 0x7ff34c195ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff33c000c00 tx=0x7ff33c00f690 comp rx=0 tx=0).stop 2024-09-13T21:38:13.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.134+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 shutdown_connections 2024-09-13T21:38:13.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.134+0000 7ff35182b700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ff33406c680 0x7ff33406eb30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:13.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.134+0000 7ff35182b700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff34c100240 0x7ff34c195ad0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:13.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.134+0000 7ff35182b700 1 --2- 172.21.15.88:0/2389137118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff34c101440 0x7ff34c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:13.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.134+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 >> 172.21.15.88:0/2389137118 conn(0x7ff34c0fb7f0 msgr2=0x7ff34c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:13.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.135+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 shutdown_connections 2024-09-13T21:38:13.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:13.135+0000 7ff35182b700 1 -- 172.21.15.88:0/2389137118 wait complete. 2024-09-13T21:38:13.424 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:13 smithi116 ceph-mon[33391]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 8 op/s 2024-09-13T21:38:13.424 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:13 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2389137118' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-13T21:38:13.424 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:13 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:13.424 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:13 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:13.424 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:13 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:13.424 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:13 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.mjrkvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:38:13.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:13 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.mjrkvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:38:13.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:13 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:13.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:13 smithi088 ceph-mon[27963]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 8 op/s 2024-09-13T21:38:13.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:13 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2389137118' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-13T21:38:13.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:13 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:13.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:13 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:13.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:13 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:13.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:13 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.mjrkvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:38:13.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:13 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.mjrkvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:38:13.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:13 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:13.863 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:38:13.893 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:38:13.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-13T21:38:14.099 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:14.409 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:14 smithi088 ceph-mon[27963]: Deploying daemon mds.cephfs.smithi116.mjrkvg on smithi116 2024-09-13T21:38:14.409 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:14 smithi088 ceph-mon[27963]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T21:38:14.409 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:14 smithi088 ceph-mon[27963]: Cluster is now healthy 2024-09-13T21:38:14.409 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:14 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2389137118' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-13T21:38:14.409 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:14 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:boot 2024-09-13T21:38:14.409 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:14 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:active} 1 up:standby 2024-09-13T21:38:14.410 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:14 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:38:14.427 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:14 smithi116 ceph-mon[33391]: Deploying daemon mds.cephfs.smithi116.mjrkvg on smithi116 2024-09-13T21:38:14.427 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:14 smithi116 ceph-mon[33391]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T21:38:14.427 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:14 smithi116 ceph-mon[33391]: Cluster is now healthy 2024-09-13T21:38:14.427 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:14 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2389137118' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-13T21:38:14.427 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:14 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:boot 2024-09-13T21:38:14.427 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:14 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:active} 1 up:standby 2024-09-13T21:38:14.427 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:14 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:38:15.350 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:15 smithi116 ceph-mon[33391]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-13T21:38:15.350 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:15 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:15.432 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:15 smithi088 ceph-mon[27963]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-13T21:38:15.432 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:15 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:15.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.664+0000 7f21d6d71700 1 -- 172.21.15.88:0/1347361731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d0100350 msgr2=0x7f21d01007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:15.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.664+0000 7f21d6d71700 1 --2- 172.21.15.88:0/1347361731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d0100350 0x7f21d01007a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009910 tx=0x7f21bc009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:15.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.664+0000 7f21d6d71700 1 -- 172.21.15.88:0/1347361731 shutdown_connections 2024-09-13T21:38:15.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.664+0000 7f21d6d71700 1 --2- 172.21.15.88:0/1347361731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d0100350 0x7f21d01007a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.664+0000 7f21d6d71700 1 --2- 172.21.15.88:0/1347361731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21d00ff150 0x7f21d00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.664+0000 7f21d6d71700 1 -- 172.21.15.88:0/1347361731 >> 172.21.15.88:0/1347361731 conn(0x7f21d00fa700 msgr2=0x7f21d00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.664+0000 7f21d6d71700 1 -- 172.21.15.88:0/1347361731 shutdown_connections 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.664+0000 7f21d6d71700 1 -- 172.21.15.88:0/1347361731 wait complete. 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21d6d71700 1 Processor -- start 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21d6d71700 1 -- start start 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21d6d71700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d00ff150 0x7f21d0069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21d6d71700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21d0100350 0x7f21d019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21d6d71700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d019adc0 con 0x7f21d00ff150 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21d6d71700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d019af00 con 0x7f21d0100350 2024-09-13T21:38:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21d4b0d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d00ff150 0x7f21d0069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21d4b0d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d00ff150 0x7f21d0069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45420/0 (socket says 172.21.15.88:45420) 2024-09-13T21:38:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21d4b0d700 1 -- 172.21.15.88:0/616409807 learned_addr learned my addr 172.21.15.88:0/616409807 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.665+0000 7f21cffff700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21d0100350 0x7f21d019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.666+0000 7f21d4b0d700 1 -- 172.21.15.88:0/616409807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21d0100350 msgr2=0x7f21d019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.666+0000 7f21d4b0d700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21d0100350 0x7f21d019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.666+0000 7f21d4b0d700 1 -- 172.21.15.88:0/616409807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0095f0 con 0x7f21d00ff150 2024-09-13T21:38:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.666+0000 7f21d4b0d700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d00ff150 0x7f21d0069990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e8f0 tx=0x7f21c400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:15.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.666+0000 7f21cdffb700 1 -- 172.21.15.88:0/616409807 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c4009790 con 0x7f21d00ff150 2024-09-13T21:38:15.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.666+0000 7f21cdffb700 1 -- 172.21.15.88:0/616409807 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f21c400c810 con 0x7f21d00ff150 2024-09-13T21:38:15.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.666+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d019b1e0 con 0x7f21d00ff150 2024-09-13T21:38:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.666+0000 7f21cdffb700 1 -- 172.21.15.88:0/616409807 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c4003d20 con 0x7f21d00ff150 2024-09-13T21:38:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.666+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d019b730 con 0x7f21d00ff150 2024-09-13T21:38:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.667+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d0107ca0 con 0x7f21d00ff150 2024-09-13T21:38:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.668+0000 7f21cdffb700 1 -- 172.21.15.88:0/616409807 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f21c40041f0 con 0x7f21d00ff150 2024-09-13T21:38:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.668+0000 7f21cdffb700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f21c006c680 0x7f21c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.668+0000 7f21cdffb700 1 -- 172.21.15.88:0/616409807 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f21c4014070 con 0x7f21d00ff150 2024-09-13T21:38:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.668+0000 7f21cffff700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f21c006c680 0x7f21c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.669+0000 7f21cffff700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f21c006c680 0x7f21c006eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00b6f0 tx=0x7f21bc005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:15.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.673+0000 7f21cdffb700 1 -- 172.21.15.88:0/616409807 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f21c4059e20 con 0x7f21d00ff150 2024-09-13T21:38:15.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:15.923+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21d0107e90 con 0x7f21d00ff150 2024-09-13T21:38:16.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.139+0000 7f21cdffb700 1 -- 172.21.15.88:0/616409807 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v10) v1 ==== 168+0+0 (secure 0 0 0) 0x7f21c40599b0 con 0x7f21d00ff150 2024-09-13T21:38:16.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f21c006c680 msgr2=0x7f21c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f21c006c680 0x7f21c006eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00b6f0 tx=0x7f21bc005a90 comp rx=0 tx=0).stop 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d00ff150 msgr2=0x7f21d0069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d00ff150 0x7f21d0069990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e8f0 tx=0x7f21c400ec00 comp rx=0 tx=0).stop 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 shutdown_connections 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f21c006c680 0x7f21c006eb30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d00ff150 0x7f21d0069990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 --2- 172.21.15.88:0/616409807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21d0100350 0x7f21d019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 >> 172.21.15.88:0/616409807 conn(0x7f21d00fa700 msgr2=0x7f21d0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 shutdown_connections 2024-09-13T21:38:16.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:16.141+0000 7f21d6d71700 1 -- 172.21.15.88:0/616409807 wait complete. 2024-09-13T21:38:16.145 INFO:teuthology.orchestra.run.smithi088.stderr:inline data enabled 2024-09-13T21:38:16.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/616409807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T21:38:16.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-13T21:38:16.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T21:38:16.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] up:boot 2024-09-13T21:38:16.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/616409807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T21:38:16.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:16.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:16 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:38:16.663 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/616409807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] up:boot 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/616409807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T21:38:16.664 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:16.665 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:16 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:38:17.389 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:38:17.400 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:38:17.400 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T21:38:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:standby 2024-09-13T21:38:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] up:active 2024-09-13T21:38:18.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: Dropping low affinity active daemon mds.cephfs.smithi088.yszliw in favor of higher affinity standby. 2024-09-13T21:38:18.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: Replacing daemon mds.cephfs.smithi088.yszliw as rank 0 with standby daemon mds.cephfs.smithi088.vqfqko 2024-09-13T21:38:18.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:38:18.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:18.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T21:38:18.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: fsmap cephfs:2/2 {0=cephfs.smithi088.vqfqko=up:replay,1=cephfs.smithi116.rwfayz=up:active} 1 up:standby 2024-09-13T21:38:18.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:18.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:18.735 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:18 smithi088 ceph-mon[27963]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-13T21:38:18.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:standby 2024-09-13T21:38:18.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] up:active 2024-09-13T21:38:18.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: Dropping low affinity active daemon mds.cephfs.smithi088.yszliw in favor of higher affinity standby. 2024-09-13T21:38:18.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: Replacing daemon mds.cephfs.smithi088.yszliw as rank 0 with standby daemon mds.cephfs.smithi088.vqfqko 2024-09-13T21:38:18.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:38:18.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:18.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T21:38:18.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: fsmap cephfs:2/2 {0=cephfs.smithi088.vqfqko=up:replay,1=cephfs.smithi116.rwfayz=up:active} 1 up:standby 2024-09-13T21:38:18.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:18.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:18.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:18 smithi116 ceph-mon[33391]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-13T21:38:18.889 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:19.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:19 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:resolve 2024-09-13T21:38:19.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:19 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] up:boot 2024-09-13T21:38:19.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:19 smithi088 ceph-mon[27963]: fsmap cephfs:2/2 {0=cephfs.smithi088.vqfqko=up:resolve,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:19.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:19 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:38:19.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:19 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:resolve 2024-09-13T21:38:19.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:19 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] up:boot 2024-09-13T21:38:19.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:19 smithi116 ceph-mon[33391]: fsmap cephfs:2/2 {0=cephfs.smithi088.vqfqko=up:resolve,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:19.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:19 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:38:20.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:20 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:reconnect 2024-09-13T21:38:20.666 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:20 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] up:standby 2024-09-13T21:38:20.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:20 smithi088 ceph-mon[27963]: fsmap cephfs:2/2 {0=cephfs.smithi088.vqfqko=up:reconnect,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:20.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:20 smithi088 ceph-mon[27963]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 819 B/s wr, 4 op/s 2024-09-13T21:38:20.667 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:20 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:20.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:20 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:reconnect 2024-09-13T21:38:20.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:20 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] up:standby 2024-09-13T21:38:20.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:20 smithi116 ceph-mon[33391]: fsmap cephfs:2/2 {0=cephfs.smithi088.vqfqko=up:reconnect,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:20.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:20 smithi116 ceph-mon[33391]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 819 B/s wr, 4 op/s 2024-09-13T21:38:20.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:20 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:21.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.365+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/3204649801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 msgr2=0x7ffb180ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:21.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.365+0000 7ffb1dc7f700 1 --2- 172.21.15.88:0/3204649801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 0x7ffb180ff540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800b0a0 tx=0x7ffb0800b3b0 comp rx=0 tx=0).stop 2024-09-13T21:38:21.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.365+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/3204649801 shutdown_connections 2024-09-13T21:38:21.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.365+0000 7ffb1dc7f700 1 --2- 172.21.15.88:0/3204649801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb181003d0 0x7ffb18100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:21.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.365+0000 7ffb1dc7f700 1 --2- 172.21.15.88:0/3204649801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 0x7ffb180ff540 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:21.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.365+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/3204649801 >> 172.21.15.88:0/3204649801 conn(0x7ffb180fa780 msgr2=0x7ffb180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:21.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.365+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/3204649801 shutdown_connections 2024-09-13T21:38:21.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.365+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/3204649801 wait complete. 2024-09-13T21:38:21.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.365+0000 7ffb1dc7f700 1 Processor -- start 2024-09-13T21:38:21.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb1dc7f700 1 -- start start 2024-09-13T21:38:21.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb1dc7f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 0x7ffb180690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:21.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb1dc7f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb181003d0 0x7ffb1819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:21.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb1dc7f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1819ade0 con 0x7ffb180ff130 2024-09-13T21:38:21.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb1dc7f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1819af50 con 0x7ffb181003d0 2024-09-13T21:38:21.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb177fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 0x7ffb180690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:21.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb177fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 0x7ffb180690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39480/0 (socket says 172.21.15.88:39480) 2024-09-13T21:38:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb177fe700 1 -- 172.21.15.88:0/615669331 learned_addr learned my addr 172.21.15.88:0/615669331 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb177fe700 1 -- 172.21.15.88:0/615669331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb181003d0 msgr2=0x7ffb1819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb16ffd700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb181003d0 0x7ffb1819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:21.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb177fe700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb181003d0 0x7ffb1819a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb177fe700 1 -- 172.21.15.88:0/615669331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08009d00 con 0x7ffb180ff130 2024-09-13T21:38:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb177fe700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 0x7ffb180690c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009fd0 tx=0x7ffb08009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.366+0000 7ffb14ff9700 1 -- 172.21.15.88:0/615669331 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0800e040 con 0x7ffb180ff130 2024-09-13T21:38:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.367+0000 7ffb14ff9700 1 -- 172.21.15.88:0/615669331 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb08003de0 con 0x7ffb180ff130 2024-09-13T21:38:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.367+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1819b1d0 con 0x7ffb180ff130 2024-09-13T21:38:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.367+0000 7ffb14ff9700 1 -- 172.21.15.88:0/615669331 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0801da10 con 0x7ffb180ff130 2024-09-13T21:38:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.367+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1819b6c0 con 0x7ffb180ff130 2024-09-13T21:38:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.368+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb18107c10 con 0x7ffb180ff130 2024-09-13T21:38:21.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.368+0000 7ffb14ff9700 1 -- 172.21.15.88:0/615669331 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ffb0801dc90 con 0x7ffb180ff130 2024-09-13T21:38:21.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.368+0000 7ffb14ff9700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb0406c680 0x7ffb0406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:21.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.368+0000 7ffb14ff9700 1 -- 172.21.15.88:0/615669331 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ffb0808d2c0 con 0x7ffb180ff130 2024-09-13T21:38:21.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.368+0000 7ffb16ffd700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb0406c680 0x7ffb0406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:21.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.369+0000 7ffb16ffd700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb0406c680 0x7ffb0406eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb00005950 tx=0x7ffb000058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:21.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.373+0000 7ffb14ff9700 1 -- 172.21.15.88:0/615669331 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffb0805b480 con 0x7ffb180ff130 2024-09-13T21:38:21.573 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:21 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:rejoin 2024-09-13T21:38:21.573 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:21 smithi088 ceph-mon[27963]: fsmap cephfs:2/2 {0=cephfs.smithi088.vqfqko=up:rejoin,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:21.573 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:21 smithi088 ceph-mon[27963]: daemon mds.cephfs.smithi088.vqfqko is now active in filesystem cephfs as rank 0 2024-09-13T21:38:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.611+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb18107e00 con 0x7ffb180ff130 2024-09-13T21:38:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.611+0000 7ffb14ff9700 1 -- 172.21.15.88:0/615669331 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1832 (secure 0 0 0) 0x7ffb0805b010 con 0x7ffb180ff130 2024-09-13T21:38:21.613 INFO:teuthology.orchestra.run.smithi088.stdout:e16 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 16 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:38:21.497352+0000 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:38:21.614 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:38:21.615 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:38:21.616 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:38:21.617 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:38:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.613+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb0406c680 msgr2=0x7ffb0406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.613+0000 7ffb1dc7f700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb0406c680 0x7ffb0406eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb00005950 tx=0x7ffb000058e0 comp rx=0 tx=0).stop 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.613+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 msgr2=0x7ffb180690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.613+0000 7ffb1dc7f700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 0x7ffb180690c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009fd0 tx=0x7ffb08009790 comp rx=0 tx=0).stop 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.614+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 shutdown_connections 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.614+0000 7ffb1dc7f700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7ffb0406c680 0x7ffb0406eb30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.614+0000 7ffb1dc7f700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb180ff130 0x7ffb180690c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.614+0000 7ffb1dc7f700 1 --2- 172.21.15.88:0/615669331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb181003d0 0x7ffb1819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.614+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 >> 172.21.15.88:0/615669331 conn(0x7ffb180fa780 msgr2=0x7ffb18103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.614+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 shutdown_connections 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:21.614+0000 7ffb1dc7f700 1 -- 172.21.15.88:0/615669331 wait complete. 2024-09-13T21:38:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-09-13T21:38:21.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:21 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:rejoin 2024-09-13T21:38:21.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:21 smithi116 ceph-mon[33391]: fsmap cephfs:2/2 {0=cephfs.smithi088.vqfqko=up:rejoin,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:21.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:21 smithi116 ceph-mon[33391]: daemon mds.cephfs.smithi088.vqfqko is now active in filesystem cephfs as rank 0 2024-09-13T21:38:22.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T21:38:22.592 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:22.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:22 smithi088 ceph-mon[27963]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:38:22.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:22 smithi088 ceph-mon[27963]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:active 2024-09-13T21:38:22.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:22 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:22.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:22 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/615669331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:38:22.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:22 smithi088 ceph-mon[27963]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 716 B/s wr, 5 op/s 2024-09-13T21:38:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:22 smithi116 ceph-mon[33391]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:38:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:22 smithi116 ceph-mon[33391]: mds.? [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] up:active 2024-09-13T21:38:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:22 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:38:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:22 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/615669331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:38:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:22 smithi116 ceph-mon[33391]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 716 B/s wr, 5 op/s 2024-09-13T21:38:23.710 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:23.710 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:23.710 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:23.710 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:23.710 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:23.710 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:23 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:23.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:23.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:23 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.247+0000 7f4e976b7700 1 -- 172.21.15.88:0/1385744140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 msgr2=0x7f4e900ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.247+0000 7f4e976b7700 1 --2- 172.21.15.88:0/1385744140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 0x7f4e900ff550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c009910 tx=0x7f4e8c009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.247+0000 7f4e976b7700 1 -- 172.21.15.88:0/1385744140 shutdown_connections 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.247+0000 7f4e976b7700 1 --2- 172.21.15.88:0/1385744140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e90100340 0x7f4e90100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.247+0000 7f4e976b7700 1 --2- 172.21.15.88:0/1385744140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 0x7f4e900ff550 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.247+0000 7f4e976b7700 1 -- 172.21.15.88:0/1385744140 >> 172.21.15.88:0/1385744140 conn(0x7f4e900fa6d0 msgr2=0x7f4e900fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.248+0000 7f4e976b7700 1 -- 172.21.15.88:0/1385744140 shutdown_connections 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.248+0000 7f4e976b7700 1 -- 172.21.15.88:0/1385744140 wait complete. 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.248+0000 7f4e976b7700 1 Processor -- start 2024-09-13T21:38:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.248+0000 7f4e976b7700 1 -- start start 2024-09-13T21:38:24.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.248+0000 7f4e976b7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 0x7f4e90069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:24.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.248+0000 7f4e976b7700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e90100340 0x7f4e9019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:24.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.248+0000 7f4e976b7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9019ade0 con 0x7f4e900ff140 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e976b7700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9019af20 con 0x7f4e90100340 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e95453700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 0x7f4e90069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e95453700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 0x7f4e90069950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39486/0 (socket says 172.21.15.88:39486) 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e95453700 1 -- 172.21.15.88:0/108446639 learned_addr learned my addr 172.21.15.88:0/108446639 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e94c52700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e90100340 0x7f4e9019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e95453700 1 -- 172.21.15.88:0/108446639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e90100340 msgr2=0x7f4e9019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e95453700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e90100340 0x7f4e9019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e95453700 1 -- 172.21.15.88:0/108446639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c0095f0 con 0x7f4e900ff140 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e94c52700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e90100340 0x7f4e9019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e95453700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 0x7f4e90069950 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00bda0 tx=0x7f4e8c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e867fc700 1 -- 172.21.15.88:0/108446639 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8c01d070 con 0x7f4e900ff140 2024-09-13T21:38:24.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e867fc700 1 -- 172.21.15.88:0/108446639 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4e8c00f460 con 0x7f4e900ff140 2024-09-13T21:38:24.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9019b1a0 con 0x7f4e900ff140 2024-09-13T21:38:24.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e867fc700 1 -- 172.21.15.88:0/108446639 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8c021640 con 0x7f4e900ff140 2024-09-13T21:38:24.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.249+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9019b690 con 0x7f4e900ff140 2024-09-13T21:38:24.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.250+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e90107c90 con 0x7f4e900ff140 2024-09-13T21:38:24.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.251+0000 7f4e867fc700 1 -- 172.21.15.88:0/108446639 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4e8c00f5d0 con 0x7f4e900ff140 2024-09-13T21:38:24.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.251+0000 7f4e867fc700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:24.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.251+0000 7f4e867fc700 1 -- 172.21.15.88:0/108446639 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4e8c08cad0 con 0x7f4e900ff140 2024-09-13T21:38:24.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.252+0000 7f4e94c52700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:24.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.252+0000 7f4e94c52700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e80005d90 tx=0x7f4e80005d00 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:24.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.256+0000 7f4e867fc700 1 -- 172.21.15.88:0/108446639 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4e8c05ac90 con 0x7f4e900ff140 2024-09-13T21:38:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.492+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e90107eb0 con 0x7f4e900ff140 2024-09-13T21:38:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.492+0000 7f4e867fc700 1 -- 172.21.15.88:0/108446639 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4754 (secure 0 0 0) 0x7f4e90107eb0 con 0x7f4e900ff140 2024-09-13T21:38:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4e7c06c680 msgr2=0x7f4e7c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e80005d90 tx=0x7f4e80005d00 comp rx=0 tx=0).stop 2024-09-13T21:38:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 msgr2=0x7f4e90069950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 0x7f4e90069950 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00bda0 tx=0x7f4e8c00be80 comp rx=0 tx=0).stop 2024-09-13T21:38:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 shutdown_connections 2024-09-13T21:38:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e900ff140 0x7f4e90069950 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 --2- 172.21.15.88:0/108446639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e90100340 0x7f4e9019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 >> 172.21.15.88:0/108446639 conn(0x7f4e900fa6d0 msgr2=0x7f4e90103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 shutdown_connections 2024-09-13T21:38:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:24.495+0000 7f4e976b7700 1 -- 172.21.15.88:0/108446639 wait complete. 2024-09-13T21:38:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-09-13T21:38:24.509 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:38:24.775 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:24 smithi088 ceph-mon[27963]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:38:24.775 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:24 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/108446639' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:38:25.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:24 smithi116 ceph-mon[33391]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:38:25.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:24 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/108446639' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:38:25.414 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T21:38:26.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:26.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:26.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:26.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:26.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:27.020 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:27.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:26 smithi116 ceph-mon[33391]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T21:38:27.217 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:26 smithi088 ceph-mon[27963]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T21:38:29.346 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:29 smithi088 ceph-mon[27963]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T21:38:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:29 smithi116 ceph-mon[33391]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T21:38:29.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.870+0000 7f4c54d9b700 1 -- 172.21.15.88:0/1627853605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 msgr2=0x7f4c500ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:29.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.870+0000 7f4c54d9b700 1 --2- 172.21.15.88:0/1627853605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 0x7f4c500ff560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c40009910 tx=0x7f4c40009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:29.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.871+0000 7f4c54d9b700 1 -- 172.21.15.88:0/1627853605 shutdown_connections 2024-09-13T21:38:29.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.871+0000 7f4c54d9b700 1 --2- 172.21.15.88:0/1627853605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c501003f0 0x7f4c50100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:29.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.871+0000 7f4c54d9b700 1 --2- 172.21.15.88:0/1627853605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 0x7f4c500ff560 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:29.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.871+0000 7f4c54d9b700 1 -- 172.21.15.88:0/1627853605 >> 172.21.15.88:0/1627853605 conn(0x7f4c500fa7a0 msgr2=0x7f4c500fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:29.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.871+0000 7f4c54d9b700 1 -- 172.21.15.88:0/1627853605 shutdown_connections 2024-09-13T21:38:29.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.871+0000 7f4c54d9b700 1 -- 172.21.15.88:0/1627853605 wait complete. 2024-09-13T21:38:29.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.871+0000 7f4c54d9b700 1 Processor -- start 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.871+0000 7f4c54d9b700 1 -- start start 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c54d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 0x7f4c50195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c54d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c501003f0 0x7f4c50196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c54d9b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50196970 con 0x7f4c500ff150 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c54d9b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50196ab0 con 0x7f4c501003f0 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c4e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 0x7f4c50195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c4e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 0x7f4c50195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39512/0 (socket says 172.21.15.88:39512) 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c4e59c700 1 -- 172.21.15.88:0/2536523307 learned_addr learned my addr 172.21.15.88:0/2536523307 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c4e59c700 1 -- 172.21.15.88:0/2536523307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c501003f0 msgr2=0x7f4c50196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c4e59c700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c501003f0 0x7f4c50196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c4e59c700 1 -- 172.21.15.88:0/2536523307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c400095f0 con 0x7f4c500ff150 2024-09-13T21:38:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c4e59c700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 0x7f4c50195e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006010 tx=0x7f4c4000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/2536523307 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c4001d070 con 0x7f4c500ff150 2024-09-13T21:38:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/2536523307 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c4000f460 con 0x7f4c500ff150 2024-09-13T21:38:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5019b500 con 0x7f4c500ff150 2024-09-13T21:38:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/2536523307 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c40017630 con 0x7f4c500ff150 2024-09-13T21:38:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.872+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5019b9f0 con 0x7f4c500ff150 2024-09-13T21:38:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.873+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c50068ab0 con 0x7f4c500ff150 2024-09-13T21:38:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.874+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/2536523307 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4c4000f5d0 con 0x7f4c500ff150 2024-09-13T21:38:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.874+0000 7f4c3f7fe700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4c3806c680 0x7f4c3806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.874+0000 7f4c4dd9b700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4c3806c680 0x7f4c3806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.874+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/2536523307 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4c4008ccd0 con 0x7f4c500ff150 2024-09-13T21:38:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.875+0000 7f4c4dd9b700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4c3806c680 0x7f4c3806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c44005950 tx=0x7f4c440058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:29.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:29.879+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/2536523307 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4c4005ae90 con 0x7f4c500ff150 2024-09-13T21:38:30.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.198+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f4c5019c0c0 con 0x7f4c500ff150 2024-09-13T21:38:30.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.199+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/2536523307 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+83 (secure 0 0 0) 0x7f4c4005aa20 con 0x7f4c500ff150 2024-09-13T21:38:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4c3806c680 msgr2=0x7f4c3806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4c3806c680 0x7f4c3806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c44005950 tx=0x7f4c440058e0 comp rx=0 tx=0).stop 2024-09-13T21:38:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 msgr2=0x7f4c50195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 0x7f4c50195e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006010 tx=0x7f4c4000be20 comp rx=0 tx=0).stop 2024-09-13T21:38:30.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 shutdown_connections 2024-09-13T21:38:30.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4c3806c680 0x7f4c3806eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:30.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c500ff150 0x7f4c50195e10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:30.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 --2- 172.21.15.88:0/2536523307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c501003f0 0x7f4c50196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:30.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 >> 172.21.15.88:0/2536523307 conn(0x7f4c500fa7a0 msgr2=0x7f4c50068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:30.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 shutdown_connections 2024-09-13T21:38:30.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:30.201+0000 7f4c54d9b700 1 -- 172.21.15.88:0/2536523307 wait complete. 2024-09-13T21:38:30.214 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:38:30.860 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T21:38:30.888 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T21:38:31.091 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:31.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:31 smithi088 ceph-mon[27963]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T21:38:31.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:31.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:31.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:31.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:31.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:31 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:31.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:31 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2536523307' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T21:38:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:31 smithi116 ceph-mon[33391]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T21:38:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:31.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:31.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:31 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:38:31.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:31 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2536523307' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T21:38:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.555+0000 7f26531bb700 1 -- 172.21.15.88:0/1979232286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 msgr2=0x7f264c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.555+0000 7f26531bb700 1 --2- 172.21.15.88:0/1979232286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 0x7f264c1094d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f263c009940 tx=0x7f263c009c50 comp rx=0 tx=0).stop 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.555+0000 7f26531bb700 1 -- 172.21.15.88:0/1979232286 shutdown_connections 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.555+0000 7f26531bb700 1 --2- 172.21.15.88:0/1979232286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 0x7f264c1094d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.555+0000 7f26531bb700 1 --2- 172.21.15.88:0/1979232286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f264c100460 0x7f264c100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.555+0000 7f26531bb700 1 -- 172.21.15.88:0/1979232286 >> 172.21.15.88:0/1979232286 conn(0x7f264c0748b0 msgr2=0x7f264c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.555+0000 7f26531bb700 1 -- 172.21.15.88:0/1979232286 shutdown_connections 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.555+0000 7f26531bb700 1 -- 172.21.15.88:0/1979232286 wait complete. 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f26531bb700 1 Processor -- start 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f26531bb700 1 -- start start 2024-09-13T21:38:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f26531bb700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f264c100460 0x7f264c196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f26531bb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 0x7f264c1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f26531bb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c1978f0 con 0x7f264c100d70 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f26531bb700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c197a60 con 0x7f264c100460 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f2643fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 0x7f264c1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f2643fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 0x7f264c1972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54206/0 (socket says 172.21.15.88:54206) 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f2643fff700 1 -- 172.21.15.88:0/1873904753 learned_addr learned my addr 172.21.15.88:0/1873904753 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f2650f57700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f264c100460 0x7f264c196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f2643fff700 1 -- 172.21.15.88:0/1873904753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f264c100460 msgr2=0x7f264c196d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f2643fff700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f264c100460 0x7f264c196d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.556+0000 7f2643fff700 1 -- 172.21.15.88:0/1873904753 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c0095f0 con 0x7f264c100d70 2024-09-13T21:38:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.557+0000 7f2643fff700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 0x7f264c1972d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f263c0055f0 tx=0x7f263c0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:32.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.557+0000 7f2641ffb700 1 -- 172.21.15.88:0/1873904753 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f263c01d070 con 0x7f264c100d70 2024-09-13T21:38:32.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.557+0000 7f2641ffb700 1 -- 172.21.15.88:0/1873904753 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f263c003ba0 con 0x7f264c100d70 2024-09-13T21:38:32.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.557+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c19fe00 con 0x7f264c100d70 2024-09-13T21:38:32.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.557+0000 7f2641ffb700 1 -- 172.21.15.88:0/1873904753 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f263c021640 con 0x7f264c100d70 2024-09-13T21:38:32.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.557+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c1a0240 con 0x7f264c100d70 2024-09-13T21:38:32.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.558+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c106bd0 con 0x7f264c100d70 2024-09-13T21:38:32.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.558+0000 7f2641ffb700 1 -- 172.21.15.88:0/1873904753 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f263c00f460 con 0x7f264c100d70 2024-09-13T21:38:32.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.559+0000 7f2641ffb700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f263406c680 0x7f263406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:32.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.559+0000 7f2641ffb700 1 -- 172.21.15.88:0/1873904753 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f263c08cc80 con 0x7f264c100d70 2024-09-13T21:38:32.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.559+0000 7f2650f57700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f263406c680 0x7f263406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:32.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.559+0000 7f2650f57700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f263406c680 0x7f263406eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26480060b0 tx=0x7f2648007b80 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:32.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.563+0000 7f2641ffb700 1 -- 172.21.15.88:0/1873904753 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f263c0573b0 con 0x7f264c100d70 2024-09-13T21:38:32.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.795+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f264c04f2a0 con 0x7f264c100d70 2024-09-13T21:38:32.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.796+0000 7f2641ffb700 1 -- 172.21.15.88:0/1873904753 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4754 (secure 0 0 0) 0x7f263c05a9d0 con 0x7f264c100d70 2024-09-13T21:38:32.798 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:38:32.798 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1678889304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1678889304},{"type":"v1","addr":"172.21.15.88:6827","nonce":1678889304}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:38:21.497352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi088.vqfqko","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6829/3000160721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3000160721},{"type":"v1","addr":"172.21.15.88:6829","nonce":3000160721}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi116.rwfayz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6825/3165930293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3165930293},{"type":"v1","addr":"172.21.15.116:6825","nonce":3165930293}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f263406c680 msgr2=0x7f263406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f263406c680 0x7f263406eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26480060b0 tx=0x7f2648007b80 comp rx=0 tx=0).stop 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 msgr2=0x7f264c1972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 0x7f264c1972d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f263c0055f0 tx=0x7f263c0056d0 comp rx=0 tx=0).stop 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 shutdown_connections 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f263406c680 0x7f263406eb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f264c100460 0x7f264c196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 --2- 172.21.15.88:0/1873904753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f264c100d70 0x7f264c1972d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 >> 172.21.15.88:0/1873904753 conn(0x7f264c0748b0 msgr2=0x7f264c103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:32.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 shutdown_connections 2024-09-13T21:38:32.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:32.798+0000 7f26531bb700 1 -- 172.21.15.88:0/1873904753 wait complete. 2024-09-13T21:38:32.801 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 16 2024-09-13T21:38:33.433 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:33 smithi088 ceph-mon[27963]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T21:38:33.433 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:33 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1873904753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:38:33.455 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 2, 'flags': 18} 2024-09-13T21:38:33.455 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T21:38:33.580 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T21:38:33.581 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-13T21:38:33.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:33.581 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-09-13T21:38:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:33 smithi116 ceph-mon[33391]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T21:38:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:33 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/1873904753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:38:33.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:33.598 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-09-13T21:38:33.667 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2024-09-13T21:38:33.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:38:33.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:33.669 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-09-13T21:38:33.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:33.689 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-09-13T21:38:33.764 INFO:teuthology.orchestra.run.smithi116.stderr:Cannot find device "ceph-brx" 2024-09-13T21:38:33.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:38:33.766 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T21:38:33.766 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T21:38:33.766 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T21:38:33.766 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T21:38:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:35.303 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:35 smithi088 ceph-mon[27963]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T21:38:35.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.516+0000 7f5f06cad700 1 -- 172.21.15.88:0/4031925091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00105230 msgr2=0x7f5f00105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:35.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.516+0000 7f5f06cad700 1 --2- 172.21.15.88:0/4031925091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00105230 0x7f5f00105600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009910 tx=0x7f5ef4009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:35.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.516+0000 7f5f06cad700 1 -- 172.21.15.88:0/4031925091 shutdown_connections 2024-09-13T21:38:35.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.516+0000 7f5f06cad700 1 --2- 172.21.15.88:0/4031925091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f00068540 0x7f5f000689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.516+0000 7f5f06cad700 1 --2- 172.21.15.88:0/4031925091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00105230 0x7f5f00105600 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.516+0000 7f5f06cad700 1 -- 172.21.15.88:0/4031925091 >> 172.21.15.88:0/4031925091 conn(0x7f5f00075130 msgr2=0x7f5f00075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.516+0000 7f5f06cad700 1 -- 172.21.15.88:0/4031925091 shutdown_connections 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.516+0000 7f5f06cad700 1 -- 172.21.15.88:0/4031925091 wait complete. 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.516+0000 7f5f06cad700 1 Processor -- start 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f06cad700 1 -- start start 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f06cad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00068540 0x7f5f00195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f06cad700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f00105230 0x7f5f00196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f06cad700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f00196af0 con 0x7f5f00068540 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f06cad700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0019a880 con 0x7f5f00105230 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f04a49700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00068540 0x7f5f00195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:35.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f04a49700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00068540 0x7f5f00195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54224/0 (socket says 172.21.15.88:54224) 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f04a49700 1 -- 172.21.15.88:0/251714792 learned_addr learned my addr 172.21.15.88:0/251714792 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5efffff700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f00105230 0x7f5f00196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f04a49700 1 -- 172.21.15.88:0/251714792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f00105230 msgr2=0x7f5f00196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f04a49700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f00105230 0x7f5f00196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f04a49700 1 -- 172.21.15.88:0/251714792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef40095f0 con 0x7f5f00068540 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5efffff700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f00105230 0x7f5f00196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f04a49700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00068540 0x7f5f00195ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4006010 tx=0x7f5ef400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5efdffb700 1 -- 172.21.15.88:0/251714792 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef401d070 con 0x7f5f00068540 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.517+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0019ab00 con 0x7f5f00068540 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.518+0000 7f5efdffb700 1 -- 172.21.15.88:0/251714792 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5ef400f460 con 0x7f5f00068540 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.518+0000 7f5efdffb700 1 -- 172.21.15.88:0/251714792 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef4021640 con 0x7f5f00068540 2024-09-13T21:38:35.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.518+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0019aff0 con 0x7f5f00068540 2024-09-13T21:38:35.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.519+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0004f2a0 con 0x7f5f00068540 2024-09-13T21:38:35.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.519+0000 7f5efdffb700 1 -- 172.21.15.88:0/251714792 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5ef400faf0 con 0x7f5f00068540 2024-09-13T21:38:35.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.519+0000 7f5efdffb700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5ef006c680 0x7f5ef006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:35.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.520+0000 7f5efdffb700 1 -- 172.21.15.88:0/251714792 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f5ef408cbe0 con 0x7f5f00068540 2024-09-13T21:38:35.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.520+0000 7f5efffff700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5ef006c680 0x7f5ef006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:35.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.520+0000 7f5efffff700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5ef006c680 0x7f5ef006eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5f001974f0 tx=0x7f5eec008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:35.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.524+0000 7f5efdffb700 1 -- 172.21.15.88:0/251714792 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5ef4057310 con 0x7f5f00068540 2024-09-13T21:38:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:35 smithi116 ceph-mon[33391]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T21:38:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.758+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5f0019b2d0 con 0x7f5f00068540 2024-09-13T21:38:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.758+0000 7f5efdffb700 1 -- 172.21.15.88:0/251714792 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f5ef4026070 con 0x7f5f00068540 2024-09-13T21:38:35.760 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T21:38:35.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5ef006c680 msgr2=0x7f5ef006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5ef006c680 0x7f5ef006eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5f001974f0 tx=0x7f5eec008040 comp rx=0 tx=0).stop 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00068540 msgr2=0x7f5f00195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00068540 0x7f5f00195ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4006010 tx=0x7f5ef400be20 comp rx=0 tx=0).stop 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 shutdown_connections 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f5ef006c680 0x7f5ef006eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f00068540 0x7f5f00195ed0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 --2- 172.21.15.88:0/251714792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f00105230 0x7f5f00196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 >> 172.21.15.88:0/251714792 conn(0x7f5f00075130 msgr2=0x7f5f000fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 shutdown_connections 2024-09-13T21:38:35.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:35.761+0000 7f5f06cad700 1 -- 172.21.15.88:0/251714792 wait complete. 2024-09-13T21:38:36.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:36 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/251714792' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T21:38:36.410 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T21:38:36.410 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T21:38:36.410 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2024-09-13T21:38:36.410 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T21:38:36.410 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T21:38:36.410 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T21:38:36.410 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T21:38:36.410 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T21:38:36.410 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T21:38:36.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:36.411 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2024-09-13T21:38:36.428 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T21:38:36.428 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T21:38:36.428 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T21:38:36.428 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:38:36.428 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2024-09-13T21:38:36.428 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:38:36.428 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:38:36.428 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42329sec preferred_lft 42329sec 2024-09-13T21:38:36.429 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link noprefixroute 2024-09-13T21:38:36.430 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:38:36.430 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T21:38:36.430 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:36.430 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T21:38:36.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2024-09-13T21:38:36.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2024-09-13T21:38:36.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2024-09-13T21:38:36.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T21:38:36.431 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T21:38:36.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:36.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:36 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/251714792' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T21:38:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:36.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:36.657 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T21:38:36.683 INFO:teuthology.orchestra.run.smithi088.stdout:1 2024-09-13T21:38:36.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:36.685 DEBUG:teuthology.orchestra.run.smithi088:> route 2024-09-13T21:38:36.749 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2024-09-13T21:38:36.749 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T21:38:36.749 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T21:38:36.750 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T21:38:36.750 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T21:38:36.750 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:36.750 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T21:38:36.750 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T21:38:36.750 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T21:38:36.751 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T21:38:36.751 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T21:38:36.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:37.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:37.065 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-09-13T21:38:37.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:37.081 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2024-09-13T21:38:37.137 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:37.137 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T21:38:37.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T21:38:37.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T21:38:37.137 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T21:38:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:37.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:37 smithi088 ceph-mon[27963]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T21:38:37.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:37.255 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T21:38:37.256 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:37.256 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T21:38:37.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T21:38:37.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T21:38:37.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T21:38:37.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T21:38:37.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T21:38:37.256 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T21:38:37.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:37.380 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:37.380 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T21:38:37.380 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2024-09-13T21:38:37.380 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T21:38:37.380 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T21:38:37.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:37.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:37.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T21:38:37.457 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T21:38:37.472 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T21:38:37.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T21:38:37.472 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T21:38:37.526 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:37 smithi116 ceph-mon[33391]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T21:38:37.527 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T21:38:37.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:37.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T21:38:37.655 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T21:38:37.655 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T21:38:37.655 INFO:teuthology.orchestra.run.smithi088.stdout:invalid new device string format 2024-09-13T21:38:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T21:38:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T21:38:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:invalid new device string format 2024-09-13T21:38:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.116:3300" 2024-09-13T21:38:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T21:38:37.803 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T21:38:37.803 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T21:38:37.803 INFO:teuthology.orchestra.run.smithi088.stdout:invalid new device string format 2024-09-13T21:38:37.803 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.116:3300" 2024-09-13T21:38:37.804 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T21:38:37.804 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:6789,172.21.15.116:6789" 2024-09-13T21:38:37.804 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.88:6789,172.21.15.116:6789:/ 2024-09-13T21:38:37.804 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=67511300-7217-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T21:38:37.804 INFO:teuthology.orchestra.run.smithi088.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T21:38:37.804 INFO:teuthology.orchestra.run.smithi088.stdout: You just mounted a file system that supports labels which does not 2024-09-13T21:38:37.805 INFO:teuthology.orchestra.run.smithi088.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T21:38:37.805 INFO:teuthology.orchestra.run.smithi088.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T21:38:37.805 INFO:teuthology.orchestra.run.smithi088.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T21:38:37.807 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T21:38:37.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:37.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T21:38:37.836 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T21:38:37.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T21:38:37.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:37.932 INFO:teuthology.orchestra.run.smithi088.stdout:client14512 2024-09-13T21:38:37.932 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:38:37.933 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T21:38:37.950 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T21:38:38.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T21:38:38.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:38.046 INFO:teuthology.orchestra.run.smithi088.stdout:client14512 2024-09-13T21:38:38.047 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T21:38:38.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T21:38:38.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:38.102 INFO:teuthology.orchestra.run.smithi088.stdout:client14512 2024-09-13T21:38:38.102 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/67511300-7217-11ef-bceb-c7b262605968.client14512/status') 2024-09-13T21:38:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:38.160 INFO:teuthology.orchestra.run.smithi088.stdout:instance: client.14512 (3)192.168.0.1:0/3173709186 2024-09-13T21:38:38.160 INFO:teuthology.orchestra.run.smithi088.stdout:blocklisted: false 2024-09-13T21:38:38.161 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records in 2024-09-13T21:38:38.161 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records out 2024-09-13T21:38:38.161 INFO:teuthology.orchestra.run.smithi088.stderr:70 bytes copied, 2.2413e-05 s, 3.1 MB/s 2024-09-13T21:38:38.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:38.168 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-13T21:38:38.168 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T21:38:38.168 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T21:38:38.168 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T21:38:38.370 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:39.445 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:39 smithi088 ceph-mon[27963]: pgmap v199: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-09-13T21:38:39.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:39 smithi116 ceph-mon[33391]: pgmap v199: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-09-13T21:38:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.867+0000 7f3600809700 1 -- 172.21.15.88:0/2524827954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ffc60 msgr2=0x7f35fc10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.867+0000 7f3600809700 1 --2- 172.21.15.88:0/2524827954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ffc60 0x7f35fc10a6d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009910 tx=0x7f35e4009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.868+0000 7f3600809700 1 -- 172.21.15.88:0/2524827954 shutdown_connections 2024-09-13T21:38:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.868+0000 7f3600809700 1 --2- 172.21.15.88:0/2524827954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ffc60 0x7f35fc10a6d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.868+0000 7f3600809700 1 --2- 172.21.15.88:0/2524827954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35fc0ff350 0x7f35fc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.868+0000 7f3600809700 1 -- 172.21.15.88:0/2524827954 >> 172.21.15.88:0/2524827954 conn(0x7f35fc0748b0 msgr2=0x7f35fc074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.868+0000 7f3600809700 1 -- 172.21.15.88:0/2524827954 shutdown_connections 2024-09-13T21:38:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.868+0000 7f3600809700 1 -- 172.21.15.88:0/2524827954 wait complete. 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.868+0000 7f3600809700 1 Processor -- start 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f3600809700 1 -- start start 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f3600809700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ff350 0x7f35fc195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f3600809700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35fc0ffc60 0x7f35fc196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f3600809700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc196a20 con 0x7f35fc0ff350 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f3600809700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc19a7b0 con 0x7f35fc0ffc60 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f35fa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ff350 0x7f35fc195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f35fa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ff350 0x7f35fc195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54242/0 (socket says 172.21.15.88:54242) 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f35fa59c700 1 -- 172.21.15.88:0/2486755772 learned_addr learned my addr 172.21.15.88:0/2486755772 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f35f9d9b700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35fc0ffc60 0x7f35fc196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f35fa59c700 1 -- 172.21.15.88:0/2486755772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35fc0ffc60 msgr2=0x7f35fc196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f35fa59c700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35fc0ffc60 0x7f35fc196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f35fa59c700 1 -- 172.21.15.88:0/2486755772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40095f0 con 0x7f35fc0ff350 2024-09-13T21:38:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f35fa59c700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ff350 0x7f35fc195e00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f35f4007e60 tx=0x7f35f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.869+0000 7f35f37fe700 1 -- 172.21.15.88:0/2486755772 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f400dda0 con 0x7f35fc0ff350 2024-09-13T21:38:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.870+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc19aa90 con 0x7f35fc0ff350 2024-09-13T21:38:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.870+0000 7f35f37fe700 1 -- 172.21.15.88:0/2486755772 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35f400f040 con 0x7f35fc0ff350 2024-09-13T21:38:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.870+0000 7f35f37fe700 1 -- 172.21.15.88:0/2486755772 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f40147d0 con 0x7f35fc0ff350 2024-09-13T21:38:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.870+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc19afe0 con 0x7f35fc0ff350 2024-09-13T21:38:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.871+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc107dd0 con 0x7f35fc0ff350 2024-09-13T21:38:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.871+0000 7f35f37fe700 1 -- 172.21.15.88:0/2486755772 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f35f4014930 con 0x7f35fc0ff350 2024-09-13T21:38:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.872+0000 7f35f37fe700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f35e806c680 0x7f35e806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.872+0000 7f35f9d9b700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f35e806c680 0x7f35e806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.872+0000 7f35f37fe700 1 -- 172.21.15.88:0/2486755772 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f35f408b500 con 0x7f35fc0ff350 2024-09-13T21:38:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.872+0000 7f35f9d9b700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f35e806c680 0x7f35e806eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f35e4005b40 tx=0x7f35e401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:39.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:39.876+0000 7f35f37fe700 1 -- 172.21.15.88:0/2486755772 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f35f4055c30 con 0x7f35fc0ff350 2024-09-13T21:38:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.111+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f35fc19b260 con 0x7f35fc0ff350 2024-09-13T21:38:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.111+0000 7f35f37fe700 1 -- 172.21.15.88:0/2486755772 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f35f4059250 con 0x7f35fc0ff350 2024-09-13T21:38:40.113 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T21:38:40.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.113+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f35e806c680 msgr2=0x7f35e806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.113+0000 7f3600809700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f35e806c680 0x7f35e806eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f35e4005b40 tx=0x7f35e401a040 comp rx=0 tx=0).stop 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.113+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ff350 msgr2=0x7f35fc195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.113+0000 7f3600809700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ff350 0x7f35fc195e00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f35f4007e60 tx=0x7f35f400d3b0 comp rx=0 tx=0).stop 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.114+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 shutdown_connections 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.114+0000 7f3600809700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f35e806c680 0x7f35e806eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.114+0000 7f3600809700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35fc0ff350 0x7f35fc195e00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.114+0000 7f3600809700 1 --2- 172.21.15.88:0/2486755772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35fc0ffc60 0x7f35fc196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.114+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 >> 172.21.15.88:0/2486755772 conn(0x7f35fc0748b0 msgr2=0x7f35fc104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.114+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 shutdown_connections 2024-09-13T21:38:40.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:40.114+0000 7f3600809700 1 -- 172.21.15.88:0/2486755772 wait complete. 2024-09-13T21:38:40.481 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:40.481 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:40 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2486755772' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T21:38:40.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:40.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:40 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2486755772' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T21:38:40.717 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T21:38:40.717 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T21:38:40.717 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-09-13T21:38:40.717 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T21:38:40.718 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T21:38:40.718 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T21:38:40.718 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T21:38:40.718 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T21:38:40.718 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T21:38:40.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:40.718 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-09-13T21:38:40.740 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T21:38:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T21:38:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T21:38:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:38:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-09-13T21:38:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:38:40.741 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:38:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-09-13T21:38:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-09-13T21:38:40.741 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:38:40.741 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T21:38:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-09-13T21:38:40.742 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:38:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-09-13T21:38:40.742 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T21:38:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-09-13T21:38:40.742 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T21:38:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42312sec preferred_lft 42312sec 2024-09-13T21:38:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link noprefixroute 2024-09-13T21:38:40.743 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:38:40.743 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T21:38:40.744 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:40.744 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-09-13T21:38:40.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add name ceph-brx type bridge 2024-09-13T21:38:40.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr flush dev ceph-brx 2024-09-13T21:38:40.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set ceph-brx up 2024-09-13T21:38:40.745 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T21:38:40.745 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-09-13T21:38:40.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:40.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:40.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:40.961 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T21:38:40.986 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-09-13T21:38:40.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:40.988 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-09-13T21:38:41.053 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-09-13T21:38:41.053 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T21:38:41.053 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T21:38:41.053 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T21:38:41.053 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T21:38:41.054 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:41.054 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-09-13T21:38:41.054 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T21:38:41.054 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T21:38:41.054 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T21:38:41.054 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-09-13T21:38:41.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:41.354 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:41 smithi116 ceph-mon[33391]: pgmap v200: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:38:41.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:41.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:41.362 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-09-13T21:38:41.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:41.377 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2024-09-13T21:38:41.433 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:41.433 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-09-13T21:38:41.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T21:38:41.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T21:38:41.433 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-09-13T21:38:41.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:41 smithi088 ceph-mon[27963]: pgmap v200: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:38:41.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:41.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:41.552 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T21:38:41.552 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:41.552 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-09-13T21:38:41.553 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T21:38:41.553 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T21:38:41.553 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T21:38:41.553 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T21:38:41.553 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T21:38:41.553 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-09-13T21:38:41.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:41.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:41.684 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:38:41.684 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-09-13T21:38:41.684 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-09-13T21:38:41.684 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T21:38:41.684 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-09-13T21:38:41.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:41.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:41.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T21:38:41.762 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T21:38:41.777 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T21:38:41.777 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T21:38:41.777 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T21:38:41.832 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T21:38:41.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:41.832 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T21:38:41.929 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T21:38:41.930 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T21:38:41.930 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-09-13T21:38:42.059 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T21:38:42.059 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T21:38:42.059 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-09-13T21:38:42.059 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.116:3300" 2024-09-13T21:38:42.059 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T21:38:42.068 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T21:38:42.068 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T21:38:42.068 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-09-13T21:38:42.068 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.116:3300" 2024-09-13T21:38:42.068 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T21:38:42.068 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.88:6789,172.21.15.116:6789" 2024-09-13T21:38:42.068 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.88:6789,172.21.15.116:6789:/ 2024-09-13T21:38:42.068 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=67511300-7217-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T21:38:42.069 INFO:teuthology.orchestra.run.smithi116.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T21:38:42.069 INFO:teuthology.orchestra.run.smithi116.stdout: You just mounted a file system that supports labels which does not 2024-09-13T21:38:42.069 INFO:teuthology.orchestra.run.smithi116.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T21:38:42.069 INFO:teuthology.orchestra.run.smithi116.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T21:38:42.069 INFO:teuthology.orchestra.run.smithi116.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T21:38:42.071 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T21:38:42.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:38:42.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T21:38:42.095 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T21:38:42.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T21:38:42.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:42.193 INFO:teuthology.orchestra.run.smithi116.stdout:client14518 2024-09-13T21:38:42.193 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:38:42.193 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T21:38:42.211 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T21:38:42.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T21:38:42.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:42.306 INFO:teuthology.orchestra.run.smithi116.stdout:client14518 2024-09-13T21:38:42.306 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T21:38:42.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T21:38:42.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:42.362 INFO:teuthology.orchestra.run.smithi116.stdout:client14518 2024-09-13T21:38:42.363 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/67511300-7217-11ef-bceb-c7b262605968.client14518/status') 2024-09-13T21:38:42.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:38:42.421 INFO:teuthology.orchestra.run.smithi116.stdout:instance: client.14518 (3)172.21.15.116:0/3148794409 2024-09-13T21:38:42.421 INFO:teuthology.orchestra.run.smithi116.stdout:blocklisted: false 2024-09-13T21:38:42.421 INFO:teuthology.orchestra.run.smithi116.stderr:0+1 records in 2024-09-13T21:38:42.421 INFO:teuthology.orchestra.run.smithi116.stderr:0+1 records out 2024-09-13T21:38:42.421 INFO:teuthology.orchestra.run.smithi116.stderr:72 bytes copied, 2.1682e-05 s, 3.3 MB/s 2024-09-13T21:38:42.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T21:38:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:38:42.428 INFO:teuthology.run_tasks:Running task print... 2024-09-13T21:38:42.439 INFO:teuthology.task.print:**** done client 2024-09-13T21:38:42.439 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T21:38:42.485 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T21:38:42.485 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T21:38:42.486 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T21:38:42.486 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:38:42.486 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T21:38:42.487 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T21:38:42.487 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T21:38:42.492 INFO:tasks.workunit:Pulling workunits from ref ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:38:42.492 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T21:38:42.492 INFO:tasks.workunit:timeout=3h 2024-09-13T21:38:42.492 INFO:tasks.workunit:cleanup=True 2024-09-13T21:38:42.493 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T21:38:42.513 INFO:teuthology.orchestra.run.smithi088.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T21:38:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T21:38:42.514 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 84h/132d Inode: 1 Links: 2 2024-09-13T21:38:42.514 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:42.514 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T21:38:42.514 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T21:38:42.514 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 21:38:06.915240153 +0000 2024-09-13T21:38:42.514 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 21:38:37.829365327 +0000 2024-09-13T21:38:42.514 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-13 21:38:06.915240153 +0000 2024-09-13T21:38:42.514 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T21:38:42.514 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T21:38:42.584 DEBUG:teuthology.orchestra.run.smithi116:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T21:38:42.602 INFO:teuthology.orchestra.run.smithi116.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T21:38:42.602 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-13T21:38:42.602 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-13T21:38:42.603 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:42.603 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T21:38:42.603 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T21:38:42.603 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-13 21:38:42.577275296 +0000 2024-09-13T21:38:42.603 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-13 21:38:42.577275296 +0000 2024-09-13T21:38:42.603 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-13 21:38:06.915240153 +0000 2024-09-13T21:38:42.603 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T21:38:42.603 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T21:38:42.675 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:38:42.675 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:38:42.691 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T21:38:42.715 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:42.731 INFO:tasks.workunit.client.1.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T21:38:43.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:43 smithi088 ceph-mon[27963]: pgmap v201: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:38:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:43 smithi116 ceph-mon[33391]: pgmap v201: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:38:44.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.271+0000 7fd78ceb2700 1 -- 172.21.15.88:0/846451422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788101440 msgr2=0x7fd788101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:44.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.271+0000 7fd78ceb2700 1 --2- 172.21.15.88:0/846451422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788101440 0x7fd788101890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd778009910 tx=0x7fd778009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:44.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.271+0000 7fd78ceb2700 1 -- 172.21.15.88:0/846451422 shutdown_connections 2024-09-13T21:38:44.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.271+0000 7fd78ceb2700 1 --2- 172.21.15.88:0/846451422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788101440 0x7fd788101890 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:44.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.271+0000 7fd78ceb2700 1 --2- 172.21.15.88:0/846451422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd788100240 0x7fd788100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.271+0000 7fd78ceb2700 1 -- 172.21.15.88:0/846451422 >> 172.21.15.88:0/846451422 conn(0x7fd7880fb7f0 msgr2=0x7fd7880fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.271+0000 7fd78ceb2700 1 -- 172.21.15.88:0/846451422 shutdown_connections 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.271+0000 7fd78ceb2700 1 -- 172.21.15.88:0/846451422 wait complete. 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.272+0000 7fd78ceb2700 1 Processor -- start 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.272+0000 7fd78ceb2700 1 -- start start 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.272+0000 7fd78ceb2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788100240 0x7fd788074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.272+0000 7fd78ceb2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd788101440 0x7fd788073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.272+0000 7fd78ceb2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788073680 con 0x7fd788100240 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.272+0000 7fd78ceb2700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880737c0 con 0x7fd788101440 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.272+0000 7fd78659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788100240 0x7fd788074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.272+0000 7fd78659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788100240 0x7fd788074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55238/0 (socket says 172.21.15.88:55238) 2024-09-13T21:38:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.272+0000 7fd78659c700 1 -- 172.21.15.88:0/3478676224 learned_addr learned my addr 172.21.15.88:0/3478676224 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd785d9b700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd788101440 0x7fd788073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd78659c700 1 -- 172.21.15.88:0/3478676224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd788101440 msgr2=0x7fd788073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd78659c700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd788101440 0x7fd788073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd78659c700 1 -- 172.21.15.88:0/3478676224 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7780095f0 con 0x7fd788100240 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd785d9b700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd788101440 0x7fd788073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd78659c700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788100240 0x7fd788074af0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd77000b480 tx=0x7fd77000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd77f7fe700 1 -- 172.21.15.88:0/3478676224 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7700118c0 con 0x7fd788100240 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd788073aa0 con 0x7fd788100240 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd77f7fe700 1 -- 172.21.15.88:0/3478676224 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd770010380 con 0x7fd788100240 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd77f7fe700 1 -- 172.21.15.88:0/3478676224 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd77000f4f0 con 0x7fd788100240 2024-09-13T21:38:44.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.273+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78819dbb0 con 0x7fd788100240 2024-09-13T21:38:44.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.274+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd788108e30 con 0x7fd788100240 2024-09-13T21:38:44.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.275+0000 7fd77f7fe700 1 -- 172.21.15.88:0/3478676224 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd7700104f0 con 0x7fd788100240 2024-09-13T21:38:44.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.275+0000 7fd77f7fe700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd77406c680 0x7fd77406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:44.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.275+0000 7fd77f7fe700 1 -- 172.21.15.88:0/3478676224 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd77008b480 con 0x7fd788100240 2024-09-13T21:38:44.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.275+0000 7fd785d9b700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd77406c680 0x7fd77406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:44.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.276+0000 7fd785d9b700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd77406c680 0x7fd77406eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd7780059d0 tx=0x7fd778005920 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:44.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.280+0000 7fd77f7fe700 1 -- 172.21.15.88:0/3478676224 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd770059640 con 0x7fd788100240 2024-09-13T21:38:44.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.469+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fd788108ff0 con 0x7fd788100240 2024-09-13T21:38:44.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.470+0000 7fd77f7fe700 1 -- 172.21.15.88:0/3478676224 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fd788108ff0 con 0x7fd788100240 2024-09-13T21:38:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd77406c680 msgr2=0x7fd77406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd77406c680 0x7fd77406eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd7780059d0 tx=0x7fd778005920 comp rx=0 tx=0).stop 2024-09-13T21:38:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788100240 msgr2=0x7fd788074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788100240 0x7fd788074af0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd77000b480 tx=0x7fd77000b840 comp rx=0 tx=0).stop 2024-09-13T21:38:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 shutdown_connections 2024-09-13T21:38:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd77406c680 0x7fd77406eb30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd788100240 0x7fd788074af0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 --2- 172.21.15.88:0/3478676224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd788101440 0x7fd788073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 >> 172.21.15.88:0/3478676224 conn(0x7fd7880fb7f0 msgr2=0x7fd788104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 shutdown_connections 2024-09-13T21:38:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:44.472+0000 7fd78ceb2700 1 -- 172.21.15.88:0/3478676224 wait complete. 2024-09-13T21:38:45.098 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T21:38:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:45.453 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:45 smithi088 ceph-mon[27963]: pgmap v202: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:38:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:45 smithi116 ceph-mon[33391]: pgmap v202: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:38:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.950+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/3938773106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8100240 msgr2=0x7fd9f8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.950+0000 7fd9fe8f7700 1 --2- 172.21.15.88:0/3938773106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8100240 0x7fd9f8100650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009910 tx=0x7fd9e8009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.950+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/3938773106 shutdown_connections 2024-09-13T21:38:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.950+0000 7fd9fe8f7700 1 --2- 172.21.15.88:0/3938773106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f8101440 0x7fd9f8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.950+0000 7fd9fe8f7700 1 --2- 172.21.15.88:0/3938773106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8100240 0x7fd9f8100650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.950+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/3938773106 >> 172.21.15.88:0/3938773106 conn(0x7fd9f80fb7f0 msgr2=0x7fd9f80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.950+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/3938773106 shutdown_connections 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.950+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/3938773106 wait complete. 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.951+0000 7fd9fe8f7700 1 Processor -- start 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.951+0000 7fd9fe8f7700 1 -- start start 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.951+0000 7fd9fe8f7700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f8100240 0x7fd9f8195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.951+0000 7fd9fe8f7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8101440 0x7fd9f81960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.951+0000 7fd9fe8f7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f81966c0 con 0x7fd9f8101440 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.951+0000 7fd9fe8f7700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f8196800 con 0x7fd9f8100240 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.951+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8101440 0x7fd9f81960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.951+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8101440 0x7fd9f81960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55250/0 (socket says 172.21.15.88:55250) 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.951+0000 7fd9f77fe700 1 -- 172.21.15.88:0/4193377084 learned_addr learned my addr 172.21.15.88:0/4193377084 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9f7fff700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f8100240 0x7fd9f8195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9f77fe700 1 -- 172.21.15.88:0/4193377084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f8100240 msgr2=0x7fd9f8195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9f77fe700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f8100240 0x7fd9f8195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9f77fe700 1 -- 172.21.15.88:0/4193377084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80095f0 con 0x7fd9f8101440 2024-09-13T21:38:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9f77fe700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8101440 0x7fd9f81960a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00b4b0 tx=0x7fd9ec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9f57fa700 1 -- 172.21.15.88:0/4193377084 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9ec011800 con 0x7fd9f8101440 2024-09-13T21:38:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9f57fa700 1 -- 172.21.15.88:0/4193377084 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd9ec011e10 con 0x7fd9f8101440 2024-09-13T21:38:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9f57fa700 1 -- 172.21.15.88:0/4193377084 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9ec00f2e0 con 0x7fd9f8101440 2024-09-13T21:38:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f819b2b0 con 0x7fd9f8101440 2024-09-13T21:38:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.952+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f819b800 con 0x7fd9f8101440 2024-09-13T21:38:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.953+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f8108e10 con 0x7fd9f8101440 2024-09-13T21:38:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.954+0000 7fd9f57fa700 1 -- 172.21.15.88:0/4193377084 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd9ec010380 con 0x7fd9f8101440 2024-09-13T21:38:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.954+0000 7fd9f57fa700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd9e006c680 0x7fd9e006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.954+0000 7fd9f57fa700 1 -- 172.21.15.88:0/4193377084 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd9ec08b4a0 con 0x7fd9f8101440 2024-09-13T21:38:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.954+0000 7fd9f7fff700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd9e006c680 0x7fd9e006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.955+0000 7fd9f7fff700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd9e006c680 0x7fd9e006eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8006010 tx=0x7fd9e8005920 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:46.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:46.959+0000 7fd9f57fa700 1 -- 172.21.15.88:0/4193377084 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd9ec059660 con 0x7fd9f8101440 2024-09-13T21:38:47.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.148+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fd9f8108fd0 con 0x7fd9f8101440 2024-09-13T21:38:47.150 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:46 smithi088 ceph-mon[27963]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-13T21:38:47.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.148+0000 7fd9f57fa700 1 -- 172.21.15.88:0/4193377084 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd9ec0591f0 con 0x7fd9f8101440 2024-09-13T21:38:47.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd9e006c680 msgr2=0x7fd9e006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:47.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd9e006c680 0x7fd9e006eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8006010 tx=0x7fd9e8005920 comp rx=0 tx=0).stop 2024-09-13T21:38:47.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8101440 msgr2=0x7fd9f81960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:47.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8101440 0x7fd9f81960a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00b4b0 tx=0x7fd9ec00b870 comp rx=0 tx=0).stop 2024-09-13T21:38:47.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 shutdown_connections 2024-09-13T21:38:47.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fd9e006c680 0x7fd9e006eb30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:47.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f8100240 0x7fd9f8195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:47.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 --2- 172.21.15.88:0/4193377084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9f8101440 0x7fd9f81960a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:47.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 >> 172.21.15.88:0/4193377084 conn(0x7fd9f80fb7f0 msgr2=0x7fd9f8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:47.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.150+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 shutdown_connections 2024-09-13T21:38:47.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:47.151+0000 7fd9fe8f7700 1 -- 172.21.15.88:0/4193377084 wait complete. 2024-09-13T21:38:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:46 smithi116 ceph-mon[33391]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-13T21:38:47.782 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T21:38:47.988 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:49.431 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:49 smithi088 ceph-mon[27963]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-13T21:38:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:49 smithi116 ceph-mon[33391]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-13T21:38:49.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.682+0000 7f879ec25700 1 -- 172.21.15.88:0/3296369790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 msgr2=0x7f87980ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.682+0000 7f879ec25700 1 --2- 172.21.15.88:0/3296369790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 0x7f87980ff540 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f878c009910 tx=0x7f878c009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.682+0000 7f879ec25700 1 -- 172.21.15.88:0/3296369790 shutdown_connections 2024-09-13T21:38:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.682+0000 7f879ec25700 1 --2- 172.21.15.88:0/3296369790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87981003d0 0x7f8798100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.682+0000 7f879ec25700 1 --2- 172.21.15.88:0/3296369790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 0x7f87980ff540 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.682+0000 7f879ec25700 1 -- 172.21.15.88:0/3296369790 >> 172.21.15.88:0/3296369790 conn(0x7f87980fa780 msgr2=0x7f87980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.682+0000 7f879ec25700 1 -- 172.21.15.88:0/3296369790 shutdown_connections 2024-09-13T21:38:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.682+0000 7f879ec25700 1 -- 172.21.15.88:0/3296369790 wait complete. 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.683+0000 7f879ec25700 1 Processor -- start 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.683+0000 7f879ec25700 1 -- start start 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.683+0000 7f879ec25700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 0x7f87980690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.683+0000 7f879ec25700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87981003d0 0x7f879819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.683+0000 7f879ec25700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879819ade0 con 0x7f87980ff130 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.683+0000 7f879ec25700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879819af20 con 0x7f87981003d0 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.683+0000 7f879c9c1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 0x7f87980690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.683+0000 7f879c9c1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 0x7f87980690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55264/0 (socket says 172.21.15.88:55264) 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.683+0000 7f879c9c1700 1 -- 172.21.15.88:0/4252249675 learned_addr learned my addr 172.21.15.88:0/4252249675 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f8797fff700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87981003d0 0x7f879819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f879c9c1700 1 -- 172.21.15.88:0/4252249675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87981003d0 msgr2=0x7f879819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f879c9c1700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87981003d0 0x7f879819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f879c9c1700 1 -- 172.21.15.88:0/4252249675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c0095f0 con 0x7f87980ff130 2024-09-13T21:38:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f879c9c1700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 0x7f87980690a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f878c006010 tx=0x7f878c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f8795ffb700 1 -- 172.21.15.88:0/4252249675 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f878c01d070 con 0x7f87980ff130 2024-09-13T21:38:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879819b1a0 con 0x7f87980ff130 2024-09-13T21:38:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f8795ffb700 1 -- 172.21.15.88:0/4252249675 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f878c00f460 con 0x7f87980ff130 2024-09-13T21:38:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f8795ffb700 1 -- 172.21.15.88:0/4252249675 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f878c021640 con 0x7f87980ff130 2024-09-13T21:38:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.684+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879819b690 con 0x7f87980ff130 2024-09-13T21:38:49.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.685+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8798107c10 con 0x7f87980ff130 2024-09-13T21:38:49.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.686+0000 7f8795ffb700 1 -- 172.21.15.88:0/4252249675 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f878c004b20 con 0x7f87980ff130 2024-09-13T21:38:49.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.686+0000 7f8795ffb700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f878806c680 0x7f878806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:49.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.686+0000 7f8795ffb700 1 -- 172.21.15.88:0/4252249675 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f878c08cb80 con 0x7f87980ff130 2024-09-13T21:38:49.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.686+0000 7f8797fff700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f878806c680 0x7f878806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:49.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.687+0000 7f8797fff700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f878806c680 0x7f878806eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8784005fd0 tx=0x7f878400a560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:49.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.691+0000 7f8795ffb700 1 -- 172.21.15.88:0/4252249675 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f878c05adc0 con 0x7f87980ff130 2024-09-13T21:38:49.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.878+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f879819bd90 con 0x7f87980ff130 2024-09-13T21:38:49.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.878+0000 7f8795ffb700 1 -- 172.21.15.88:0/4252249675 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f878c0260c0 con 0x7f87980ff130 2024-09-13T21:38:49.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.880+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f878806c680 msgr2=0x7f878806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:49.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.880+0000 7f879ec25700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f878806c680 0x7f878806eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8784005fd0 tx=0x7f878400a560 comp rx=0 tx=0).stop 2024-09-13T21:38:49.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.880+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 msgr2=0x7f87980690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:49.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.880+0000 7f879ec25700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 0x7f87980690a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f878c006010 tx=0x7f878c00be20 comp rx=0 tx=0).stop 2024-09-13T21:38:49.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.880+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 shutdown_connections 2024-09-13T21:38:49.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.880+0000 7f879ec25700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f878806c680 0x7f878806eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:49.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.880+0000 7f879ec25700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87980ff130 0x7f87980690a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:49.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.880+0000 7f879ec25700 1 --2- 172.21.15.88:0/4252249675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87981003d0 0x7f879819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:49.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.880+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 >> 172.21.15.88:0/4252249675 conn(0x7f87980fa780 msgr2=0x7f8798103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:49.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.881+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 shutdown_connections 2024-09-13T21:38:49.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:49.881+0000 7f879ec25700 1 -- 172.21.15.88:0/4252249675 wait complete. 2024-09-13T21:38:50.611 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-13T21:38:50.812 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:38:51.225 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:51 smithi088 ceph-mon[27963]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-13T21:38:51.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:51 smithi116 ceph-mon[33391]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-13T21:38:52.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.456+0000 7fbcd46c7700 1 -- 172.21.15.88:0/3529950353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc101440 msgr2=0x7fbccc101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:52.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.456+0000 7fbcd46c7700 1 --2- 172.21.15.88:0/3529950353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc101440 0x7fbccc101890 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009910 tx=0x7fbcbc009c20 comp rx=0 tx=0).stop 2024-09-13T21:38:52.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.456+0000 7fbcd46c7700 1 -- 172.21.15.88:0/3529950353 shutdown_connections 2024-09-13T21:38:52.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.456+0000 7fbcd46c7700 1 --2- 172.21.15.88:0/3529950353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc101440 0x7fbccc101890 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:52.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.456+0000 7fbcd46c7700 1 --2- 172.21.15.88:0/3529950353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbccc100240 0x7fbccc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:52.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.456+0000 7fbcd46c7700 1 -- 172.21.15.88:0/3529950353 >> 172.21.15.88:0/3529950353 conn(0x7fbccc0fb7f0 msgr2=0x7fbccc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.456+0000 7fbcd46c7700 1 -- 172.21.15.88:0/3529950353 shutdown_connections 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.456+0000 7fbcd46c7700 1 -- 172.21.15.88:0/3529950353 wait complete. 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.456+0000 7fbcd46c7700 1 Processor -- start 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd46c7700 1 -- start start 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd46c7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc100240 0x7fbccc195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd46c7700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbccc101440 0x7fbccc1960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd46c7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc1966e0 con 0x7fbccc100240 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd46c7700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc196820 con 0x7fbccc101440 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd2463700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc100240 0x7fbccc195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd2463700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc100240 0x7fbccc195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55360/0 (socket says 172.21.15.88:55360) 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd2463700 1 -- 172.21.15.88:0/2695055587 learned_addr learned my addr 172.21.15.88:0/2695055587 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:38:52.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd1c62700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbccc101440 0x7fbccc1960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:52.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd2463700 1 -- 172.21.15.88:0/2695055587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbccc101440 msgr2=0x7fbccc1960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:52.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd2463700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbccc101440 0x7fbccc1960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:52.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd2463700 1 -- 172.21.15.88:0/2695055587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0095f0 con 0x7fbccc100240 2024-09-13T21:38:52.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd2463700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc100240 0x7fbccc195b80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800b480 tx=0x7fbcc800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:52.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcc37fe700 1 -- 172.21.15.88:0/2695055587 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc80118c0 con 0x7fbccc100240 2024-09-13T21:38:52.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcc37fe700 1 -- 172.21.15.88:0/2695055587 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbcc8010380 con 0x7fbccc100240 2024-09-13T21:38:52.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc19b2d0 con 0x7fbccc100240 2024-09-13T21:38:52.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.457+0000 7fbcc37fe700 1 -- 172.21.15.88:0/2695055587 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc800f4f0 con 0x7fbccc100240 2024-09-13T21:38:52.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.458+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc19b820 con 0x7fbccc100240 2024-09-13T21:38:52.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.459+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc108e30 con 0x7fbccc100240 2024-09-13T21:38:52.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.459+0000 7fbcc37fe700 1 -- 172.21.15.88:0/2695055587 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbcc8011a20 con 0x7fbccc100240 2024-09-13T21:38:52.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.459+0000 7fbcc37fe700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbcb806c680 0x7fbcb806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:52.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.460+0000 7fbcd1c62700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbcb806c680 0x7fbcb806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:52.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.460+0000 7fbcc37fe700 1 -- 172.21.15.88:0/2695055587 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fbcc808b4f0 con 0x7fbccc100240 2024-09-13T21:38:52.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.460+0000 7fbcd1c62700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbcb806c680 0x7fbcb806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc006010 tx=0x7fbcbc00b580 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:52.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.464+0000 7fbcc37fe700 1 -- 172.21.15.88:0/2695055587 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbcc80596b0 con 0x7fbccc100240 2024-09-13T21:38:52.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:38:52.673+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fbccc105d90 con 0x7fbcb806c680 2024-09-13T21:38:53.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:53 smithi088 ceph-mon[27963]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-09-13T21:38:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:53 smithi116 ceph-mon[33391]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-09-13T21:38:54.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:54 smithi088 ceph-mon[27963]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:38:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:54 smithi116 ceph-mon[33391]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:38:55.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:55 smithi088 ceph-mon[27963]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-09-13T21:38:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:55 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:55 smithi116 ceph-mon[33391]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-09-13T21:38:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:55 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:57.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:56 smithi088 ceph-mon[27963]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-13T21:38:57.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:56 smithi116 ceph-mon[33391]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-13T21:38:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:38:59 smithi088 ceph-mon[27963]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:38:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:38:59 smithi116 ceph-mon[33391]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:01.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:01 smithi088 ceph-mon[27963]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:01 smithi116 ceph-mon[33391]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:03.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:03 smithi088 ceph-mon[27963]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:03 smithi116 ceph-mon[33391]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:05.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:05 smithi088 ceph-mon[27963]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:05 smithi116 ceph-mon[33391]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:07.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:06 smithi088 ceph-mon[27963]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:07.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:06 smithi116 ceph-mon[33391]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:09 smithi088 ceph-mon[27963]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:09.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:09 smithi116 ceph-mon[33391]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:10.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:10.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:11.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:11 smithi088 ceph-mon[27963]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:11 smithi116 ceph-mon[33391]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:13.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:13 smithi088 ceph-mon[27963]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:13 smithi116 ceph-mon[33391]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:15 smithi088 ceph-mon[27963]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:15.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:15 smithi116 ceph-mon[33391]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:17.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:16 smithi088 ceph-mon[27963]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T21:39:17.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:16 smithi116 ceph-mon[33391]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T21:39:19.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:19 smithi088 ceph-mon[27963]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T21:39:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:19 smithi116 ceph-mon[33391]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T21:39:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:21 smithi088 ceph-mon[27963]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:39:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:21 smithi116 ceph-mon[33391]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:39:23.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:23 smithi116 ceph-mon[33391]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:39:23.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:23 smithi088 ceph-mon[27963]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:39:24.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.787+0000 7fbcc37fe700 1 -- 172.21.15.88:0/2695055587 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fbccc105d90 con 0x7fbcb806c680 2024-09-13T21:39:24.789 INFO:teuthology.orchestra.run.smithi088.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:39:24.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbcb806c680 msgr2=0x7fbcb806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:24.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbcb806c680 0x7fbcb806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc006010 tx=0x7fbcbc00b580 comp rx=0 tx=0).stop 2024-09-13T21:39:24.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc100240 msgr2=0x7fbccc195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:24.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc100240 0x7fbccc195b80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800b480 tx=0x7fbcc800b840 comp rx=0 tx=0).stop 2024-09-13T21:39:24.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 shutdown_connections 2024-09-13T21:39:24.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fbcb806c680 0x7fbcb806eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:24.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbccc100240 0x7fbccc195b80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:24.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 --2- 172.21.15.88:0/2695055587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbccc101440 0x7fbccc1960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:24.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 >> 172.21.15.88:0/2695055587 conn(0x7fbccc0fb7f0 msgr2=0x7fbccc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:24.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 shutdown_connections 2024-09-13T21:39:24.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:24.790+0000 7fbcd46c7700 1 -- 172.21.15.88:0/2695055587 wait complete. 2024-09-13T21:39:25.461 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:25 smithi088 ceph-mon[27963]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:39:25.461 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:39:25.461 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:25.461 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:25.490 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-13T21:39:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:25 smithi116 ceph-mon[33391]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:39:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:39:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:25.740 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:39:26.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:26 smithi088 ceph-mon[27963]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:39:26.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:26.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:26.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:26 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:39:26.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:26 smithi116 ceph-mon[33391]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:39:26.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:26.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:26.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:26 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:39:27.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:27 smithi088 ceph-mon[27963]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:39:27.477 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:27 smithi088 ceph-mon[27963]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T21:39:27.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:27 smithi116 ceph-mon[33391]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:39:27.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:27 smithi116 ceph-mon[33391]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T21:39:27.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.925+0000 7f4b47877700 1 -- 172.21.15.88:0/2297429901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b401006f0 msgr2=0x7f4b40100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:27.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.925+0000 7f4b47877700 1 --2- 172.21.15.88:0/2297429901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b401006f0 0x7f4b40100b00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009910 tx=0x7f4b3c009c20 comp rx=0 tx=0).stop 2024-09-13T21:39:27.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.925+0000 7f4b47877700 1 -- 172.21.15.88:0/2297429901 shutdown_connections 2024-09-13T21:39:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.925+0000 7f4b47877700 1 --2- 172.21.15.88:0/2297429901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b40101040 0x7f4b400ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.925+0000 7f4b47877700 1 --2- 172.21.15.88:0/2297429901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b401006f0 0x7f4b40100b00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.925+0000 7f4b47877700 1 -- 172.21.15.88:0/2297429901 >> 172.21.15.88:0/2297429901 conn(0x7f4b400f9f10 msgr2=0x7f4b400fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.926+0000 7f4b47877700 1 -- 172.21.15.88:0/2297429901 shutdown_connections 2024-09-13T21:39:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.926+0000 7f4b47877700 1 -- 172.21.15.88:0/2297429901 wait complete. 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.927+0000 7f4b47877700 1 Processor -- start 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.927+0000 7f4b47877700 1 -- start start 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.927+0000 7f4b47877700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b401006f0 0x7f4b40195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.927+0000 7f4b47877700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b40101040 0x7f4b40196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.927+0000 7f4b47877700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b40196640 con 0x7f4b40101040 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.927+0000 7f4b47877700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b40196780 con 0x7f4b401006f0 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.927+0000 7f4b44e12700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b40101040 0x7f4b40196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.927+0000 7f4b44e12700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b40101040 0x7f4b40196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43910/0 (socket says 172.21.15.88:43910) 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.927+0000 7f4b44e12700 1 -- 172.21.15.88:0/2644687225 learned_addr learned my addr 172.21.15.88:0/2644687225 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b45613700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b401006f0 0x7f4b40195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b44e12700 1 -- 172.21.15.88:0/2644687225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b401006f0 msgr2=0x7f4b40195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:27.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b44e12700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b401006f0 0x7f4b40195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:27.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b44e12700 1 -- 172.21.15.88:0/2644687225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c0095f0 con 0x7f4b40101040 2024-09-13T21:39:27.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b45613700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b401006f0 0x7f4b40195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:39:27.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b44e12700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b40101040 0x7f4b40196020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e920 tx=0x7f4b3000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:27.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b367fc700 1 -- 172.21.15.88:0/2644687225 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b3000cba0 con 0x7f4b40101040 2024-09-13T21:39:27.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4019b230 con 0x7f4b40101040 2024-09-13T21:39:27.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b367fc700 1 -- 172.21.15.88:0/2644687225 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b3000cd00 con 0x7f4b40101040 2024-09-13T21:39:27.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b367fc700 1 -- 172.21.15.88:0/2644687225 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b30018770 con 0x7f4b40101040 2024-09-13T21:39:27.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.928+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4019b780 con 0x7f4b40101040 2024-09-13T21:39:27.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.930+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b40108d00 con 0x7f4b40101040 2024-09-13T21:39:27.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.930+0000 7f4b367fc700 1 -- 172.21.15.88:0/2644687225 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4b30010430 con 0x7f4b40101040 2024-09-13T21:39:27.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.931+0000 7f4b367fc700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4b2c06c680 0x7f4b2c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:27.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.931+0000 7f4b367fc700 1 -- 172.21.15.88:0/2644687225 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4b30014070 con 0x7f4b40101040 2024-09-13T21:39:27.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.931+0000 7f4b45613700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4b2c06c680 0x7f4b2c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:27.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.931+0000 7f4b45613700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4b2c06c680 0x7f4b2c06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c006010 tx=0x7f4b3c009f70 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:27.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:27.939+0000 7f4b367fc700 1 -- 172.21.15.88:0/2644687225 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4b30051720 con 0x7f4b40101040 2024-09-13T21:39:28.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.238+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b40104d50 con 0x7f4b2c06c680 2024-09-13T21:39:28.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.240+0000 7f4b367fc700 1 -- 172.21.15.88:0/2644687225 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f4b40104d50 con 0x7f4b2c06c680 2024-09-13T21:39:28.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.242+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4b2c06c680 msgr2=0x7f4b2c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:28.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.242+0000 7f4b47877700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4b2c06c680 0x7f4b2c06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c006010 tx=0x7f4b3c009f70 comp rx=0 tx=0).stop 2024-09-13T21:39:28.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.242+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b40101040 msgr2=0x7f4b40196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:28.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.242+0000 7f4b47877700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b40101040 0x7f4b40196020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e920 tx=0x7f4b3000ece0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.242+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 shutdown_connections 2024-09-13T21:39:28.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.242+0000 7f4b47877700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4b2c06c680 0x7f4b2c06eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.242+0000 7f4b47877700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b401006f0 0x7f4b40195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.242+0000 7f4b47877700 1 --2- 172.21.15.88:0/2644687225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b40101040 0x7f4b40196020 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.242+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 >> 172.21.15.88:0/2644687225 conn(0x7f4b400f9f10 msgr2=0x7f4b40103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:28.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.243+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 shutdown_connections 2024-09-13T21:39:28.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.243+0000 7f4b47877700 1 -- 172.21.15.88:0/2644687225 wait complete. 2024-09-13T21:39:28.258 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.361+0000 7fb54529d700 1 -- 172.21.15.88:0/3865079196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb540103600 msgr2=0x7fb5401059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.361+0000 7fb54529d700 1 --2- 172.21.15.88:0/3865079196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb540103600 0x7fb5401059e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb534009910 tx=0x7fb534009c20 comp rx=0 tx=0).stop 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.361+0000 7fb54529d700 1 -- 172.21.15.88:0/3865079196 shutdown_connections 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.361+0000 7fb54529d700 1 --2- 172.21.15.88:0/3865079196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb540103600 0x7fb5401059e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.361+0000 7fb54529d700 1 --2- 172.21.15.88:0/3865079196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb540100ce0 0x7fb5401030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.361+0000 7fb54529d700 1 -- 172.21.15.88:0/3865079196 >> 172.21.15.88:0/3865079196 conn(0x7fb5400fa700 msgr2=0x7fb5400fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.361+0000 7fb54529d700 1 -- 172.21.15.88:0/3865079196 shutdown_connections 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.361+0000 7fb54529d700 1 -- 172.21.15.88:0/3865079196 wait complete. 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.362+0000 7fb54529d700 1 Processor -- start 2024-09-13T21:39:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.362+0000 7fb54529d700 1 -- start start 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.362+0000 7fb54529d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb540100ce0 0x7fb540100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.362+0000 7fb54529d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5400fec90 0x7fb5400ff100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb53effd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb540100ce0 0x7fb540100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb53effd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb540100ce0 0x7fb540100640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:41946/0 (socket says 172.21.15.88:41946) 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb53e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5400fec90 0x7fb5400ff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb53e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5400fec90 0x7fb5400ff100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43932/0 (socket says 172.21.15.88:43932) 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb54529d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400ff640 con 0x7fb5400fec90 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb54529d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400ff7b0 con 0x7fb540100ce0 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb53effd700 1 -- 172.21.15.88:0/4109559420 learned_addr learned my addr 172.21.15.88:0/4109559420 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb53e7fc700 1 -- 172.21.15.88:0/4109559420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb540100ce0 msgr2=0x7fb540100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb53e7fc700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb540100ce0 0x7fb540100640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb53e7fc700 1 -- 172.21.15.88:0/4109559420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5340095f0 con 0x7fb5400fec90 2024-09-13T21:39:28.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.363+0000 7fb53effd700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb540100ce0 0x7fb540100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-13T21:39:28.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.364+0000 7fb53e7fc700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5400fec90 0x7fb5400ff100 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb534008000 tx=0x7fb53400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:28.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.364+0000 7fb527fff700 1 -- 172.21.15.88:0/4109559420 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53401d070 con 0x7fb5400fec90 2024-09-13T21:39:28.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.364+0000 7fb527fff700 1 -- 172.21.15.88:0/4109559420 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb534005dc0 con 0x7fb5400fec90 2024-09-13T21:39:28.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.364+0000 7fb527fff700 1 -- 172.21.15.88:0/4109559420 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb534021da0 con 0x7fb5400fec90 2024-09-13T21:39:28.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.364+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5400ffa30 con 0x7fb5400fec90 2024-09-13T21:39:28.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.365+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54019df20 con 0x7fb5400fec90 2024-09-13T21:39:28.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.366+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb540108d90 con 0x7fb5400fec90 2024-09-13T21:39:28.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.366+0000 7fb527fff700 1 -- 172.21.15.88:0/4109559420 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb534021410 con 0x7fb5400fec90 2024-09-13T21:39:28.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.367+0000 7fb527fff700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb52806c680 0x7fb52806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:28.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.367+0000 7fb527fff700 1 -- 172.21.15.88:0/4109559420 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb53408c930 con 0x7fb5400fec90 2024-09-13T21:39:28.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.367+0000 7fb53effd700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb52806c680 0x7fb52806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:28.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.367+0000 7fb53effd700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb52806c680 0x7fb52806eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb530009ca0 tx=0x7fb530009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:28.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.375+0000 7fb527fff700 1 -- 172.21.15.88:0/4109559420 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb53405ab70 con 0x7fb5400fec90 2024-09-13T21:39:28.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.654+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb540101940 con 0x7fb52806c680 2024-09-13T21:39:28.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.656+0000 7fb527fff700 1 -- 172.21.15.88:0/4109559420 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fb540101940 con 0x7fb52806c680 2024-09-13T21:39:28.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.659+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb52806c680 msgr2=0x7fb52806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:28.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.659+0000 7fb54529d700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb52806c680 0x7fb52806eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb530009ca0 tx=0x7fb530009260 comp rx=0 tx=0).stop 2024-09-13T21:39:28.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.659+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5400fec90 msgr2=0x7fb5400ff100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:28.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.659+0000 7fb54529d700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5400fec90 0x7fb5400ff100 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb534008000 tx=0x7fb53400fab0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.659+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 shutdown_connections 2024-09-13T21:39:28.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.659+0000 7fb54529d700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb52806c680 0x7fb52806eb30 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb530009ca0 tx=0x7fb530009260 comp rx=0 tx=0).stop 2024-09-13T21:39:28.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.659+0000 7fb54529d700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb540100ce0 0x7fb540100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.659+0000 7fb54529d700 1 --2- 172.21.15.88:0/4109559420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5400fec90 0x7fb5400ff100 secure :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb534008000 tx=0x7fb53400fab0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.659+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 >> 172.21.15.88:0/4109559420 conn(0x7fb5400fa700 msgr2=0x7fb5400fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:28.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.660+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 shutdown_connections 2024-09-13T21:39:28.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.660+0000 7fb54529d700 1 -- 172.21.15.88:0/4109559420 wait complete. 2024-09-13T21:39:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.774+0000 7f11b0685700 1 -- 172.21.15.88:0/1058842221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11a8069270 msgr2=0x7f11a8102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.774+0000 7f11b0685700 1 --2- 172.21.15.88:0/1058842221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11a8069270 0x7f11a8102dd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009910 tx=0x7f11a4009c20 comp rx=0 tx=0).stop 2024-09-13T21:39:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.775+0000 7f11b0685700 1 -- 172.21.15.88:0/1058842221 shutdown_connections 2024-09-13T21:39:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.775+0000 7f11b0685700 1 --2- 172.21.15.88:0/1058842221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11a8103310 0x7f11a8105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.775+0000 7f11b0685700 1 --2- 172.21.15.88:0/1058842221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11a8069270 0x7f11a8102dd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.775+0000 7f11b0685700 1 -- 172.21.15.88:0/1058842221 >> 172.21.15.88:0/1058842221 conn(0x7f11a80fa780 msgr2=0x7f11a80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.775+0000 7f11b0685700 1 -- 172.21.15.88:0/1058842221 shutdown_connections 2024-09-13T21:39:28.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.775+0000 7f11b0685700 1 -- 172.21.15.88:0/1058842221 wait complete. 2024-09-13T21:39:28.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.776+0000 7f11b0685700 1 Processor -- start 2024-09-13T21:39:28.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.776+0000 7f11b0685700 1 -- start start 2024-09-13T21:39:28.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.776+0000 7f11b0685700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11a8103310 0x7f11a8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:28.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.776+0000 7f11b0685700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11a80fed70 0x7f11a80ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:28.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.776+0000 7f11b0685700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a80ff720 con 0x7f11a8103310 2024-09-13T21:39:28.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.776+0000 7f11b0685700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a80ff890 con 0x7f11a80fed70 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.776+0000 7f11adc20700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11a80fed70 0x7f11a80ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f11adc20700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11a80fed70 0x7f11a80ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:41958/0 (socket says 172.21.15.88:41958) 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f11adc20700 1 -- 172.21.15.88:0/4238993279 learned_addr learned my addr 172.21.15.88:0/4238993279 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f11ae421700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11a8103310 0x7f11a8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f11adc20700 1 -- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11a8103310 msgr2=0x7f11a8100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f11adc20700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11a8103310 0x7f11a8100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f11adc20700 1 -- 172.21.15.88:0/4238993279 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40095f0 con 0x7f11a80fed70 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f11adc20700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11a80fed70 0x7f11a80ff1e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f119800e920 tx=0x7f119800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f11ae421700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11a8103310 0x7f11a8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f119f7fe700 1 -- 172.21.15.88:0/4238993279 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f119800cba0 con 0x7f11a80fed70 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f119f7fe700 1 -- 172.21.15.88:0/4238993279 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f119800cd00 con 0x7f11a80fed70 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.777+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a80ffb70 con 0x7f11a80fed70 2024-09-13T21:39:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.778+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a819dd40 con 0x7f11a80fed70 2024-09-13T21:39:28.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.778+0000 7f119f7fe700 1 -- 172.21.15.88:0/4238993279 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1198018770 con 0x7f11a80fed70 2024-09-13T21:39:28.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.779+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a818fbd0 con 0x7f11a80fed70 2024-09-13T21:39:28.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.779+0000 7f119f7fe700 1 -- 172.21.15.88:0/4238993279 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1198010430 con 0x7f11a80fed70 2024-09-13T21:39:28.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.780+0000 7f119f7fe700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f119406c6d0 0x7f119406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:28.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.780+0000 7f119f7fe700 1 -- 172.21.15.88:0/4238993279 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1198014070 con 0x7f11a80fed70 2024-09-13T21:39:28.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.780+0000 7f11ae421700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f119406c6d0 0x7f119406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:28.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.780+0000 7f11ae421700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f119406c6d0 0x7f119406eb80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11a4000c00 tx=0x7f11a4009f70 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:28.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:28.784+0000 7f119f7fe700 1 -- 172.21.15.88:0/4238993279 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f119805a000 con 0x7f11a80fed70 2024-09-13T21:39:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.113+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f11a802cda0 con 0x7f119406c6d0 2024-09-13T21:39:29.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.124+0000 7f119f7fe700 1 -- 172.21.15.88:0/4238993279 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f11a802cda0 con 0x7f119406c6d0 2024-09-13T21:39:29.126 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:39:29.126 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (5m) 58s ago 6m 24.7M - 0.25.0 c8568f914cd2 c82eca12b874 2024-09-13T21:39:29.126 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (7m) 58s ago 7m 7419k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:39:29.126 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (6m) 64s ago 6m 7331k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:39:29.126 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (7m) 58s ago 7m 6665k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:39:29.126 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (6m) 64s ago 5m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (5m) 58s ago 6m 88.1M - 9.4.7 954c08fa6188 aa2cd07a9c2d 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (77s) 58s ago 76s 17.0M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (83s) 58s ago 82s 11.2M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (74s) 64s ago 73s 13.1M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (80s) 64s ago 80s 18.3M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:9283,8765,8443 running (8m) 58s ago 8m 489M - 18.2.0 dc2bc1663786 9fc04dc2c4a7 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (5m) 64s ago 5m 437M - 18.2.0 dc2bc1663786 3d98303b8a6d 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (8m) 58s ago 8m 45.0M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (5m) 64s ago 5m 34.7M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (6m) 58s ago 6m 15.7M - 1.5.0 0da6a335fe13 71ce2b0df304 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (5m) 64s ago 5m 16.1M - 1.5.0 0da6a335fe13 6d3c62590d98 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (5m) 58s ago 5m 49.6M 3946M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (4m) 58s ago 4m 50.6M 3946M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:39:29.127 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (4m) 58s ago 4m 47.0M 3946M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:39:29.128 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (3m) 64s ago 3m 46.5M 4970M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:39:29.128 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (3m) 64s ago 3m 46.5M 4970M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:39:29.128 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (2m) 64s ago 2m 44.4M 4970M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:39:29.128 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (5m) 58s ago 6m 64.3M - 2.43.0 a07b618ecd1d 85cb356d6671 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.126+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f119406c6d0 msgr2=0x7f119406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.126+0000 7f11b0685700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f119406c6d0 0x7f119406eb80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11a4000c00 tx=0x7f11a4009f70 comp rx=0 tx=0).stop 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.126+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11a80fed70 msgr2=0x7f11a80ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.126+0000 7f11b0685700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11a80fed70 0x7f11a80ff1e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f119800e920 tx=0x7f119800ece0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.126+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 shutdown_connections 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.127+0000 7f11b0685700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f119406c6d0 0x7f119406eb80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.127+0000 7f11b0685700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11a8103310 0x7f11a8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.127+0000 7f11b0685700 1 --2- 172.21.15.88:0/4238993279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11a80fed70 0x7f11a80ff1e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.127+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 >> 172.21.15.88:0/4238993279 conn(0x7f11a80fa780 msgr2=0x7f11a80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:29.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.127+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 shutdown_connections 2024-09-13T21:39:29.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.127+0000 7f11b0685700 1 -- 172.21.15.88:0/4238993279 wait complete. 2024-09-13T21:39:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.269+0000 7f5367b1d700 1 -- 172.21.15.88:0/2226603152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5360100d60 msgr2=0x7f5360103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.269+0000 7f5367b1d700 1 --2- 172.21.15.88:0/2226603152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5360100d60 0x7f5360103140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f535c009910 tx=0x7f535c009c20 comp rx=0 tx=0).stop 2024-09-13T21:39:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.269+0000 7f5367b1d700 1 -- 172.21.15.88:0/2226603152 shutdown_connections 2024-09-13T21:39:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.269+0000 7f5367b1d700 1 --2- 172.21.15.88:0/2226603152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360103680 0x7f5360105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.269+0000 7f5367b1d700 1 --2- 172.21.15.88:0/2226603152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5360100d60 0x7f5360103140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.269+0000 7f5367b1d700 1 -- 172.21.15.88:0/2226603152 >> 172.21.15.88:0/2226603152 conn(0x7f53600fa780 msgr2=0x7f53600fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.269+0000 7f5367b1d700 1 -- 172.21.15.88:0/2226603152 shutdown_connections 2024-09-13T21:39:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.269+0000 7f5367b1d700 1 -- 172.21.15.88:0/2226603152 wait complete. 2024-09-13T21:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.270+0000 7f5367b1d700 1 Processor -- start 2024-09-13T21:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.270+0000 7f5367b1d700 1 -- start start 2024-09-13T21:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.270+0000 7f5367b1d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360100d60 0x7f53601006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.270+0000 7f5367b1d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5360103680 0x7f53600fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.270+0000 7f5367b1d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360199700 con 0x7f5360103680 2024-09-13T21:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.270+0000 7f5367b1d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360199840 con 0x7f5360100d60 2024-09-13T21:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f53658b9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360100d60 0x7f53601006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f53658b9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360100d60 0x7f53601006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:41972/0 (socket says 172.21.15.88:41972) 2024-09-13T21:39:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f53650b8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5360103680 0x7f53600fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f53658b9700 1 -- 172.21.15.88:0/3197521626 learned_addr learned my addr 172.21.15.88:0/3197521626 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:39:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f53658b9700 1 -- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5360103680 msgr2=0x7f53600fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f53658b9700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5360103680 0x7f53600fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f53658b9700 1 -- 172.21.15.88:0/3197521626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0095f0 con 0x7f5360100d60 2024-09-13T21:39:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f53650b8700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5360103680 0x7f53600fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:39:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f53658b9700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360100d60 0x7f53601006c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f535c000c00 tx=0x7f535c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f5356ffd700 1 -- 172.21.15.88:0/3197521626 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535c01d070 con 0x7f5360100d60 2024-09-13T21:39:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53600ff250 con 0x7f5360100d60 2024-09-13T21:39:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f5356ffd700 1 -- 172.21.15.88:0/3197521626 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f535c005dc0 con 0x7f5360100d60 2024-09-13T21:39:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.271+0000 7f5356ffd700 1 -- 172.21.15.88:0/3197521626 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535c022470 con 0x7f5360100d60 2024-09-13T21:39:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.272+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53600ff710 con 0x7f5360100d60 2024-09-13T21:39:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.273+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536018fbc0 con 0x7f5360100d60 2024-09-13T21:39:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.273+0000 7f5356ffd700 1 -- 172.21.15.88:0/3197521626 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f535c003810 con 0x7f5360100d60 2024-09-13T21:39:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.274+0000 7f5356ffd700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f534c06c680 0x7f534c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.274+0000 7f53650b8700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f534c06c680 0x7f534c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.274+0000 7f5356ffd700 1 -- 172.21.15.88:0/3197521626 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f535c08cdc0 con 0x7f5360100d60 2024-09-13T21:39:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.274+0000 7f53650b8700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f534c06c680 0x7f534c06eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5350011490 tx=0x7f5350009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:29.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.282+0000 7f5356ffd700 1 -- 172.21.15.88:0/3197521626 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f535c090030 con 0x7f5360100d60 2024-09-13T21:39:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:29 smithi088 ceph-mon[27963]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T21:39:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:29 smithi088 ceph-mon[27963]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:29 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:39:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:29 smithi088 ceph-mon[27963]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T21:39:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:29 smithi088 ceph-mon[27963]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T21:39:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:29 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:29 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:39:29.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:29 smithi088 ceph-mon[27963]: Upgrade: Need to upgrade myself (mgr.smithi088.scyrwy) 2024-09-13T21:39:29.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.828+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f536002cd80 con 0x7f5360100d60 2024-09-13T21:39:29.831 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:39:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:39:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:39:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:39:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:39:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:39:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:39:29.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.829+0000 7f5356ffd700 1 -- 172.21.15.88:0/3197521626 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f535c05aee0 con 0x7f5360100d60 2024-09-13T21:39:29.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f534c06c680 msgr2=0x7f534c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:29.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f534c06c680 0x7f534c06eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5350011490 tx=0x7f5350009260 comp rx=0 tx=0).stop 2024-09-13T21:39:29.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360100d60 msgr2=0x7f53601006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:29.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360100d60 0x7f53601006c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f535c000c00 tx=0x7f535c00f690 comp rx=0 tx=0).stop 2024-09-13T21:39:29.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 shutdown_connections 2024-09-13T21:39:29.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f534c06c680 0x7f534c06eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360100d60 0x7f53601006c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 --2- 172.21.15.88:0/3197521626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5360103680 0x7f53600fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:29.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 >> 172.21.15.88:0/3197521626 conn(0x7f53600fa780 msgr2=0x7f53600fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:29.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 shutdown_connections 2024-09-13T21:39:29.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:29.832+0000 7f5367b1d700 1 -- 172.21.15.88:0/3197521626 wait complete. 2024-09-13T21:39:29.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:29 smithi116 ceph-mon[33391]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T21:39:29.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:29 smithi116 ceph-mon[33391]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:29.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:29 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:39:29.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:29 smithi116 ceph-mon[33391]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T21:39:29.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:29 smithi116 ceph-mon[33391]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T21:39:29.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:29 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:29.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:29 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:39:29.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:29 smithi116 ceph-mon[33391]: Upgrade: Need to upgrade myself (mgr.smithi088.scyrwy) 2024-09-13T21:39:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.007+0000 7efc24475700 1 -- 172.21.15.88:0/3698490216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fe500 msgr2=0x7efc1c0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.007+0000 7efc24475700 1 --2- 172.21.15.88:0/3698490216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fe500 0x7efc1c0fe910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efc18009910 tx=0x7efc18009c20 comp rx=0 tx=0).stop 2024-09-13T21:39:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.007+0000 7efc24475700 1 -- 172.21.15.88:0/3698490216 shutdown_connections 2024-09-13T21:39:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.007+0000 7efc24475700 1 --2- 172.21.15.88:0/3698490216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc1c0fee50 0x7efc1c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:30.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.007+0000 7efc24475700 1 --2- 172.21.15.88:0/3698490216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fe500 0x7efc1c0fe910 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:30.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.007+0000 7efc24475700 1 -- 172.21.15.88:0/3698490216 >> 172.21.15.88:0/3698490216 conn(0x7efc1c0f9f10 msgr2=0x7efc1c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:30.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.007+0000 7efc24475700 1 -- 172.21.15.88:0/3698490216 shutdown_connections 2024-09-13T21:39:30.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.007+0000 7efc24475700 1 -- 172.21.15.88:0/3698490216 wait complete. 2024-09-13T21:39:30.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.008+0000 7efc24475700 1 Processor -- start 2024-09-13T21:39:30.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.008+0000 7efc24475700 1 -- start start 2024-09-13T21:39:30.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.008+0000 7efc24475700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc1c0fe500 0x7efc1c071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:30.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.008+0000 7efc24475700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fee50 0x7efc1c072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:30.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.008+0000 7efc24475700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c072960 con 0x7efc1c0fee50 2024-09-13T21:39:30.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.008+0000 7efc24475700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c1a34c0 con 0x7efc1c0fe500 2024-09-13T21:39:30.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.009+0000 7efc21a10700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fee50 0x7efc1c072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:30.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.009+0000 7efc21a10700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fee50 0x7efc1c072340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43974/0 (socket says 172.21.15.88:43974) 2024-09-13T21:39:30.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.009+0000 7efc21a10700 1 -- 172.21.15.88:0/2734684602 learned_addr learned my addr 172.21.15.88:0/2734684602 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:39:30.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.009+0000 7efc22211700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc1c0fe500 0x7efc1c071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:30.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.009+0000 7efc21a10700 1 -- 172.21.15.88:0/2734684602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc1c0fe500 msgr2=0x7efc1c071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:30.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.009+0000 7efc21a10700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc1c0fe500 0x7efc1c071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:30.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.009+0000 7efc21a10700 1 -- 172.21.15.88:0/2734684602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180095f0 con 0x7efc1c0fee50 2024-09-13T21:39:30.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.009+0000 7efc21a10700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fee50 0x7efc1c072340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00e8c0 tx=0x7efc0c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:30.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.010+0000 7efc137fe700 1 -- 172.21.15.88:0/2734684602 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0c00c9b0 con 0x7efc1c0fee50 2024-09-13T21:39:30.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.010+0000 7efc137fe700 1 -- 172.21.15.88:0/2734684602 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efc0c010430 con 0x7efc1c0fee50 2024-09-13T21:39:30.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.010+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c0ff780 con 0x7efc1c0fee50 2024-09-13T21:39:30.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.010+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c0ffcd0 con 0x7efc1c0fee50 2024-09-13T21:39:30.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.011+0000 7efc137fe700 1 -- 172.21.15.88:0/2734684602 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0c018650 con 0x7efc1c0fee50 2024-09-13T21:39:30.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.012+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c04f2a0 con 0x7efc1c0fee50 2024-09-13T21:39:30.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.013+0000 7efc137fe700 1 -- 172.21.15.88:0/2734684602 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efc0c00cb10 con 0x7efc1c0fee50 2024-09-13T21:39:30.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.014+0000 7efc137fe700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7efc0806c590 0x7efc0806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:30.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.014+0000 7efc137fe700 1 -- 172.21.15.88:0/2734684602 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7efc0c014070 con 0x7efc1c0fee50 2024-09-13T21:39:30.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.014+0000 7efc22211700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7efc0806c590 0x7efc0806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:30.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.015+0000 7efc22211700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7efc0806c590 0x7efc0806ea40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc1800b6f0 tx=0x7efc18005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:30.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.021+0000 7efc137fe700 1 -- 172.21.15.88:0/2734684602 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efc0c05a240 con 0x7efc1c0fee50 2024-09-13T21:39:30.413 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:30 smithi088 ceph-mon[27963]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:30.414 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:30 smithi088 ceph-mon[27963]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi116 2024-09-13T21:39:30.414 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:30 smithi088 ceph-mon[27963]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:30.414 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:30 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3197521626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:39:30.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.444+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efc1c105ed0 con 0x7efc0806c590 2024-09-13T21:39:30.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.445+0000 7efc137fe700 1 -- 172.21.15.88:0/2734684602 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7efc1c105ed0 con 0x7efc0806c590 2024-09-13T21:39:30.447 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:39:30.447 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:39:30.447 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:39:30.447 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T21:39:30.447 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-13T21:39:30.448 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "0/2 daemons upgraded", 2024-09-13T21:39:30.448 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 image on host smithi116", 2024-09-13T21:39:30.448 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:39:30.448 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:39:30.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.448+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7efc0806c590 msgr2=0x7efc0806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:30.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.448+0000 7efc24475700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7efc0806c590 0x7efc0806ea40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc1800b6f0 tx=0x7efc18005a90 comp rx=0 tx=0).stop 2024-09-13T21:39:30.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.448+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fee50 msgr2=0x7efc1c072340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:30.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.448+0000 7efc24475700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fee50 0x7efc1c072340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00e8c0 tx=0x7efc0c00ebd0 comp rx=0 tx=0).stop 2024-09-13T21:39:30.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.448+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 shutdown_connections 2024-09-13T21:39:30.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.448+0000 7efc24475700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7efc0806c590 0x7efc0806ea40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:30.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.448+0000 7efc24475700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc1c0fe500 0x7efc1c071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:30.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.448+0000 7efc24475700 1 --2- 172.21.15.88:0/2734684602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc1c0fee50 0x7efc1c072340 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:30.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.448+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 >> 172.21.15.88:0/2734684602 conn(0x7efc1c0f9f10 msgr2=0x7efc1c1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:30.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.449+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 shutdown_connections 2024-09-13T21:39:30.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:39:30.449+0000 7efc24475700 1 -- 172.21.15.88:0/2734684602 wait complete. 2024-09-13T21:39:30.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:30 smithi116 ceph-mon[33391]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:30.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:30 smithi116 ceph-mon[33391]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi116 2024-09-13T21:39:30.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:30 smithi116 ceph-mon[33391]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:30.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:30 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3197521626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:39:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:31 smithi088 ceph-mon[27963]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T21:39:31.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:31 smithi088 ceph-mon[27963]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:31.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:31 smithi116 ceph-mon[33391]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T21:39:31.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:31 smithi116 ceph-mon[33391]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:33.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:33 smithi088 ceph-mon[27963]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:39:33.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:33 smithi116 ceph-mon[33391]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:39:35.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:35 smithi088 ceph-mon[27963]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:39:35.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:35 smithi116 ceph-mon[33391]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:39:37.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:36 smithi088 ceph-mon[27963]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:39:37.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:36 smithi116 ceph-mon[33391]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:39:39.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:39 smithi088 ceph-mon[27963]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:39.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:39 smithi116 ceph-mon[33391]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:40.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:40.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:41.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:41 smithi088 ceph-mon[27963]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:41 smithi116 ceph-mon[33391]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:43.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:43 smithi088 ceph-mon[27963]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:43 smithi116 ceph-mon[33391]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:43.603 INFO:tasks.workunit.client.1.smithi116.stderr:Updating files: 95% (12254/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-13T21:39:44.412 INFO:tasks.workunit.client.1.smithi116.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T21:39:44.412 INFO:tasks.workunit.client.1.smithi116.stderr: 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr: 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr: 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr: git switch -c 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr: 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr:Or undo this operation with: 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr: 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr: git switch - 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr: 2024-09-13T21:39:44.413 INFO:tasks.workunit.client.1.smithi116.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T21:39:44.414 INFO:tasks.workunit.client.1.smithi116.stderr: 2024-09-13T21:39:44.414 INFO:tasks.workunit.client.1.smithi116.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T21:39:44.418 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T21:39:44.479 INFO:tasks.workunit.client.1.smithi116.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T21:39:44.482 INFO:tasks.workunit.client.1.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T21:39:44.482 INFO:tasks.workunit.client.1.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T21:39:45.153 INFO:tasks.workunit.client.1.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T21:39:45.224 INFO:tasks.workunit.client.1.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T21:39:45.264 INFO:tasks.workunit.client.1.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T21:39:45.265 INFO:tasks.workunit.client.1.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T21:39:45.266 INFO:tasks.workunit.client.1.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T21:39:45.305 INFO:tasks.workunit.client.1.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T21:39:45.309 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:39:45.309 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T21:39:45.365 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T21:39:45.367 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T21:39:45.367 DEBUG:teuthology.orchestra.run.smithi116:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T21:39:45.424 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T21:39:45.424 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T21:39:45.424 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T21:39:45.424 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T21:39:45.424 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T21:39:45.424 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T21:39:45.424 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T21:39:45.424 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T21:39:45.425 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T21:39:45.428 INFO:tasks.workunit.client.1.smithi116.stderr:+ mkdir -p fsstress 2024-09-13T21:39:45.429 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T21:39:45.430 INFO:tasks.workunit.client.1.smithi116.stderr:+ pushd fsstress 2024-09-13T21:39:45.430 INFO:tasks.workunit.client.1.smithi116.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T21:39:45.430 INFO:tasks.workunit.client.1.smithi116.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T21:39:45.458 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T21:39:45.461 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T21:39:45.461 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T21:39:45.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:45 smithi088 ceph-mon[27963]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:45 smithi116 ceph-mon[33391]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:45.964 INFO:tasks.workunit.client.1.smithi116.stderr:+ tar xzf ltp-full.tgz 2024-09-13T21:39:46.066 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T21:39:46.141 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T21:39:46.181 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T21:39:46.182 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T21:39:46.183 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T21:39:46.227 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T21:39:46.230 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:39:46.230 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T21:39:46.246 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T21:39:46.247 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T21:39:46.247 DEBUG:teuthology.orchestra.run.smithi088:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T21:39:46.308 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir -p fsstress 2024-09-13T21:39:46.310 INFO:tasks.workunit.client.0.smithi088.stderr:+ pushd fsstress 2024-09-13T21:39:46.311 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T21:39:46.311 INFO:tasks.workunit.client.0.smithi088.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T21:39:46.818 INFO:tasks.workunit.client.0.smithi088.stderr:+ tar xzf ltp-full.tgz 2024-09-13T21:39:47.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:46 smithi088 ceph-mon[27963]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:46 smithi116 ceph-mon[33391]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:49.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:49 smithi088 ceph-mon[27963]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:49 smithi116 ceph-mon[33391]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:39:51.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:51 smithi088 ceph-mon[27963]: pgmap v235: 65 pgs: 65 active+clean; 9.8 MiB data, 179 MiB used, 536 GiB / 536 GiB avail; 796 KiB/s wr, 1 op/s 2024-09-13T21:39:51.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:51 smithi116 ceph-mon[33391]: pgmap v235: 65 pgs: 65 active+clean; 9.8 MiB data, 179 MiB used, 536 GiB / 536 GiB avail; 796 KiB/s wr, 1 op/s 2024-09-13T21:39:53.420 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:53 smithi116 ceph-mon[33391]: pgmap v236: 65 pgs: 65 active+clean; 11 MiB data, 194 MiB used, 536 GiB / 536 GiB avail; 964 KiB/s wr, 42 op/s 2024-09-13T21:39:53.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:53 smithi088 ceph-mon[27963]: pgmap v236: 65 pgs: 65 active+clean; 11 MiB data, 194 MiB used, 536 GiB / 536 GiB avail; 964 KiB/s wr, 42 op/s 2024-09-13T21:39:54.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:54 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:39:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:54 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:39:55.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:55 smithi088 ceph-mon[27963]: pgmap v237: 65 pgs: 65 active+clean; 23 MiB data, 225 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s wr, 122 op/s 2024-09-13T21:39:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:55 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:55 smithi116 ceph-mon[33391]: pgmap v237: 65 pgs: 65 active+clean; 23 MiB data, 225 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s wr, 122 op/s 2024-09-13T21:39:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:55 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:57.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:56 smithi088 ceph-mon[27963]: pgmap v238: 65 pgs: 65 active+clean; 55 MiB data, 321 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s wr, 297 op/s 2024-09-13T21:39:57.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:56 smithi116 ceph-mon[33391]: pgmap v238: 65 pgs: 65 active+clean; 55 MiB data, 321 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s wr, 297 op/s 2024-09-13T21:39:59.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:39:59 smithi088 ceph-mon[27963]: pgmap v239: 65 pgs: 65 active+clean; 61 MiB data, 362 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s wr, 331 op/s 2024-09-13T21:39:59.530 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:39:59 smithi116 ceph-mon[33391]: pgmap v239: 65 pgs: 65 active+clean; 61 MiB data, 362 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s wr, 331 op/s 2024-09-13T21:40:00.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:00 smithi116 ceph-mon[33391]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:40:00.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:00 smithi116 ceph-mon[33391]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:40:00.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:00 smithi116 ceph-mon[33391]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:40:00.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:00 smithi088 ceph-mon[27963]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:40:00.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:00 smithi088 ceph-mon[27963]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:40:00.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:00 smithi088 ceph-mon[27963]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:40:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.572+0000 7f548d635700 1 -- 172.21.15.88:0/2348711815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5488100250 msgr2=0x7f5488100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.572+0000 7f548d635700 1 --2- 172.21.15.88:0/2348711815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5488100250 0x7f5488100660 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5478009910 tx=0x7f5478009c20 comp rx=0 tx=0).stop 2024-09-13T21:40:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.573+0000 7f548d635700 1 -- 172.21.15.88:0/2348711815 shutdown_connections 2024-09-13T21:40:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.573+0000 7f548d635700 1 --2- 172.21.15.88:0/2348711815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5488101450 0x7f54881018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.573+0000 7f548d635700 1 --2- 172.21.15.88:0/2348711815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5488100250 0x7f5488100660 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.573+0000 7f548d635700 1 -- 172.21.15.88:0/2348711815 >> 172.21.15.88:0/2348711815 conn(0x7f54880fb7e0 msgr2=0x7f54880fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.573+0000 7f548d635700 1 -- 172.21.15.88:0/2348711815 shutdown_connections 2024-09-13T21:40:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.573+0000 7f548d635700 1 -- 172.21.15.88:0/2348711815 wait complete. 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f548d635700 1 Processor -- start 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f548d635700 1 -- start start 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f548d635700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5488100250 0x7f5488197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f548d635700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5488101450 0x7f5488198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f548d635700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5488198850 con 0x7f5488101450 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f548d635700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548819d260 con 0x7f5488100250 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f5486ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5488100250 0x7f5488197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f54867fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5488101450 0x7f5488198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f5486ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5488100250 0x7f5488197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:49640/0 (socket says 172.21.15.88:49640) 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.574+0000 7f5486ffd700 1 -- 172.21.15.88:0/2539881199 learned_addr learned my addr 172.21.15.88:0/2539881199 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.575+0000 7f5486ffd700 1 -- 172.21.15.88:0/2539881199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5488101450 msgr2=0x7f5488198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.575+0000 7f5486ffd700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5488101450 0x7f5488198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.575+0000 7f5486ffd700 1 -- 172.21.15.88:0/2539881199 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54780095f0 con 0x7f5488100250 2024-09-13T21:40:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.575+0000 7f5486ffd700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5488100250 0x7f5488197cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f547800fa00 tx=0x7f547800fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.575+0000 7f546ffff700 1 -- 172.21.15.88:0/2539881199 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f547801d070 con 0x7f5488100250 2024-09-13T21:40:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.575+0000 7f546ffff700 1 -- 172.21.15.88:0/2539881199 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f547800fe90 con 0x7f5488100250 2024-09-13T21:40:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.575+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548819d400 con 0x7f5488100250 2024-09-13T21:40:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.575+0000 7f546ffff700 1 -- 172.21.15.88:0/2539881199 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5478017630 con 0x7f5488100250 2024-09-13T21:40:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.575+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548819d8c0 con 0x7f5488100250 2024-09-13T21:40:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.576+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5488105530 con 0x7f5488100250 2024-09-13T21:40:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.577+0000 7f546ffff700 1 -- 172.21.15.88:0/2539881199 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5478003680 con 0x7f5488100250 2024-09-13T21:40:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.578+0000 7f546ffff700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f547006c680 0x7f547006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.578+0000 7f546ffff700 1 -- 172.21.15.88:0/2539881199 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f547808cb30 con 0x7f5488100250 2024-09-13T21:40:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.578+0000 7f54867fc700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f547006c680 0x7f547006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.578+0000 7f54867fc700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f547006c680 0x7f547006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f547c009c60 tx=0x7f547c009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:00.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.582+0000 7f546ffff700 1 -- 172.21.15.88:0/2539881199 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f54780572e0 con 0x7f5488100250 2024-09-13T21:40:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.816+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5488061190 con 0x7f547006c680 2024-09-13T21:40:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.817+0000 7f546ffff700 1 -- 172.21.15.88:0/2539881199 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f5488061190 con 0x7f547006c680 2024-09-13T21:40:00.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f547006c680 msgr2=0x7f547006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:00.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f547006c680 0x7f547006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f547c009c60 tx=0x7f547c009260 comp rx=0 tx=0).stop 2024-09-13T21:40:00.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5488100250 msgr2=0x7f5488197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:00.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5488100250 0x7f5488197cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f547800fa00 tx=0x7f547800fa30 comp rx=0 tx=0).stop 2024-09-13T21:40:00.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 shutdown_connections 2024-09-13T21:40:00.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f547006c680 0x7f547006eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:00.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5488100250 0x7f5488197cf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:00.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 --2- 172.21.15.88:0/2539881199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5488101450 0x7f5488198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:00.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 >> 172.21.15.88:0/2539881199 conn(0x7f54880fb7e0 msgr2=0x7f5488102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:00.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 shutdown_connections 2024-09-13T21:40:00.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.820+0000 7f548d635700 1 -- 172.21.15.88:0/2539881199 wait complete. 2024-09-13T21:40:00.835 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:40:00.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.953+0000 7fb321ad6700 1 -- 172.21.15.88:0/2779511707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb31c0ff130 msgr2=0x7fb31c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:00.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.953+0000 7fb321ad6700 1 --2- 172.21.15.88:0/2779511707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb31c0ff130 0x7fb31c0ff540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009910 tx=0x7fb30c009c20 comp rx=0 tx=0).stop 2024-09-13T21:40:00.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.953+0000 7fb321ad6700 1 -- 172.21.15.88:0/2779511707 shutdown_connections 2024-09-13T21:40:00.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.953+0000 7fb321ad6700 1 --2- 172.21.15.88:0/2779511707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb31c1003d0 0x7fb31c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.953+0000 7fb321ad6700 1 --2- 172.21.15.88:0/2779511707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb31c0ff130 0x7fb31c0ff540 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.953+0000 7fb321ad6700 1 -- 172.21.15.88:0/2779511707 >> 172.21.15.88:0/2779511707 conn(0x7fb31c0fa780 msgr2=0x7fb31c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.953+0000 7fb321ad6700 1 -- 172.21.15.88:0/2779511707 shutdown_connections 2024-09-13T21:40:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.953+0000 7fb321ad6700 1 -- 172.21.15.88:0/2779511707 wait complete. 2024-09-13T21:40:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.954+0000 7fb321ad6700 1 Processor -- start 2024-09-13T21:40:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.954+0000 7fb321ad6700 1 -- start start 2024-09-13T21:40:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.954+0000 7fb321ad6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb31c0ff130 0x7fb31c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.954+0000 7fb321ad6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb31c1003d0 0x7fb31c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.954+0000 7fb321ad6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c196680 con 0x7fb31c0ff130 2024-09-13T21:40:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.954+0000 7fb321ad6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c19d150 con 0x7fb31c1003d0 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb31b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb31c0ff130 0x7fb31c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb31b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb31c0ff130 0x7fb31c0690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51426/0 (socket says 172.21.15.88:51426) 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb31b7fe700 1 -- 172.21.15.88:0/3506267693 learned_addr learned my addr 172.21.15.88:0/3506267693 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb313fff700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb31c1003d0 0x7fb31c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb31b7fe700 1 -- 172.21.15.88:0/3506267693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb31c1003d0 msgr2=0x7fb31c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb31b7fe700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb31c1003d0 0x7fb31c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb31b7fe700 1 -- 172.21.15.88:0/3506267693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304009520 con 0x7fb31c0ff130 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb313fff700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb31c1003d0 0x7fb31c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb31b7fe700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb31c0ff130 0x7fb31c0690a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00f690 tx=0x7fb30c00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb3197fa700 1 -- 172.21.15.88:0/3506267693 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb30c01d070 con 0x7fb31c0ff130 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c0095f0 con 0x7fb31c0ff130 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb3197fa700 1 -- 172.21.15.88:0/3506267693 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb30c005dc0 con 0x7fb31c0ff130 2024-09-13T21:40:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb3197fa700 1 -- 172.21.15.88:0/3506267693 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb30c021640 con 0x7fb31c0ff130 2024-09-13T21:40:00.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.955+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c19d6a0 con 0x7fb31c0ff130 2024-09-13T21:40:00.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.957+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c107c10 con 0x7fb31c0ff130 2024-09-13T21:40:00.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.957+0000 7fb3197fa700 1 -- 172.21.15.88:0/3506267693 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb30c003680 con 0x7fb31c0ff130 2024-09-13T21:40:00.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.958+0000 7fb3197fa700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb30806c680 0x7fb30806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:00.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.958+0000 7fb3197fa700 1 -- 172.21.15.88:0/3506267693 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb30c08c9f0 con 0x7fb31c0ff130 2024-09-13T21:40:00.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.958+0000 7fb313fff700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb30806c680 0x7fb30806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:00.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.958+0000 7fb313fff700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb30806c680 0x7fb30806eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb304009fd0 tx=0x7fb304009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:00.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:00.963+0000 7fb3197fa700 1 -- 172.21.15.88:0/3506267693 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb30c08ee60 con 0x7fb31c0ff130 2024-09-13T21:40:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.224+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb31c104d20 con 0x7fb30806c680 2024-09-13T21:40:01.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.225+0000 7fb3197fa700 1 -- 172.21.15.88:0/3506267693 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fb31c104d20 con 0x7fb30806c680 2024-09-13T21:40:01.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb30806c680 msgr2=0x7fb30806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb30806c680 0x7fb30806eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb304009fd0 tx=0x7fb304009260 comp rx=0 tx=0).stop 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb31c0ff130 msgr2=0x7fb31c0690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb31c0ff130 0x7fb31c0690a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00f690 tx=0x7fb30c00f6c0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 shutdown_connections 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fb30806c680 0x7fb30806eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb31c0ff130 0x7fb31c0690a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 --2- 172.21.15.88:0/3506267693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb31c1003d0 0x7fb31c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 >> 172.21.15.88:0/3506267693 conn(0x7fb31c0fa780 msgr2=0x7fb31c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 shutdown_connections 2024-09-13T21:40:01.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.228+0000 7fb321ad6700 1 -- 172.21.15.88:0/3506267693 wait complete. 2024-09-13T21:40:01.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.342+0000 7f0444a71700 1 -- 172.21.15.88:0/733736431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0440101440 msgr2=0x7f0440101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:01.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.342+0000 7f0444a71700 1 --2- 172.21.15.88:0/733736431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0440101440 0x7f0440101890 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0434009910 tx=0x7f0434009c20 comp rx=0 tx=0).stop 2024-09-13T21:40:01.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.342+0000 7f0444a71700 1 -- 172.21.15.88:0/733736431 shutdown_connections 2024-09-13T21:40:01.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.342+0000 7f0444a71700 1 --2- 172.21.15.88:0/733736431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0440101440 0x7f0440101890 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.342+0000 7f0444a71700 1 --2- 172.21.15.88:0/733736431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0440100240 0x7f0440100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.342+0000 7f0444a71700 1 -- 172.21.15.88:0/733736431 >> 172.21.15.88:0/733736431 conn(0x7f04400fb7f0 msgr2=0x7f04400fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:01.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.342+0000 7f0444a71700 1 -- 172.21.15.88:0/733736431 shutdown_connections 2024-09-13T21:40:01.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.342+0000 7f0444a71700 1 -- 172.21.15.88:0/733736431 wait complete. 2024-09-13T21:40:01.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.343+0000 7f0444a71700 1 Processor -- start 2024-09-13T21:40:01.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.343+0000 7f0444a71700 1 -- start start 2024-09-13T21:40:01.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.343+0000 7f0444a71700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0440100240 0x7f0440195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:01.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f0444a71700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0440101440 0x7f0440195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:01.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f0444a71700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0440196610 con 0x7f0440100240 2024-09-13T21:40:01.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f0444a71700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0440196750 con 0x7f0440101440 2024-09-13T21:40:01.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f043e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0440100240 0x7f0440195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:01.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f043dd9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0440101440 0x7f0440195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:01.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f043dd9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0440101440 0x7f0440195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:49686/0 (socket says 172.21.15.88:49686) 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f043dd9b700 1 -- 172.21.15.88:0/2185942791 learned_addr learned my addr 172.21.15.88:0/2185942791 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f043e59c700 1 -- 172.21.15.88:0/2185942791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0440101440 msgr2=0x7f0440195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f043e59c700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0440101440 0x7f0440195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f043e59c700 1 -- 172.21.15.88:0/2185942791 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340095f0 con 0x7f0440100240 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f043dd9b700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0440101440 0x7f0440195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.344+0000 7f043e59c700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0440100240 0x7f0440195ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f043000e940 tx=0x7f043000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.345+0000 7f042f7fe700 1 -- 172.21.15.88:0/2185942791 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04300041f0 con 0x7f0440100240 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.345+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0440072fe0 con 0x7f0440100240 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.345+0000 7f042f7fe700 1 -- 172.21.15.88:0/2185942791 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0430004350 con 0x7f0440100240 2024-09-13T21:40:01.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.345+0000 7f042f7fe700 1 -- 172.21.15.88:0/2185942791 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0430003c80 con 0x7f0440100240 2024-09-13T21:40:01.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.345+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0440073530 con 0x7f0440100240 2024-09-13T21:40:01.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.346+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0440108d90 con 0x7f0440100240 2024-09-13T21:40:01.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.346+0000 7f042f7fe700 1 -- 172.21.15.88:0/2185942791 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f043000c7c0 con 0x7f0440100240 2024-09-13T21:40:01.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.347+0000 7f042f7fe700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f042806c680 0x7f042806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.347+0000 7f042f7fe700 1 -- 172.21.15.88:0/2185942791 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0430014070 con 0x7f0440100240 2024-09-13T21:40:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.347+0000 7f043dd9b700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f042806c680 0x7f042806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.347+0000 7f043dd9b700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f042806c680 0x7f042806eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0434009fd0 tx=0x7f0434005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:01.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.353+0000 7f042f7fe700 1 -- 172.21.15.88:0/2185942791 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0430059e70 con 0x7f0440100240 2024-09-13T21:40:01.462 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:01 smithi088 ceph-mon[27963]: pgmap v240: 65 pgs: 65 active+clean; 81 MiB data, 431 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s wr, 337 op/s 2024-09-13T21:40:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:01 smithi116 ceph-mon[33391]: pgmap v240: 65 pgs: 65 active+clean; 81 MiB data, 431 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s wr, 337 op/s 2024-09-13T21:40:01.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.658+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0440105d90 con 0x7f042806c680 2024-09-13T21:40:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.682+0000 7f042f7fe700 1 -- 172.21.15.88:0/2185942791 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f0440105d90 con 0x7f042806c680 2024-09-13T21:40:01.684 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:40:01.684 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (5m) 91s ago 7m 24.7M - 0.25.0 c8568f914cd2 c82eca12b874 2024-09-13T21:40:01.684 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (7m) 91s ago 7m 7419k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:40:01.684 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (6m) 96s ago 6m 7331k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:40:01.684 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (7m) 91s ago 7m 6665k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:40:01.684 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (6m) 96s ago 6m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:40:01.684 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (5m) 91s ago 7m 88.1M - 9.4.7 954c08fa6188 aa2cd07a9c2d 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (109s) 91s ago 108s 17.0M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (116s) 91s ago 115s 11.2M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (106s) 96s ago 106s 13.1M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (113s) 96s ago 112s 18.3M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:9283,8765,8443 running (8m) 91s ago 8m 489M - 18.2.0 dc2bc1663786 9fc04dc2c4a7 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (6m) 96s ago 6m 437M - 18.2.0 dc2bc1663786 3d98303b8a6d 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (8m) 91s ago 8m 45.0M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (6m) 96s ago 6m 34.7M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (7m) 91s ago 7m 15.7M - 1.5.0 0da6a335fe13 71ce2b0df304 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (6m) 96s ago 6m 16.1M - 1.5.0 0da6a335fe13 6d3c62590d98 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (5m) 91s ago 5m 49.6M 3946M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:40:01.685 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (5m) 91s ago 5m 50.6M 3946M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:40:01.686 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (4m) 91s ago 4m 47.0M 3946M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:40:01.686 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (4m) 96s ago 4m 46.5M 4970M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:40:01.686 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (3m) 96s ago 3m 46.5M 4970M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:40:01.686 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (3m) 96s ago 3m 44.4M 4970M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:40:01.686 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (5m) 91s ago 6m 64.3M - 2.43.0 a07b618ecd1d 85cb356d6671 2024-09-13T21:40:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.686+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f042806c680 msgr2=0x7f042806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.686+0000 7f0444a71700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f042806c680 0x7f042806eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0434009fd0 tx=0x7f0434005940 comp rx=0 tx=0).stop 2024-09-13T21:40:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.686+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0440100240 msgr2=0x7f0440195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:01.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.686+0000 7f0444a71700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0440100240 0x7f0440195ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f043000e940 tx=0x7f043000ec50 comp rx=0 tx=0).stop 2024-09-13T21:40:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.686+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 shutdown_connections 2024-09-13T21:40:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.687+0000 7f0444a71700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f042806c680 0x7f042806eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.687+0000 7f0444a71700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0440100240 0x7f0440195ab0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.687+0000 7f0444a71700 1 --2- 172.21.15.88:0/2185942791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0440101440 0x7f0440195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.687+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 >> 172.21.15.88:0/2185942791 conn(0x7f04400fb7f0 msgr2=0x7f0440104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.687+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 shutdown_connections 2024-09-13T21:40:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.687+0000 7f0444a71700 1 -- 172.21.15.88:0/2185942791 wait complete. 2024-09-13T21:40:01.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.888+0000 7f4f2759e700 1 -- 172.21.15.88:0/2502814278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f280fe6a0 msgr2=0x7f4f280feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:01.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.888+0000 7f4f2759e700 1 --2- 172.21.15.88:0/2502814278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f280fe6a0 0x7f4f280feab0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800aa20 tx=0x7f4f1800ad30 comp rx=0 tx=0).stop 2024-09-13T21:40:01.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.890+0000 7f4f2759e700 1 -- 172.21.15.88:0/2502814278 shutdown_connections 2024-09-13T21:40:01.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.890+0000 7f4f2759e700 1 --2- 172.21.15.88:0/2502814278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f280ff8a0 0x7f4f280ffcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.890+0000 7f4f2759e700 1 --2- 172.21.15.88:0/2502814278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f280fe6a0 0x7f4f280feab0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.890+0000 7f4f2759e700 1 -- 172.21.15.88:0/2502814278 >> 172.21.15.88:0/2502814278 conn(0x7f4f280f9c30 msgr2=0x7f4f280fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:01.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.890+0000 7f4f2759e700 1 -- 172.21.15.88:0/2502814278 shutdown_connections 2024-09-13T21:40:01.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.890+0000 7f4f2759e700 1 -- 172.21.15.88:0/2502814278 wait complete. 2024-09-13T21:40:01.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.891+0000 7f4f2759e700 1 Processor -- start 2024-09-13T21:40:01.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.893+0000 7f4f2759e700 1 -- start start 2024-09-13T21:40:01.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.893+0000 7f4f2759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f280fe6a0 0x7f4f2819be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:01.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.893+0000 7f4f2759e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f280ff8a0 0x7f4f2819c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:01.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.893+0000 7f4f2759e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2819c9f0 con 0x7f4f280fe6a0 2024-09-13T21:40:01.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.893+0000 7f4f2759e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2819cb30 con 0x7f4f280ff8a0 2024-09-13T21:40:01.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.895+0000 7f4f2659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f280fe6a0 0x7f4f2819be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:01.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.895+0000 7f4f2659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f280fe6a0 0x7f4f2819be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51468/0 (socket says 172.21.15.88:51468) 2024-09-13T21:40:01.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.895+0000 7f4f2659c700 1 -- 172.21.15.88:0/3984131056 learned_addr learned my addr 172.21.15.88:0/3984131056 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:01.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.896+0000 7f4f25d9b700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f280ff8a0 0x7f4f2819c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:01.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.896+0000 7f4f2659c700 1 -- 172.21.15.88:0/3984131056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f280ff8a0 msgr2=0x7f4f2819c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:01.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.896+0000 7f4f2659c700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f280ff8a0 0x7f4f2819c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:01.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.896+0000 7f4f2659c700 1 -- 172.21.15.88:0/3984131056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1800a700 con 0x7f4f280fe6a0 2024-09-13T21:40:01.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.899+0000 7f4f2659c700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f280fe6a0 0x7f4f2819be90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4f18006010 tx=0x7f4f1800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:01.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.900+0000 7f4f177fe700 1 -- 172.21.15.88:0/3984131056 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f1800caf0 con 0x7f4f280fe6a0 2024-09-13T21:40:01.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.900+0000 7f4f177fe700 1 -- 172.21.15.88:0/3984131056 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f1800cc50 con 0x7f4f280fe6a0 2024-09-13T21:40:01.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.900+0000 7f4f177fe700 1 -- 172.21.15.88:0/3984131056 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f18016860 con 0x7f4f280fe6a0 2024-09-13T21:40:01.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.901+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f281a1580 con 0x7f4f280fe6a0 2024-09-13T21:40:01.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.901+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f281a1af0 con 0x7f4f280fe6a0 2024-09-13T21:40:01.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.903+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2810f170 con 0x7f4f280fe6a0 2024-09-13T21:40:01.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.903+0000 7f4f177fe700 1 -- 172.21.15.88:0/3984131056 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4f18003680 con 0x7f4f280fe6a0 2024-09-13T21:40:01.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.903+0000 7f4f177fe700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4f1006c720 0x7f4f1006ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:01.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.903+0000 7f4f177fe700 1 -- 172.21.15.88:0/3984131056 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4f18012070 con 0x7f4f280fe6a0 2024-09-13T21:40:01.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.904+0000 7f4f25d9b700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4f1006c720 0x7f4f1006ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:01.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.904+0000 7f4f25d9b700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4f1006c720 0x7f4f1006ebd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005950 tx=0x7f4f1c00b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:01.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:01.912+0000 7f4f177fe700 1 -- 172.21.15.88:0/3984131056 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4f1805b8a0 con 0x7f4f280fe6a0 2024-09-13T21:40:02.467 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:02 smithi088 ceph-mon[27963]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:02.467 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:02 smithi088 ceph-mon[27963]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.465+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f281a24d0 con 0x7f4f280fe6a0 2024-09-13T21:40:02.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.467+0000 7f4f177fe700 1 -- 172.21.15.88:0/3984131056 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f4f1805b430 con 0x7f4f280fe6a0 2024-09-13T21:40:02.468 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:40:02.468 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:40:02.468 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-13T21:40:02.469 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:40:02.470 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:40:02.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.471+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4f1006c720 msgr2=0x7f4f1006ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:02.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.471+0000 7f4f2759e700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4f1006c720 0x7f4f1006ebd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005950 tx=0x7f4f1c00b410 comp rx=0 tx=0).stop 2024-09-13T21:40:02.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.471+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f280fe6a0 msgr2=0x7f4f2819be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:02.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.471+0000 7f4f2759e700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f280fe6a0 0x7f4f2819be90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4f18006010 tx=0x7f4f1800fce0 comp rx=0 tx=0).stop 2024-09-13T21:40:02.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.474+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 shutdown_connections 2024-09-13T21:40:02.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.474+0000 7f4f2759e700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4f1006c720 0x7f4f1006ebd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:02.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.474+0000 7f4f2759e700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f280fe6a0 0x7f4f2819be90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:02.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.474+0000 7f4f2759e700 1 --2- 172.21.15.88:0/3984131056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f280ff8a0 0x7f4f2819c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:02.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.474+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 >> 172.21.15.88:0/3984131056 conn(0x7f4f280f9c30 msgr2=0x7f4f28102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.475+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 shutdown_connections 2024-09-13T21:40:02.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.477+0000 7f4f2759e700 1 -- 172.21.15.88:0/3984131056 wait complete. 2024-09-13T21:40:02.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:02 smithi116 ceph-mon[33391]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:02.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:02 smithi116 ceph-mon[33391]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.678+0000 7f470f9ee700 1 -- 172.21.15.88:0/3771663861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4708074d80 msgr2=0x7f47080731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:02.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.678+0000 7f470f9ee700 1 --2- 172.21.15.88:0/3771663861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4708074d80 0x7f47080731e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4700009fc0 tx=0x7f470001c340 comp rx=0 tx=0).stop 2024-09-13T21:40:02.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.681+0000 7f470f9ee700 1 -- 172.21.15.88:0/3771663861 shutdown_connections 2024-09-13T21:40:02.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.681+0000 7f470f9ee700 1 --2- 172.21.15.88:0/3771663861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47080737b0 0x7f4708073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:02.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.681+0000 7f470f9ee700 1 --2- 172.21.15.88:0/3771663861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4708074d80 0x7f47080731e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:02.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.681+0000 7f470f9ee700 1 -- 172.21.15.88:0/3771663861 >> 172.21.15.88:0/3771663861 conn(0x7f47080fb600 msgr2=0x7f47080fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:02.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.681+0000 7f470f9ee700 1 -- 172.21.15.88:0/3771663861 shutdown_connections 2024-09-13T21:40:02.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.681+0000 7f470f9ee700 1 -- 172.21.15.88:0/3771663861 wait complete. 2024-09-13T21:40:02.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.682+0000 7f470f9ee700 1 Processor -- start 2024-09-13T21:40:02.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.682+0000 7f470f9ee700 1 -- start start 2024-09-13T21:40:02.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.683+0000 7f470f9ee700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47080737b0 0x7f47081937c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:02.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.683+0000 7f470f9ee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4708074d80 0x7f4708193d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:02.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.683+0000 7f470f9ee700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4708194320 con 0x7f4708074d80 2024-09-13T21:40:02.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.683+0000 7f470f9ee700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4708194460 con 0x7f47080737b0 2024-09-13T21:40:02.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.684+0000 7f470d78a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47080737b0 0x7f47081937c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:02.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.684+0000 7f470d78a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47080737b0 0x7f47081937c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:49710/0 (socket says 172.21.15.88:49710) 2024-09-13T21:40:02.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.684+0000 7f470d78a700 1 -- 172.21.15.88:0/1745008418 learned_addr learned my addr 172.21.15.88:0/1745008418 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:02.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.684+0000 7f470d78a700 1 -- 172.21.15.88:0/1745008418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4708074d80 msgr2=0x7f4708193d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:02.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.684+0000 7f470d78a700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4708074d80 0x7f4708193d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:02.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.684+0000 7f470d78a700 1 -- 172.21.15.88:0/1745008418 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700009d00 con 0x7f47080737b0 2024-09-13T21:40:02.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.685+0000 7f470d78a700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47080737b0 0x7f47081937c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4700026040 tx=0x7f4700008fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:02.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.686+0000 7f46fe7fc700 1 -- 172.21.15.88:0/1745008418 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4700003a00 con 0x7f47080737b0 2024-09-13T21:40:02.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.686+0000 7f46fe7fc700 1 -- 172.21.15.88:0/1745008418 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4700003b60 con 0x7f47080737b0 2024-09-13T21:40:02.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.686+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4708198eb0 con 0x7f47080737b0 2024-09-13T21:40:02.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.687+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4708199420 con 0x7f47080737b0 2024-09-13T21:40:02.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.687+0000 7f46fe7fc700 1 -- 172.21.15.88:0/1745008418 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f470002f680 con 0x7f47080737b0 2024-09-13T21:40:02.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.690+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4708106840 con 0x7f47080737b0 2024-09-13T21:40:02.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.692+0000 7f46fe7fc700 1 -- 172.21.15.88:0/1745008418 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4700004040 con 0x7f47080737b0 2024-09-13T21:40:02.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.692+0000 7f46fe7fc700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f46f406c7f0 0x7f46f406eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:02.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.693+0000 7f46fe7fc700 1 -- 172.21.15.88:0/1745008418 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f470009e2c0 con 0x7f47080737b0 2024-09-13T21:40:02.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.694+0000 7f470cf89700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f46f406c7f0 0x7f46f406eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:02.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.701+0000 7f46fe7fc700 1 -- 172.21.15.88:0/1745008418 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f470006c4e0 con 0x7f47080737b0 2024-09-13T21:40:02.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:02.704+0000 7f470cf89700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f46f406c7f0 0x7f46f406eca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009770 tx=0x7f46f8006cd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:03.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.148+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4708199b20 con 0x7f46f406c7f0 2024-09-13T21:40:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.153+0000 7f46fe7fc700 1 -- 172.21.15.88:0/1745008418 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f4708199b20 con 0x7f46f406c7f0 2024-09-13T21:40:03.155 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:40:03.156 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:40:03.156 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:40:03.156 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T21:40:03.156 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-13T21:40:03.156 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "0/2 daemons upgraded", 2024-09-13T21:40:03.156 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 image on host smithi116", 2024-09-13T21:40:03.156 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:40:03.156 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:40:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.159+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f46f406c7f0 msgr2=0x7f46f406eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.159+0000 7f470f9ee700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f46f406c7f0 0x7f46f406eca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009770 tx=0x7f46f8006cd0 comp rx=0 tx=0).stop 2024-09-13T21:40:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.159+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47080737b0 msgr2=0x7f47081937c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.159+0000 7f470f9ee700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47080737b0 0x7f47081937c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4700026040 tx=0x7f4700008fc0 comp rx=0 tx=0).stop 2024-09-13T21:40:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.160+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 shutdown_connections 2024-09-13T21:40:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.160+0000 7f470f9ee700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f46f406c7f0 0x7f46f406eca0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.160+0000 7f470f9ee700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47080737b0 0x7f47081937c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.160+0000 7f470f9ee700 1 --2- 172.21.15.88:0/1745008418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4708074d80 0x7f4708193d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:03.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.160+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 >> 172.21.15.88:0/1745008418 conn(0x7f47080fb600 msgr2=0x7f4708101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:03.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.162+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 shutdown_connections 2024-09-13T21:40:03.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:03.162+0000 7f470f9ee700 1 -- 172.21.15.88:0/1745008418 wait complete. 2024-09-13T21:40:03.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:03 smithi088 ceph-mon[27963]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:03.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:03 smithi088 ceph-mon[27963]: pgmap v241: 65 pgs: 65 active+clean; 85 MiB data, 443 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s wr, 337 op/s 2024-09-13T21:40:03.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:03 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3984131056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:40:03.545 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:03 smithi116 ceph-mon[33391]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:03.546 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:03 smithi116 ceph-mon[33391]: pgmap v241: 65 pgs: 65 active+clean; 85 MiB data, 443 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s wr, 337 op/s 2024-09-13T21:40:03.546 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:03 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3984131056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:40:04.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:04 smithi088 ceph-mon[27963]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:04.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:04 smithi088 ceph-mon[27963]: Upgrade: Updating mgr.smithi116.bqnvtn 2024-09-13T21:40:04.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:04 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:04.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:04 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:40:04.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:04 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:40:04.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:04 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:04.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:04 smithi088 ceph-mon[27963]: Deploying daemon mgr.smithi116.bqnvtn on smithi116 2024-09-13T21:40:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:04 smithi116 ceph-mon[33391]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:04 smithi116 ceph-mon[33391]: Upgrade: Updating mgr.smithi116.bqnvtn 2024-09-13T21:40:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:04 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:04 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:40:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:04 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:40:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:04 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:04.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:04 smithi116 ceph-mon[33391]: Deploying daemon mgr.smithi116.bqnvtn on smithi116 2024-09-13T21:40:05.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:05 smithi116 ceph-mon[33391]: pgmap v242: 65 pgs: 65 active+clean; 100 MiB data, 481 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s wr, 493 op/s 2024-09-13T21:40:05.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:05 smithi088 ceph-mon[27963]: pgmap v242: 65 pgs: 65 active+clean; 100 MiB data, 481 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s wr, 493 op/s 2024-09-13T21:40:07.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:06 smithi088 ceph-mon[27963]: pgmap v243: 65 pgs: 65 active+clean; 135 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 9.9 MiB/s wr, 844 op/s 2024-09-13T21:40:07.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:06 smithi116 ceph-mon[33391]: pgmap v243: 65 pgs: 65 active+clean; 135 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 9.9 MiB/s wr, 844 op/s 2024-09-13T21:40:09.327 INFO:tasks.workunit.client.1.smithi116.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T21:40:09.328 INFO:tasks.workunit.client.1.smithi116.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T21:40:09.328 INFO:tasks.workunit.client.1.smithi116.stderr:+ make 2024-09-13T21:40:09.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:09 smithi088 ceph-mon[27963]: pgmap v244: 65 pgs: 65 active+clean; 148 MiB data, 734 MiB used, 536 GiB / 536 GiB avail; 8.2 MiB/s wr, 847 op/s 2024-09-13T21:40:09.500 INFO:tasks.workunit.client.1.smithi116.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T21:40:09.523 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:09 smithi116 ceph-mon[33391]: pgmap v244: 65 pgs: 65 active+clean; 148 MiB data, 734 MiB used, 536 GiB / 536 GiB avail; 8.2 MiB/s wr, 847 op/s 2024-09-13T21:40:10.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:10 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:10.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:10 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:11.443 INFO:tasks.workunit.client.1.smithi116.stderr:++ readlink -f fsstress 2024-09-13T21:40:11.444 INFO:tasks.workunit.client.1.smithi116.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T21:40:11.444 INFO:tasks.workunit.client.1.smithi116.stderr:+ popd 2024-09-13T21:40:11.444 INFO:tasks.workunit.client.1.smithi116.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T21:40:11.445 INFO:tasks.workunit.client.1.smithi116.stderr:+ popd 2024-09-13T21:40:11.445 INFO:tasks.workunit.client.1.smithi116.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T21:40:11.445 INFO:tasks.workunit.client.1.smithi116.stderr:++ mktemp -d -p . 2024-09-13T21:40:11.446 INFO:tasks.workunit.client.1.smithi116.stderr:+ T=./tmp.jo7nbdM8n8 2024-09-13T21:40:11.446 INFO:tasks.workunit.client.1.smithi116.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.jo7nbdM8n8 -l 1 -n 1000 -p 10 -v 2024-09-13T21:40:11.447 INFO:tasks.workunit.client.1.smithi116.stdout:seed = 1726112256 2024-09-13T21:40:11.450 INFO:tasks.workunit.client.1.smithi116.stdout:0/0: mknod c0 0 2024-09-13T21:40:11.450 INFO:tasks.workunit.client.1.smithi116.stdout:0/1: dwrite - no filename 2024-09-13T21:40:11.452 INFO:tasks.workunit.client.1.smithi116.stdout:1/0: mknod c0 0 2024-09-13T21:40:11.452 INFO:tasks.workunit.client.1.smithi116.stdout:1/1: fdatasync - no filename 2024-09-13T21:40:11.452 INFO:tasks.workunit.client.1.smithi116.stdout:1/2: truncate - no filename 2024-09-13T21:40:11.452 INFO:tasks.workunit.client.1.smithi116.stdout:1/3: truncate - no filename 2024-09-13T21:40:11.452 INFO:tasks.workunit.client.1.smithi116.stdout:1/4: write - no filename 2024-09-13T21:40:11.452 INFO:tasks.workunit.client.1.smithi116.stdout:1/5: chown c0 9669 1 2024-09-13T21:40:11.452 INFO:tasks.workunit.client.1.smithi116.stdout:1/6: write - no filename 2024-09-13T21:40:11.452 INFO:tasks.workunit.client.1.smithi116.stdout:1/7: dwrite - no filename 2024-09-13T21:40:11.453 INFO:tasks.workunit.client.1.smithi116.stdout:0/2: unlink c0 0 2024-09-13T21:40:11.453 INFO:tasks.workunit.client.1.smithi116.stdout:3/0: dwrite - no filename 2024-09-13T21:40:11.453 INFO:tasks.workunit.client.1.smithi116.stdout:3/1: dread - no filename 2024-09-13T21:40:11.453 INFO:tasks.workunit.client.1.smithi116.stdout:3/2: dread - no filename 2024-09-13T21:40:11.453 INFO:tasks.workunit.client.1.smithi116.stdout:3/3: write - no filename 2024-09-13T21:40:11.453 INFO:tasks.workunit.client.1.smithi116.stdout:3/4: fsync - no filename 2024-09-13T21:40:11.453 INFO:tasks.workunit.client.1.smithi116.stdout:3/5: rename - no filename 2024-09-13T21:40:11.454 INFO:tasks.workunit.client.1.smithi116.stdout:2/0: mkdir d0 0 2024-09-13T21:40:11.454 INFO:tasks.workunit.client.1.smithi116.stdout:2/1: write - no filename 2024-09-13T21:40:11.454 INFO:tasks.workunit.client.1.smithi116.stdout:2/2: write - no filename 2024-09-13T21:40:11.454 INFO:tasks.workunit.client.1.smithi116.stdout:2/3: link - no file 2024-09-13T21:40:11.454 INFO:tasks.workunit.client.1.smithi116.stdout:2/4: chown d0 1637 1 2024-09-13T21:40:11.454 INFO:tasks.workunit.client.1.smithi116.stdout:2/5: link - no file 2024-09-13T21:40:11.455 INFO:tasks.workunit.client.1.smithi116.stdout:1/8: creat f1 x:0 0 0 2024-09-13T21:40:11.455 INFO:tasks.workunit.client.1.smithi116.stdout:1/9: creat f2 x:0 0 0 2024-09-13T21:40:11.455 INFO:tasks.workunit.client.1.smithi116.stdout:1/10: write f2 [109776,24143] 0 2024-09-13T21:40:11.455 INFO:tasks.workunit.client.1.smithi116.stdout:0/3: creat f1 x:0 0 0 2024-09-13T21:40:11.455 INFO:tasks.workunit.client.1.smithi116.stdout:0/4: write f1 [337422,18239] 0 2024-09-13T21:40:11.456 INFO:tasks.workunit.client.1.smithi116.stdout:4/0: read - no filename 2024-09-13T21:40:11.456 INFO:tasks.workunit.client.1.smithi116.stdout:4/1: readlink - no filename 2024-09-13T21:40:11.456 INFO:tasks.workunit.client.1.smithi116.stdout:4/2: getdents . 0 2024-09-13T21:40:11.456 INFO:tasks.workunit.client.1.smithi116.stdout:4/3: fdatasync - no filename 2024-09-13T21:40:11.456 INFO:tasks.workunit.client.1.smithi116.stdout:4/4: unlink - no file 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:4/5: dwrite - no filename 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:4/6: truncate - no filename 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:4/7: rename - no filename 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:4/8: truncate - no filename 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:4/9: fdatasync - no filename 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:4/10: chown . 2412 1 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:3/6: mknod c0 0 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:3/7: dread - no filename 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:3/8: fsync - no filename 2024-09-13T21:40:11.457 INFO:tasks.workunit.client.1.smithi116.stdout:2/6: mknod d0/c1 0 2024-09-13T21:40:11.458 INFO:tasks.workunit.client.1.smithi116.stdout:1/11: link f1 f3 0 2024-09-13T21:40:11.458 INFO:tasks.workunit.client.1.smithi116.stdout:1/12: write f3 [955350,115679] 0 2024-09-13T21:40:11.458 INFO:tasks.workunit.client.1.smithi116.stdout:0/5: mkdir d2 0 2024-09-13T21:40:11.459 INFO:tasks.workunit.client.1.smithi116.stdout:5/0: dwrite - no filename 2024-09-13T21:40:11.459 INFO:tasks.workunit.client.1.smithi116.stdout:5/1: truncate - no filename 2024-09-13T21:40:11.459 INFO:tasks.workunit.client.1.smithi116.stdout:5/2: stat - no entries 2024-09-13T21:40:11.459 INFO:tasks.workunit.client.1.smithi116.stdout:5/3: write - no filename 2024-09-13T21:40:11.459 INFO:tasks.workunit.client.1.smithi116.stdout:5/4: rename - no filename 2024-09-13T21:40:11.460 INFO:tasks.workunit.client.1.smithi116.stdout:4/11: mkdir d0 0 2024-09-13T21:40:11.460 INFO:tasks.workunit.client.1.smithi116.stdout:4/12: link - no file 2024-09-13T21:40:11.460 INFO:tasks.workunit.client.1.smithi116.stdout:4/13: write - no filename 2024-09-13T21:40:11.460 INFO:tasks.workunit.client.1.smithi116.stdout:4/14: fdatasync - no filename 2024-09-13T21:40:11.460 INFO:tasks.workunit.client.1.smithi116.stdout:4/15: dread - no filename 2024-09-13T21:40:11.461 INFO:tasks.workunit.client.1.smithi116.stdout:3/9: mknod c1 0 2024-09-13T21:40:11.461 INFO:tasks.workunit.client.1.smithi116.stdout:3/10: rmdir - no directory 2024-09-13T21:40:11.461 INFO:tasks.workunit.client.1.smithi116.stdout:2/7: rename d0/c1 to d0/c2 0 2024-09-13T21:40:11.461 INFO:tasks.workunit.client.1.smithi116.stdout:2/8: write - no filename 2024-09-13T21:40:11.461 INFO:tasks.workunit.client.1.smithi116.stdout:2/9: chown d0/c2 1 1 2024-09-13T21:40:11.461 INFO:tasks.workunit.client.1.smithi116.stdout:2/10: write - no filename 2024-09-13T21:40:11.462 INFO:tasks.workunit.client.1.smithi116.stdout:1/13: mkdir d4 0 2024-09-13T21:40:11.463 INFO:tasks.workunit.client.1.smithi116.stdout:0/6: mknod d2/c3 0 2024-09-13T21:40:11.463 INFO:tasks.workunit.client.1.smithi116.stdout:6/0: dwrite - no filename 2024-09-13T21:40:11.463 INFO:tasks.workunit.client.1.smithi116.stdout:6/1: unlink - no file 2024-09-13T21:40:11.463 INFO:tasks.workunit.client.1.smithi116.stdout:6/2: fsync - no filename 2024-09-13T21:40:11.463 INFO:tasks.workunit.client.1.smithi116.stdout:6/3: write - no filename 2024-09-13T21:40:11.463 INFO:tasks.workunit.client.1.smithi116.stdout:6/4: getdents . 0 2024-09-13T21:40:11.464 INFO:tasks.workunit.client.1.smithi116.stdout:5/5: mknod c0 0 2024-09-13T21:40:11.465 INFO:tasks.workunit.client.1.smithi116.stdout:5/6: chown c0 7 1 2024-09-13T21:40:11.465 INFO:tasks.workunit.client.1.smithi116.stdout:5/7: write - no filename 2024-09-13T21:40:11.465 INFO:tasks.workunit.client.1.smithi116.stdout:5/8: dread - no filename 2024-09-13T21:40:11.465 INFO:tasks.workunit.client.1.smithi116.stdout:4/16: creat d0/f1 x:0 0 0 2024-09-13T21:40:11.465 INFO:tasks.workunit.client.1.smithi116.stdout:4/17: stat d0 0 2024-09-13T21:40:11.465 INFO:tasks.workunit.client.1.smithi116.stdout:4/18: rename d0 to d0/d2 22 2024-09-13T21:40:11.465 INFO:tasks.workunit.client.1.smithi116.stdout:4/19: write d0/f1 [1033361,109116] 0 2024-09-13T21:40:11.465 INFO:tasks.workunit.client.1.smithi116.stdout:4/20: rename d0 to d0/d3 22 2024-09-13T21:40:11.466 INFO:tasks.workunit.client.1.smithi116.stdout:3/11: creat f2 x:0 0 0 2024-09-13T21:40:11.466 INFO:tasks.workunit.client.1.smithi116.stdout:2/11: mknod d0/c3 0 2024-09-13T21:40:11.466 INFO:tasks.workunit.client.1.smithi116.stdout:1/14: mknod d4/c5 0 2024-09-13T21:40:11.467 INFO:tasks.workunit.client.1.smithi116.stdout:0/7: unlink f1 0 2024-09-13T21:40:11.468 INFO:tasks.workunit.client.1.smithi116.stdout:7/0: dwrite - no filename 2024-09-13T21:40:11.468 INFO:tasks.workunit.client.1.smithi116.stdout:6/5: creat f0 x:0 0 0 2024-09-13T21:40:11.468 INFO:tasks.workunit.client.1.smithi116.stdout:6/6: rmdir - no directory 2024-09-13T21:40:11.468 INFO:tasks.workunit.client.1.smithi116.stdout:6/7: rmdir - no directory 2024-09-13T21:40:11.469 INFO:tasks.workunit.client.1.smithi116.stdout:5/9: unlink c0 0 2024-09-13T21:40:11.469 INFO:tasks.workunit.client.1.smithi116.stdout:5/10: write - no filename 2024-09-13T21:40:11.469 INFO:tasks.workunit.client.1.smithi116.stdout:5/11: truncate - no filename 2024-09-13T21:40:11.469 INFO:tasks.workunit.client.1.smithi116.stdout:5/12: write - no filename 2024-09-13T21:40:11.469 INFO:tasks.workunit.client.1.smithi116.stdout:5/13: chown . 792 1 2024-09-13T21:40:11.470 INFO:tasks.workunit.client.1.smithi116.stdout:5/14: read - no filename 2024-09-13T21:40:11.470 INFO:tasks.workunit.client.1.smithi116.stdout:5/15: chown . 116317 1 2024-09-13T21:40:11.470 INFO:tasks.workunit.client.1.smithi116.stdout:5/16: dread - no filename 2024-09-13T21:40:11.470 INFO:tasks.workunit.client.1.smithi116.stdout:4/21: symlink d0/l4 0 2024-09-13T21:40:11.470 INFO:tasks.workunit.client.1.smithi116.stdout:1/15: dread f3 [0,4194304] 0 2024-09-13T21:40:11.471 INFO:tasks.workunit.client.1.smithi116.stdout:3/12: mkdir d3 0 2024-09-13T21:40:11.471 INFO:tasks.workunit.client.1.smithi116.stdout:2/12: symlink d0/l4 0 2024-09-13T21:40:11.471 INFO:tasks.workunit.client.1.smithi116.stdout:2/13: fsync - no filename 2024-09-13T21:40:11.472 INFO:tasks.workunit.client.1.smithi116.stdout:0/8: symlink d2/l4 0 2024-09-13T21:40:11.473 INFO:tasks.workunit.client.1.smithi116.stdout:7/1: creat f0 x:0 0 0 2024-09-13T21:40:11.473 INFO:tasks.workunit.client.1.smithi116.stdout:7/2: creat f1 x:0 0 0 2024-09-13T21:40:11.474 INFO:tasks.workunit.client.1.smithi116.stdout:7/3: write f1 [96214,72003] 0 2024-09-13T21:40:11.474 INFO:tasks.workunit.client.1.smithi116.stdout:4/22: dread d0/f1 [0,4194304] 0 2024-09-13T21:40:11.475 INFO:tasks.workunit.client.1.smithi116.stdout:1/16: link c0 d4/c6 0 2024-09-13T21:40:11.477 INFO:tasks.workunit.client.1.smithi116.stdout:3/13: unlink f2 0 2024-09-13T21:40:11.478 INFO:tasks.workunit.client.1.smithi116.stdout:2/14: mkdir d0/d5 0 2024-09-13T21:40:11.478 INFO:tasks.workunit.client.1.smithi116.stdout:2/15: dread - no filename 2024-09-13T21:40:11.478 INFO:tasks.workunit.client.1.smithi116.stdout:2/16: write - no filename 2024-09-13T21:40:11.479 INFO:tasks.workunit.client.1.smithi116.stdout:0/9: mkdir d2/d5 0 2024-09-13T21:40:11.479 INFO:tasks.workunit.client.1.smithi116.stdout:0/10: getdents d2/d5 0 2024-09-13T21:40:11.479 INFO:tasks.workunit.client.1.smithi116.stdout:0/11: read - no filename 2024-09-13T21:40:11.479 INFO:tasks.workunit.client.1.smithi116.stdout:0/12: write - no filename 2024-09-13T21:40:11.479 INFO:tasks.workunit.client.1.smithi116.stdout:0/13: dwrite - no filename 2024-09-13T21:40:11.481 INFO:tasks.workunit.client.1.smithi116.stdout:9/0: dread - no filename 2024-09-13T21:40:11.481 INFO:tasks.workunit.client.1.smithi116.stdout:9/1: dread - no filename 2024-09-13T21:40:11.482 INFO:tasks.workunit.client.1.smithi116.stdout:8/0: creat f0 x:0 0 0 2024-09-13T21:40:11.482 INFO:tasks.workunit.client.1.smithi116.stdout:8/1: write f0 [674395,56113] 0 2024-09-13T21:40:11.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:11 smithi088 ceph-mon[27963]: pgmap v245: 65 pgs: 65 active+clean; 177 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s wr, 895 op/s 2024-09-13T21:40:11.484 INFO:tasks.workunit.client.1.smithi116.stdout:3/14: creat d3/f4 x:0 0 0 2024-09-13T21:40:11.484 INFO:tasks.workunit.client.1.smithi116.stdout:3/15: chown d3 1609 1 2024-09-13T21:40:11.491 INFO:tasks.workunit.client.1.smithi116.stdout:6/8: dwrite f0 [0,4194304] 0 2024-09-13T21:40:11.506 INFO:tasks.workunit.client.1.smithi116.stdout:2/17: creat d0/f6 x:0 0 0 2024-09-13T21:40:11.506 INFO:tasks.workunit.client.1.smithi116.stdout:0/14: creat d2/d5/f6 x:0 0 0 2024-09-13T21:40:11.506 INFO:tasks.workunit.client.1.smithi116.stdout:8/2: mknod c1 0 2024-09-13T21:40:11.507 INFO:tasks.workunit.client.1.smithi116.stdout:9/2: creat f0 x:0 0 0 2024-09-13T21:40:11.507 INFO:tasks.workunit.client.1.smithi116.stdout:3/16: symlink d3/l5 0 2024-09-13T21:40:11.507 INFO:tasks.workunit.client.1.smithi116.stdout:3/17: fdatasync d3/f4 0 2024-09-13T21:40:11.515 INFO:tasks.workunit.client.1.smithi116.stdout:2/18: unlink d0/f6 0 2024-09-13T21:40:11.515 INFO:tasks.workunit.client.1.smithi116.stdout:2/19: write - no filename 2024-09-13T21:40:11.518 INFO:tasks.workunit.client.1.smithi116.stdout:0/15: creat d2/f7 x:0 0 0 2024-09-13T21:40:11.518 INFO:tasks.workunit.client.1.smithi116.stdout:0/16: dread - d2/d5/f6 zero size 2024-09-13T21:40:11.518 INFO:tasks.workunit.client.1.smithi116.stdout:0/17: dread - d2/d5/f6 zero size 2024-09-13T21:40:11.518 INFO:tasks.workunit.client.1.smithi116.stdout:0/18: creat d2/d5/f8 x:0 0 0 2024-09-13T21:40:11.518 INFO:tasks.workunit.client.1.smithi116.stdout:0/19: dread - d2/d5/f6 zero size 2024-09-13T21:40:11.518 INFO:tasks.workunit.client.1.smithi116.stdout:0/20: write d2/d5/f6 [435289,90328] 0 2024-09-13T21:40:11.519 INFO:tasks.workunit.client.1.smithi116.stdout:0/21: read - d2/d5/f8 zero size 2024-09-13T21:40:11.522 INFO:tasks.workunit.client.1.smithi116.stdout:8/3: unlink c1 0 2024-09-13T21:40:11.526 INFO:tasks.workunit.client.1.smithi116.stdout:3/18: symlink d3/l6 0 2024-09-13T21:40:11.526 INFO:tasks.workunit.client.1.smithi116.stdout:3/19: write d3/f4 [1041921,101363] 0 2024-09-13T21:40:11.526 INFO:tasks.workunit.client.1.smithi116.stdout:3/20: chown d3/f4 495443 1 2024-09-13T21:40:11.546 INFO:tasks.workunit.client.1.smithi116.stdout:5/17: getdents . 0 2024-09-13T21:40:11.546 INFO:tasks.workunit.client.1.smithi116.stdout:5/18: dwrite - no filename 2024-09-13T21:40:11.546 INFO:tasks.workunit.client.1.smithi116.stdout:5/19: write - no filename 2024-09-13T21:40:11.547 INFO:tasks.workunit.client.1.smithi116.stdout:5/20: rmdir - no directory 2024-09-13T21:40:11.547 INFO:tasks.workunit.client.1.smithi116.stdout:5/21: rmdir - no directory 2024-09-13T21:40:11.547 INFO:tasks.workunit.client.1.smithi116.stdout:5/22: truncate - no filename 2024-09-13T21:40:11.547 INFO:tasks.workunit.client.1.smithi116.stdout:5/23: fdatasync - no filename 2024-09-13T21:40:11.547 INFO:tasks.workunit.client.1.smithi116.stdout:5/24: dread - no filename 2024-09-13T21:40:11.547 INFO:tasks.workunit.client.1.smithi116.stdout:5/25: readlink - no filename 2024-09-13T21:40:11.551 INFO:tasks.workunit.client.1.smithi116.stdout:5/26: creat f1 x:0 0 0 2024-09-13T21:40:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:11 smithi116 ceph-mon[33391]: pgmap v245: 65 pgs: 65 active+clean; 177 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s wr, 895 op/s 2024-09-13T21:40:11.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/20: getdents d0 0 2024-09-13T21:40:11.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/21: chown d0/d5 0 1 2024-09-13T21:40:11.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/22: dwrite - no filename 2024-09-13T21:40:11.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/23: stat d0/c2 0 2024-09-13T21:40:11.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/24: write - no filename 2024-09-13T21:40:11.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/25: chown d0 521 1 2024-09-13T21:40:11.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/26: dread - no filename 2024-09-13T21:40:11.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/27: write - no filename 2024-09-13T21:40:11.668 INFO:tasks.workunit.client.1.smithi116.stdout:0/22: truncate d2/d5/f6 414299 0 2024-09-13T21:40:11.668 INFO:tasks.workunit.client.1.smithi116.stdout:0/23: creat d2/d5/f9 x:0 0 0 2024-09-13T21:40:11.740 INFO:tasks.workunit.client.1.smithi116.stdout:2/28: mkdir d0/d7 0 2024-09-13T21:40:11.740 INFO:tasks.workunit.client.1.smithi116.stdout:2/29: fdatasync - no filename 2024-09-13T21:40:11.740 INFO:tasks.workunit.client.1.smithi116.stdout:2/30: chown d0/c3 220 1 2024-09-13T21:40:11.939 INFO:tasks.workunit.client.1.smithi116.stdout:5/27: dwrite f1 [0,4194304] 0 2024-09-13T21:40:11.976 INFO:tasks.workunit.client.1.smithi116.stdout:3/21: dwrite d3/f4 [0,4194304] 0 2024-09-13T21:40:11.981 INFO:tasks.workunit.client.1.smithi116.stdout:7/4: dwrite f1 [0,4194304] 0 2024-09-13T21:40:11.988 INFO:tasks.workunit.client.1.smithi116.stdout:6/9: dwrite f0 [0,4194304] 0 2024-09-13T21:40:12.014 INFO:tasks.workunit.client.1.smithi116.stdout:6/10: dwrite f0 [0,4194304] 0 2024-09-13T21:40:12.015 INFO:tasks.workunit.client.1.smithi116.stdout:6/11: creat f1 x:0 0 0 2024-09-13T21:40:12.015 INFO:tasks.workunit.client.1.smithi116.stdout:6/12: readlink - no filename 2024-09-13T21:40:12.015 INFO:tasks.workunit.client.1.smithi116.stdout:0/24: dwrite d2/d5/f8 [0,4194304] 0 2024-09-13T21:40:12.035 INFO:tasks.workunit.client.1.smithi116.stdout:9/3: write f0 [316772,121823] 0 2024-09-13T21:40:12.035 INFO:tasks.workunit.client.1.smithi116.stdout:9/4: write f0 [710116,97223] 0 2024-09-13T21:40:12.035 INFO:tasks.workunit.client.1.smithi116.stdout:9/5: chown f0 7 1 2024-09-13T21:40:12.035 INFO:tasks.workunit.client.1.smithi116.stdout:8/4: dread f0 [0,4194304] 0 2024-09-13T21:40:12.647 INFO:tasks.workunit.client.1.smithi116.stdout:5/28: link f1 f2 0 2024-09-13T21:40:12.730 INFO:tasks.workunit.client.1.smithi116.stdout:3/22: mknod d3/c7 0 2024-09-13T21:40:12.756 INFO:tasks.workunit.client.1.smithi116.stdout:7/5: rename f1 to f2 0 2024-09-13T21:40:12.783 INFO:tasks.workunit.client.1.smithi116.stdout:6/13: mknod c2 0 2024-09-13T21:40:12.783 INFO:tasks.workunit.client.1.smithi116.stdout:6/14: write f1 [85966,35099] 0 2024-09-13T21:40:12.788 INFO:tasks.workunit.client.1.smithi116.stdout:0/25: mknod d2/ca 0 2024-09-13T21:40:12.788 INFO:tasks.workunit.client.1.smithi116.stdout:0/26: write d2/f7 [863752,97677] 0 2024-09-13T21:40:12.801 INFO:tasks.workunit.client.1.smithi116.stdout:8/5: mkdir d2 0 2024-09-13T21:40:12.820 INFO:tasks.workunit.client.1.smithi116.stdout:6/15: rename f1 to f3 0 2024-09-13T21:40:12.821 INFO:tasks.workunit.client.1.smithi116.stdout:8/6: unlink f0 0 2024-09-13T21:40:12.821 INFO:tasks.workunit.client.1.smithi116.stdout:8/7: write - no filename 2024-09-13T21:40:12.821 INFO:tasks.workunit.client.1.smithi116.stdout:8/8: getdents d2 0 2024-09-13T21:40:12.821 INFO:tasks.workunit.client.1.smithi116.stdout:8/9: dwrite - no filename 2024-09-13T21:40:12.821 INFO:tasks.workunit.client.1.smithi116.stdout:8/10: write - no filename 2024-09-13T21:40:12.826 INFO:tasks.workunit.client.1.smithi116.stdout:8/11: symlink d2/l3 0 2024-09-13T21:40:12.827 INFO:tasks.workunit.client.1.smithi116.stdout:8/12: mknod d2/c4 0 2024-09-13T21:40:12.828 INFO:tasks.workunit.client.1.smithi116.stdout:8/13: dwrite - no filename 2024-09-13T21:40:12.829 INFO:tasks.workunit.client.1.smithi116.stdout:8/14: rename d2/l3 to d2/l5 0 2024-09-13T21:40:12.830 INFO:tasks.workunit.client.1.smithi116.stdout:8/15: dread - no filename 2024-09-13T21:40:12.836 INFO:tasks.workunit.client.1.smithi116.stdout:8/16: link d2/c4 d2/c6 0 2024-09-13T21:40:12.836 INFO:tasks.workunit.client.1.smithi116.stdout:8/17: chown d2/l5 51 1 2024-09-13T21:40:12.840 INFO:tasks.workunit.client.1.smithi116.stdout:8/18: symlink d2/l7 0 2024-09-13T21:40:12.842 INFO:tasks.workunit.client.1.smithi116.stdout:8/19: creat d2/f8 x:0 0 0 2024-09-13T21:40:12.844 INFO:tasks.workunit.client.1.smithi116.stdout:8/20: mknod d2/c9 0 2024-09-13T21:40:12.844 INFO:tasks.workunit.client.1.smithi116.stdout:8/21: stat d2 0 2024-09-13T21:40:13.051 INFO:tasks.workunit.client.1.smithi116.stdout:5/29: truncate f1 3046895 0 2024-09-13T21:40:13.054 INFO:tasks.workunit.client.1.smithi116.stdout:5/30: mknod c3 0 2024-09-13T21:40:13.075 INFO:tasks.workunit.client.1.smithi116.stdout:7/6: dwrite f2 [0,4194304] 0 2024-09-13T21:40:13.075 INFO:tasks.workunit.client.1.smithi116.stdout:7/7: fdatasync f0 0 2024-09-13T21:40:13.080 INFO:tasks.workunit.client.1.smithi116.stdout:7/8: symlink l3 0 2024-09-13T21:40:13.080 INFO:tasks.workunit.client.1.smithi116.stdout:7/9: dread - f0 zero size 2024-09-13T21:40:13.083 INFO:tasks.workunit.client.1.smithi116.stdout:7/10: mknod c4 0 2024-09-13T21:40:13.100 INFO:tasks.workunit.client.1.smithi116.stdout:3/23: write d3/f4 [4800250,20435] 0 2024-09-13T21:40:13.100 INFO:tasks.workunit.client.1.smithi116.stdout:3/24: readlink d3/l6 0 2024-09-13T21:40:13.100 INFO:tasks.workunit.client.1.smithi116.stdout:3/25: creat d3/f8 x:0 0 0 2024-09-13T21:40:13.100 INFO:tasks.workunit.client.1.smithi116.stdout:3/26: readlink d3/l6 0 2024-09-13T21:40:13.100 INFO:tasks.workunit.client.1.smithi116.stdout:3/27: chown d3/c7 116257490 1 2024-09-13T21:40:13.100 INFO:tasks.workunit.client.1.smithi116.stdout:3/28: creat d3/f9 x:0 0 0 2024-09-13T21:40:13.103 INFO:tasks.workunit.client.1.smithi116.stdout:9/6: truncate f0 451357 0 2024-09-13T21:40:13.110 INFO:tasks.workunit.client.1.smithi116.stdout:9/7: mknod c1 0 2024-09-13T21:40:13.117 INFO:tasks.workunit.client.1.smithi116.stdout:7/11: read f2 [2532433,49300] 0 2024-09-13T21:40:13.121 INFO:tasks.workunit.client.1.smithi116.stdout:8/22: rmdir d2 39 2024-09-13T21:40:13.122 INFO:tasks.workunit.client.1.smithi116.stdout:7/12: mkdir d5 0 2024-09-13T21:40:13.126 INFO:tasks.workunit.client.1.smithi116.stdout:7/13: mkdir d5/d6 0 2024-09-13T21:40:13.159 INFO:tasks.workunit.client.1.smithi116.stdout:3/29: fsync d3/f8 0 2024-09-13T21:40:13.161 INFO:tasks.workunit.client.1.smithi116.stdout:9/8: write f0 [217280,41437] 0 2024-09-13T21:40:13.162 INFO:tasks.workunit.client.1.smithi116.stdout:3/30: rename d3/l5 to d3/la 0 2024-09-13T21:40:13.164 INFO:tasks.workunit.client.1.smithi116.stdout:9/9: mkdir d2 0 2024-09-13T21:40:13.164 INFO:tasks.workunit.client.1.smithi116.stdout:9/10: stat c1 0 2024-09-13T21:40:13.166 INFO:tasks.workunit.client.1.smithi116.stdout:9/11: creat d2/f3 x:0 0 0 2024-09-13T21:40:13.166 INFO:tasks.workunit.client.1.smithi116.stdout:9/12: write d2/f3 [791788,109310] 0 2024-09-13T21:40:13.166 INFO:tasks.workunit.client.1.smithi116.stdout:9/13: creat d2/f4 x:0 0 0 2024-09-13T21:40:13.166 INFO:tasks.workunit.client.1.smithi116.stdout:9/14: read d2/f3 [813337,101882] 0 2024-09-13T21:40:13.180 INFO:tasks.workunit.client.1.smithi116.stdout:5/31: write f2 [880796,128974] 0 2024-09-13T21:40:13.180 INFO:tasks.workunit.client.1.smithi116.stdout:5/32: write f1 [760783,82282] 0 2024-09-13T21:40:13.182 INFO:tasks.workunit.client.1.smithi116.stdout:9/15: fdatasync d2/f3 0 2024-09-13T21:40:13.182 INFO:tasks.workunit.client.1.smithi116.stdout:9/16: creat d2/f5 x:0 0 0 2024-09-13T21:40:13.183 INFO:tasks.workunit.client.1.smithi116.stdout:5/33: unlink f2 0 2024-09-13T21:40:13.202 INFO:tasks.workunit.client.1.smithi116.stdout:8/23: dwrite d2/f8 [0,4194304] 0 2024-09-13T21:40:13.226 INFO:tasks.workunit.client.1.smithi116.stdout:8/24: write d2/f8 [683542,36588] 0 2024-09-13T21:40:13.231 INFO:tasks.workunit.client.1.smithi116.stdout:7/14: dwrite f0 [0,4194304] 0 2024-09-13T21:40:13.236 INFO:tasks.workunit.client.1.smithi116.stdout:7/15: dread f2 [0,4194304] 0 2024-09-13T21:40:13.237 INFO:tasks.workunit.client.1.smithi116.stdout:7/16: symlink d5/d6/l7 0 2024-09-13T21:40:13.239 INFO:tasks.workunit.client.1.smithi116.stdout:7/17: creat d5/f8 x:0 0 0 2024-09-13T21:40:13.241 INFO:tasks.workunit.client.1.smithi116.stdout:9/17: dwrite d2/f5 [0,4194304] 0 2024-09-13T21:40:13.275 INFO:tasks.workunit.client.1.smithi116.stdout:6/16: dwrite f0 [0,4194304] 0 2024-09-13T21:40:13.278 INFO:tasks.workunit.client.1.smithi116.stdout:6/17: rename f0 to f4 0 2024-09-13T21:40:13.278 INFO:tasks.workunit.client.1.smithi116.stdout:6/18: creat f5 x:0 0 0 2024-09-13T21:40:13.280 INFO:tasks.workunit.client.1.smithi116.stdout:6/19: mknod c6 0 2024-09-13T21:40:13.298 INFO:tasks.workunit.client.1.smithi116.stdout:0/27: write d2/d5/f8 [3931991,53435] 0 2024-09-13T21:40:13.298 INFO:tasks.workunit.client.1.smithi116.stdout:0/28: creat d2/fb x:0 0 0 2024-09-13T21:40:13.301 INFO:tasks.workunit.client.1.smithi116.stdout:0/29: unlink d2/l4 0 2024-09-13T21:40:13.301 INFO:tasks.workunit.client.1.smithi116.stdout:0/30: write d2/d5/f6 [788323,100797] 0 2024-09-13T21:40:13.301 INFO:tasks.workunit.client.1.smithi116.stdout:0/31: readlink - no filename 2024-09-13T21:40:13.301 INFO:tasks.workunit.client.1.smithi116.stdout:0/32: stat d2 0 2024-09-13T21:40:13.334 INFO:tasks.workunit.client.1.smithi116.stdout:5/34: dwrite f1 [0,4194304] 0 2024-09-13T21:40:13.334 INFO:tasks.workunit.client.1.smithi116.stdout:5/35: creat f4 x:0 0 0 2024-09-13T21:40:13.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:13 smithi116 ceph-mon[33391]: pgmap v246: 65 pgs: 65 active+clean; 182 MiB data, 849 MiB used, 536 GiB / 536 GiB avail; 8.9 MiB/s wr, 903 op/s 2024-09-13T21:40:13.346 INFO:tasks.workunit.client.1.smithi116.stdout:5/36: dread f1 [0,4194304] 0 2024-09-13T21:40:13.346 INFO:tasks.workunit.client.1.smithi116.stdout:5/37: readlink - no filename 2024-09-13T21:40:13.348 INFO:tasks.workunit.client.1.smithi116.stdout:5/38: mknod c5 0 2024-09-13T21:40:13.356 INFO:tasks.workunit.client.1.smithi116.stdout:8/25: dwrite d2/f8 [0,4194304] 0 2024-09-13T21:40:13.360 INFO:tasks.workunit.client.1.smithi116.stdout:0/33: write d2/f7 [705438,22791] 0 2024-09-13T21:40:13.362 INFO:tasks.workunit.client.1.smithi116.stdout:0/34: mkdir d2/dc 0 2024-09-13T21:40:13.362 INFO:tasks.workunit.client.1.smithi116.stdout:0/35: readlink - no filename 2024-09-13T21:40:13.373 INFO:tasks.workunit.client.1.smithi116.stdout:5/39: dwrite f4 [0,4194304] 0 2024-09-13T21:40:13.374 INFO:tasks.workunit.client.1.smithi116.stdout:8/26: read d2/f8 [2750123,130311] 0 2024-09-13T21:40:13.374 INFO:tasks.workunit.client.1.smithi116.stdout:8/27: chown d2 122881 1 2024-09-13T21:40:13.375 INFO:tasks.workunit.client.1.smithi116.stdout:8/28: readlink d2/l7 0 2024-09-13T21:40:13.380 INFO:tasks.workunit.client.1.smithi116.stdout:5/40: write f1 [2984873,41033] 0 2024-09-13T21:40:13.383 INFO:tasks.workunit.client.1.smithi116.stdout:5/41: unlink f4 0 2024-09-13T21:40:13.383 INFO:tasks.workunit.client.1.smithi116.stdout:5/42: creat f6 x:0 0 0 2024-09-13T21:40:13.383 INFO:tasks.workunit.client.1.smithi116.stdout:5/43: write f1 [3274534,108100] 0 2024-09-13T21:40:13.383 INFO:tasks.workunit.client.1.smithi116.stdout:5/44: truncate f1 4736037 0 2024-09-13T21:40:13.386 INFO:tasks.workunit.client.1.smithi116.stdout:7/18: getdents d5 0 2024-09-13T21:40:13.386 INFO:tasks.workunit.client.1.smithi116.stdout:7/19: write f2 [5099271,59424] 0 2024-09-13T21:40:13.388 INFO:tasks.workunit.client.1.smithi116.stdout:7/20: mkdir d5/d9 0 2024-09-13T21:40:13.388 INFO:tasks.workunit.client.1.smithi116.stdout:7/21: chown d5/d6 33505 1 2024-09-13T21:40:13.391 INFO:tasks.workunit.client.1.smithi116.stdout:3/31: dread d3/f4 [0,4194304] 0 2024-09-13T21:40:13.394 INFO:tasks.workunit.client.1.smithi116.stdout:5/45: fdatasync f1 0 2024-09-13T21:40:13.396 INFO:tasks.workunit.client.1.smithi116.stdout:5/46: mkdir d7 0 2024-09-13T21:40:13.396 INFO:tasks.workunit.client.1.smithi116.stdout:5/47: fsync f1 0 2024-09-13T21:40:13.397 INFO:tasks.workunit.client.1.smithi116.stdout:8/29: dwrite d2/f8 [0,4194304] 0 2024-09-13T21:40:13.399 INFO:tasks.workunit.client.1.smithi116.stdout:7/22: write f0 [2424116,88895] 0 2024-09-13T21:40:13.399 INFO:tasks.workunit.client.1.smithi116.stdout:5/48: link f1 d7/f8 0 2024-09-13T21:40:13.400 INFO:tasks.workunit.client.1.smithi116.stdout:5/49: write f6 [506801,120873] 0 2024-09-13T21:40:13.401 INFO:tasks.workunit.client.1.smithi116.stdout:8/30: creat d2/fa x:0 0 0 2024-09-13T21:40:13.404 INFO:tasks.workunit.client.1.smithi116.stdout:7/23: rmdir d5 39 2024-09-13T21:40:13.410 INFO:tasks.workunit.client.1.smithi116.stdout:5/50: dread f1 [0,4194304] 0 2024-09-13T21:40:13.411 INFO:tasks.workunit.client.1.smithi116.stdout:5/51: rmdir d7 39 2024-09-13T21:40:13.413 INFO:tasks.workunit.client.1.smithi116.stdout:3/32: dwrite d3/f8 [0,4194304] 0 2024-09-13T21:40:13.417 INFO:tasks.workunit.client.1.smithi116.stdout:7/24: truncate f0 3249804 0 2024-09-13T21:40:13.417 INFO:tasks.workunit.client.1.smithi116.stdout:7/25: readlink d5/d6/l7 0 2024-09-13T21:40:13.417 INFO:tasks.workunit.client.1.smithi116.stdout:7/26: truncate f2 5829254 0 2024-09-13T21:40:13.417 INFO:tasks.workunit.client.1.smithi116.stdout:7/27: dread - d5/f8 zero size 2024-09-13T21:40:13.419 INFO:tasks.workunit.client.1.smithi116.stdout:7/28: write f2 [5584380,24152] 0 2024-09-13T21:40:13.419 INFO:tasks.workunit.client.1.smithi116.stdout:7/29: chown d5 6 1 2024-09-13T21:40:13.421 INFO:tasks.workunit.client.1.smithi116.stdout:8/31: dwrite d2/f8 [0,4194304] 0 2024-09-13T21:40:13.423 INFO:tasks.workunit.client.1.smithi116.stdout:8/32: symlink d2/lb 0 2024-09-13T21:40:13.423 INFO:tasks.workunit.client.1.smithi116.stdout:8/33: chown d2/f8 13978 1 2024-09-13T21:40:13.424 INFO:tasks.workunit.client.1.smithi116.stdout:3/33: truncate d3/f8 2633379 0 2024-09-13T21:40:13.424 INFO:tasks.workunit.client.1.smithi116.stdout:3/34: stat d3/f4 0 2024-09-13T21:40:13.424 INFO:tasks.workunit.client.1.smithi116.stdout:8/34: symlink d2/lc 0 2024-09-13T21:40:13.425 INFO:tasks.workunit.client.1.smithi116.stdout:8/35: write d2/fa [552475,85757] 0 2024-09-13T21:40:13.426 INFO:tasks.workunit.client.1.smithi116.stdout:3/35: mkdir d3/db 0 2024-09-13T21:40:13.428 INFO:tasks.workunit.client.1.smithi116.stdout:7/30: rename f0 to d5/d9/fa 0 2024-09-13T21:40:13.428 INFO:tasks.workunit.client.1.smithi116.stdout:7/31: read f2 [259657,47633] 0 2024-09-13T21:40:13.428 INFO:tasks.workunit.client.1.smithi116.stdout:7/32: readlink d5/d6/l7 0 2024-09-13T21:40:13.428 INFO:tasks.workunit.client.1.smithi116.stdout:3/36: stat d3/la 0 2024-09-13T21:40:13.428 INFO:tasks.workunit.client.1.smithi116.stdout:3/37: creat d3/fc x:0 0 0 2024-09-13T21:40:13.428 INFO:tasks.workunit.client.1.smithi116.stdout:3/38: write d3/fc [283726,33886] 0 2024-09-13T21:40:13.428 INFO:tasks.workunit.client.1.smithi116.stdout:3/39: stat d3/f4 0 2024-09-13T21:40:13.428 INFO:tasks.workunit.client.1.smithi116.stdout:3/40: write d3/f4 [5692471,64550] 0 2024-09-13T21:40:13.429 INFO:tasks.workunit.client.1.smithi116.stdout:3/41: symlink d3/db/ld 0 2024-09-13T21:40:13.429 INFO:tasks.workunit.client.1.smithi116.stdout:3/42: dread - d3/f9 zero size 2024-09-13T21:40:13.431 INFO:tasks.workunit.client.1.smithi116.stdout:3/43: mknod d3/ce 0 2024-09-13T21:40:13.432 INFO:tasks.workunit.client.1.smithi116.stdout:5/52: dwrite f1 [0,4194304] 0 2024-09-13T21:40:13.433 INFO:tasks.workunit.client.1.smithi116.stdout:8/36: dread d2/fa [0,4194304] 0 2024-09-13T21:40:13.433 INFO:tasks.workunit.client.1.smithi116.stdout:3/44: creat d3/db/ff x:0 0 0 2024-09-13T21:40:13.434 INFO:tasks.workunit.client.1.smithi116.stdout:3/45: mkdir d3/db/d10 0 2024-09-13T21:40:13.434 INFO:tasks.workunit.client.1.smithi116.stdout:3/46: creat d3/f11 x:0 0 0 2024-09-13T21:40:13.437 INFO:tasks.workunit.client.1.smithi116.stdout:3/47: symlink d3/db/l12 0 2024-09-13T21:40:13.444 INFO:tasks.workunit.client.1.smithi116.stdout:3/48: dread d3/fc [0,4194304] 0 2024-09-13T21:40:13.449 INFO:tasks.workunit.client.1.smithi116.stdout:8/37: write d2/f8 [3596186,11302] 0 2024-09-13T21:40:13.449 INFO:tasks.workunit.client.1.smithi116.stdout:8/38: write d2/f8 [5176237,35178] 0 2024-09-13T21:40:13.449 INFO:tasks.workunit.client.1.smithi116.stdout:8/39: fdatasync d2/fa 0 2024-09-13T21:40:13.450 INFO:tasks.workunit.client.1.smithi116.stdout:8/40: dread d2/fa [0,4194304] 0 2024-09-13T21:40:13.455 INFO:tasks.workunit.client.1.smithi116.stdout:5/53: dwrite d7/f8 [4194304,4194304] 0 2024-09-13T21:40:13.455 INFO:tasks.workunit.client.1.smithi116.stdout:7/33: dwrite f2 [4194304,4194304] 0 2024-09-13T21:40:13.455 INFO:tasks.workunit.client.1.smithi116.stdout:5/54: write f6 [1206221,25518] 0 2024-09-13T21:40:13.460 INFO:tasks.workunit.client.1.smithi116.stdout:5/55: rename f6 to d7/f9 0 2024-09-13T21:40:13.464 INFO:tasks.workunit.client.1.smithi116.stdout:5/56: mkdir d7/da 0 2024-09-13T21:40:13.468 INFO:tasks.workunit.client.1.smithi116.stdout:5/57: mknod d7/da/cb 0 2024-09-13T21:40:13.482 INFO:tasks.workunit.client.1.smithi116.stdout:3/49: dwrite d3/f4 [4194304,4194304] 0 2024-09-13T21:40:13.482 INFO:tasks.workunit.client.1.smithi116.stdout:3/50: dread - d3/db/ff zero size 2024-09-13T21:40:13.482 INFO:tasks.workunit.client.1.smithi116.stdout:3/51: chown d3/db/l12 5 1 2024-09-13T21:40:13.482 INFO:tasks.workunit.client.1.smithi116.stdout:3/52: write d3/db/ff [420633,29134] 0 2024-09-13T21:40:13.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:13 smithi088 ceph-mon[27963]: pgmap v246: 65 pgs: 65 active+clean; 182 MiB data, 849 MiB used, 536 GiB / 536 GiB avail; 8.9 MiB/s wr, 903 op/s 2024-09-13T21:40:13.483 INFO:tasks.workunit.client.1.smithi116.stdout:3/53: creat d3/db/d10/f13 x:0 0 0 2024-09-13T21:40:13.484 INFO:tasks.workunit.client.1.smithi116.stdout:7/34: dwrite d5/d9/fa [0,4194304] 0 2024-09-13T21:40:13.484 INFO:tasks.workunit.client.1.smithi116.stdout:0/36: dwrite d2/fb [0,4194304] 0 2024-09-13T21:40:13.484 INFO:tasks.workunit.client.1.smithi116.stdout:0/37: creat d2/d5/fd x:0 0 0 2024-09-13T21:40:13.485 INFO:tasks.workunit.client.1.smithi116.stdout:3/54: rename c0 to d3/db/c14 0 2024-09-13T21:40:13.486 INFO:tasks.workunit.client.1.smithi116.stdout:5/58: link d7/f9 d7/fc 0 2024-09-13T21:40:13.490 INFO:tasks.workunit.client.1.smithi116.stdout:3/55: link d3/f4 d3/db/d10/f15 0 2024-09-13T21:40:13.492 INFO:tasks.workunit.client.1.smithi116.stdout:5/59: rmdir d7/da 39 2024-09-13T21:40:13.501 INFO:tasks.workunit.client.1.smithi116.stdout:5/60: dread f1 [0,4194304] 0 2024-09-13T21:40:13.501 INFO:tasks.workunit.client.1.smithi116.stdout:5/61: getdents d7/da 0 2024-09-13T21:40:13.502 INFO:tasks.workunit.client.1.smithi116.stdout:5/62: truncate f1 1193636 0 2024-09-13T21:40:13.516 INFO:tasks.workunit.client.1.smithi116.stdout:0/38: dwrite d2/d5/f6 [0,4194304] 0 2024-09-13T21:40:13.516 INFO:tasks.workunit.client.1.smithi116.stdout:3/56: dwrite d3/f4 [4194304,4194304] 0 2024-09-13T21:40:13.516 INFO:tasks.workunit.client.1.smithi116.stdout:7/35: dwrite d5/d9/fa [0,4194304] 0 2024-09-13T21:40:13.516 INFO:tasks.workunit.client.1.smithi116.stdout:7/36: readlink d5/d6/l7 0 2024-09-13T21:40:13.517 INFO:tasks.workunit.client.1.smithi116.stdout:7/37: fsync f2 0 2024-09-13T21:40:13.519 INFO:tasks.workunit.client.1.smithi116.stdout:5/63: fsync f1 0 2024-09-13T21:40:13.521 INFO:tasks.workunit.client.1.smithi116.stdout:3/57: mknod d3/db/d10/c16 0 2024-09-13T21:40:13.521 INFO:tasks.workunit.client.1.smithi116.stdout:3/58: write d3/f9 [48123,12294] 0 2024-09-13T21:40:13.523 INFO:tasks.workunit.client.1.smithi116.stdout:5/64: dread d7/f8 [0,4194304] 0 2024-09-13T21:40:13.523 INFO:tasks.workunit.client.1.smithi116.stdout:7/38: write d5/d9/fa [720935,92974] 0 2024-09-13T21:40:13.525 INFO:tasks.workunit.client.1.smithi116.stdout:7/39: rename d5/d6 to d5/d9/db 0 2024-09-13T21:40:13.525 INFO:tasks.workunit.client.1.smithi116.stdout:3/59: dread d3/db/ff [0,4194304] 0 2024-09-13T21:40:13.526 INFO:tasks.workunit.client.1.smithi116.stdout:3/60: chown d3/db/d10 50365 1 2024-09-13T21:40:13.528 INFO:tasks.workunit.client.1.smithi116.stdout:3/61: rename d3/f4 to d3/db/f17 0 2024-09-13T21:40:13.528 INFO:tasks.workunit.client.1.smithi116.stdout:3/62: creat d3/db/d10/f18 x:0 0 0 2024-09-13T21:40:13.530 INFO:tasks.workunit.client.1.smithi116.stdout:3/63: mknod d3/db/d10/c19 0 2024-09-13T21:40:13.530 INFO:tasks.workunit.client.1.smithi116.stdout:3/64: truncate d3/db/d10/f18 614483 0 2024-09-13T21:40:13.530 INFO:tasks.workunit.client.1.smithi116.stdout:3/65: dread - d3/db/d10/f13 zero size 2024-09-13T21:40:13.530 INFO:tasks.workunit.client.1.smithi116.stdout:3/66: readlink d3/la 0 2024-09-13T21:40:13.531 INFO:tasks.workunit.client.1.smithi116.stdout:3/67: symlink d3/l1a 0 2024-09-13T21:40:13.534 INFO:tasks.workunit.client.1.smithi116.stdout:7/40: dread f2 [4194304,4194304] 0 2024-09-13T21:40:13.535 INFO:tasks.workunit.client.1.smithi116.stdout:7/41: mkdir d5/dc 0 2024-09-13T21:40:13.535 INFO:tasks.workunit.client.1.smithi116.stdout:7/42: read - d5/f8 zero size 2024-09-13T21:40:13.537 INFO:tasks.workunit.client.1.smithi116.stdout:7/43: rmdir d5/d9/db 39 2024-09-13T21:40:13.537 INFO:tasks.workunit.client.1.smithi116.stdout:7/44: dread - d5/f8 zero size 2024-09-13T21:40:13.538 INFO:tasks.workunit.client.1.smithi116.stdout:3/68: link d3/db/f17 d3/f1b 0 2024-09-13T21:40:13.538 INFO:tasks.workunit.client.1.smithi116.stdout:3/69: write d3/f9 [955890,1066] 0 2024-09-13T21:40:13.539 INFO:tasks.workunit.client.1.smithi116.stdout:7/45: rmdir d5 39 2024-09-13T21:40:13.539 INFO:tasks.workunit.client.1.smithi116.stdout:7/46: write d5/d9/fa [434507,89196] 0 2024-09-13T21:40:13.540 INFO:tasks.workunit.client.1.smithi116.stdout:7/47: rmdir d5/d9/db 39 2024-09-13T21:40:13.540 INFO:tasks.workunit.client.1.smithi116.stdout:7/48: write d5/d9/fa [1343750,22475] 0 2024-09-13T21:40:13.540 INFO:tasks.workunit.client.1.smithi116.stdout:7/49: write d5/d9/fa [2311568,56726] 0 2024-09-13T21:40:13.541 INFO:tasks.workunit.client.1.smithi116.stdout:7/50: rmdir d5/dc 0 2024-09-13T21:40:13.542 INFO:tasks.workunit.client.1.smithi116.stdout:7/51: symlink d5/ld 0 2024-09-13T21:40:13.543 INFO:tasks.workunit.client.1.smithi116.stdout:5/65: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:13.543 INFO:tasks.workunit.client.1.smithi116.stdout:7/52: creat d5/d9/db/fe x:0 0 0 2024-09-13T21:40:13.543 INFO:tasks.workunit.client.1.smithi116.stdout:7/53: write d5/d9/fa [5041797,109617] 0 2024-09-13T21:40:13.544 INFO:tasks.workunit.client.1.smithi116.stdout:5/66: getdents d7 0 2024-09-13T21:40:13.547 INFO:tasks.workunit.client.1.smithi116.stdout:3/70: dread d3/f8 [0,4194304] 0 2024-09-13T21:40:13.550 INFO:tasks.workunit.client.1.smithi116.stdout:7/54: dread f2 [4194304,4194304] 0 2024-09-13T21:40:13.550 INFO:tasks.workunit.client.1.smithi116.stdout:7/55: chown f2 425036284 1 2024-09-13T21:40:13.550 INFO:tasks.workunit.client.1.smithi116.stdout:7/56: read - d5/d9/db/fe zero size 2024-09-13T21:40:13.550 INFO:tasks.workunit.client.1.smithi116.stdout:7/57: creat d5/d9/db/ff x:0 0 0 2024-09-13T21:40:13.552 INFO:tasks.workunit.client.1.smithi116.stdout:7/58: rename d5/d9/fa to d5/d9/f10 0 2024-09-13T21:40:13.554 INFO:tasks.workunit.client.1.smithi116.stdout:7/59: link l3 d5/d9/db/l11 0 2024-09-13T21:40:13.554 INFO:tasks.workunit.client.1.smithi116.stdout:7/60: creat d5/d9/db/f12 x:0 0 0 2024-09-13T21:40:13.572 INFO:tasks.workunit.client.1.smithi116.stdout:5/67: dwrite d7/f8 [0,4194304] 0 2024-09-13T21:40:13.572 INFO:tasks.workunit.client.1.smithi116.stdout:3/71: dwrite d3/db/ff [0,4194304] 0 2024-09-13T21:40:13.573 INFO:tasks.workunit.client.1.smithi116.stdout:5/68: mknod d7/da/cd 0 2024-09-13T21:40:13.575 INFO:tasks.workunit.client.1.smithi116.stdout:5/69: mknod d7/ce 0 2024-09-13T21:40:13.584 INFO:tasks.workunit.client.1.smithi116.stdout:5/70: dread f1 [0,4194304] 0 2024-09-13T21:40:13.585 INFO:tasks.workunit.client.1.smithi116.stdout:5/71: symlink d7/da/lf 0 2024-09-13T21:40:13.586 INFO:tasks.workunit.client.1.smithi116.stdout:5/72: creat d7/da/f10 x:0 0 0 2024-09-13T21:40:13.586 INFO:tasks.workunit.client.1.smithi116.stdout:5/73: truncate d7/fc 469625 0 2024-09-13T21:40:13.587 INFO:tasks.workunit.client.1.smithi116.stdout:5/74: creat d7/da/f11 x:0 0 0 2024-09-13T21:40:13.587 INFO:tasks.workunit.client.1.smithi116.stdout:5/75: chown d7/da/lf 1988475 1 2024-09-13T21:40:13.592 INFO:tasks.workunit.client.1.smithi116.stdout:3/72: dwrite d3/f8 [0,4194304] 0 2024-09-13T21:40:13.592 INFO:tasks.workunit.client.1.smithi116.stdout:3/73: fdatasync d3/db/ff 0 2024-09-13T21:40:13.592 INFO:tasks.workunit.client.1.smithi116.stdout:3/74: readlink d3/db/ld 0 2024-09-13T21:40:13.593 INFO:tasks.workunit.client.1.smithi116.stdout:3/75: mkdir d3/db/d10/d1c 0 2024-09-13T21:40:13.593 INFO:tasks.workunit.client.1.smithi116.stdout:3/76: chown d3/f8 136848666 1 2024-09-13T21:40:13.593 INFO:tasks.workunit.client.1.smithi116.stdout:3/77: chown d3/f1b 1834 1 2024-09-13T21:40:13.593 INFO:tasks.workunit.client.1.smithi116.stdout:3/78: fdatasync d3/db/d10/f13 0 2024-09-13T21:40:13.593 INFO:tasks.workunit.client.1.smithi116.stdout:3/79: dread - d3/db/d10/f13 zero size 2024-09-13T21:40:13.596 INFO:tasks.workunit.client.1.smithi116.stdout:5/76: rename d7/f9 to d7/f12 0 2024-09-13T21:40:13.601 INFO:tasks.workunit.client.1.smithi116.stdout:3/80: write d3/f1b [7133728,61544] 0 2024-09-13T21:40:13.601 INFO:tasks.workunit.client.1.smithi116.stdout:3/81: chown d3/db/d10/f18 3910 1 2024-09-13T21:40:13.601 INFO:tasks.workunit.client.1.smithi116.stdout:3/82: getdents d3/db/d10/d1c 0 2024-09-13T21:40:13.609 INFO:tasks.workunit.client.1.smithi116.stdout:3/83: truncate d3/db/d10/f15 2836036 0 2024-09-13T21:40:13.611 INFO:tasks.workunit.client.1.smithi116.stdout:3/84: mkdir d3/db/d10/d1d 0 2024-09-13T21:40:13.611 INFO:tasks.workunit.client.1.smithi116.stdout:3/85: stat d3/f11 0 2024-09-13T21:40:13.611 INFO:tasks.workunit.client.1.smithi116.stdout:3/86: read - d3/db/d10/f13 zero size 2024-09-13T21:40:13.612 INFO:tasks.workunit.client.1.smithi116.stdout:3/87: creat d3/db/d10/d1d/f1e x:0 0 0 2024-09-13T21:40:13.617 INFO:tasks.workunit.client.1.smithi116.stdout:5/77: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:13.617 INFO:tasks.workunit.client.1.smithi116.stdout:3/88: fsync d3/f1b 0 2024-09-13T21:40:13.619 INFO:tasks.workunit.client.1.smithi116.stdout:5/78: rename d7/da/lf to d7/da/l13 0 2024-09-13T21:40:13.619 INFO:tasks.workunit.client.1.smithi116.stdout:5/79: truncate d7/da/f11 704011 0 2024-09-13T21:40:13.624 INFO:tasks.workunit.client.1.smithi116.stdout:5/80: dread f1 [0,4194304] 0 2024-09-13T21:40:13.625 INFO:tasks.workunit.client.1.smithi116.stdout:5/81: mknod d7/c14 0 2024-09-13T21:40:13.626 INFO:tasks.workunit.client.1.smithi116.stdout:5/82: symlink d7/da/l15 0 2024-09-13T21:40:13.626 INFO:tasks.workunit.client.1.smithi116.stdout:5/83: write d7/da/f11 [1274871,87813] 0 2024-09-13T21:40:13.627 INFO:tasks.workunit.client.1.smithi116.stdout:5/84: rename d7/f8 to d7/f16 0 2024-09-13T21:40:13.627 INFO:tasks.workunit.client.1.smithi116.stdout:5/85: stat d7/da 0 2024-09-13T21:40:13.633 INFO:tasks.workunit.client.1.smithi116.stdout:5/86: write d7/f16 [1269684,16193] 0 2024-09-13T21:40:13.633 INFO:tasks.workunit.client.1.smithi116.stdout:5/87: chown d7/ce 141285953 1 2024-09-13T21:40:13.633 INFO:tasks.workunit.client.1.smithi116.stdout:5/88: write d7/da/f10 [663265,11625] 0 2024-09-13T21:40:13.635 INFO:tasks.workunit.client.1.smithi116.stdout:5/89: fsync d7/da/f11 0 2024-09-13T21:40:13.635 INFO:tasks.workunit.client.1.smithi116.stdout:3/89: dwrite d3/db/d10/f13 [0,4194304] 0 2024-09-13T21:40:13.635 INFO:tasks.workunit.client.1.smithi116.stdout:5/90: write f1 [2623873,62922] 0 2024-09-13T21:40:13.635 INFO:tasks.workunit.client.1.smithi116.stdout:5/91: chown c3 3032 1 2024-09-13T21:40:13.637 INFO:tasks.workunit.client.1.smithi116.stdout:3/90: link d3/f11 d3/db/d10/d1c/f1f 0 2024-09-13T21:40:13.638 INFO:tasks.workunit.client.1.smithi116.stdout:3/91: mkdir d3/db/d20 0 2024-09-13T21:40:13.639 INFO:tasks.workunit.client.1.smithi116.stdout:3/92: creat d3/db/d10/d1c/f21 x:0 0 0 2024-09-13T21:40:13.640 INFO:tasks.workunit.client.1.smithi116.stdout:3/93: fdatasync d3/db/ff 0 2024-09-13T21:40:13.640 INFO:tasks.workunit.client.1.smithi116.stdout:3/94: mknod d3/c22 0 2024-09-13T21:40:13.642 INFO:tasks.workunit.client.1.smithi116.stdout:3/95: dread d3/fc [0,4194304] 0 2024-09-13T21:40:13.643 INFO:tasks.workunit.client.1.smithi116.stdout:5/92: write d7/fc [1091750,17853] 0 2024-09-13T21:40:13.643 INFO:tasks.workunit.client.1.smithi116.stdout:3/96: rename d3/f1b to d3/db/d20/f23 0 2024-09-13T21:40:13.643 INFO:tasks.workunit.client.1.smithi116.stdout:3/97: write d3/db/d10/f18 [1640751,43980] 0 2024-09-13T21:40:13.644 INFO:tasks.workunit.client.1.smithi116.stdout:5/93: mknod d7/da/c17 0 2024-09-13T21:40:13.645 INFO:tasks.workunit.client.1.smithi116.stdout:3/98: mknod d3/db/c24 0 2024-09-13T21:40:13.645 INFO:tasks.workunit.client.1.smithi116.stdout:3/99: readlink d3/l6 0 2024-09-13T21:40:13.646 INFO:tasks.workunit.client.1.smithi116.stdout:3/100: mkdir d3/db/d20/d25 0 2024-09-13T21:40:13.646 INFO:tasks.workunit.client.1.smithi116.stdout:3/101: write d3/db/d10/d1c/f1f [856281,19793] 0 2024-09-13T21:40:13.646 INFO:tasks.workunit.client.1.smithi116.stdout:5/94: fsync d7/da/f10 0 2024-09-13T21:40:13.648 INFO:tasks.workunit.client.1.smithi116.stdout:5/95: rename d7/da/cb to d7/c18 0 2024-09-13T21:40:13.649 INFO:tasks.workunit.client.1.smithi116.stdout:5/96: rename d7/da/f10 to d7/da/f19 0 2024-09-13T21:40:13.667 INFO:tasks.workunit.client.1.smithi116.stdout:3/102: dwrite d3/db/d10/d1d/f1e [0,4194304] 0 2024-09-13T21:40:13.667 INFO:tasks.workunit.client.1.smithi116.stdout:5/97: dwrite d7/da/f11 [0,4194304] 0 2024-09-13T21:40:13.672 INFO:tasks.workunit.client.1.smithi116.stdout:5/98: mknod d7/c1a 0 2024-09-13T21:40:13.673 INFO:tasks.workunit.client.1.smithi116.stdout:5/99: dread d7/da/f19 [0,4194304] 0 2024-09-13T21:40:13.673 INFO:tasks.workunit.client.1.smithi116.stdout:5/100: creat d7/da/f1b x:0 0 0 2024-09-13T21:40:13.673 INFO:tasks.workunit.client.1.smithi116.stdout:5/101: creat d7/da/f1c x:0 0 0 2024-09-13T21:40:13.673 INFO:tasks.workunit.client.1.smithi116.stdout:5/102: write f1 [4221209,35349] 0 2024-09-13T21:40:13.673 INFO:tasks.workunit.client.1.smithi116.stdout:3/103: write d3/db/d10/f15 [1033244,115075] 0 2024-09-13T21:40:13.681 INFO:tasks.workunit.client.1.smithi116.stdout:5/103: write d7/da/f11 [986247,50064] 0 2024-09-13T21:40:13.681 INFO:tasks.workunit.client.1.smithi116.stdout:5/104: chown d7/da/f19 1 1 2024-09-13T21:40:13.683 INFO:tasks.workunit.client.1.smithi116.stdout:5/105: fdatasync d7/fc 0 2024-09-13T21:40:13.683 INFO:tasks.workunit.client.1.smithi116.stdout:5/106: write d7/fc [650935,105359] 0 2024-09-13T21:40:13.695 INFO:tasks.workunit.client.1.smithi116.stdout:3/104: dwrite d3/f8 [0,4194304] 0 2024-09-13T21:40:13.697 INFO:tasks.workunit.client.1.smithi116.stdout:3/105: mkdir d3/db/d26 0 2024-09-13T21:40:13.698 INFO:tasks.workunit.client.1.smithi116.stdout:3/106: mknod d3/db/d10/d1d/c27 0 2024-09-13T21:40:13.812 INFO:tasks.workunit.client.1.smithi116.stdout:5/107: dwrite f1 [0,4194304] 0 2024-09-13T21:40:13.813 INFO:tasks.workunit.client.1.smithi116.stdout:5/108: mkdir d7/d1d 0 2024-09-13T21:40:13.814 INFO:tasks.workunit.client.1.smithi116.stdout:5/109: symlink d7/d1d/l1e 0 2024-09-13T21:40:13.814 INFO:tasks.workunit.client.1.smithi116.stdout:5/110: stat d7/c18 0 2024-09-13T21:40:13.815 INFO:tasks.workunit.client.1.smithi116.stdout:5/111: mknod d7/d1d/c1f 0 2024-09-13T21:40:13.816 INFO:tasks.workunit.client.1.smithi116.stdout:5/112: link d7/da/f1b d7/d1d/f20 0 2024-09-13T21:40:13.817 INFO:tasks.workunit.client.1.smithi116.stdout:5/113: mkdir d7/da/d21 0 2024-09-13T21:40:13.818 INFO:tasks.workunit.client.1.smithi116.stdout:5/114: mknod d7/da/d21/c22 0 2024-09-13T21:40:13.819 INFO:tasks.workunit.client.1.smithi116.stdout:5/115: mknod d7/da/c23 0 2024-09-13T21:40:13.820 INFO:tasks.workunit.client.1.smithi116.stdout:5/116: mknod d7/c24 0 2024-09-13T21:40:13.820 INFO:tasks.workunit.client.1.smithi116.stdout:5/117: write d7/da/f19 [1020062,54601] 0 2024-09-13T21:40:13.820 INFO:tasks.workunit.client.1.smithi116.stdout:5/118: stat d7/ce 0 2024-09-13T21:40:13.835 INFO:tasks.workunit.client.1.smithi116.stdout:5/119: dwrite d7/da/f1c [0,4194304] 0 2024-09-13T21:40:13.836 INFO:tasks.workunit.client.1.smithi116.stdout:5/120: rmdir d7 39 2024-09-13T21:40:13.838 INFO:tasks.workunit.client.1.smithi116.stdout:5/121: creat d7/f25 x:0 0 0 2024-09-13T21:40:13.838 INFO:tasks.workunit.client.1.smithi116.stdout:5/122: chown f1 829429 1 2024-09-13T21:40:13.838 INFO:tasks.workunit.client.1.smithi116.stdout:5/123: truncate d7/da/f19 1247930 0 2024-09-13T21:40:13.845 INFO:tasks.workunit.client.1.smithi116.stdout:5/124: write d7/da/f1c [3305180,115563] 0 2024-09-13T21:40:13.846 INFO:tasks.workunit.client.1.smithi116.stdout:5/125: dread - d7/f25 zero size 2024-09-13T21:40:13.846 INFO:tasks.workunit.client.1.smithi116.stdout:5/126: read d7/fc [4123608,3038] 0 2024-09-13T21:40:13.846 INFO:tasks.workunit.client.1.smithi116.stdout:5/127: write d7/d1d/f20 [866539,46509] 0 2024-09-13T21:40:13.846 INFO:tasks.workunit.client.1.smithi116.stdout:5/128: rename d7/da/l13 to d7/d1d/l26 0 2024-09-13T21:40:13.856 INFO:tasks.workunit.client.1.smithi116.stdout:5/129: dread d7/f16 [0,4194304] 0 2024-09-13T21:40:13.856 INFO:tasks.workunit.client.1.smithi116.stdout:5/130: readlink d7/d1d/l1e 0 2024-09-13T21:40:13.857 INFO:tasks.workunit.client.1.smithi116.stdout:5/131: rename d7/da/f11 to d7/da/f27 0 2024-09-13T21:40:13.858 INFO:tasks.workunit.client.1.smithi116.stdout:5/132: symlink d7/da/d21/l28 0 2024-09-13T21:40:13.875 INFO:tasks.workunit.client.1.smithi116.stdout:5/133: dwrite d7/f16 [0,4194304] 0 2024-09-13T21:40:13.876 INFO:tasks.workunit.client.1.smithi116.stdout:5/134: creat d7/d1d/f29 x:0 0 0 2024-09-13T21:40:13.877 INFO:tasks.workunit.client.1.smithi116.stdout:5/135: symlink d7/da/d21/l2a 0 2024-09-13T21:40:13.877 INFO:tasks.workunit.client.1.smithi116.stdout:5/136: symlink d7/l2b 0 2024-09-13T21:40:13.878 INFO:tasks.workunit.client.1.smithi116.stdout:5/137: symlink d7/l2c 0 2024-09-13T21:40:13.897 INFO:tasks.workunit.client.1.smithi116.stdout:5/138: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:13.904 INFO:tasks.workunit.client.1.smithi116.stdout:5/139: dread d7/f12 [0,4194304] 0 2024-09-13T21:40:13.904 INFO:tasks.workunit.client.1.smithi116.stdout:5/140: truncate d7/d1d/f29 381934 0 2024-09-13T21:40:13.905 INFO:tasks.workunit.client.1.smithi116.stdout:5/141: rename c3 to d7/d1d/c2d 0 2024-09-13T21:40:13.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/142: fsync d7/da/f27 0 2024-09-13T21:40:13.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/143: fsync d7/f25 0 2024-09-13T21:40:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:15 smithi088 ceph-mon[27963]: pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 878 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s rd, 9.5 MiB/s wr, 1.04k op/s 2024-09-13T21:40:15.497 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:15 smithi116 ceph-mon[33391]: pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 878 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s rd, 9.5 MiB/s wr, 1.04k op/s 2024-09-13T21:40:15.567 INFO:tasks.workunit.client.0.smithi088.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T21:40:15.580 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T21:40:15.581 INFO:tasks.workunit.client.0.smithi088.stderr:+ make 2024-09-13T21:40:15.886 INFO:tasks.workunit.client.0.smithi088.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T21:40:16.144 INFO:tasks.workunit.client.0.smithi088.stderr:++ readlink -f fsstress 2024-09-13T21:40:16.144 INFO:tasks.workunit.client.0.smithi088.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T21:40:16.145 INFO:tasks.workunit.client.0.smithi088.stderr:+ popd 2024-09-13T21:40:16.145 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T21:40:16.146 INFO:tasks.workunit.client.0.smithi088.stderr:+ popd 2024-09-13T21:40:16.146 INFO:tasks.workunit.client.0.smithi088.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T21:40:16.146 INFO:tasks.workunit.client.0.smithi088.stderr:++ mktemp -d -p . 2024-09-13T21:40:16.147 INFO:tasks.workunit.client.0.smithi088.stderr:+ T=./tmp.oEIdpO56Qr 2024-09-13T21:40:16.147 INFO:tasks.workunit.client.0.smithi088.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.oEIdpO56Qr -l 1 -n 1000 -p 10 -v 2024-09-13T21:40:16.148 INFO:tasks.workunit.client.0.smithi088.stdout:seed = 1726411392 2024-09-13T21:40:16.150 INFO:tasks.workunit.client.0.smithi088.stdout:0/0: chown . 11 1 2024-09-13T21:40:16.151 INFO:tasks.workunit.client.0.smithi088.stdout:0/1: write - no filename 2024-09-13T21:40:16.151 INFO:tasks.workunit.client.0.smithi088.stdout:0/2: dwrite - no filename 2024-09-13T21:40:16.151 INFO:tasks.workunit.client.0.smithi088.stdout:1/0: unlink - no file 2024-09-13T21:40:16.152 INFO:tasks.workunit.client.0.smithi088.stdout:0/3: creat f0 x:0 0 0 2024-09-13T21:40:16.152 INFO:tasks.workunit.client.0.smithi088.stdout:0/4: stat f0 0 2024-09-13T21:40:16.152 INFO:tasks.workunit.client.0.smithi088.stdout:0/5: readlink - no filename 2024-09-13T21:40:16.152 INFO:tasks.workunit.client.0.smithi088.stdout:0/6: write f0 [674995,64601] 0 2024-09-13T21:40:16.153 INFO:tasks.workunit.client.0.smithi088.stdout:2/0: write - no filename 2024-09-13T21:40:16.153 INFO:tasks.workunit.client.0.smithi088.stdout:2/1: dwrite - no filename 2024-09-13T21:40:16.153 INFO:tasks.workunit.client.0.smithi088.stdout:2/2: dread - no filename 2024-09-13T21:40:16.153 INFO:tasks.workunit.client.0.smithi088.stdout:2/3: stat - no entries 2024-09-13T21:40:16.153 INFO:tasks.workunit.client.0.smithi088.stdout:2/4: write - no filename 2024-09-13T21:40:16.153 INFO:tasks.workunit.client.0.smithi088.stdout:2/5: dwrite - no filename 2024-09-13T21:40:16.153 INFO:tasks.workunit.client.0.smithi088.stdout:2/6: getdents . 0 2024-09-13T21:40:16.153 INFO:tasks.workunit.client.0.smithi088.stdout:1/1: mknod c0 0 2024-09-13T21:40:16.154 INFO:tasks.workunit.client.0.smithi088.stdout:3/0: dread - no filename 2024-09-13T21:40:16.154 INFO:tasks.workunit.client.0.smithi088.stdout:3/1: getdents . 0 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/2: write - no filename 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/3: unlink - no file 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/4: dread - no filename 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/5: dwrite - no filename 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/6: write - no filename 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/7: write - no filename 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:2/7: creat f0 x:0 0 0 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:2/8: dread - f0 zero size 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:1/2: creat f1 x:0 0 0 2024-09-13T21:40:16.155 INFO:tasks.workunit.client.0.smithi088.stdout:1/3: dread - f1 zero size 2024-09-13T21:40:16.156 INFO:tasks.workunit.client.0.smithi088.stdout:1/4: readlink - no filename 2024-09-13T21:40:16.156 INFO:tasks.workunit.client.0.smithi088.stdout:2/9: mkdir d1 0 2024-09-13T21:40:16.162 INFO:tasks.workunit.client.0.smithi088.stdout:1/5: link c0 c2 0 2024-09-13T21:40:16.162 INFO:tasks.workunit.client.0.smithi088.stdout:1/6: dread - f1 zero size 2024-09-13T21:40:16.165 INFO:tasks.workunit.client.0.smithi088.stdout:2/10: symlink d1/l2 0 2024-09-13T21:40:16.168 INFO:tasks.workunit.client.0.smithi088.stdout:2/11: mknod d1/c3 0 2024-09-13T21:40:16.206 INFO:tasks.workunit.client.0.smithi088.stdout:6/0: rename - no filename 2024-09-13T21:40:16.206 INFO:tasks.workunit.client.0.smithi088.stdout:6/1: dwrite - no filename 2024-09-13T21:40:16.206 INFO:tasks.workunit.client.0.smithi088.stdout:7/0: chown . 10780 1 2024-09-13T21:40:16.207 INFO:tasks.workunit.client.0.smithi088.stdout:5/0: chown . 0 1 2024-09-13T21:40:16.207 INFO:tasks.workunit.client.0.smithi088.stdout:7/1: unlink - no file 2024-09-13T21:40:16.208 INFO:tasks.workunit.client.0.smithi088.stdout:6/2: mkdir d0 0 2024-09-13T21:40:16.208 INFO:tasks.workunit.client.0.smithi088.stdout:6/3: truncate - no filename 2024-09-13T21:40:16.208 INFO:tasks.workunit.client.0.smithi088.stdout:6/4: unlink - no file 2024-09-13T21:40:16.209 INFO:tasks.workunit.client.0.smithi088.stdout:8/0: creat f0 x:0 0 0 2024-09-13T21:40:16.209 INFO:tasks.workunit.client.0.smithi088.stdout:9/0: symlink l0 0 2024-09-13T21:40:16.210 INFO:tasks.workunit.client.0.smithi088.stdout:9/1: write - no filename 2024-09-13T21:40:16.210 INFO:tasks.workunit.client.0.smithi088.stdout:7/2: mknod c0 0 2024-09-13T21:40:16.211 INFO:tasks.workunit.client.0.smithi088.stdout:7/3: fsync - no filename 2024-09-13T21:40:16.211 INFO:tasks.workunit.client.0.smithi088.stdout:7/4: write - no filename 2024-09-13T21:40:16.211 INFO:tasks.workunit.client.0.smithi088.stdout:7/5: dwrite - no filename 2024-09-13T21:40:16.211 INFO:tasks.workunit.client.0.smithi088.stdout:4/0: symlink l0 0 2024-09-13T21:40:16.212 INFO:tasks.workunit.client.0.smithi088.stdout:5/1: symlink l0 0 2024-09-13T21:40:16.213 INFO:tasks.workunit.client.0.smithi088.stdout:6/5: mkdir d0/d1 0 2024-09-13T21:40:16.213 INFO:tasks.workunit.client.0.smithi088.stdout:6/6: dread - no filename 2024-09-13T21:40:16.214 INFO:tasks.workunit.client.0.smithi088.stdout:8/1: mknod c1 0 2024-09-13T21:40:16.214 INFO:tasks.workunit.client.0.smithi088.stdout:8/2: chown f0 10722821 1 2024-09-13T21:40:16.214 INFO:tasks.workunit.client.0.smithi088.stdout:8/3: rmdir - no directory 2024-09-13T21:40:16.214 INFO:tasks.workunit.client.0.smithi088.stdout:8/4: write f0 [730688,72447] 0 2024-09-13T21:40:16.215 INFO:tasks.workunit.client.0.smithi088.stdout:7/6: creat f1 x:0 0 0 2024-09-13T21:40:16.216 INFO:tasks.workunit.client.0.smithi088.stdout:2/12: dwrite f0 [0,4194304] 0 2024-09-13T21:40:16.217 INFO:tasks.workunit.client.0.smithi088.stdout:5/2: creat f1 x:0 0 0 2024-09-13T21:40:16.217 INFO:tasks.workunit.client.0.smithi088.stdout:5/3: chown l0 990877 1 2024-09-13T21:40:16.217 INFO:tasks.workunit.client.0.smithi088.stdout:5/4: chown f1 1371 1 2024-09-13T21:40:16.218 INFO:tasks.workunit.client.0.smithi088.stdout:0/7: dwrite f0 [0,4194304] 0 2024-09-13T21:40:16.219 INFO:tasks.workunit.client.0.smithi088.stdout:6/7: rmdir d0/d1 0 2024-09-13T21:40:16.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/8: chown d0 499 1 2024-09-13T21:40:16.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/9: truncate - no filename 2024-09-13T21:40:16.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/10: stat d0 0 2024-09-13T21:40:16.221 INFO:tasks.workunit.client.0.smithi088.stdout:8/5: unlink c1 0 2024-09-13T21:40:16.222 INFO:tasks.workunit.client.0.smithi088.stdout:1/7: fsync f1 0 2024-09-13T21:40:16.222 INFO:tasks.workunit.client.0.smithi088.stdout:1/8: write f1 [642435,31650] 0 2024-09-13T21:40:16.223 INFO:tasks.workunit.client.0.smithi088.stdout:8/6: dread f0 [0,4194304] 0 2024-09-13T21:40:16.223 INFO:tasks.workunit.client.0.smithi088.stdout:8/7: creat f2 x:0 0 0 2024-09-13T21:40:16.228 INFO:tasks.workunit.client.0.smithi088.stdout:0/8: write f0 [2044985,88392] 0 2024-09-13T21:40:16.228 INFO:tasks.workunit.client.0.smithi088.stdout:0/9: chown f0 22293 1 2024-09-13T21:40:16.228 INFO:tasks.workunit.client.0.smithi088.stdout:0/10: stat f0 0 2024-09-13T21:40:16.228 INFO:tasks.workunit.client.0.smithi088.stdout:0/11: write f0 [1775186,54852] 0 2024-09-13T21:40:16.230 INFO:tasks.workunit.client.0.smithi088.stdout:8/8: mknod c3 0 2024-09-13T21:40:16.230 INFO:tasks.workunit.client.0.smithi088.stdout:8/9: chown f2 0 1 2024-09-13T21:40:16.231 INFO:tasks.workunit.client.0.smithi088.stdout:8/10: symlink l4 0 2024-09-13T21:40:16.232 INFO:tasks.workunit.client.0.smithi088.stdout:2/13: dread f0 [0,4194304] 0 2024-09-13T21:40:16.232 INFO:tasks.workunit.client.0.smithi088.stdout:2/14: stat d1 0 2024-09-13T21:40:16.234 INFO:tasks.workunit.client.0.smithi088.stdout:1/9: dread f1 [0,4194304] 0 2024-09-13T21:40:16.235 INFO:tasks.workunit.client.0.smithi088.stdout:0/12: write f0 [3257502,91419] 0 2024-09-13T21:40:16.235 INFO:tasks.workunit.client.0.smithi088.stdout:0/13: write f0 [2625471,40958] 0 2024-09-13T21:40:16.236 INFO:tasks.workunit.client.0.smithi088.stdout:0/14: symlink l1 0 2024-09-13T21:40:16.236 INFO:tasks.workunit.client.0.smithi088.stdout:1/10: dread f1 [0,4194304] 0 2024-09-13T21:40:16.238 INFO:tasks.workunit.client.0.smithi088.stdout:2/15: dread f0 [0,4194304] 0 2024-09-13T21:40:16.239 INFO:tasks.workunit.client.0.smithi088.stdout:5/5: dwrite f1 [0,4194304] 0 2024-09-13T21:40:16.242 INFO:tasks.workunit.client.0.smithi088.stdout:5/6: rename f1 to f2 0 2024-09-13T21:40:16.242 INFO:tasks.workunit.client.0.smithi088.stdout:4/1: getdents . 0 2024-09-13T21:40:16.242 INFO:tasks.workunit.client.0.smithi088.stdout:4/2: chown l0 11 1 2024-09-13T21:40:16.243 INFO:tasks.workunit.client.0.smithi088.stdout:2/16: rename f0 to d1/f4 0 2024-09-13T21:40:16.245 INFO:tasks.workunit.client.0.smithi088.stdout:4/3: creat f1 x:0 0 0 2024-09-13T21:40:16.248 INFO:tasks.workunit.client.0.smithi088.stdout:4/4: mkdir d2 0 2024-09-13T21:40:16.248 INFO:tasks.workunit.client.0.smithi088.stdout:4/5: truncate f1 958481 0 2024-09-13T21:40:16.250 INFO:tasks.workunit.client.0.smithi088.stdout:6/11: getdents d0 0 2024-09-13T21:40:16.250 INFO:tasks.workunit.client.0.smithi088.stdout:6/12: truncate - no filename 2024-09-13T21:40:16.250 INFO:tasks.workunit.client.0.smithi088.stdout:6/13: readlink - no filename 2024-09-13T21:40:16.250 INFO:tasks.workunit.client.0.smithi088.stdout:6/14: dwrite - no filename 2024-09-13T21:40:16.250 INFO:tasks.workunit.client.0.smithi088.stdout:6/15: fdatasync - no filename 2024-09-13T21:40:16.252 INFO:tasks.workunit.client.0.smithi088.stdout:8/11: dwrite f0 [0,4194304] 0 2024-09-13T21:40:16.253 INFO:tasks.workunit.client.0.smithi088.stdout:4/6: rename l0 to d2/l3 0 2024-09-13T21:40:16.254 INFO:tasks.workunit.client.0.smithi088.stdout:4/7: write f1 [505730,805] 0 2024-09-13T21:40:16.255 INFO:tasks.workunit.client.0.smithi088.stdout:6/16: creat d0/f2 x:0 0 0 2024-09-13T21:40:16.256 INFO:tasks.workunit.client.0.smithi088.stdout:6/17: truncate d0/f2 510602 0 2024-09-13T21:40:16.256 INFO:tasks.workunit.client.0.smithi088.stdout:6/18: truncate d0/f2 879793 0 2024-09-13T21:40:16.260 INFO:tasks.workunit.client.0.smithi088.stdout:6/19: mkdir d0/d3 0 2024-09-13T21:40:16.260 INFO:tasks.workunit.client.0.smithi088.stdout:6/20: write d0/f2 [1649054,62613] 0 2024-09-13T21:40:16.273 INFO:tasks.workunit.client.0.smithi088.stdout:1/11: dwrite f1 [0,4194304] 0 2024-09-13T21:40:16.274 INFO:tasks.workunit.client.0.smithi088.stdout:0/15: truncate f0 1395817 0 2024-09-13T21:40:16.274 INFO:tasks.workunit.client.0.smithi088.stdout:5/7: dwrite f2 [0,4194304] 0 2024-09-13T21:40:16.274 INFO:tasks.workunit.client.0.smithi088.stdout:8/12: dwrite f2 [0,4194304] 0 2024-09-13T21:40:16.275 INFO:tasks.workunit.client.0.smithi088.stdout:1/12: symlink l3 0 2024-09-13T21:40:16.282 INFO:tasks.workunit.client.0.smithi088.stdout:8/13: getdents . 0 2024-09-13T21:40:16.282 INFO:tasks.workunit.client.0.smithi088.stdout:8/14: fsync f2 0 2024-09-13T21:40:16.284 INFO:tasks.workunit.client.0.smithi088.stdout:8/15: symlink l5 0 2024-09-13T21:40:16.286 INFO:tasks.workunit.client.0.smithi088.stdout:8/16: creat f6 x:0 0 0 2024-09-13T21:40:16.288 INFO:tasks.workunit.client.0.smithi088.stdout:8/17: chown f0 1 1 2024-09-13T21:40:16.289 INFO:tasks.workunit.client.0.smithi088.stdout:6/21: getdents d0 0 2024-09-13T21:40:16.289 INFO:tasks.workunit.client.0.smithi088.stdout:5/8: write f2 [2596426,10624] 0 2024-09-13T21:40:16.291 INFO:tasks.workunit.client.0.smithi088.stdout:6/22: rmdir d0 39 2024-09-13T21:40:16.291 INFO:tasks.workunit.client.0.smithi088.stdout:6/23: chown d0/f2 215 1 2024-09-13T21:40:16.291 INFO:tasks.workunit.client.0.smithi088.stdout:6/24: chown d0 1 1 2024-09-13T21:40:16.293 INFO:tasks.workunit.client.0.smithi088.stdout:8/18: symlink l7 0 2024-09-13T21:40:16.295 INFO:tasks.workunit.client.0.smithi088.stdout:8/19: rename f6 to f8 0 2024-09-13T21:40:16.299 INFO:tasks.workunit.client.0.smithi088.stdout:5/9: fsync f2 0 2024-09-13T21:40:16.299 INFO:tasks.workunit.client.0.smithi088.stdout:5/10: creat f3 x:0 0 0 2024-09-13T21:40:16.305 INFO:tasks.workunit.client.0.smithi088.stdout:4/8: dwrite f1 [0,4194304] 0 2024-09-13T21:40:16.307 INFO:tasks.workunit.client.0.smithi088.stdout:4/9: symlink d2/l4 0 2024-09-13T21:40:16.307 INFO:tasks.workunit.client.0.smithi088.stdout:4/10: truncate f1 4463231 0 2024-09-13T21:40:16.316 INFO:tasks.workunit.client.0.smithi088.stdout:1/13: dwrite f1 [0,4194304] 0 2024-09-13T21:40:16.316 INFO:tasks.workunit.client.0.smithi088.stdout:1/14: creat f4 x:0 0 0 2024-09-13T21:40:16.317 INFO:tasks.workunit.client.0.smithi088.stdout:1/15: creat f5 x:0 0 0 2024-09-13T21:40:16.317 INFO:tasks.workunit.client.0.smithi088.stdout:1/16: creat f6 x:0 0 0 2024-09-13T21:40:16.317 INFO:tasks.workunit.client.0.smithi088.stdout:8/20: dwrite f0 [0,4194304] 0 2024-09-13T21:40:16.317 INFO:tasks.workunit.client.0.smithi088.stdout:0/16: dwrite f0 [0,4194304] 0 2024-09-13T21:40:16.322 INFO:tasks.workunit.client.0.smithi088.stdout:5/11: truncate f2 170274 0 2024-09-13T21:40:16.322 INFO:tasks.workunit.client.0.smithi088.stdout:1/17: mknod c7 0 2024-09-13T21:40:16.325 INFO:tasks.workunit.client.0.smithi088.stdout:5/12: mkdir d4 0 2024-09-13T21:40:16.325 INFO:tasks.workunit.client.0.smithi088.stdout:5/13: getdents d4 0 2024-09-13T21:40:16.360 INFO:tasks.workunit.client.0.smithi088.stdout:1/18: symlink l8 0 2024-09-13T21:40:16.362 INFO:tasks.workunit.client.0.smithi088.stdout:1/19: mkdir d9 0 2024-09-13T21:40:16.362 INFO:tasks.workunit.client.0.smithi088.stdout:1/20: dread - f6 zero size 2024-09-13T21:40:16.362 INFO:tasks.workunit.client.0.smithi088.stdout:1/21: fdatasync f6 0 2024-09-13T21:40:16.362 INFO:tasks.workunit.client.0.smithi088.stdout:1/22: symlink d9/la 0 2024-09-13T21:40:16.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/17: write f0 [1258336,87291] 0 2024-09-13T21:40:16.366 INFO:tasks.workunit.client.0.smithi088.stdout:0/18: symlink l2 0 2024-09-13T21:40:16.371 INFO:tasks.workunit.client.0.smithi088.stdout:8/21: dwrite f8 [0,4194304] 0 2024-09-13T21:40:16.371 INFO:tasks.workunit.client.0.smithi088.stdout:6/25: dwrite d0/f2 [0,4194304] 0 2024-09-13T21:40:16.377 INFO:tasks.workunit.client.0.smithi088.stdout:6/26: rmdir d0/d3 0 2024-09-13T21:40:16.377 INFO:tasks.workunit.client.0.smithi088.stdout:6/27: rename d0 to d0/d4 22 2024-09-13T21:40:16.378 INFO:tasks.workunit.client.0.smithi088.stdout:0/19: dread f0 [0,4194304] 0 2024-09-13T21:40:16.378 INFO:tasks.workunit.client.0.smithi088.stdout:0/20: creat f3 x:0 0 0 2024-09-13T21:40:16.378 INFO:tasks.workunit.client.0.smithi088.stdout:8/22: rename l4 to l9 0 2024-09-13T21:40:16.392 INFO:tasks.workunit.client.0.smithi088.stdout:6/28: dread d0/f2 [0,4194304] 0 2024-09-13T21:40:16.392 INFO:tasks.workunit.client.0.smithi088.stdout:1/23: dwrite f5 [0,4194304] 0 2024-09-13T21:40:16.392 INFO:tasks.workunit.client.0.smithi088.stdout:6/29: fdatasync d0/f2 0 2024-09-13T21:40:16.394 INFO:tasks.workunit.client.0.smithi088.stdout:1/24: mknod d9/cb 0 2024-09-13T21:40:16.395 INFO:tasks.workunit.client.0.smithi088.stdout:8/23: dread f8 [0,4194304] 0 2024-09-13T21:40:16.395 INFO:tasks.workunit.client.0.smithi088.stdout:1/25: truncate f1 1396318 0 2024-09-13T21:40:16.397 INFO:tasks.workunit.client.0.smithi088.stdout:1/26: mkdir d9/dc 0 2024-09-13T21:40:16.397 INFO:tasks.workunit.client.0.smithi088.stdout:1/27: getdents d9/dc 0 2024-09-13T21:40:16.402 INFO:tasks.workunit.client.0.smithi088.stdout:8/24: write f0 [3791214,112545] 0 2024-09-13T21:40:16.414 INFO:tasks.workunit.client.0.smithi088.stdout:6/30: dwrite d0/f2 [0,4194304] 0 2024-09-13T21:40:16.416 INFO:tasks.workunit.client.0.smithi088.stdout:6/31: mknod d0/c5 0 2024-09-13T21:40:16.416 INFO:tasks.workunit.client.0.smithi088.stdout:6/32: rmdir d0 39 2024-09-13T21:40:16.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/33: creat d0/f6 x:0 0 0 2024-09-13T21:40:16.418 INFO:tasks.workunit.client.0.smithi088.stdout:6/34: symlink d0/l7 0 2024-09-13T21:40:16.420 INFO:tasks.workunit.client.0.smithi088.stdout:1/28: dwrite f4 [0,4194304] 0 2024-09-13T21:40:16.421 INFO:tasks.workunit.client.0.smithi088.stdout:6/35: truncate d0/f2 3833764 0 2024-09-13T21:40:16.424 INFO:tasks.workunit.client.0.smithi088.stdout:6/36: symlink d0/l8 0 2024-09-13T21:40:16.425 INFO:tasks.workunit.client.0.smithi088.stdout:6/37: fsync d0/f6 0 2024-09-13T21:40:16.430 INFO:tasks.workunit.client.0.smithi088.stdout:6/38: truncate d0/f2 3000434 0 2024-09-13T21:40:16.432 INFO:tasks.workunit.client.0.smithi088.stdout:6/39: symlink d0/l9 0 2024-09-13T21:40:16.433 INFO:tasks.workunit.client.0.smithi088.stdout:6/40: mkdir d0/da 0 2024-09-13T21:40:16.433 INFO:tasks.workunit.client.0.smithi088.stdout:6/41: fdatasync d0/f2 0 2024-09-13T21:40:16.433 INFO:tasks.workunit.client.0.smithi088.stdout:6/42: read - d0/f6 zero size 2024-09-13T21:40:16.434 INFO:tasks.workunit.client.0.smithi088.stdout:6/43: rename d0/da to d0/db 0 2024-09-13T21:40:16.441 INFO:tasks.workunit.client.0.smithi088.stdout:6/44: dread d0/f2 [0,4194304] 0 2024-09-13T21:40:16.443 INFO:tasks.workunit.client.0.smithi088.stdout:6/45: rename d0/l9 to d0/lc 0 2024-09-13T21:40:16.446 INFO:tasks.workunit.client.0.smithi088.stdout:6/46: read d0/f2 [1381805,105417] 0 2024-09-13T21:40:16.446 INFO:tasks.workunit.client.0.smithi088.stdout:1/29: dwrite f4 [0,4194304] 0 2024-09-13T21:40:16.450 INFO:tasks.workunit.client.0.smithi088.stdout:6/47: rmdir d0 39 2024-09-13T21:40:16.455 INFO:tasks.workunit.client.0.smithi088.stdout:1/30: dread f5 [0,4194304] 0 2024-09-13T21:40:16.456 INFO:tasks.workunit.client.0.smithi088.stdout:1/31: rename f4 to d9/fd 0 2024-09-13T21:40:16.476 INFO:tasks.workunit.client.0.smithi088.stdout:6/48: dwrite d0/f2 [0,4194304] 0 2024-09-13T21:40:16.476 INFO:tasks.workunit.client.0.smithi088.stdout:6/49: chown d0/lc 4800404 1 2024-09-13T21:40:16.476 INFO:tasks.workunit.client.0.smithi088.stdout:6/50: fdatasync d0/f2 0 2024-09-13T21:40:16.476 INFO:tasks.workunit.client.0.smithi088.stdout:6/51: rename d0 to d0/db/dd 22 2024-09-13T21:40:16.476 INFO:tasks.workunit.client.0.smithi088.stdout:6/52: chown d0 194923724 1 2024-09-13T21:40:16.476 INFO:tasks.workunit.client.0.smithi088.stdout:1/32: dwrite f6 [0,4194304] 0 2024-09-13T21:40:16.477 INFO:tasks.workunit.client.0.smithi088.stdout:6/53: rename d0/lc to d0/le 0 2024-09-13T21:40:16.501 INFO:tasks.workunit.client.0.smithi088.stdout:1/33: dwrite f5 [0,4194304] 0 2024-09-13T21:40:16.501 INFO:tasks.workunit.client.0.smithi088.stdout:6/54: dwrite d0/f2 [4194304,4194304] 0 2024-09-13T21:40:16.503 INFO:tasks.workunit.client.0.smithi088.stdout:6/55: creat d0/ff x:0 0 0 2024-09-13T21:40:16.503 INFO:tasks.workunit.client.0.smithi088.stdout:6/56: write d0/ff [733125,116517] 0 2024-09-13T21:40:16.503 INFO:tasks.workunit.client.0.smithi088.stdout:6/57: chown d0/le 76 1 2024-09-13T21:40:16.504 INFO:tasks.workunit.client.0.smithi088.stdout:6/58: unlink d0/f2 0 2024-09-13T21:40:16.510 INFO:tasks.workunit.client.0.smithi088.stdout:1/34: dread f6 [0,4194304] 0 2024-09-13T21:40:16.511 INFO:tasks.workunit.client.0.smithi088.stdout:1/35: rename d9/la to d9/le 0 2024-09-13T21:40:16.512 INFO:tasks.workunit.client.0.smithi088.stdout:1/36: symlink d9/lf 0 2024-09-13T21:40:16.529 INFO:tasks.workunit.client.0.smithi088.stdout:1/37: dwrite f6 [0,4194304] 0 2024-09-13T21:40:16.538 INFO:tasks.workunit.client.0.smithi088.stdout:1/38: dread f6 [0,4194304] 0 2024-09-13T21:40:16.538 INFO:tasks.workunit.client.0.smithi088.stdout:1/39: fdatasync f6 0 2024-09-13T21:40:16.554 INFO:tasks.workunit.client.0.smithi088.stdout:1/40: dwrite f5 [4194304,4194304] 0 2024-09-13T21:40:16.554 INFO:tasks.workunit.client.0.smithi088.stdout:1/41: chown d9/le 1901 1 2024-09-13T21:40:16.556 INFO:tasks.workunit.client.0.smithi088.stdout:1/42: mkdir d9/d10 0 2024-09-13T21:40:16.557 INFO:tasks.workunit.client.0.smithi088.stdout:1/43: creat d9/d10/f11 x:0 0 0 2024-09-13T21:40:16.557 INFO:tasks.workunit.client.0.smithi088.stdout:1/44: fsync f6 0 2024-09-13T21:40:16.557 INFO:tasks.workunit.client.0.smithi088.stdout:1/45: chown c2 202 1 2024-09-13T21:40:16.566 INFO:tasks.workunit.client.0.smithi088.stdout:1/46: dread d9/fd [0,4194304] 0 2024-09-13T21:40:16.567 INFO:tasks.workunit.client.0.smithi088.stdout:1/47: creat d9/f12 x:0 0 0 2024-09-13T21:40:16.584 INFO:tasks.workunit.client.0.smithi088.stdout:1/48: dwrite f1 [0,4194304] 0 2024-09-13T21:40:16.585 INFO:tasks.workunit.client.0.smithi088.stdout:1/49: symlink d9/d10/l13 0 2024-09-13T21:40:16.585 INFO:tasks.workunit.client.0.smithi088.stdout:1/50: creat d9/f14 x:0 0 0 2024-09-13T21:40:16.586 INFO:tasks.workunit.client.0.smithi088.stdout:1/51: mkdir d9/dc/d15 0 2024-09-13T21:40:16.590 INFO:tasks.workunit.client.0.smithi088.stdout:1/52: rmdir d9 39 2024-09-13T21:40:16.605 INFO:tasks.workunit.client.0.smithi088.stdout:1/53: dwrite d9/f14 [0,4194304] 0 2024-09-13T21:40:16.607 INFO:tasks.workunit.client.0.smithi088.stdout:1/54: rename f5 to d9/f16 0 2024-09-13T21:40:16.608 INFO:tasks.workunit.client.0.smithi088.stdout:1/55: creat d9/d10/f17 x:0 0 0 2024-09-13T21:40:16.610 INFO:tasks.workunit.client.0.smithi088.stdout:1/56: rename d9/dc/d15 to d9/d18 0 2024-09-13T21:40:16.614 INFO:tasks.workunit.client.0.smithi088.stdout:1/57: read d9/fd [649340,59222] 0 2024-09-13T21:40:16.618 INFO:tasks.workunit.client.0.smithi088.stdout:1/58: getdents d9/d10 0 2024-09-13T21:40:16.619 INFO:tasks.workunit.client.0.smithi088.stdout:1/59: getdents d9/dc 0 2024-09-13T21:40:16.619 INFO:tasks.workunit.client.0.smithi088.stdout:1/60: creat d9/f19 x:0 0 0 2024-09-13T21:40:16.624 INFO:tasks.workunit.client.0.smithi088.stdout:1/61: dread f6 [0,4194304] 0 2024-09-13T21:40:16.625 INFO:tasks.workunit.client.0.smithi088.stdout:1/62: mkdir d9/d10/d1a 0 2024-09-13T21:40:16.626 INFO:tasks.workunit.client.0.smithi088.stdout:1/63: symlink d9/d18/l1b 0 2024-09-13T21:40:16.626 INFO:tasks.workunit.client.0.smithi088.stdout:1/64: chown d9/d10/f17 1385384 1 2024-09-13T21:40:16.631 INFO:tasks.workunit.client.0.smithi088.stdout:1/65: write f6 [3617401,40383] 0 2024-09-13T21:40:16.632 INFO:tasks.workunit.client.0.smithi088.stdout:1/66: unlink f6 0 2024-09-13T21:40:16.633 INFO:tasks.workunit.client.0.smithi088.stdout:1/67: rmdir d9/d10/d1a 0 2024-09-13T21:40:16.634 INFO:tasks.workunit.client.0.smithi088.stdout:1/68: link d9/cb d9/dc/c1c 0 2024-09-13T21:40:16.636 INFO:tasks.workunit.client.0.smithi088.stdout:1/69: unlink d9/d10/l13 0 2024-09-13T21:40:16.636 INFO:tasks.workunit.client.0.smithi088.stdout:1/70: creat d9/d18/f1d x:0 0 0 2024-09-13T21:40:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:16 smithi116 ceph-mon[33391]: pgmap v248: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 19 MiB/s wr, 1.15k op/s 2024-09-13T21:40:17.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:16 smithi088 ceph-mon[27963]: pgmap v248: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 19 MiB/s wr, 1.15k op/s 2024-09-13T21:40:18.261 INFO:tasks.workunit.client.0.smithi088.stdout:3/8: sync 2024-09-13T21:40:18.261 INFO:tasks.workunit.client.0.smithi088.stdout:9/2: sync 2024-09-13T21:40:18.261 INFO:tasks.workunit.client.0.smithi088.stdout:0/21: sync 2024-09-13T21:40:18.261 INFO:tasks.workunit.client.0.smithi088.stdout:3/9: dread - no filename 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:3/10: dread - no filename 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:3/11: write - no filename 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:3/12: rmdir - no directory 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:9/3: chown l0 9212549 1 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:0/22: fsync f0 0 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:5/14: sync 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:4/11: sync 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:9/4: read - no filename 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:9/5: fdatasync - no filename 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:1/71: sync 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:9/6: chown l0 5 1 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:6/59: sync 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:1/72: chown l3 4614 1 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:1/73: fdatasync d9/d10/f17 0 2024-09-13T21:40:18.262 INFO:tasks.workunit.client.0.smithi088.stdout:7/7: sync 2024-09-13T21:40:18.263 INFO:tasks.workunit.client.0.smithi088.stdout:8/25: sync 2024-09-13T21:40:18.263 INFO:tasks.workunit.client.0.smithi088.stdout:2/17: sync 2024-09-13T21:40:18.263 INFO:tasks.workunit.client.0.smithi088.stdout:7/8: write f1 [150442,61701] 0 2024-09-13T21:40:18.263 INFO:tasks.workunit.client.0.smithi088.stdout:7/9: chown f1 32322520 1 2024-09-13T21:40:18.263 INFO:tasks.workunit.client.0.smithi088.stdout:5/15: creat d4/f5 x:0 0 0 2024-09-13T21:40:18.263 INFO:tasks.workunit.client.0.smithi088.stdout:3/13: creat f0 x:0 0 0 2024-09-13T21:40:18.264 INFO:tasks.workunit.client.0.smithi088.stdout:3/14: stat f0 0 2024-09-13T21:40:18.264 INFO:tasks.workunit.client.0.smithi088.stdout:5/16: dread - d4/f5 zero size 2024-09-13T21:40:18.264 INFO:tasks.workunit.client.0.smithi088.stdout:5/17: stat d4/f5 0 2024-09-13T21:40:18.264 INFO:tasks.workunit.client.0.smithi088.stdout:5/18: dread - f3 zero size 2024-09-13T21:40:18.264 INFO:tasks.workunit.client.0.smithi088.stdout:3/15: creat f1 x:0 0 0 2024-09-13T21:40:18.264 INFO:tasks.workunit.client.0.smithi088.stdout:3/16: chown f1 133043 1 2024-09-13T21:40:18.264 INFO:tasks.workunit.client.0.smithi088.stdout:9/7: mknod c1 0 2024-09-13T21:40:18.264 INFO:tasks.workunit.client.0.smithi088.stdout:9/8: write - no filename 2024-09-13T21:40:18.265 INFO:tasks.workunit.client.0.smithi088.stdout:9/9: dread - no filename 2024-09-13T21:40:18.265 INFO:tasks.workunit.client.0.smithi088.stdout:9/10: chown l0 863945 1 2024-09-13T21:40:18.266 INFO:tasks.workunit.client.0.smithi088.stdout:6/60: creat d0/db/f10 x:0 0 0 2024-09-13T21:40:18.266 INFO:tasks.workunit.client.0.smithi088.stdout:5/19: dread f2 [0,4194304] 0 2024-09-13T21:40:18.266 INFO:tasks.workunit.client.0.smithi088.stdout:5/20: readlink l0 0 2024-09-13T21:40:18.266 INFO:tasks.workunit.client.0.smithi088.stdout:1/74: mknod d9/dc/c1e 0 2024-09-13T21:40:18.267 INFO:tasks.workunit.client.0.smithi088.stdout:8/26: dread f0 [0,4194304] 0 2024-09-13T21:40:18.268 INFO:tasks.workunit.client.0.smithi088.stdout:2/18: symlink d1/l5 0 2024-09-13T21:40:18.270 INFO:tasks.workunit.client.0.smithi088.stdout:5/21: unlink d4/f5 0 2024-09-13T21:40:18.271 INFO:tasks.workunit.client.0.smithi088.stdout:5/22: creat d4/f6 x:0 0 0 2024-09-13T21:40:18.271 INFO:tasks.workunit.client.0.smithi088.stdout:5/23: fdatasync f2 0 2024-09-13T21:40:18.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/75: rmdir d9/dc 39 2024-09-13T21:40:18.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/76: readlink d9/le 0 2024-09-13T21:40:18.274 INFO:tasks.workunit.client.0.smithi088.stdout:2/19: mknod d1/c6 0 2024-09-13T21:40:18.277 INFO:tasks.workunit.client.0.smithi088.stdout:1/77: creat d9/dc/f1f x:0 0 0 2024-09-13T21:40:18.277 INFO:tasks.workunit.client.0.smithi088.stdout:1/78: dread - d9/f12 zero size 2024-09-13T21:40:18.277 INFO:tasks.workunit.client.0.smithi088.stdout:1/79: write d9/d10/f11 [352429,4913] 0 2024-09-13T21:40:18.277 INFO:tasks.workunit.client.0.smithi088.stdout:1/80: write d9/fd [1045824,94197] 0 2024-09-13T21:40:18.278 INFO:tasks.workunit.client.0.smithi088.stdout:2/20: mknod d1/c7 0 2024-09-13T21:40:18.281 INFO:tasks.workunit.client.0.smithi088.stdout:1/81: rmdir d9/d10 39 2024-09-13T21:40:18.281 INFO:tasks.workunit.client.0.smithi088.stdout:1/82: chown d9/d10/f17 62 1 2024-09-13T21:40:18.282 INFO:tasks.workunit.client.0.smithi088.stdout:6/61: dread d0/ff [0,4194304] 0 2024-09-13T21:40:18.285 INFO:tasks.workunit.client.0.smithi088.stdout:9/11: getdents . 0 2024-09-13T21:40:18.285 INFO:tasks.workunit.client.0.smithi088.stdout:9/12: dwrite - no filename 2024-09-13T21:40:18.285 INFO:tasks.workunit.client.0.smithi088.stdout:9/13: dread - no filename 2024-09-13T21:40:18.286 INFO:tasks.workunit.client.0.smithi088.stdout:6/62: getdents d0 0 2024-09-13T21:40:18.289 INFO:tasks.workunit.client.0.smithi088.stdout:9/14: rename c1 to c2 0 2024-09-13T21:40:18.289 INFO:tasks.workunit.client.0.smithi088.stdout:9/15: fdatasync - no filename 2024-09-13T21:40:18.289 INFO:tasks.workunit.client.0.smithi088.stdout:9/16: fdatasync - no filename 2024-09-13T21:40:18.290 INFO:tasks.workunit.client.0.smithi088.stdout:6/63: symlink d0/l11 0 2024-09-13T21:40:18.293 INFO:tasks.workunit.client.0.smithi088.stdout:6/64: getdents d0/db 0 2024-09-13T21:40:18.294 INFO:tasks.workunit.client.0.smithi088.stdout:6/65: write d0/ff [1030587,698] 0 2024-09-13T21:40:18.296 INFO:tasks.workunit.client.0.smithi088.stdout:6/66: creat d0/db/f12 x:0 0 0 2024-09-13T21:40:18.296 INFO:tasks.workunit.client.0.smithi088.stdout:6/67: write d0/db/f10 [744088,115823] 0 2024-09-13T21:40:18.297 INFO:tasks.workunit.client.0.smithi088.stdout:6/68: mkdir d0/db/d13 0 2024-09-13T21:40:18.299 INFO:tasks.workunit.client.0.smithi088.stdout:6/69: symlink d0/db/l14 0 2024-09-13T21:40:18.299 INFO:tasks.workunit.client.0.smithi088.stdout:4/12: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.299 INFO:tasks.workunit.client.0.smithi088.stdout:2/21: dread d1/f4 [0,4194304] 0 2024-09-13T21:40:18.299 INFO:tasks.workunit.client.0.smithi088.stdout:0/23: dwrite f0 [0,4194304] 0 2024-09-13T21:40:18.299 INFO:tasks.workunit.client.0.smithi088.stdout:7/10: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.299 INFO:tasks.workunit.client.0.smithi088.stdout:0/24: chown l1 12367 1 2024-09-13T21:40:18.299 INFO:tasks.workunit.client.0.smithi088.stdout:8/27: dwrite f2 [0,4194304] 0 2024-09-13T21:40:18.302 INFO:tasks.workunit.client.0.smithi088.stdout:2/22: mkdir d1/d8 0 2024-09-13T21:40:18.303 INFO:tasks.workunit.client.0.smithi088.stdout:0/25: mknod c4 0 2024-09-13T21:40:18.305 INFO:tasks.workunit.client.0.smithi088.stdout:8/28: unlink f2 0 2024-09-13T21:40:18.306 INFO:tasks.workunit.client.0.smithi088.stdout:9/17: link c2 c3 0 2024-09-13T21:40:18.314 INFO:tasks.workunit.client.0.smithi088.stdout:6/70: mknod d0/c15 0 2024-09-13T21:40:18.315 INFO:tasks.workunit.client.0.smithi088.stdout:6/71: creat d0/f16 x:0 0 0 2024-09-13T21:40:18.316 INFO:tasks.workunit.client.0.smithi088.stdout:6/72: dread - d0/f6 zero size 2024-09-13T21:40:18.317 INFO:tasks.workunit.client.0.smithi088.stdout:2/23: getdents d1 0 2024-09-13T21:40:18.318 INFO:tasks.workunit.client.0.smithi088.stdout:0/26: dread f0 [0,4194304] 0 2024-09-13T21:40:18.318 INFO:tasks.workunit.client.0.smithi088.stdout:6/73: rmdir d0/db/d13 0 2024-09-13T21:40:18.318 INFO:tasks.workunit.client.0.smithi088.stdout:6/74: write d0/f16 [367227,7161] 0 2024-09-13T21:40:18.319 INFO:tasks.workunit.client.0.smithi088.stdout:2/24: truncate d1/f4 916612 0 2024-09-13T21:40:18.319 INFO:tasks.workunit.client.0.smithi088.stdout:8/29: dread f8 [0,4194304] 0 2024-09-13T21:40:18.321 INFO:tasks.workunit.client.0.smithi088.stdout:0/27: rename f0 to f5 0 2024-09-13T21:40:18.321 INFO:tasks.workunit.client.0.smithi088.stdout:0/28: dread - f3 zero size 2024-09-13T21:40:18.321 INFO:tasks.workunit.client.0.smithi088.stdout:0/29: chown l2 2441933 1 2024-09-13T21:40:18.324 INFO:tasks.workunit.client.0.smithi088.stdout:2/25: symlink d1/l9 0 2024-09-13T21:40:18.324 INFO:tasks.workunit.client.0.smithi088.stdout:2/26: stat d1/f4 0 2024-09-13T21:40:18.325 INFO:tasks.workunit.client.0.smithi088.stdout:2/27: chown d1/c3 6663 1 2024-09-13T21:40:18.325 INFO:tasks.workunit.client.0.smithi088.stdout:2/28: readlink d1/l9 0 2024-09-13T21:40:18.325 INFO:tasks.workunit.client.0.smithi088.stdout:2/29: chown d1/l9 66430 1 2024-09-13T21:40:18.326 INFO:tasks.workunit.client.0.smithi088.stdout:4/13: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.327 INFO:tasks.workunit.client.0.smithi088.stdout:6/75: link d0/ff d0/f17 0 2024-09-13T21:40:18.328 INFO:tasks.workunit.client.0.smithi088.stdout:2/30: unlink d1/c6 0 2024-09-13T21:40:18.328 INFO:tasks.workunit.client.0.smithi088.stdout:2/31: stat d1/d8 0 2024-09-13T21:40:18.329 INFO:tasks.workunit.client.0.smithi088.stdout:2/32: chown d1/l2 153 1 2024-09-13T21:40:18.329 INFO:tasks.workunit.client.0.smithi088.stdout:0/30: dread f5 [0,4194304] 0 2024-09-13T21:40:18.329 INFO:tasks.workunit.client.0.smithi088.stdout:0/31: fsync f3 0 2024-09-13T21:40:18.329 INFO:tasks.workunit.client.0.smithi088.stdout:8/30: rename f0 to fa 0 2024-09-13T21:40:18.332 INFO:tasks.workunit.client.0.smithi088.stdout:6/76: symlink d0/db/l18 0 2024-09-13T21:40:18.332 INFO:tasks.workunit.client.0.smithi088.stdout:2/33: symlink d1/d8/la 0 2024-09-13T21:40:18.332 INFO:tasks.workunit.client.0.smithi088.stdout:7/11: dwrite f1 [4194304,4194304] 0 2024-09-13T21:40:18.337 INFO:tasks.workunit.client.0.smithi088.stdout:8/31: mkdir db 0 2024-09-13T21:40:18.337 INFO:tasks.workunit.client.0.smithi088.stdout:6/77: write d0/ff [109148,99631] 0 2024-09-13T21:40:18.338 INFO:tasks.workunit.client.0.smithi088.stdout:0/32: dread f5 [0,4194304] 0 2024-09-13T21:40:18.338 INFO:tasks.workunit.client.0.smithi088.stdout:8/32: creat db/fc x:0 0 0 2024-09-13T21:40:18.341 INFO:tasks.workunit.client.0.smithi088.stdout:2/34: write d1/f4 [69427,58043] 0 2024-09-13T21:40:18.341 INFO:tasks.workunit.client.0.smithi088.stdout:0/33: link c4 c6 0 2024-09-13T21:40:18.341 INFO:tasks.workunit.client.0.smithi088.stdout:0/34: chown c6 0 1 2024-09-13T21:40:18.341 INFO:tasks.workunit.client.0.smithi088.stdout:7/12: dread f1 [0,4194304] 0 2024-09-13T21:40:18.341 INFO:tasks.workunit.client.0.smithi088.stdout:7/13: chown c0 32834302 1 2024-09-13T21:40:18.341 INFO:tasks.workunit.client.0.smithi088.stdout:7/14: chown f1 133 1 2024-09-13T21:40:18.342 INFO:tasks.workunit.client.0.smithi088.stdout:8/33: link l5 db/ld 0 2024-09-13T21:40:18.345 INFO:tasks.workunit.client.0.smithi088.stdout:7/15: mknod c2 0 2024-09-13T21:40:18.347 INFO:tasks.workunit.client.0.smithi088.stdout:8/34: dread f8 [0,4194304] 0 2024-09-13T21:40:18.347 INFO:tasks.workunit.client.0.smithi088.stdout:8/35: read - db/fc zero size 2024-09-13T21:40:18.348 INFO:tasks.workunit.client.0.smithi088.stdout:7/16: mknod c3 0 2024-09-13T21:40:18.349 INFO:tasks.workunit.client.0.smithi088.stdout:8/36: symlink db/le 0 2024-09-13T21:40:18.350 INFO:tasks.workunit.client.0.smithi088.stdout:2/35: rmdir d1 39 2024-09-13T21:40:18.350 INFO:tasks.workunit.client.0.smithi088.stdout:4/14: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.351 INFO:tasks.workunit.client.0.smithi088.stdout:7/17: symlink l4 0 2024-09-13T21:40:18.351 INFO:tasks.workunit.client.0.smithi088.stdout:7/18: chown c0 0 1 2024-09-13T21:40:18.351 INFO:tasks.workunit.client.0.smithi088.stdout:7/19: readlink l4 0 2024-09-13T21:40:18.352 INFO:tasks.workunit.client.0.smithi088.stdout:8/37: mkdir db/df 0 2024-09-13T21:40:18.353 INFO:tasks.workunit.client.0.smithi088.stdout:2/36: creat d1/fb x:0 0 0 2024-09-13T21:40:18.353 INFO:tasks.workunit.client.0.smithi088.stdout:2/37: chown d1/c3 197 1 2024-09-13T21:40:18.355 INFO:tasks.workunit.client.0.smithi088.stdout:7/20: dread f1 [0,4194304] 0 2024-09-13T21:40:18.355 INFO:tasks.workunit.client.0.smithi088.stdout:2/38: creat d1/d8/fc x:0 0 0 2024-09-13T21:40:18.355 INFO:tasks.workunit.client.0.smithi088.stdout:2/39: truncate d1/f4 1945273 0 2024-09-13T21:40:18.355 INFO:tasks.workunit.client.0.smithi088.stdout:2/40: creat d1/fd x:0 0 0 2024-09-13T21:40:18.357 INFO:tasks.workunit.client.0.smithi088.stdout:6/78: dread d0/f17 [0,4194304] 0 2024-09-13T21:40:18.359 INFO:tasks.workunit.client.0.smithi088.stdout:8/38: write f8 [2566851,4109] 0 2024-09-13T21:40:18.359 INFO:tasks.workunit.client.0.smithi088.stdout:8/39: fsync db/fc 0 2024-09-13T21:40:18.359 INFO:tasks.workunit.client.0.smithi088.stdout:6/79: symlink d0/l19 0 2024-09-13T21:40:18.359 INFO:tasks.workunit.client.0.smithi088.stdout:6/80: chown d0/l11 51 1 2024-09-13T21:40:18.359 INFO:tasks.workunit.client.0.smithi088.stdout:6/81: chown d0/ff 9907602 1 2024-09-13T21:40:18.360 INFO:tasks.workunit.client.0.smithi088.stdout:0/35: dwrite f5 [0,4194304] 0 2024-09-13T21:40:18.360 INFO:tasks.workunit.client.0.smithi088.stdout:0/36: stat l2 0 2024-09-13T21:40:18.361 INFO:tasks.workunit.client.0.smithi088.stdout:8/40: symlink db/l10 0 2024-09-13T21:40:18.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/37: unlink c6 0 2024-09-13T21:40:18.364 INFO:tasks.workunit.client.0.smithi088.stdout:0/38: chown f5 0 1 2024-09-13T21:40:18.365 INFO:tasks.workunit.client.0.smithi088.stdout:6/82: symlink d0/l1a 0 2024-09-13T21:40:18.367 INFO:tasks.workunit.client.0.smithi088.stdout:0/39: mkdir d7 0 2024-09-13T21:40:18.368 INFO:tasks.workunit.client.0.smithi088.stdout:4/15: write f1 [3633351,124270] 0 2024-09-13T21:40:18.369 INFO:tasks.workunit.client.0.smithi088.stdout:4/16: stat f1 0 2024-09-13T21:40:18.371 INFO:tasks.workunit.client.0.smithi088.stdout:2/41: dread d1/f4 [0,4194304] 0 2024-09-13T21:40:18.371 INFO:tasks.workunit.client.0.smithi088.stdout:2/42: write d1/d8/fc [857863,119826] 0 2024-09-13T21:40:18.371 INFO:tasks.workunit.client.0.smithi088.stdout:2/43: readlink d1/l5 0 2024-09-13T21:40:18.373 INFO:tasks.workunit.client.0.smithi088.stdout:6/83: fdatasync d0/f16 0 2024-09-13T21:40:18.375 INFO:tasks.workunit.client.0.smithi088.stdout:6/84: mknod d0/db/c1b 0 2024-09-13T21:40:18.377 INFO:tasks.workunit.client.0.smithi088.stdout:6/85: mknod d0/c1c 0 2024-09-13T21:40:18.380 INFO:tasks.workunit.client.0.smithi088.stdout:7/21: dwrite f1 [4194304,4194304] 0 2024-09-13T21:40:18.380 INFO:tasks.workunit.client.0.smithi088.stdout:7/22: chown f1 591883691 1 2024-09-13T21:40:18.380 INFO:tasks.workunit.client.0.smithi088.stdout:4/17: dread f1 [0,4194304] 0 2024-09-13T21:40:18.380 INFO:tasks.workunit.client.0.smithi088.stdout:4/18: readlink d2/l4 0 2024-09-13T21:40:18.382 INFO:tasks.workunit.client.0.smithi088.stdout:4/19: mkdir d2/d5 0 2024-09-13T21:40:18.382 INFO:tasks.workunit.client.0.smithi088.stdout:4/20: write f1 [3337628,124147] 0 2024-09-13T21:40:18.382 INFO:tasks.workunit.client.0.smithi088.stdout:4/21: chown d2 1 1 2024-09-13T21:40:18.383 INFO:tasks.workunit.client.0.smithi088.stdout:4/22: mknod d2/c6 0 2024-09-13T21:40:18.389 INFO:tasks.workunit.client.0.smithi088.stdout:2/44: dwrite d1/d8/fc [0,4194304] 0 2024-09-13T21:40:18.404 INFO:tasks.workunit.client.0.smithi088.stdout:6/86: dwrite d0/db/f12 [0,4194304] 0 2024-09-13T21:40:18.404 INFO:tasks.workunit.client.0.smithi088.stdout:7/23: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.406 INFO:tasks.workunit.client.0.smithi088.stdout:8/41: dwrite f8 [0,4194304] 0 2024-09-13T21:40:18.407 INFO:tasks.workunit.client.0.smithi088.stdout:2/45: getdents d1 0 2024-09-13T21:40:18.407 INFO:tasks.workunit.client.0.smithi088.stdout:2/46: creat d1/d8/fe x:0 0 0 2024-09-13T21:40:18.407 INFO:tasks.workunit.client.0.smithi088.stdout:2/47: truncate d1/f4 2120421 0 2024-09-13T21:40:18.407 INFO:tasks.workunit.client.0.smithi088.stdout:2/48: dread - d1/fb zero size 2024-09-13T21:40:18.407 INFO:tasks.workunit.client.0.smithi088.stdout:2/49: dread - d1/fb zero size 2024-09-13T21:40:18.407 INFO:tasks.workunit.client.0.smithi088.stdout:2/50: dread - d1/fb zero size 2024-09-13T21:40:18.408 INFO:tasks.workunit.client.0.smithi088.stdout:2/51: read d1/f4 [643365,53962] 0 2024-09-13T21:40:18.408 INFO:tasks.workunit.client.0.smithi088.stdout:2/52: chown d1/c3 4049906 1 2024-09-13T21:40:18.408 INFO:tasks.workunit.client.0.smithi088.stdout:8/42: creat db/df/f11 x:0 0 0 2024-09-13T21:40:18.413 INFO:tasks.workunit.client.0.smithi088.stdout:6/87: symlink d0/l1d 0 2024-09-13T21:40:18.413 INFO:tasks.workunit.client.0.smithi088.stdout:8/43: rename db/l10 to db/l12 0 2024-09-13T21:40:18.415 INFO:tasks.workunit.client.0.smithi088.stdout:7/24: write f1 [4042749,59670] 0 2024-09-13T21:40:18.415 INFO:tasks.workunit.client.0.smithi088.stdout:7/25: creat f5 x:0 0 0 2024-09-13T21:40:18.415 INFO:tasks.workunit.client.0.smithi088.stdout:7/26: truncate f5 998543 0 2024-09-13T21:40:18.415 INFO:tasks.workunit.client.0.smithi088.stdout:6/88: mkdir d0/d1e 0 2024-09-13T21:40:18.415 INFO:tasks.workunit.client.0.smithi088.stdout:6/89: fdatasync d0/f16 0 2024-09-13T21:40:18.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/90: mkdir d0/d1e/d1f 0 2024-09-13T21:40:18.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/91: chown d0/d1e/d1f 26228167 1 2024-09-13T21:40:18.419 INFO:tasks.workunit.client.0.smithi088.stdout:4/23: getdents d2 0 2024-09-13T21:40:18.421 INFO:tasks.workunit.client.0.smithi088.stdout:6/92: rename d0/db/l18 to d0/l20 0 2024-09-13T21:40:18.421 INFO:tasks.workunit.client.0.smithi088.stdout:6/93: fdatasync d0/f17 0 2024-09-13T21:40:18.421 INFO:tasks.workunit.client.0.smithi088.stdout:6/94: truncate d0/f6 618331 0 2024-09-13T21:40:18.422 INFO:tasks.workunit.client.0.smithi088.stdout:4/24: unlink d2/c6 0 2024-09-13T21:40:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:7/27: write f1 [5935910,39906] 0 2024-09-13T21:40:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:7/28: chown f5 0 1 2024-09-13T21:40:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:7/29: truncate f5 1435913 0 2024-09-13T21:40:18.434 INFO:tasks.workunit.client.0.smithi088.stdout:7/30: dread f5 [0,4194304] 0 2024-09-13T21:40:18.437 INFO:tasks.workunit.client.0.smithi088.stdout:7/31: fdatasync f1 0 2024-09-13T21:40:18.437 INFO:tasks.workunit.client.0.smithi088.stdout:7/32: mkdir d6 0 2024-09-13T21:40:18.439 INFO:tasks.workunit.client.0.smithi088.stdout:7/33: symlink d6/l7 0 2024-09-13T21:40:18.439 INFO:tasks.workunit.client.0.smithi088.stdout:7/34: readlink l4 0 2024-09-13T21:40:18.440 INFO:tasks.workunit.client.0.smithi088.stdout:7/35: symlink d6/l8 0 2024-09-13T21:40:18.440 INFO:tasks.workunit.client.0.smithi088.stdout:7/36: write f5 [773256,69546] 0 2024-09-13T21:40:18.441 INFO:tasks.workunit.client.0.smithi088.stdout:6/95: dwrite d0/db/f12 [0,4194304] 0 2024-09-13T21:40:18.445 INFO:tasks.workunit.client.0.smithi088.stdout:5/24: sync 2024-09-13T21:40:18.445 INFO:tasks.workunit.client.0.smithi088.stdout:3/17: sync 2024-09-13T21:40:18.445 INFO:tasks.workunit.client.0.smithi088.stdout:1/83: sync 2024-09-13T21:40:18.446 INFO:tasks.workunit.client.0.smithi088.stdout:5/25: dread - f3 zero size 2024-09-13T21:40:18.446 INFO:tasks.workunit.client.0.smithi088.stdout:4/25: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.447 INFO:tasks.workunit.client.0.smithi088.stdout:4/26: fsync f1 0 2024-09-13T21:40:18.447 INFO:tasks.workunit.client.0.smithi088.stdout:5/26: link f2 d4/f7 0 2024-09-13T21:40:18.447 INFO:tasks.workunit.client.0.smithi088.stdout:5/27: chown f3 31 1 2024-09-13T21:40:18.447 INFO:tasks.workunit.client.0.smithi088.stdout:5/28: stat d4 0 2024-09-13T21:40:18.448 INFO:tasks.workunit.client.0.smithi088.stdout:1/84: mkdir d9/d18/d20 0 2024-09-13T21:40:18.449 INFO:tasks.workunit.client.0.smithi088.stdout:7/37: getdents d6 0 2024-09-13T21:40:18.450 INFO:tasks.workunit.client.0.smithi088.stdout:4/27: rename d2/d5 to d2/d5/d7 22 2024-09-13T21:40:18.450 INFO:tasks.workunit.client.0.smithi088.stdout:4/28: getdents d2/d5 0 2024-09-13T21:40:18.454 INFO:tasks.workunit.client.0.smithi088.stdout:5/29: mkdir d4/d8 0 2024-09-13T21:40:18.454 INFO:tasks.workunit.client.0.smithi088.stdout:7/38: mknod d6/c9 0 2024-09-13T21:40:18.454 INFO:tasks.workunit.client.0.smithi088.stdout:4/29: rename d2 to d2/d8 22 2024-09-13T21:40:18.454 INFO:tasks.workunit.client.0.smithi088.stdout:4/30: truncate f1 5260568 0 2024-09-13T21:40:18.454 INFO:tasks.workunit.client.0.smithi088.stdout:4/31: chown d2/d5 819650870 1 2024-09-13T21:40:18.456 INFO:tasks.workunit.client.0.smithi088.stdout:5/30: link f3 d4/d8/f9 0 2024-09-13T21:40:18.456 INFO:tasks.workunit.client.0.smithi088.stdout:5/31: fdatasync f3 0 2024-09-13T21:40:18.458 INFO:tasks.workunit.client.0.smithi088.stdout:5/32: rename f3 to d4/d8/fa 0 2024-09-13T21:40:18.458 INFO:tasks.workunit.client.0.smithi088.stdout:5/33: chown d4/f6 19 1 2024-09-13T21:40:18.459 INFO:tasks.workunit.client.0.smithi088.stdout:5/34: dread f2 [0,4194304] 0 2024-09-13T21:40:18.460 INFO:tasks.workunit.client.0.smithi088.stdout:5/35: chown d4/d8/f9 3466171 1 2024-09-13T21:40:18.460 INFO:tasks.workunit.client.0.smithi088.stdout:6/96: dwrite d0/f16 [0,4194304] 0 2024-09-13T21:40:18.460 INFO:tasks.workunit.client.0.smithi088.stdout:5/36: symlink d4/d8/lb 0 2024-09-13T21:40:18.460 INFO:tasks.workunit.client.0.smithi088.stdout:5/37: creat d4/fc x:0 0 0 2024-09-13T21:40:18.463 INFO:tasks.workunit.client.0.smithi088.stdout:1/85: rmdir d9/d18 39 2024-09-13T21:40:18.463 INFO:tasks.workunit.client.0.smithi088.stdout:1/86: chown d9/d18/d20 7629 1 2024-09-13T21:40:18.465 INFO:tasks.workunit.client.0.smithi088.stdout:5/38: link d4/d8/lb d4/ld 0 2024-09-13T21:40:18.465 INFO:tasks.workunit.client.0.smithi088.stdout:5/39: write f2 [961096,62210] 0 2024-09-13T21:40:18.465 INFO:tasks.workunit.client.0.smithi088.stdout:5/40: chown d4/d8/fa 817641 1 2024-09-13T21:40:18.466 INFO:tasks.workunit.client.0.smithi088.stdout:1/87: rmdir d9/d18/d20 0 2024-09-13T21:40:18.469 INFO:tasks.workunit.client.0.smithi088.stdout:1/88: rename d9/f12 to d9/d18/f21 0 2024-09-13T21:40:18.469 INFO:tasks.workunit.client.0.smithi088.stdout:1/89: readlink l3 0 2024-09-13T21:40:18.470 INFO:tasks.workunit.client.0.smithi088.stdout:4/32: write f1 [1927638,30034] 0 2024-09-13T21:40:18.471 INFO:tasks.workunit.client.0.smithi088.stdout:4/33: chown d2 148 1 2024-09-13T21:40:18.471 INFO:tasks.workunit.client.0.smithi088.stdout:3/18: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.471 INFO:tasks.workunit.client.0.smithi088.stdout:4/34: write f1 [3821227,64264] 0 2024-09-13T21:40:18.471 INFO:tasks.workunit.client.0.smithi088.stdout:3/19: creat f2 x:0 0 0 2024-09-13T21:40:18.471 INFO:tasks.workunit.client.0.smithi088.stdout:6/97: truncate d0/f16 3101598 0 2024-09-13T21:40:18.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/39: dread f5 [0,4194304] 0 2024-09-13T21:40:18.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/40: stat c0 0 2024-09-13T21:40:18.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/41: write f5 [1137499,6970] 0 2024-09-13T21:40:18.480 INFO:tasks.workunit.client.0.smithi088.stdout:1/90: dread f1 [0,4194304] 0 2024-09-13T21:40:18.480 INFO:tasks.workunit.client.0.smithi088.stdout:4/35: mkdir d2/d9 0 2024-09-13T21:40:18.481 INFO:tasks.workunit.client.0.smithi088.stdout:7/42: mkdir d6/da 0 2024-09-13T21:40:18.482 INFO:tasks.workunit.client.0.smithi088.stdout:1/91: symlink d9/dc/l22 0 2024-09-13T21:40:18.482 INFO:tasks.workunit.client.0.smithi088.stdout:7/43: creat d6/da/fb x:0 0 0 2024-09-13T21:40:18.483 INFO:tasks.workunit.client.0.smithi088.stdout:1/92: creat d9/d18/f23 x:0 0 0 2024-09-13T21:40:18.484 INFO:tasks.workunit.client.0.smithi088.stdout:1/93: creat d9/dc/f24 x:0 0 0 2024-09-13T21:40:18.484 INFO:tasks.workunit.client.0.smithi088.stdout:4/36: mknod d2/ca 0 2024-09-13T21:40:18.484 INFO:tasks.workunit.client.0.smithi088.stdout:4/37: write f1 [5075650,18902] 0 2024-09-13T21:40:18.485 INFO:tasks.workunit.client.0.smithi088.stdout:5/41: dwrite d4/fc [0,4194304] 0 2024-09-13T21:40:18.487 INFO:tasks.workunit.client.0.smithi088.stdout:1/94: rename c7 to d9/d18/c25 0 2024-09-13T21:40:18.487 INFO:tasks.workunit.client.0.smithi088.stdout:1/95: truncate d9/f19 936383 0 2024-09-13T21:40:18.489 INFO:tasks.workunit.client.0.smithi088.stdout:3/20: dwrite f0 [0,4194304] 0 2024-09-13T21:40:18.491 INFO:tasks.workunit.client.0.smithi088.stdout:5/42: mknod d4/ce 0 2024-09-13T21:40:18.494 INFO:tasks.workunit.client.0.smithi088.stdout:3/21: rename f2 to f3 0 2024-09-13T21:40:18.494 INFO:tasks.workunit.client.0.smithi088.stdout:5/43: getdents d4/d8 0 2024-09-13T21:40:18.496 INFO:tasks.workunit.client.0.smithi088.stdout:5/44: unlink d4/d8/f9 0 2024-09-13T21:40:18.496 INFO:tasks.workunit.client.0.smithi088.stdout:5/45: creat d4/ff x:0 0 0 2024-09-13T21:40:18.497 INFO:tasks.workunit.client.0.smithi088.stdout:5/46: rmdir d4/d8 39 2024-09-13T21:40:18.497 INFO:tasks.workunit.client.0.smithi088.stdout:5/47: fdatasync d4/ff 0 2024-09-13T21:40:18.499 INFO:tasks.workunit.client.0.smithi088.stdout:5/48: link d4/ff d4/f10 0 2024-09-13T21:40:18.500 INFO:tasks.workunit.client.0.smithi088.stdout:7/44: dwrite d6/da/fb [0,4194304] 0 2024-09-13T21:40:18.503 INFO:tasks.workunit.client.0.smithi088.stdout:7/45: stat d6/l7 0 2024-09-13T21:40:18.504 INFO:tasks.workunit.client.0.smithi088.stdout:7/46: getdents d6 0 2024-09-13T21:40:18.507 INFO:tasks.workunit.client.0.smithi088.stdout:3/22: dwrite f0 [0,4194304] 0 2024-09-13T21:40:18.509 INFO:tasks.workunit.client.0.smithi088.stdout:7/47: dread f5 [0,4194304] 0 2024-09-13T21:40:18.511 INFO:tasks.workunit.client.0.smithi088.stdout:0/40: sync 2024-09-13T21:40:18.512 INFO:tasks.workunit.client.0.smithi088.stdout:9/18: sync 2024-09-13T21:40:18.513 INFO:tasks.workunit.client.0.smithi088.stdout:9/19: creat f4 x:0 0 0 2024-09-13T21:40:18.517 INFO:tasks.workunit.client.0.smithi088.stdout:7/48: dread f5 [0,4194304] 0 2024-09-13T21:40:18.518 INFO:tasks.workunit.client.0.smithi088.stdout:7/49: truncate f5 703946 0 2024-09-13T21:40:18.520 INFO:tasks.workunit.client.0.smithi088.stdout:7/50: mknod d6/da/cc 0 2024-09-13T21:40:18.520 INFO:tasks.workunit.client.0.smithi088.stdout:7/51: readlink l4 0 2024-09-13T21:40:18.522 INFO:tasks.workunit.client.0.smithi088.stdout:7/52: write d6/da/fb [105662,12511] 0 2024-09-13T21:40:18.524 INFO:tasks.workunit.client.0.smithi088.stdout:7/53: symlink d6/da/ld 0 2024-09-13T21:40:18.525 INFO:tasks.workunit.client.0.smithi088.stdout:3/23: write f1 [3258142,87182] 0 2024-09-13T21:40:18.526 INFO:tasks.workunit.client.0.smithi088.stdout:7/54: mknod d6/ce 0 2024-09-13T21:40:18.527 INFO:tasks.workunit.client.0.smithi088.stdout:3/24: mknod c4 0 2024-09-13T21:40:18.530 INFO:tasks.workunit.client.0.smithi088.stdout:5/49: dwrite d4/fc [4194304,4194304] 0 2024-09-13T21:40:18.531 INFO:tasks.workunit.client.0.smithi088.stdout:5/50: dread - d4/d8/fa zero size 2024-09-13T21:40:18.532 INFO:tasks.workunit.client.0.smithi088.stdout:5/51: stat d4/ce 0 2024-09-13T21:40:18.538 INFO:tasks.workunit.client.0.smithi088.stdout:0/41: dwrite f5 [0,4194304] 0 2024-09-13T21:40:18.538 INFO:tasks.workunit.client.0.smithi088.stdout:0/42: rename d7 to d7/d8 22 2024-09-13T21:40:18.540 INFO:tasks.workunit.client.0.smithi088.stdout:9/20: dwrite f4 [0,4194304] 0 2024-09-13T21:40:18.541 INFO:tasks.workunit.client.0.smithi088.stdout:0/43: creat d7/f9 x:0 0 0 2024-09-13T21:40:18.542 INFO:tasks.workunit.client.0.smithi088.stdout:7/55: rmdir d6/da 39 2024-09-13T21:40:18.546 INFO:tasks.workunit.client.0.smithi088.stdout:3/25: truncate f0 3657942 0 2024-09-13T21:40:18.548 INFO:tasks.workunit.client.0.smithi088.stdout:0/44: mkdir d7/da 0 2024-09-13T21:40:18.548 INFO:tasks.workunit.client.0.smithi088.stdout:0/45: getdents d7/da 0 2024-09-13T21:40:18.551 INFO:tasks.workunit.client.0.smithi088.stdout:0/46: mknod d7/cb 0 2024-09-13T21:40:18.551 INFO:tasks.workunit.client.0.smithi088.stdout:0/47: dread - d7/f9 zero size 2024-09-13T21:40:18.551 INFO:tasks.workunit.client.0.smithi088.stdout:0/48: creat d7/fc x:0 0 0 2024-09-13T21:40:18.552 INFO:tasks.workunit.client.0.smithi088.stdout:7/56: mknod d6/cf 0 2024-09-13T21:40:18.552 INFO:tasks.workunit.client.0.smithi088.stdout:7/57: read f1 [4248833,92928] 0 2024-09-13T21:40:18.552 INFO:tasks.workunit.client.0.smithi088.stdout:7/58: write f5 [1416740,95622] 0 2024-09-13T21:40:18.553 INFO:tasks.workunit.client.0.smithi088.stdout:0/49: mknod d7/cd 0 2024-09-13T21:40:18.555 INFO:tasks.workunit.client.0.smithi088.stdout:0/50: rename d7/cb to d7/ce 0 2024-09-13T21:40:18.555 INFO:tasks.workunit.client.0.smithi088.stdout:0/51: creat d7/ff x:0 0 0 2024-09-13T21:40:18.555 INFO:tasks.workunit.client.0.smithi088.stdout:0/52: chown l1 1691333 1 2024-09-13T21:40:18.556 INFO:tasks.workunit.client.0.smithi088.stdout:7/59: truncate d6/da/fb 1120068 0 2024-09-13T21:40:18.556 INFO:tasks.workunit.client.0.smithi088.stdout:7/60: readlink l4 0 2024-09-13T21:40:18.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/21: dwrite f4 [0,4194304] 0 2024-09-13T21:40:18.558 INFO:tasks.workunit.client.0.smithi088.stdout:3/26: truncate f0 4638269 0 2024-09-13T21:40:18.558 INFO:tasks.workunit.client.0.smithi088.stdout:3/27: fsync f3 0 2024-09-13T21:40:18.574 INFO:tasks.workunit.client.0.smithi088.stdout:9/22: write f4 [1511989,5161] 0 2024-09-13T21:40:18.574 INFO:tasks.workunit.client.0.smithi088.stdout:9/23: write f4 [4182416,115027] 0 2024-09-13T21:40:18.575 INFO:tasks.workunit.client.0.smithi088.stdout:9/24: unlink c2 0 2024-09-13T21:40:18.577 INFO:tasks.workunit.client.0.smithi088.stdout:9/25: link l0 l5 0 2024-09-13T21:40:18.589 INFO:tasks.workunit.client.0.smithi088.stdout:7/61: dwrite f1 [4194304,4194304] 0 2024-09-13T21:40:18.589 INFO:tasks.workunit.client.0.smithi088.stdout:0/53: dwrite f5 [0,4194304] 0 2024-09-13T21:40:18.594 INFO:tasks.workunit.client.0.smithi088.stdout:0/54: rename c4 to d7/c10 0 2024-09-13T21:40:18.597 INFO:tasks.workunit.client.0.smithi088.stdout:9/26: truncate f4 2913278 0 2024-09-13T21:40:18.597 INFO:tasks.workunit.client.0.smithi088.stdout:0/55: mknod d7/da/c11 0 2024-09-13T21:40:18.601 INFO:tasks.workunit.client.0.smithi088.stdout:9/27: chown l0 1100 1 2024-09-13T21:40:18.606 INFO:tasks.workunit.client.0.smithi088.stdout:7/62: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.610 INFO:tasks.workunit.client.0.smithi088.stdout:9/28: dread f4 [0,4194304] 0 2024-09-13T21:40:18.611 INFO:tasks.workunit.client.0.smithi088.stdout:9/29: rename l5 to l6 0 2024-09-13T21:40:18.613 INFO:tasks.workunit.client.0.smithi088.stdout:9/30: rename c3 to c7 0 2024-09-13T21:40:18.616 INFO:tasks.workunit.client.0.smithi088.stdout:7/63: write f1 [443110,51247] 0 2024-09-13T21:40:18.617 INFO:tasks.workunit.client.0.smithi088.stdout:9/31: rename c7 to c8 0 2024-09-13T21:40:18.617 INFO:tasks.workunit.client.0.smithi088.stdout:7/64: creat d6/da/f10 x:0 0 0 2024-09-13T21:40:18.619 INFO:tasks.workunit.client.0.smithi088.stdout:7/65: symlink d6/l11 0 2024-09-13T21:40:18.621 INFO:tasks.workunit.client.0.smithi088.stdout:7/66: rename l4 to d6/da/l12 0 2024-09-13T21:40:18.623 INFO:tasks.workunit.client.0.smithi088.stdout:7/67: link d6/l11 d6/l13 0 2024-09-13T21:40:18.623 INFO:tasks.workunit.client.0.smithi088.stdout:7/68: rename d6/da to d6/da/d14 22 2024-09-13T21:40:18.639 INFO:tasks.workunit.client.0.smithi088.stdout:9/32: dwrite f4 [0,4194304] 0 2024-09-13T21:40:18.639 INFO:tasks.workunit.client.0.smithi088.stdout:9/33: rmdir - no directory 2024-09-13T21:40:18.640 INFO:tasks.workunit.client.0.smithi088.stdout:7/69: dwrite d6/da/fb [0,4194304] 0 2024-09-13T21:40:18.641 INFO:tasks.workunit.client.0.smithi088.stdout:7/70: mknod d6/da/c15 0 2024-09-13T21:40:18.642 INFO:tasks.workunit.client.0.smithi088.stdout:7/71: unlink d6/da/c15 0 2024-09-13T21:40:18.643 INFO:tasks.workunit.client.0.smithi088.stdout:7/72: mknod d6/c16 0 2024-09-13T21:40:18.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/73: mknod d6/da/c17 0 2024-09-13T21:40:18.645 INFO:tasks.workunit.client.0.smithi088.stdout:7/74: creat d6/f18 x:0 0 0 2024-09-13T21:40:18.646 INFO:tasks.workunit.client.0.smithi088.stdout:2/53: sync 2024-09-13T21:40:18.646 INFO:tasks.workunit.client.0.smithi088.stdout:8/44: sync 2024-09-13T21:40:18.646 INFO:tasks.workunit.client.0.smithi088.stdout:8/45: fsync db/df/f11 0 2024-09-13T21:40:18.646 INFO:tasks.workunit.client.0.smithi088.stdout:6/98: sync 2024-09-13T21:40:18.646 INFO:tasks.workunit.client.0.smithi088.stdout:8/46: write fa [165581,104465] 0 2024-09-13T21:40:18.646 INFO:tasks.workunit.client.0.smithi088.stdout:8/47: write fa [4240881,128187] 0 2024-09-13T21:40:18.647 INFO:tasks.workunit.client.0.smithi088.stdout:6/99: rename d0/db/l14 to d0/db/l21 0 2024-09-13T21:40:18.651 INFO:tasks.workunit.client.0.smithi088.stdout:8/48: symlink db/df/l13 0 2024-09-13T21:40:18.651 INFO:tasks.workunit.client.0.smithi088.stdout:6/100: dread d0/ff [0,4194304] 0 2024-09-13T21:40:18.651 INFO:tasks.workunit.client.0.smithi088.stdout:9/34: read f4 [185080,47021] 0 2024-09-13T21:40:18.651 INFO:tasks.workunit.client.0.smithi088.stdout:8/49: unlink db/ld 0 2024-09-13T21:40:18.654 INFO:tasks.workunit.client.0.smithi088.stdout:6/101: dread d0/db/f10 [0,4194304] 0 2024-09-13T21:40:18.655 INFO:tasks.workunit.client.0.smithi088.stdout:6/102: creat d0/f22 x:0 0 0 2024-09-13T21:40:18.655 INFO:tasks.workunit.client.0.smithi088.stdout:6/103: write d0/ff [1565723,131018] 0 2024-09-13T21:40:18.656 INFO:tasks.workunit.client.0.smithi088.stdout:6/104: read d0/f6 [249413,118549] 0 2024-09-13T21:40:18.656 INFO:tasks.workunit.client.0.smithi088.stdout:6/105: write d0/f22 [856374,58084] 0 2024-09-13T21:40:18.656 INFO:tasks.workunit.client.0.smithi088.stdout:6/106: write d0/ff [176969,26751] 0 2024-09-13T21:40:18.657 INFO:tasks.workunit.client.0.smithi088.stdout:2/54: dread d1/d8/fc [0,4194304] 0 2024-09-13T21:40:18.657 INFO:tasks.workunit.client.0.smithi088.stdout:6/107: mknod d0/db/c23 0 2024-09-13T21:40:18.658 INFO:tasks.workunit.client.0.smithi088.stdout:2/55: rename d1/c7 to d1/cf 0 2024-09-13T21:40:18.669 INFO:tasks.workunit.client.0.smithi088.stdout:7/75: dwrite d6/da/fb [0,4194304] 0 2024-09-13T21:40:18.669 INFO:tasks.workunit.client.0.smithi088.stdout:7/76: creat d6/da/f19 x:0 0 0 2024-09-13T21:40:18.673 INFO:tasks.workunit.client.0.smithi088.stdout:7/77: mkdir d6/da/d1a 0 2024-09-13T21:40:18.673 INFO:tasks.workunit.client.0.smithi088.stdout:7/78: readlink d6/da/ld 0 2024-09-13T21:40:18.674 INFO:tasks.workunit.client.0.smithi088.stdout:7/79: write d6/da/f19 [511329,113551] 0 2024-09-13T21:40:18.675 INFO:tasks.workunit.client.0.smithi088.stdout:9/35: dwrite f4 [4194304,4194304] 0 2024-09-13T21:40:18.677 INFO:tasks.workunit.client.0.smithi088.stdout:8/50: dwrite fa [0,4194304] 0 2024-09-13T21:40:18.677 INFO:tasks.workunit.client.0.smithi088.stdout:8/51: readlink l7 0 2024-09-13T21:40:18.686 INFO:tasks.workunit.client.0.smithi088.stdout:8/52: dread fa [0,4194304] 0 2024-09-13T21:40:18.687 INFO:tasks.workunit.client.0.smithi088.stdout:9/36: write f4 [6096817,79960] 0 2024-09-13T21:40:18.687 INFO:tasks.workunit.client.0.smithi088.stdout:9/37: chown f4 62503 1 2024-09-13T21:40:18.689 INFO:tasks.workunit.client.0.smithi088.stdout:9/38: creat f9 x:0 0 0 2024-09-13T21:40:18.690 INFO:tasks.workunit.client.0.smithi088.stdout:7/80: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.698 INFO:tasks.workunit.client.0.smithi088.stdout:7/81: rename f5 to d6/f1b 0 2024-09-13T21:40:18.699 INFO:tasks.workunit.client.0.smithi088.stdout:7/82: creat d6/f1c x:0 0 0 2024-09-13T21:40:18.699 INFO:tasks.workunit.client.0.smithi088.stdout:7/83: read - d6/da/f10 zero size 2024-09-13T21:40:18.700 INFO:tasks.workunit.client.0.smithi088.stdout:9/39: truncate f4 7138057 0 2024-09-13T21:40:18.700 INFO:tasks.workunit.client.0.smithi088.stdout:9/40: dread - f9 zero size 2024-09-13T21:40:18.701 INFO:tasks.workunit.client.0.smithi088.stdout:7/84: symlink d6/da/d1a/l1d 0 2024-09-13T21:40:18.701 INFO:tasks.workunit.client.0.smithi088.stdout:7/85: creat d6/da/f1e x:0 0 0 2024-09-13T21:40:18.701 INFO:tasks.workunit.client.0.smithi088.stdout:7/86: chown d6/l11 10281 1 2024-09-13T21:40:18.703 INFO:tasks.workunit.client.0.smithi088.stdout:8/53: dwrite f8 [0,4194304] 0 2024-09-13T21:40:18.703 INFO:tasks.workunit.client.0.smithi088.stdout:7/87: rename d6/da/cc to d6/da/d1a/c1f 0 2024-09-13T21:40:18.707 INFO:tasks.workunit.client.0.smithi088.stdout:8/54: rename db/fc to db/f14 0 2024-09-13T21:40:18.707 INFO:tasks.workunit.client.0.smithi088.stdout:3/28: sync 2024-09-13T21:40:18.707 INFO:tasks.workunit.client.0.smithi088.stdout:4/38: sync 2024-09-13T21:40:18.707 INFO:tasks.workunit.client.0.smithi088.stdout:5/52: sync 2024-09-13T21:40:18.707 INFO:tasks.workunit.client.0.smithi088.stdout:5/53: chown d4/ff 181 1 2024-09-13T21:40:18.707 INFO:tasks.workunit.client.0.smithi088.stdout:1/96: sync 2024-09-13T21:40:18.708 INFO:tasks.workunit.client.0.smithi088.stdout:1/97: fdatasync d9/f14 0 2024-09-13T21:40:18.708 INFO:tasks.workunit.client.0.smithi088.stdout:1/98: truncate d9/d18/f23 605710 0 2024-09-13T21:40:18.708 INFO:tasks.workunit.client.0.smithi088.stdout:8/55: mknod db/df/c15 0 2024-09-13T21:40:18.708 INFO:tasks.workunit.client.0.smithi088.stdout:8/56: write db/f14 [732075,130878] 0 2024-09-13T21:40:18.709 INFO:tasks.workunit.client.0.smithi088.stdout:8/57: write db/f14 [1809509,16782] 0 2024-09-13T21:40:18.709 INFO:tasks.workunit.client.0.smithi088.stdout:3/29: mkdir d5 0 2024-09-13T21:40:18.711 INFO:tasks.workunit.client.0.smithi088.stdout:1/99: symlink d9/dc/l26 0 2024-09-13T21:40:18.711 INFO:tasks.workunit.client.0.smithi088.stdout:1/100: creat d9/d18/f27 x:0 0 0 2024-09-13T21:40:18.711 INFO:tasks.workunit.client.0.smithi088.stdout:1/101: creat d9/d18/f28 x:0 0 0 2024-09-13T21:40:18.713 INFO:tasks.workunit.client.0.smithi088.stdout:8/58: mknod db/df/c16 0 2024-09-13T21:40:18.713 INFO:tasks.workunit.client.0.smithi088.stdout:8/59: creat db/f17 x:0 0 0 2024-09-13T21:40:18.713 INFO:tasks.workunit.client.0.smithi088.stdout:3/30: creat d5/f6 x:0 0 0 2024-09-13T21:40:18.714 INFO:tasks.workunit.client.0.smithi088.stdout:9/41: dread f4 [4194304,4194304] 0 2024-09-13T21:40:18.715 INFO:tasks.workunit.client.0.smithi088.stdout:5/54: dread d4/f7 [0,4194304] 0 2024-09-13T21:40:18.716 INFO:tasks.workunit.client.0.smithi088.stdout:5/55: fdatasync d4/f7 0 2024-09-13T21:40:18.717 INFO:tasks.workunit.client.0.smithi088.stdout:1/102: creat d9/d10/f29 x:0 0 0 2024-09-13T21:40:18.719 INFO:tasks.workunit.client.0.smithi088.stdout:3/31: mknod d5/c7 0 2024-09-13T21:40:18.719 INFO:tasks.workunit.client.0.smithi088.stdout:3/32: chown f1 513 1 2024-09-13T21:40:18.720 INFO:tasks.workunit.client.0.smithi088.stdout:1/103: mkdir d9/d10/d2a 0 2024-09-13T21:40:18.721 INFO:tasks.workunit.client.0.smithi088.stdout:1/104: dread - d9/d18/f28 zero size 2024-09-13T21:40:18.722 INFO:tasks.workunit.client.0.smithi088.stdout:3/33: symlink d5/l8 0 2024-09-13T21:40:18.723 INFO:tasks.workunit.client.0.smithi088.stdout:3/34: chown f0 2892853 1 2024-09-13T21:40:18.723 INFO:tasks.workunit.client.0.smithi088.stdout:3/35: write f3 [114492,99186] 0 2024-09-13T21:40:18.723 INFO:tasks.workunit.client.0.smithi088.stdout:3/36: read f1 [1853290,89650] 0 2024-09-13T21:40:18.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/42: mknod ca 0 2024-09-13T21:40:18.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/43: dread - f9 zero size 2024-09-13T21:40:18.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/44: chown l6 415399246 1 2024-09-13T21:40:18.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/45: fsync f4 0 2024-09-13T21:40:18.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/46: write f4 [4309908,96504] 0 2024-09-13T21:40:18.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/47: chown ca 8 1 2024-09-13T21:40:18.724 INFO:tasks.workunit.client.0.smithi088.stdout:3/37: symlink d5/l9 0 2024-09-13T21:40:18.724 INFO:tasks.workunit.client.0.smithi088.stdout:3/38: dread - d5/f6 zero size 2024-09-13T21:40:18.731 INFO:tasks.workunit.client.0.smithi088.stdout:7/88: dwrite f1 [0,4194304] 0 2024-09-13T21:40:18.732 INFO:tasks.workunit.client.0.smithi088.stdout:4/39: dwrite f1 [4194304,4194304] 0 2024-09-13T21:40:18.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/39: dread f1 [0,4194304] 0 2024-09-13T21:40:18.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/40: chown d5/f6 31369 1 2024-09-13T21:40:18.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/41: write d5/f6 [1010624,122645] 0 2024-09-13T21:40:18.735 INFO:tasks.workunit.client.0.smithi088.stdout:7/89: rename d6/da/c17 to d6/da/d1a/c20 0 2024-09-13T21:40:18.737 INFO:tasks.workunit.client.0.smithi088.stdout:1/105: dwrite d9/f14 [0,4194304] 0 2024-09-13T21:40:18.737 INFO:tasks.workunit.client.0.smithi088.stdout:1/106: read - d9/dc/f24 zero size 2024-09-13T21:40:18.737 INFO:tasks.workunit.client.0.smithi088.stdout:8/60: getdents db/df 0 2024-09-13T21:40:18.738 INFO:tasks.workunit.client.0.smithi088.stdout:8/61: write db/f14 [1905579,1143] 0 2024-09-13T21:40:18.741 INFO:tasks.workunit.client.0.smithi088.stdout:1/107: rename l3 to d9/d18/l2b 0 2024-09-13T21:40:18.742 INFO:tasks.workunit.client.0.smithi088.stdout:1/108: creat d9/d10/f2c x:0 0 0 2024-09-13T21:40:18.742 INFO:tasks.workunit.client.0.smithi088.stdout:1/109: write d9/f16 [9111681,81149] 0 2024-09-13T21:40:18.742 INFO:tasks.workunit.client.0.smithi088.stdout:8/62: creat db/df/f18 x:0 0 0 2024-09-13T21:40:18.742 INFO:tasks.workunit.client.0.smithi088.stdout:8/63: dread - db/f17 zero size 2024-09-13T21:40:18.745 INFO:tasks.workunit.client.0.smithi088.stdout:4/40: dread f1 [4194304,4194304] 0 2024-09-13T21:40:18.746 INFO:tasks.workunit.client.0.smithi088.stdout:1/110: symlink d9/dc/l2d 0 2024-09-13T21:40:18.747 INFO:tasks.workunit.client.0.smithi088.stdout:4/41: creat d2/fb x:0 0 0 2024-09-13T21:40:18.752 INFO:tasks.workunit.client.0.smithi088.stdout:7/90: dwrite d6/da/fb [0,4194304] 0 2024-09-13T21:40:18.753 INFO:tasks.workunit.client.0.smithi088.stdout:9/48: getdents . 0 2024-09-13T21:40:18.753 INFO:tasks.workunit.client.0.smithi088.stdout:9/49: write f9 [991946,78449] 0 2024-09-13T21:40:18.753 INFO:tasks.workunit.client.0.smithi088.stdout:9/50: getdents . 0 2024-09-13T21:40:18.753 INFO:tasks.workunit.client.0.smithi088.stdout:9/51: write f4 [5249093,101829] 0 2024-09-13T21:40:18.753 INFO:tasks.workunit.client.0.smithi088.stdout:9/52: read f4 [3854802,30863] 0 2024-09-13T21:40:18.755 INFO:tasks.workunit.client.0.smithi088.stdout:3/42: getdents d5 0 2024-09-13T21:40:18.758 INFO:tasks.workunit.client.0.smithi088.stdout:9/53: creat fb x:0 0 0 2024-09-13T21:40:18.758 INFO:tasks.workunit.client.0.smithi088.stdout:9/54: dread - fb zero size 2024-09-13T21:40:18.759 INFO:tasks.workunit.client.0.smithi088.stdout:3/43: mknod d5/ca 0 2024-09-13T21:40:18.759 INFO:tasks.workunit.client.0.smithi088.stdout:0/56: sync 2024-09-13T21:40:18.759 INFO:tasks.workunit.client.0.smithi088.stdout:0/57: dread - d7/fc zero size 2024-09-13T21:40:18.759 INFO:tasks.workunit.client.0.smithi088.stdout:7/91: getdents d6/da 0 2024-09-13T21:40:18.760 INFO:tasks.workunit.client.0.smithi088.stdout:4/42: write f1 [7886975,92894] 0 2024-09-13T21:40:18.760 INFO:tasks.workunit.client.0.smithi088.stdout:4/43: chown f1 3040741 1 2024-09-13T21:40:18.760 INFO:tasks.workunit.client.0.smithi088.stdout:4/44: fdatasync d2/fb 0 2024-09-13T21:40:18.762 INFO:tasks.workunit.client.0.smithi088.stdout:3/44: mkdir d5/db 0 2024-09-13T21:40:18.763 INFO:tasks.workunit.client.0.smithi088.stdout:9/55: symlink lc 0 2024-09-13T21:40:18.775 INFO:tasks.workunit.client.0.smithi088.stdout:3/45: creat d5/fc x:0 0 0 2024-09-13T21:40:18.781 INFO:tasks.workunit.client.0.smithi088.stdout:1/111: dwrite d9/d10/f11 [0,4194304] 0 2024-09-13T21:40:18.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/58: dwrite f5 [0,4194304] 0 2024-09-13T21:40:18.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/59: creat d7/f12 x:0 0 0 2024-09-13T21:40:18.809 INFO:tasks.workunit.client.0.smithi088.stdout:1/112: dwrite d9/dc/f24 [0,4194304] 0 2024-09-13T21:40:18.809 INFO:tasks.workunit.client.0.smithi088.stdout:0/60: dread f5 [0,4194304] 0 2024-09-13T21:40:18.809 INFO:tasks.workunit.client.0.smithi088.stdout:9/56: dwrite f9 [0,4194304] 0 2024-09-13T21:40:18.827 INFO:tasks.workunit.client.0.smithi088.stdout:1/113: unlink d9/dc/c1c 0 2024-09-13T21:40:18.829 INFO:tasks.workunit.client.0.smithi088.stdout:0/61: link d7/fc d7/da/f13 0 2024-09-13T21:40:18.829 INFO:tasks.workunit.client.0.smithi088.stdout:0/62: readlink l1 0 2024-09-13T21:40:18.829 INFO:tasks.workunit.client.0.smithi088.stdout:0/63: chown d7/cd 248269875 1 2024-09-13T21:40:18.831 INFO:tasks.workunit.client.0.smithi088.stdout:1/114: rename d9/le to d9/d10/l2e 0 2024-09-13T21:40:18.832 INFO:tasks.workunit.client.0.smithi088.stdout:0/64: unlink d7/da/c11 0 2024-09-13T21:40:18.834 INFO:tasks.workunit.client.0.smithi088.stdout:9/57: link ca cd 0 2024-09-13T21:40:18.835 INFO:tasks.workunit.client.0.smithi088.stdout:0/65: mknod d7/c14 0 2024-09-13T21:40:18.835 INFO:tasks.workunit.client.0.smithi088.stdout:0/66: dread - d7/f9 zero size 2024-09-13T21:40:18.839 INFO:tasks.workunit.client.0.smithi088.stdout:0/67: rename d7/ff to d7/f15 0 2024-09-13T21:40:18.839 INFO:tasks.workunit.client.0.smithi088.stdout:0/68: write d7/f15 [807029,918] 0 2024-09-13T21:40:18.839 INFO:tasks.workunit.client.0.smithi088.stdout:0/69: chown d7/f12 302614389 1 2024-09-13T21:40:18.841 INFO:tasks.workunit.client.0.smithi088.stdout:9/58: unlink l6 0 2024-09-13T21:40:18.841 INFO:tasks.workunit.client.0.smithi088.stdout:9/59: write fb [998183,39262] 0 2024-09-13T21:40:18.841 INFO:tasks.workunit.client.0.smithi088.stdout:9/60: stat f4 0 2024-09-13T21:40:18.841 INFO:tasks.workunit.client.0.smithi088.stdout:0/70: symlink d7/l16 0 2024-09-13T21:40:18.843 INFO:tasks.workunit.client.0.smithi088.stdout:0/71: creat d7/da/f17 x:0 0 0 2024-09-13T21:40:18.843 INFO:tasks.workunit.client.0.smithi088.stdout:0/72: fdatasync d7/f12 0 2024-09-13T21:40:18.844 INFO:tasks.workunit.client.0.smithi088.stdout:9/61: symlink le 0 2024-09-13T21:40:18.846 INFO:tasks.workunit.client.0.smithi088.stdout:9/62: unlink le 0 2024-09-13T21:40:18.846 INFO:tasks.workunit.client.0.smithi088.stdout:9/63: write f4 [3214215,32083] 0 2024-09-13T21:40:18.847 INFO:tasks.workunit.client.0.smithi088.stdout:1/115: dwrite d9/dc/f1f [0,4194304] 0 2024-09-13T21:40:18.847 INFO:tasks.workunit.client.0.smithi088.stdout:1/116: creat d9/d18/f2f x:0 0 0 2024-09-13T21:40:18.848 INFO:tasks.workunit.client.0.smithi088.stdout:9/64: creat ff x:0 0 0 2024-09-13T21:40:18.848 INFO:tasks.workunit.client.0.smithi088.stdout:9/65: dread - ff zero size 2024-09-13T21:40:18.848 INFO:tasks.workunit.client.0.smithi088.stdout:9/66: stat fb 0 2024-09-13T21:40:18.848 INFO:tasks.workunit.client.0.smithi088.stdout:6/108: sync 2024-09-13T21:40:18.848 INFO:tasks.workunit.client.0.smithi088.stdout:2/56: sync 2024-09-13T21:40:18.853 INFO:tasks.workunit.client.0.smithi088.stdout:9/67: unlink l0 0 2024-09-13T21:40:18.853 INFO:tasks.workunit.client.0.smithi088.stdout:9/68: write ff [542984,68915] 0 2024-09-13T21:40:18.853 INFO:tasks.workunit.client.0.smithi088.stdout:6/109: rmdir d0/d1e 39 2024-09-13T21:40:18.854 INFO:tasks.workunit.client.0.smithi088.stdout:5/56: sync 2024-09-13T21:40:18.854 INFO:tasks.workunit.client.0.smithi088.stdout:8/64: sync 2024-09-13T21:40:18.855 INFO:tasks.workunit.client.0.smithi088.stdout:2/57: creat d1/f10 x:0 0 0 2024-09-13T21:40:18.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/58: write d1/d8/fe [742315,98751] 0 2024-09-13T21:40:18.858 INFO:tasks.workunit.client.0.smithi088.stdout:2/59: dread d1/f4 [0,4194304] 0 2024-09-13T21:40:18.858 INFO:tasks.workunit.client.0.smithi088.stdout:2/60: chown d1/l5 11 1 2024-09-13T21:40:18.859 INFO:tasks.workunit.client.0.smithi088.stdout:3/46: sync 2024-09-13T21:40:18.859 INFO:tasks.workunit.client.0.smithi088.stdout:7/92: sync 2024-09-13T21:40:18.859 INFO:tasks.workunit.client.0.smithi088.stdout:4/45: sync 2024-09-13T21:40:18.859 INFO:tasks.workunit.client.0.smithi088.stdout:3/47: readlink d5/l9 0 2024-09-13T21:40:18.859 INFO:tasks.workunit.client.0.smithi088.stdout:4/46: dread - d2/fb zero size 2024-09-13T21:40:18.859 INFO:tasks.workunit.client.0.smithi088.stdout:4/47: write d2/fb [611156,119345] 0 2024-09-13T21:40:18.859 INFO:tasks.workunit.client.0.smithi088.stdout:4/48: read f1 [5570045,120363] 0 2024-09-13T21:40:18.861 INFO:tasks.workunit.client.0.smithi088.stdout:6/110: creat d0/d1e/f24 x:0 0 0 2024-09-13T21:40:18.862 INFO:tasks.workunit.client.0.smithi088.stdout:9/69: dread f9 [0,4194304] 0 2024-09-13T21:40:18.863 INFO:tasks.workunit.client.0.smithi088.stdout:8/65: mknod db/c19 0 2024-09-13T21:40:18.863 INFO:tasks.workunit.client.0.smithi088.stdout:8/66: truncate db/df/f18 652607 0 2024-09-13T21:40:18.864 INFO:tasks.workunit.client.0.smithi088.stdout:2/61: link d1/d8/la d1/d8/l11 0 2024-09-13T21:40:18.866 INFO:tasks.workunit.client.0.smithi088.stdout:7/93: creat d6/da/d1a/f21 x:0 0 0 2024-09-13T21:40:18.867 INFO:tasks.workunit.client.0.smithi088.stdout:9/70: write f9 [1665972,70243] 0 2024-09-13T21:40:18.868 INFO:tasks.workunit.client.0.smithi088.stdout:4/49: creat d2/d9/fc x:0 0 0 2024-09-13T21:40:18.868 INFO:tasks.workunit.client.0.smithi088.stdout:2/62: dread d1/d8/fc [0,4194304] 0 2024-09-13T21:40:18.869 INFO:tasks.workunit.client.0.smithi088.stdout:2/63: creat d1/d8/f12 x:0 0 0 2024-09-13T21:40:18.869 INFO:tasks.workunit.client.0.smithi088.stdout:2/64: fdatasync d1/d8/f12 0 2024-09-13T21:40:18.869 INFO:tasks.workunit.client.0.smithi088.stdout:2/65: truncate d1/fb 779956 0 2024-09-13T21:40:18.869 INFO:tasks.workunit.client.0.smithi088.stdout:3/48: write f0 [896828,51541] 0 2024-09-13T21:40:18.872 INFO:tasks.workunit.client.0.smithi088.stdout:6/111: truncate d0/db/f12 3536717 0 2024-09-13T21:40:18.872 INFO:tasks.workunit.client.0.smithi088.stdout:0/73: fsync d7/da/f17 0 2024-09-13T21:40:18.872 INFO:tasks.workunit.client.0.smithi088.stdout:8/67: rename db/df/f11 to db/f1a 0 2024-09-13T21:40:18.872 INFO:tasks.workunit.client.0.smithi088.stdout:0/74: creat d7/f18 x:0 0 0 2024-09-13T21:40:18.874 INFO:tasks.workunit.client.0.smithi088.stdout:9/71: creat f10 x:0 0 0 2024-09-13T21:40:18.875 INFO:tasks.workunit.client.0.smithi088.stdout:5/57: dwrite d4/ff [0,4194304] 0 2024-09-13T21:40:18.876 INFO:tasks.workunit.client.0.smithi088.stdout:8/68: dread fa [0,4194304] 0 2024-09-13T21:40:18.876 INFO:tasks.workunit.client.0.smithi088.stdout:4/50: mkdir d2/d5/dd 0 2024-09-13T21:40:18.878 INFO:tasks.workunit.client.0.smithi088.stdout:3/49: symlink d5/ld 0 2024-09-13T21:40:18.879 INFO:tasks.workunit.client.0.smithi088.stdout:1/117: rmdir d9 39 2024-09-13T21:40:18.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/50: dread d5/f6 [0,4194304] 0 2024-09-13T21:40:18.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/51: creat d5/fe x:0 0 0 2024-09-13T21:40:18.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/52: dread - d5/fe zero size 2024-09-13T21:40:18.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/53: write f0 [1154376,20044] 0 2024-09-13T21:40:18.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/54: write d5/fc [831771,15426] 0 2024-09-13T21:40:18.881 INFO:tasks.workunit.client.0.smithi088.stdout:6/112: symlink d0/d1e/l25 0 2024-09-13T21:40:18.883 INFO:tasks.workunit.client.0.smithi088.stdout:3/55: fsync d5/fc 0 2024-09-13T21:40:18.883 INFO:tasks.workunit.client.0.smithi088.stdout:7/94: link d6/da/f1e d6/f22 0 2024-09-13T21:40:18.895 INFO:tasks.workunit.client.0.smithi088.stdout:5/58: creat d4/d8/f11 x:0 0 0 2024-09-13T21:40:18.902 INFO:tasks.workunit.client.0.smithi088.stdout:7/95: dwrite d6/da/f1e [0,4194304] 0 2024-09-13T21:40:18.903 INFO:tasks.workunit.client.0.smithi088.stdout:7/96: chown d6/da/ld 798448 1 2024-09-13T21:40:18.903 INFO:tasks.workunit.client.0.smithi088.stdout:4/51: rename d2/d5/dd to d2/d9/de 0 2024-09-13T21:40:18.903 INFO:tasks.workunit.client.0.smithi088.stdout:4/52: chown d2/d9/de 3999573 1 2024-09-13T21:40:18.903 INFO:tasks.workunit.client.0.smithi088.stdout:4/53: stat d2/d9/fc 0 2024-09-13T21:40:18.904 INFO:tasks.workunit.client.0.smithi088.stdout:1/118: mknod d9/c30 0 2024-09-13T21:40:18.904 INFO:tasks.workunit.client.0.smithi088.stdout:1/119: dread - d9/d10/f17 zero size 2024-09-13T21:40:18.904 INFO:tasks.workunit.client.0.smithi088.stdout:1/120: fdatasync d9/d10/f29 0 2024-09-13T21:40:18.904 INFO:tasks.workunit.client.0.smithi088.stdout:1/121: readlink d9/d18/l2b 0 2024-09-13T21:40:18.908 INFO:tasks.workunit.client.0.smithi088.stdout:0/75: rename d7/f18 to d7/f19 0 2024-09-13T21:40:18.910 INFO:tasks.workunit.client.0.smithi088.stdout:3/56: truncate f3 52971 0 2024-09-13T21:40:18.912 INFO:tasks.workunit.client.0.smithi088.stdout:9/72: truncate f4 6653803 0 2024-09-13T21:40:18.913 INFO:tasks.workunit.client.0.smithi088.stdout:8/69: getdents db 0 2024-09-13T21:40:18.917 INFO:tasks.workunit.client.0.smithi088.stdout:7/97: mknod d6/da/d1a/c23 0 2024-09-13T21:40:18.918 INFO:tasks.workunit.client.0.smithi088.stdout:7/98: creat d6/da/d1a/f24 x:0 0 0 2024-09-13T21:40:18.918 INFO:tasks.workunit.client.0.smithi088.stdout:7/99: fsync f1 0 2024-09-13T21:40:18.919 INFO:tasks.workunit.client.0.smithi088.stdout:5/59: rename l0 to d4/d8/l12 0 2024-09-13T21:40:18.920 INFO:tasks.workunit.client.0.smithi088.stdout:1/122: creat d9/f31 x:0 0 0 2024-09-13T21:40:18.921 INFO:tasks.workunit.client.0.smithi088.stdout:6/113: unlink d0/c5 0 2024-09-13T21:40:18.922 INFO:tasks.workunit.client.0.smithi088.stdout:3/57: symlink d5/lf 0 2024-09-13T21:40:18.924 INFO:tasks.workunit.client.0.smithi088.stdout:8/70: mknod db/df/c1b 0 2024-09-13T21:40:18.925 INFO:tasks.workunit.client.0.smithi088.stdout:1/123: mknod d9/d18/c32 0 2024-09-13T21:40:18.927 INFO:tasks.workunit.client.0.smithi088.stdout:8/71: read fa [516216,13379] 0 2024-09-13T21:40:18.929 INFO:tasks.workunit.client.0.smithi088.stdout:6/114: getdents d0/d1e 0 2024-09-13T21:40:18.929 INFO:tasks.workunit.client.0.smithi088.stdout:6/115: creat d0/db/f26 x:0 0 0 2024-09-13T21:40:18.929 INFO:tasks.workunit.client.0.smithi088.stdout:6/116: fsync d0/d1e/f24 0 2024-09-13T21:40:18.930 INFO:tasks.workunit.client.0.smithi088.stdout:8/72: symlink db/l1c 0 2024-09-13T21:40:18.931 INFO:tasks.workunit.client.0.smithi088.stdout:9/73: rename c8 to c11 0 2024-09-13T21:40:18.931 INFO:tasks.workunit.client.0.smithi088.stdout:9/74: chown f10 2 1 2024-09-13T21:40:18.933 INFO:tasks.workunit.client.0.smithi088.stdout:9/75: unlink lc 0 2024-09-13T21:40:18.940 INFO:tasks.workunit.client.0.smithi088.stdout:0/76: dwrite d7/f9 [0,4194304] 0 2024-09-13T21:40:18.940 INFO:tasks.workunit.client.0.smithi088.stdout:0/77: write f3 [275071,111006] 0 2024-09-13T21:40:18.944 INFO:tasks.workunit.client.0.smithi088.stdout:0/78: mkdir d7/d1a 0 2024-09-13T21:40:18.947 INFO:tasks.workunit.client.0.smithi088.stdout:7/100: write d6/da/f1e [675023,105041] 0 2024-09-13T21:40:18.949 INFO:tasks.workunit.client.0.smithi088.stdout:0/79: rename f3 to d7/da/f1b 0 2024-09-13T21:40:18.949 INFO:tasks.workunit.client.0.smithi088.stdout:0/80: creat d7/da/f1c x:0 0 0 2024-09-13T21:40:18.949 INFO:tasks.workunit.client.0.smithi088.stdout:3/58: dread f3 [0,4194304] 0 2024-09-13T21:40:18.951 INFO:tasks.workunit.client.0.smithi088.stdout:7/101: mknod d6/da/c25 0 2024-09-13T21:40:18.952 INFO:tasks.workunit.client.0.smithi088.stdout:1/124: write d9/d10/f11 [2991448,34263] 0 2024-09-13T21:40:18.953 INFO:tasks.workunit.client.0.smithi088.stdout:6/117: write d0/ff [417964,56571] 0 2024-09-13T21:40:18.954 INFO:tasks.workunit.client.0.smithi088.stdout:0/81: mkdir d7/d1d 0 2024-09-13T21:40:18.954 INFO:tasks.workunit.client.0.smithi088.stdout:1/125: dread d9/d18/f23 [0,4194304] 0 2024-09-13T21:40:18.954 INFO:tasks.workunit.client.0.smithi088.stdout:1/126: dread - d9/d18/f28 zero size 2024-09-13T21:40:18.954 INFO:tasks.workunit.client.0.smithi088.stdout:3/59: creat d5/db/f10 x:0 0 0 2024-09-13T21:40:18.955 INFO:tasks.workunit.client.0.smithi088.stdout:7/102: unlink c2 0 2024-09-13T21:40:18.957 INFO:tasks.workunit.client.0.smithi088.stdout:6/118: mkdir d0/d1e/d1f/d27 0 2024-09-13T21:40:18.957 INFO:tasks.workunit.client.0.smithi088.stdout:6/119: read d0/f17 [887072,15367] 0 2024-09-13T21:40:18.957 INFO:tasks.workunit.client.0.smithi088.stdout:0/82: creat d7/d1a/f1e x:0 0 0 2024-09-13T21:40:18.958 INFO:tasks.workunit.client.0.smithi088.stdout:3/60: symlink d5/l11 0 2024-09-13T21:40:18.959 INFO:tasks.workunit.client.0.smithi088.stdout:8/73: dwrite db/f1a [0,4194304] 0 2024-09-13T21:40:18.959 INFO:tasks.workunit.client.0.smithi088.stdout:8/74: chown db/l1c 17780 1 2024-09-13T21:40:18.960 INFO:tasks.workunit.client.0.smithi088.stdout:7/103: mknod d6/da/c26 0 2024-09-13T21:40:18.960 INFO:tasks.workunit.client.0.smithi088.stdout:9/76: dwrite fb [0,4194304] 0 2024-09-13T21:40:18.961 INFO:tasks.workunit.client.0.smithi088.stdout:0/83: mknod d7/c1f 0 2024-09-13T21:40:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:1/127: dread f1 [0,4194304] 0 2024-09-13T21:40:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:1/128: dread - d9/d18/f2f zero size 2024-09-13T21:40:18.965 INFO:tasks.workunit.client.0.smithi088.stdout:1/129: chown d9/d18/f23 7025 1 2024-09-13T21:40:18.967 INFO:tasks.workunit.client.0.smithi088.stdout:8/75: link db/df/c16 db/c1d 0 2024-09-13T21:40:18.967 INFO:tasks.workunit.client.0.smithi088.stdout:8/76: dread - db/f17 zero size 2024-09-13T21:40:18.967 INFO:tasks.workunit.client.0.smithi088.stdout:8/77: readlink l9 0 2024-09-13T21:40:18.968 INFO:tasks.workunit.client.0.smithi088.stdout:7/104: symlink d6/da/d1a/l27 0 2024-09-13T21:40:18.968 INFO:tasks.workunit.client.0.smithi088.stdout:7/105: fdatasync d6/da/fb 0 2024-09-13T21:40:18.976 INFO:tasks.workunit.client.0.smithi088.stdout:6/120: mkdir d0/d28 0 2024-09-13T21:40:18.977 INFO:tasks.workunit.client.0.smithi088.stdout:6/121: chown d0/l1a 0 1 2024-09-13T21:40:18.977 INFO:tasks.workunit.client.0.smithi088.stdout:6/122: creat d0/db/f29 x:0 0 0 2024-09-13T21:40:18.977 INFO:tasks.workunit.client.0.smithi088.stdout:6/123: rename d0/d1e to d0/d1e/d1f/d27/d2a 22 2024-09-13T21:40:18.977 INFO:tasks.workunit.client.0.smithi088.stdout:0/84: symlink d7/d1d/l20 0 2024-09-13T21:40:18.978 INFO:tasks.workunit.client.0.smithi088.stdout:3/61: rmdir d5 39 2024-09-13T21:40:18.978 INFO:tasks.workunit.client.0.smithi088.stdout:3/62: truncate f3 690042 0 2024-09-13T21:40:18.980 INFO:tasks.workunit.client.0.smithi088.stdout:1/130: mkdir d9/d18/d33 0 2024-09-13T21:40:18.981 INFO:tasks.workunit.client.0.smithi088.stdout:8/78: symlink db/df/l1e 0 2024-09-13T21:40:18.982 INFO:tasks.workunit.client.0.smithi088.stdout:9/77: symlink l12 0 2024-09-13T21:40:18.984 INFO:tasks.workunit.client.0.smithi088.stdout:9/78: creat f13 x:0 0 0 2024-09-13T21:40:18.984 INFO:tasks.workunit.client.0.smithi088.stdout:9/79: creat f14 x:0 0 0 2024-09-13T21:40:18.985 INFO:tasks.workunit.client.0.smithi088.stdout:9/80: creat f15 x:0 0 0 2024-09-13T21:40:18.985 INFO:tasks.workunit.client.0.smithi088.stdout:0/85: write d7/f9 [3224423,19660] 0 2024-09-13T21:40:18.985 INFO:tasks.workunit.client.0.smithi088.stdout:0/86: write d7/da/f17 [287030,65990] 0 2024-09-13T21:40:18.986 INFO:tasks.workunit.client.0.smithi088.stdout:0/87: mkdir d7/d1d/d21 0 2024-09-13T21:40:18.987 INFO:tasks.workunit.client.0.smithi088.stdout:0/88: creat d7/d1a/f22 x:0 0 0 2024-09-13T21:40:18.987 INFO:tasks.workunit.client.0.smithi088.stdout:9/81: link l12 l16 0 2024-09-13T21:40:18.987 INFO:tasks.workunit.client.0.smithi088.stdout:9/82: chown c11 1505 1 2024-09-13T21:40:18.989 INFO:tasks.workunit.client.0.smithi088.stdout:0/89: dread d7/da/f1b [0,4194304] 0 2024-09-13T21:40:18.989 INFO:tasks.workunit.client.0.smithi088.stdout:7/106: dwrite d6/da/f19 [0,4194304] 0 2024-09-13T21:40:18.990 INFO:tasks.workunit.client.0.smithi088.stdout:9/83: unlink ff 0 2024-09-13T21:40:18.990 INFO:tasks.workunit.client.0.smithi088.stdout:9/84: chown f4 14 1 2024-09-13T21:40:18.993 INFO:tasks.workunit.client.0.smithi088.stdout:8/79: dread db/f1a [0,4194304] 0 2024-09-13T21:40:18.994 INFO:tasks.workunit.client.0.smithi088.stdout:7/107: rmdir d6/da 39 2024-09-13T21:40:18.994 INFO:tasks.workunit.client.0.smithi088.stdout:0/90: rename d7/d1a/f1e to d7/f23 0 2024-09-13T21:40:18.994 INFO:tasks.workunit.client.0.smithi088.stdout:7/108: write d6/f1c [448112,28578] 0 2024-09-13T21:40:18.995 INFO:tasks.workunit.client.0.smithi088.stdout:1/131: write d9/dc/f24 [2434791,835] 0 2024-09-13T21:40:19.000 INFO:tasks.workunit.client.0.smithi088.stdout:0/91: unlink d7/f15 0 2024-09-13T21:40:19.000 INFO:tasks.workunit.client.0.smithi088.stdout:0/92: read - d7/f23 zero size 2024-09-13T21:40:19.000 INFO:tasks.workunit.client.0.smithi088.stdout:0/93: creat d7/f24 x:0 0 0 2024-09-13T21:40:19.000 INFO:tasks.workunit.client.0.smithi088.stdout:0/94: write d7/f9 [4896328,88842] 0 2024-09-13T21:40:19.001 INFO:tasks.workunit.client.0.smithi088.stdout:7/109: link c3 d6/da/c28 0 2024-09-13T21:40:19.001 INFO:tasks.workunit.client.0.smithi088.stdout:7/110: fsync d6/da/f10 0 2024-09-13T21:40:19.002 INFO:tasks.workunit.client.0.smithi088.stdout:1/132: symlink d9/dc/l34 0 2024-09-13T21:40:19.008 INFO:tasks.workunit.client.0.smithi088.stdout:0/95: mknod d7/d1a/c25 0 2024-09-13T21:40:19.008 INFO:tasks.workunit.client.0.smithi088.stdout:1/133: creat d9/dc/f35 x:0 0 0 2024-09-13T21:40:19.008 INFO:tasks.workunit.client.0.smithi088.stdout:1/134: chown d9/d10/f2c 3809513 1 2024-09-13T21:40:19.010 INFO:tasks.workunit.client.0.smithi088.stdout:1/135: unlink d9/d10/f2c 0 2024-09-13T21:40:19.022 INFO:tasks.workunit.client.0.smithi088.stdout:6/124: dwrite d0/f17 [0,4194304] 0 2024-09-13T21:40:19.022 INFO:tasks.workunit.client.0.smithi088.stdout:6/125: stat d0/l19 0 2024-09-13T21:40:19.024 INFO:tasks.workunit.client.0.smithi088.stdout:8/80: dwrite db/f17 [0,4194304] 0 2024-09-13T21:40:19.024 INFO:tasks.workunit.client.0.smithi088.stdout:8/81: truncate fa 4613837 0 2024-09-13T21:40:19.024 INFO:tasks.workunit.client.0.smithi088.stdout:8/82: chown db/df/f18 42129 1 2024-09-13T21:40:19.024 INFO:tasks.workunit.client.0.smithi088.stdout:8/83: creat db/df/f1f x:0 0 0 2024-09-13T21:40:19.024 INFO:tasks.workunit.client.0.smithi088.stdout:7/111: dwrite d6/da/f10 [0,4194304] 0 2024-09-13T21:40:19.024 INFO:tasks.workunit.client.0.smithi088.stdout:7/112: chown d6/f1c 298353851 1 2024-09-13T21:40:19.025 INFO:tasks.workunit.client.0.smithi088.stdout:6/126: rmdir d0/d1e/d1f/d27 0 2024-09-13T21:40:19.029 INFO:tasks.workunit.client.0.smithi088.stdout:8/84: mknod db/c20 0 2024-09-13T21:40:19.029 INFO:tasks.workunit.client.0.smithi088.stdout:8/85: chown db/df/l13 205 1 2024-09-13T21:40:19.029 INFO:tasks.workunit.client.0.smithi088.stdout:8/86: write db/f14 [2710673,3646] 0 2024-09-13T21:40:19.033 INFO:tasks.workunit.client.0.smithi088.stdout:0/96: dwrite d7/f24 [0,4194304] 0 2024-09-13T21:40:19.033 INFO:tasks.workunit.client.0.smithi088.stdout:7/113: dread d6/da/f1e [0,4194304] 0 2024-09-13T21:40:19.033 INFO:tasks.workunit.client.0.smithi088.stdout:7/114: chown d6/da/f19 9024 1 2024-09-13T21:40:19.033 INFO:tasks.workunit.client.0.smithi088.stdout:0/97: write d7/da/f13 [646542,72260] 0 2024-09-13T21:40:19.033 INFO:tasks.workunit.client.0.smithi088.stdout:7/115: truncate d6/da/d1a/f24 358089 0 2024-09-13T21:40:19.033 INFO:tasks.workunit.client.0.smithi088.stdout:8/87: read db/f14 [1651181,16407] 0 2024-09-13T21:40:19.033 INFO:tasks.workunit.client.0.smithi088.stdout:8/88: truncate db/f1a 4780370 0 2024-09-13T21:40:19.033 INFO:tasks.workunit.client.0.smithi088.stdout:2/66: sync 2024-09-13T21:40:19.034 INFO:tasks.workunit.client.0.smithi088.stdout:4/54: sync 2024-09-13T21:40:19.034 INFO:tasks.workunit.client.0.smithi088.stdout:4/55: chown d2/d9/fc 1307984 1 2024-09-13T21:40:19.034 INFO:tasks.workunit.client.0.smithi088.stdout:4/56: truncate d2/d9/fc 349317 0 2024-09-13T21:40:19.035 INFO:tasks.workunit.client.0.smithi088.stdout:2/67: write d1/d8/fe [658640,33344] 0 2024-09-13T21:40:19.036 INFO:tasks.workunit.client.0.smithi088.stdout:8/89: mknod db/c21 0 2024-09-13T21:40:19.036 INFO:tasks.workunit.client.0.smithi088.stdout:8/90: chown db/c21 34 1 2024-09-13T21:40:19.037 INFO:tasks.workunit.client.0.smithi088.stdout:1/136: dwrite d9/dc/f35 [0,4194304] 0 2024-09-13T21:40:19.037 INFO:tasks.workunit.client.0.smithi088.stdout:1/137: dread - d9/d18/f27 zero size 2024-09-13T21:40:19.038 INFO:tasks.workunit.client.0.smithi088.stdout:1/138: write d9/dc/f24 [1861564,33625] 0 2024-09-13T21:40:19.040 INFO:tasks.workunit.client.0.smithi088.stdout:4/57: link f1 d2/d5/ff 0 2024-09-13T21:40:19.040 INFO:tasks.workunit.client.0.smithi088.stdout:4/58: chown d2/d5/ff 874175473 1 2024-09-13T21:40:19.040 INFO:tasks.workunit.client.0.smithi088.stdout:4/59: rename d2/d9/de to d2/d9/de/d10 22 2024-09-13T21:40:19.040 INFO:tasks.workunit.client.0.smithi088.stdout:4/60: write d2/d9/fc [870078,45741] 0 2024-09-13T21:40:19.040 INFO:tasks.workunit.client.0.smithi088.stdout:4/61: chown d2/fb 344177154 1 2024-09-13T21:40:19.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/68: mkdir d1/d13 0 2024-09-13T21:40:19.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/69: fsync d1/d8/f12 0 2024-09-13T21:40:19.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/70: truncate d1/f10 489018 0 2024-09-13T21:40:19.042 INFO:tasks.workunit.client.0.smithi088.stdout:0/98: dread d7/f9 [0,4194304] 0 2024-09-13T21:40:19.042 INFO:tasks.workunit.client.0.smithi088.stdout:0/99: write d7/f12 [556744,101462] 0 2024-09-13T21:40:19.042 INFO:tasks.workunit.client.0.smithi088.stdout:8/91: symlink db/df/l22 0 2024-09-13T21:40:19.044 INFO:tasks.workunit.client.0.smithi088.stdout:6/127: dwrite d0/f16 [0,4194304] 0 2024-09-13T21:40:19.047 INFO:tasks.workunit.client.0.smithi088.stdout:7/116: write d6/da/fb [168,89773] 0 2024-09-13T21:40:19.053 INFO:tasks.workunit.client.0.smithi088.stdout:0/100: mkdir d7/d1d/d26 0 2024-09-13T21:40:19.053 INFO:tasks.workunit.client.0.smithi088.stdout:0/101: read - d7/f19 zero size 2024-09-13T21:40:19.053 INFO:tasks.workunit.client.0.smithi088.stdout:0/102: stat d7/c1f 0 2024-09-13T21:40:19.053 INFO:tasks.workunit.client.0.smithi088.stdout:0/103: chown d7/l16 7 1 2024-09-13T21:40:19.053 INFO:tasks.workunit.client.0.smithi088.stdout:0/104: stat d7/d1d 0 2024-09-13T21:40:19.055 INFO:tasks.workunit.client.0.smithi088.stdout:6/128: write d0/f17 [2472052,120433] 0 2024-09-13T21:40:19.058 INFO:tasks.workunit.client.0.smithi088.stdout:6/129: dread d0/f22 [0,4194304] 0 2024-09-13T21:40:19.061 INFO:tasks.workunit.client.0.smithi088.stdout:4/62: dwrite d2/d9/fc [0,4194304] 0 2024-09-13T21:40:19.064 INFO:tasks.workunit.client.0.smithi088.stdout:4/63: dread d2/fb [0,4194304] 0 2024-09-13T21:40:19.064 INFO:tasks.workunit.client.0.smithi088.stdout:4/64: write f1 [6788456,39818] 0 2024-09-13T21:40:19.067 INFO:tasks.workunit.client.0.smithi088.stdout:2/71: getdents d1/d8 0 2024-09-13T21:40:19.067 INFO:tasks.workunit.client.0.smithi088.stdout:0/105: dread f5 [0,4194304] 0 2024-09-13T21:40:19.067 INFO:tasks.workunit.client.0.smithi088.stdout:0/106: dread - d7/da/f1c zero size 2024-09-13T21:40:19.069 INFO:tasks.workunit.client.0.smithi088.stdout:8/92: unlink c3 0 2024-09-13T21:40:19.070 INFO:tasks.workunit.client.0.smithi088.stdout:0/107: dread d7/da/f13 [0,4194304] 0 2024-09-13T21:40:19.072 INFO:tasks.workunit.client.0.smithi088.stdout:6/130: mknod d0/d28/c2b 0 2024-09-13T21:40:19.073 INFO:tasks.workunit.client.0.smithi088.stdout:4/65: chown d2/l3 2 1 2024-09-13T21:40:19.074 INFO:tasks.workunit.client.0.smithi088.stdout:7/117: getdents d6 0 2024-09-13T21:40:19.078 INFO:tasks.workunit.client.0.smithi088.stdout:8/93: creat db/f23 x:0 0 0 2024-09-13T21:40:19.079 INFO:tasks.workunit.client.0.smithi088.stdout:8/94: write db/f23 [851033,105604] 0 2024-09-13T21:40:19.079 INFO:tasks.workunit.client.0.smithi088.stdout:8/95: creat db/f24 x:0 0 0 2024-09-13T21:40:19.079 INFO:tasks.workunit.client.0.smithi088.stdout:8/96: chown db/df/c15 1 1 2024-09-13T21:40:19.079 INFO:tasks.workunit.client.0.smithi088.stdout:0/108: mkdir d7/d1d/d27 0 2024-09-13T21:40:19.082 INFO:tasks.workunit.client.0.smithi088.stdout:2/72: dwrite d1/d8/fc [0,4194304] 0 2024-09-13T21:40:19.083 INFO:tasks.workunit.client.0.smithi088.stdout:0/109: rename d7/fc to d7/f28 0 2024-09-13T21:40:19.084 INFO:tasks.workunit.client.0.smithi088.stdout:6/131: mkdir d0/d2c 0 2024-09-13T21:40:19.085 INFO:tasks.workunit.client.0.smithi088.stdout:4/66: mkdir d2/d11 0 2024-09-13T21:40:19.086 INFO:tasks.workunit.client.0.smithi088.stdout:0/110: creat d7/d1d/f29 x:0 0 0 2024-09-13T21:40:19.088 INFO:tasks.workunit.client.0.smithi088.stdout:4/67: stat d2/l4 0 2024-09-13T21:40:19.088 INFO:tasks.workunit.client.0.smithi088.stdout:2/73: dread d1/d8/fc [0,4194304] 0 2024-09-13T21:40:19.089 INFO:tasks.workunit.client.0.smithi088.stdout:2/74: write d1/fd [668362,54149] 0 2024-09-13T21:40:19.089 INFO:tasks.workunit.client.0.smithi088.stdout:6/132: mknod d0/c2d 0 2024-09-13T21:40:19.089 INFO:tasks.workunit.client.0.smithi088.stdout:6/133: truncate d0/d1e/f24 461549 0 2024-09-13T21:40:19.089 INFO:tasks.workunit.client.0.smithi088.stdout:6/134: truncate d0/d1e/f24 901337 0 2024-09-13T21:40:19.090 INFO:tasks.workunit.client.0.smithi088.stdout:6/135: creat d0/db/f2e x:0 0 0 2024-09-13T21:40:19.090 INFO:tasks.workunit.client.0.smithi088.stdout:0/111: dread d7/da/f1b [0,4194304] 0 2024-09-13T21:40:19.091 INFO:tasks.workunit.client.0.smithi088.stdout:8/97: write f8 [3078575,70909] 0 2024-09-13T21:40:19.092 INFO:tasks.workunit.client.0.smithi088.stdout:6/136: chown d0/l7 9329 1 2024-09-13T21:40:19.094 INFO:tasks.workunit.client.0.smithi088.stdout:0/112: rename d7/da/f1b to d7/d1d/d21/f2a 0 2024-09-13T21:40:19.094 INFO:tasks.workunit.client.0.smithi088.stdout:5/60: sync 2024-09-13T21:40:19.095 INFO:tasks.workunit.client.0.smithi088.stdout:4/68: truncate f1 3206855 0 2024-09-13T21:40:19.097 INFO:tasks.workunit.client.0.smithi088.stdout:8/98: dread db/f23 [0,4194304] 0 2024-09-13T21:40:19.097 INFO:tasks.workunit.client.0.smithi088.stdout:8/99: fsync db/df/f1f 0 2024-09-13T21:40:19.102 INFO:tasks.workunit.client.0.smithi088.stdout:4/69: mkdir d2/d9/de/d12 0 2024-09-13T21:40:19.103 INFO:tasks.workunit.client.0.smithi088.stdout:8/100: mkdir db/df/d25 0 2024-09-13T21:40:19.104 INFO:tasks.workunit.client.0.smithi088.stdout:5/61: rmdir d4/d8 39 2024-09-13T21:40:19.105 INFO:tasks.workunit.client.0.smithi088.stdout:5/62: dread - d4/d8/f11 zero size 2024-09-13T21:40:19.105 INFO:tasks.workunit.client.0.smithi088.stdout:5/63: chown d4/fc 464204 1 2024-09-13T21:40:19.105 INFO:tasks.workunit.client.0.smithi088.stdout:5/64: creat d4/f13 x:0 0 0 2024-09-13T21:40:19.105 INFO:tasks.workunit.client.0.smithi088.stdout:5/65: dread - d4/d8/fa zero size 2024-09-13T21:40:19.107 INFO:tasks.workunit.client.0.smithi088.stdout:5/66: dread d4/f7 [0,4194304] 0 2024-09-13T21:40:19.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/75: dwrite d1/f4 [0,4194304] 0 2024-09-13T21:40:19.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/76: read - d1/d8/f12 zero size 2024-09-13T21:40:19.107 INFO:tasks.workunit.client.0.smithi088.stdout:8/101: mkdir db/d26 0 2024-09-13T21:40:19.110 INFO:tasks.workunit.client.0.smithi088.stdout:4/70: mkdir d2/d13 0 2024-09-13T21:40:19.114 INFO:tasks.workunit.client.0.smithi088.stdout:2/77: creat d1/d8/f14 x:0 0 0 2024-09-13T21:40:19.114 INFO:tasks.workunit.client.0.smithi088.stdout:2/78: creat d1/f15 x:0 0 0 2024-09-13T21:40:19.114 INFO:tasks.workunit.client.0.smithi088.stdout:2/79: write d1/f10 [1339021,1377] 0 2024-09-13T21:40:19.115 INFO:tasks.workunit.client.0.smithi088.stdout:8/102: link l9 db/df/d25/l27 0 2024-09-13T21:40:19.115 INFO:tasks.workunit.client.0.smithi088.stdout:8/103: fsync db/f14 0 2024-09-13T21:40:19.115 INFO:tasks.workunit.client.0.smithi088.stdout:5/67: dread d4/fc [0,4194304] 0 2024-09-13T21:40:19.115 INFO:tasks.workunit.client.0.smithi088.stdout:5/68: chown d4/d8 4635540 1 2024-09-13T21:40:19.116 INFO:tasks.workunit.client.0.smithi088.stdout:4/71: creat d2/d5/f14 x:0 0 0 2024-09-13T21:40:19.118 INFO:tasks.workunit.client.0.smithi088.stdout:8/104: dread db/f1a [0,4194304] 0 2024-09-13T21:40:19.119 INFO:tasks.workunit.client.0.smithi088.stdout:4/72: creat d2/f15 x:0 0 0 2024-09-13T21:40:19.123 INFO:tasks.workunit.client.0.smithi088.stdout:5/69: dread d4/ff [0,4194304] 0 2024-09-13T21:40:19.123 INFO:tasks.workunit.client.0.smithi088.stdout:4/73: rename d2/d9/fc to d2/d11/f16 0 2024-09-13T21:40:19.124 INFO:tasks.workunit.client.0.smithi088.stdout:4/74: creat d2/d9/f17 x:0 0 0 2024-09-13T21:40:19.125 INFO:tasks.workunit.client.0.smithi088.stdout:5/70: unlink d4/d8/l12 0 2024-09-13T21:40:19.126 INFO:tasks.workunit.client.0.smithi088.stdout:5/71: stat d4/d8/fa 0 2024-09-13T21:40:19.128 INFO:tasks.workunit.client.0.smithi088.stdout:4/75: truncate d2/d5/ff 1148832 0 2024-09-13T21:40:19.129 INFO:tasks.workunit.client.0.smithi088.stdout:5/72: stat d4/d8/lb 0 2024-09-13T21:40:19.131 INFO:tasks.workunit.client.0.smithi088.stdout:5/73: symlink d4/d8/l14 0 2024-09-13T21:40:19.131 INFO:tasks.workunit.client.0.smithi088.stdout:5/74: dread - d4/d8/f11 zero size 2024-09-13T21:40:19.133 INFO:tasks.workunit.client.0.smithi088.stdout:2/80: rmdir d1 39 2024-09-13T21:40:19.134 INFO:tasks.workunit.client.0.smithi088.stdout:8/105: dwrite db/f24 [0,4194304] 0 2024-09-13T21:40:19.135 INFO:tasks.workunit.client.0.smithi088.stdout:2/81: mkdir d1/d8/d16 0 2024-09-13T21:40:19.136 INFO:tasks.workunit.client.0.smithi088.stdout:8/106: dread db/f23 [0,4194304] 0 2024-09-13T21:40:19.138 INFO:tasks.workunit.client.0.smithi088.stdout:8/107: dread db/df/f18 [0,4194304] 0 2024-09-13T21:40:19.138 INFO:tasks.workunit.client.0.smithi088.stdout:8/108: fsync db/f23 0 2024-09-13T21:40:19.138 INFO:tasks.workunit.client.0.smithi088.stdout:4/76: dread d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:19.138 INFO:tasks.workunit.client.0.smithi088.stdout:2/82: creat d1/d13/f17 x:0 0 0 2024-09-13T21:40:19.140 INFO:tasks.workunit.client.0.smithi088.stdout:4/77: unlink d2/ca 0 2024-09-13T21:40:19.141 INFO:tasks.workunit.client.0.smithi088.stdout:4/78: write d2/d9/f17 [938911,102558] 0 2024-09-13T21:40:19.141 INFO:tasks.workunit.client.0.smithi088.stdout:8/109: dread db/f14 [0,4194304] 0 2024-09-13T21:40:19.141 INFO:tasks.workunit.client.0.smithi088.stdout:5/75: rmdir d4 39 2024-09-13T21:40:19.142 INFO:tasks.workunit.client.0.smithi088.stdout:2/83: symlink d1/l18 0 2024-09-13T21:40:19.142 INFO:tasks.workunit.client.0.smithi088.stdout:2/84: chown d1/c3 41484 1 2024-09-13T21:40:19.144 INFO:tasks.workunit.client.0.smithi088.stdout:4/79: creat d2/d9/de/d12/f18 x:0 0 0 2024-09-13T21:40:19.144 INFO:tasks.workunit.client.0.smithi088.stdout:5/76: write d4/f10 [2921440,1093] 0 2024-09-13T21:40:19.146 INFO:tasks.workunit.client.0.smithi088.stdout:8/110: getdents db/df/d25 0 2024-09-13T21:40:19.146 INFO:tasks.workunit.client.0.smithi088.stdout:8/111: readlink db/df/l22 0 2024-09-13T21:40:19.148 INFO:tasks.workunit.client.0.smithi088.stdout:4/80: dread d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:19.149 INFO:tasks.workunit.client.0.smithi088.stdout:5/77: creat d4/d8/f15 x:0 0 0 2024-09-13T21:40:19.152 INFO:tasks.workunit.client.0.smithi088.stdout:5/78: mknod d4/c16 0 2024-09-13T21:40:19.152 INFO:tasks.workunit.client.0.smithi088.stdout:5/79: write d4/d8/f15 [318928,9101] 0 2024-09-13T21:40:19.152 INFO:tasks.workunit.client.0.smithi088.stdout:5/80: creat d4/d8/f17 x:0 0 0 2024-09-13T21:40:19.152 INFO:tasks.workunit.client.0.smithi088.stdout:5/81: truncate f2 1076950 0 2024-09-13T21:40:19.160 INFO:tasks.workunit.client.0.smithi088.stdout:3/63: sync 2024-09-13T21:40:19.160 INFO:tasks.workunit.client.0.smithi088.stdout:9/85: sync 2024-09-13T21:40:19.161 INFO:tasks.workunit.client.0.smithi088.stdout:3/64: read - d5/db/f10 zero size 2024-09-13T21:40:19.162 INFO:tasks.workunit.client.0.smithi088.stdout:3/65: unlink d5/ca 0 2024-09-13T21:40:19.163 INFO:tasks.workunit.client.0.smithi088.stdout:3/66: mknod d5/c12 0 2024-09-13T21:40:19.163 INFO:tasks.workunit.client.0.smithi088.stdout:3/67: chown d5/c7 159 1 2024-09-13T21:40:19.163 INFO:tasks.workunit.client.0.smithi088.stdout:2/85: dwrite d1/d8/fe [0,4194304] 0 2024-09-13T21:40:19.165 INFO:tasks.workunit.client.0.smithi088.stdout:3/68: dread d5/fc [0,4194304] 0 2024-09-13T21:40:19.166 INFO:tasks.workunit.client.0.smithi088.stdout:2/86: creat d1/d8/f19 x:0 0 0 2024-09-13T21:40:19.168 INFO:tasks.workunit.client.0.smithi088.stdout:3/69: getdents d5/db 0 2024-09-13T21:40:19.168 INFO:tasks.workunit.client.0.smithi088.stdout:3/70: fdatasync d5/fc 0 2024-09-13T21:40:19.169 INFO:tasks.workunit.client.0.smithi088.stdout:5/82: rename d4/d8 to d4/d18 0 2024-09-13T21:40:19.170 INFO:tasks.workunit.client.0.smithi088.stdout:5/83: chown d4/ff 98760448 1 2024-09-13T21:40:19.170 INFO:tasks.workunit.client.0.smithi088.stdout:5/84: chown d4/d18/l14 1 1 2024-09-13T21:40:19.171 INFO:tasks.workunit.client.0.smithi088.stdout:5/85: symlink d4/l19 0 2024-09-13T21:40:19.171 INFO:tasks.workunit.client.0.smithi088.stdout:5/86: readlink d4/d18/l14 0 2024-09-13T21:40:19.172 INFO:tasks.workunit.client.0.smithi088.stdout:5/87: link d4/ld d4/l1a 0 2024-09-13T21:40:19.173 INFO:tasks.workunit.client.0.smithi088.stdout:5/88: write d4/f6 [383408,69162] 0 2024-09-13T21:40:19.173 INFO:tasks.workunit.client.0.smithi088.stdout:4/81: dwrite d2/d5/ff [0,4194304] 0 2024-09-13T21:40:19.174 INFO:tasks.workunit.client.0.smithi088.stdout:5/89: mkdir d4/d1b 0 2024-09-13T21:40:19.176 INFO:tasks.workunit.client.0.smithi088.stdout:5/90: truncate d4/ff 619392 0 2024-09-13T21:40:19.178 INFO:tasks.workunit.client.0.smithi088.stdout:5/91: truncate d4/fc 7837782 0 2024-09-13T21:40:19.180 INFO:tasks.workunit.client.0.smithi088.stdout:5/92: write d4/d18/f15 [187647,127226] 0 2024-09-13T21:40:19.182 INFO:tasks.workunit.client.0.smithi088.stdout:5/93: mkdir d4/d1c 0 2024-09-13T21:40:19.182 INFO:tasks.workunit.client.0.smithi088.stdout:5/94: dread - d4/f13 zero size 2024-09-13T21:40:19.182 INFO:tasks.workunit.client.0.smithi088.stdout:5/95: read - d4/d18/f17 zero size 2024-09-13T21:40:19.198 INFO:tasks.workunit.client.0.smithi088.stdout:2/87: dwrite d1/d8/fc [0,4194304] 0 2024-09-13T21:40:19.198 INFO:tasks.workunit.client.0.smithi088.stdout:3/71: dwrite f0 [0,4194304] 0 2024-09-13T21:40:19.199 INFO:tasks.workunit.client.0.smithi088.stdout:4/82: dwrite d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:19.199 INFO:tasks.workunit.client.0.smithi088.stdout:4/83: write d2/d11/f16 [4243126,19999] 0 2024-09-13T21:40:19.200 INFO:tasks.workunit.client.0.smithi088.stdout:2/88: link d1/f10 d1/d13/f1a 0 2024-09-13T21:40:19.201 INFO:tasks.workunit.client.0.smithi088.stdout:4/84: dread d2/d9/f17 [0,4194304] 0 2024-09-13T21:40:19.203 INFO:tasks.workunit.client.0.smithi088.stdout:3/72: truncate f1 3134074 0 2024-09-13T21:40:19.203 INFO:tasks.workunit.client.0.smithi088.stdout:3/73: dread - d5/fe zero size 2024-09-13T21:40:19.205 INFO:tasks.workunit.client.0.smithi088.stdout:5/96: write d4/ff [386083,88567] 0 2024-09-13T21:40:19.205 INFO:tasks.workunit.client.0.smithi088.stdout:5/97: chown d4/d18 435 1 2024-09-13T21:40:19.213 INFO:tasks.workunit.client.0.smithi088.stdout:2/89: truncate d1/f10 473211 0 2024-09-13T21:40:19.213 INFO:tasks.workunit.client.0.smithi088.stdout:2/90: creat d1/d8/f1b x:0 0 0 2024-09-13T21:40:19.213 INFO:tasks.workunit.client.0.smithi088.stdout:2/91: dread - d1/d8/f19 zero size 2024-09-13T21:40:19.213 INFO:tasks.workunit.client.0.smithi088.stdout:2/92: chown d1/fb 1491508 1 2024-09-13T21:40:19.217 INFO:tasks.workunit.client.0.smithi088.stdout:2/93: chown d1/f15 3 1 2024-09-13T21:40:19.217 INFO:tasks.workunit.client.0.smithi088.stdout:3/74: rename d5/db/f10 to d5/f13 0 2024-09-13T21:40:19.217 INFO:tasks.workunit.client.0.smithi088.stdout:5/98: unlink d4/f10 0 2024-09-13T21:40:19.217 INFO:tasks.workunit.client.0.smithi088.stdout:5/99: fsync d4/f7 0 2024-09-13T21:40:19.218 INFO:tasks.workunit.client.0.smithi088.stdout:4/85: dwrite d2/d9/f17 [0,4194304] 0 2024-09-13T21:40:19.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/94: rename d1/d8/l11 to d1/d8/d16/l1c 0 2024-09-13T21:40:19.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/95: write d1/d13/f17 [264781,13040] 0 2024-09-13T21:40:19.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/96: write d1/d8/f1b [936329,119464] 0 2024-09-13T21:40:19.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/97: truncate d1/fd 871030 0 2024-09-13T21:40:19.220 INFO:tasks.workunit.client.0.smithi088.stdout:3/75: mkdir d5/d14 0 2024-09-13T21:40:19.221 INFO:tasks.workunit.client.0.smithi088.stdout:5/100: symlink d4/d1c/l1d 0 2024-09-13T21:40:19.222 INFO:tasks.workunit.client.0.smithi088.stdout:5/101: read d4/f6 [200348,27231] 0 2024-09-13T21:40:19.223 INFO:tasks.workunit.client.0.smithi088.stdout:5/102: chown d4/d18/lb 1318764 1 2024-09-13T21:40:19.225 INFO:tasks.workunit.client.0.smithi088.stdout:4/86: mkdir d2/d9/d19 0 2024-09-13T21:40:19.226 INFO:tasks.workunit.client.0.smithi088.stdout:7/118: sync 2024-09-13T21:40:19.226 INFO:tasks.workunit.client.0.smithi088.stdout:1/139: sync 2024-09-13T21:40:19.227 INFO:tasks.workunit.client.0.smithi088.stdout:2/98: link d1/d8/la d1/d8/l1d 0 2024-09-13T21:40:19.229 INFO:tasks.workunit.client.0.smithi088.stdout:5/103: mknod d4/d1c/c1e 0 2024-09-13T21:40:19.231 INFO:tasks.workunit.client.0.smithi088.stdout:4/87: unlink d2/fb 0 2024-09-13T21:40:19.232 INFO:tasks.workunit.client.0.smithi088.stdout:2/99: symlink d1/d8/d16/l1e 0 2024-09-13T21:40:19.235 INFO:tasks.workunit.client.0.smithi088.stdout:5/104: creat d4/f1f x:0 0 0 2024-09-13T21:40:19.237 INFO:tasks.workunit.client.0.smithi088.stdout:2/100: link d1/l2 d1/l1f 0 2024-09-13T21:40:19.238 INFO:tasks.workunit.client.0.smithi088.stdout:5/105: mknod d4/d18/c20 0 2024-09-13T21:40:19.240 INFO:tasks.workunit.client.0.smithi088.stdout:5/106: symlink d4/l21 0 2024-09-13T21:40:19.240 INFO:tasks.workunit.client.0.smithi088.stdout:5/107: dread - d4/f13 zero size 2024-09-13T21:40:19.240 INFO:tasks.workunit.client.0.smithi088.stdout:5/108: write d4/f13 [165131,87874] 0 2024-09-13T21:40:19.240 INFO:tasks.workunit.client.0.smithi088.stdout:5/109: creat d4/f22 x:0 0 0 2024-09-13T21:40:19.241 INFO:tasks.workunit.client.0.smithi088.stdout:1/140: dread f1 [0,4194304] 0 2024-09-13T21:40:19.246 INFO:tasks.workunit.client.0.smithi088.stdout:4/88: dread d2/d5/ff [0,4194304] 0 2024-09-13T21:40:19.247 INFO:tasks.workunit.client.0.smithi088.stdout:4/89: getdents d2/d11 0 2024-09-13T21:40:19.248 INFO:tasks.workunit.client.0.smithi088.stdout:7/119: dwrite d6/da/fb [4194304,4194304] 0 2024-09-13T21:40:19.249 INFO:tasks.workunit.client.0.smithi088.stdout:3/76: dwrite f3 [0,4194304] 0 2024-09-13T21:40:19.249 INFO:tasks.workunit.client.0.smithi088.stdout:3/77: fdatasync f0 0 2024-09-13T21:40:19.250 INFO:tasks.workunit.client.0.smithi088.stdout:2/101: dread d1/d8/f1b [0,4194304] 0 2024-09-13T21:40:19.256 INFO:tasks.workunit.client.0.smithi088.stdout:4/90: read d2/d5/ff [332242,48705] 0 2024-09-13T21:40:19.258 INFO:tasks.workunit.client.0.smithi088.stdout:3/78: symlink d5/d14/l15 0 2024-09-13T21:40:19.263 INFO:tasks.workunit.client.0.smithi088.stdout:2/102: symlink d1/d8/l20 0 2024-09-13T21:40:19.264 INFO:tasks.workunit.client.0.smithi088.stdout:2/103: symlink d1/d8/l21 0 2024-09-13T21:40:19.264 INFO:tasks.workunit.client.0.smithi088.stdout:4/91: symlink d2/l1a 0 2024-09-13T21:40:19.266 INFO:tasks.workunit.client.0.smithi088.stdout:7/120: dread f1 [4194304,4194304] 0 2024-09-13T21:40:19.266 INFO:tasks.workunit.client.0.smithi088.stdout:1/141: dwrite d9/d18/f27 [0,4194304] 0 2024-09-13T21:40:19.266 INFO:tasks.workunit.client.0.smithi088.stdout:7/121: creat d6/da/d1a/f29 x:0 0 0 2024-09-13T21:40:19.266 INFO:tasks.workunit.client.0.smithi088.stdout:1/142: write d9/d18/f2f [430361,40718] 0 2024-09-13T21:40:19.266 INFO:tasks.workunit.client.0.smithi088.stdout:4/92: symlink d2/d13/l1b 0 2024-09-13T21:40:19.269 INFO:tasks.workunit.client.0.smithi088.stdout:1/143: mknod d9/d18/d33/c36 0 2024-09-13T21:40:19.269 INFO:tasks.workunit.client.0.smithi088.stdout:1/144: readlink d9/d18/l1b 0 2024-09-13T21:40:19.271 INFO:tasks.workunit.client.0.smithi088.stdout:3/79: read f3 [1909779,95890] 0 2024-09-13T21:40:19.271 INFO:tasks.workunit.client.0.smithi088.stdout:3/80: stat d5/fe 0 2024-09-13T21:40:19.271 INFO:tasks.workunit.client.0.smithi088.stdout:3/81: fdatasync d5/f13 0 2024-09-13T21:40:19.271 INFO:tasks.workunit.client.0.smithi088.stdout:3/82: dread - d5/fe zero size 2024-09-13T21:40:19.271 INFO:tasks.workunit.client.0.smithi088.stdout:3/83: fdatasync f0 0 2024-09-13T21:40:19.271 INFO:tasks.workunit.client.0.smithi088.stdout:3/84: read f3 [4191564,65951] 0 2024-09-13T21:40:19.271 INFO:tasks.workunit.client.0.smithi088.stdout:3/85: read f3 [3481555,27562] 0 2024-09-13T21:40:19.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/145: rename d9/cb to d9/c37 0 2024-09-13T21:40:19.273 INFO:tasks.workunit.client.0.smithi088.stdout:3/86: rename f3 to d5/f16 0 2024-09-13T21:40:19.273 INFO:tasks.workunit.client.0.smithi088.stdout:3/87: chown d5/f13 230044137 1 2024-09-13T21:40:19.273 INFO:tasks.workunit.client.0.smithi088.stdout:3/88: stat d5/ld 0 2024-09-13T21:40:19.274 INFO:tasks.workunit.client.0.smithi088.stdout:1/146: truncate d9/dc/f35 2351032 0 2024-09-13T21:40:19.275 INFO:tasks.workunit.client.0.smithi088.stdout:6/137: sync 2024-09-13T21:40:19.275 INFO:tasks.workunit.client.0.smithi088.stdout:0/113: sync 2024-09-13T21:40:19.276 INFO:tasks.workunit.client.0.smithi088.stdout:0/114: creat d7/f2b x:0 0 0 2024-09-13T21:40:19.276 INFO:tasks.workunit.client.0.smithi088.stdout:4/93: dread d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:19.276 INFO:tasks.workunit.client.0.smithi088.stdout:8/112: sync 2024-09-13T21:40:19.279 INFO:tasks.workunit.client.0.smithi088.stdout:1/147: creat d9/d10/d2a/f38 x:0 0 0 2024-09-13T21:40:19.279 INFO:tasks.workunit.client.0.smithi088.stdout:1/148: write d9/d10/d2a/f38 [564585,44655] 0 2024-09-13T21:40:19.280 INFO:tasks.workunit.client.0.smithi088.stdout:1/149: write d9/d10/f11 [4874600,57338] 0 2024-09-13T21:40:19.281 INFO:tasks.workunit.client.0.smithi088.stdout:4/94: dread d2/d5/ff [0,4194304] 0 2024-09-13T21:40:19.283 INFO:tasks.workunit.client.0.smithi088.stdout:0/115: mkdir d7/d2c 0 2024-09-13T21:40:19.283 INFO:tasks.workunit.client.0.smithi088.stdout:0/116: fsync d7/d1a/f22 0 2024-09-13T21:40:19.285 INFO:tasks.workunit.client.0.smithi088.stdout:1/150: mkdir d9/d18/d39 0 2024-09-13T21:40:19.286 INFO:tasks.workunit.client.0.smithi088.stdout:4/95: read d2/d11/f16 [3616406,74041] 0 2024-09-13T21:40:19.286 INFO:tasks.workunit.client.0.smithi088.stdout:4/96: chown d2/l4 21751 1 2024-09-13T21:40:19.287 INFO:tasks.workunit.client.0.smithi088.stdout:4/97: write d2/f15 [115930,61932] 0 2024-09-13T21:40:19.287 INFO:tasks.workunit.client.0.smithi088.stdout:4/98: dread - d2/d5/f14 zero size 2024-09-13T21:40:19.287 INFO:tasks.workunit.client.0.smithi088.stdout:4/99: dread - d2/d5/f14 zero size 2024-09-13T21:40:19.289 INFO:tasks.workunit.client.0.smithi088.stdout:0/117: symlink d7/d2c/l2d 0 2024-09-13T21:40:19.290 INFO:tasks.workunit.client.0.smithi088.stdout:0/118: write d7/f2b [383014,11150] 0 2024-09-13T21:40:19.290 INFO:tasks.workunit.client.0.smithi088.stdout:0/119: readlink d7/d1d/l20 0 2024-09-13T21:40:19.291 INFO:tasks.workunit.client.0.smithi088.stdout:1/151: mkdir d9/d18/d3a 0 2024-09-13T21:40:19.291 INFO:tasks.workunit.client.0.smithi088.stdout:1/152: truncate d9/d18/f1d 38819 0 2024-09-13T21:40:19.292 INFO:tasks.workunit.client.0.smithi088.stdout:4/100: symlink d2/d5/l1c 0 2024-09-13T21:40:19.293 INFO:tasks.workunit.client.0.smithi088.stdout:4/101: write f1 [2770630,120630] 0 2024-09-13T21:40:19.295 INFO:tasks.workunit.client.0.smithi088.stdout:0/120: rename d7/da/f13 to d7/d2c/f2e 0 2024-09-13T21:40:19.298 INFO:tasks.workunit.client.0.smithi088.stdout:1/153: symlink d9/l3b 0 2024-09-13T21:40:19.301 INFO:tasks.workunit.client.0.smithi088.stdout:4/102: getdents d2 0 2024-09-13T21:40:19.304 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:19 smithi116 ceph-mon[33391]: pgmap v249: 65 pgs: 65 active+clean; 305 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 21 MiB/s wr, 847 op/s 2024-09-13T21:40:19.312 INFO:tasks.workunit.client.0.smithi088.stdout:2/104: dwrite d1/d8/f14 [0,4194304] 0 2024-09-13T21:40:19.312 INFO:tasks.workunit.client.0.smithi088.stdout:2/105: chown d1/d13/f1a 94274 1 2024-09-13T21:40:19.314 INFO:tasks.workunit.client.0.smithi088.stdout:7/122: dwrite d6/da/f1e [4194304,4194304] 0 2024-09-13T21:40:19.314 INFO:tasks.workunit.client.0.smithi088.stdout:7/123: write d6/f18 [210673,10923] 0 2024-09-13T21:40:19.314 INFO:tasks.workunit.client.0.smithi088.stdout:7/124: chown c0 3 1 2024-09-13T21:40:19.315 INFO:tasks.workunit.client.0.smithi088.stdout:2/106: mkdir d1/d22 0 2024-09-13T21:40:19.316 INFO:tasks.workunit.client.0.smithi088.stdout:3/89: dwrite d5/f16 [0,4194304] 0 2024-09-13T21:40:19.316 INFO:tasks.workunit.client.0.smithi088.stdout:2/107: read d1/fd [401883,27690] 0 2024-09-13T21:40:19.317 INFO:tasks.workunit.client.0.smithi088.stdout:8/113: dwrite db/f23 [0,4194304] 0 2024-09-13T21:40:19.319 INFO:tasks.workunit.client.0.smithi088.stdout:2/108: creat d1/d8/d16/f23 x:0 0 0 2024-09-13T21:40:19.320 INFO:tasks.workunit.client.0.smithi088.stdout:6/138: dwrite d0/f6 [0,4194304] 0 2024-09-13T21:40:19.321 INFO:tasks.workunit.client.0.smithi088.stdout:1/154: dwrite d9/f19 [0,4194304] 0 2024-09-13T21:40:19.325 INFO:tasks.workunit.client.0.smithi088.stdout:2/109: mkdir d1/d8/d24 0 2024-09-13T21:40:19.327 INFO:tasks.workunit.client.0.smithi088.stdout:3/90: rmdir d5/db 0 2024-09-13T21:40:19.327 INFO:tasks.workunit.client.0.smithi088.stdout:8/114: dread f8 [0,4194304] 0 2024-09-13T21:40:19.329 INFO:tasks.workunit.client.0.smithi088.stdout:3/91: dread d5/f6 [0,4194304] 0 2024-09-13T21:40:19.331 INFO:tasks.workunit.client.0.smithi088.stdout:8/115: dread db/f1a [0,4194304] 0 2024-09-13T21:40:19.337 INFO:tasks.workunit.client.0.smithi088.stdout:7/125: dwrite d6/da/d1a/f21 [0,4194304] 0 2024-09-13T21:40:19.337 INFO:tasks.workunit.client.0.smithi088.stdout:1/155: symlink d9/d10/d2a/l3c 0 2024-09-13T21:40:19.337 INFO:tasks.workunit.client.0.smithi088.stdout:3/92: creat d5/f17 x:0 0 0 2024-09-13T21:40:19.338 INFO:tasks.workunit.client.0.smithi088.stdout:8/116: creat db/df/d25/f28 x:0 0 0 2024-09-13T21:40:19.340 INFO:tasks.workunit.client.0.smithi088.stdout:6/139: dwrite d0/f6 [0,4194304] 0 2024-09-13T21:40:19.346 INFO:tasks.workunit.client.0.smithi088.stdout:1/156: rename d9/f16 to d9/d18/d33/f3d 0 2024-09-13T21:40:19.347 INFO:tasks.workunit.client.0.smithi088.stdout:1/157: read d9/d18/f2f [319954,74204] 0 2024-09-13T21:40:19.347 INFO:tasks.workunit.client.0.smithi088.stdout:1/158: write d9/d18/f28 [37646,9842] 0 2024-09-13T21:40:19.347 INFO:tasks.workunit.client.0.smithi088.stdout:3/93: creat d5/d14/f18 x:0 0 0 2024-09-13T21:40:19.350 INFO:tasks.workunit.client.0.smithi088.stdout:7/126: symlink d6/l2a 0 2024-09-13T21:40:19.352 INFO:tasks.workunit.client.0.smithi088.stdout:8/117: rename db/df/d25/l27 to db/l29 0 2024-09-13T21:40:19.352 INFO:tasks.workunit.client.0.smithi088.stdout:6/140: dwrite d0/ff [4194304,4194304] 0 2024-09-13T21:40:19.353 INFO:tasks.workunit.client.0.smithi088.stdout:6/141: readlink d0/l1d 0 2024-09-13T21:40:19.354 INFO:tasks.workunit.client.0.smithi088.stdout:3/94: symlink d5/l19 0 2024-09-13T21:40:19.354 INFO:tasks.workunit.client.0.smithi088.stdout:3/95: truncate d5/f13 176907 0 2024-09-13T21:40:19.354 INFO:tasks.workunit.client.0.smithi088.stdout:7/127: getdents d6/da 0 2024-09-13T21:40:19.357 INFO:tasks.workunit.client.0.smithi088.stdout:1/159: rmdir d9/d10 39 2024-09-13T21:40:19.359 INFO:tasks.workunit.client.0.smithi088.stdout:3/96: rename d5/fc to d5/d14/f1a 0 2024-09-13T21:40:19.359 INFO:tasks.workunit.client.0.smithi088.stdout:3/97: fdatasync f1 0 2024-09-13T21:40:19.360 INFO:tasks.workunit.client.0.smithi088.stdout:6/142: dread d0/ff [4194304,4194304] 0 2024-09-13T21:40:19.360 INFO:tasks.workunit.client.0.smithi088.stdout:6/143: write d0/db/f26 [398115,91656] 0 2024-09-13T21:40:19.360 INFO:tasks.workunit.client.0.smithi088.stdout:6/144: write d0/db/f10 [1894565,20848] 0 2024-09-13T21:40:19.360 INFO:tasks.workunit.client.0.smithi088.stdout:1/160: stat d9/c37 0 2024-09-13T21:40:19.360 INFO:tasks.workunit.client.0.smithi088.stdout:1/161: fsync d9/f14 0 2024-09-13T21:40:19.361 INFO:tasks.workunit.client.0.smithi088.stdout:9/86: sync 2024-09-13T21:40:19.361 INFO:tasks.workunit.client.0.smithi088.stdout:3/98: mknod d5/d14/c1b 0 2024-09-13T21:40:19.362 INFO:tasks.workunit.client.0.smithi088.stdout:7/128: getdents d6/da/d1a 0 2024-09-13T21:40:19.364 INFO:tasks.workunit.client.0.smithi088.stdout:6/145: symlink d0/d1e/l2f 0 2024-09-13T21:40:19.365 INFO:tasks.workunit.client.0.smithi088.stdout:1/162: rmdir d9/d18 39 2024-09-13T21:40:19.366 INFO:tasks.workunit.client.0.smithi088.stdout:9/87: unlink f4 0 2024-09-13T21:40:19.367 INFO:tasks.workunit.client.0.smithi088.stdout:3/99: unlink d5/c7 0 2024-09-13T21:40:19.368 INFO:tasks.workunit.client.0.smithi088.stdout:3/100: write d5/d14/f1a [373304,103097] 0 2024-09-13T21:40:19.368 INFO:tasks.workunit.client.0.smithi088.stdout:3/101: fdatasync f0 0 2024-09-13T21:40:19.368 INFO:tasks.workunit.client.0.smithi088.stdout:8/118: rename db/l29 to db/l2a 0 2024-09-13T21:40:19.369 INFO:tasks.workunit.client.0.smithi088.stdout:7/129: write f1 [71012,30263] 0 2024-09-13T21:40:19.369 INFO:tasks.workunit.client.0.smithi088.stdout:7/130: fdatasync d6/da/f10 0 2024-09-13T21:40:19.369 INFO:tasks.workunit.client.0.smithi088.stdout:6/146: rmdir d0/d28 39 2024-09-13T21:40:19.370 INFO:tasks.workunit.client.0.smithi088.stdout:1/163: symlink d9/d10/d2a/l3e 0 2024-09-13T21:40:19.371 INFO:tasks.workunit.client.0.smithi088.stdout:9/88: creat f17 x:0 0 0 2024-09-13T21:40:19.371 INFO:tasks.workunit.client.0.smithi088.stdout:9/89: dread - f17 zero size 2024-09-13T21:40:19.371 INFO:tasks.workunit.client.0.smithi088.stdout:9/90: truncate f17 537546 0 2024-09-13T21:40:19.371 INFO:tasks.workunit.client.0.smithi088.stdout:9/91: chown f17 736 1 2024-09-13T21:40:19.374 INFO:tasks.workunit.client.0.smithi088.stdout:8/119: link db/f24 db/d26/f2b 0 2024-09-13T21:40:19.374 INFO:tasks.workunit.client.0.smithi088.stdout:8/120: chown db/df/d25/f28 41549 1 2024-09-13T21:40:19.374 INFO:tasks.workunit.client.0.smithi088.stdout:8/121: chown db/c20 147102143 1 2024-09-13T21:40:19.376 INFO:tasks.workunit.client.0.smithi088.stdout:7/131: unlink d6/da/c25 0 2024-09-13T21:40:19.378 INFO:tasks.workunit.client.0.smithi088.stdout:6/147: unlink d0/l7 0 2024-09-13T21:40:19.378 INFO:tasks.workunit.client.0.smithi088.stdout:6/148: truncate d0/db/f12 4276720 0 2024-09-13T21:40:19.380 INFO:tasks.workunit.client.0.smithi088.stdout:1/164: unlink d9/c37 0 2024-09-13T21:40:19.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/92: creat f18 x:0 0 0 2024-09-13T21:40:19.384 INFO:tasks.workunit.client.0.smithi088.stdout:3/102: rmdir d5 39 2024-09-13T21:40:19.384 INFO:tasks.workunit.client.0.smithi088.stdout:3/103: readlink d5/ld 0 2024-09-13T21:40:19.390 INFO:tasks.workunit.client.0.smithi088.stdout:1/165: write d9/d18/d33/f3d [240144,80656] 0 2024-09-13T21:40:19.391 INFO:tasks.workunit.client.0.smithi088.stdout:6/149: mknod d0/d1e/d1f/c30 0 2024-09-13T21:40:19.391 INFO:tasks.workunit.client.0.smithi088.stdout:6/150: readlink d0/d1e/l2f 0 2024-09-13T21:40:19.391 INFO:tasks.workunit.client.0.smithi088.stdout:7/132: dwrite d6/da/f10 [0,4194304] 0 2024-09-13T21:40:19.391 INFO:tasks.workunit.client.0.smithi088.stdout:9/93: truncate fb 424896 0 2024-09-13T21:40:19.392 INFO:tasks.workunit.client.0.smithi088.stdout:3/104: symlink d5/d14/l1c 0 2024-09-13T21:40:19.392 INFO:tasks.workunit.client.0.smithi088.stdout:6/151: rmdir d0/d28 39 2024-09-13T21:40:19.393 INFO:tasks.workunit.client.0.smithi088.stdout:6/152: fdatasync d0/db/f26 0 2024-09-13T21:40:19.393 INFO:tasks.workunit.client.0.smithi088.stdout:1/166: creat d9/d10/f3f x:0 0 0 2024-09-13T21:40:19.394 INFO:tasks.workunit.client.0.smithi088.stdout:1/167: write d9/f31 [263586,75811] 0 2024-09-13T21:40:19.395 INFO:tasks.workunit.client.0.smithi088.stdout:7/133: creat d6/da/d1a/f2b x:0 0 0 2024-09-13T21:40:19.397 INFO:tasks.workunit.client.0.smithi088.stdout:3/105: mknod d5/c1d 0 2024-09-13T21:40:19.398 INFO:tasks.workunit.client.0.smithi088.stdout:3/106: fsync d5/d14/f18 0 2024-09-13T21:40:19.399 INFO:tasks.workunit.client.0.smithi088.stdout:6/153: link d0/c1c d0/d28/c31 0 2024-09-13T21:40:19.400 INFO:tasks.workunit.client.0.smithi088.stdout:1/168: unlink d9/d10/d2a/f38 0 2024-09-13T21:40:19.402 INFO:tasks.workunit.client.0.smithi088.stdout:9/94: symlink l19 0 2024-09-13T21:40:19.402 INFO:tasks.workunit.client.0.smithi088.stdout:5/110: sync 2024-09-13T21:40:19.402 INFO:tasks.workunit.client.0.smithi088.stdout:4/103: sync 2024-09-13T21:40:19.402 INFO:tasks.workunit.client.0.smithi088.stdout:2/110: sync 2024-09-13T21:40:19.402 INFO:tasks.workunit.client.0.smithi088.stdout:5/111: truncate d4/f7 1590460 0 2024-09-13T21:40:19.402 INFO:tasks.workunit.client.0.smithi088.stdout:0/121: sync 2024-09-13T21:40:19.402 INFO:tasks.workunit.client.0.smithi088.stdout:5/112: fsync d4/f1f 0 2024-09-13T21:40:19.402 INFO:tasks.workunit.client.0.smithi088.stdout:4/104: write d2/d5/ff [4564358,33718] 0 2024-09-13T21:40:19.403 INFO:tasks.workunit.client.0.smithi088.stdout:4/105: chown d2/d11 349938 1 2024-09-13T21:40:19.403 INFO:tasks.workunit.client.0.smithi088.stdout:2/111: write d1/d8/d16/f23 [206248,75232] 0 2024-09-13T21:40:19.403 INFO:tasks.workunit.client.0.smithi088.stdout:2/112: dread - d1/d8/f19 zero size 2024-09-13T21:40:19.403 INFO:tasks.workunit.client.0.smithi088.stdout:2/113: fsync d1/d13/f1a 0 2024-09-13T21:40:19.403 INFO:tasks.workunit.client.0.smithi088.stdout:0/122: write d7/d1a/f22 [488076,103371] 0 2024-09-13T21:40:19.406 INFO:tasks.workunit.client.0.smithi088.stdout:6/154: chown d0/le 991882 1 2024-09-13T21:40:19.409 INFO:tasks.workunit.client.0.smithi088.stdout:1/169: unlink d9/dc/f24 0 2024-09-13T21:40:19.409 INFO:tasks.workunit.client.0.smithi088.stdout:1/170: write d9/d10/f3f [755599,2982] 0 2024-09-13T21:40:19.409 INFO:tasks.workunit.client.0.smithi088.stdout:1/171: write d9/d18/f2f [1322293,54590] 0 2024-09-13T21:40:19.411 INFO:tasks.workunit.client.0.smithi088.stdout:5/113: getdents d4/d1c 0 2024-09-13T21:40:19.411 INFO:tasks.workunit.client.0.smithi088.stdout:5/114: read d4/f6 [206362,29582] 0 2024-09-13T21:40:19.411 INFO:tasks.workunit.client.0.smithi088.stdout:5/115: dread - d4/f1f zero size 2024-09-13T21:40:19.411 INFO:tasks.workunit.client.0.smithi088.stdout:2/114: dread d1/d8/d16/f23 [0,4194304] 0 2024-09-13T21:40:19.411 INFO:tasks.workunit.client.0.smithi088.stdout:2/115: write d1/d13/f17 [1325498,76767] 0 2024-09-13T21:40:19.411 INFO:tasks.workunit.client.0.smithi088.stdout:2/116: readlink d1/d8/l21 0 2024-09-13T21:40:19.412 INFO:tasks.workunit.client.0.smithi088.stdout:0/123: rename d7/d1d/l20 to d7/d1a/l2f 0 2024-09-13T21:40:19.413 INFO:tasks.workunit.client.0.smithi088.stdout:9/95: mkdir d1a 0 2024-09-13T21:40:19.416 INFO:tasks.workunit.client.0.smithi088.stdout:4/106: dread d2/d5/ff [0,4194304] 0 2024-09-13T21:40:19.417 INFO:tasks.workunit.client.0.smithi088.stdout:3/107: dwrite d5/f17 [0,4194304] 0 2024-09-13T21:40:19.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/155: read d0/db/f12 [3004557,111723] 0 2024-09-13T21:40:19.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/156: chown d0/d28/c31 27975 1 2024-09-13T21:40:19.417 INFO:tasks.workunit.client.0.smithi088.stdout:5/116: symlink d4/l23 0 2024-09-13T21:40:19.417 INFO:tasks.workunit.client.0.smithi088.stdout:2/117: creat d1/d8/d24/f25 x:0 0 0 2024-09-13T21:40:19.418 INFO:tasks.workunit.client.0.smithi088.stdout:1/172: rename d9/d18/f27 to d9/d18/d39/f40 0 2024-09-13T21:40:19.418 INFO:tasks.workunit.client.0.smithi088.stdout:5/117: write f2 [728144,16477] 0 2024-09-13T21:40:19.419 INFO:tasks.workunit.client.0.smithi088.stdout:0/124: mkdir d7/d2c/d30 0 2024-09-13T21:40:19.421 INFO:tasks.workunit.client.0.smithi088.stdout:9/96: mkdir d1a/d1b 0 2024-09-13T21:40:19.423 INFO:tasks.workunit.client.0.smithi088.stdout:4/107: unlink d2/d9/f17 0 2024-09-13T21:40:19.425 INFO:tasks.workunit.client.0.smithi088.stdout:9/97: dread fb [0,4194304] 0 2024-09-13T21:40:19.426 INFO:tasks.workunit.client.0.smithi088.stdout:9/98: dread f17 [0,4194304] 0 2024-09-13T21:40:19.427 INFO:tasks.workunit.client.0.smithi088.stdout:6/157: dread d0/f6 [0,4194304] 0 2024-09-13T21:40:19.429 INFO:tasks.workunit.client.0.smithi088.stdout:2/118: symlink d1/l26 0 2024-09-13T21:40:19.430 INFO:tasks.workunit.client.0.smithi088.stdout:1/173: mkdir d9/d10/d41 0 2024-09-13T21:40:19.430 INFO:tasks.workunit.client.0.smithi088.stdout:1/174: chown d9/d18/d33/f3d 11748 1 2024-09-13T21:40:19.433 INFO:tasks.workunit.client.0.smithi088.stdout:5/118: unlink d4/d18/f17 0 2024-09-13T21:40:19.433 INFO:tasks.workunit.client.0.smithi088.stdout:5/119: write d4/f1f [62487,39064] 0 2024-09-13T21:40:19.434 INFO:tasks.workunit.client.0.smithi088.stdout:0/125: mkdir d7/d2c/d30/d31 0 2024-09-13T21:40:19.435 INFO:tasks.workunit.client.0.smithi088.stdout:3/108: dwrite f1 [0,4194304] 0 2024-09-13T21:40:19.436 INFO:tasks.workunit.client.0.smithi088.stdout:4/108: symlink d2/d9/l1d 0 2024-09-13T21:40:19.438 INFO:tasks.workunit.client.0.smithi088.stdout:9/99: creat d1a/f1c x:0 0 0 2024-09-13T21:40:19.439 INFO:tasks.workunit.client.0.smithi088.stdout:6/158: stat d0/l8 0 2024-09-13T21:40:19.439 INFO:tasks.workunit.client.0.smithi088.stdout:9/100: write fb [217003,109790] 0 2024-09-13T21:40:19.441 INFO:tasks.workunit.client.0.smithi088.stdout:5/120: mkdir d4/d1c/d24 0 2024-09-13T21:40:19.443 INFO:tasks.workunit.client.0.smithi088.stdout:0/126: rename d7/f24 to d7/d2c/d30/d31/f32 0 2024-09-13T21:40:19.443 INFO:tasks.workunit.client.0.smithi088.stdout:1/175: dread d9/d10/f11 [0,4194304] 0 2024-09-13T21:40:19.443 INFO:tasks.workunit.client.0.smithi088.stdout:1/176: creat d9/dc/f42 x:0 0 0 2024-09-13T21:40:19.444 INFO:tasks.workunit.client.0.smithi088.stdout:2/119: dwrite d1/fb [0,4194304] 0 2024-09-13T21:40:19.448 INFO:tasks.workunit.client.0.smithi088.stdout:5/121: dread d4/f1f [0,4194304] 0 2024-09-13T21:40:19.448 INFO:tasks.workunit.client.0.smithi088.stdout:5/122: chown d4/d1c/c1e 66158 1 2024-09-13T21:40:19.448 INFO:tasks.workunit.client.0.smithi088.stdout:3/109: unlink d5/lf 0 2024-09-13T21:40:19.448 INFO:tasks.workunit.client.0.smithi088.stdout:3/110: write d5/f17 [4475431,37054] 0 2024-09-13T21:40:19.451 INFO:tasks.workunit.client.0.smithi088.stdout:4/109: mkdir d2/d9/de/d1e 0 2024-09-13T21:40:19.451 INFO:tasks.workunit.client.0.smithi088.stdout:4/110: stat d2/l1a 0 2024-09-13T21:40:19.451 INFO:tasks.workunit.client.0.smithi088.stdout:0/127: write f5 [3043140,56011] 0 2024-09-13T21:40:19.451 INFO:tasks.workunit.client.0.smithi088.stdout:0/128: truncate d7/f28 1454923 0 2024-09-13T21:40:19.451 INFO:tasks.workunit.client.0.smithi088.stdout:6/159: mkdir d0/d2c/d32 0 2024-09-13T21:40:19.452 INFO:tasks.workunit.client.0.smithi088.stdout:9/101: symlink d1a/d1b/l1d 0 2024-09-13T21:40:19.456 INFO:tasks.workunit.client.0.smithi088.stdout:1/177: unlink d9/d18/c32 0 2024-09-13T21:40:19.461 INFO:tasks.workunit.client.0.smithi088.stdout:2/120: link d1/l9 d1/d22/l27 0 2024-09-13T21:40:19.462 INFO:tasks.workunit.client.0.smithi088.stdout:2/121: truncate d1/d8/d16/f23 919555 0 2024-09-13T21:40:19.465 INFO:tasks.workunit.client.0.smithi088.stdout:5/123: rename d4/l1a to d4/d1b/l25 0 2024-09-13T21:40:19.467 INFO:tasks.workunit.client.0.smithi088.stdout:3/111: unlink d5/c12 0 2024-09-13T21:40:19.472 INFO:tasks.workunit.client.0.smithi088.stdout:0/129: symlink d7/d1d/d21/l33 0 2024-09-13T21:40:19.475 INFO:tasks.workunit.client.0.smithi088.stdout:4/111: rename d2/l1a to d2/d13/l1f 0 2024-09-13T21:40:19.475 INFO:tasks.workunit.client.0.smithi088.stdout:4/112: read d2/f15 [158225,81570] 0 2024-09-13T21:40:19.478 INFO:tasks.workunit.client.0.smithi088.stdout:5/124: unlink d4/ld 0 2024-09-13T21:40:19.479 INFO:tasks.workunit.client.0.smithi088.stdout:3/112: creat d5/f1e x:0 0 0 2024-09-13T21:40:19.480 INFO:tasks.workunit.client.0.smithi088.stdout:0/130: mkdir d7/d1d/d26/d34 0 2024-09-13T21:40:19.482 INFO:tasks.workunit.client.0.smithi088.stdout:4/113: mkdir d2/d5/d20 0 2024-09-13T21:40:19.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:19 smithi088 ceph-mon[27963]: pgmap v249: 65 pgs: 65 active+clean; 305 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 21 MiB/s wr, 847 op/s 2024-09-13T21:40:19.482 INFO:tasks.workunit.client.0.smithi088.stdout:5/125: mkdir d4/d1c/d24/d26 0 2024-09-13T21:40:19.484 INFO:tasks.workunit.client.0.smithi088.stdout:3/113: symlink d5/l1f 0 2024-09-13T21:40:19.484 INFO:tasks.workunit.client.0.smithi088.stdout:3/114: dread - d5/f1e zero size 2024-09-13T21:40:19.484 INFO:tasks.workunit.client.0.smithi088.stdout:4/114: symlink d2/d9/d19/l21 0 2024-09-13T21:40:19.485 INFO:tasks.workunit.client.0.smithi088.stdout:5/126: mknod d4/d1c/d24/d26/c27 0 2024-09-13T21:40:19.487 INFO:tasks.workunit.client.0.smithi088.stdout:3/115: rmdir d5/d14 39 2024-09-13T21:40:19.487 INFO:tasks.workunit.client.0.smithi088.stdout:5/127: dread d4/f1f [0,4194304] 0 2024-09-13T21:40:19.487 INFO:tasks.workunit.client.0.smithi088.stdout:5/128: chown d4/d18/lb 15784 1 2024-09-13T21:40:19.488 INFO:tasks.workunit.client.0.smithi088.stdout:4/115: symlink d2/d9/l22 0 2024-09-13T21:40:19.490 INFO:tasks.workunit.client.0.smithi088.stdout:3/116: symlink d5/d14/l20 0 2024-09-13T21:40:19.490 INFO:tasks.workunit.client.0.smithi088.stdout:3/117: creat d5/f21 x:0 0 0 2024-09-13T21:40:19.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/118: fdatasync d5/f1e 0 2024-09-13T21:40:19.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/119: chown d5/f16 24315834 1 2024-09-13T21:40:19.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/120: dread - d5/f21 zero size 2024-09-13T21:40:19.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/121: write d5/f21 [448445,50060] 0 2024-09-13T21:40:19.493 INFO:tasks.workunit.client.0.smithi088.stdout:5/129: rename d4/f6 to d4/d1b/f28 0 2024-09-13T21:40:19.493 INFO:tasks.workunit.client.0.smithi088.stdout:5/130: write d4/f1f [845902,125858] 0 2024-09-13T21:40:19.495 INFO:tasks.workunit.client.0.smithi088.stdout:6/160: dwrite d0/f16 [0,4194304] 0 2024-09-13T21:40:19.499 INFO:tasks.workunit.client.0.smithi088.stdout:4/116: dread d2/d5/ff [0,4194304] 0 2024-09-13T21:40:19.499 INFO:tasks.workunit.client.0.smithi088.stdout:1/178: dwrite d9/d10/f11 [0,4194304] 0 2024-09-13T21:40:19.499 INFO:tasks.workunit.client.0.smithi088.stdout:1/179: write d9/d10/f3f [1151452,26401] 0 2024-09-13T21:40:19.500 INFO:tasks.workunit.client.0.smithi088.stdout:4/117: mkdir d2/d9/de/d1e/d23 0 2024-09-13T21:40:19.501 INFO:tasks.workunit.client.0.smithi088.stdout:1/180: mkdir d9/d18/d39/d43 0 2024-09-13T21:40:19.501 INFO:tasks.workunit.client.0.smithi088.stdout:1/181: fsync d9/dc/f42 0 2024-09-13T21:40:19.504 INFO:tasks.workunit.client.0.smithi088.stdout:9/102: dwrite fb [0,4194304] 0 2024-09-13T21:40:19.505 INFO:tasks.workunit.client.0.smithi088.stdout:9/103: chown d1a/d1b/l1d 12421 1 2024-09-13T21:40:19.505 INFO:tasks.workunit.client.0.smithi088.stdout:9/104: dread - d1a/f1c zero size 2024-09-13T21:40:19.505 INFO:tasks.workunit.client.0.smithi088.stdout:2/122: dwrite d1/d8/f19 [0,4194304] 0 2024-09-13T21:40:19.505 INFO:tasks.workunit.client.0.smithi088.stdout:0/131: dwrite d7/da/f1c [0,4194304] 0 2024-09-13T21:40:19.509 INFO:tasks.workunit.client.0.smithi088.stdout:5/131: read d4/fc [4940970,76717] 0 2024-09-13T21:40:19.515 INFO:tasks.workunit.client.0.smithi088.stdout:6/161: dwrite d0/db/f12 [0,4194304] 0 2024-09-13T21:40:19.517 INFO:tasks.workunit.client.0.smithi088.stdout:2/123: mknod d1/d8/d16/c28 0 2024-09-13T21:40:19.517 INFO:tasks.workunit.client.0.smithi088.stdout:2/124: write d1/f15 [367482,38339] 0 2024-09-13T21:40:19.518 INFO:tasks.workunit.client.0.smithi088.stdout:2/125: chown d1/fb 150195839 1 2024-09-13T21:40:19.521 INFO:tasks.workunit.client.0.smithi088.stdout:3/122: getdents d5/d14 0 2024-09-13T21:40:19.521 INFO:tasks.workunit.client.0.smithi088.stdout:3/123: chown d5/l11 1 1 2024-09-13T21:40:19.522 INFO:tasks.workunit.client.0.smithi088.stdout:0/132: dread d7/d2c/d30/d31/f32 [0,4194304] 0 2024-09-13T21:40:19.522 INFO:tasks.workunit.client.0.smithi088.stdout:0/133: truncate d7/d1d/f29 903635 0 2024-09-13T21:40:19.523 INFO:tasks.workunit.client.0.smithi088.stdout:5/132: rmdir d4/d1c/d24 39 2024-09-13T21:40:19.527 INFO:tasks.workunit.client.0.smithi088.stdout:3/124: truncate d5/f17 1522733 0 2024-09-13T21:40:19.528 INFO:tasks.workunit.client.0.smithi088.stdout:3/125: chown d5/l11 7864 1 2024-09-13T21:40:19.528 INFO:tasks.workunit.client.0.smithi088.stdout:3/126: chown d5/d14/c1b 189 1 2024-09-13T21:40:19.528 INFO:tasks.workunit.client.0.smithi088.stdout:1/182: dwrite d9/d18/f21 [0,4194304] 0 2024-09-13T21:40:19.529 INFO:tasks.workunit.client.0.smithi088.stdout:0/134: creat d7/d2c/d30/f35 x:0 0 0 2024-09-13T21:40:19.532 INFO:tasks.workunit.client.0.smithi088.stdout:5/133: symlink d4/d1c/d24/l29 0 2024-09-13T21:40:19.532 INFO:tasks.workunit.client.0.smithi088.stdout:5/134: chown d4/f13 2946 1 2024-09-13T21:40:19.532 INFO:tasks.workunit.client.0.smithi088.stdout:5/135: truncate d4/d18/f11 59698 0 2024-09-13T21:40:19.532 INFO:tasks.workunit.client.0.smithi088.stdout:2/126: write d1/f4 [1109944,107693] 0 2024-09-13T21:40:19.532 INFO:tasks.workunit.client.0.smithi088.stdout:9/105: dwrite f15 [0,4194304] 0 2024-09-13T21:40:19.532 INFO:tasks.workunit.client.0.smithi088.stdout:3/127: truncate d5/f6 431060 0 2024-09-13T21:40:19.533 INFO:tasks.workunit.client.0.smithi088.stdout:3/128: chown d5 20745848 1 2024-09-13T21:40:19.533 INFO:tasks.workunit.client.0.smithi088.stdout:3/129: write d5/d14/f18 [931804,80253] 0 2024-09-13T21:40:19.533 INFO:tasks.workunit.client.0.smithi088.stdout:3/130: readlink d5/d14/l20 0 2024-09-13T21:40:19.534 INFO:tasks.workunit.client.0.smithi088.stdout:1/183: truncate d9/f31 46345 0 2024-09-13T21:40:19.537 INFO:tasks.workunit.client.0.smithi088.stdout:6/162: dwrite d0/db/f26 [0,4194304] 0 2024-09-13T21:40:19.539 INFO:tasks.workunit.client.0.smithi088.stdout:5/136: getdents d4/d1c/d24/d26 0 2024-09-13T21:40:19.540 INFO:tasks.workunit.client.0.smithi088.stdout:2/127: symlink d1/d13/l29 0 2024-09-13T21:40:19.540 INFO:tasks.workunit.client.0.smithi088.stdout:2/128: write d1/d13/f17 [1484276,50328] 0 2024-09-13T21:40:19.541 INFO:tasks.workunit.client.0.smithi088.stdout:9/106: symlink d1a/l1e 0 2024-09-13T21:40:19.542 INFO:tasks.workunit.client.0.smithi088.stdout:3/131: link d5/f21 d5/f22 0 2024-09-13T21:40:19.543 INFO:tasks.workunit.client.0.smithi088.stdout:1/184: symlink d9/d18/l44 0 2024-09-13T21:40:19.543 INFO:tasks.workunit.client.0.smithi088.stdout:8/122: sync 2024-09-13T21:40:19.544 INFO:tasks.workunit.client.0.smithi088.stdout:8/123: dread - db/df/d25/f28 zero size 2024-09-13T21:40:19.544 INFO:tasks.workunit.client.0.smithi088.stdout:8/124: stat db/f14 0 2024-09-13T21:40:19.544 INFO:tasks.workunit.client.0.smithi088.stdout:6/163: dread d0/f16 [0,4194304] 0 2024-09-13T21:40:19.544 INFO:tasks.workunit.client.0.smithi088.stdout:6/164: fsync d0/f16 0 2024-09-13T21:40:19.546 INFO:tasks.workunit.client.0.smithi088.stdout:0/135: dwrite d7/f19 [0,4194304] 0 2024-09-13T21:40:19.547 INFO:tasks.workunit.client.0.smithi088.stdout:0/136: stat d7/d1a 0 2024-09-13T21:40:19.547 INFO:tasks.workunit.client.0.smithi088.stdout:7/134: sync 2024-09-13T21:40:19.547 INFO:tasks.workunit.client.0.smithi088.stdout:5/137: mkdir d4/d1b/d2a 0 2024-09-13T21:40:19.548 INFO:tasks.workunit.client.0.smithi088.stdout:2/129: mkdir d1/d13/d2a 0 2024-09-13T21:40:19.550 INFO:tasks.workunit.client.0.smithi088.stdout:3/132: mkdir d5/d23 0 2024-09-13T21:40:19.550 INFO:tasks.workunit.client.0.smithi088.stdout:3/133: creat d5/f24 x:0 0 0 2024-09-13T21:40:19.551 INFO:tasks.workunit.client.0.smithi088.stdout:1/185: mknod d9/d18/c45 0 2024-09-13T21:40:19.553 INFO:tasks.workunit.client.0.smithi088.stdout:8/125: truncate db/f17 2418607 0 2024-09-13T21:40:19.553 INFO:tasks.workunit.client.0.smithi088.stdout:8/126: chown l7 52765976 1 2024-09-13T21:40:19.559 INFO:tasks.workunit.client.0.smithi088.stdout:7/135: symlink d6/da/l2c 0 2024-09-13T21:40:19.559 INFO:tasks.workunit.client.0.smithi088.stdout:7/136: creat d6/da/d1a/f2d x:0 0 0 2024-09-13T21:40:19.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/138: mknod d4/d1b/c2b 0 2024-09-13T21:40:19.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/139: readlink d4/l19 0 2024-09-13T21:40:19.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/140: truncate d4/d18/f11 1056231 0 2024-09-13T21:40:19.563 INFO:tasks.workunit.client.0.smithi088.stdout:3/134: mknod d5/d23/c25 0 2024-09-13T21:40:19.566 INFO:tasks.workunit.client.0.smithi088.stdout:1/186: symlink d9/dc/l46 0 2024-09-13T21:40:19.566 INFO:tasks.workunit.client.0.smithi088.stdout:1/187: chown d9/d10/d41 56 1 2024-09-13T21:40:19.566 INFO:tasks.workunit.client.0.smithi088.stdout:0/137: dread d7/da/f1c [0,4194304] 0 2024-09-13T21:40:19.566 INFO:tasks.workunit.client.0.smithi088.stdout:9/107: dwrite f14 [0,4194304] 0 2024-09-13T21:40:19.568 INFO:tasks.workunit.client.0.smithi088.stdout:8/127: mkdir db/d26/d2c 0 2024-09-13T21:40:19.568 INFO:tasks.workunit.client.0.smithi088.stdout:8/128: creat db/df/d25/f2d x:0 0 0 2024-09-13T21:40:19.569 INFO:tasks.workunit.client.0.smithi088.stdout:6/165: rename d0/db/f26 to d0/f33 0 2024-09-13T21:40:19.572 INFO:tasks.workunit.client.0.smithi088.stdout:3/135: mkdir d5/d26 0 2024-09-13T21:40:19.574 INFO:tasks.workunit.client.0.smithi088.stdout:7/137: write d6/da/d1a/f21 [3421488,115127] 0 2024-09-13T21:40:19.579 INFO:tasks.workunit.client.0.smithi088.stdout:6/166: link d0/l19 d0/d2c/d32/l34 0 2024-09-13T21:40:19.581 INFO:tasks.workunit.client.0.smithi088.stdout:9/108: dread fb [0,4194304] 0 2024-09-13T21:40:19.581 INFO:tasks.workunit.client.0.smithi088.stdout:3/136: rename d5/f1e to d5/d26/f27 0 2024-09-13T21:40:19.584 INFO:tasks.workunit.client.0.smithi088.stdout:6/167: creat d0/d28/f35 x:0 0 0 2024-09-13T21:40:19.584 INFO:tasks.workunit.client.0.smithi088.stdout:6/168: dread - d0/db/f29 zero size 2024-09-13T21:40:19.588 INFO:tasks.workunit.client.0.smithi088.stdout:9/109: mknod d1a/d1b/c1f 0 2024-09-13T21:40:19.588 INFO:tasks.workunit.client.0.smithi088.stdout:9/110: creat d1a/f20 x:0 0 0 2024-09-13T21:40:19.589 INFO:tasks.workunit.client.0.smithi088.stdout:9/111: creat d1a/f21 x:0 0 0 2024-09-13T21:40:19.590 INFO:tasks.workunit.client.0.smithi088.stdout:3/137: rename d5/d14/c1b to d5/d14/c28 0 2024-09-13T21:40:19.590 INFO:tasks.workunit.client.0.smithi088.stdout:3/138: write d5/d14/f1a [498236,128535] 0 2024-09-13T21:40:19.594 INFO:tasks.workunit.client.0.smithi088.stdout:9/112: creat d1a/d1b/f22 x:0 0 0 2024-09-13T21:40:19.594 INFO:tasks.workunit.client.0.smithi088.stdout:9/113: dread - d1a/d1b/f22 zero size 2024-09-13T21:40:19.596 INFO:tasks.workunit.client.0.smithi088.stdout:3/139: rename d5/fe to d5/d14/f29 0 2024-09-13T21:40:19.596 INFO:tasks.workunit.client.0.smithi088.stdout:3/140: write d5/f13 [899036,71908] 0 2024-09-13T21:40:19.596 INFO:tasks.workunit.client.0.smithi088.stdout:3/141: write d5/d14/f1a [1274347,51585] 0 2024-09-13T21:40:19.598 INFO:tasks.workunit.client.0.smithi088.stdout:3/142: mkdir d5/d23/d2a 0 2024-09-13T21:40:19.599 INFO:tasks.workunit.client.0.smithi088.stdout:2/130: dwrite d1/f10 [0,4194304] 0 2024-09-13T21:40:19.602 INFO:tasks.workunit.client.0.smithi088.stdout:2/131: creat d1/d13/d2a/f2b x:0 0 0 2024-09-13T21:40:19.602 INFO:tasks.workunit.client.0.smithi088.stdout:2/132: creat d1/d13/f2c x:0 0 0 2024-09-13T21:40:19.602 INFO:tasks.workunit.client.0.smithi088.stdout:2/133: fsync d1/fd 0 2024-09-13T21:40:19.603 INFO:tasks.workunit.client.0.smithi088.stdout:5/141: dwrite d4/f1f [0,4194304] 0 2024-09-13T21:40:19.603 INFO:tasks.workunit.client.0.smithi088.stdout:5/142: stat d4/c16 0 2024-09-13T21:40:19.603 INFO:tasks.workunit.client.0.smithi088.stdout:1/188: dwrite d9/d18/f28 [0,4194304] 0 2024-09-13T21:40:19.603 INFO:tasks.workunit.client.0.smithi088.stdout:1/189: dread - d9/dc/f42 zero size 2024-09-13T21:40:19.604 INFO:tasks.workunit.client.0.smithi088.stdout:8/129: dwrite db/df/d25/f2d [0,4194304] 0 2024-09-13T21:40:19.604 INFO:tasks.workunit.client.0.smithi088.stdout:8/130: fdatasync db/f24 0 2024-09-13T21:40:19.605 INFO:tasks.workunit.client.0.smithi088.stdout:3/143: fdatasync d5/d14/f18 0 2024-09-13T21:40:19.605 INFO:tasks.workunit.client.0.smithi088.stdout:7/138: dwrite d6/da/f10 [4194304,4194304] 0 2024-09-13T21:40:19.610 INFO:tasks.workunit.client.0.smithi088.stdout:5/143: mknod d4/d1c/c2c 0 2024-09-13T21:40:19.613 INFO:tasks.workunit.client.0.smithi088.stdout:9/114: dwrite f18 [0,4194304] 0 2024-09-13T21:40:19.613 INFO:tasks.workunit.client.0.smithi088.stdout:3/144: dread d5/f21 [0,4194304] 0 2024-09-13T21:40:19.613 INFO:tasks.workunit.client.0.smithi088.stdout:3/145: readlink d5/l8 0 2024-09-13T21:40:19.613 INFO:tasks.workunit.client.0.smithi088.stdout:9/115: write f13 [615974,14944] 0 2024-09-13T21:40:19.613 INFO:tasks.workunit.client.0.smithi088.stdout:3/146: write d5/d26/f27 [751060,117259] 0 2024-09-13T21:40:19.614 INFO:tasks.workunit.client.0.smithi088.stdout:3/147: fdatasync d5/f6 0 2024-09-13T21:40:19.617 INFO:tasks.workunit.client.0.smithi088.stdout:1/190: mkdir d9/d10/d2a/d47 0 2024-09-13T21:40:19.625 INFO:tasks.workunit.client.0.smithi088.stdout:8/131: dwrite db/f1a [0,4194304] 0 2024-09-13T21:40:19.629 INFO:tasks.workunit.client.0.smithi088.stdout:5/144: creat d4/d1b/d2a/f2d x:0 0 0 2024-09-13T21:40:19.629 INFO:tasks.workunit.client.0.smithi088.stdout:5/145: write d4/d1b/d2a/f2d [938051,43642] 0 2024-09-13T21:40:19.630 INFO:tasks.workunit.client.0.smithi088.stdout:5/146: write d4/d18/f15 [835738,87045] 0 2024-09-13T21:40:19.630 INFO:tasks.workunit.client.0.smithi088.stdout:3/148: dwrite d5/d14/f29 [0,4194304] 0 2024-09-13T21:40:19.630 INFO:tasks.workunit.client.0.smithi088.stdout:2/134: dwrite d1/d8/f12 [0,4194304] 0 2024-09-13T21:40:19.638 INFO:tasks.workunit.client.0.smithi088.stdout:1/191: symlink d9/d18/l48 0 2024-09-13T21:40:19.640 INFO:tasks.workunit.client.0.smithi088.stdout:7/139: rmdir d6/da/d1a 39 2024-09-13T21:40:19.646 INFO:tasks.workunit.client.0.smithi088.stdout:3/149: mknod d5/c2b 0 2024-09-13T21:40:19.649 INFO:tasks.workunit.client.0.smithi088.stdout:9/116: rmdir d1a 39 2024-09-13T21:40:19.650 INFO:tasks.workunit.client.0.smithi088.stdout:9/117: write f17 [968351,119335] 0 2024-09-13T21:40:19.650 INFO:tasks.workunit.client.0.smithi088.stdout:8/132: dwrite db/df/f18 [0,4194304] 0 2024-09-13T21:40:19.651 INFO:tasks.workunit.client.0.smithi088.stdout:8/133: creat db/df/d25/f2e x:0 0 0 2024-09-13T21:40:19.651 INFO:tasks.workunit.client.0.smithi088.stdout:1/192: mknod d9/d18/c49 0 2024-09-13T21:40:19.653 INFO:tasks.workunit.client.0.smithi088.stdout:7/140: rename d6/c9 to d6/da/d1a/c2e 0 2024-09-13T21:40:19.656 INFO:tasks.workunit.client.0.smithi088.stdout:3/150: getdents d5/d23 0 2024-09-13T21:40:19.656 INFO:tasks.workunit.client.0.smithi088.stdout:3/151: readlink d5/l8 0 2024-09-13T21:40:19.658 INFO:tasks.workunit.client.0.smithi088.stdout:9/118: creat d1a/f23 x:0 0 0 2024-09-13T21:40:19.659 INFO:tasks.workunit.client.0.smithi088.stdout:9/119: creat d1a/f24 x:0 0 0 2024-09-13T21:40:19.661 INFO:tasks.workunit.client.0.smithi088.stdout:8/134: mknod db/d26/c2f 0 2024-09-13T21:40:19.662 INFO:tasks.workunit.client.0.smithi088.stdout:1/193: truncate d9/f14 3738420 0 2024-09-13T21:40:19.662 INFO:tasks.workunit.client.0.smithi088.stdout:1/194: write d9/d10/f17 [52741,74097] 0 2024-09-13T21:40:19.665 INFO:tasks.workunit.client.0.smithi088.stdout:5/147: dwrite d4/ff [0,4194304] 0 2024-09-13T21:40:19.665 INFO:tasks.workunit.client.0.smithi088.stdout:5/148: read d4/fc [4428715,77651] 0 2024-09-13T21:40:19.665 INFO:tasks.workunit.client.0.smithi088.stdout:9/120: creat d1a/d1b/f25 x:0 0 0 2024-09-13T21:40:19.667 INFO:tasks.workunit.client.0.smithi088.stdout:8/135: symlink db/df/d25/l30 0 2024-09-13T21:40:19.667 INFO:tasks.workunit.client.0.smithi088.stdout:8/136: write f8 [3727440,111284] 0 2024-09-13T21:40:19.668 INFO:tasks.workunit.client.0.smithi088.stdout:7/141: dread d6/da/fb [4194304,4194304] 0 2024-09-13T21:40:19.669 INFO:tasks.workunit.client.0.smithi088.stdout:1/195: link d9/d18/c49 d9/dc/c4a 0 2024-09-13T21:40:19.670 INFO:tasks.workunit.client.0.smithi088.stdout:3/152: dread f1 [0,4194304] 0 2024-09-13T21:40:19.671 INFO:tasks.workunit.client.0.smithi088.stdout:9/121: symlink d1a/d1b/l26 0 2024-09-13T21:40:19.672 INFO:tasks.workunit.client.0.smithi088.stdout:5/149: write d4/ff [674757,67668] 0 2024-09-13T21:40:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:3/153: getdents d5 0 2024-09-13T21:40:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:3/154: chown d5/c1d 1 1 2024-09-13T21:40:19.678 INFO:tasks.workunit.client.0.smithi088.stdout:1/196: dread d9/dc/f35 [0,4194304] 0 2024-09-13T21:40:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:3/155: creat d5/d14/f2c x:0 0 0 2024-09-13T21:40:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:9/122: write f17 [440104,124108] 0 2024-09-13T21:40:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:9/123: read - d1a/d1b/f25 zero size 2024-09-13T21:40:19.679 INFO:tasks.workunit.client.0.smithi088.stdout:9/124: stat d1a/d1b/l1d 0 2024-09-13T21:40:19.683 INFO:tasks.workunit.client.0.smithi088.stdout:3/156: truncate d5/f16 2295702 0 2024-09-13T21:40:19.696 INFO:tasks.workunit.client.0.smithi088.stdout:1/197: rename d9/d18 to d9/d10/d2a/d4b 0 2024-09-13T21:40:19.697 INFO:tasks.workunit.client.0.smithi088.stdout:8/137: dwrite f8 [4194304,4194304] 0 2024-09-13T21:40:19.697 INFO:tasks.workunit.client.0.smithi088.stdout:5/150: dwrite f2 [0,4194304] 0 2024-09-13T21:40:19.700 INFO:tasks.workunit.client.0.smithi088.stdout:5/151: mknod d4/d1c/d24/c2e 0 2024-09-13T21:40:19.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/138: dread db/f14 [0,4194304] 0 2024-09-13T21:40:19.701 INFO:tasks.workunit.client.0.smithi088.stdout:5/152: mknod d4/d1c/c2f 0 2024-09-13T21:40:19.701 INFO:tasks.workunit.client.0.smithi088.stdout:5/153: chown d4/d1b/l25 14476 1 2024-09-13T21:40:19.703 INFO:tasks.workunit.client.0.smithi088.stdout:8/139: link l5 db/d26/d2c/l31 0 2024-09-13T21:40:19.723 INFO:tasks.workunit.client.0.smithi088.stdout:3/157: dwrite f1 [0,4194304] 0 2024-09-13T21:40:19.724 INFO:tasks.workunit.client.0.smithi088.stdout:9/125: dwrite f9 [0,4194304] 0 2024-09-13T21:40:19.725 INFO:tasks.workunit.client.0.smithi088.stdout:3/158: mkdir d5/d26/d2d 0 2024-09-13T21:40:19.728 INFO:tasks.workunit.client.0.smithi088.stdout:3/159: creat d5/d26/d2d/f2e x:0 0 0 2024-09-13T21:40:19.728 INFO:tasks.workunit.client.0.smithi088.stdout:3/160: stat d5/d14/l20 0 2024-09-13T21:40:19.728 INFO:tasks.workunit.client.0.smithi088.stdout:3/161: write d5/d14/f2c [615872,102274] 0 2024-09-13T21:40:19.729 INFO:tasks.workunit.client.0.smithi088.stdout:9/126: rmdir d1a/d1b 39 2024-09-13T21:40:19.729 INFO:tasks.workunit.client.0.smithi088.stdout:9/127: chown d1a/d1b 127 1 2024-09-13T21:40:19.729 INFO:tasks.workunit.client.0.smithi088.stdout:9/128: write d1a/d1b/f22 [116156,38787] 0 2024-09-13T21:40:19.730 INFO:tasks.workunit.client.0.smithi088.stdout:3/162: creat d5/d26/f2f x:0 0 0 2024-09-13T21:40:19.730 INFO:tasks.workunit.client.0.smithi088.stdout:9/129: stat l12 0 2024-09-13T21:40:19.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/198: dwrite f1 [0,4194304] 0 2024-09-13T21:40:19.731 INFO:tasks.workunit.client.0.smithi088.stdout:5/154: dwrite d4/d1b/d2a/f2d [0,4194304] 0 2024-09-13T21:40:19.732 INFO:tasks.workunit.client.0.smithi088.stdout:8/140: dwrite db/df/f1f [0,4194304] 0 2024-09-13T21:40:19.732 INFO:tasks.workunit.client.0.smithi088.stdout:3/163: unlink d5/d23/c25 0 2024-09-13T21:40:19.733 INFO:tasks.workunit.client.0.smithi088.stdout:1/199: symlink d9/d10/d2a/d4b/d3a/l4c 0 2024-09-13T21:40:19.738 INFO:tasks.workunit.client.0.smithi088.stdout:9/130: dread f17 [0,4194304] 0 2024-09-13T21:40:19.738 INFO:tasks.workunit.client.0.smithi088.stdout:9/131: read - d1a/f20 zero size 2024-09-13T21:40:19.738 INFO:tasks.workunit.client.0.smithi088.stdout:9/132: write d1a/f20 [400580,6052] 0 2024-09-13T21:40:19.738 INFO:tasks.workunit.client.0.smithi088.stdout:9/133: write d1a/f23 [908708,98169] 0 2024-09-13T21:40:19.739 INFO:tasks.workunit.client.0.smithi088.stdout:9/134: creat d1a/f27 x:0 0 0 2024-09-13T21:40:19.739 INFO:tasks.workunit.client.0.smithi088.stdout:9/135: fsync f10 0 2024-09-13T21:40:19.742 INFO:tasks.workunit.client.0.smithi088.stdout:3/164: mknod d5/d26/c30 0 2024-09-13T21:40:19.745 INFO:tasks.workunit.client.0.smithi088.stdout:9/136: creat d1a/d1b/f28 x:0 0 0 2024-09-13T21:40:19.745 INFO:tasks.workunit.client.0.smithi088.stdout:9/137: chown l16 0 1 2024-09-13T21:40:19.746 INFO:tasks.workunit.client.0.smithi088.stdout:8/141: getdents db 0 2024-09-13T21:40:19.748 INFO:tasks.workunit.client.0.smithi088.stdout:3/165: mkdir d5/d26/d2d/d31 0 2024-09-13T21:40:19.749 INFO:tasks.workunit.client.0.smithi088.stdout:0/138: sync 2024-09-13T21:40:19.749 INFO:tasks.workunit.client.0.smithi088.stdout:4/118: sync 2024-09-13T21:40:19.749 INFO:tasks.workunit.client.0.smithi088.stdout:4/119: stat d2 0 2024-09-13T21:40:19.749 INFO:tasks.workunit.client.0.smithi088.stdout:4/120: creat d2/d5/f24 x:0 0 0 2024-09-13T21:40:19.750 INFO:tasks.workunit.client.0.smithi088.stdout:3/166: mknod d5/d14/c32 0 2024-09-13T21:40:19.750 INFO:tasks.workunit.client.0.smithi088.stdout:3/167: readlink d5/l9 0 2024-09-13T21:40:19.750 INFO:tasks.workunit.client.0.smithi088.stdout:8/142: dread fa [0,4194304] 0 2024-09-13T21:40:19.751 INFO:tasks.workunit.client.0.smithi088.stdout:3/168: write d5/f13 [459788,59198] 0 2024-09-13T21:40:19.751 INFO:tasks.workunit.client.0.smithi088.stdout:3/169: creat d5/d26/f33 x:0 0 0 2024-09-13T21:40:19.752 INFO:tasks.workunit.client.0.smithi088.stdout:0/139: rename l1 to d7/l36 0 2024-09-13T21:40:19.752 INFO:tasks.workunit.client.0.smithi088.stdout:0/140: fdatasync d7/da/f17 0 2024-09-13T21:40:19.754 INFO:tasks.workunit.client.0.smithi088.stdout:4/121: symlink d2/d9/d19/l25 0 2024-09-13T21:40:19.754 INFO:tasks.workunit.client.0.smithi088.stdout:4/122: getdents d2/d11 0 2024-09-13T21:40:19.757 INFO:tasks.workunit.client.0.smithi088.stdout:5/155: dwrite d4/d18/f11 [0,4194304] 0 2024-09-13T21:40:19.757 INFO:tasks.workunit.client.0.smithi088.stdout:1/200: dwrite d9/f31 [0,4194304] 0 2024-09-13T21:40:19.757 INFO:tasks.workunit.client.0.smithi088.stdout:3/170: creat d5/f34 x:0 0 0 2024-09-13T21:40:19.758 INFO:tasks.workunit.client.0.smithi088.stdout:0/141: mkdir d7/d2c/d37 0 2024-09-13T21:40:19.759 INFO:tasks.workunit.client.0.smithi088.stdout:9/138: dread d1a/f20 [0,4194304] 0 2024-09-13T21:40:19.760 INFO:tasks.workunit.client.0.smithi088.stdout:4/123: link d2/d5/ff d2/d9/de/d1e/f26 0 2024-09-13T21:40:19.762 INFO:tasks.workunit.client.0.smithi088.stdout:8/143: rmdir db/df 39 2024-09-13T21:40:19.762 INFO:tasks.workunit.client.0.smithi088.stdout:8/144: write db/df/d25/f28 [369505,21746] 0 2024-09-13T21:40:19.762 INFO:tasks.workunit.client.0.smithi088.stdout:8/145: getdents db 0 2024-09-13T21:40:19.762 INFO:tasks.workunit.client.0.smithi088.stdout:8/146: fsync db/f1a 0 2024-09-13T21:40:19.764 INFO:tasks.workunit.client.0.smithi088.stdout:0/142: dread d7/da/f1c [0,4194304] 0 2024-09-13T21:40:19.767 INFO:tasks.workunit.client.0.smithi088.stdout:5/156: dread f2 [0,4194304] 0 2024-09-13T21:40:19.767 INFO:tasks.workunit.client.0.smithi088.stdout:5/157: write d4/d18/f15 [1039561,126927] 0 2024-09-13T21:40:19.767 INFO:tasks.workunit.client.0.smithi088.stdout:5/158: truncate d4/d1b/f28 1318679 0 2024-09-13T21:40:19.771 INFO:tasks.workunit.client.0.smithi088.stdout:1/201: creat d9/d10/d2a/d4b/d39/d43/f4d x:0 0 0 2024-09-13T21:40:19.772 INFO:tasks.workunit.client.0.smithi088.stdout:3/171: mknod d5/d23/d2a/c35 0 2024-09-13T21:40:19.773 INFO:tasks.workunit.client.0.smithi088.stdout:9/139: symlink d1a/l29 0 2024-09-13T21:40:19.774 INFO:tasks.workunit.client.0.smithi088.stdout:4/124: mknod d2/d9/d19/c27 0 2024-09-13T21:40:19.774 INFO:tasks.workunit.client.0.smithi088.stdout:4/125: write d2/f15 [503983,46604] 0 2024-09-13T21:40:19.776 INFO:tasks.workunit.client.0.smithi088.stdout:8/147: creat db/d26/d2c/f32 x:0 0 0 2024-09-13T21:40:19.776 INFO:tasks.workunit.client.0.smithi088.stdout:8/148: write db/d26/d2c/f32 [329335,10945] 0 2024-09-13T21:40:19.776 INFO:tasks.workunit.client.0.smithi088.stdout:8/149: write db/f17 [2424443,31095] 0 2024-09-13T21:40:19.777 INFO:tasks.workunit.client.0.smithi088.stdout:0/143: creat d7/d1d/d26/d34/f38 x:0 0 0 2024-09-13T21:40:19.777 INFO:tasks.workunit.client.0.smithi088.stdout:0/144: chown l2 1045618 1 2024-09-13T21:40:19.778 INFO:tasks.workunit.client.0.smithi088.stdout:0/145: chown d7/f2b 107346 1 2024-09-13T21:40:19.778 INFO:tasks.workunit.client.0.smithi088.stdout:1/202: write d9/dc/f35 [2076928,84872] 0 2024-09-13T21:40:19.778 INFO:tasks.workunit.client.0.smithi088.stdout:0/146: read d7/d1d/f29 [537699,115957] 0 2024-09-13T21:40:19.779 INFO:tasks.workunit.client.0.smithi088.stdout:5/159: creat d4/d18/f30 x:0 0 0 2024-09-13T21:40:19.779 INFO:tasks.workunit.client.0.smithi088.stdout:5/160: creat d4/f31 x:0 0 0 2024-09-13T21:40:19.781 INFO:tasks.workunit.client.0.smithi088.stdout:9/140: mknod d1a/d1b/c2a 0 2024-09-13T21:40:19.781 INFO:tasks.workunit.client.0.smithi088.stdout:9/141: chown d1a/d1b/l26 0 1 2024-09-13T21:40:19.782 INFO:tasks.workunit.client.0.smithi088.stdout:6/169: sync 2024-09-13T21:40:19.782 INFO:tasks.workunit.client.0.smithi088.stdout:2/135: sync 2024-09-13T21:40:19.782 INFO:tasks.workunit.client.0.smithi088.stdout:6/170: write d0/db/f29 [952509,76861] 0 2024-09-13T21:40:19.782 INFO:tasks.workunit.client.0.smithi088.stdout:6/171: fsync d0/db/f2e 0 2024-09-13T21:40:19.782 INFO:tasks.workunit.client.0.smithi088.stdout:6/172: chown d0/db/c1b 122654335 1 2024-09-13T21:40:19.783 INFO:tasks.workunit.client.0.smithi088.stdout:4/126: link d2/d9/de/d1e/f26 d2/d9/de/f28 0 2024-09-13T21:40:19.783 INFO:tasks.workunit.client.0.smithi088.stdout:4/127: fdatasync d2/d11/f16 0 2024-09-13T21:40:19.785 INFO:tasks.workunit.client.0.smithi088.stdout:8/150: mkdir db/d33 0 2024-09-13T21:40:19.787 INFO:tasks.workunit.client.0.smithi088.stdout:0/147: link d7/f19 d7/d1d/d27/f39 0 2024-09-13T21:40:19.788 INFO:tasks.workunit.client.0.smithi088.stdout:6/173: truncate d0/d1e/f24 202818 0 2024-09-13T21:40:19.790 INFO:tasks.workunit.client.0.smithi088.stdout:4/128: link d2/d9/d19/c27 d2/d9/de/c29 0 2024-09-13T21:40:19.792 INFO:tasks.workunit.client.0.smithi088.stdout:8/151: rename l9 to db/df/d25/l34 0 2024-09-13T21:40:19.792 INFO:tasks.workunit.client.0.smithi088.stdout:8/152: truncate db/df/d25/f2e 23511 0 2024-09-13T21:40:19.794 INFO:tasks.workunit.client.0.smithi088.stdout:6/174: symlink d0/d2c/l36 0 2024-09-13T21:40:19.795 INFO:tasks.workunit.client.0.smithi088.stdout:4/129: rename d2/d9/de/d12/f18 to d2/d9/f2a 0 2024-09-13T21:40:19.795 INFO:tasks.workunit.client.0.smithi088.stdout:4/130: readlink d2/l4 0 2024-09-13T21:40:19.796 INFO:tasks.workunit.client.0.smithi088.stdout:8/153: creat db/d26/f35 x:0 0 0 2024-09-13T21:40:19.796 INFO:tasks.workunit.client.0.smithi088.stdout:6/175: mkdir d0/db/d37 0 2024-09-13T21:40:19.797 INFO:tasks.workunit.client.0.smithi088.stdout:4/131: mknod d2/d9/de/d12/c2b 0 2024-09-13T21:40:19.798 INFO:tasks.workunit.client.0.smithi088.stdout:6/176: rmdir d0/d2c/d32 39 2024-09-13T21:40:19.799 INFO:tasks.workunit.client.0.smithi088.stdout:4/132: rename d2/d13/l1b to d2/d5/l2c 0 2024-09-13T21:40:19.800 INFO:tasks.workunit.client.0.smithi088.stdout:4/133: mkdir d2/d5/d2d 0 2024-09-13T21:40:19.801 INFO:tasks.workunit.client.0.smithi088.stdout:6/177: rename d0/d1e/d1f/c30 to d0/c38 0 2024-09-13T21:40:19.802 INFO:tasks.workunit.client.0.smithi088.stdout:4/134: symlink d2/d5/d20/l2e 0 2024-09-13T21:40:19.808 INFO:tasks.workunit.client.0.smithi088.stdout:3/172: dwrite d5/f16 [0,4194304] 0 2024-09-13T21:40:19.808 INFO:tasks.workunit.client.0.smithi088.stdout:4/135: dread d2/d9/de/f28 [4194304,4194304] 0 2024-09-13T21:40:19.808 INFO:tasks.workunit.client.0.smithi088.stdout:4/136: chown d2/d11/f16 20 1 2024-09-13T21:40:19.809 INFO:tasks.workunit.client.0.smithi088.stdout:1/203: dwrite d9/d10/d2a/d4b/d39/d43/f4d [0,4194304] 0 2024-09-13T21:40:19.809 INFO:tasks.workunit.client.0.smithi088.stdout:2/136: dwrite d1/d8/f12 [0,4194304] 0 2024-09-13T21:40:19.810 INFO:tasks.workunit.client.0.smithi088.stdout:8/154: dread db/f24 [0,4194304] 0 2024-09-13T21:40:19.810 INFO:tasks.workunit.client.0.smithi088.stdout:8/155: creat db/d26/f36 x:0 0 0 2024-09-13T21:40:19.814 INFO:tasks.workunit.client.0.smithi088.stdout:1/204: write d9/d10/f11 [4262395,117442] 0 2024-09-13T21:40:19.816 INFO:tasks.workunit.client.0.smithi088.stdout:9/142: dread d1a/f23 [0,4194304] 0 2024-09-13T21:40:19.817 INFO:tasks.workunit.client.0.smithi088.stdout:0/148: rmdir d7/d1d/d26/d34 39 2024-09-13T21:40:19.818 INFO:tasks.workunit.client.0.smithi088.stdout:8/156: write db/d26/f2b [2152208,87596] 0 2024-09-13T21:40:19.818 INFO:tasks.workunit.client.0.smithi088.stdout:9/143: dread d1a/d1b/f22 [0,4194304] 0 2024-09-13T21:40:19.819 INFO:tasks.workunit.client.0.smithi088.stdout:9/144: write d1a/d1b/f22 [106104,32902] 0 2024-09-13T21:40:19.819 INFO:tasks.workunit.client.0.smithi088.stdout:9/145: fdatasync d1a/f1c 0 2024-09-13T21:40:19.825 INFO:tasks.workunit.client.0.smithi088.stdout:3/173: symlink d5/d26/d2d/d31/l36 0 2024-09-13T21:40:19.825 INFO:tasks.workunit.client.0.smithi088.stdout:3/174: readlink d5/d14/l1c 0 2024-09-13T21:40:19.825 INFO:tasks.workunit.client.0.smithi088.stdout:3/175: chown d5/d26/d2d/d31/l36 209 1 2024-09-13T21:40:19.825 INFO:tasks.workunit.client.0.smithi088.stdout:3/176: creat d5/d14/f37 x:0 0 0 2024-09-13T21:40:19.825 INFO:tasks.workunit.client.0.smithi088.stdout:3/177: dread - d5/d26/d2d/f2e zero size 2024-09-13T21:40:19.825 INFO:tasks.workunit.client.0.smithi088.stdout:2/137: creat d1/d22/f2d x:0 0 0 2024-09-13T21:40:19.829 INFO:tasks.workunit.client.0.smithi088.stdout:1/205: symlink d9/d10/d2a/d4b/d3a/l4e 0 2024-09-13T21:40:19.829 INFO:tasks.workunit.client.0.smithi088.stdout:1/206: truncate d9/d10/d2a/d4b/f21 4262443 0 2024-09-13T21:40:19.831 INFO:tasks.workunit.client.0.smithi088.stdout:5/161: dwrite d4/d18/f15 [0,4194304] 0 2024-09-13T21:40:19.831 INFO:tasks.workunit.client.0.smithi088.stdout:5/162: chown d4/d1c/d24/c2e 40046 1 2024-09-13T21:40:19.831 INFO:tasks.workunit.client.0.smithi088.stdout:0/149: symlink d7/d1a/l3a 0 2024-09-13T21:40:19.832 INFO:tasks.workunit.client.0.smithi088.stdout:0/150: dread d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:19.833 INFO:tasks.workunit.client.0.smithi088.stdout:0/151: read d7/da/f17 [201952,127091] 0 2024-09-13T21:40:19.833 INFO:tasks.workunit.client.0.smithi088.stdout:0/152: stat d7/c14 0 2024-09-13T21:40:19.833 INFO:tasks.workunit.client.0.smithi088.stdout:0/153: write d7/f23 [543245,62614] 0 2024-09-13T21:40:19.834 INFO:tasks.workunit.client.0.smithi088.stdout:8/157: truncate db/f23 179970 0 2024-09-13T21:40:19.838 INFO:tasks.workunit.client.0.smithi088.stdout:3/178: unlink d5/d14/c32 0 2024-09-13T21:40:19.838 INFO:tasks.workunit.client.0.smithi088.stdout:3/179: creat d5/f38 x:0 0 0 2024-09-13T21:40:19.841 INFO:tasks.workunit.client.0.smithi088.stdout:9/146: dwrite fb [0,4194304] 0 2024-09-13T21:40:19.842 INFO:tasks.workunit.client.0.smithi088.stdout:0/154: mknod d7/d1d/d26/d34/c3b 0 2024-09-13T21:40:19.845 INFO:tasks.workunit.client.0.smithi088.stdout:8/158: mkdir db/d26/d37 0 2024-09-13T21:40:19.851 INFO:tasks.workunit.client.0.smithi088.stdout:0/155: dread d7/d2c/d30/d31/f32 [0,4194304] 0 2024-09-13T21:40:19.851 INFO:tasks.workunit.client.0.smithi088.stdout:8/159: symlink db/l38 0 2024-09-13T21:40:19.852 INFO:tasks.workunit.client.0.smithi088.stdout:0/156: mknod d7/d1d/d21/c3c 0 2024-09-13T21:40:19.854 INFO:tasks.workunit.client.0.smithi088.stdout:7/142: sync 2024-09-13T21:40:19.855 INFO:tasks.workunit.client.0.smithi088.stdout:7/143: symlink d6/da/l2f 0 2024-09-13T21:40:19.861 INFO:tasks.workunit.client.0.smithi088.stdout:2/138: rename d1/d22 to d1/d8/d2e 0 2024-09-13T21:40:19.861 INFO:tasks.workunit.client.0.smithi088.stdout:3/180: dwrite d5/d14/f37 [0,4194304] 0 2024-09-13T21:40:19.862 INFO:tasks.workunit.client.0.smithi088.stdout:3/181: fsync d5/d14/f2c 0 2024-09-13T21:40:19.863 INFO:tasks.workunit.client.0.smithi088.stdout:2/139: mknod d1/d8/d2e/c2f 0 2024-09-13T21:40:19.864 INFO:tasks.workunit.client.0.smithi088.stdout:0/157: dread d7/d1d/d27/f39 [0,4194304] 0 2024-09-13T21:40:19.867 INFO:tasks.workunit.client.0.smithi088.stdout:8/160: dread db/df/f1f [0,4194304] 0 2024-09-13T21:40:19.869 INFO:tasks.workunit.client.0.smithi088.stdout:8/161: rename db/df/l13 to db/l39 0 2024-09-13T21:40:19.869 INFO:tasks.workunit.client.0.smithi088.stdout:8/162: mknod db/d26/d37/c3a 0 2024-09-13T21:40:19.877 INFO:tasks.workunit.client.0.smithi088.stdout:3/182: write d5/d14/f37 [3873750,9095] 0 2024-09-13T21:40:19.877 INFO:tasks.workunit.client.0.smithi088.stdout:9/147: dwrite d1a/d1b/f28 [0,4194304] 0 2024-09-13T21:40:19.877 INFO:tasks.workunit.client.0.smithi088.stdout:7/144: dwrite d6/da/d1a/f2b [0,4194304] 0 2024-09-13T21:40:19.878 INFO:tasks.workunit.client.0.smithi088.stdout:9/148: fdatasync d1a/f20 0 2024-09-13T21:40:19.878 INFO:tasks.workunit.client.0.smithi088.stdout:9/149: chown l19 72 1 2024-09-13T21:40:19.878 INFO:tasks.workunit.client.0.smithi088.stdout:9/150: chown l19 48 1 2024-09-13T21:40:19.880 INFO:tasks.workunit.client.0.smithi088.stdout:2/140: dread d1/d8/fe [0,4194304] 0 2024-09-13T21:40:19.881 INFO:tasks.workunit.client.0.smithi088.stdout:3/183: mknod d5/c39 0 2024-09-13T21:40:19.883 INFO:tasks.workunit.client.0.smithi088.stdout:0/158: dread d7/d2c/d30/d31/f32 [0,4194304] 0 2024-09-13T21:40:19.885 INFO:tasks.workunit.client.0.smithi088.stdout:7/145: creat d6/da/d1a/f30 x:0 0 0 2024-09-13T21:40:19.888 INFO:tasks.workunit.client.0.smithi088.stdout:3/184: link d5/d26/c30 d5/d26/d2d/d31/c3a 0 2024-09-13T21:40:19.888 INFO:tasks.workunit.client.0.smithi088.stdout:3/185: creat d5/d26/d2d/f3b x:0 0 0 2024-09-13T21:40:19.890 INFO:tasks.workunit.client.0.smithi088.stdout:7/146: link d6/da/d1a/f2d d6/da/f31 0 2024-09-13T21:40:19.891 INFO:tasks.workunit.client.0.smithi088.stdout:9/151: rmdir d1a/d1b 39 2024-09-13T21:40:19.893 INFO:tasks.workunit.client.0.smithi088.stdout:3/186: creat d5/d23/f3c x:0 0 0 2024-09-13T21:40:19.893 INFO:tasks.workunit.client.0.smithi088.stdout:3/187: creat d5/d26/f3d x:0 0 0 2024-09-13T21:40:19.898 INFO:tasks.workunit.client.0.smithi088.stdout:3/188: mknod d5/d26/d2d/d31/c3e 0 2024-09-13T21:40:19.898 INFO:tasks.workunit.client.0.smithi088.stdout:7/147: mknod d6/c32 0 2024-09-13T21:40:19.898 INFO:tasks.workunit.client.0.smithi088.stdout:7/148: write d6/da/d1a/f29 [915325,119065] 0 2024-09-13T21:40:19.920 INFO:tasks.workunit.client.0.smithi088.stdout:8/163: dwrite db/d26/d2c/f32 [0,4194304] 0 2024-09-13T21:40:19.920 INFO:tasks.workunit.client.0.smithi088.stdout:2/141: dwrite d1/d13/f2c [0,4194304] 0 2024-09-13T21:40:19.920 INFO:tasks.workunit.client.0.smithi088.stdout:2/142: stat d1/f15 0 2024-09-13T21:40:19.920 INFO:tasks.workunit.client.0.smithi088.stdout:2/143: chown d1/d8/d2e/c2f 15 1 2024-09-13T21:40:19.920 INFO:tasks.workunit.client.0.smithi088.stdout:0/159: dwrite d7/da/f17 [0,4194304] 0 2024-09-13T21:40:19.921 INFO:tasks.workunit.client.0.smithi088.stdout:9/152: dwrite d1a/d1b/f25 [0,4194304] 0 2024-09-13T21:40:19.921 INFO:tasks.workunit.client.0.smithi088.stdout:7/149: dwrite d6/da/f19 [0,4194304] 0 2024-09-13T21:40:19.922 INFO:tasks.workunit.client.0.smithi088.stdout:7/150: creat d6/da/d1a/f33 x:0 0 0 2024-09-13T21:40:19.922 INFO:tasks.workunit.client.0.smithi088.stdout:2/144: dread d1/d8/d16/f23 [0,4194304] 0 2024-09-13T21:40:19.922 INFO:tasks.workunit.client.0.smithi088.stdout:2/145: readlink d1/l18 0 2024-09-13T21:40:19.922 INFO:tasks.workunit.client.0.smithi088.stdout:2/146: readlink d1/l2 0 2024-09-13T21:40:19.923 INFO:tasks.workunit.client.0.smithi088.stdout:8/164: dread db/df/d25/f28 [0,4194304] 0 2024-09-13T21:40:19.923 INFO:tasks.workunit.client.0.smithi088.stdout:8/165: write db/df/d25/f2e [932684,50041] 0 2024-09-13T21:40:19.926 INFO:tasks.workunit.client.0.smithi088.stdout:0/160: truncate d7/d1d/f29 554367 0 2024-09-13T21:40:19.929 INFO:tasks.workunit.client.0.smithi088.stdout:3/189: rmdir d5 39 2024-09-13T21:40:19.931 INFO:tasks.workunit.client.0.smithi088.stdout:6/178: sync 2024-09-13T21:40:19.931 INFO:tasks.workunit.client.0.smithi088.stdout:4/137: sync 2024-09-13T21:40:19.931 INFO:tasks.workunit.client.0.smithi088.stdout:9/153: mknod d1a/c2b 0 2024-09-13T21:40:19.933 INFO:tasks.workunit.client.0.smithi088.stdout:7/151: symlink d6/da/l34 0 2024-09-13T21:40:19.934 INFO:tasks.workunit.client.0.smithi088.stdout:2/147: mknod d1/c30 0 2024-09-13T21:40:19.935 INFO:tasks.workunit.client.0.smithi088.stdout:8/166: symlink db/df/d25/l3b 0 2024-09-13T21:40:19.936 INFO:tasks.workunit.client.0.smithi088.stdout:0/161: mkdir d7/d1d/d3d 0 2024-09-13T21:40:19.936 INFO:tasks.workunit.client.0.smithi088.stdout:0/162: chown d7/da/f17 1227573 1 2024-09-13T21:40:19.937 INFO:tasks.workunit.client.0.smithi088.stdout:3/190: mkdir d5/d23/d2a/d3f 0 2024-09-13T21:40:19.938 INFO:tasks.workunit.client.0.smithi088.stdout:9/154: write f15 [3271498,23789] 0 2024-09-13T21:40:19.938 INFO:tasks.workunit.client.0.smithi088.stdout:4/138: truncate d2/d5/ff 2030324 0 2024-09-13T21:40:19.939 INFO:tasks.workunit.client.0.smithi088.stdout:5/163: sync 2024-09-13T21:40:19.939 INFO:tasks.workunit.client.0.smithi088.stdout:1/207: sync 2024-09-13T21:40:19.940 INFO:tasks.workunit.client.0.smithi088.stdout:1/208: readlink d9/d10/d2a/d4b/l2b 0 2024-09-13T21:40:19.940 INFO:tasks.workunit.client.0.smithi088.stdout:6/179: mkdir d0/d2c/d32/d39 0 2024-09-13T21:40:19.942 INFO:tasks.workunit.client.0.smithi088.stdout:2/148: link d1/l26 d1/l31 0 2024-09-13T21:40:19.943 INFO:tasks.workunit.client.0.smithi088.stdout:8/167: mknod db/df/d25/c3c 0 2024-09-13T21:40:19.944 INFO:tasks.workunit.client.0.smithi088.stdout:8/168: readlink db/l12 0 2024-09-13T21:40:19.945 INFO:tasks.workunit.client.0.smithi088.stdout:0/163: creat d7/d1d/d27/f3e x:0 0 0 2024-09-13T21:40:19.947 INFO:tasks.workunit.client.0.smithi088.stdout:0/164: dread d7/f2b [0,4194304] 0 2024-09-13T21:40:19.947 INFO:tasks.workunit.client.0.smithi088.stdout:8/169: dread db/df/f1f [0,4194304] 0 2024-09-13T21:40:19.947 INFO:tasks.workunit.client.0.smithi088.stdout:8/170: write db/f17 [3167272,107805] 0 2024-09-13T21:40:19.949 INFO:tasks.workunit.client.0.smithi088.stdout:9/155: rename l16 to d1a/l2c 0 2024-09-13T21:40:19.949 INFO:tasks.workunit.client.0.smithi088.stdout:9/156: chown d1a/f20 10 1 2024-09-13T21:40:19.949 INFO:tasks.workunit.client.0.smithi088.stdout:5/164: read d4/d1b/d2a/f2d [3288345,102760] 0 2024-09-13T21:40:19.949 INFO:tasks.workunit.client.0.smithi088.stdout:1/209: mkdir d9/d4f 0 2024-09-13T21:40:19.952 INFO:tasks.workunit.client.0.smithi088.stdout:6/180: symlink d0/d1e/d1f/l3a 0 2024-09-13T21:40:19.952 INFO:tasks.workunit.client.0.smithi088.stdout:6/181: truncate d0/db/f12 4810461 0 2024-09-13T21:40:19.954 INFO:tasks.workunit.client.0.smithi088.stdout:7/152: symlink d6/l35 0 2024-09-13T21:40:19.955 INFO:tasks.workunit.client.0.smithi088.stdout:2/149: symlink d1/d13/d2a/l32 0 2024-09-13T21:40:19.957 INFO:tasks.workunit.client.0.smithi088.stdout:0/165: mknod d7/d2c/c3f 0 2024-09-13T21:40:19.957 INFO:tasks.workunit.client.0.smithi088.stdout:0/166: creat d7/f40 x:0 0 0 2024-09-13T21:40:19.958 INFO:tasks.workunit.client.0.smithi088.stdout:8/171: rename db/f14 to db/df/f3d 0 2024-09-13T21:40:19.959 INFO:tasks.workunit.client.0.smithi088.stdout:7/153: mknod d6/da/d1a/c36 0 2024-09-13T21:40:19.960 INFO:tasks.workunit.client.0.smithi088.stdout:7/154: fsync d6/da/f10 0 2024-09-13T21:40:19.961 INFO:tasks.workunit.client.0.smithi088.stdout:2/150: mknod d1/d8/c33 0 2024-09-13T21:40:19.962 INFO:tasks.workunit.client.0.smithi088.stdout:0/167: symlink d7/d1d/d26/l41 0 2024-09-13T21:40:19.962 INFO:tasks.workunit.client.0.smithi088.stdout:0/168: dread - d7/d1d/d27/f3e zero size 2024-09-13T21:40:19.963 INFO:tasks.workunit.client.0.smithi088.stdout:8/172: symlink db/d26/l3e 0 2024-09-13T21:40:19.963 INFO:tasks.workunit.client.0.smithi088.stdout:5/165: getdents d4/d1b/d2a 0 2024-09-13T21:40:19.965 INFO:tasks.workunit.client.0.smithi088.stdout:2/151: creat d1/f34 x:0 0 0 2024-09-13T21:40:19.965 INFO:tasks.workunit.client.0.smithi088.stdout:2/152: dread - d1/d8/d2e/f2d zero size 2024-09-13T21:40:19.965 INFO:tasks.workunit.client.0.smithi088.stdout:2/153: write d1/f34 [477886,52835] 0 2024-09-13T21:40:19.965 INFO:tasks.workunit.client.0.smithi088.stdout:0/169: getdents d7/d1d/d21 0 2024-09-13T21:40:19.966 INFO:tasks.workunit.client.0.smithi088.stdout:5/166: mknod d4/d1b/d2a/c32 0 2024-09-13T21:40:19.967 INFO:tasks.workunit.client.0.smithi088.stdout:5/167: write d4/d1b/f28 [570804,30975] 0 2024-09-13T21:40:19.967 INFO:tasks.workunit.client.0.smithi088.stdout:2/154: symlink d1/d8/d16/l35 0 2024-09-13T21:40:19.969 INFO:tasks.workunit.client.0.smithi088.stdout:0/170: mkdir d7/d2c/d30/d31/d42 0 2024-09-13T21:40:19.969 INFO:tasks.workunit.client.0.smithi088.stdout:0/171: chown d7/d1a/c25 1350 1 2024-09-13T21:40:19.969 INFO:tasks.workunit.client.0.smithi088.stdout:2/155: stat d1/l26 0 2024-09-13T21:40:19.970 INFO:tasks.workunit.client.0.smithi088.stdout:2/156: creat d1/f36 x:0 0 0 2024-09-13T21:40:19.970 INFO:tasks.workunit.client.0.smithi088.stdout:2/157: creat d1/d8/d16/f37 x:0 0 0 2024-09-13T21:40:19.975 INFO:tasks.workunit.client.0.smithi088.stdout:0/172: rename d7/da to d7/d1d/d27/d43 0 2024-09-13T21:40:19.984 INFO:tasks.workunit.client.0.smithi088.stdout:6/182: dwrite d0/f22 [0,4194304] 0 2024-09-13T21:40:19.985 INFO:tasks.workunit.client.0.smithi088.stdout:1/210: dwrite d9/d10/d2a/d4b/f23 [0,4194304] 0 2024-09-13T21:40:19.985 INFO:tasks.workunit.client.0.smithi088.stdout:9/157: dwrite d1a/d1b/f25 [4194304,4194304] 0 2024-09-13T21:40:19.985 INFO:tasks.workunit.client.0.smithi088.stdout:5/168: fdatasync d4/d1b/f28 0 2024-09-13T21:40:19.985 INFO:tasks.workunit.client.0.smithi088.stdout:7/155: dwrite d6/f18 [0,4194304] 0 2024-09-13T21:40:19.988 INFO:tasks.workunit.client.0.smithi088.stdout:6/183: unlink d0/db/f29 0 2024-09-13T21:40:19.988 INFO:tasks.workunit.client.0.smithi088.stdout:6/184: fsync d0/ff 0 2024-09-13T21:40:19.991 INFO:tasks.workunit.client.0.smithi088.stdout:0/173: dwrite d7/d1d/d27/f39 [0,4194304] 0 2024-09-13T21:40:19.991 INFO:tasks.workunit.client.0.smithi088.stdout:0/174: fdatasync d7/f19 0 2024-09-13T21:40:19.992 INFO:tasks.workunit.client.0.smithi088.stdout:5/169: dread d4/ff [0,4194304] 0 2024-09-13T21:40:19.992 INFO:tasks.workunit.client.0.smithi088.stdout:5/170: write d4/f13 [38651,74354] 0 2024-09-13T21:40:19.997 INFO:tasks.workunit.client.0.smithi088.stdout:9/158: creat d1a/d1b/f2d x:0 0 0 2024-09-13T21:40:19.997 INFO:tasks.workunit.client.0.smithi088.stdout:9/159: creat d1a/d1b/f2e x:0 0 0 2024-09-13T21:40:19.997 INFO:tasks.workunit.client.0.smithi088.stdout:9/160: fdatasync f13 0 2024-09-13T21:40:19.997 INFO:tasks.workunit.client.0.smithi088.stdout:9/161: stat d1a/f24 0 2024-09-13T21:40:19.997 INFO:tasks.workunit.client.0.smithi088.stdout:9/162: truncate d1a/f27 369228 0 2024-09-13T21:40:19.999 INFO:tasks.workunit.client.0.smithi088.stdout:7/156: mknod d6/da/c37 0 2024-09-13T21:40:20.001 INFO:tasks.workunit.client.0.smithi088.stdout:1/211: dwrite d9/d10/d2a/d4b/d39/f40 [4194304,4194304] 0 2024-09-13T21:40:20.004 INFO:tasks.workunit.client.0.smithi088.stdout:0/175: truncate d7/d1d/f29 116890 0 2024-09-13T21:40:20.004 INFO:tasks.workunit.client.0.smithi088.stdout:0/176: fsync d7/f28 0 2024-09-13T21:40:20.005 INFO:tasks.workunit.client.0.smithi088.stdout:5/171: mkdir d4/d1c/d33 0 2024-09-13T21:40:20.006 INFO:tasks.workunit.client.0.smithi088.stdout:0/177: dread d7/f23 [0,4194304] 0 2024-09-13T21:40:20.010 INFO:tasks.workunit.client.0.smithi088.stdout:9/163: mknod d1a/d1b/c2f 0 2024-09-13T21:40:20.010 INFO:tasks.workunit.client.0.smithi088.stdout:9/164: creat d1a/f30 x:0 0 0 2024-09-13T21:40:20.010 INFO:tasks.workunit.client.0.smithi088.stdout:9/165: readlink d1a/d1b/l1d 0 2024-09-13T21:40:20.013 INFO:tasks.workunit.client.0.smithi088.stdout:5/172: rmdir d4/d1c/d33 0 2024-09-13T21:40:20.013 INFO:tasks.workunit.client.0.smithi088.stdout:5/173: dread - d4/f22 zero size 2024-09-13T21:40:20.018 INFO:tasks.workunit.client.0.smithi088.stdout:9/166: rename d1a/f27 to d1a/f31 0 2024-09-13T21:40:20.020 INFO:tasks.workunit.client.0.smithi088.stdout:7/157: rmdir d6/da 39 2024-09-13T21:40:20.021 INFO:tasks.workunit.client.0.smithi088.stdout:9/167: dread d1a/f23 [0,4194304] 0 2024-09-13T21:40:20.029 INFO:tasks.workunit.client.0.smithi088.stdout:1/212: dwrite d9/f19 [0,4194304] 0 2024-09-13T21:40:20.029 INFO:tasks.workunit.client.0.smithi088.stdout:5/174: dread d4/f13 [0,4194304] 0 2024-09-13T21:40:20.029 INFO:tasks.workunit.client.0.smithi088.stdout:0/178: dwrite d7/f28 [0,4194304] 0 2024-09-13T21:40:20.029 INFO:tasks.workunit.client.0.smithi088.stdout:0/179: write d7/d1d/f29 [527408,67301] 0 2024-09-13T21:40:20.029 INFO:tasks.workunit.client.0.smithi088.stdout:5/175: mkdir d4/d1c/d24/d34 0 2024-09-13T21:40:20.031 INFO:tasks.workunit.client.0.smithi088.stdout:9/168: dread d1a/d1b/f25 [4194304,4194304] 0 2024-09-13T21:40:20.031 INFO:tasks.workunit.client.0.smithi088.stdout:9/169: dread - d1a/d1b/f2e zero size 2024-09-13T21:40:20.031 INFO:tasks.workunit.client.0.smithi088.stdout:9/170: stat d1a/f21 0 2024-09-13T21:40:20.033 INFO:tasks.workunit.client.0.smithi088.stdout:0/180: mkdir d7/d2c/d44 0 2024-09-13T21:40:20.035 INFO:tasks.workunit.client.0.smithi088.stdout:1/213: write d9/d10/d2a/d4b/f28 [656195,1420] 0 2024-09-13T21:40:20.036 INFO:tasks.workunit.client.0.smithi088.stdout:5/176: rename d4/d18/f15 to d4/d1c/d24/f35 0 2024-09-13T21:40:20.037 INFO:tasks.workunit.client.0.smithi088.stdout:5/177: fdatasync f2 0 2024-09-13T21:40:20.039 INFO:tasks.workunit.client.0.smithi088.stdout:3/191: sync 2024-09-13T21:40:20.045 INFO:tasks.workunit.client.0.smithi088.stdout:9/171: write f14 [660857,57514] 0 2024-09-13T21:40:20.046 INFO:tasks.workunit.client.0.smithi088.stdout:0/181: write d7/f19 [1900211,33622] 0 2024-09-13T21:40:20.048 INFO:tasks.workunit.client.0.smithi088.stdout:9/172: mknod d1a/c32 0 2024-09-13T21:40:20.065 INFO:tasks.workunit.client.0.smithi088.stdout:0/182: write d7/d2c/d30/d31/f32 [2770406,33443] 0 2024-09-13T21:40:20.065 INFO:tasks.workunit.client.0.smithi088.stdout:0/183: truncate d7/d1d/d21/f2a 954413 0 2024-09-13T21:40:20.066 INFO:tasks.workunit.client.0.smithi088.stdout:1/214: dwrite d9/dc/f1f [0,4194304] 0 2024-09-13T21:40:20.067 INFO:tasks.workunit.client.0.smithi088.stdout:0/184: unlink d7/ce 0 2024-09-13T21:40:20.067 INFO:tasks.workunit.client.0.smithi088.stdout:0/185: chown d7/l16 99 1 2024-09-13T21:40:20.069 INFO:tasks.workunit.client.0.smithi088.stdout:1/215: rename d9/f31 to d9/d10/d2a/d47/f50 0 2024-09-13T21:40:20.069 INFO:tasks.workunit.client.0.smithi088.stdout:0/186: mkdir d7/d1d/d26/d45 0 2024-09-13T21:40:20.075 INFO:tasks.workunit.client.0.smithi088.stdout:5/178: dwrite d4/d18/f11 [0,4194304] 0 2024-09-13T21:40:20.086 INFO:tasks.workunit.client.0.smithi088.stdout:5/179: write d4/d18/f11 [2265028,56112] 0 2024-09-13T21:40:20.087 INFO:tasks.workunit.client.0.smithi088.stdout:5/180: creat d4/d1c/d24/d26/f36 x:0 0 0 2024-09-13T21:40:20.087 INFO:tasks.workunit.client.0.smithi088.stdout:9/173: dwrite d1a/d1b/f28 [0,4194304] 0 2024-09-13T21:40:20.088 INFO:tasks.workunit.client.0.smithi088.stdout:5/181: symlink d4/d1b/l37 0 2024-09-13T21:40:20.088 INFO:tasks.workunit.client.0.smithi088.stdout:3/192: dwrite d5/f13 [0,4194304] 0 2024-09-13T21:40:20.088 INFO:tasks.workunit.client.0.smithi088.stdout:0/187: dwrite d7/f23 [0,4194304] 0 2024-09-13T21:40:20.089 INFO:tasks.workunit.client.0.smithi088.stdout:9/174: symlink d1a/d1b/l33 0 2024-09-13T21:40:20.089 INFO:tasks.workunit.client.0.smithi088.stdout:9/175: stat d1a/d1b/f2d 0 2024-09-13T21:40:20.093 INFO:tasks.workunit.client.0.smithi088.stdout:5/182: dread d4/fc [4194304,4194304] 0 2024-09-13T21:40:20.094 INFO:tasks.workunit.client.0.smithi088.stdout:1/216: dwrite d9/d10/f11 [0,4194304] 0 2024-09-13T21:40:20.095 INFO:tasks.workunit.client.0.smithi088.stdout:3/193: creat d5/d23/d2a/f40 x:0 0 0 2024-09-13T21:40:20.096 INFO:tasks.workunit.client.0.smithi088.stdout:0/188: dread f5 [0,4194304] 0 2024-09-13T21:40:20.096 INFO:tasks.workunit.client.0.smithi088.stdout:5/183: rename d4/d1b/f28 to d4/d1b/f38 0 2024-09-13T21:40:20.097 INFO:tasks.workunit.client.0.smithi088.stdout:5/184: read - d4/f22 zero size 2024-09-13T21:40:20.097 INFO:tasks.workunit.client.0.smithi088.stdout:5/185: dread - d4/f22 zero size 2024-09-13T21:40:20.098 INFO:tasks.workunit.client.0.smithi088.stdout:0/189: dread d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:20.098 INFO:tasks.workunit.client.0.smithi088.stdout:1/217: mknod d9/dc/c51 0 2024-09-13T21:40:20.098 INFO:tasks.workunit.client.0.smithi088.stdout:1/218: read - d9/dc/f42 zero size 2024-09-13T21:40:20.099 INFO:tasks.workunit.client.0.smithi088.stdout:3/194: symlink d5/d23/d2a/d3f/l41 0 2024-09-13T21:40:20.102 INFO:tasks.workunit.client.0.smithi088.stdout:0/190: link d7/f28 d7/f46 0 2024-09-13T21:40:20.102 INFO:tasks.workunit.client.0.smithi088.stdout:0/191: dread - d7/f40 zero size 2024-09-13T21:40:20.103 INFO:tasks.workunit.client.0.smithi088.stdout:1/219: mkdir d9/dc/d52 0 2024-09-13T21:40:20.104 INFO:tasks.workunit.client.0.smithi088.stdout:3/195: rename d5/f34 to d5/f42 0 2024-09-13T21:40:20.104 INFO:tasks.workunit.client.0.smithi088.stdout:8/173: sync 2024-09-13T21:40:20.104 INFO:tasks.workunit.client.0.smithi088.stdout:2/158: sync 2024-09-13T21:40:20.104 INFO:tasks.workunit.client.0.smithi088.stdout:4/139: sync 2024-09-13T21:40:20.104 INFO:tasks.workunit.client.0.smithi088.stdout:4/140: chown d2/d9/l22 10125 1 2024-09-13T21:40:20.105 INFO:tasks.workunit.client.0.smithi088.stdout:5/186: rename d4/d1c/d24/d26/f36 to d4/d1c/d24/f39 0 2024-09-13T21:40:20.106 INFO:tasks.workunit.client.0.smithi088.stdout:2/159: write d1/f15 [144259,109045] 0 2024-09-13T21:40:20.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/160: chown d1/cf 301 1 2024-09-13T21:40:20.107 INFO:tasks.workunit.client.0.smithi088.stdout:1/220: mknod d9/d10/d41/c53 0 2024-09-13T21:40:20.107 INFO:tasks.workunit.client.0.smithi088.stdout:3/196: rmdir d5 39 2024-09-13T21:40:20.109 INFO:tasks.workunit.client.0.smithi088.stdout:5/187: symlink d4/l3a 0 2024-09-13T21:40:20.111 INFO:tasks.workunit.client.0.smithi088.stdout:2/161: link d1/d8/f19 d1/d8/d2e/f38 0 2024-09-13T21:40:20.111 INFO:tasks.workunit.client.0.smithi088.stdout:2/162: chown d1/d8/c33 96219 1 2024-09-13T21:40:20.112 INFO:tasks.workunit.client.0.smithi088.stdout:1/221: rmdir d9/d10/d2a/d4b/d33 39 2024-09-13T21:40:20.114 INFO:tasks.workunit.client.0.smithi088.stdout:7/158: sync 2024-09-13T21:40:20.114 INFO:tasks.workunit.client.0.smithi088.stdout:6/185: sync 2024-09-13T21:40:20.115 INFO:tasks.workunit.client.0.smithi088.stdout:7/159: fdatasync d6/f1b 0 2024-09-13T21:40:20.115 INFO:tasks.workunit.client.0.smithi088.stdout:3/197: mkdir d5/d26/d43 0 2024-09-13T21:40:20.115 INFO:tasks.workunit.client.0.smithi088.stdout:3/198: write d5/d14/f2c [711177,101427] 0 2024-09-13T21:40:20.115 INFO:tasks.workunit.client.0.smithi088.stdout:2/163: dread d1/d13/f17 [0,4194304] 0 2024-09-13T21:40:20.116 INFO:tasks.workunit.client.0.smithi088.stdout:5/188: creat d4/d1b/d2a/f3b x:0 0 0 2024-09-13T21:40:20.116 INFO:tasks.workunit.client.0.smithi088.stdout:5/189: dread - d4/d1c/d24/f39 zero size 2024-09-13T21:40:20.117 INFO:tasks.workunit.client.0.smithi088.stdout:1/222: truncate d9/d10/d2a/d4b/d39/f40 5933226 0 2024-09-13T21:40:20.119 INFO:tasks.workunit.client.0.smithi088.stdout:6/186: mknod d0/d2c/d32/d39/c3b 0 2024-09-13T21:40:20.119 INFO:tasks.workunit.client.0.smithi088.stdout:6/187: fdatasync d0/db/f10 0 2024-09-13T21:40:20.120 INFO:tasks.workunit.client.0.smithi088.stdout:3/199: dread d5/d26/f27 [0,4194304] 0 2024-09-13T21:40:20.121 INFO:tasks.workunit.client.0.smithi088.stdout:5/190: rmdir d4/d1c/d24/d34 0 2024-09-13T21:40:20.123 INFO:tasks.workunit.client.0.smithi088.stdout:1/223: truncate d9/d10/f3f 470057 0 2024-09-13T21:40:20.125 INFO:tasks.workunit.client.0.smithi088.stdout:3/200: rename d5/d26/f3d to d5/d26/d2d/f44 0 2024-09-13T21:40:20.126 INFO:tasks.workunit.client.0.smithi088.stdout:0/192: dwrite d7/f9 [4194304,4194304] 0 2024-09-13T21:40:20.126 INFO:tasks.workunit.client.0.smithi088.stdout:0/193: stat d7/f23 0 2024-09-13T21:40:20.127 INFO:tasks.workunit.client.0.smithi088.stdout:1/224: rename d9/dc/c1e to d9/c54 0 2024-09-13T21:40:20.128 INFO:tasks.workunit.client.0.smithi088.stdout:1/225: chown d9/f19 87518699 1 2024-09-13T21:40:20.129 INFO:tasks.workunit.client.0.smithi088.stdout:6/188: write d0/db/f12 [3871365,545] 0 2024-09-13T21:40:20.130 INFO:tasks.workunit.client.0.smithi088.stdout:0/194: unlink d7/f40 0 2024-09-13T21:40:20.130 INFO:tasks.workunit.client.0.smithi088.stdout:4/141: dwrite d2/d5/f14 [0,4194304] 0 2024-09-13T21:40:20.130 INFO:tasks.workunit.client.0.smithi088.stdout:0/195: creat d7/d1a/f47 x:0 0 0 2024-09-13T21:40:20.130 INFO:tasks.workunit.client.0.smithi088.stdout:0/196: truncate d7/f2b 938194 0 2024-09-13T21:40:20.130 INFO:tasks.workunit.client.0.smithi088.stdout:0/197: chown d7/d1a 41813 1 2024-09-13T21:40:20.132 INFO:tasks.workunit.client.0.smithi088.stdout:3/201: fdatasync d5/d14/f2c 0 2024-09-13T21:40:20.132 INFO:tasks.workunit.client.0.smithi088.stdout:7/160: write d6/da/f1e [7400860,84211] 0 2024-09-13T21:40:20.132 INFO:tasks.workunit.client.0.smithi088.stdout:1/226: creat d9/d10/d2a/f55 x:0 0 0 2024-09-13T21:40:20.132 INFO:tasks.workunit.client.0.smithi088.stdout:1/227: write d9/d10/f17 [1128064,92407] 0 2024-09-13T21:40:20.138 INFO:tasks.workunit.client.0.smithi088.stdout:3/202: symlink d5/l45 0 2024-09-13T21:40:20.139 INFO:tasks.workunit.client.0.smithi088.stdout:6/189: write d0/f6 [1470230,47255] 0 2024-09-13T21:40:20.139 INFO:tasks.workunit.client.0.smithi088.stdout:1/228: symlink d9/d10/d2a/d4b/l56 0 2024-09-13T21:40:20.140 INFO:tasks.workunit.client.0.smithi088.stdout:6/190: truncate d0/f22 4533222 0 2024-09-13T21:40:20.141 INFO:tasks.workunit.client.0.smithi088.stdout:3/203: rename d5/d26/f2f to d5/d26/d2d/f46 0 2024-09-13T21:40:20.141 INFO:tasks.workunit.client.0.smithi088.stdout:3/204: fdatasync d5/d23/d2a/f40 0 2024-09-13T21:40:20.141 INFO:tasks.workunit.client.0.smithi088.stdout:3/205: write d5/d26/f33 [736923,128954] 0 2024-09-13T21:40:20.143 INFO:tasks.workunit.client.0.smithi088.stdout:6/191: truncate d0/ff 5054255 0 2024-09-13T21:40:20.143 INFO:tasks.workunit.client.0.smithi088.stdout:6/192: fdatasync d0/db/f10 0 2024-09-13T21:40:20.144 INFO:tasks.workunit.client.0.smithi088.stdout:3/206: getdents d5/d26/d2d/d31 0 2024-09-13T21:40:20.146 INFO:tasks.workunit.client.0.smithi088.stdout:6/193: link d0/d28/c2b d0/d28/c3c 0 2024-09-13T21:40:20.147 INFO:tasks.workunit.client.0.smithi088.stdout:3/207: symlink d5/d23/d2a/d3f/l47 0 2024-09-13T21:40:20.149 INFO:tasks.workunit.client.0.smithi088.stdout:7/161: dread d6/da/d1a/f2b [0,4194304] 0 2024-09-13T21:40:20.150 INFO:tasks.workunit.client.0.smithi088.stdout:7/162: chown d6/da/l12 326 1 2024-09-13T21:40:20.150 INFO:tasks.workunit.client.0.smithi088.stdout:7/163: stat d6/da/c37 0 2024-09-13T21:40:20.150 INFO:tasks.workunit.client.0.smithi088.stdout:6/194: unlink d0/l11 0 2024-09-13T21:40:20.150 INFO:tasks.workunit.client.0.smithi088.stdout:3/208: mkdir d5/d26/d2d/d48 0 2024-09-13T21:40:20.153 INFO:tasks.workunit.client.0.smithi088.stdout:5/191: dwrite d4/f1f [0,4194304] 0 2024-09-13T21:40:20.155 INFO:tasks.workunit.client.0.smithi088.stdout:7/164: link d6/da/f10 d6/da/f38 0 2024-09-13T21:40:20.157 INFO:tasks.workunit.client.0.smithi088.stdout:7/165: getdents d6 0 2024-09-13T21:40:20.160 INFO:tasks.workunit.client.0.smithi088.stdout:5/192: dread d4/d1b/d2a/f2d [0,4194304] 0 2024-09-13T21:40:20.161 INFO:tasks.workunit.client.0.smithi088.stdout:5/193: rename d4/d1b to d4/d1b/d2a/d3c 22 2024-09-13T21:40:20.161 INFO:tasks.workunit.client.0.smithi088.stdout:5/194: write d4/f13 [521759,80067] 0 2024-09-13T21:40:20.162 INFO:tasks.workunit.client.0.smithi088.stdout:5/195: write d4/d1b/f38 [1090413,34577] 0 2024-09-13T21:40:20.169 INFO:tasks.workunit.client.0.smithi088.stdout:0/198: dwrite d7/d1d/d21/f2a [0,4194304] 0 2024-09-13T21:40:20.169 INFO:tasks.workunit.client.0.smithi088.stdout:2/164: dwrite d1/f10 [0,4194304] 0 2024-09-13T21:40:20.174 INFO:tasks.workunit.client.0.smithi088.stdout:4/142: dwrite d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:20.178 INFO:tasks.workunit.client.0.smithi088.stdout:1/229: dwrite d9/d10/d2a/d4b/d33/f3d [4194304,4194304] 0 2024-09-13T21:40:20.181 INFO:tasks.workunit.client.0.smithi088.stdout:4/143: getdents d2 0 2024-09-13T21:40:20.187 INFO:tasks.workunit.client.0.smithi088.stdout:4/144: dread d2/d9/de/d1e/f26 [0,4194304] 0 2024-09-13T21:40:20.193 INFO:tasks.workunit.client.0.smithi088.stdout:7/166: dwrite d6/da/fb [0,4194304] 0 2024-09-13T21:40:20.194 INFO:tasks.workunit.client.0.smithi088.stdout:7/167: fdatasync d6/f1b 0 2024-09-13T21:40:20.194 INFO:tasks.workunit.client.0.smithi088.stdout:7/168: read - d6/da/d1a/f33 zero size 2024-09-13T21:40:20.195 INFO:tasks.workunit.client.0.smithi088.stdout:1/230: symlink d9/d10/d2a/l57 0 2024-09-13T21:40:20.195 INFO:tasks.workunit.client.0.smithi088.stdout:4/145: symlink d2/d5/l2f 0 2024-09-13T21:40:20.196 INFO:tasks.workunit.client.0.smithi088.stdout:4/146: write d2/d9/f2a [454347,33993] 0 2024-09-13T21:40:20.197 INFO:tasks.workunit.client.0.smithi088.stdout:1/231: unlink d9/d10/d2a/d4b/c49 0 2024-09-13T21:40:20.197 INFO:tasks.workunit.client.0.smithi088.stdout:1/232: chown d9/d10/d2a/d4b/f1d 408035 1 2024-09-13T21:40:20.198 INFO:tasks.workunit.client.0.smithi088.stdout:4/147: symlink d2/d9/d19/l30 0 2024-09-13T21:40:20.198 INFO:tasks.workunit.client.0.smithi088.stdout:1/233: read d9/d10/f3f [382884,74098] 0 2024-09-13T21:40:20.199 INFO:tasks.workunit.client.0.smithi088.stdout:7/169: truncate d6/f22 2589920 0 2024-09-13T21:40:20.199 INFO:tasks.workunit.client.0.smithi088.stdout:4/148: mkdir d2/d9/de/d1e/d31 0 2024-09-13T21:40:20.199 INFO:tasks.workunit.client.0.smithi088.stdout:4/149: chown d2/d11 7319564 1 2024-09-13T21:40:20.200 INFO:tasks.workunit.client.0.smithi088.stdout:1/234: dread d9/d10/d2a/d4b/f2f [0,4194304] 0 2024-09-13T21:40:20.201 INFO:tasks.workunit.client.0.smithi088.stdout:1/235: fsync d9/d10/d2a/d4b/f23 0 2024-09-13T21:40:20.201 INFO:tasks.workunit.client.0.smithi088.stdout:1/236: truncate d9/d10/d2a/d4b/f28 4753561 0 2024-09-13T21:40:20.201 INFO:tasks.workunit.client.0.smithi088.stdout:5/196: dwrite d4/d1c/d24/f35 [0,4194304] 0 2024-09-13T21:40:20.201 INFO:tasks.workunit.client.0.smithi088.stdout:4/150: creat d2/d9/de/f32 x:0 0 0 2024-09-13T21:40:20.202 INFO:tasks.workunit.client.0.smithi088.stdout:2/165: dwrite d1/d13/d2a/f2b [0,4194304] 0 2024-09-13T21:40:20.202 INFO:tasks.workunit.client.0.smithi088.stdout:2/166: write d1/f36 [597121,64900] 0 2024-09-13T21:40:20.202 INFO:tasks.workunit.client.0.smithi088.stdout:1/237: dread d9/d10/f3f [0,4194304] 0 2024-09-13T21:40:20.202 INFO:tasks.workunit.client.0.smithi088.stdout:6/195: dwrite d0/f6 [0,4194304] 0 2024-09-13T21:40:20.203 INFO:tasks.workunit.client.0.smithi088.stdout:4/151: truncate d2/d9/de/d1e/f26 1325474 0 2024-09-13T21:40:20.205 INFO:tasks.workunit.client.0.smithi088.stdout:1/238: dread d9/d10/f17 [0,4194304] 0 2024-09-13T21:40:20.205 INFO:tasks.workunit.client.0.smithi088.stdout:1/239: fsync d9/d10/d2a/d4b/f28 0 2024-09-13T21:40:20.206 INFO:tasks.workunit.client.0.smithi088.stdout:5/197: dread d4/d1b/d2a/f2d [0,4194304] 0 2024-09-13T21:40:20.208 INFO:tasks.workunit.client.0.smithi088.stdout:2/167: truncate d1/d13/f17 564663 0 2024-09-13T21:40:20.208 INFO:tasks.workunit.client.0.smithi088.stdout:2/168: creat d1/d8/d24/f39 x:0 0 0 2024-09-13T21:40:20.208 INFO:tasks.workunit.client.0.smithi088.stdout:2/169: creat d1/d13/d2a/f3a x:0 0 0 2024-09-13T21:40:20.210 INFO:tasks.workunit.client.0.smithi088.stdout:7/170: write d6/da/f38 [6673060,86348] 0 2024-09-13T21:40:20.212 INFO:tasks.workunit.client.0.smithi088.stdout:4/152: symlink d2/d9/l33 0 2024-09-13T21:40:20.212 INFO:tasks.workunit.client.0.smithi088.stdout:7/171: fdatasync d6/da/f10 0 2024-09-13T21:40:20.214 INFO:tasks.workunit.client.0.smithi088.stdout:1/240: creat d9/d10/d2a/d4b/d3a/f58 x:0 0 0 2024-09-13T21:40:20.215 INFO:tasks.workunit.client.0.smithi088.stdout:5/198: mknod d4/c3d 0 2024-09-13T21:40:20.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/170: mkdir d1/d8/d2e/d3b 0 2024-09-13T21:40:20.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/171: readlink d1/d8/d2e/l27 0 2024-09-13T21:40:20.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/172: read - d1/d8/d24/f39 zero size 2024-09-13T21:40:20.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/173: chown d1/d13/d2a/f2b 1 1 2024-09-13T21:40:20.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/174: chown d1/fd 11 1 2024-09-13T21:40:20.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/172: mkdir d6/da/d39 0 2024-09-13T21:40:20.222 INFO:tasks.workunit.client.0.smithi088.stdout:5/199: creat d4/d1c/f3e x:0 0 0 2024-09-13T21:40:20.223 INFO:tasks.workunit.client.0.smithi088.stdout:1/241: write f1 [288074,130352] 0 2024-09-13T21:40:20.223 INFO:tasks.workunit.client.0.smithi088.stdout:6/196: dwrite d0/db/f12 [4194304,4194304] 0 2024-09-13T21:40:20.224 INFO:tasks.workunit.client.0.smithi088.stdout:7/173: mkdir d6/da/d1a/d3a 0 2024-09-13T21:40:20.227 INFO:tasks.workunit.client.0.smithi088.stdout:1/242: creat d9/d10/d2a/d4b/d33/f59 x:0 0 0 2024-09-13T21:40:20.233 INFO:tasks.workunit.client.0.smithi088.stdout:5/200: rename d4/d1c/d24/c2e to d4/d1b/d2a/c3f 0 2024-09-13T21:40:20.233 INFO:tasks.workunit.client.0.smithi088.stdout:5/201: fsync d4/f7 0 2024-09-13T21:40:20.233 INFO:tasks.workunit.client.0.smithi088.stdout:5/202: fdatasync d4/d1b/d2a/f2d 0 2024-09-13T21:40:20.233 INFO:tasks.workunit.client.0.smithi088.stdout:5/203: truncate d4/f22 477909 0 2024-09-13T21:40:20.234 INFO:tasks.workunit.client.0.smithi088.stdout:4/153: write d2/d9/de/d1e/f26 [1097603,76872] 0 2024-09-13T21:40:20.234 INFO:tasks.workunit.client.0.smithi088.stdout:4/154: write f1 [871621,28175] 0 2024-09-13T21:40:20.237 INFO:tasks.workunit.client.0.smithi088.stdout:1/243: symlink d9/dc/l5a 0 2024-09-13T21:40:20.238 INFO:tasks.workunit.client.0.smithi088.stdout:6/197: symlink d0/l3d 0 2024-09-13T21:40:20.243 INFO:tasks.workunit.client.0.smithi088.stdout:1/244: rename d9/d10/d2a/l3c to d9/d10/d2a/d4b/d39/l5b 0 2024-09-13T21:40:20.244 INFO:tasks.workunit.client.0.smithi088.stdout:6/198: rmdir d0/d2c/d32/d39 39 2024-09-13T21:40:20.244 INFO:tasks.workunit.client.0.smithi088.stdout:2/175: dwrite d1/f15 [0,4194304] 0 2024-09-13T21:40:20.244 INFO:tasks.workunit.client.0.smithi088.stdout:7/174: dwrite d6/da/d1a/f29 [0,4194304] 0 2024-09-13T21:40:20.246 INFO:tasks.workunit.client.0.smithi088.stdout:1/245: mknod d9/c5c 0 2024-09-13T21:40:20.251 INFO:tasks.workunit.client.0.smithi088.stdout:4/155: dwrite d2/d5/f24 [0,4194304] 0 2024-09-13T21:40:20.251 INFO:tasks.workunit.client.0.smithi088.stdout:4/156: write d2/d9/de/f28 [1624981,82580] 0 2024-09-13T21:40:20.251 INFO:tasks.workunit.client.0.smithi088.stdout:4/157: chown d2/d9/de/d1e/f26 15 1 2024-09-13T21:40:20.251 INFO:tasks.workunit.client.0.smithi088.stdout:4/158: creat d2/d9/de/d12/f34 x:0 0 0 2024-09-13T21:40:20.253 INFO:tasks.workunit.client.0.smithi088.stdout:9/176: sync 2024-09-13T21:40:20.253 INFO:tasks.workunit.client.0.smithi088.stdout:9/177: chown d1a/d1b/f2d 1381527595 1 2024-09-13T21:40:20.255 INFO:tasks.workunit.client.0.smithi088.stdout:6/199: rename d0/d2c/d32/l34 to d0/db/l3e 0 2024-09-13T21:40:20.256 INFO:tasks.workunit.client.0.smithi088.stdout:6/200: dread d0/d1e/f24 [0,4194304] 0 2024-09-13T21:40:20.260 INFO:tasks.workunit.client.0.smithi088.stdout:2/176: dwrite d1/d8/f12 [4194304,4194304] 0 2024-09-13T21:40:20.260 INFO:tasks.workunit.client.0.smithi088.stdout:7/175: truncate d6/f18 685092 0 2024-09-13T21:40:20.261 INFO:tasks.workunit.client.0.smithi088.stdout:7/176: write d6/da/d1a/f33 [585788,100810] 0 2024-09-13T21:40:20.264 INFO:tasks.workunit.client.0.smithi088.stdout:5/204: rmdir d4/d1c 39 2024-09-13T21:40:20.265 INFO:tasks.workunit.client.0.smithi088.stdout:9/178: write f9 [4186723,74728] 0 2024-09-13T21:40:20.266 INFO:tasks.workunit.client.0.smithi088.stdout:9/179: dread d1a/f31 [0,4194304] 0 2024-09-13T21:40:20.269 INFO:tasks.workunit.client.0.smithi088.stdout:1/246: rename d9/c30 to d9/d4f/c5d 0 2024-09-13T21:40:20.271 INFO:tasks.workunit.client.0.smithi088.stdout:6/201: mkdir d0/d2c/d32/d39/d3f 0 2024-09-13T21:40:20.271 INFO:tasks.workunit.client.0.smithi088.stdout:6/202: creat d0/d28/f40 x:0 0 0 2024-09-13T21:40:20.276 INFO:tasks.workunit.client.0.smithi088.stdout:7/177: symlink d6/da/d1a/l3b 0 2024-09-13T21:40:20.276 INFO:tasks.workunit.client.0.smithi088.stdout:7/178: chown d6/da/d1a/f2b 36 1 2024-09-13T21:40:20.276 INFO:tasks.workunit.client.0.smithi088.stdout:2/177: dwrite d1/fb [0,4194304] 0 2024-09-13T21:40:20.278 INFO:tasks.workunit.client.0.smithi088.stdout:9/180: mkdir d1a/d34 0 2024-09-13T21:40:20.278 INFO:tasks.workunit.client.0.smithi088.stdout:9/181: creat d1a/d1b/f35 x:0 0 0 2024-09-13T21:40:20.278 INFO:tasks.workunit.client.0.smithi088.stdout:9/182: dread - d1a/d1b/f35 zero size 2024-09-13T21:40:20.282 INFO:tasks.workunit.client.0.smithi088.stdout:1/247: truncate d9/fd 1921171 0 2024-09-13T21:40:20.282 INFO:tasks.workunit.client.0.smithi088.stdout:1/248: chown d9/d10/f11 1463072 1 2024-09-13T21:40:20.284 INFO:tasks.workunit.client.0.smithi088.stdout:2/178: write d1/d8/fc [3567459,43697] 0 2024-09-13T21:40:20.284 INFO:tasks.workunit.client.0.smithi088.stdout:2/179: dread - d1/d8/d2e/f2d zero size 2024-09-13T21:40:20.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/203: stat d0/d28/c3c 0 2024-09-13T21:40:20.285 INFO:tasks.workunit.client.0.smithi088.stdout:7/179: mkdir d6/da/d39/d3c 0 2024-09-13T21:40:20.287 INFO:tasks.workunit.client.0.smithi088.stdout:9/183: mknod d1a/d1b/c36 0 2024-09-13T21:40:20.291 INFO:tasks.workunit.client.0.smithi088.stdout:6/204: read d0/f22 [1256355,102362] 0 2024-09-13T21:40:20.291 INFO:tasks.workunit.client.0.smithi088.stdout:1/249: link d9/d10/d2a/d4b/c45 d9/d10/d2a/d4b/d39/d43/c5e 0 2024-09-13T21:40:20.293 INFO:tasks.workunit.client.0.smithi088.stdout:2/180: mkdir d1/d13/d2a/d3c 0 2024-09-13T21:40:20.294 INFO:tasks.workunit.client.0.smithi088.stdout:7/180: symlink d6/da/d39/d3c/l3d 0 2024-09-13T21:40:20.294 INFO:tasks.workunit.client.0.smithi088.stdout:4/159: fsync d2/d9/de/d12/f34 0 2024-09-13T21:40:20.296 INFO:tasks.workunit.client.0.smithi088.stdout:9/184: dread f9 [0,4194304] 0 2024-09-13T21:40:20.297 INFO:tasks.workunit.client.0.smithi088.stdout:5/205: rename d4/d18 to d4/d1c/d24/d26/d40 0 2024-09-13T21:40:20.297 INFO:tasks.workunit.client.0.smithi088.stdout:5/206: write d4/d1c/d24/f39 [1039102,46495] 0 2024-09-13T21:40:20.298 INFO:tasks.workunit.client.0.smithi088.stdout:6/205: truncate d0/f16 3555653 0 2024-09-13T21:40:20.301 INFO:tasks.workunit.client.0.smithi088.stdout:9/185: dread f13 [0,4194304] 0 2024-09-13T21:40:20.301 INFO:tasks.workunit.client.0.smithi088.stdout:9/186: read - d1a/f24 zero size 2024-09-13T21:40:20.302 INFO:tasks.workunit.client.0.smithi088.stdout:2/181: mknod d1/d13/d2a/d3c/c3d 0 2024-09-13T21:40:20.303 INFO:tasks.workunit.client.0.smithi088.stdout:4/160: mknod d2/d9/de/d12/c35 0 2024-09-13T21:40:20.306 INFO:tasks.workunit.client.0.smithi088.stdout:5/207: unlink d4/f7 0 2024-09-13T21:40:20.308 INFO:tasks.workunit.client.0.smithi088.stdout:6/206: unlink d0/db/l21 0 2024-09-13T21:40:20.308 INFO:tasks.workunit.client.0.smithi088.stdout:6/207: read d0/db/f12 [1507051,75174] 0 2024-09-13T21:40:20.311 INFO:tasks.workunit.client.0.smithi088.stdout:9/187: rename d1a/f21 to d1a/d1b/f37 0 2024-09-13T21:40:20.311 INFO:tasks.workunit.client.0.smithi088.stdout:9/188: chown f15 116333 1 2024-09-13T21:40:20.311 INFO:tasks.workunit.client.0.smithi088.stdout:9/189: truncate d1a/f30 813603 0 2024-09-13T21:40:20.312 INFO:tasks.workunit.client.0.smithi088.stdout:2/182: mknod d1/d13/d2a/d3c/c3e 0 2024-09-13T21:40:20.313 INFO:tasks.workunit.client.0.smithi088.stdout:4/161: symlink d2/d9/d19/l36 0 2024-09-13T21:40:20.315 INFO:tasks.workunit.client.0.smithi088.stdout:5/208: unlink d4/d1c/l1d 0 2024-09-13T21:40:20.318 INFO:tasks.workunit.client.0.smithi088.stdout:2/183: mkdir d1/d13/d3f 0 2024-09-13T21:40:20.318 INFO:tasks.workunit.client.0.smithi088.stdout:2/184: chown d1/cf 5435800 1 2024-09-13T21:40:20.322 INFO:tasks.workunit.client.0.smithi088.stdout:2/185: mkdir d1/d8/d16/d40 0 2024-09-13T21:40:20.322 INFO:tasks.workunit.client.0.smithi088.stdout:7/181: dwrite d6/da/d1a/f24 [0,4194304] 0 2024-09-13T21:40:20.322 INFO:tasks.workunit.client.0.smithi088.stdout:7/182: chown d6/da/f10 4 1 2024-09-13T21:40:20.322 INFO:tasks.workunit.client.0.smithi088.stdout:7/183: write d6/da/f31 [477245,129564] 0 2024-09-13T21:40:20.322 INFO:tasks.workunit.client.0.smithi088.stdout:7/184: read d6/f22 [108955,54106] 0 2024-09-13T21:40:20.324 INFO:tasks.workunit.client.0.smithi088.stdout:2/186: unlink d1/d8/d16/l1c 0 2024-09-13T21:40:20.324 INFO:tasks.workunit.client.0.smithi088.stdout:6/208: dread d0/ff [0,4194304] 0 2024-09-13T21:40:20.327 INFO:tasks.workunit.client.0.smithi088.stdout:2/187: mkdir d1/d13/d2a/d41 0 2024-09-13T21:40:20.327 INFO:tasks.workunit.client.0.smithi088.stdout:4/162: dread d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:20.328 INFO:tasks.workunit.client.0.smithi088.stdout:1/250: dwrite d9/dc/f1f [0,4194304] 0 2024-09-13T21:40:20.329 INFO:tasks.workunit.client.0.smithi088.stdout:2/188: rename d1/l5 to d1/d13/d2a/d41/l42 0 2024-09-13T21:40:20.332 INFO:tasks.workunit.client.0.smithi088.stdout:4/163: creat d2/d9/de/d1e/f37 x:0 0 0 2024-09-13T21:40:20.333 INFO:tasks.workunit.client.0.smithi088.stdout:9/190: dwrite d1a/d1b/f37 [0,4194304] 0 2024-09-13T21:40:20.334 INFO:tasks.workunit.client.0.smithi088.stdout:9/191: creat d1a/d1b/f38 x:0 0 0 2024-09-13T21:40:20.334 INFO:tasks.workunit.client.0.smithi088.stdout:1/251: symlink d9/l5f 0 2024-09-13T21:40:20.336 INFO:tasks.workunit.client.0.smithi088.stdout:7/185: write d6/da/f19 [2434887,53713] 0 2024-09-13T21:40:20.336 INFO:tasks.workunit.client.0.smithi088.stdout:6/209: write d0/db/f12 [8204406,96600] 0 2024-09-13T21:40:20.336 INFO:tasks.workunit.client.0.smithi088.stdout:6/210: write d0/db/f12 [6350241,89533] 0 2024-09-13T21:40:20.342 INFO:tasks.workunit.client.0.smithi088.stdout:4/164: symlink d2/d11/l38 0 2024-09-13T21:40:20.342 INFO:tasks.workunit.client.0.smithi088.stdout:4/165: chown d2/l4 421144090 1 2024-09-13T21:40:20.342 INFO:tasks.workunit.client.0.smithi088.stdout:4/166: write d2/d9/de/f28 [2630583,120580] 0 2024-09-13T21:40:20.342 INFO:tasks.workunit.client.0.smithi088.stdout:1/252: dread d9/d10/d2a/d4b/d39/f40 [4194304,4194304] 0 2024-09-13T21:40:20.342 INFO:tasks.workunit.client.0.smithi088.stdout:1/253: write d9/d10/f3f [973368,4574] 0 2024-09-13T21:40:20.343 INFO:tasks.workunit.client.0.smithi088.stdout:1/254: creat d9/f60 x:0 0 0 2024-09-13T21:40:20.349 INFO:tasks.workunit.client.0.smithi088.stdout:9/192: mknod d1a/c39 0 2024-09-13T21:40:20.350 INFO:tasks.workunit.client.0.smithi088.stdout:9/193: creat d1a/f3a x:0 0 0 2024-09-13T21:40:20.352 INFO:tasks.workunit.client.0.smithi088.stdout:2/189: getdents d1/d13 0 2024-09-13T21:40:20.352 INFO:tasks.workunit.client.0.smithi088.stdout:2/190: chown d1/d8/d2e/d3b 5105940 1 2024-09-13T21:40:20.353 INFO:tasks.workunit.client.0.smithi088.stdout:2/191: write d1/d8/fe [5048656,45852] 0 2024-09-13T21:40:20.353 INFO:tasks.workunit.client.0.smithi088.stdout:2/192: fdatasync d1/fb 0 2024-09-13T21:40:20.353 INFO:tasks.workunit.client.0.smithi088.stdout:2/193: chown d1/d13/d2a 35714 1 2024-09-13T21:40:20.353 INFO:tasks.workunit.client.0.smithi088.stdout:2/194: stat d1/d13/d2a/d41 0 2024-09-13T21:40:20.354 INFO:tasks.workunit.client.0.smithi088.stdout:7/186: mknod d6/da/d39/d3c/c3e 0 2024-09-13T21:40:20.356 INFO:tasks.workunit.client.0.smithi088.stdout:6/211: mknod d0/d2c/d32/d39/c41 0 2024-09-13T21:40:20.356 INFO:tasks.workunit.client.0.smithi088.stdout:6/212: chown d0/f22 14029 1 2024-09-13T21:40:20.358 INFO:tasks.workunit.client.0.smithi088.stdout:4/167: unlink d2/d9/d19/c27 0 2024-09-13T21:40:20.358 INFO:tasks.workunit.client.0.smithi088.stdout:4/168: readlink d2/d5/l2c 0 2024-09-13T21:40:20.360 INFO:tasks.workunit.client.0.smithi088.stdout:1/255: mkdir d9/d10/d2a/d4b/d61 0 2024-09-13T21:40:20.360 INFO:tasks.workunit.client.0.smithi088.stdout:1/256: write d9/d10/d2a/d4b/d33/f3d [1783977,76005] 0 2024-09-13T21:40:20.362 INFO:tasks.workunit.client.0.smithi088.stdout:6/213: dread d0/f33 [0,4194304] 0 2024-09-13T21:40:20.362 INFO:tasks.workunit.client.0.smithi088.stdout:6/214: fdatasync d0/d28/f40 0 2024-09-13T21:40:20.363 INFO:tasks.workunit.client.0.smithi088.stdout:9/194: unlink ca 0 2024-09-13T21:40:20.366 INFO:tasks.workunit.client.0.smithi088.stdout:2/195: creat d1/d13/d3f/f43 x:0 0 0 2024-09-13T21:40:20.368 INFO:tasks.workunit.client.0.smithi088.stdout:7/187: creat d6/da/d1a/d3a/f3f x:0 0 0 2024-09-13T21:40:20.368 INFO:tasks.workunit.client.0.smithi088.stdout:7/188: truncate d6/da/d1a/f33 972442 0 2024-09-13T21:40:20.371 INFO:tasks.workunit.client.0.smithi088.stdout:1/257: creat d9/d4f/f62 x:0 0 0 2024-09-13T21:40:20.371 INFO:tasks.workunit.client.0.smithi088.stdout:1/258: dread - d9/f60 zero size 2024-09-13T21:40:20.374 INFO:tasks.workunit.client.0.smithi088.stdout:2/196: unlink d1/l9 0 2024-09-13T21:40:20.375 INFO:tasks.workunit.client.0.smithi088.stdout:2/197: dread d1/d8/d16/f23 [0,4194304] 0 2024-09-13T21:40:20.375 INFO:tasks.workunit.client.0.smithi088.stdout:7/189: symlink d6/da/d39/d3c/l40 0 2024-09-13T21:40:20.376 INFO:tasks.workunit.client.0.smithi088.stdout:7/190: write d6/da/f31 [403384,74695] 0 2024-09-13T21:40:20.380 INFO:tasks.workunit.client.0.smithi088.stdout:2/198: mkdir d1/d8/d2e/d44 0 2024-09-13T21:40:20.380 INFO:tasks.workunit.client.0.smithi088.stdout:2/199: truncate d1/fd 1554896 0 2024-09-13T21:40:20.380 INFO:tasks.workunit.client.0.smithi088.stdout:2/200: chown d1/f34 119 1 2024-09-13T21:40:20.380 INFO:tasks.workunit.client.0.smithi088.stdout:2/201: fdatasync d1/d8/d24/f25 0 2024-09-13T21:40:20.382 INFO:tasks.workunit.client.0.smithi088.stdout:7/191: rename d6/f1b to d6/da/d39/d3c/f41 0 2024-09-13T21:40:20.382 INFO:tasks.workunit.client.0.smithi088.stdout:2/202: rename d1 to d1/d13/d45 22 2024-09-13T21:40:20.383 INFO:tasks.workunit.client.0.smithi088.stdout:2/203: chown d1/f15 402102 1 2024-09-13T21:40:20.384 INFO:tasks.workunit.client.0.smithi088.stdout:7/192: creat d6/f42 x:0 0 0 2024-09-13T21:40:20.385 INFO:tasks.workunit.client.0.smithi088.stdout:2/204: mknod d1/d8/d2e/d3b/c46 0 2024-09-13T21:40:20.385 INFO:tasks.workunit.client.0.smithi088.stdout:2/205: fsync d1/f4 0 2024-09-13T21:40:20.386 INFO:tasks.workunit.client.0.smithi088.stdout:8/174: sync 2024-09-13T21:40:20.386 INFO:tasks.workunit.client.0.smithi088.stdout:3/209: sync 2024-09-13T21:40:20.386 INFO:tasks.workunit.client.0.smithi088.stdout:7/193: rename d6/da/d1a/f29 to d6/da/d1a/f43 0 2024-09-13T21:40:20.391 INFO:tasks.workunit.client.0.smithi088.stdout:9/195: dwrite d1a/d1b/f37 [0,4194304] 0 2024-09-13T21:40:20.392 INFO:tasks.workunit.client.0.smithi088.stdout:9/196: truncate d1a/f24 992526 0 2024-09-13T21:40:20.392 INFO:tasks.workunit.client.0.smithi088.stdout:9/197: dread - d1a/f1c zero size 2024-09-13T21:40:20.392 INFO:tasks.workunit.client.0.smithi088.stdout:9/198: write d1a/f31 [987346,30011] 0 2024-09-13T21:40:20.395 INFO:tasks.workunit.client.0.smithi088.stdout:2/206: dread d1/f4 [0,4194304] 0 2024-09-13T21:40:20.395 INFO:tasks.workunit.client.0.smithi088.stdout:2/207: truncate d1/d8/d2e/f38 5124158 0 2024-09-13T21:40:20.395 INFO:tasks.workunit.client.0.smithi088.stdout:6/215: dwrite d0/db/f2e [0,4194304] 0 2024-09-13T21:40:20.395 INFO:tasks.workunit.client.0.smithi088.stdout:2/208: creat d1/d8/f47 x:0 0 0 2024-09-13T21:40:20.395 INFO:tasks.workunit.client.0.smithi088.stdout:2/209: chown d1/d8/l20 23 1 2024-09-13T21:40:20.395 INFO:tasks.workunit.client.0.smithi088.stdout:2/210: chown d1/d8/d2e/d44 1370061262 1 2024-09-13T21:40:20.399 INFO:tasks.workunit.client.0.smithi088.stdout:6/216: dread d0/f22 [0,4194304] 0 2024-09-13T21:40:20.399 INFO:tasks.workunit.client.0.smithi088.stdout:6/217: fdatasync d0/d28/f35 0 2024-09-13T21:40:20.399 INFO:tasks.workunit.client.0.smithi088.stdout:6/218: readlink d0/l20 0 2024-09-13T21:40:20.403 INFO:tasks.workunit.client.0.smithi088.stdout:1/259: getdents d9/d4f 0 2024-09-13T21:40:20.405 INFO:tasks.workunit.client.0.smithi088.stdout:7/194: dwrite d6/da/d1a/f43 [0,4194304] 0 2024-09-13T21:40:20.406 INFO:tasks.workunit.client.0.smithi088.stdout:4/169: truncate d2/d9/de/d1e/f26 2162502 0 2024-09-13T21:40:20.412 INFO:tasks.workunit.client.0.smithi088.stdout:1/260: write d9/dc/f1f [2546671,32933] 0 2024-09-13T21:40:20.415 INFO:tasks.workunit.client.0.smithi088.stdout:2/211: mkdir d1/d13/d2a/d41/d48 0 2024-09-13T21:40:20.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/219: symlink d0/d2c/d32/d39/l42 0 2024-09-13T21:40:20.422 INFO:tasks.workunit.client.0.smithi088.stdout:7/195: dwrite d6/f18 [0,4194304] 0 2024-09-13T21:40:20.428 INFO:tasks.workunit.client.0.smithi088.stdout:1/261: chown d9/dc/l26 5166 1 2024-09-13T21:40:20.430 INFO:tasks.workunit.client.0.smithi088.stdout:2/212: link d1/l1f d1/d8/l49 0 2024-09-13T21:40:20.436 INFO:tasks.workunit.client.0.smithi088.stdout:7/196: mkdir d6/da/d44 0 2024-09-13T21:40:20.436 INFO:tasks.workunit.client.0.smithi088.stdout:7/197: readlink d6/da/d39/d3c/l3d 0 2024-09-13T21:40:20.436 INFO:tasks.workunit.client.0.smithi088.stdout:6/220: dwrite d0/db/f12 [4194304,4194304] 0 2024-09-13T21:40:20.436 INFO:tasks.workunit.client.0.smithi088.stdout:6/221: truncate d0/ff 5061628 0 2024-09-13T21:40:20.436 INFO:tasks.workunit.client.0.smithi088.stdout:6/222: stat d0/ff 0 2024-09-13T21:40:20.437 INFO:tasks.workunit.client.0.smithi088.stdout:4/170: mknod d2/d9/de/d12/c39 0 2024-09-13T21:40:20.441 INFO:tasks.workunit.client.0.smithi088.stdout:1/262: link d9/d10/d2a/l3e d9/d10/d2a/d4b/d39/l63 0 2024-09-13T21:40:20.442 INFO:tasks.workunit.client.0.smithi088.stdout:2/213: mkdir d1/d13/d2a/d3c/d4a 0 2024-09-13T21:40:20.443 INFO:tasks.workunit.client.0.smithi088.stdout:2/214: fdatasync d1/fd 0 2024-09-13T21:40:20.444 INFO:tasks.workunit.client.0.smithi088.stdout:7/198: truncate d6/da/d1a/f2d 221686 0 2024-09-13T21:40:20.444 INFO:tasks.workunit.client.0.smithi088.stdout:7/199: chown d6/da/l34 0 1 2024-09-13T21:40:20.447 INFO:tasks.workunit.client.0.smithi088.stdout:1/263: mkdir d9/d4f/d64 0 2024-09-13T21:40:20.447 INFO:tasks.workunit.client.0.smithi088.stdout:1/264: write f1 [3334706,124095] 0 2024-09-13T21:40:20.449 INFO:tasks.workunit.client.0.smithi088.stdout:7/200: truncate d6/da/f10 7382526 0 2024-09-13T21:40:20.452 INFO:tasks.workunit.client.0.smithi088.stdout:1/265: link d9/d10/d2a/d4b/f21 d9/d10/d2a/d4b/f65 0 2024-09-13T21:40:20.452 INFO:tasks.workunit.client.0.smithi088.stdout:1/266: truncate d9/d10/d2a/d47/f50 5100470 0 2024-09-13T21:40:20.453 INFO:tasks.workunit.client.0.smithi088.stdout:7/201: mkdir d6/da/d39/d45 0 2024-09-13T21:40:20.454 INFO:tasks.workunit.client.0.smithi088.stdout:1/267: unlink d9/d10/d2a/d4b/d3a/f58 0 2024-09-13T21:40:20.456 INFO:tasks.workunit.client.0.smithi088.stdout:2/215: dread d1/d8/d2e/f38 [0,4194304] 0 2024-09-13T21:40:20.458 INFO:tasks.workunit.client.0.smithi088.stdout:2/216: getdents d1/d8/d2e/d3b 0 2024-09-13T21:40:20.459 INFO:tasks.workunit.client.0.smithi088.stdout:2/217: creat d1/d13/d2a/d3c/f4b x:0 0 0 2024-09-13T21:40:20.460 INFO:tasks.workunit.client.0.smithi088.stdout:4/171: dwrite d2/d9/de/d1e/f37 [0,4194304] 0 2024-09-13T21:40:20.462 INFO:tasks.workunit.client.0.smithi088.stdout:0/199: sync 2024-09-13T21:40:20.462 INFO:tasks.workunit.client.0.smithi088.stdout:5/209: sync 2024-09-13T21:40:20.466 INFO:tasks.workunit.client.0.smithi088.stdout:0/200: creat d7/d2c/f48 x:0 0 0 2024-09-13T21:40:20.467 INFO:tasks.workunit.client.0.smithi088.stdout:5/210: creat d4/d1c/d24/f41 x:0 0 0 2024-09-13T21:40:20.467 INFO:tasks.workunit.client.0.smithi088.stdout:7/202: read d6/da/f10 [3018038,69327] 0 2024-09-13T21:40:20.472 INFO:tasks.workunit.client.0.smithi088.stdout:5/211: link d4/d1c/d24/f41 d4/d1c/f42 0 2024-09-13T21:40:20.472 INFO:tasks.workunit.client.0.smithi088.stdout:7/203: unlink d6/cf 0 2024-09-13T21:40:20.472 INFO:tasks.workunit.client.0.smithi088.stdout:5/212: stat d4/d1c/d24/f35 0 2024-09-13T21:40:20.474 INFO:tasks.workunit.client.0.smithi088.stdout:5/213: creat d4/d1b/f43 x:0 0 0 2024-09-13T21:40:20.474 INFO:tasks.workunit.client.0.smithi088.stdout:5/214: dread - d4/d1b/d2a/f3b zero size 2024-09-13T21:40:20.475 INFO:tasks.workunit.client.0.smithi088.stdout:7/204: creat d6/da/f46 x:0 0 0 2024-09-13T21:40:20.480 INFO:tasks.workunit.client.0.smithi088.stdout:0/201: dread d7/f12 [0,4194304] 0 2024-09-13T21:40:20.483 INFO:tasks.workunit.client.0.smithi088.stdout:0/202: mknod d7/d2c/d30/c49 0 2024-09-13T21:40:20.485 INFO:tasks.workunit.client.0.smithi088.stdout:2/218: dwrite d1/d13/d2a/f3a [0,4194304] 0 2024-09-13T21:40:20.485 INFO:tasks.workunit.client.0.smithi088.stdout:1/268: dwrite d9/d10/d2a/d4b/f65 [0,4194304] 0 2024-09-13T21:40:20.485 INFO:tasks.workunit.client.0.smithi088.stdout:0/203: mknod d7/d1d/d26/d34/c4a 0 2024-09-13T21:40:20.490 INFO:tasks.workunit.client.0.smithi088.stdout:2/219: rename d1/d13/d2a/f3a to d1/d8/d24/f4c 0 2024-09-13T21:40:20.490 INFO:tasks.workunit.client.0.smithi088.stdout:2/220: fsync d1/d13/d2a/f2b 0 2024-09-13T21:40:20.490 INFO:tasks.workunit.client.0.smithi088.stdout:4/172: dwrite d2/d9/de/f28 [0,4194304] 0 2024-09-13T21:40:20.490 INFO:tasks.workunit.client.0.smithi088.stdout:4/173: truncate d2/d9/de/d12/f34 129036 0 2024-09-13T21:40:20.492 INFO:tasks.workunit.client.0.smithi088.stdout:0/204: mkdir d7/d2c/d30/d31/d42/d4b 0 2024-09-13T21:40:20.492 INFO:tasks.workunit.client.0.smithi088.stdout:0/205: read d7/f12 [599134,49179] 0 2024-09-13T21:40:20.493 INFO:tasks.workunit.client.0.smithi088.stdout:5/215: getdents d4/d1c/d24 0 2024-09-13T21:40:20.493 INFO:tasks.workunit.client.0.smithi088.stdout:5/216: write d4/d1c/d24/d26/d40/f11 [633162,64769] 0 2024-09-13T21:40:20.494 INFO:tasks.workunit.client.0.smithi088.stdout:4/174: dread d2/f15 [0,4194304] 0 2024-09-13T21:40:20.496 INFO:tasks.workunit.client.0.smithi088.stdout:2/221: truncate d1/d8/d2e/f2d 956798 0 2024-09-13T21:40:20.500 INFO:tasks.workunit.client.0.smithi088.stdout:7/205: rmdir d6/da 39 2024-09-13T21:40:20.500 INFO:tasks.workunit.client.0.smithi088.stdout:7/206: chown c0 0 1 2024-09-13T21:40:20.501 INFO:tasks.workunit.client.0.smithi088.stdout:4/175: dread - d2/d9/de/f32 zero size 2024-09-13T21:40:20.503 INFO:tasks.workunit.client.0.smithi088.stdout:2/222: rmdir d1/d13 39 2024-09-13T21:40:20.503 INFO:tasks.workunit.client.0.smithi088.stdout:2/223: chown d1/d13/d2a 31441014 1 2024-09-13T21:40:20.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/176: read d2/d11/f16 [4090748,79904] 0 2024-09-13T21:40:20.506 INFO:tasks.workunit.client.0.smithi088.stdout:7/207: symlink d6/da/d44/l47 0 2024-09-13T21:40:20.507 INFO:tasks.workunit.client.0.smithi088.stdout:2/224: unlink d1/d13/d2a/d3c/f4b 0 2024-09-13T21:40:20.508 INFO:tasks.workunit.client.0.smithi088.stdout:2/225: rename d1/d8 to d1/d8/d16/d4d 22 2024-09-13T21:40:20.508 INFO:tasks.workunit.client.0.smithi088.stdout:2/226: truncate d1/d8/d24/f25 189430 0 2024-09-13T21:40:20.510 INFO:tasks.workunit.client.0.smithi088.stdout:4/177: unlink d2/d5/l1c 0 2024-09-13T21:40:20.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/206: rmdir d7/d1d 39 2024-09-13T21:40:20.510 INFO:tasks.workunit.client.0.smithi088.stdout:0/207: readlink l2 0 2024-09-13T21:40:20.512 INFO:tasks.workunit.client.0.smithi088.stdout:2/227: mkdir d1/d13/d2a/d3c/d4e 0 2024-09-13T21:40:20.513 INFO:tasks.workunit.client.0.smithi088.stdout:4/178: mknod d2/d11/c3a 0 2024-09-13T21:40:20.513 INFO:tasks.workunit.client.0.smithi088.stdout:4/179: dread - d2/d9/de/f32 zero size 2024-09-13T21:40:20.515 INFO:tasks.workunit.client.0.smithi088.stdout:0/208: creat d7/d1d/d21/f4c x:0 0 0 2024-09-13T21:40:20.517 INFO:tasks.workunit.client.0.smithi088.stdout:2/228: link d1/d13/d3f/f43 d1/d8/f4f 0 2024-09-13T21:40:20.517 INFO:tasks.workunit.client.0.smithi088.stdout:2/229: readlink d1/l18 0 2024-09-13T21:40:20.517 INFO:tasks.workunit.client.0.smithi088.stdout:2/230: truncate d1/d8/d2e/f2d 1686736 0 2024-09-13T21:40:20.517 INFO:tasks.workunit.client.0.smithi088.stdout:2/231: read d1/d8/d16/f23 [60474,69360] 0 2024-09-13T21:40:20.518 INFO:tasks.workunit.client.0.smithi088.stdout:0/209: symlink d7/d2c/l4d 0 2024-09-13T21:40:20.518 INFO:tasks.workunit.client.0.smithi088.stdout:0/210: stat d7/d2c/l4d 0 2024-09-13T21:40:20.518 INFO:tasks.workunit.client.0.smithi088.stdout:0/211: rename d7/d1d to d7/d1d/d4e 22 2024-09-13T21:40:20.518 INFO:tasks.workunit.client.0.smithi088.stdout:7/208: dread d6/da/d1a/f2b [0,4194304] 0 2024-09-13T21:40:20.519 INFO:tasks.workunit.client.0.smithi088.stdout:1/269: dwrite d9/dc/f35 [0,4194304] 0 2024-09-13T21:40:20.519 INFO:tasks.workunit.client.0.smithi088.stdout:5/217: dwrite d4/d1c/f3e [0,4194304] 0 2024-09-13T21:40:20.519 INFO:tasks.workunit.client.0.smithi088.stdout:5/218: chown d4/d1b/l37 13233203 1 2024-09-13T21:40:20.519 INFO:tasks.workunit.client.0.smithi088.stdout:0/212: creat d7/d1d/d26/d34/f4f x:0 0 0 2024-09-13T21:40:20.520 INFO:tasks.workunit.client.0.smithi088.stdout:0/213: dread - d7/d2c/d30/f35 zero size 2024-09-13T21:40:20.520 INFO:tasks.workunit.client.0.smithi088.stdout:7/209: creat d6/da/d39/d3c/f48 x:0 0 0 2024-09-13T21:40:20.520 INFO:tasks.workunit.client.0.smithi088.stdout:7/210: chown d6/l7 18841729 1 2024-09-13T21:40:20.521 INFO:tasks.workunit.client.0.smithi088.stdout:2/232: symlink d1/d8/d2e/d44/l50 0 2024-09-13T21:40:20.524 INFO:tasks.workunit.client.0.smithi088.stdout:5/219: symlink d4/d1c/d24/d26/d40/l44 0 2024-09-13T21:40:20.525 INFO:tasks.workunit.client.0.smithi088.stdout:0/214: symlink d7/d1d/d27/d43/l50 0 2024-09-13T21:40:20.525 INFO:tasks.workunit.client.0.smithi088.stdout:0/215: rename d7/d1d to d7/d1d/d21/d51 22 2024-09-13T21:40:20.526 INFO:tasks.workunit.client.0.smithi088.stdout:4/180: write d2/d9/de/d1e/f26 [3732959,22040] 0 2024-09-13T21:40:20.526 INFO:tasks.workunit.client.0.smithi088.stdout:4/181: readlink d2/d9/l22 0 2024-09-13T21:40:20.526 INFO:tasks.workunit.client.0.smithi088.stdout:7/211: link d6/l13 d6/da/d1a/l49 0 2024-09-13T21:40:20.527 INFO:tasks.workunit.client.0.smithi088.stdout:2/233: mknod d1/d13/c51 0 2024-09-13T21:40:20.527 INFO:tasks.workunit.client.0.smithi088.stdout:2/234: readlink d1/d8/l20 0 2024-09-13T21:40:20.527 INFO:tasks.workunit.client.0.smithi088.stdout:2/235: getdents d1/d8/d2e/d3b 0 2024-09-13T21:40:20.529 INFO:tasks.workunit.client.0.smithi088.stdout:1/270: symlink d9/dc/d52/l66 0 2024-09-13T21:40:20.533 INFO:tasks.workunit.client.0.smithi088.stdout:5/220: creat d4/d1c/f45 x:0 0 0 2024-09-13T21:40:20.533 INFO:tasks.workunit.client.0.smithi088.stdout:0/216: dread d7/d1d/d27/d43/f1c [0,4194304] 0 2024-09-13T21:40:20.533 INFO:tasks.workunit.client.0.smithi088.stdout:0/217: chown d7/d2c/f2e 2674 1 2024-09-13T21:40:20.534 INFO:tasks.workunit.client.0.smithi088.stdout:4/182: creat d2/d9/de/d1e/d31/f3b x:0 0 0 2024-09-13T21:40:20.536 INFO:tasks.workunit.client.0.smithi088.stdout:2/236: mknod d1/d13/d2a/d3c/d4a/c52 0 2024-09-13T21:40:20.537 INFO:tasks.workunit.client.0.smithi088.stdout:7/212: write d6/f18 [2759769,102219] 0 2024-09-13T21:40:20.537 INFO:tasks.workunit.client.0.smithi088.stdout:7/213: stat d6/f18 0 2024-09-13T21:40:20.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/218: link d7/d1d/d26/d34/c4a d7/d1d/d21/c52 0 2024-09-13T21:40:20.545 INFO:tasks.workunit.client.0.smithi088.stdout:0/219: write d7/f12 [324408,12392] 0 2024-09-13T21:40:20.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/183: mkdir d2/d9/de/d1e/d23/d3c 0 2024-09-13T21:40:20.549 INFO:tasks.workunit.client.0.smithi088.stdout:5/221: dwrite d4/f1f [0,4194304] 0 2024-09-13T21:40:20.549 INFO:tasks.workunit.client.0.smithi088.stdout:0/220: creat d7/d1d/d27/d43/f53 x:0 0 0 2024-09-13T21:40:20.549 INFO:tasks.workunit.client.0.smithi088.stdout:0/221: chown d7/d1a/c25 61359 1 2024-09-13T21:40:20.550 INFO:tasks.workunit.client.0.smithi088.stdout:4/184: creat d2/d9/de/d1e/d23/f3d x:0 0 0 2024-09-13T21:40:20.553 INFO:tasks.workunit.client.0.smithi088.stdout:5/222: creat d4/d1c/d24/d26/d40/f46 x:0 0 0 2024-09-13T21:40:20.554 INFO:tasks.workunit.client.0.smithi088.stdout:4/185: creat d2/d5/d2d/f3e x:0 0 0 2024-09-13T21:40:20.555 INFO:tasks.workunit.client.0.smithi088.stdout:5/223: rename d4/d1b/l25 to d4/d1c/d24/d26/l47 0 2024-09-13T21:40:20.556 INFO:tasks.workunit.client.0.smithi088.stdout:4/186: creat d2/d9/d19/f3f x:0 0 0 2024-09-13T21:40:20.557 INFO:tasks.workunit.client.0.smithi088.stdout:5/224: truncate d4/d1c/f3e 4080853 0 2024-09-13T21:40:20.558 INFO:tasks.workunit.client.0.smithi088.stdout:0/222: dread d7/d1d/d27/d43/f17 [0,4194304] 0 2024-09-13T21:40:20.558 INFO:tasks.workunit.client.0.smithi088.stdout:0/223: stat d7/d1d/d27/d43/l50 0 2024-09-13T21:40:20.559 INFO:tasks.workunit.client.0.smithi088.stdout:4/187: unlink d2/d9/de/d12/c39 0 2024-09-13T21:40:20.559 INFO:tasks.workunit.client.0.smithi088.stdout:4/188: chown d2/d9/de/f28 29 1 2024-09-13T21:40:20.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/225: link d4/d1c/d24/f35 d4/d1c/f48 0 2024-09-13T21:40:20.561 INFO:tasks.workunit.client.0.smithi088.stdout:5/226: truncate d4/d1c/f45 235637 0 2024-09-13T21:40:20.562 INFO:tasks.workunit.client.0.smithi088.stdout:4/189: getdents d2/d5/d20 0 2024-09-13T21:40:20.562 INFO:tasks.workunit.client.0.smithi088.stdout:4/190: chown d2/d9/d19/l21 10 1 2024-09-13T21:40:20.564 INFO:tasks.workunit.client.0.smithi088.stdout:6/223: sync 2024-09-13T21:40:20.564 INFO:tasks.workunit.client.0.smithi088.stdout:8/175: sync 2024-09-13T21:40:20.565 INFO:tasks.workunit.client.0.smithi088.stdout:9/199: sync 2024-09-13T21:40:20.565 INFO:tasks.workunit.client.0.smithi088.stdout:3/210: sync 2024-09-13T21:40:20.565 INFO:tasks.workunit.client.0.smithi088.stdout:6/224: creat d0/db/f43 x:0 0 0 2024-09-13T21:40:20.566 INFO:tasks.workunit.client.0.smithi088.stdout:3/211: rmdir d5/d26 39 2024-09-13T21:40:20.566 INFO:tasks.workunit.client.0.smithi088.stdout:3/212: readlink d5/ld 0 2024-09-13T21:40:20.571 INFO:tasks.workunit.client.0.smithi088.stdout:6/225: link d0/d1e/l25 d0/d1e/l44 0 2024-09-13T21:40:20.571 INFO:tasks.workunit.client.0.smithi088.stdout:6/226: dread - d0/db/f43 zero size 2024-09-13T21:40:20.571 INFO:tasks.workunit.client.0.smithi088.stdout:6/227: write d0/f22 [3611051,73214] 0 2024-09-13T21:40:20.571 INFO:tasks.workunit.client.0.smithi088.stdout:6/228: fsync d0/f6 0 2024-09-13T21:40:20.572 INFO:tasks.workunit.client.0.smithi088.stdout:3/213: mkdir d5/d26/d2d/d48/d49 0 2024-09-13T21:40:20.574 INFO:tasks.workunit.client.0.smithi088.stdout:5/227: write d4/f1f [2331120,91023] 0 2024-09-13T21:40:20.575 INFO:tasks.workunit.client.0.smithi088.stdout:3/214: creat d5/d23/f4a x:0 0 0 2024-09-13T21:40:20.577 INFO:tasks.workunit.client.0.smithi088.stdout:8/176: dread f8 [0,4194304] 0 2024-09-13T21:40:20.578 INFO:tasks.workunit.client.0.smithi088.stdout:3/215: unlink d5/l19 0 2024-09-13T21:40:20.583 INFO:tasks.workunit.client.0.smithi088.stdout:6/229: write d0/db/f2e [1196880,120188] 0 2024-09-13T21:40:20.595 INFO:tasks.workunit.client.0.smithi088.stdout:8/177: dread db/f24 [0,4194304] 0 2024-09-13T21:40:20.595 INFO:tasks.workunit.client.0.smithi088.stdout:8/178: write db/f23 [1143214,80907] 0 2024-09-13T21:40:20.595 INFO:tasks.workunit.client.0.smithi088.stdout:8/179: chown db/df/l22 89741349 1 2024-09-13T21:40:20.597 INFO:tasks.workunit.client.0.smithi088.stdout:8/180: rmdir db 39 2024-09-13T21:40:20.597 INFO:tasks.workunit.client.0.smithi088.stdout:8/181: chown db/df/c1b 244 1 2024-09-13T21:40:20.597 INFO:tasks.workunit.client.0.smithi088.stdout:8/182: write f8 [36666,12377] 0 2024-09-13T21:40:20.597 INFO:tasks.workunit.client.0.smithi088.stdout:4/191: dwrite d2/d9/de/d1e/d31/f3b [0,4194304] 0 2024-09-13T21:40:20.597 INFO:tasks.workunit.client.0.smithi088.stdout:3/216: write d5/f16 [1206559,18186] 0 2024-09-13T21:40:20.598 INFO:tasks.workunit.client.0.smithi088.stdout:4/192: creat d2/d5/d2d/f40 x:0 0 0 2024-09-13T21:40:20.598 INFO:tasks.workunit.client.0.smithi088.stdout:8/183: rmdir db 39 2024-09-13T21:40:20.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/217: mknod d5/d26/c4b 0 2024-09-13T21:40:20.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/218: truncate d5/f6 1091682 0 2024-09-13T21:40:20.600 INFO:tasks.workunit.client.0.smithi088.stdout:4/193: mkdir d2/d5/d20/d41 0 2024-09-13T21:40:20.601 INFO:tasks.workunit.client.0.smithi088.stdout:3/219: dread d5/d14/f2c [0,4194304] 0 2024-09-13T21:40:20.602 INFO:tasks.workunit.client.0.smithi088.stdout:3/220: write d5/d23/f3c [480173,106300] 0 2024-09-13T21:40:20.602 INFO:tasks.workunit.client.0.smithi088.stdout:8/184: symlink db/df/d25/l3f 0 2024-09-13T21:40:20.602 INFO:tasks.workunit.client.0.smithi088.stdout:6/230: dread d0/d1e/f24 [0,4194304] 0 2024-09-13T21:40:20.605 INFO:tasks.workunit.client.0.smithi088.stdout:3/221: creat d5/d26/d43/f4c x:0 0 0 2024-09-13T21:40:20.607 INFO:tasks.workunit.client.0.smithi088.stdout:0/224: dwrite d7/d2c/f48 [0,4194304] 0 2024-09-13T21:40:20.607 INFO:tasks.workunit.client.0.smithi088.stdout:8/185: read db/f23 [125363,80867] 0 2024-09-13T21:40:20.609 INFO:tasks.workunit.client.0.smithi088.stdout:6/231: unlink d0/l1d 0 2024-09-13T21:40:20.609 INFO:tasks.workunit.client.0.smithi088.stdout:6/232: write d0/db/f43 [829480,123989] 0 2024-09-13T21:40:20.609 INFO:tasks.workunit.client.0.smithi088.stdout:6/233: truncate d0/d28/f35 247535 0 2024-09-13T21:40:20.612 INFO:tasks.workunit.client.0.smithi088.stdout:6/234: write d0/f33 [1000507,102200] 0 2024-09-13T21:40:20.615 INFO:tasks.workunit.client.0.smithi088.stdout:0/225: creat d7/d1d/d27/f54 x:0 0 0 2024-09-13T21:40:20.622 INFO:tasks.workunit.client.0.smithi088.stdout:4/194: dwrite d2/d5/d2d/f3e [0,4194304] 0 2024-09-13T21:40:20.633 INFO:tasks.workunit.client.0.smithi088.stdout:4/195: symlink d2/d5/d20/d41/l42 0 2024-09-13T21:40:20.634 INFO:tasks.workunit.client.0.smithi088.stdout:3/222: dwrite d5/f22 [0,4194304] 0 2024-09-13T21:40:20.635 INFO:tasks.workunit.client.0.smithi088.stdout:6/235: getdents d0 0 2024-09-13T21:40:20.635 INFO:tasks.workunit.client.0.smithi088.stdout:6/236: chown d0/f33 386 1 2024-09-13T21:40:20.638 INFO:tasks.workunit.client.0.smithi088.stdout:3/223: link d5/l8 d5/d14/l4d 0 2024-09-13T21:40:20.640 INFO:tasks.workunit.client.0.smithi088.stdout:3/224: creat d5/d26/d2d/d31/f4e x:0 0 0 2024-09-13T21:40:20.641 INFO:tasks.workunit.client.0.smithi088.stdout:6/237: getdents d0/d28 0 2024-09-13T21:40:20.642 INFO:tasks.workunit.client.0.smithi088.stdout:0/226: dwrite d7/f28 [0,4194304] 0 2024-09-13T21:40:20.642 INFO:tasks.workunit.client.0.smithi088.stdout:6/238: write d0/db/f10 [1059020,40287] 0 2024-09-13T21:40:20.642 INFO:tasks.workunit.client.0.smithi088.stdout:8/186: dwrite db/f17 [0,4194304] 0 2024-09-13T21:40:20.643 INFO:tasks.workunit.client.0.smithi088.stdout:3/225: mkdir d5/d23/d2a/d3f/d4f 0 2024-09-13T21:40:20.645 INFO:tasks.workunit.client.0.smithi088.stdout:0/227: link d7/f23 d7/d2c/d44/f55 0 2024-09-13T21:40:20.647 INFO:tasks.workunit.client.0.smithi088.stdout:6/239: mknod d0/db/c45 0 2024-09-13T21:40:20.647 INFO:tasks.workunit.client.0.smithi088.stdout:6/240: read d0/d28/f35 [241742,33152] 0 2024-09-13T21:40:20.649 INFO:tasks.workunit.client.0.smithi088.stdout:8/187: rename db/c1d to db/c40 0 2024-09-13T21:40:20.650 INFO:tasks.workunit.client.0.smithi088.stdout:3/226: creat d5/f50 x:0 0 0 2024-09-13T21:40:20.650 INFO:tasks.workunit.client.0.smithi088.stdout:3/227: write d5/f38 [1000928,128603] 0 2024-09-13T21:40:20.651 INFO:tasks.workunit.client.0.smithi088.stdout:0/228: creat d7/d1d/d26/d45/f56 x:0 0 0 2024-09-13T21:40:20.653 INFO:tasks.workunit.client.0.smithi088.stdout:6/241: rename d0/d1e/l25 to d0/d28/l46 0 2024-09-13T21:40:20.653 INFO:tasks.workunit.client.0.smithi088.stdout:6/242: read d0/d1e/f24 [85625,13366] 0 2024-09-13T21:40:20.653 INFO:tasks.workunit.client.0.smithi088.stdout:6/243: chown d0/d28 0 1 2024-09-13T21:40:20.653 INFO:tasks.workunit.client.0.smithi088.stdout:6/244: write d0/db/f43 [1777179,23468] 0 2024-09-13T21:40:20.654 INFO:tasks.workunit.client.0.smithi088.stdout:8/188: creat db/d26/d37/f41 x:0 0 0 2024-09-13T21:40:20.655 INFO:tasks.workunit.client.0.smithi088.stdout:4/196: truncate d2/d5/d2d/f3e 2604627 0 2024-09-13T21:40:20.656 INFO:tasks.workunit.client.0.smithi088.stdout:4/197: creat d2/d9/de/d1e/d31/f43 x:0 0 0 2024-09-13T21:40:20.657 INFO:tasks.workunit.client.0.smithi088.stdout:0/229: creat d7/d1d/d3d/f57 x:0 0 0 2024-09-13T21:40:20.658 INFO:tasks.workunit.client.0.smithi088.stdout:0/230: fdatasync d7/f19 0 2024-09-13T21:40:20.658 INFO:tasks.workunit.client.0.smithi088.stdout:0/231: dread - d7/d1d/d27/f54 zero size 2024-09-13T21:40:20.658 INFO:tasks.workunit.client.0.smithi088.stdout:0/232: creat d7/d1d/d26/d45/f58 x:0 0 0 2024-09-13T21:40:20.660 INFO:tasks.workunit.client.0.smithi088.stdout:6/245: unlink d0/f16 0 2024-09-13T21:40:20.662 INFO:tasks.workunit.client.0.smithi088.stdout:8/189: symlink db/l42 0 2024-09-13T21:40:20.662 INFO:tasks.workunit.client.0.smithi088.stdout:8/190: write db/df/d25/f28 [595627,36487] 0 2024-09-13T21:40:20.664 INFO:tasks.workunit.client.0.smithi088.stdout:4/198: symlink d2/d5/d2d/l44 0 2024-09-13T21:40:20.666 INFO:tasks.workunit.client.0.smithi088.stdout:3/228: dwrite d5/d26/f33 [0,4194304] 0 2024-09-13T21:40:20.669 INFO:tasks.workunit.client.0.smithi088.stdout:0/233: rename d7/d1a/f47 to d7/d2c/d37/f59 0 2024-09-13T21:40:20.670 INFO:tasks.workunit.client.0.smithi088.stdout:6/246: rmdir d0/d1e/d1f 39 2024-09-13T21:40:20.671 INFO:tasks.workunit.client.0.smithi088.stdout:8/191: rmdir db/df/d25 39 2024-09-13T21:40:20.674 INFO:tasks.workunit.client.0.smithi088.stdout:4/199: link d2/d9/de/d12/f34 d2/f45 0 2024-09-13T21:40:20.675 INFO:tasks.workunit.client.0.smithi088.stdout:0/234: write d7/d1d/d27/d43/f1c [2955578,114630] 0 2024-09-13T21:40:20.676 INFO:tasks.workunit.client.0.smithi088.stdout:0/235: truncate d7/d1d/d26/d34/f38 808379 0 2024-09-13T21:40:20.677 INFO:tasks.workunit.client.0.smithi088.stdout:3/229: stat d5/d14/c28 0 2024-09-13T21:40:20.684 INFO:tasks.workunit.client.0.smithi088.stdout:6/247: rename d0/f33 to d0/d2c/f47 0 2024-09-13T21:40:20.686 INFO:tasks.workunit.client.0.smithi088.stdout:8/192: unlink db/c21 0 2024-09-13T21:40:20.687 INFO:tasks.workunit.client.0.smithi088.stdout:4/200: getdents d2/d13 0 2024-09-13T21:40:20.688 INFO:tasks.workunit.client.0.smithi088.stdout:3/230: write d5/f13 [2342328,44397] 0 2024-09-13T21:40:20.688 INFO:tasks.workunit.client.0.smithi088.stdout:3/231: write d5/f38 [1788070,64597] 0 2024-09-13T21:40:20.688 INFO:tasks.workunit.client.0.smithi088.stdout:3/232: write d5/d14/f37 [3416021,52073] 0 2024-09-13T21:40:20.688 INFO:tasks.workunit.client.0.smithi088.stdout:3/233: write d5/f50 [825289,74688] 0 2024-09-13T21:40:20.688 INFO:tasks.workunit.client.0.smithi088.stdout:6/248: write d0/db/f43 [1465630,112333] 0 2024-09-13T21:40:20.689 INFO:tasks.workunit.client.0.smithi088.stdout:0/236: symlink d7/d1d/d27/l5a 0 2024-09-13T21:40:20.698 INFO:tasks.workunit.client.0.smithi088.stdout:3/234: unlink d5/f24 0 2024-09-13T21:40:20.701 INFO:tasks.workunit.client.0.smithi088.stdout:1/271: sync 2024-09-13T21:40:20.701 INFO:tasks.workunit.client.0.smithi088.stdout:2/237: sync 2024-09-13T21:40:20.701 INFO:tasks.workunit.client.0.smithi088.stdout:7/214: sync 2024-09-13T21:40:20.701 INFO:tasks.workunit.client.0.smithi088.stdout:7/215: chown c3 297 1 2024-09-13T21:40:20.702 INFO:tasks.workunit.client.0.smithi088.stdout:6/249: mknod d0/d1e/d1f/c48 0 2024-09-13T21:40:20.702 INFO:tasks.workunit.client.0.smithi088.stdout:6/250: chown d0/d1e/d1f 321369 1 2024-09-13T21:40:20.702 INFO:tasks.workunit.client.0.smithi088.stdout:6/251: write d0/d1e/f24 [85277,51845] 0 2024-09-13T21:40:20.702 INFO:tasks.workunit.client.0.smithi088.stdout:6/252: write d0/f22 [2349726,14588] 0 2024-09-13T21:40:20.702 INFO:tasks.workunit.client.0.smithi088.stdout:6/253: chown d0/d28/c3c 60593318 1 2024-09-13T21:40:20.702 INFO:tasks.workunit.client.0.smithi088.stdout:6/254: chown d0/d28/c3c 17097 1 2024-09-13T21:40:20.703 INFO:tasks.workunit.client.0.smithi088.stdout:4/201: dread d2/d9/de/d1e/d31/f3b [0,4194304] 0 2024-09-13T21:40:20.704 INFO:tasks.workunit.client.0.smithi088.stdout:4/202: chown d2/d9/de/d1e/d23 24 1 2024-09-13T21:40:20.704 INFO:tasks.workunit.client.0.smithi088.stdout:0/237: link d7/l36 d7/d2c/d30/d31/d42/d4b/l5b 0 2024-09-13T21:40:20.705 INFO:tasks.workunit.client.0.smithi088.stdout:0/238: write d7/d2c/d37/f59 [987169,87737] 0 2024-09-13T21:40:20.706 INFO:tasks.workunit.client.0.smithi088.stdout:2/238: creat d1/d8/d2e/f53 x:0 0 0 2024-09-13T21:40:20.706 INFO:tasks.workunit.client.0.smithi088.stdout:7/216: mknod d6/da/d39/c4a 0 2024-09-13T21:40:20.707 INFO:tasks.workunit.client.0.smithi088.stdout:6/255: creat d0/d1e/f49 x:0 0 0 2024-09-13T21:40:20.708 INFO:tasks.workunit.client.0.smithi088.stdout:9/200: sync 2024-09-13T21:40:20.708 INFO:tasks.workunit.client.0.smithi088.stdout:5/228: sync 2024-09-13T21:40:20.709 INFO:tasks.workunit.client.0.smithi088.stdout:4/203: symlink d2/d11/l46 0 2024-09-13T21:40:20.709 INFO:tasks.workunit.client.0.smithi088.stdout:4/204: stat d2/d9/l22 0 2024-09-13T21:40:20.709 INFO:tasks.workunit.client.0.smithi088.stdout:4/205: fdatasync d2/d9/de/d1e/d31/f3b 0 2024-09-13T21:40:20.710 INFO:tasks.workunit.client.0.smithi088.stdout:4/206: fsync d2/d5/d2d/f40 0 2024-09-13T21:40:20.711 INFO:tasks.workunit.client.0.smithi088.stdout:0/239: mkdir d7/d5c 0 2024-09-13T21:40:20.712 INFO:tasks.workunit.client.0.smithi088.stdout:2/239: getdents d1/d13/d2a/d41 0 2024-09-13T21:40:20.713 INFO:tasks.workunit.client.0.smithi088.stdout:7/217: mknod d6/da/d1a/c4b 0 2024-09-13T21:40:20.713 INFO:tasks.workunit.client.0.smithi088.stdout:9/201: fdatasync d1a/f23 0 2024-09-13T21:40:20.714 INFO:tasks.workunit.client.0.smithi088.stdout:5/229: rename d4/d1c/d24/d26/d40/f30 to d4/d1c/d24/d26/d40/f49 0 2024-09-13T21:40:20.714 INFO:tasks.workunit.client.0.smithi088.stdout:5/230: stat d4/d1b/d2a 0 2024-09-13T21:40:20.715 INFO:tasks.workunit.client.0.smithi088.stdout:2/240: link d1/d13/f1a d1/d8/d2e/d44/f54 0 2024-09-13T21:40:20.716 INFO:tasks.workunit.client.0.smithi088.stdout:1/272: write d9/f14 [2895646,7151] 0 2024-09-13T21:40:20.716 INFO:tasks.workunit.client.0.smithi088.stdout:1/273: write d9/f60 [997161,44459] 0 2024-09-13T21:40:20.717 INFO:tasks.workunit.client.0.smithi088.stdout:8/193: dwrite db/df/f18 [0,4194304] 0 2024-09-13T21:40:20.717 INFO:tasks.workunit.client.0.smithi088.stdout:9/202: rename d1a/f24 to d1a/f3b 0 2024-09-13T21:40:20.718 INFO:tasks.workunit.client.0.smithi088.stdout:5/231: mkdir d4/d1c/d4a 0 2024-09-13T21:40:20.720 INFO:tasks.workunit.client.0.smithi088.stdout:1/274: creat d9/d4f/f67 x:0 0 0 2024-09-13T21:40:20.722 INFO:tasks.workunit.client.0.smithi088.stdout:8/194: rename db/c40 to db/d33/c43 0 2024-09-13T21:40:20.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/203: write f9 [2641943,43748] 0 2024-09-13T21:40:20.725 INFO:tasks.workunit.client.0.smithi088.stdout:1/275: dread - d9/dc/f42 zero size 2024-09-13T21:40:20.728 INFO:tasks.workunit.client.0.smithi088.stdout:8/195: rename db/df/d25/l3f to db/df/l44 0 2024-09-13T21:40:20.766 INFO:tasks.workunit.client.0.smithi088.stdout:4/207: dwrite d2/d5/ff [0,4194304] 0 2024-09-13T21:40:20.766 INFO:tasks.workunit.client.0.smithi088.stdout:6/256: dwrite d0/d2c/f47 [0,4194304] 0 2024-09-13T21:40:20.768 INFO:tasks.workunit.client.0.smithi088.stdout:4/208: mknod d2/d9/de/d1e/d31/c47 0 2024-09-13T21:40:20.768 INFO:tasks.workunit.client.0.smithi088.stdout:4/209: fsync d2/d9/de/f32 0 2024-09-13T21:40:20.768 INFO:tasks.workunit.client.0.smithi088.stdout:4/210: dread - d2/d9/d19/f3f zero size 2024-09-13T21:40:20.771 INFO:tasks.workunit.client.0.smithi088.stdout:6/257: rename d0/d28/l46 to d0/d2c/d32/d39/d3f/l4a 0 2024-09-13T21:40:20.772 INFO:tasks.workunit.client.0.smithi088.stdout:6/258: symlink d0/db/d37/l4b 0 2024-09-13T21:40:20.773 INFO:tasks.workunit.client.0.smithi088.stdout:4/211: dread d2/d9/de/d1e/d31/f3b [0,4194304] 0 2024-09-13T21:40:20.773 INFO:tasks.workunit.client.0.smithi088.stdout:6/259: getdents d0 0 2024-09-13T21:40:20.774 INFO:tasks.workunit.client.0.smithi088.stdout:6/260: creat d0/d1e/f4c x:0 0 0 2024-09-13T21:40:20.775 INFO:tasks.workunit.client.0.smithi088.stdout:7/218: dwrite d6/f18 [0,4194304] 0 2024-09-13T21:40:20.776 INFO:tasks.workunit.client.0.smithi088.stdout:0/240: dwrite d7/d1d/d26/d45/f56 [0,4194304] 0 2024-09-13T21:40:20.776 INFO:tasks.workunit.client.0.smithi088.stdout:0/241: write d7/f23 [4431251,2156] 0 2024-09-13T21:40:20.776 INFO:tasks.workunit.client.0.smithi088.stdout:9/204: dwrite f18 [0,4194304] 0 2024-09-13T21:40:20.776 INFO:tasks.workunit.client.0.smithi088.stdout:9/205: write f18 [4798699,78369] 0 2024-09-13T21:40:20.777 INFO:tasks.workunit.client.0.smithi088.stdout:8/196: dwrite fa [0,4194304] 0 2024-09-13T21:40:20.777 INFO:tasks.workunit.client.0.smithi088.stdout:4/212: rename d2/d9/de/d1e/d31/f43 to d2/f48 0 2024-09-13T21:40:20.777 INFO:tasks.workunit.client.0.smithi088.stdout:4/213: fsync d2/d5/f14 0 2024-09-13T21:40:20.778 INFO:tasks.workunit.client.0.smithi088.stdout:1/276: dwrite d9/d10/f3f [0,4194304] 0 2024-09-13T21:40:20.778 INFO:tasks.workunit.client.0.smithi088.stdout:1/277: stat d9/d10/f29 0 2024-09-13T21:40:20.778 INFO:tasks.workunit.client.0.smithi088.stdout:1/278: write d9/fd [855669,113066] 0 2024-09-13T21:40:20.779 INFO:tasks.workunit.client.0.smithi088.stdout:6/261: creat d0/d1e/d1f/f4d x:0 0 0 2024-09-13T21:40:20.787 INFO:tasks.workunit.client.0.smithi088.stdout:0/242: symlink d7/d2c/d30/d31/l5d 0 2024-09-13T21:40:20.791 INFO:tasks.workunit.client.0.smithi088.stdout:4/214: mknod d2/d9/de/d1e/c49 0 2024-09-13T21:40:20.794 INFO:tasks.workunit.client.0.smithi088.stdout:1/279: symlink d9/d10/d2a/l68 0 2024-09-13T21:40:20.795 INFO:tasks.workunit.client.0.smithi088.stdout:7/219: dwrite d6/da/d39/d3c/f48 [0,4194304] 0 2024-09-13T21:40:20.796 INFO:tasks.workunit.client.0.smithi088.stdout:7/220: write d6/da/f10 [8095809,82069] 0 2024-09-13T21:40:20.796 INFO:tasks.workunit.client.0.smithi088.stdout:7/221: chown d6/da/d39/c4a 7405 1 2024-09-13T21:40:20.796 INFO:tasks.workunit.client.0.smithi088.stdout:7/222: write d6/da/d1a/d3a/f3f [371704,9295] 0 2024-09-13T21:40:20.796 INFO:tasks.workunit.client.0.smithi088.stdout:6/262: getdents d0/d2c/d32 0 2024-09-13T21:40:20.796 INFO:tasks.workunit.client.0.smithi088.stdout:6/263: creat d0/d1e/d1f/f4e x:0 0 0 2024-09-13T21:40:20.797 INFO:tasks.workunit.client.0.smithi088.stdout:0/243: mknod d7/d1d/c5e 0 2024-09-13T21:40:20.797 INFO:tasks.workunit.client.0.smithi088.stdout:0/244: readlink d7/d1d/d27/l5a 0 2024-09-13T21:40:20.798 INFO:tasks.workunit.client.0.smithi088.stdout:0/245: chown d7/d1d/d27/f54 57876 1 2024-09-13T21:40:20.798 INFO:tasks.workunit.client.0.smithi088.stdout:8/197: dwrite db/f23 [0,4194304] 0 2024-09-13T21:40:20.802 INFO:tasks.workunit.client.0.smithi088.stdout:4/215: symlink d2/d5/l4a 0 2024-09-13T21:40:20.802 INFO:tasks.workunit.client.0.smithi088.stdout:4/216: chown d2/d11/l38 191666 1 2024-09-13T21:40:20.804 INFO:tasks.workunit.client.0.smithi088.stdout:9/206: getdents d1a 0 2024-09-13T21:40:20.804 INFO:tasks.workunit.client.0.smithi088.stdout:9/207: readlink d1a/d1b/l33 0 2024-09-13T21:40:20.806 INFO:tasks.workunit.client.0.smithi088.stdout:1/280: mknod d9/dc/d52/c69 0 2024-09-13T21:40:20.810 INFO:tasks.workunit.client.0.smithi088.stdout:7/223: write d6/f18 [262967,101982] 0 2024-09-13T21:40:20.812 INFO:tasks.workunit.client.0.smithi088.stdout:0/246: mknod d7/d2c/d44/c5f 0 2024-09-13T21:40:20.822 INFO:tasks.workunit.client.0.smithi088.stdout:4/217: mkdir d2/d5/d20/d41/d4b 0 2024-09-13T21:40:20.822 INFO:tasks.workunit.client.0.smithi088.stdout:8/198: dwrite db/df/d25/f2d [4194304,4194304] 0 2024-09-13T21:40:20.822 INFO:tasks.workunit.client.0.smithi088.stdout:8/199: write db/d26/d37/f41 [1002368,33529] 0 2024-09-13T21:40:20.825 INFO:tasks.workunit.client.0.smithi088.stdout:9/208: mkdir d1a/d3c 0 2024-09-13T21:40:20.826 INFO:tasks.workunit.client.0.smithi088.stdout:1/281: creat d9/d10/d2a/d4b/d61/f6a x:0 0 0 2024-09-13T21:40:20.827 INFO:tasks.workunit.client.0.smithi088.stdout:7/224: getdents d6/da 0 2024-09-13T21:40:20.828 INFO:tasks.workunit.client.0.smithi088.stdout:6/264: getdents d0/db 0 2024-09-13T21:40:20.829 INFO:tasks.workunit.client.0.smithi088.stdout:0/247: mknod d7/d1d/d27/c60 0 2024-09-13T21:40:20.830 INFO:tasks.workunit.client.0.smithi088.stdout:0/248: fdatasync d7/d1d/d27/d43/f53 0 2024-09-13T21:40:20.830 INFO:tasks.workunit.client.0.smithi088.stdout:0/249: chown d7/d2c/d30/c49 27282 1 2024-09-13T21:40:20.831 INFO:tasks.workunit.client.0.smithi088.stdout:4/218: rename d2/l4 to d2/d9/de/d1e/d31/l4c 0 2024-09-13T21:40:20.837 INFO:tasks.workunit.client.0.smithi088.stdout:0/250: mknod d7/d1d/d27/d43/c61 0 2024-09-13T21:40:20.839 INFO:tasks.workunit.client.0.smithi088.stdout:9/209: mkdir d1a/d34/d3d 0 2024-09-13T21:40:20.839 INFO:tasks.workunit.client.0.smithi088.stdout:9/210: truncate f18 5815308 0 2024-09-13T21:40:20.844 INFO:tasks.workunit.client.0.smithi088.stdout:9/211: write d1a/f30 [1359255,10563] 0 2024-09-13T21:40:20.845 INFO:tasks.workunit.client.0.smithi088.stdout:9/212: link d1a/d1b/l26 d1a/d34/d3d/l3e 0 2024-09-13T21:40:20.847 INFO:tasks.workunit.client.0.smithi088.stdout:9/213: fdatasync f14 0 2024-09-13T21:40:20.849 INFO:tasks.workunit.client.0.smithi088.stdout:9/214: mkdir d1a/d1b/d3f 0 2024-09-13T21:40:20.849 INFO:tasks.workunit.client.0.smithi088.stdout:9/215: dread - d1a/d1b/f38 zero size 2024-09-13T21:40:20.849 INFO:tasks.workunit.client.0.smithi088.stdout:9/216: creat d1a/d1b/f40 x:0 0 0 2024-09-13T21:40:20.849 INFO:tasks.workunit.client.0.smithi088.stdout:0/251: dread d7/d1d/d21/f2a [0,4194304] 0 2024-09-13T21:40:20.852 INFO:tasks.workunit.client.0.smithi088.stdout:0/252: rename d7/d2c/d44/f55 to d7/d2c/d30/d31/f62 0 2024-09-13T21:40:20.852 INFO:tasks.workunit.client.0.smithi088.stdout:0/253: fsync d7/d1d/d3d/f57 0 2024-09-13T21:40:20.852 INFO:tasks.workunit.client.0.smithi088.stdout:0/254: write d7/f19 [4776885,42368] 0 2024-09-13T21:40:20.854 INFO:tasks.workunit.client.0.smithi088.stdout:9/217: unlink d1a/c2b 0 2024-09-13T21:40:20.854 INFO:tasks.workunit.client.0.smithi088.stdout:9/218: write d1a/d1b/f35 [1026376,79322] 0 2024-09-13T21:40:20.854 INFO:tasks.workunit.client.0.smithi088.stdout:3/235: sync 2024-09-13T21:40:20.854 INFO:tasks.workunit.client.0.smithi088.stdout:5/232: sync 2024-09-13T21:40:20.854 INFO:tasks.workunit.client.0.smithi088.stdout:2/241: sync 2024-09-13T21:40:20.854 INFO:tasks.workunit.client.0.smithi088.stdout:3/236: dread - d5/d26/d2d/f46 zero size 2024-09-13T21:40:20.857 INFO:tasks.workunit.client.0.smithi088.stdout:1/282: dwrite d9/d10/d2a/d4b/f23 [0,4194304] 0 2024-09-13T21:40:20.857 INFO:tasks.workunit.client.0.smithi088.stdout:0/255: symlink d7/d2c/d44/l63 0 2024-09-13T21:40:20.857 INFO:tasks.workunit.client.0.smithi088.stdout:4/219: dwrite d2/f45 [0,4194304] 0 2024-09-13T21:40:20.857 INFO:tasks.workunit.client.0.smithi088.stdout:4/220: chown d2/d9/d19/l30 810584043 1 2024-09-13T21:40:20.857 INFO:tasks.workunit.client.0.smithi088.stdout:9/219: mkdir d1a/d34/d3d/d41 0 2024-09-13T21:40:20.858 INFO:tasks.workunit.client.0.smithi088.stdout:5/233: mkdir d4/d1c/d24/d26/d4b 0 2024-09-13T21:40:20.859 INFO:tasks.workunit.client.0.smithi088.stdout:2/242: write d1/d8/f19 [2213715,90522] 0 2024-09-13T21:40:20.859 INFO:tasks.workunit.client.0.smithi088.stdout:2/243: truncate d1/d8/d24/f39 281428 0 2024-09-13T21:40:20.859 INFO:tasks.workunit.client.0.smithi088.stdout:1/283: truncate d9/d10/d2a/d4b/d39/f40 4747701 0 2024-09-13T21:40:20.869 INFO:tasks.workunit.client.0.smithi088.stdout:9/220: read d1a/f31 [282562,76031] 0 2024-09-13T21:40:20.869 INFO:tasks.workunit.client.0.smithi088.stdout:9/221: chown f18 105093 1 2024-09-13T21:40:20.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/234: symlink d4/d1c/d24/l4c 0 2024-09-13T21:40:20.871 INFO:tasks.workunit.client.0.smithi088.stdout:2/244: symlink d1/d8/d2e/d3b/l55 0 2024-09-13T21:40:20.872 INFO:tasks.workunit.client.0.smithi088.stdout:1/284: symlink d9/l6b 0 2024-09-13T21:40:20.873 INFO:tasks.workunit.client.0.smithi088.stdout:0/256: rmdir d7/d1d/d21 39 2024-09-13T21:40:20.876 INFO:tasks.workunit.client.0.smithi088.stdout:3/237: dwrite d5/f22 [0,4194304] 0 2024-09-13T21:40:20.876 INFO:tasks.workunit.client.0.smithi088.stdout:4/221: dwrite d2/d9/de/d12/f34 [0,4194304] 0 2024-09-13T21:40:20.876 INFO:tasks.workunit.client.0.smithi088.stdout:9/222: fsync d1a/f30 0 2024-09-13T21:40:20.877 INFO:tasks.workunit.client.0.smithi088.stdout:5/235: truncate d4/f22 272560 0 2024-09-13T21:40:20.877 INFO:tasks.workunit.client.0.smithi088.stdout:5/236: chown d4/d1c/d24/l4c 871220 1 2024-09-13T21:40:20.878 INFO:tasks.workunit.client.0.smithi088.stdout:1/285: creat d9/d10/d2a/d4b/d39/f6c x:0 0 0 2024-09-13T21:40:20.883 INFO:tasks.workunit.client.0.smithi088.stdout:3/238: unlink d5/c39 0 2024-09-13T21:40:20.883 INFO:tasks.workunit.client.0.smithi088.stdout:3/239: stat d5/d26/d2d/d31 0 2024-09-13T21:40:20.886 INFO:tasks.workunit.client.0.smithi088.stdout:2/245: dwrite d1/f15 [4194304,4194304] 0 2024-09-13T21:40:20.887 INFO:tasks.workunit.client.0.smithi088.stdout:3/240: truncate d5/d14/f29 1069055 0 2024-09-13T21:40:20.887 INFO:tasks.workunit.client.0.smithi088.stdout:3/241: creat d5/d23/d2a/f51 x:0 0 0 2024-09-13T21:40:20.892 INFO:tasks.workunit.client.0.smithi088.stdout:5/237: dread d4/fc [0,4194304] 0 2024-09-13T21:40:20.892 INFO:tasks.workunit.client.0.smithi088.stdout:5/238: creat d4/d1c/f4d x:0 0 0 2024-09-13T21:40:20.892 INFO:tasks.workunit.client.0.smithi088.stdout:5/239: creat d4/d1c/f4e x:0 0 0 2024-09-13T21:40:20.893 INFO:tasks.workunit.client.0.smithi088.stdout:2/246: symlink d1/d13/d2a/d3c/d4a/l56 0 2024-09-13T21:40:20.906 INFO:tasks.workunit.client.0.smithi088.stdout:2/247: dread d1/d13/d2a/f2b [0,4194304] 0 2024-09-13T21:40:20.906 INFO:tasks.workunit.client.0.smithi088.stdout:2/248: creat d1/d8/f57 x:0 0 0 2024-09-13T21:40:20.907 INFO:tasks.workunit.client.0.smithi088.stdout:2/249: readlink d1/l1f 0 2024-09-13T21:40:20.909 INFO:tasks.workunit.client.0.smithi088.stdout:2/250: dread d1/f36 [0,4194304] 0 2024-09-13T21:40:20.919 INFO:tasks.workunit.client.0.smithi088.stdout:1/286: read d9/d10/d2a/d4b/d39/f40 [1425016,54728] 0 2024-09-13T21:40:20.919 INFO:tasks.workunit.client.0.smithi088.stdout:1/287: chown d9/d10/d2a/d4b/d61 11 1 2024-09-13T21:40:20.920 INFO:tasks.workunit.client.0.smithi088.stdout:1/288: dread d9/d10/d2a/d4b/f2f [0,4194304] 0 2024-09-13T21:40:20.924 INFO:tasks.workunit.client.0.smithi088.stdout:0/257: dwrite d7/d1d/d27/d43/f17 [4194304,4194304] 0 2024-09-13T21:40:20.924 INFO:tasks.workunit.client.0.smithi088.stdout:9/223: dwrite d1a/d1b/f2e [0,4194304] 0 2024-09-13T21:40:20.924 INFO:tasks.workunit.client.0.smithi088.stdout:4/222: dwrite d2/d9/f2a [0,4194304] 0 2024-09-13T21:40:20.924 INFO:tasks.workunit.client.0.smithi088.stdout:9/224: fsync d1a/d1b/f25 0 2024-09-13T21:40:20.924 INFO:tasks.workunit.client.0.smithi088.stdout:0/258: fsync d7/d1d/d26/d34/f38 0 2024-09-13T21:40:20.924 INFO:tasks.workunit.client.0.smithi088.stdout:5/240: dwrite d4/ff [4194304,4194304] 0 2024-09-13T21:40:20.944 INFO:tasks.workunit.client.0.smithi088.stdout:9/225: mknod d1a/d34/c42 0 2024-09-13T21:40:21.030 INFO:tasks.workunit.client.0.smithi088.stdout:1/289: dwrite d9/f19 [4194304,4194304] 0 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:1/290: chown d9/dc/f1f 227229164 1 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:1/291: stat d9/d10/d2a/d4b/d39/f6c 0 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:1/292: write d9/f60 [243119,65438] 0 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:1/293: write d9/d10/f29 [975432,32310] 0 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:5/241: symlink d4/d1c/d4a/l4f 0 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:3/242: dwrite d5/d14/f29 [0,4194304] 0 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:3/243: write d5/f38 [2326990,15455] 0 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:3/244: chown d5/d26 62 1 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:3/245: dread - d5/d26/d2d/f44 zero size 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:9/226: creat d1a/f43 x:0 0 0 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:9/227: stat d1a 0 2024-09-13T21:40:21.031 INFO:tasks.workunit.client.0.smithi088.stdout:1/294: mkdir d9/d10/d2a/d4b/d39/d43/d6d 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:1/295: write d9/d10/d2a/d4b/d39/f40 [75578,51718] 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:4/223: truncate d2/f45 861990 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:0/259: dwrite d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:3/246: rename d5/d14/l4d to d5/d26/d2d/d48/l52 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:4/224: rename d2/d5/d20 to d2/d5/d20/d4d 22 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:3/247: fsync d5/d26/d43/f4c 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:1/296: unlink d9/d10/d2a/d4b/f1d 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:8/200: sync 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:8/201: fdatasync fa 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:5/242: getdents d4/d1c/d24/d26/d40 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:4/225: dread d2/d9/de/d1e/d31/f3b [0,4194304] 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:3/248: rename d5/f17 to d5/d26/d2d/d48/d49/f53 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:9/228: dwrite d1a/d1b/f40 [0,4194304] 0 2024-09-13T21:40:21.032 INFO:tasks.workunit.client.0.smithi088.stdout:1/297: getdents d9/dc/d52 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:4/226: mkdir d2/d5/d20/d41/d4b/d4e 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:3/249: creat d5/d14/f54 x:0 0 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:3/250: truncate d5/d14/f2c 983178 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:7/225: sync 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/265: sync 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:1/298: symlink d9/d10/d2a/d4b/d61/l6e 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:0/260: dread d7/f19 [0,4194304] 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/266: mknod d0/c4f 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/267: mknod d0/db/d37/c50 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/268: creat d0/d1e/d1f/f51 x:0 0 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/269: dread - d0/d28/f40 zero size 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:5/243: dread d4/d1c/f48 [0,4194304] 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:1/299: dread d9/d10/d2a/d4b/f21 [0,4194304] 0 2024-09-13T21:40:21.033 INFO:tasks.workunit.client.0.smithi088.stdout:1/300: link d9/dc/d52/l66 d9/d10/d2a/d4b/d39/l6f 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:1/301: rmdir d9/d10/d2a/d4b/d39/d43/d6d 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:1/302: creat d9/d10/d2a/d4b/d61/f70 x:0 0 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:1/303: creat d9/dc/f71 x:0 0 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:1/304: write d9/d10/d2a/d4b/f65 [1689698,45362] 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:1/305: write d9/dc/f1f [1538231,14792] 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:1/306: write d9/fd [1196945,71257] 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:9/229: dwrite d1a/d1b/f35 [0,4194304] 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:7/226: dwrite d6/da/f10 [4194304,4194304] 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:8/202: dwrite db/df/f18 [0,4194304] 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:5/244: dwrite d4/d1c/d24/d26/d40/f46 [0,4194304] 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:5/245: chown d4/d1c/d24/d26 86 1 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:1/307: symlink d9/d10/d2a/l72 0 2024-09-13T21:40:21.034 INFO:tasks.workunit.client.0.smithi088.stdout:9/230: creat d1a/d34/d3d/d41/f44 x:0 0 0 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:8/203: write db/df/d25/f2d [4227229,57182] 0 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:7/227: read d6/da/f38 [5090812,112569] 0 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:5/246: creat d4/d1c/d4a/f50 x:0 0 0 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:5/247: fsync d4/d1c/d24/f39 0 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:5/248: read d4/d1c/f45 [68020,111771] 0 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:1/308: link d9/l5f d9/d10/d2a/d47/l73 0 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:9/231: dread - d1a/f3a zero size 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:7/228: mkdir d6/da/d39/d3c/d4c 0 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:8/204: dread db/df/d25/f2d [0,4194304] 0 2024-09-13T21:40:21.035 INFO:tasks.workunit.client.0.smithi088.stdout:4/227: truncate d2/d9/de/d12/f34 764658 0 2024-09-13T21:40:21.036 INFO:tasks.workunit.client.0.smithi088.stdout:1/309: mkdir d9/dc/d74 0 2024-09-13T21:40:21.036 INFO:tasks.workunit.client.0.smithi088.stdout:1/310: fsync d9/d10/d2a/d4b/f23 0 2024-09-13T21:40:21.038 INFO:tasks.workunit.client.0.smithi088.stdout:9/232: dread d1a/d1b/f2e [0,4194304] 0 2024-09-13T21:40:21.041 INFO:tasks.workunit.client.0.smithi088.stdout:2/251: sync 2024-09-13T21:40:21.042 INFO:tasks.workunit.client.0.smithi088.stdout:9/233: symlink d1a/d34/d3d/d41/l45 0 2024-09-13T21:40:21.042 INFO:tasks.workunit.client.0.smithi088.stdout:9/234: creat d1a/d34/d3d/d41/f46 x:0 0 0 2024-09-13T21:40:21.048 INFO:tasks.workunit.client.0.smithi088.stdout:2/252: rmdir d1/d8/d16 39 2024-09-13T21:40:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:9/235: rename l19 to d1a/d34/l47 0 2024-09-13T21:40:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:2/253: mknod d1/d13/d3f/c58 0 2024-09-13T21:40:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:9/236: mkdir d1a/d34/d3d/d41/d48 0 2024-09-13T21:40:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:4/228: dread d2/d5/d2d/f3e [0,4194304] 0 2024-09-13T21:40:21.049 INFO:tasks.workunit.client.0.smithi088.stdout:2/254: mknod d1/d8/d2e/d3b/c59 0 2024-09-13T21:40:21.050 INFO:tasks.workunit.client.0.smithi088.stdout:2/255: truncate d1/d13/f17 328196 0 2024-09-13T21:40:21.051 INFO:tasks.workunit.client.0.smithi088.stdout:2/256: symlink d1/d8/l5a 0 2024-09-13T21:40:21.053 INFO:tasks.workunit.client.0.smithi088.stdout:2/257: mkdir d1/d13/d2a/d3c/d4e/d5b 0 2024-09-13T21:40:21.054 INFO:tasks.workunit.client.0.smithi088.stdout:2/258: creat d1/d8/d16/f5c x:0 0 0 2024-09-13T21:40:21.057 INFO:tasks.workunit.client.0.smithi088.stdout:2/259: symlink d1/d13/d3f/l5d 0 2024-09-13T21:40:21.068 INFO:tasks.workunit.client.0.smithi088.stdout:2/260: write d1/d13/f1a [722431,67482] 0 2024-09-13T21:40:21.077 INFO:tasks.workunit.client.0.smithi088.stdout:8/205: dwrite db/df/f18 [0,4194304] 0 2024-09-13T21:40:21.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/229: dwrite d6/da/f1e [0,4194304] 0 2024-09-13T21:40:21.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/230: write d6/f18 [4724485,64766] 0 2024-09-13T21:40:21.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/231: readlink d6/da/l2c 0 2024-09-13T21:40:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:4/229: dwrite d2/d9/de/d12/f34 [0,4194304] 0 2024-09-13T21:40:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:8/206: truncate db/f23 1594024 0 2024-09-13T21:40:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:8/207: stat db/c19 0 2024-09-13T21:40:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:8/208: creat db/d26/f45 x:0 0 0 2024-09-13T21:40:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:8/209: chown db/d26/d2c/f32 25 1 2024-09-13T21:40:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:8/210: chown db/d26/l3e 14083 1 2024-09-13T21:40:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:8/211: creat db/d26/d37/f46 x:0 0 0 2024-09-13T21:40:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:9/237: dwrite f10 [0,4194304] 0 2024-09-13T21:40:21.080 INFO:tasks.workunit.client.0.smithi088.stdout:2/261: write d1/d13/f2c [2793102,45299] 0 2024-09-13T21:40:21.081 INFO:tasks.workunit.client.0.smithi088.stdout:9/238: dread - d1a/d34/d3d/d41/f44 zero size 2024-09-13T21:40:21.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/232: symlink d6/da/d39/d3c/l4d 0 2024-09-13T21:40:21.082 INFO:tasks.workunit.client.0.smithi088.stdout:4/230: creat d2/d5/d20/d41/d4b/f4f x:0 0 0 2024-09-13T21:40:21.085 INFO:tasks.workunit.client.0.smithi088.stdout:8/212: rename db/l39 to db/d33/l47 0 2024-09-13T21:40:21.085 INFO:tasks.workunit.client.0.smithi088.stdout:8/213: truncate db/d26/d37/f46 671360 0 2024-09-13T21:40:21.085 INFO:tasks.workunit.client.0.smithi088.stdout:8/214: creat db/d26/f48 x:0 0 0 2024-09-13T21:40:21.088 INFO:tasks.workunit.client.0.smithi088.stdout:7/233: dread d6/da/fb [0,4194304] 0 2024-09-13T21:40:21.089 INFO:tasks.workunit.client.0.smithi088.stdout:9/239: creat d1a/f49 x:0 0 0 2024-09-13T21:40:21.089 INFO:tasks.workunit.client.0.smithi088.stdout:9/240: dread - d1a/f43 zero size 2024-09-13T21:40:21.090 INFO:tasks.workunit.client.0.smithi088.stdout:2/262: creat d1/d8/d2e/d3b/f5e x:0 0 0 2024-09-13T21:40:21.090 INFO:tasks.workunit.client.0.smithi088.stdout:2/263: chown d1/d13/f2c 428 1 2024-09-13T21:40:21.092 INFO:tasks.workunit.client.0.smithi088.stdout:4/231: rename d2/d5/d20/d41/d4b/d4e to d2/d13/d50 0 2024-09-13T21:40:21.092 INFO:tasks.workunit.client.0.smithi088.stdout:4/232: chown d2/d9 0 1 2024-09-13T21:40:21.092 INFO:tasks.workunit.client.0.smithi088.stdout:4/233: chown d2/d9/d19/f3f 11840 1 2024-09-13T21:40:21.093 INFO:tasks.workunit.client.0.smithi088.stdout:2/264: dread d1/d8/f19 [0,4194304] 0 2024-09-13T21:40:21.095 INFO:tasks.workunit.client.0.smithi088.stdout:8/215: creat db/df/f49 x:0 0 0 2024-09-13T21:40:21.095 INFO:tasks.workunit.client.0.smithi088.stdout:8/216: chown db/c20 125750778 1 2024-09-13T21:40:21.100 INFO:tasks.workunit.client.0.smithi088.stdout:4/234: mknod d2/d5/d20/d41/d4b/c51 0 2024-09-13T21:40:21.102 INFO:tasks.workunit.client.0.smithi088.stdout:8/217: mknod db/d26/c4a 0 2024-09-13T21:40:21.104 INFO:tasks.workunit.client.0.smithi088.stdout:7/234: mkdir d6/d4e 0 2024-09-13T21:40:21.105 INFO:tasks.workunit.client.0.smithi088.stdout:4/235: rename d2/d11/c3a to d2/d5/d20/d41/c52 0 2024-09-13T21:40:21.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/265: getdents d1/d13/d2a 0 2024-09-13T21:40:21.107 INFO:tasks.workunit.client.0.smithi088.stdout:0/261: sync 2024-09-13T21:40:21.108 INFO:tasks.workunit.client.0.smithi088.stdout:3/251: sync 2024-09-13T21:40:21.109 INFO:tasks.workunit.client.0.smithi088.stdout:8/218: symlink db/d26/l4b 0 2024-09-13T21:40:21.109 INFO:tasks.workunit.client.0.smithi088.stdout:8/219: chown db/df/d25/f2e 51196 1 2024-09-13T21:40:21.109 INFO:tasks.workunit.client.0.smithi088.stdout:9/241: write fb [389659,53796] 0 2024-09-13T21:40:21.111 INFO:tasks.workunit.client.0.smithi088.stdout:6/270: sync 2024-09-13T21:40:21.111 INFO:tasks.workunit.client.0.smithi088.stdout:2/266: mknod d1/d13/d3f/c5f 0 2024-09-13T21:40:21.111 INFO:tasks.workunit.client.0.smithi088.stdout:2/267: chown d1/d8/d2e/f2d 17277085 1 2024-09-13T21:40:21.111 INFO:tasks.workunit.client.0.smithi088.stdout:5/249: sync 2024-09-13T21:40:21.113 INFO:tasks.workunit.client.0.smithi088.stdout:2/268: creat d1/d8/d16/d40/f60 x:0 0 0 2024-09-13T21:40:21.113 INFO:tasks.workunit.client.0.smithi088.stdout:9/242: truncate f13 115232 0 2024-09-13T21:40:21.115 INFO:tasks.workunit.client.0.smithi088.stdout:2/269: getdents d1/d13 0 2024-09-13T21:40:21.119 INFO:tasks.workunit.client.0.smithi088.stdout:2/270: mknod d1/d13/d2a/d3c/d4e/c61 0 2024-09-13T21:40:21.119 INFO:tasks.workunit.client.0.smithi088.stdout:2/271: chown d1/f10 222563 1 2024-09-13T21:40:21.122 INFO:tasks.workunit.client.0.smithi088.stdout:0/262: dread d7/f9 [4194304,4194304] 0 2024-09-13T21:40:21.124 INFO:tasks.workunit.client.0.smithi088.stdout:0/263: rename f5 to d7/d1d/d27/f64 0 2024-09-13T21:40:21.126 INFO:tasks.workunit.client.0.smithi088.stdout:6/271: dread d0/d2c/f47 [0,4194304] 0 2024-09-13T21:40:21.126 INFO:tasks.workunit.client.0.smithi088.stdout:6/272: fdatasync d0/d1e/f4c 0 2024-09-13T21:40:21.128 INFO:tasks.workunit.client.0.smithi088.stdout:6/273: creat d0/f52 x:0 0 0 2024-09-13T21:40:21.128 INFO:tasks.workunit.client.0.smithi088.stdout:6/274: chown d0/d2c/d32/d39/c41 252 1 2024-09-13T21:40:21.129 INFO:tasks.workunit.client.0.smithi088.stdout:7/235: dwrite d6/da/d1a/f33 [0,4194304] 0 2024-09-13T21:40:21.130 INFO:tasks.workunit.client.0.smithi088.stdout:6/275: mknod d0/d2c/d32/c53 0 2024-09-13T21:40:21.135 INFO:tasks.workunit.client.0.smithi088.stdout:6/276: mknod d0/d2c/c54 0 2024-09-13T21:40:21.139 INFO:tasks.workunit.client.0.smithi088.stdout:5/250: dwrite d4/f13 [0,4194304] 0 2024-09-13T21:40:21.139 INFO:tasks.workunit.client.0.smithi088.stdout:5/251: chown d4/d1c/c2f 23248 1 2024-09-13T21:40:21.143 INFO:tasks.workunit.client.0.smithi088.stdout:7/236: write d6/da/d1a/f43 [1251698,1943] 0 2024-09-13T21:40:21.147 INFO:tasks.workunit.client.0.smithi088.stdout:7/237: rename d6/da/d39/d3c to d6/da/d39/d4f 0 2024-09-13T21:40:21.149 INFO:tasks.workunit.client.0.smithi088.stdout:1/311: sync 2024-09-13T21:40:21.150 INFO:tasks.workunit.client.0.smithi088.stdout:1/312: mknod d9/d10/c75 0 2024-09-13T21:40:21.152 INFO:tasks.workunit.client.0.smithi088.stdout:1/313: rename d9/d10/d2a/d4b/f65 to d9/d10/d2a/d4b/d33/f76 0 2024-09-13T21:40:21.152 INFO:tasks.workunit.client.0.smithi088.stdout:1/314: dread - d9/dc/f42 zero size 2024-09-13T21:40:21.160 INFO:tasks.workunit.client.0.smithi088.stdout:9/243: dwrite d1a/f1c [0,4194304] 0 2024-09-13T21:40:21.167 INFO:tasks.workunit.client.0.smithi088.stdout:1/315: read d9/d10/d2a/d4b/f23 [3076061,59551] 0 2024-09-13T21:40:21.169 INFO:tasks.workunit.client.0.smithi088.stdout:2/272: dwrite d1/d8/fc [4194304,4194304] 0 2024-09-13T21:40:21.169 INFO:tasks.workunit.client.0.smithi088.stdout:4/236: dwrite d2/d9/de/f28 [0,4194304] 0 2024-09-13T21:40:21.170 INFO:tasks.workunit.client.0.smithi088.stdout:4/237: stat d2/d13 0 2024-09-13T21:40:21.171 INFO:tasks.workunit.client.0.smithi088.stdout:6/277: dwrite d0/d28/f40 [0,4194304] 0 2024-09-13T21:40:21.171 INFO:tasks.workunit.client.0.smithi088.stdout:3/252: dwrite d5/f42 [0,4194304] 0 2024-09-13T21:40:21.171 INFO:tasks.workunit.client.0.smithi088.stdout:5/252: dwrite d4/d1c/f48 [0,4194304] 0 2024-09-13T21:40:21.172 INFO:tasks.workunit.client.0.smithi088.stdout:5/253: readlink d4/d1c/d24/l4c 0 2024-09-13T21:40:21.172 INFO:tasks.workunit.client.0.smithi088.stdout:5/254: chown d4/d1c/c2c 766844 1 2024-09-13T21:40:21.172 INFO:tasks.workunit.client.0.smithi088.stdout:2/273: link d1/d8/d2e/d3b/l55 d1/d13/d2a/d41/d48/l62 0 2024-09-13T21:40:21.179 INFO:tasks.workunit.client.0.smithi088.stdout:7/238: truncate d6/da/d1a/f43 2222203 0 2024-09-13T21:40:21.180 INFO:tasks.workunit.client.0.smithi088.stdout:7/239: read d6/da/f38 [8372104,9425] 0 2024-09-13T21:40:21.180 INFO:tasks.workunit.client.0.smithi088.stdout:7/240: fdatasync d6/da/fb 0 2024-09-13T21:40:21.185 INFO:tasks.workunit.client.0.smithi088.stdout:3/253: mkdir d5/d23/d2a/d55 0 2024-09-13T21:40:21.187 INFO:tasks.workunit.client.0.smithi088.stdout:9/244: dwrite d1a/f31 [0,4194304] 0 2024-09-13T21:40:21.188 INFO:tasks.workunit.client.0.smithi088.stdout:5/255: symlink d4/d1c/l51 0 2024-09-13T21:40:21.191 INFO:tasks.workunit.client.0.smithi088.stdout:9/245: creat d1a/d1b/d3f/f4a x:0 0 0 2024-09-13T21:40:21.192 INFO:tasks.workunit.client.0.smithi088.stdout:5/256: symlink d4/d1b/l52 0 2024-09-13T21:40:21.193 INFO:tasks.workunit.client.0.smithi088.stdout:5/257: chown d4/l19 15 1 2024-09-13T21:40:21.193 INFO:tasks.workunit.client.0.smithi088.stdout:5/258: creat d4/d1c/f53 x:0 0 0 2024-09-13T21:40:21.193 INFO:tasks.workunit.client.0.smithi088.stdout:7/241: mknod d6/c50 0 2024-09-13T21:40:21.199 INFO:tasks.workunit.client.0.smithi088.stdout:3/254: dread d5/d26/f33 [0,4194304] 0 2024-09-13T21:40:21.201 INFO:tasks.workunit.client.0.smithi088.stdout:3/255: link d5/d14/f54 d5/f56 0 2024-09-13T21:40:21.201 INFO:tasks.workunit.client.0.smithi088.stdout:3/256: creat d5/d23/f57 x:0 0 0 2024-09-13T21:40:21.202 INFO:tasks.workunit.client.0.smithi088.stdout:1/316: dwrite d9/d10/d2a/d4b/d33/f3d [0,4194304] 0 2024-09-13T21:40:21.202 INFO:tasks.workunit.client.0.smithi088.stdout:3/257: truncate d5/f22 3140558 0 2024-09-13T21:40:21.203 INFO:tasks.workunit.client.0.smithi088.stdout:1/317: mknod d9/d10/d2a/d4b/d61/c77 0 2024-09-13T21:40:21.204 INFO:tasks.workunit.client.0.smithi088.stdout:1/318: fsync d9/d10/d2a/f55 0 2024-09-13T21:40:21.204 INFO:tasks.workunit.client.0.smithi088.stdout:3/258: unlink d5/d26/d43/f4c 0 2024-09-13T21:40:21.205 INFO:tasks.workunit.client.0.smithi088.stdout:3/259: readlink d5/l11 0 2024-09-13T21:40:21.205 INFO:tasks.workunit.client.0.smithi088.stdout:3/260: getdents d5/d23/d2a/d3f/d4f 0 2024-09-13T21:40:21.205 INFO:tasks.workunit.client.0.smithi088.stdout:3/261: chown d5/d14/f37 1 1 2024-09-13T21:40:21.205 INFO:tasks.workunit.client.0.smithi088.stdout:3/262: fsync d5/d26/d2d/f44 0 2024-09-13T21:40:21.205 INFO:tasks.workunit.client.0.smithi088.stdout:3/263: mknod d5/d23/c58 0 2024-09-13T21:40:21.205 INFO:tasks.workunit.client.0.smithi088.stdout:3/264: creat d5/d23/d2a/f59 x:0 0 0 2024-09-13T21:40:21.207 INFO:tasks.workunit.client.0.smithi088.stdout:3/265: mkdir d5/d5a 0 2024-09-13T21:40:21.207 INFO:tasks.workunit.client.0.smithi088.stdout:3/266: chown d5/f22 222 1 2024-09-13T21:40:21.207 INFO:tasks.workunit.client.0.smithi088.stdout:3/267: truncate d5/d26/f33 5029624 0 2024-09-13T21:40:21.216 INFO:tasks.workunit.client.0.smithi088.stdout:6/278: dwrite d0/f6 [0,4194304] 0 2024-09-13T21:40:21.217 INFO:tasks.workunit.client.0.smithi088.stdout:2/274: dwrite d1/f34 [0,4194304] 0 2024-09-13T21:40:21.217 INFO:tasks.workunit.client.0.smithi088.stdout:4/238: dwrite d2/d9/de/d1e/f37 [0,4194304] 0 2024-09-13T21:40:21.218 INFO:tasks.workunit.client.0.smithi088.stdout:4/239: fdatasync d2/d9/de/f28 0 2024-09-13T21:40:21.218 INFO:tasks.workunit.client.0.smithi088.stdout:4/240: chown d2/d5/f24 307599097 1 2024-09-13T21:40:21.218 INFO:tasks.workunit.client.0.smithi088.stdout:4/241: creat d2/d5/f53 x:0 0 0 2024-09-13T21:40:21.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/279: read d0/d2c/f47 [1139709,84794] 0 2024-09-13T21:40:21.220 INFO:tasks.workunit.client.0.smithi088.stdout:9/246: dwrite d1a/d34/d3d/d41/f46 [0,4194304] 0 2024-09-13T21:40:21.221 INFO:tasks.workunit.client.0.smithi088.stdout:1/319: dwrite d9/f14 [0,4194304] 0 2024-09-13T21:40:21.222 INFO:tasks.workunit.client.0.smithi088.stdout:3/268: dread d5/f13 [0,4194304] 0 2024-09-13T21:40:21.228 INFO:tasks.workunit.client.0.smithi088.stdout:6/280: dread d0/db/f2e [0,4194304] 0 2024-09-13T21:40:21.229 INFO:tasks.workunit.client.0.smithi088.stdout:4/242: dread d2/d9/de/d12/f34 [0,4194304] 0 2024-09-13T21:40:21.229 INFO:tasks.workunit.client.0.smithi088.stdout:4/243: truncate d2/d9/de/f28 4979703 0 2024-09-13T21:40:21.229 INFO:tasks.workunit.client.0.smithi088.stdout:4/244: dread - d2/d5/d2d/f40 zero size 2024-09-13T21:40:21.229 INFO:tasks.workunit.client.0.smithi088.stdout:4/245: truncate d2/d9/de/d1e/d31/f3b 4675398 0 2024-09-13T21:40:21.230 INFO:tasks.workunit.client.0.smithi088.stdout:3/269: link d5/d26/c30 d5/d26/d2d/d48/c5b 0 2024-09-13T21:40:21.230 INFO:tasks.workunit.client.0.smithi088.stdout:3/270: dread - d5/d26/d2d/f46 zero size 2024-09-13T21:40:21.230 INFO:tasks.workunit.client.0.smithi088.stdout:6/281: mkdir d0/d1e/d1f/d55 0 2024-09-13T21:40:21.231 INFO:tasks.workunit.client.0.smithi088.stdout:3/271: truncate d5/f42 2125506 0 2024-09-13T21:40:21.231 INFO:tasks.workunit.client.0.smithi088.stdout:3/272: readlink d5/d23/d2a/d3f/l41 0 2024-09-13T21:40:21.231 INFO:tasks.workunit.client.0.smithi088.stdout:3/273: dread - d5/d26/d2d/f3b zero size 2024-09-13T21:40:21.232 INFO:tasks.workunit.client.0.smithi088.stdout:9/247: write f17 [551754,55984] 0 2024-09-13T21:40:21.232 INFO:tasks.workunit.client.0.smithi088.stdout:2/275: write d1/d8/d24/f4c [2524310,43544] 0 2024-09-13T21:40:21.232 INFO:tasks.workunit.client.0.smithi088.stdout:2/276: fdatasync d1/d8/fc 0 2024-09-13T21:40:21.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/277: dread d1/f36 [0,4194304] 0 2024-09-13T21:40:21.233 INFO:tasks.workunit.client.0.smithi088.stdout:6/282: link d0/c4f d0/d2c/d32/d39/c56 0 2024-09-13T21:40:21.234 INFO:tasks.workunit.client.0.smithi088.stdout:3/274: rename d5/d23/f4a to d5/d26/d2d/f5c 0 2024-09-13T21:40:21.237 INFO:tasks.workunit.client.0.smithi088.stdout:9/248: mknod d1a/d34/d3d/d41/c4b 0 2024-09-13T21:40:21.241 INFO:tasks.workunit.client.0.smithi088.stdout:7/242: dwrite d6/da/d1a/f43 [0,4194304] 0 2024-09-13T21:40:21.241 INFO:tasks.workunit.client.0.smithi088.stdout:6/283: link d0/db/d37/c50 d0/d1e/d1f/c57 0 2024-09-13T21:40:21.241 INFO:tasks.workunit.client.0.smithi088.stdout:6/284: readlink d0/d2c/l36 0 2024-09-13T21:40:21.242 INFO:tasks.workunit.client.0.smithi088.stdout:6/285: write d0/f22 [4386916,52435] 0 2024-09-13T21:40:21.242 INFO:tasks.workunit.client.0.smithi088.stdout:6/286: chown d0/l3d 1 1 2024-09-13T21:40:21.243 INFO:tasks.workunit.client.0.smithi088.stdout:3/275: creat d5/d23/d2a/d3f/d4f/f5d x:0 0 0 2024-09-13T21:40:21.244 INFO:tasks.workunit.client.0.smithi088.stdout:3/276: chown d5/d26/d2d 29116392 1 2024-09-13T21:40:21.244 INFO:tasks.workunit.client.0.smithi088.stdout:3/277: chown d5/f13 139209605 1 2024-09-13T21:40:21.244 INFO:tasks.workunit.client.0.smithi088.stdout:9/249: fdatasync d1a/f20 0 2024-09-13T21:40:21.245 INFO:tasks.workunit.client.0.smithi088.stdout:2/278: rmdir d1/d13/d2a/d3c 39 2024-09-13T21:40:21.245 INFO:tasks.workunit.client.0.smithi088.stdout:2/279: read - d1/d8/f57 zero size 2024-09-13T21:40:21.246 INFO:tasks.workunit.client.0.smithi088.stdout:2/280: write d1/d13/f1a [4306750,54855] 0 2024-09-13T21:40:21.246 INFO:tasks.workunit.client.0.smithi088.stdout:6/287: truncate d0/db/f12 7048892 0 2024-09-13T21:40:21.247 INFO:tasks.workunit.client.0.smithi088.stdout:6/288: write d0/d1e/f49 [244787,40079] 0 2024-09-13T21:40:21.248 INFO:tasks.workunit.client.0.smithi088.stdout:4/246: dwrite d2/d5/f24 [0,4194304] 0 2024-09-13T21:40:21.248 INFO:tasks.workunit.client.0.smithi088.stdout:4/247: creat d2/d5/d20/d41/d4b/f54 x:0 0 0 2024-09-13T21:40:21.248 INFO:tasks.workunit.client.0.smithi088.stdout:4/248: dread - d2/d5/d20/d41/d4b/f54 zero size 2024-09-13T21:40:21.248 INFO:tasks.workunit.client.0.smithi088.stdout:4/249: creat d2/d5/f55 x:0 0 0 2024-09-13T21:40:21.249 INFO:tasks.workunit.client.0.smithi088.stdout:3/278: symlink d5/d23/d2a/l5e 0 2024-09-13T21:40:21.249 INFO:tasks.workunit.client.0.smithi088.stdout:3/279: fsync d5/d14/f37 0 2024-09-13T21:40:21.249 INFO:tasks.workunit.client.0.smithi088.stdout:3/280: creat d5/d26/d2d/d31/f5f x:0 0 0 2024-09-13T21:40:21.250 INFO:tasks.workunit.client.0.smithi088.stdout:9/250: mknod d1a/d34/d3d/d41/c4c 0 2024-09-13T21:40:21.252 INFO:tasks.workunit.client.0.smithi088.stdout:2/281: rename d1/l26 to d1/d13/d2a/l63 0 2024-09-13T21:40:21.257 INFO:tasks.workunit.client.0.smithi088.stdout:6/289: symlink d0/d2c/d32/d39/l58 0 2024-09-13T21:40:21.257 INFO:tasks.workunit.client.0.smithi088.stdout:6/290: chown d0/d1e/d1f/c57 0 1 2024-09-13T21:40:21.257 INFO:tasks.workunit.client.0.smithi088.stdout:8/220: sync 2024-09-13T21:40:21.257 INFO:tasks.workunit.client.0.smithi088.stdout:4/250: mknod d2/d5/d2d/c56 0 2024-09-13T21:40:21.257 INFO:tasks.workunit.client.0.smithi088.stdout:0/264: sync 2024-09-13T21:40:21.258 INFO:tasks.workunit.client.0.smithi088.stdout:6/291: dread d0/db/f43 [0,4194304] 0 2024-09-13T21:40:21.260 INFO:tasks.workunit.client.0.smithi088.stdout:3/281: symlink d5/d23/d2a/l60 0 2024-09-13T21:40:21.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/251: dread d2/d5/d2d/f3e [0,4194304] 0 2024-09-13T21:40:21.261 INFO:tasks.workunit.client.0.smithi088.stdout:4/252: fsync d2/d9/de/d12/f34 0 2024-09-13T21:40:21.264 INFO:tasks.workunit.client.0.smithi088.stdout:9/251: mknod d1a/c4d 0 2024-09-13T21:40:21.267 INFO:tasks.workunit.client.0.smithi088.stdout:3/282: mknod d5/d23/d2a/d3f/d4f/c61 0 2024-09-13T21:40:21.267 INFO:tasks.workunit.client.0.smithi088.stdout:3/283: dread - d5/d26/d2d/f2e zero size 2024-09-13T21:40:21.267 INFO:tasks.workunit.client.0.smithi088.stdout:3/284: fsync d5/d14/f2c 0 2024-09-13T21:40:21.269 INFO:tasks.workunit.client.0.smithi088.stdout:8/221: rmdir db/d26/d37 39 2024-09-13T21:40:21.269 INFO:tasks.workunit.client.0.smithi088.stdout:8/222: creat db/d26/d2c/f4c x:0 0 0 2024-09-13T21:40:21.271 INFO:tasks.workunit.client.0.smithi088.stdout:4/253: symlink d2/l57 0 2024-09-13T21:40:21.274 INFO:tasks.workunit.client.0.smithi088.stdout:3/285: creat d5/d26/d2d/d48/d49/f62 x:0 0 0 2024-09-13T21:40:21.274 INFO:tasks.workunit.client.0.smithi088.stdout:3/286: truncate d5/d26/d2d/d48/d49/f62 158865 0 2024-09-13T21:40:21.276 INFO:tasks.workunit.client.0.smithi088.stdout:8/223: symlink db/d33/l4d 0 2024-09-13T21:40:21.276 INFO:tasks.workunit.client.0.smithi088.stdout:8/224: chown db/l38 8908 1 2024-09-13T21:40:21.278 INFO:tasks.workunit.client.0.smithi088.stdout:0/265: rename d7/d1a to d7/d65 0 2024-09-13T21:40:21.278 INFO:tasks.workunit.client.0.smithi088.stdout:0/266: readlink d7/d65/l3a 0 2024-09-13T21:40:21.280 INFO:tasks.workunit.client.0.smithi088.stdout:2/282: dwrite d1/d8/d2e/f38 [0,4194304] 0 2024-09-13T21:40:21.280 INFO:tasks.workunit.client.0.smithi088.stdout:2/283: read - d1/d8/d16/d40/f60 zero size 2024-09-13T21:40:21.282 INFO:tasks.workunit.client.0.smithi088.stdout:0/267: mkdir d7/d1d/d66 0 2024-09-13T21:40:21.286 INFO:tasks.workunit.client.0.smithi088.stdout:4/254: getdents d2/d5/d20/d41/d4b 0 2024-09-13T21:40:21.287 INFO:tasks.workunit.client.0.smithi088.stdout:0/268: rmdir d7/d2c/d30/d31 39 2024-09-13T21:40:21.288 INFO:tasks.workunit.client.0.smithi088.stdout:6/292: dwrite d0/f52 [0,4194304] 0 2024-09-13T21:40:21.290 INFO:tasks.workunit.client.0.smithi088.stdout:6/293: dread d0/d1e/f49 [0,4194304] 0 2024-09-13T21:40:21.291 INFO:tasks.workunit.client.0.smithi088.stdout:6/294: readlink d0/l8 0 2024-09-13T21:40:21.291 INFO:tasks.workunit.client.0.smithi088.stdout:6/295: readlink d0/l8 0 2024-09-13T21:40:21.291 INFO:tasks.workunit.client.0.smithi088.stdout:0/269: link d7/d1d/c5e d7/d65/c67 0 2024-09-13T21:40:21.291 INFO:tasks.workunit.client.0.smithi088.stdout:2/284: dread d1/f34 [0,4194304] 0 2024-09-13T21:40:21.291 INFO:tasks.workunit.client.0.smithi088.stdout:6/296: write d0/d1e/f49 [73091,61123] 0 2024-09-13T21:40:21.292 INFO:tasks.workunit.client.0.smithi088.stdout:4/255: getdents d2/d9/de/d12 0 2024-09-13T21:40:21.294 INFO:tasks.workunit.client.0.smithi088.stdout:2/285: symlink d1/d13/l64 0 2024-09-13T21:40:21.296 INFO:tasks.workunit.client.0.smithi088.stdout:3/287: rename d5/d26/d2d to d5/d23/d2a/d63 0 2024-09-13T21:40:21.300 INFO:tasks.workunit.client.0.smithi088.stdout:6/297: dread d0/f22 [0,4194304] 0 2024-09-13T21:40:21.302 INFO:tasks.workunit.client.0.smithi088.stdout:4/256: dread d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:21.302 INFO:tasks.workunit.client.0.smithi088.stdout:6/298: mkdir d0/d2c/d59 0 2024-09-13T21:40:21.303 INFO:tasks.workunit.client.0.smithi088.stdout:4/257: creat d2/d9/de/f58 x:0 0 0 2024-09-13T21:40:21.306 INFO:tasks.workunit.client.0.smithi088.stdout:6/299: symlink d0/d1e/d1f/d55/l5a 0 2024-09-13T21:40:21.308 INFO:tasks.workunit.client.0.smithi088.stdout:4/258: rmdir d2/d9/de/d1e/d31 39 2024-09-13T21:40:21.309 INFO:tasks.workunit.client.0.smithi088.stdout:0/270: dwrite d7/d65/f22 [0,4194304] 0 2024-09-13T21:40:21.309 INFO:tasks.workunit.client.0.smithi088.stdout:6/300: dread d0/ff [4194304,4194304] 0 2024-09-13T21:40:21.310 INFO:tasks.workunit.client.0.smithi088.stdout:3/288: rmdir d5/d23/d2a/d63 39 2024-09-13T21:40:21.313 INFO:tasks.workunit.client.0.smithi088.stdout:0/271: rename d7/d1d/c5e to d7/d2c/d30/c68 0 2024-09-13T21:40:21.313 INFO:tasks.workunit.client.0.smithi088.stdout:3/289: rmdir d5/d23/d2a/d63/d48 39 2024-09-13T21:40:21.315 INFO:tasks.workunit.client.0.smithi088.stdout:3/290: creat d5/d23/d2a/d3f/f64 x:0 0 0 2024-09-13T21:40:21.315 INFO:tasks.workunit.client.0.smithi088.stdout:3/291: chown d5/d23/d2a/f40 129586537 1 2024-09-13T21:40:21.315 INFO:tasks.workunit.client.0.smithi088.stdout:3/292: creat d5/d23/f65 x:0 0 0 2024-09-13T21:40:21.317 INFO:tasks.workunit.client.0.smithi088.stdout:3/293: mknod d5/d23/d2a/d63/c66 0 2024-09-13T21:40:21.318 INFO:tasks.workunit.client.0.smithi088.stdout:3/294: read d5/d14/f37 [768857,131013] 0 2024-09-13T21:40:21.318 INFO:tasks.workunit.client.0.smithi088.stdout:3/295: chown d5/d14/l20 2554 1 2024-09-13T21:40:21.318 INFO:tasks.workunit.client.0.smithi088.stdout:3/296: truncate d5/f16 4712357 0 2024-09-13T21:40:21.318 INFO:tasks.workunit.client.0.smithi088.stdout:3/297: chown d5/d5a 44 1 2024-09-13T21:40:21.318 INFO:tasks.workunit.client.0.smithi088.stdout:2/286: dwrite d1/d13/d3f/f43 [0,4194304] 0 2024-09-13T21:40:21.326 INFO:tasks.workunit.client.0.smithi088.stdout:6/301: dread d0/d28/f40 [0,4194304] 0 2024-09-13T21:40:21.326 INFO:tasks.workunit.client.0.smithi088.stdout:6/302: stat d0/d1e/d1f/f4d 0 2024-09-13T21:40:21.326 INFO:tasks.workunit.client.0.smithi088.stdout:6/303: chown d0/d2c/l36 244456 1 2024-09-13T21:40:21.326 INFO:tasks.workunit.client.0.smithi088.stdout:6/304: chown d0/f52 64 1 2024-09-13T21:40:21.326 INFO:tasks.workunit.client.0.smithi088.stdout:6/305: write d0/d2c/f47 [2156278,27008] 0 2024-09-13T21:40:21.331 INFO:tasks.workunit.client.0.smithi088.stdout:3/298: mknod d5/d23/d2a/d63/d48/d49/c67 0 2024-09-13T21:40:21.332 INFO:tasks.workunit.client.0.smithi088.stdout:0/272: dwrite d7/d1d/d27/d43/f17 [4194304,4194304] 0 2024-09-13T21:40:21.334 INFO:tasks.workunit.client.0.smithi088.stdout:2/287: creat d1/d13/d2a/f65 x:0 0 0 2024-09-13T21:40:21.335 INFO:tasks.workunit.client.0.smithi088.stdout:0/273: unlink d7/d1d/d27/d43/c61 0 2024-09-13T21:40:21.338 INFO:tasks.workunit.client.0.smithi088.stdout:0/274: creat d7/d1d/f69 x:0 0 0 2024-09-13T21:40:21.339 INFO:tasks.workunit.client.0.smithi088.stdout:0/275: creat d7/d2c/d37/f6a x:0 0 0 2024-09-13T21:40:21.341 INFO:tasks.workunit.client.0.smithi088.stdout:5/259: sync 2024-09-13T21:40:21.341 INFO:tasks.workunit.client.0.smithi088.stdout:5/260: creat d4/d1b/f54 x:0 0 0 2024-09-13T21:40:21.341 INFO:tasks.workunit.client.0.smithi088.stdout:5/261: write d4/d1c/f4d [409075,79148] 0 2024-09-13T21:40:21.341 INFO:tasks.workunit.client.0.smithi088.stdout:5/262: fsync d4/d1c/f48 0 2024-09-13T21:40:21.345 INFO:tasks.workunit.client.0.smithi088.stdout:2/288: dread d1/f15 [4194304,4194304] 0 2024-09-13T21:40:21.346 INFO:tasks.workunit.client.0.smithi088.stdout:2/289: mkdir d1/d13/d2a/d3c/d4e/d66 0 2024-09-13T21:40:21.353 INFO:tasks.workunit.client.0.smithi088.stdout:6/306: dwrite d0/db/f2e [0,4194304] 0 2024-09-13T21:40:21.353 INFO:tasks.workunit.client.0.smithi088.stdout:3/299: dwrite d5/d23/d2a/f59 [0,4194304] 0 2024-09-13T21:40:21.354 INFO:tasks.workunit.client.0.smithi088.stdout:3/300: chown d5/d23/f3c 885547174 1 2024-09-13T21:40:21.354 INFO:tasks.workunit.client.0.smithi088.stdout:0/276: dread d7/d2c/d30/d31/f62 [0,4194304] 0 2024-09-13T21:40:21.354 INFO:tasks.workunit.client.0.smithi088.stdout:6/307: mknod d0/c5b 0 2024-09-13T21:40:21.354 INFO:tasks.workunit.client.0.smithi088.stdout:5/263: write d4/f13 [772718,13869] 0 2024-09-13T21:40:21.355 INFO:tasks.workunit.client.0.smithi088.stdout:6/308: write d0/db/f10 [1348725,10887] 0 2024-09-13T21:40:21.357 INFO:tasks.workunit.client.0.smithi088.stdout:2/290: getdents d1/d13/d2a 0 2024-09-13T21:40:21.357 INFO:tasks.workunit.client.0.smithi088.stdout:2/291: creat d1/d8/d16/d40/f67 x:0 0 0 2024-09-13T21:40:21.359 INFO:tasks.workunit.client.0.smithi088.stdout:0/277: mknod d7/c6b 0 2024-09-13T21:40:21.359 INFO:tasks.workunit.client.0.smithi088.stdout:0/278: chown d7/d65/f22 883901857 1 2024-09-13T21:40:21.360 INFO:tasks.workunit.client.0.smithi088.stdout:5/264: creat d4/d1c/d24/d26/f55 x:0 0 0 2024-09-13T21:40:21.360 INFO:tasks.workunit.client.0.smithi088.stdout:5/265: write d4/f1f [872593,35236] 0 2024-09-13T21:40:21.361 INFO:tasks.workunit.client.0.smithi088.stdout:6/309: dread d0/d28/f40 [0,4194304] 0 2024-09-13T21:40:21.362 INFO:tasks.workunit.client.0.smithi088.stdout:0/279: dread d7/d2c/d30/d31/f62 [0,4194304] 0 2024-09-13T21:40:21.363 INFO:tasks.workunit.client.0.smithi088.stdout:5/266: mkdir d4/d1c/d24/d26/d56 0 2024-09-13T21:40:21.369 INFO:tasks.workunit.client.0.smithi088.stdout:0/280: mkdir d7/d2c/d30/d31/d42/d6c 0 2024-09-13T21:40:21.370 INFO:tasks.workunit.client.0.smithi088.stdout:0/281: mknod d7/d1d/c6d 0 2024-09-13T21:40:21.372 INFO:tasks.workunit.client.0.smithi088.stdout:0/282: creat d7/d2c/d30/d31/f6e x:0 0 0 2024-09-13T21:40:21.372 INFO:tasks.workunit.client.0.smithi088.stdout:0/283: creat d7/d1d/d27/f6f x:0 0 0 2024-09-13T21:40:21.372 INFO:tasks.workunit.client.0.smithi088.stdout:0/284: dread - d7/d1d/d27/d43/f53 zero size 2024-09-13T21:40:21.373 INFO:tasks.workunit.client.0.smithi088.stdout:0/285: creat d7/d1d/d27/f70 x:0 0 0 2024-09-13T21:40:21.377 INFO:tasks.workunit.client.0.smithi088.stdout:6/310: write d0/db/f2e [3887541,38277] 0 2024-09-13T21:40:21.380 INFO:tasks.workunit.client.0.smithi088.stdout:6/311: link d0/db/f10 d0/d2c/d32/d39/d3f/f5c 0 2024-09-13T21:40:21.381 INFO:tasks.workunit.client.0.smithi088.stdout:6/312: truncate d0/f6 2214441 0 2024-09-13T21:40:21.384 INFO:tasks.workunit.client.0.smithi088.stdout:2/292: dwrite d1/d8/d2e/d44/f54 [0,4194304] 0 2024-09-13T21:40:21.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/267: dwrite d4/d1c/d24/f39 [0,4194304] 0 2024-09-13T21:40:21.387 INFO:tasks.workunit.client.0.smithi088.stdout:5/268: chown d4/d1c/f3e 18 1 2024-09-13T21:40:21.391 INFO:tasks.workunit.client.0.smithi088.stdout:5/269: rename d4/ce to d4/d1c/d24/d26/d4b/c57 0 2024-09-13T21:40:21.398 INFO:tasks.workunit.client.0.smithi088.stdout:5/270: write d4/fc [3268370,121431] 0 2024-09-13T21:40:21.398 INFO:tasks.workunit.client.0.smithi088.stdout:5/271: creat d4/d1c/f58 x:0 0 0 2024-09-13T21:40:21.398 INFO:tasks.workunit.client.0.smithi088.stdout:5/272: write d4/d1b/d2a/f3b [596153,104789] 0 2024-09-13T21:40:21.398 INFO:tasks.workunit.client.0.smithi088.stdout:5/273: write d4/d1c/f45 [984076,83007] 0 2024-09-13T21:40:21.398 INFO:tasks.workunit.client.0.smithi088.stdout:5/274: read d4/f22 [243801,70565] 0 2024-09-13T21:40:21.398 INFO:tasks.workunit.client.0.smithi088.stdout:5/275: chown d4/l19 12830205 1 2024-09-13T21:40:21.401 INFO:tasks.workunit.client.0.smithi088.stdout:5/276: rmdir d4/d1c/d4a 39 2024-09-13T21:40:21.403 INFO:tasks.workunit.client.0.smithi088.stdout:5/277: creat d4/d1c/d24/f59 x:0 0 0 2024-09-13T21:40:21.403 INFO:tasks.workunit.client.0.smithi088.stdout:5/278: write d4/d1b/f38 [1005611,17506] 0 2024-09-13T21:40:21.403 INFO:tasks.workunit.client.0.smithi088.stdout:5/279: chown d4/d1b/f54 13527260 1 2024-09-13T21:40:21.404 INFO:tasks.workunit.client.0.smithi088.stdout:5/280: creat d4/d1c/d24/d26/d40/f5a x:0 0 0 2024-09-13T21:40:21.404 INFO:tasks.workunit.client.0.smithi088.stdout:5/281: truncate d4/d1b/d2a/f3b 1163876 0 2024-09-13T21:40:21.407 INFO:tasks.workunit.client.0.smithi088.stdout:0/286: dwrite d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:21.409 INFO:tasks.workunit.client.0.smithi088.stdout:0/287: unlink d7/d1d/d26/l41 0 2024-09-13T21:40:21.416 INFO:tasks.workunit.client.0.smithi088.stdout:6/313: dwrite d0/d2c/f47 [0,4194304] 0 2024-09-13T21:40:21.416 INFO:tasks.workunit.client.0.smithi088.stdout:6/314: truncate d0/d2c/d32/d39/d3f/f5c 2042455 0 2024-09-13T21:40:21.416 INFO:tasks.workunit.client.0.smithi088.stdout:2/293: dwrite d1/d8/f19 [4194304,4194304] 0 2024-09-13T21:40:21.416 INFO:tasks.workunit.client.0.smithi088.stdout:2/294: write d1/d8/f47 [760704,40824] 0 2024-09-13T21:40:21.416 INFO:tasks.workunit.client.0.smithi088.stdout:2/295: chown d1/d13/f1a 12978 1 2024-09-13T21:40:21.416 INFO:tasks.workunit.client.0.smithi088.stdout:6/315: rmdir d0/db 39 2024-09-13T21:40:21.418 INFO:tasks.workunit.client.0.smithi088.stdout:6/316: dread d0/ff [4194304,4194304] 0 2024-09-13T21:40:21.419 INFO:tasks.workunit.client.0.smithi088.stdout:6/317: write d0/d1e/f49 [676962,37131] 0 2024-09-13T21:40:21.419 INFO:tasks.workunit.client.0.smithi088.stdout:6/318: readlink d0/d1e/d1f/l3a 0 2024-09-13T21:40:21.419 INFO:tasks.workunit.client.0.smithi088.stdout:6/319: chown d0/d2c/d32/d39/d3f 842566 1 2024-09-13T21:40:21.419 INFO:tasks.workunit.client.0.smithi088.stdout:6/320: readlink d0/db/l3e 0 2024-09-13T21:40:21.419 INFO:tasks.workunit.client.0.smithi088.stdout:2/296: unlink d1/fb 0 2024-09-13T21:40:21.419 INFO:tasks.workunit.client.0.smithi088.stdout:2/297: stat d1/d8/f14 0 2024-09-13T21:40:21.420 INFO:tasks.workunit.client.0.smithi088.stdout:2/298: truncate d1/d13/d2a/f65 130999 0 2024-09-13T21:40:21.420 INFO:tasks.workunit.client.0.smithi088.stdout:5/282: getdents d4/d1c/d24/d26/d4b 0 2024-09-13T21:40:21.421 INFO:tasks.workunit.client.0.smithi088.stdout:5/283: dread d4/f22 [0,4194304] 0 2024-09-13T21:40:21.423 INFO:tasks.workunit.client.0.smithi088.stdout:2/299: unlink d1/f36 0 2024-09-13T21:40:21.426 INFO:tasks.workunit.client.0.smithi088.stdout:5/284: unlink d4/d1c/d24/d26/l47 0 2024-09-13T21:40:21.426 INFO:tasks.workunit.client.0.smithi088.stdout:0/288: dwrite d7/d1d/d27/f70 [0,4194304] 0 2024-09-13T21:40:21.426 INFO:tasks.workunit.client.0.smithi088.stdout:5/285: stat d4/d1c/d24/f35 0 2024-09-13T21:40:21.428 INFO:tasks.workunit.client.0.smithi088.stdout:2/300: link d1/f15 d1/f68 0 2024-09-13T21:40:21.434 INFO:tasks.workunit.client.0.smithi088.stdout:6/321: truncate d0/d2c/d32/d39/d3f/f5c 1832978 0 2024-09-13T21:40:21.439 INFO:tasks.workunit.client.0.smithi088.stdout:5/286: mknod d4/d1c/d24/d26/d4b/c5b 0 2024-09-13T21:40:21.439 INFO:tasks.workunit.client.0.smithi088.stdout:5/287: creat d4/d1c/f5c x:0 0 0 2024-09-13T21:40:21.439 INFO:tasks.workunit.client.0.smithi088.stdout:2/301: mknod d1/d13/d2a/d3c/d4e/c69 0 2024-09-13T21:40:21.440 INFO:tasks.workunit.client.0.smithi088.stdout:5/288: creat d4/d1c/d4a/f5d x:0 0 0 2024-09-13T21:40:21.442 INFO:tasks.workunit.client.0.smithi088.stdout:0/289: dwrite d7/d1d/f69 [0,4194304] 0 2024-09-13T21:40:21.445 INFO:tasks.workunit.client.0.smithi088.stdout:0/290: symlink d7/d2c/d30/d31/l71 0 2024-09-13T21:40:21.448 INFO:tasks.workunit.client.0.smithi088.stdout:2/302: write d1/d8/f19 [1088448,74354] 0 2024-09-13T21:40:21.448 INFO:tasks.workunit.client.0.smithi088.stdout:2/303: chown d1/fd 839624726 1 2024-09-13T21:40:21.452 INFO:tasks.workunit.client.0.smithi088.stdout:7/243: sync 2024-09-13T21:40:21.452 INFO:tasks.workunit.client.0.smithi088.stdout:9/252: sync 2024-09-13T21:40:21.452 INFO:tasks.workunit.client.0.smithi088.stdout:1/320: sync 2024-09-13T21:40:21.452 INFO:tasks.workunit.client.0.smithi088.stdout:3/301: sync 2024-09-13T21:40:21.453 INFO:tasks.workunit.client.0.smithi088.stdout:4/259: sync 2024-09-13T21:40:21.453 INFO:tasks.workunit.client.0.smithi088.stdout:8/225: sync 2024-09-13T21:40:21.453 INFO:tasks.workunit.client.0.smithi088.stdout:6/322: write d0/db/f10 [1723636,105293] 0 2024-09-13T21:40:21.455 INFO:tasks.workunit.client.0.smithi088.stdout:7/244: creat d6/d4e/f51 x:0 0 0 2024-09-13T21:40:21.455 INFO:tasks.workunit.client.0.smithi088.stdout:9/253: rename d1a/d34/d3d/l3e to d1a/d34/d3d/d41/l4e 0 2024-09-13T21:40:21.455 INFO:tasks.workunit.client.0.smithi088.stdout:1/321: mknod d9/d4f/d64/c78 0 2024-09-13T21:40:21.456 INFO:tasks.workunit.client.0.smithi088.stdout:5/289: dread d4/d1c/d24/d26/d40/f46 [0,4194304] 0 2024-09-13T21:40:21.461 INFO:tasks.workunit.client.0.smithi088.stdout:3/302: rmdir d5/d23/d2a/d63 39 2024-09-13T21:40:21.461 INFO:tasks.workunit.client.0.smithi088.stdout:4/260: creat d2/d13/d50/f59 x:0 0 0 2024-09-13T21:40:21.461 INFO:tasks.workunit.client.0.smithi088.stdout:4/261: readlink d2/d5/d2d/l44 0 2024-09-13T21:40:21.464 INFO:tasks.workunit.client.0.smithi088.stdout:9/254: truncate d1a/d1b/f35 815365 0 2024-09-13T21:40:21.464 INFO:tasks.workunit.client.0.smithi088.stdout:5/290: creat d4/d1b/d2a/f5e x:0 0 0 2024-09-13T21:40:21.464 INFO:tasks.workunit.client.0.smithi088.stdout:5/291: stat d4/d1c/f3e 0 2024-09-13T21:40:21.464 INFO:tasks.workunit.client.0.smithi088.stdout:8/226: rmdir db/d26 39 2024-09-13T21:40:21.464 INFO:tasks.workunit.client.0.smithi088.stdout:8/227: write db/d26/f36 [1029440,45258] 0 2024-09-13T21:40:21.465 INFO:tasks.workunit.client.0.smithi088.stdout:6/323: dread d0/f17 [0,4194304] 0 2024-09-13T21:40:21.470 INFO:tasks.workunit.client.0.smithi088.stdout:4/262: rename d2/d9/l22 to d2/d9/de/l5a 0 2024-09-13T21:40:21.470 INFO:tasks.workunit.client.0.smithi088.stdout:4/263: chown d2/d5/d20/d41/d4b 8 1 2024-09-13T21:40:21.471 INFO:tasks.workunit.client.0.smithi088.stdout:6/324: creat d0/db/f5d x:0 0 0 2024-09-13T21:40:21.473 INFO:tasks.workunit.client.0.smithi088.stdout:4/264: mknod d2/d13/c5b 0 2024-09-13T21:40:21.473 INFO:tasks.workunit.client.0.smithi088.stdout:6/325: truncate d0/d2c/f47 708457 0 2024-09-13T21:40:21.473 INFO:tasks.workunit.client.0.smithi088.stdout:4/265: fsync d2/d5/f24 0 2024-09-13T21:40:21.473 INFO:tasks.workunit.client.0.smithi088.stdout:4/266: fdatasync d2/d9/de/d12/f34 0 2024-09-13T21:40:21.473 INFO:tasks.workunit.client.0.smithi088.stdout:0/291: dwrite d7/f23 [0,4194304] 0 2024-09-13T21:40:21.476 INFO:tasks.workunit.client.0.smithi088.stdout:6/326: mknod d0/d2c/d32/d39/c5e 0 2024-09-13T21:40:21.479 INFO:tasks.workunit.client.0.smithi088.stdout:4/267: dread d2/d5/d2d/f3e [0,4194304] 0 2024-09-13T21:40:21.480 INFO:tasks.workunit.client.0.smithi088.stdout:0/292: link d7/d2c/d30/c68 d7/d2c/d44/c72 0 2024-09-13T21:40:21.480 INFO:tasks.workunit.client.0.smithi088.stdout:0/293: write d7/d1d/d3d/f57 [636142,110991] 0 2024-09-13T21:40:21.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/294: rmdir d7/d5c 0 2024-09-13T21:40:21.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/295: fsync d7/d2c/d30/d31/f62 0 2024-09-13T21:40:21.482 INFO:tasks.workunit.client.0.smithi088.stdout:0/296: readlink d7/d2c/d44/l63 0 2024-09-13T21:40:21.485 INFO:tasks.workunit.client.0.smithi088.stdout:0/297: symlink d7/d2c/l73 0 2024-09-13T21:40:21.487 INFO:tasks.workunit.client.0.smithi088.stdout:0/298: creat d7/d2c/d30/d31/d42/f74 x:0 0 0 2024-09-13T21:40:21.489 INFO:tasks.workunit.client.0.smithi088.stdout:0/299: mkdir d7/d2c/d30/d31/d42/d4b/d75 0 2024-09-13T21:40:21.501 INFO:tasks.workunit.client.0.smithi088.stdout:7/245: dwrite d6/f18 [0,4194304] 0 2024-09-13T21:40:21.505 INFO:tasks.workunit.client.0.smithi088.stdout:8/228: dwrite db/df/f3d [0,4194304] 0 2024-09-13T21:40:21.505 INFO:tasks.workunit.client.0.smithi088.stdout:8/229: write db/d26/d37/f46 [839002,2134] 0 2024-09-13T21:40:21.506 INFO:tasks.workunit.client.0.smithi088.stdout:1/322: dwrite d9/dc/f42 [0,4194304] 0 2024-09-13T21:40:21.506 INFO:tasks.workunit.client.0.smithi088.stdout:9/255: dwrite d1a/d1b/f22 [0,4194304] 0 2024-09-13T21:40:21.506 INFO:tasks.workunit.client.0.smithi088.stdout:9/256: truncate d1a/d1b/f28 4950809 0 2024-09-13T21:40:21.506 INFO:tasks.workunit.client.0.smithi088.stdout:3/303: dwrite d5/d14/f37 [0,4194304] 0 2024-09-13T21:40:21.506 INFO:tasks.workunit.client.0.smithi088.stdout:4/268: dwrite d2/d9/f2a [0,4194304] 0 2024-09-13T21:40:21.511 INFO:tasks.workunit.client.0.smithi088.stdout:2/304: dwrite d1/d8/d16/f23 [0,4194304] 0 2024-09-13T21:40:21.512 INFO:tasks.workunit.client.0.smithi088.stdout:8/230: dread db/f23 [0,4194304] 0 2024-09-13T21:40:21.514 INFO:tasks.workunit.client.0.smithi088.stdout:3/304: rmdir d5/d23/d2a/d63/d48/d49 39 2024-09-13T21:40:21.516 INFO:tasks.workunit.client.0.smithi088.stdout:4/269: chown d2/d9/de/c29 2 1 2024-09-13T21:40:21.516 INFO:tasks.workunit.client.0.smithi088.stdout:4/270: dread - d2/d9/d19/f3f zero size 2024-09-13T21:40:21.517 INFO:tasks.workunit.client.0.smithi088.stdout:9/257: dread d1a/f1c [0,4194304] 0 2024-09-13T21:40:21.517 INFO:tasks.workunit.client.0.smithi088.stdout:9/258: fsync f17 0 2024-09-13T21:40:21.517 INFO:tasks.workunit.client.0.smithi088.stdout:9/259: fdatasync d1a/d34/d3d/d41/f46 0 2024-09-13T21:40:21.520 INFO:tasks.workunit.client.0.smithi088.stdout:8/231: getdents db/df/d25 0 2024-09-13T21:40:21.521 INFO:tasks.workunit.client.0.smithi088.stdout:8/232: truncate db/df/d25/f28 1122758 0 2024-09-13T21:40:21.523 INFO:tasks.workunit.client.0.smithi088.stdout:3/305: mknod d5/d23/d2a/d3f/c68 0 2024-09-13T21:40:21.527 INFO:tasks.workunit.client.0.smithi088.stdout:4/271: unlink d2/d5/f24 0 2024-09-13T21:40:21.528 INFO:tasks.workunit.client.0.smithi088.stdout:9/260: truncate fb 42936 0 2024-09-13T21:40:21.530 INFO:tasks.workunit.client.0.smithi088.stdout:8/233: symlink db/l4e 0 2024-09-13T21:40:21.531 INFO:tasks.workunit.client.0.smithi088.stdout:4/272: read d2/f45 [1555403,119964] 0 2024-09-13T21:40:21.531 INFO:tasks.workunit.client.0.smithi088.stdout:7/246: dwrite d6/da/d1a/f21 [0,4194304] 0 2024-09-13T21:40:21.532 INFO:tasks.workunit.client.0.smithi088.stdout:9/261: creat d1a/d34/d3d/d41/d48/f4f x:0 0 0 2024-09-13T21:40:21.533 INFO:tasks.workunit.client.0.smithi088.stdout:0/300: getdents d7/d2c 0 2024-09-13T21:40:21.533 INFO:tasks.workunit.client.0.smithi088.stdout:0/301: chown d7/d2c/d30/d31/d42/d4b/d75 165 1 2024-09-13T21:40:21.533 INFO:tasks.workunit.client.0.smithi088.stdout:0/302: readlink d7/d2c/l4d 0 2024-09-13T21:40:21.534 INFO:tasks.workunit.client.0.smithi088.stdout:8/234: mkdir db/d26/d4f 0 2024-09-13T21:40:21.536 INFO:tasks.workunit.client.0.smithi088.stdout:4/273: creat d2/d5/d20/f5c x:0 0 0 2024-09-13T21:40:21.537 INFO:tasks.workunit.client.0.smithi088.stdout:7/247: rmdir d6/da/d1a/d3a 39 2024-09-13T21:40:21.540 INFO:tasks.workunit.client.0.smithi088.stdout:0/303: link d7/d1d/f29 d7/d65/f76 0 2024-09-13T21:40:21.541 INFO:tasks.workunit.client.0.smithi088.stdout:0/304: stat d7/d2c/d30/d31/f62 0 2024-09-13T21:40:21.542 INFO:tasks.workunit.client.0.smithi088.stdout:8/235: rmdir db/d26 39 2024-09-13T21:40:21.543 INFO:tasks.workunit.client.0.smithi088.stdout:4/274: symlink d2/d13/l5d 0 2024-09-13T21:40:21.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/305: mknod d7/d1d/d26/c77 0 2024-09-13T21:40:21.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/306: chown d7/d65/c67 83 1 2024-09-13T21:40:21.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/307: fdatasync d7/d65/f76 0 2024-09-13T21:40:21.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/308: chown d7/d1d/d21/c3c 398390 1 2024-09-13T21:40:21.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/275: mknod d2/c5e 0 2024-09-13T21:40:21.545 INFO:tasks.workunit.client.0.smithi088.stdout:9/262: read f10 [1803878,98330] 0 2024-09-13T21:40:21.545 INFO:tasks.workunit.client.0.smithi088.stdout:0/309: mkdir d7/d2c/d78 0 2024-09-13T21:40:21.545 INFO:tasks.workunit.client.0.smithi088.stdout:0/310: fsync d7/f28 0 2024-09-13T21:40:21.546 INFO:tasks.workunit.client.0.smithi088.stdout:9/263: symlink d1a/d3c/l50 0 2024-09-13T21:40:21.546 INFO:tasks.workunit.client.0.smithi088.stdout:9/264: truncate f10 4414278 0 2024-09-13T21:40:21.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/265: readlink d1a/d1b/l33 0 2024-09-13T21:40:21.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/266: dread - d1a/f49 zero size 2024-09-13T21:40:21.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/267: dread - d1a/d1b/f2d zero size 2024-09-13T21:40:21.547 INFO:tasks.workunit.client.0.smithi088.stdout:0/311: symlink d7/l79 0 2024-09-13T21:40:21.547 INFO:tasks.workunit.client.0.smithi088.stdout:9/268: mkdir d1a/d3c/d51 0 2024-09-13T21:40:21.552 INFO:tasks.workunit.client.0.smithi088.stdout:5/292: dwrite d4/d1c/f45 [0,4194304] 0 2024-09-13T21:40:21.554 INFO:tasks.workunit.client.0.smithi088.stdout:8/236: dread db/d26/f2b [0,4194304] 0 2024-09-13T21:40:21.555 INFO:tasks.workunit.client.0.smithi088.stdout:5/293: mknod d4/d1b/d2a/c5f 0 2024-09-13T21:40:21.558 INFO:tasks.workunit.client.0.smithi088.stdout:8/237: creat db/d26/f50 x:0 0 0 2024-09-13T21:40:21.558 INFO:tasks.workunit.client.0.smithi088.stdout:8/238: write db/d26/d2c/f4c [1038599,99216] 0 2024-09-13T21:40:21.558 INFO:tasks.workunit.client.0.smithi088.stdout:6/327: dwrite d0/db/f2e [0,4194304] 0 2024-09-13T21:40:21.559 INFO:tasks.workunit.client.0.smithi088.stdout:3/306: dwrite d5/d23/d2a/d63/d31/f4e [0,4194304] 0 2024-09-13T21:40:21.560 INFO:tasks.workunit.client.0.smithi088.stdout:5/294: symlink d4/d1c/d24/d26/l60 0 2024-09-13T21:40:21.561 INFO:tasks.workunit.client.0.smithi088.stdout:1/323: dwrite f1 [0,4194304] 0 2024-09-13T21:40:21.561 INFO:tasks.workunit.client.0.smithi088.stdout:2/305: dwrite d1/f68 [0,4194304] 0 2024-09-13T21:40:21.561 INFO:tasks.workunit.client.0.smithi088.stdout:1/324: dread - d9/d10/d2a/f55 zero size 2024-09-13T21:40:21.565 INFO:tasks.workunit.client.0.smithi088.stdout:4/276: dwrite d2/d5/f14 [0,4194304] 0 2024-09-13T21:40:21.567 INFO:tasks.workunit.client.0.smithi088.stdout:5/295: creat d4/d1b/d2a/f61 x:0 0 0 2024-09-13T21:40:21.567 INFO:tasks.workunit.client.0.smithi088.stdout:5/296: chown d4/d1c/d4a/f5d 25 1 2024-09-13T21:40:21.567 INFO:tasks.workunit.client.0.smithi088.stdout:5/297: truncate d4/d1c/d24/f59 525484 0 2024-09-13T21:40:21.569 INFO:tasks.workunit.client.0.smithi088.stdout:3/307: write d5/d23/d2a/f59 [811559,55228] 0 2024-09-13T21:40:21.569 INFO:tasks.workunit.client.0.smithi088.stdout:3/308: fsync d5/d14/f54 0 2024-09-13T21:40:21.569 INFO:tasks.workunit.client.0.smithi088.stdout:3/309: creat d5/d23/d2a/d3f/f69 x:0 0 0 2024-09-13T21:40:21.571 INFO:tasks.workunit.client.0.smithi088.stdout:9/269: getdents d1a/d34/d3d/d41/d48 0 2024-09-13T21:40:21.576 INFO:tasks.workunit.client.0.smithi088.stdout:8/239: dread db/d26/d2c/f32 [0,4194304] 0 2024-09-13T21:40:21.576 INFO:tasks.workunit.client.0.smithi088.stdout:8/240: truncate db/d26/d37/f46 1474650 0 2024-09-13T21:40:21.576 INFO:tasks.workunit.client.0.smithi088.stdout:4/277: write d2/d9/de/d1e/f26 [4202319,77104] 0 2024-09-13T21:40:21.583 INFO:tasks.workunit.client.0.smithi088.stdout:3/310: write d5/f22 [2087817,121112] 0 2024-09-13T21:40:21.587 INFO:tasks.workunit.client.0.smithi088.stdout:5/298: mknod d4/d1c/d24/d26/c62 0 2024-09-13T21:40:21.587 INFO:tasks.workunit.client.0.smithi088.stdout:0/312: dwrite d7/d1d/d27/f39 [0,4194304] 0 2024-09-13T21:40:21.590 INFO:tasks.workunit.client.0.smithi088.stdout:9/270: unlink d1a/f30 0 2024-09-13T21:40:21.590 INFO:tasks.workunit.client.0.smithi088.stdout:9/271: dread - d1a/d1b/f38 zero size 2024-09-13T21:40:21.591 INFO:tasks.workunit.client.0.smithi088.stdout:1/325: dwrite d9/d10/d2a/d4b/d39/d43/f4d [0,4194304] 0 2024-09-13T21:40:21.591 INFO:tasks.workunit.client.0.smithi088.stdout:1/326: write d9/d10/f11 [5646614,102523] 0 2024-09-13T21:40:21.591 INFO:tasks.workunit.client.0.smithi088.stdout:2/306: dwrite d1/d8/f19 [0,4194304] 0 2024-09-13T21:40:21.592 INFO:tasks.workunit.client.0.smithi088.stdout:8/241: mkdir db/d33/d51 0 2024-09-13T21:40:21.596 INFO:tasks.workunit.client.0.smithi088.stdout:3/311: mknod d5/d23/d2a/d55/c6a 0 2024-09-13T21:40:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:21 smithi116 ceph-mon[33391]: pgmap v250: 65 pgs: 65 active+clean; 484 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 30 MiB/s rd, 47 MiB/s wr, 733 op/s 2024-09-13T21:40:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:21 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:21 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:21 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:21.598 INFO:tasks.workunit.client.0.smithi088.stdout:5/299: mkdir d4/d1c/d4a/d63 0 2024-09-13T21:40:21.601 INFO:tasks.workunit.client.0.smithi088.stdout:0/313: creat d7/d2c/d78/f7a x:0 0 0 2024-09-13T21:40:21.601 INFO:tasks.workunit.client.0.smithi088.stdout:0/314: creat d7/f7b x:0 0 0 2024-09-13T21:40:21.602 INFO:tasks.workunit.client.0.smithi088.stdout:5/300: dread d4/d1c/f4d [0,4194304] 0 2024-09-13T21:40:21.604 INFO:tasks.workunit.client.0.smithi088.stdout:2/307: link d1/d8/l49 d1/d13/d3f/l6a 0 2024-09-13T21:40:21.604 INFO:tasks.workunit.client.0.smithi088.stdout:4/278: symlink d2/d9/de/l5f 0 2024-09-13T21:40:21.605 INFO:tasks.workunit.client.0.smithi088.stdout:9/272: dread d1a/d1b/f22 [0,4194304] 0 2024-09-13T21:40:21.605 INFO:tasks.workunit.client.0.smithi088.stdout:9/273: dread - d1a/d34/d3d/d41/f44 zero size 2024-09-13T21:40:21.607 INFO:tasks.workunit.client.0.smithi088.stdout:8/242: dwrite db/d26/f35 [0,4194304] 0 2024-09-13T21:40:21.608 INFO:tasks.workunit.client.0.smithi088.stdout:0/315: rmdir d7/d2c/d30/d31/d42/d6c 0 2024-09-13T21:40:21.609 INFO:tasks.workunit.client.0.smithi088.stdout:2/308: mknod d1/d8/d16/c6b 0 2024-09-13T21:40:21.609 INFO:tasks.workunit.client.0.smithi088.stdout:2/309: write d1/d13/f1a [5028238,71243] 0 2024-09-13T21:40:21.609 INFO:tasks.workunit.client.0.smithi088.stdout:2/310: chown d1/d13/d3f/f43 5 1 2024-09-13T21:40:21.611 INFO:tasks.workunit.client.0.smithi088.stdout:1/327: dwrite d9/d10/f3f [0,4194304] 0 2024-09-13T21:40:21.612 INFO:tasks.workunit.client.0.smithi088.stdout:9/274: creat d1a/d3c/d51/f52 x:0 0 0 2024-09-13T21:40:21.617 INFO:tasks.workunit.client.0.smithi088.stdout:8/243: creat db/d33/f52 x:0 0 0 2024-09-13T21:40:21.617 INFO:tasks.workunit.client.0.smithi088.stdout:8/244: creat db/d33/f53 x:0 0 0 2024-09-13T21:40:21.619 INFO:tasks.workunit.client.0.smithi088.stdout:5/301: dwrite d4/d1b/f43 [0,4194304] 0 2024-09-13T21:40:21.619 INFO:tasks.workunit.client.0.smithi088.stdout:0/316: mkdir d7/d1d/d26/d45/d7c 0 2024-09-13T21:40:21.619 INFO:tasks.workunit.client.0.smithi088.stdout:0/317: creat d7/d2c/d37/f7d x:0 0 0 2024-09-13T21:40:21.623 INFO:tasks.workunit.client.0.smithi088.stdout:3/312: rename d5/d23/d2a/d3f/d4f to d5/d23/d2a/d6b 0 2024-09-13T21:40:21.623 INFO:tasks.workunit.client.0.smithi088.stdout:3/313: truncate d5/d23/f3c 1173122 0 2024-09-13T21:40:21.628 INFO:tasks.workunit.client.0.smithi088.stdout:3/314: read d5/d26/f33 [2667478,33449] 0 2024-09-13T21:40:21.629 INFO:tasks.workunit.client.0.smithi088.stdout:5/302: creat d4/d1c/d24/d26/d56/f64 x:0 0 0 2024-09-13T21:40:21.633 INFO:tasks.workunit.client.0.smithi088.stdout:9/275: unlink d1a/l1e 0 2024-09-13T21:40:21.635 INFO:tasks.workunit.client.0.smithi088.stdout:2/311: dwrite d1/d13/d2a/f2b [0,4194304] 0 2024-09-13T21:40:21.635 INFO:tasks.workunit.client.0.smithi088.stdout:8/245: link db/df/f3d db/d33/d51/f54 0 2024-09-13T21:40:21.635 INFO:tasks.workunit.client.0.smithi088.stdout:1/328: dwrite d9/d10/d2a/d4b/d39/d43/f4d [0,4194304] 0 2024-09-13T21:40:21.637 INFO:tasks.workunit.client.0.smithi088.stdout:3/315: rename d5/d23/f65 to d5/d23/f6c 0 2024-09-13T21:40:21.639 INFO:tasks.workunit.client.0.smithi088.stdout:5/303: mknod d4/d1c/d24/d26/c65 0 2024-09-13T21:40:21.639 INFO:tasks.workunit.client.0.smithi088.stdout:5/304: write d4/d1b/d2a/f61 [483761,76514] 0 2024-09-13T21:40:21.639 INFO:tasks.workunit.client.0.smithi088.stdout:1/329: dread d9/d10/d2a/d4b/f23 [0,4194304] 0 2024-09-13T21:40:21.639 INFO:tasks.workunit.client.0.smithi088.stdout:1/330: creat d9/d10/d2a/d4b/d39/d43/f79 x:0 0 0 2024-09-13T21:40:21.644 INFO:tasks.workunit.client.0.smithi088.stdout:0/318: getdents d7/d2c/d30/d31/d42 0 2024-09-13T21:40:21.645 INFO:tasks.workunit.client.0.smithi088.stdout:9/276: dread d1a/d1b/f25 [0,4194304] 0 2024-09-13T21:40:21.646 INFO:tasks.workunit.client.0.smithi088.stdout:5/305: write d4/d1c/f45 [222735,50983] 0 2024-09-13T21:40:21.646 INFO:tasks.workunit.client.0.smithi088.stdout:5/306: stat d4/d1b/f54 0 2024-09-13T21:40:21.650 INFO:tasks.workunit.client.0.smithi088.stdout:8/246: rename db/df/c16 to db/df/c55 0 2024-09-13T21:40:21.658 INFO:tasks.workunit.client.0.smithi088.stdout:3/316: mknod d5/d23/d2a/c6d 0 2024-09-13T21:40:21.658 INFO:tasks.workunit.client.0.smithi088.stdout:3/317: read d5/d26/f27 [763754,100332] 0 2024-09-13T21:40:21.658 INFO:tasks.workunit.client.0.smithi088.stdout:3/318: read - d5/d23/d2a/d3f/f64 zero size 2024-09-13T21:40:21.660 INFO:tasks.workunit.client.0.smithi088.stdout:1/331: mknod d9/d10/d2a/d4b/d3a/c7a 0 2024-09-13T21:40:21.661 INFO:tasks.workunit.client.0.smithi088.stdout:0/319: symlink d7/d2c/d30/d31/l7e 0 2024-09-13T21:40:21.661 INFO:tasks.workunit.client.0.smithi088.stdout:0/320: truncate d7/d1d/d21/f4c 425066 0 2024-09-13T21:40:21.664 INFO:tasks.workunit.client.0.smithi088.stdout:5/307: mkdir d4/d1c/d24/d26/d4b/d66 0 2024-09-13T21:40:21.664 INFO:tasks.workunit.client.0.smithi088.stdout:4/279: rename d2/d9 to d2/d5/d20/d60 0 2024-09-13T21:40:21.664 INFO:tasks.workunit.client.0.smithi088.stdout:4/280: readlink d2/d5/d20/d41/l42 0 2024-09-13T21:40:21.665 INFO:tasks.workunit.client.0.smithi088.stdout:1/332: unlink d9/d10/d2a/d4b/d39/d43/c5e 0 2024-09-13T21:40:21.665 INFO:tasks.workunit.client.0.smithi088.stdout:0/321: symlink d7/d1d/d26/d45/l7f 0 2024-09-13T21:40:21.666 INFO:tasks.workunit.client.0.smithi088.stdout:5/308: mkdir d4/d1c/d24/d26/d4b/d67 0 2024-09-13T21:40:21.666 INFO:tasks.workunit.client.0.smithi088.stdout:4/281: truncate d2/d5/d2d/f3e 1571654 0 2024-09-13T21:40:21.667 INFO:tasks.workunit.client.0.smithi088.stdout:1/333: symlink d9/l7b 0 2024-09-13T21:40:21.668 INFO:tasks.workunit.client.0.smithi088.stdout:8/247: dwrite db/df/d25/f28 [0,4194304] 0 2024-09-13T21:40:21.668 INFO:tasks.workunit.client.0.smithi088.stdout:9/277: dwrite d1a/d1b/f40 [0,4194304] 0 2024-09-13T21:40:21.668 INFO:tasks.workunit.client.0.smithi088.stdout:9/278: creat d1a/d1b/f53 x:0 0 0 2024-09-13T21:40:21.669 INFO:tasks.workunit.client.0.smithi088.stdout:0/322: creat d7/d1d/d21/f80 x:0 0 0 2024-09-13T21:40:21.669 INFO:tasks.workunit.client.0.smithi088.stdout:0/323: creat d7/f81 x:0 0 0 2024-09-13T21:40:21.671 INFO:tasks.workunit.client.0.smithi088.stdout:5/309: mkdir d4/d1b/d68 0 2024-09-13T21:40:21.671 INFO:tasks.workunit.client.0.smithi088.stdout:5/310: truncate d4/d1c/f5c 1035559 0 2024-09-13T21:40:21.671 INFO:tasks.workunit.client.0.smithi088.stdout:5/311: fsync f2 0 2024-09-13T21:40:21.672 INFO:tasks.workunit.client.0.smithi088.stdout:4/282: mkdir d2/d5/d20/d60/de/d1e/d31/d61 0 2024-09-13T21:40:21.675 INFO:tasks.workunit.client.0.smithi088.stdout:1/334: mknod d9/d10/d2a/d47/c7c 0 2024-09-13T21:40:21.681 INFO:tasks.workunit.client.0.smithi088.stdout:9/279: mknod d1a/d3c/d51/c54 0 2024-09-13T21:40:21.681 INFO:tasks.workunit.client.0.smithi088.stdout:9/280: creat d1a/d1b/d3f/f55 x:0 0 0 2024-09-13T21:40:21.681 INFO:tasks.workunit.client.0.smithi088.stdout:9/281: write fb [384261,114943] 0 2024-09-13T21:40:21.683 INFO:tasks.workunit.client.0.smithi088.stdout:5/312: mknod d4/d1c/c69 0 2024-09-13T21:40:21.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/283: mknod d2/d5/d2d/c62 0 2024-09-13T21:40:21.685 INFO:tasks.workunit.client.0.smithi088.stdout:8/248: dwrite db/f24 [0,4194304] 0 2024-09-13T21:40:21.685 INFO:tasks.workunit.client.0.smithi088.stdout:8/249: dread - db/df/f49 zero size 2024-09-13T21:40:21.686 INFO:tasks.workunit.client.0.smithi088.stdout:1/335: mkdir d9/d10/d41/d7d 0 2024-09-13T21:40:21.687 INFO:tasks.workunit.client.0.smithi088.stdout:1/336: creat d9/d10/f7e x:0 0 0 2024-09-13T21:40:21.687 INFO:tasks.workunit.client.0.smithi088.stdout:1/337: chown d9/l3b 685604 1 2024-09-13T21:40:21.687 INFO:tasks.workunit.client.0.smithi088.stdout:1/338: fsync d9/d10/f11 0 2024-09-13T21:40:21.688 INFO:tasks.workunit.client.0.smithi088.stdout:9/282: chown d1a/f3b 2 1 2024-09-13T21:40:21.688 INFO:tasks.workunit.client.0.smithi088.stdout:9/283: write d1a/f20 [1021081,130953] 0 2024-09-13T21:40:21.690 INFO:tasks.workunit.client.0.smithi088.stdout:0/324: getdents d7/d1d/d3d 0 2024-09-13T21:40:21.691 INFO:tasks.workunit.client.0.smithi088.stdout:4/284: truncate d2/d5/d20/d60/f2a 1526123 0 2024-09-13T21:40:21.694 INFO:tasks.workunit.client.0.smithi088.stdout:8/250: dread f8 [4194304,4194304] 0 2024-09-13T21:40:21.694 INFO:tasks.workunit.client.0.smithi088.stdout:8/251: chown db/df/l1e 974 1 2024-09-13T21:40:21.696 INFO:tasks.workunit.client.0.smithi088.stdout:1/339: mknod d9/dc/d74/c7f 0 2024-09-13T21:40:21.696 INFO:tasks.workunit.client.0.smithi088.stdout:1/340: chown d9/d10/d2a/d4b/l48 118367 1 2024-09-13T21:40:21.697 INFO:tasks.workunit.client.0.smithi088.stdout:9/284: symlink d1a/d34/d3d/d41/d48/l56 0 2024-09-13T21:40:21.698 INFO:tasks.workunit.client.0.smithi088.stdout:0/325: mkdir d7/d1d/d21/d82 0 2024-09-13T21:40:21.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/252: dread db/df/f1f [0,4194304] 0 2024-09-13T21:40:21.701 INFO:tasks.workunit.client.0.smithi088.stdout:4/285: rename d2/d5/d20/d60/l33 to d2/d5/d20/d60/de/d1e/d23/d3c/l63 0 2024-09-13T21:40:21.703 INFO:tasks.workunit.client.0.smithi088.stdout:7/248: sync 2024-09-13T21:40:21.703 INFO:tasks.workunit.client.0.smithi088.stdout:6/328: sync 2024-09-13T21:40:21.703 INFO:tasks.workunit.client.0.smithi088.stdout:6/329: chown d0/d2c/d32/d39/c3b 326051 1 2024-09-13T21:40:21.703 INFO:tasks.workunit.client.0.smithi088.stdout:7/249: write d6/d4e/f51 [492797,13934] 0 2024-09-13T21:40:21.703 INFO:tasks.workunit.client.0.smithi088.stdout:7/250: chown d6/da/d39/d4f/l4d 698306 1 2024-09-13T21:40:21.703 INFO:tasks.workunit.client.0.smithi088.stdout:1/341: creat d9/d10/d41/d7d/f80 x:0 0 0 2024-09-13T21:40:21.704 INFO:tasks.workunit.client.0.smithi088.stdout:5/313: dwrite d4/d1c/f4d [0,4194304] 0 2024-09-13T21:40:21.704 INFO:tasks.workunit.client.0.smithi088.stdout:9/285: dread f14 [0,4194304] 0 2024-09-13T21:40:21.704 INFO:tasks.workunit.client.0.smithi088.stdout:9/286: write d1a/d34/d3d/d41/d48/f4f [385729,62317] 0 2024-09-13T21:40:21.707 INFO:tasks.workunit.client.0.smithi088.stdout:6/330: symlink d0/l5f 0 2024-09-13T21:40:21.707 INFO:tasks.workunit.client.0.smithi088.stdout:6/331: chown d0/db/f10 20 1 2024-09-13T21:40:21.707 INFO:tasks.workunit.client.0.smithi088.stdout:6/332: creat d0/db/f60 x:0 0 0 2024-09-13T21:40:21.709 INFO:tasks.workunit.client.0.smithi088.stdout:1/342: chown d9/dc/l2d 868 1 2024-09-13T21:40:21.709 INFO:tasks.workunit.client.0.smithi088.stdout:1/343: dread - d9/d10/d2a/d4b/d61/f70 zero size 2024-09-13T21:40:21.712 INFO:tasks.workunit.client.0.smithi088.stdout:0/326: dread d7/d1d/d21/f2a [0,4194304] 0 2024-09-13T21:40:21.712 INFO:tasks.workunit.client.0.smithi088.stdout:5/314: mkdir d4/d1c/d4a/d63/d6a 0 2024-09-13T21:40:21.712 INFO:tasks.workunit.client.0.smithi088.stdout:0/327: creat d7/d2c/d37/f83 x:0 0 0 2024-09-13T21:40:21.713 INFO:tasks.workunit.client.0.smithi088.stdout:9/287: getdents d1a/d34/d3d 0 2024-09-13T21:40:21.713 INFO:tasks.workunit.client.0.smithi088.stdout:9/288: truncate d1a/d34/d3d/d41/f44 739912 0 2024-09-13T21:40:21.715 INFO:tasks.workunit.client.0.smithi088.stdout:8/253: getdents db/d26 0 2024-09-13T21:40:21.720 INFO:tasks.workunit.client.0.smithi088.stdout:1/344: dread d9/dc/f1f [0,4194304] 0 2024-09-13T21:40:21.721 INFO:tasks.workunit.client.0.smithi088.stdout:1/345: creat d9/f81 x:0 0 0 2024-09-13T21:40:21.721 INFO:tasks.workunit.client.0.smithi088.stdout:1/346: chown d9/d10/d2a/d47 2 1 2024-09-13T21:40:21.721 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:21 smithi088 ceph-mon[27963]: pgmap v250: 65 pgs: 65 active+clean; 484 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 30 MiB/s rd, 47 MiB/s wr, 733 op/s 2024-09-13T21:40:21.721 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:21.721 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:21.721 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:21 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:21.727 INFO:tasks.workunit.client.0.smithi088.stdout:0/328: rmdir d7/d2c/d30/d31/d42/d4b/d75 0 2024-09-13T21:40:21.729 INFO:tasks.workunit.client.0.smithi088.stdout:9/289: mknod d1a/d34/c57 0 2024-09-13T21:40:21.730 INFO:tasks.workunit.client.0.smithi088.stdout:9/290: dread - d1a/f43 zero size 2024-09-13T21:40:21.730 INFO:tasks.workunit.client.0.smithi088.stdout:9/291: readlink d1a/d34/d3d/d41/d48/l56 0 2024-09-13T21:40:21.731 INFO:tasks.workunit.client.0.smithi088.stdout:8/254: creat db/df/d25/f56 x:0 0 0 2024-09-13T21:40:21.733 INFO:tasks.workunit.client.0.smithi088.stdout:0/329: mknod d7/d2c/d44/c84 0 2024-09-13T21:40:21.745 INFO:tasks.workunit.client.0.smithi088.stdout:8/255: dread db/f24 [0,4194304] 0 2024-09-13T21:40:21.748 INFO:tasks.workunit.client.0.smithi088.stdout:7/251: dwrite d6/da/d1a/f21 [0,4194304] 0 2024-09-13T21:40:21.749 INFO:tasks.workunit.client.0.smithi088.stdout:6/333: dwrite d0/db/f12 [0,4194304] 0 2024-09-13T21:40:21.749 INFO:tasks.workunit.client.0.smithi088.stdout:6/334: readlink d0/l5f 0 2024-09-13T21:40:21.749 INFO:tasks.workunit.client.0.smithi088.stdout:6/335: fsync d0/ff 0 2024-09-13T21:40:21.749 INFO:tasks.workunit.client.0.smithi088.stdout:4/286: dwrite d2/d5/d20/d60/de/f28 [0,4194304] 0 2024-09-13T21:40:21.749 INFO:tasks.workunit.client.0.smithi088.stdout:6/336: chown d0/c5b 11 1 2024-09-13T21:40:21.750 INFO:tasks.workunit.client.0.smithi088.stdout:4/287: write d2/d5/d20/d41/d4b/f54 [222878,2978] 0 2024-09-13T21:40:21.750 INFO:tasks.workunit.client.0.smithi088.stdout:5/315: dwrite d4/f13 [0,4194304] 0 2024-09-13T21:40:21.750 INFO:tasks.workunit.client.0.smithi088.stdout:7/252: rename d6/da/c28 to d6/da/d39/c52 0 2024-09-13T21:40:21.750 INFO:tasks.workunit.client.0.smithi088.stdout:8/256: write db/d26/f36 [392762,8128] 0 2024-09-13T21:40:21.750 INFO:tasks.workunit.client.0.smithi088.stdout:0/330: dread d7/d1d/d27/f70 [0,4194304] 0 2024-09-13T21:40:21.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/337: mknod d0/d1e/c61 0 2024-09-13T21:40:21.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/338: chown d0/d1e/l44 67530021 1 2024-09-13T21:40:21.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/339: truncate d0/d28/f35 348758 0 2024-09-13T21:40:21.752 INFO:tasks.workunit.client.0.smithi088.stdout:4/288: symlink d2/d5/d20/d60/de/d1e/d23/d3c/l64 0 2024-09-13T21:40:21.752 INFO:tasks.workunit.client.0.smithi088.stdout:5/316: rename d4/d1b/d2a/f5e to d4/d1c/d4a/d63/d6a/f6b 0 2024-09-13T21:40:21.753 INFO:tasks.workunit.client.0.smithi088.stdout:5/317: creat d4/d1c/d24/d26/f6c x:0 0 0 2024-09-13T21:40:21.762 INFO:tasks.workunit.client.0.smithi088.stdout:6/340: mknod d0/d2c/d32/c62 0 2024-09-13T21:40:21.762 INFO:tasks.workunit.client.0.smithi088.stdout:6/341: fdatasync d0/ff 0 2024-09-13T21:40:21.762 INFO:tasks.workunit.client.0.smithi088.stdout:6/342: readlink d0/d1e/d1f/d55/l5a 0 2024-09-13T21:40:21.767 INFO:tasks.workunit.client.0.smithi088.stdout:5/318: mkdir d4/d1c/d4a/d63/d6a/d6d 0 2024-09-13T21:40:21.767 INFO:tasks.workunit.client.0.smithi088.stdout:5/319: creat d4/d1c/d24/d26/f6e x:0 0 0 2024-09-13T21:40:21.767 INFO:tasks.workunit.client.0.smithi088.stdout:5/320: read - d4/d1c/d24/d26/d40/fa zero size 2024-09-13T21:40:21.769 INFO:tasks.workunit.client.0.smithi088.stdout:4/289: dwrite d2/d5/d20/d60/de/d1e/f37 [0,4194304] 0 2024-09-13T21:40:21.769 INFO:tasks.workunit.client.0.smithi088.stdout:4/290: write d2/d5/f55 [967322,61586] 0 2024-09-13T21:40:21.769 INFO:tasks.workunit.client.0.smithi088.stdout:4/291: fsync d2/d11/f16 0 2024-09-13T21:40:21.769 INFO:tasks.workunit.client.0.smithi088.stdout:0/331: dwrite d7/f2b [0,4194304] 0 2024-09-13T21:40:21.771 INFO:tasks.workunit.client.0.smithi088.stdout:7/253: rmdir d6 39 2024-09-13T21:40:21.777 INFO:tasks.workunit.client.0.smithi088.stdout:4/292: dread d2/d5/d20/d60/f2a [0,4194304] 0 2024-09-13T21:40:21.780 INFO:tasks.workunit.client.0.smithi088.stdout:6/343: dwrite d0/db/f5d [0,4194304] 0 2024-09-13T21:40:21.780 INFO:tasks.workunit.client.0.smithi088.stdout:6/344: chown d0/db/l3e 0 1 2024-09-13T21:40:21.781 INFO:tasks.workunit.client.0.smithi088.stdout:7/254: creat d6/f53 x:0 0 0 2024-09-13T21:40:21.785 INFO:tasks.workunit.client.0.smithi088.stdout:2/312: sync 2024-09-13T21:40:21.786 INFO:tasks.workunit.client.0.smithi088.stdout:6/345: write d0/db/f12 [6790281,51130] 0 2024-09-13T21:40:21.786 INFO:tasks.workunit.client.0.smithi088.stdout:6/346: write d0/d1e/f24 [826672,74778] 0 2024-09-13T21:40:21.787 INFO:tasks.workunit.client.0.smithi088.stdout:7/255: mknod d6/da/d44/c54 0 2024-09-13T21:40:21.787 INFO:tasks.workunit.client.0.smithi088.stdout:0/332: dwrite d7/f46 [0,4194304] 0 2024-09-13T21:40:21.789 INFO:tasks.workunit.client.0.smithi088.stdout:6/347: symlink d0/d1e/l63 0 2024-09-13T21:40:21.790 INFO:tasks.workunit.client.0.smithi088.stdout:7/256: mknod d6/da/d44/c55 0 2024-09-13T21:40:21.790 INFO:tasks.workunit.client.0.smithi088.stdout:7/257: dread - d6/f53 zero size 2024-09-13T21:40:21.793 INFO:tasks.workunit.client.0.smithi088.stdout:2/313: rename d1/d8/d2e/c2f to d1/d13/d2a/d41/c6c 0 2024-09-13T21:40:21.794 INFO:tasks.workunit.client.0.smithi088.stdout:6/348: mknod d0/d2c/d32/d39/c64 0 2024-09-13T21:40:21.795 INFO:tasks.workunit.client.0.smithi088.stdout:7/258: creat d6/da/d1a/f56 x:0 0 0 2024-09-13T21:40:21.795 INFO:tasks.workunit.client.0.smithi088.stdout:7/259: stat d6/da/fb 0 2024-09-13T21:40:21.797 INFO:tasks.workunit.client.0.smithi088.stdout:2/314: rename d1/d13/d3f/l5d to d1/d13/d2a/d3c/d4e/d5b/l6d 0 2024-09-13T21:40:21.798 INFO:tasks.workunit.client.0.smithi088.stdout:0/333: truncate d7/f2b 2334371 0 2024-09-13T21:40:21.798 INFO:tasks.workunit.client.0.smithi088.stdout:6/349: mkdir d0/db/d37/d65 0 2024-09-13T21:40:21.800 INFO:tasks.workunit.client.0.smithi088.stdout:0/334: creat d7/d2c/d30/d31/d42/d4b/f85 x:0 0 0 2024-09-13T21:40:21.800 INFO:tasks.workunit.client.0.smithi088.stdout:0/335: getdents d7/d1d/d3d 0 2024-09-13T21:40:21.802 INFO:tasks.workunit.client.0.smithi088.stdout:6/350: rmdir d0/db/d37/d65 0 2024-09-13T21:40:21.803 INFO:tasks.workunit.client.0.smithi088.stdout:7/260: rename d6/c32 to d6/c57 0 2024-09-13T21:40:21.803 INFO:tasks.workunit.client.0.smithi088.stdout:7/261: chown d6/da/d39/d4f/l40 115206 1 2024-09-13T21:40:21.804 INFO:tasks.workunit.client.0.smithi088.stdout:0/336: creat d7/d1d/d26/d45/d7c/f86 x:0 0 0 2024-09-13T21:40:21.807 INFO:tasks.workunit.client.0.smithi088.stdout:7/262: unlink d6/l13 0 2024-09-13T21:40:21.807 INFO:tasks.workunit.client.0.smithi088.stdout:7/263: write d6/da/f31 [630978,78576] 0 2024-09-13T21:40:21.810 INFO:tasks.workunit.client.0.smithi088.stdout:4/293: dwrite d2/d5/d20/d60/de/f28 [0,4194304] 0 2024-09-13T21:40:21.810 INFO:tasks.workunit.client.0.smithi088.stdout:2/315: dread d1/d8/f4f [0,4194304] 0 2024-09-13T21:40:21.810 INFO:tasks.workunit.client.0.smithi088.stdout:2/316: chown d1/d13/d2a/d3c/d4e/d5b/l6d 3 1 2024-09-13T21:40:21.815 INFO:tasks.workunit.client.0.smithi088.stdout:2/317: truncate d1/d8/f1b 151464 0 2024-09-13T21:40:21.819 INFO:tasks.workunit.client.0.smithi088.stdout:4/294: dread d2/d5/f14 [0,4194304] 0 2024-09-13T21:40:21.819 INFO:tasks.workunit.client.0.smithi088.stdout:4/295: chown d2/d5/d20/d60/d19 255 1 2024-09-13T21:40:21.821 INFO:tasks.workunit.client.0.smithi088.stdout:4/296: mkdir d2/d5/d20/d60/de/d1e/d23/d3c/d65 0 2024-09-13T21:40:21.830 INFO:tasks.workunit.client.0.smithi088.stdout:6/351: dwrite d0/f22 [4194304,4194304] 0 2024-09-13T21:40:21.830 INFO:tasks.workunit.client.0.smithi088.stdout:6/352: mkdir d0/d1e/d66 0 2024-09-13T21:40:21.832 INFO:tasks.workunit.client.0.smithi088.stdout:6/353: mknod d0/d1e/d1f/d55/c67 0 2024-09-13T21:40:21.832 INFO:tasks.workunit.client.0.smithi088.stdout:3/319: sync 2024-09-13T21:40:21.841 INFO:tasks.workunit.client.0.smithi088.stdout:0/337: dwrite d7/d2c/d37/f59 [0,4194304] 0 2024-09-13T21:40:21.841 INFO:tasks.workunit.client.0.smithi088.stdout:2/318: dwrite d1/d8/d2e/f2d [0,4194304] 0 2024-09-13T21:40:21.854 INFO:tasks.workunit.client.0.smithi088.stdout:2/319: dread d1/d8/d16/f23 [0,4194304] 0 2024-09-13T21:40:21.855 INFO:tasks.workunit.client.0.smithi088.stdout:6/354: dwrite d0/d1e/d1f/f51 [0,4194304] 0 2024-09-13T21:40:21.855 INFO:tasks.workunit.client.0.smithi088.stdout:6/355: chown d0/db/f2e 978528 1 2024-09-13T21:40:21.855 INFO:tasks.workunit.client.0.smithi088.stdout:6/356: readlink d0/d2c/d32/d39/d3f/l4a 0 2024-09-13T21:40:21.856 INFO:tasks.workunit.client.0.smithi088.stdout:6/357: fdatasync d0/db/f2e 0 2024-09-13T21:40:21.856 INFO:tasks.workunit.client.0.smithi088.stdout:3/320: dwrite d5/f21 [0,4194304] 0 2024-09-13T21:40:21.856 INFO:tasks.workunit.client.0.smithi088.stdout:3/321: read - d5/d23/d2a/f51 zero size 2024-09-13T21:40:21.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/320: rename d1/d13/d2a/d3c/d4e to d1/d13/d2a/d3c/d4a/d6e 0 2024-09-13T21:40:21.858 INFO:tasks.workunit.client.0.smithi088.stdout:6/358: creat d0/d2c/d32/d39/d3f/f68 x:0 0 0 2024-09-13T21:40:21.858 INFO:tasks.workunit.client.0.smithi088.stdout:3/322: dread d5/d23/f3c [0,4194304] 0 2024-09-13T21:40:21.858 INFO:tasks.workunit.client.0.smithi088.stdout:3/323: fsync d5/d23/d2a/d3f/f64 0 2024-09-13T21:40:21.860 INFO:tasks.workunit.client.0.smithi088.stdout:6/359: mknod d0/db/c69 0 2024-09-13T21:40:21.860 INFO:tasks.workunit.client.0.smithi088.stdout:2/321: getdents d1/d13/d3f 0 2024-09-13T21:40:21.861 INFO:tasks.workunit.client.0.smithi088.stdout:2/322: creat d1/d8/d2e/d3b/f6f x:0 0 0 2024-09-13T21:40:21.862 INFO:tasks.workunit.client.0.smithi088.stdout:6/360: rename d0/db/d37/l4b to d0/d2c/d32/d39/l6a 0 2024-09-13T21:40:21.864 INFO:tasks.workunit.client.0.smithi088.stdout:6/361: creat d0/d2c/f6b x:0 0 0 2024-09-13T21:40:21.865 INFO:tasks.workunit.client.0.smithi088.stdout:2/323: getdents d1/d8/d16 0 2024-09-13T21:40:21.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/362: mkdir d0/d28/d6c 0 2024-09-13T21:40:21.866 INFO:tasks.workunit.client.0.smithi088.stdout:2/324: dread d1/d8/d24/f39 [0,4194304] 0 2024-09-13T21:40:21.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/363: symlink d0/db/l6d 0 2024-09-13T21:40:21.866 INFO:tasks.workunit.client.0.smithi088.stdout:6/364: write d0/ff [387524,112613] 0 2024-09-13T21:40:21.869 INFO:tasks.workunit.client.0.smithi088.stdout:6/365: unlink d0/d2c/f47 0 2024-09-13T21:40:21.870 INFO:tasks.workunit.client.0.smithi088.stdout:0/338: dwrite d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:21.871 INFO:tasks.workunit.client.0.smithi088.stdout:3/324: write f0 [3061784,126151] 0 2024-09-13T21:40:21.872 INFO:tasks.workunit.client.0.smithi088.stdout:6/366: creat d0/d2c/d32/f6e x:0 0 0 2024-09-13T21:40:21.874 INFO:tasks.workunit.client.0.smithi088.stdout:0/339: rename d7/d1d/d21/f2a to d7/d1d/d21/d82/f87 0 2024-09-13T21:40:21.877 INFO:tasks.workunit.client.0.smithi088.stdout:3/325: creat d5/d26/f6e x:0 0 0 2024-09-13T21:40:21.891 INFO:tasks.workunit.client.0.smithi088.stdout:3/326: dread d5/f22 [0,4194304] 0 2024-09-13T21:40:21.893 INFO:tasks.workunit.client.0.smithi088.stdout:3/327: creat d5/d5a/f6f x:0 0 0 2024-09-13T21:40:21.893 INFO:tasks.workunit.client.0.smithi088.stdout:3/328: fdatasync d5/d23/d2a/d63/f46 0 2024-09-13T21:40:21.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/329: creat d5/d26/f70 x:0 0 0 2024-09-13T21:40:21.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/330: write d5/d26/f33 [1492611,9208] 0 2024-09-13T21:40:21.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/331: write d5/d23/d2a/d63/d48/d49/f62 [483167,3276] 0 2024-09-13T21:40:21.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/332: fdatasync d5/f22 0 2024-09-13T21:40:21.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/333: dread - d5/d23/d2a/d63/f46 zero size 2024-09-13T21:40:21.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/334: stat d5/d14/l15 0 2024-09-13T21:40:21.894 INFO:tasks.workunit.client.0.smithi088.stdout:3/335: fdatasync d5/d23/f6c 0 2024-09-13T21:40:21.895 INFO:tasks.workunit.client.0.smithi088.stdout:2/325: dwrite d1/d13/d2a/f2b [0,4194304] 0 2024-09-13T21:40:21.895 INFO:tasks.workunit.client.0.smithi088.stdout:3/336: mkdir d5/d23/d2a/d63/d48/d71 0 2024-09-13T21:40:21.895 INFO:tasks.workunit.client.0.smithi088.stdout:0/340: dwrite d7/d65/f22 [0,4194304] 0 2024-09-13T21:40:21.896 INFO:tasks.workunit.client.0.smithi088.stdout:2/326: mknod d1/d13/d2a/d3c/d4a/d6e/d5b/c70 0 2024-09-13T21:40:21.897 INFO:tasks.workunit.client.0.smithi088.stdout:3/337: rename d5/d14/l1c to d5/d5a/l72 0 2024-09-13T21:40:21.897 INFO:tasks.workunit.client.0.smithi088.stdout:3/338: creat d5/d5a/f73 x:0 0 0 2024-09-13T21:40:21.897 INFO:tasks.workunit.client.0.smithi088.stdout:3/339: chown d5/d23/d2a/d55 17783993 1 2024-09-13T21:40:21.898 INFO:tasks.workunit.client.0.smithi088.stdout:0/341: mknod d7/d65/c88 0 2024-09-13T21:40:21.898 INFO:tasks.workunit.client.0.smithi088.stdout:2/327: symlink d1/d8/d2e/d44/l71 0 2024-09-13T21:40:21.898 INFO:tasks.workunit.client.0.smithi088.stdout:2/328: creat d1/d8/d24/f72 x:0 0 0 2024-09-13T21:40:21.899 INFO:tasks.workunit.client.0.smithi088.stdout:2/329: dread d1/d8/d24/f25 [0,4194304] 0 2024-09-13T21:40:21.900 INFO:tasks.workunit.client.0.smithi088.stdout:3/340: symlink d5/d26/l74 0 2024-09-13T21:40:21.900 INFO:tasks.workunit.client.0.smithi088.stdout:2/330: rmdir d1/d13/d2a/d3c/d4a 39 2024-09-13T21:40:21.907 INFO:tasks.workunit.client.0.smithi088.stdout:0/342: read d7/d1d/d27/d43/f17 [5764019,84736] 0 2024-09-13T21:40:21.908 INFO:tasks.workunit.client.0.smithi088.stdout:0/343: mknod d7/d2c/d30/d31/d42/c89 0 2024-09-13T21:40:21.916 INFO:tasks.workunit.client.0.smithi088.stdout:1/347: sync 2024-09-13T21:40:21.916 INFO:tasks.workunit.client.0.smithi088.stdout:9/292: sync 2024-09-13T21:40:21.917 INFO:tasks.workunit.client.0.smithi088.stdout:2/331: dwrite d1/d8/d16/f5c [0,4194304] 0 2024-09-13T21:40:21.918 INFO:tasks.workunit.client.0.smithi088.stdout:9/293: creat d1a/d34/f58 x:0 0 0 2024-09-13T21:40:21.918 INFO:tasks.workunit.client.0.smithi088.stdout:9/294: write d1a/d34/d3d/d41/f44 [769435,10600] 0 2024-09-13T21:40:21.918 INFO:tasks.workunit.client.0.smithi088.stdout:1/348: mknod d9/dc/d52/c82 0 2024-09-13T21:40:21.920 INFO:tasks.workunit.client.0.smithi088.stdout:1/349: stat d9/dc/c51 0 2024-09-13T21:40:21.920 INFO:tasks.workunit.client.0.smithi088.stdout:1/350: write d9/d10/d2a/d4b/d61/f6a [488947,68676] 0 2024-09-13T21:40:21.921 INFO:tasks.workunit.client.0.smithi088.stdout:9/295: mknod d1a/d34/c59 0 2024-09-13T21:40:21.922 INFO:tasks.workunit.client.0.smithi088.stdout:1/351: link d9/d10/l2e d9/d10/d41/l83 0 2024-09-13T21:40:21.924 INFO:tasks.workunit.client.0.smithi088.stdout:9/296: creat d1a/d3c/f5a x:0 0 0 2024-09-13T21:40:21.924 INFO:tasks.workunit.client.0.smithi088.stdout:9/297: fdatasync d1a/f43 0 2024-09-13T21:40:21.932 INFO:tasks.workunit.client.0.smithi088.stdout:1/352: dread d9/d10/f11 [0,4194304] 0 2024-09-13T21:40:21.936 INFO:tasks.workunit.client.0.smithi088.stdout:1/353: dread d9/d10/f29 [0,4194304] 0 2024-09-13T21:40:21.951 INFO:tasks.workunit.client.0.smithi088.stdout:0/344: dwrite d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:21.951 INFO:tasks.workunit.client.0.smithi088.stdout:0/345: dread - d7/d2c/d37/f83 zero size 2024-09-13T21:40:21.966 INFO:tasks.workunit.client.0.smithi088.stdout:0/346: dwrite d7/d1d/d21/f80 [0,4194304] 0 2024-09-13T21:40:21.968 INFO:tasks.workunit.client.0.smithi088.stdout:0/347: rmdir d7/d1d/d21/d82 39 2024-09-13T21:40:21.969 INFO:tasks.workunit.client.0.smithi088.stdout:0/348: creat d7/f8a x:0 0 0 2024-09-13T21:40:21.970 INFO:tasks.workunit.client.0.smithi088.stdout:0/349: mkdir d7/d1d/d66/d8b 0 2024-09-13T21:40:21.971 INFO:tasks.workunit.client.0.smithi088.stdout:2/332: dwrite d1/d8/d2e/f38 [4194304,4194304] 0 2024-09-13T21:40:21.972 INFO:tasks.workunit.client.0.smithi088.stdout:2/333: symlink d1/d8/d24/l73 0 2024-09-13T21:40:21.972 INFO:tasks.workunit.client.0.smithi088.stdout:2/334: dread - d1/d8/d16/f37 zero size 2024-09-13T21:40:21.973 INFO:tasks.workunit.client.0.smithi088.stdout:2/335: mknod d1/d8/d2e/d3b/c74 0 2024-09-13T21:40:21.973 INFO:tasks.workunit.client.0.smithi088.stdout:2/336: mkdir d1/d13/d2a/d3c/d75 0 2024-09-13T21:40:21.973 INFO:tasks.workunit.client.0.smithi088.stdout:2/337: fdatasync d1/d8/d24/f39 0 2024-09-13T21:40:21.973 INFO:tasks.workunit.client.0.smithi088.stdout:2/338: chown d1/d8/d2e/d3b 158328896 1 2024-09-13T21:40:21.974 INFO:tasks.workunit.client.0.smithi088.stdout:2/339: unlink d1/d8/d16/l35 0 2024-09-13T21:40:21.976 INFO:tasks.workunit.client.0.smithi088.stdout:2/340: mkdir d1/d13/d2a/d3c/d4a/d6e/d76 0 2024-09-13T21:40:21.977 INFO:tasks.workunit.client.0.smithi088.stdout:2/341: write d1/d8/d2e/d3b/f6f [123794,79663] 0 2024-09-13T21:40:21.977 INFO:tasks.workunit.client.0.smithi088.stdout:2/342: fdatasync d1/d8/f19 0 2024-09-13T21:40:21.977 INFO:tasks.workunit.client.0.smithi088.stdout:2/343: truncate d1/d8/d2e/d3b/f6f 708569 0 2024-09-13T21:40:21.977 INFO:tasks.workunit.client.0.smithi088.stdout:2/344: creat d1/f77 x:0 0 0 2024-09-13T21:40:21.977 INFO:tasks.workunit.client.0.smithi088.stdout:2/345: write d1/d8/d16/d40/f67 [401001,86607] 0 2024-09-13T21:40:21.980 INFO:tasks.workunit.client.0.smithi088.stdout:0/350: dread d7/d2c/f48 [0,4194304] 0 2024-09-13T21:40:21.981 INFO:tasks.workunit.client.0.smithi088.stdout:0/351: rmdir d7/d2c/d44 39 2024-09-13T21:40:21.982 INFO:tasks.workunit.client.0.smithi088.stdout:0/352: mkdir d7/d65/d8c 0 2024-09-13T21:40:21.982 INFO:tasks.workunit.client.0.smithi088.stdout:0/353: stat d7/d1d/d27/f64 0 2024-09-13T21:40:21.982 INFO:tasks.workunit.client.0.smithi088.stdout:0/354: creat d7/d1d/d26/d45/f8d x:0 0 0 2024-09-13T21:40:21.982 INFO:tasks.workunit.client.0.smithi088.stdout:0/355: stat d7/d2c/l2d 0 2024-09-13T21:40:21.985 INFO:tasks.workunit.client.0.smithi088.stdout:2/346: dread d1/d13/f1a [0,4194304] 0 2024-09-13T21:40:21.986 INFO:tasks.workunit.client.0.smithi088.stdout:2/347: mkdir d1/d8/d24/d78 0 2024-09-13T21:40:21.987 INFO:tasks.workunit.client.0.smithi088.stdout:2/348: mknod d1/c79 0 2024-09-13T21:40:21.988 INFO:tasks.workunit.client.0.smithi088.stdout:2/349: creat d1/d13/d2a/d3c/d4a/f7a x:0 0 0 2024-09-13T21:40:21.989 INFO:tasks.workunit.client.0.smithi088.stdout:2/350: rename d1/d8/d2e/d3b/c46 to d1/d13/d2a/d3c/d4a/d6e/c7b 0 2024-09-13T21:40:21.991 INFO:tasks.workunit.client.0.smithi088.stdout:2/351: rename d1/d8/d2e/f2d to d1/d8/d16/f7c 0 2024-09-13T21:40:21.991 INFO:tasks.workunit.client.0.smithi088.stdout:2/352: creat d1/d8/f7d x:0 0 0 2024-09-13T21:40:21.991 INFO:tasks.workunit.client.0.smithi088.stdout:2/353: chown d1/d8/d16/f37 5 1 2024-09-13T21:40:21.991 INFO:tasks.workunit.client.0.smithi088.stdout:2/354: chown d1/d8/f19 187484464 1 2024-09-13T21:40:21.992 INFO:tasks.workunit.client.0.smithi088.stdout:2/355: mkdir d1/d8/d16/d40/d7e 0 2024-09-13T21:40:21.992 INFO:tasks.workunit.client.0.smithi088.stdout:7/264: sync 2024-09-13T21:40:21.992 INFO:tasks.workunit.client.0.smithi088.stdout:5/321: sync 2024-09-13T21:40:21.992 INFO:tasks.workunit.client.0.smithi088.stdout:8/257: sync 2024-09-13T21:40:21.993 INFO:tasks.workunit.client.0.smithi088.stdout:2/356: mkdir d1/d8/d24/d78/d7f 0 2024-09-13T21:40:21.993 INFO:tasks.workunit.client.0.smithi088.stdout:7/265: symlink d6/da/d39/d45/l58 0 2024-09-13T21:40:21.993 INFO:tasks.workunit.client.0.smithi088.stdout:7/266: rename d6/da/d39 to d6/da/d39/d4f/d4c/d59 22 2024-09-13T21:40:21.993 INFO:tasks.workunit.client.0.smithi088.stdout:7/267: truncate d6/da/d1a/d3a/f3f 693627 0 2024-09-13T21:40:21.994 INFO:tasks.workunit.client.0.smithi088.stdout:5/322: truncate d4/d1c/f4d 1637937 0 2024-09-13T21:40:21.997 INFO:tasks.workunit.client.0.smithi088.stdout:8/258: rmdir db 39 2024-09-13T21:40:21.999 INFO:tasks.workunit.client.0.smithi088.stdout:5/323: creat d4/d1c/d4a/d63/f6f x:0 0 0 2024-09-13T21:40:21.999 INFO:tasks.workunit.client.0.smithi088.stdout:5/324: readlink d4/l3a 0 2024-09-13T21:40:21.999 INFO:tasks.workunit.client.0.smithi088.stdout:5/325: creat d4/d1c/d24/d26/d56/f70 x:0 0 0 2024-09-13T21:40:22.002 INFO:tasks.workunit.client.0.smithi088.stdout:8/259: rename db/d26/c4a to db/df/d25/c57 0 2024-09-13T21:40:22.003 INFO:tasks.workunit.client.0.smithi088.stdout:7/268: dread d6/da/d39/d4f/f48 [0,4194304] 0 2024-09-13T21:40:22.004 INFO:tasks.workunit.client.0.smithi088.stdout:7/269: chown d6/da/d1a/c4b 1082408 1 2024-09-13T21:40:22.005 INFO:tasks.workunit.client.0.smithi088.stdout:5/326: creat d4/d1c/d24/d26/d4b/d66/f71 x:0 0 0 2024-09-13T21:40:22.006 INFO:tasks.workunit.client.0.smithi088.stdout:5/327: link d4/d1b/d2a/f3b d4/d1c/d4a/f72 0 2024-09-13T21:40:22.009 INFO:tasks.workunit.client.0.smithi088.stdout:5/328: mknod d4/d1c/c73 0 2024-09-13T21:40:22.009 INFO:tasks.workunit.client.0.smithi088.stdout:5/329: creat d4/d1c/d4a/d63/f74 x:0 0 0 2024-09-13T21:40:22.009 INFO:tasks.workunit.client.0.smithi088.stdout:5/330: write d4/d1c/d24/f59 [644271,24840] 0 2024-09-13T21:40:22.009 INFO:tasks.workunit.client.0.smithi088.stdout:5/331: fdatasync d4/d1c/f45 0 2024-09-13T21:40:22.009 INFO:tasks.workunit.client.0.smithi088.stdout:5/332: chown d4/d1c/d24/l4c 30 1 2024-09-13T21:40:22.009 INFO:tasks.workunit.client.0.smithi088.stdout:5/333: creat d4/d1b/f75 x:0 0 0 2024-09-13T21:40:22.009 INFO:tasks.workunit.client.0.smithi088.stdout:5/334: chown d4/d1c/c73 7347 1 2024-09-13T21:40:22.010 INFO:tasks.workunit.client.0.smithi088.stdout:5/335: write d4/d1b/d2a/f2d [2423187,122597] 0 2024-09-13T21:40:22.013 INFO:tasks.workunit.client.0.smithi088.stdout:5/336: getdents d4/d1c/d4a/d63/d6a 0 2024-09-13T21:40:22.015 INFO:tasks.workunit.client.0.smithi088.stdout:5/337: mkdir d4/d1c/d76 0 2024-09-13T21:40:22.015 INFO:tasks.workunit.client.0.smithi088.stdout:5/338: read d4/d1b/d2a/f3b [1131405,109143] 0 2024-09-13T21:40:22.017 INFO:tasks.workunit.client.0.smithi088.stdout:5/339: link d4/d1c/d24/d26/f6e d4/d1c/d24/d26/d4b/d66/f77 0 2024-09-13T21:40:22.017 INFO:tasks.workunit.client.0.smithi088.stdout:5/340: truncate d4/d1c/f4e 491267 0 2024-09-13T21:40:22.020 INFO:tasks.workunit.client.0.smithi088.stdout:2/357: truncate d1/d8/f19 6597107 0 2024-09-13T21:40:22.022 INFO:tasks.workunit.client.0.smithi088.stdout:8/260: dwrite db/df/d25/f2e [0,4194304] 0 2024-09-13T21:40:22.022 INFO:tasks.workunit.client.0.smithi088.stdout:8/261: fsync db/df/d25/f28 0 2024-09-13T21:40:22.024 INFO:tasks.workunit.client.0.smithi088.stdout:7/270: dwrite d6/da/f46 [0,4194304] 0 2024-09-13T21:40:22.025 INFO:tasks.workunit.client.0.smithi088.stdout:8/262: mknod db/df/c58 0 2024-09-13T21:40:22.030 INFO:tasks.workunit.client.0.smithi088.stdout:5/341: dread d4/f13 [0,4194304] 0 2024-09-13T21:40:22.030 INFO:tasks.workunit.client.0.smithi088.stdout:8/263: rmdir db/d26 39 2024-09-13T21:40:22.033 INFO:tasks.workunit.client.0.smithi088.stdout:8/264: symlink db/l59 0 2024-09-13T21:40:22.035 INFO:tasks.workunit.client.0.smithi088.stdout:8/265: rmdir db/d26/d37 39 2024-09-13T21:40:22.035 INFO:tasks.workunit.client.0.smithi088.stdout:8/266: truncate db/f23 2044082 0 2024-09-13T21:40:22.041 INFO:tasks.workunit.client.0.smithi088.stdout:5/342: read d4/d1c/d24/f35 [2921719,95431] 0 2024-09-13T21:40:22.041 INFO:tasks.workunit.client.0.smithi088.stdout:5/343: write d4/d1c/d24/d26/d40/fa [191493,71175] 0 2024-09-13T21:40:22.051 INFO:tasks.workunit.client.0.smithi088.stdout:7/271: dwrite d6/da/d1a/f21 [0,4194304] 0 2024-09-13T21:40:22.052 INFO:tasks.workunit.client.0.smithi088.stdout:2/358: dwrite d1/f4 [0,4194304] 0 2024-09-13T21:40:22.055 INFO:tasks.workunit.client.0.smithi088.stdout:7/272: rename d6/da/d39/c52 to d6/c5a 0 2024-09-13T21:40:22.058 INFO:tasks.workunit.client.0.smithi088.stdout:2/359: rename d1/l1f to d1/d13/d2a/d3c/d4a/d6e/l80 0 2024-09-13T21:40:22.060 INFO:tasks.workunit.client.0.smithi088.stdout:8/267: dwrite db/d26/f35 [0,4194304] 0 2024-09-13T21:40:22.060 INFO:tasks.workunit.client.0.smithi088.stdout:7/273: unlink d6/d4e/f51 0 2024-09-13T21:40:22.062 INFO:tasks.workunit.client.0.smithi088.stdout:8/268: creat db/d26/d2c/f5a x:0 0 0 2024-09-13T21:40:22.065 INFO:tasks.workunit.client.0.smithi088.stdout:7/274: creat d6/d4e/f5b x:0 0 0 2024-09-13T21:40:22.066 INFO:tasks.workunit.client.0.smithi088.stdout:8/269: symlink db/d26/d37/l5b 0 2024-09-13T21:40:22.067 INFO:tasks.workunit.client.0.smithi088.stdout:5/344: dwrite d4/ff [0,4194304] 0 2024-09-13T21:40:22.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/275: dread d6/da/d1a/f24 [0,4194304] 0 2024-09-13T21:40:22.076 INFO:tasks.workunit.client.0.smithi088.stdout:7/276: fsync d6/da/d1a/f2d 0 2024-09-13T21:40:22.076 INFO:tasks.workunit.client.0.smithi088.stdout:7/277: stat d6/da/f46 0 2024-09-13T21:40:22.076 INFO:tasks.workunit.client.0.smithi088.stdout:7/278: truncate d6/da/fb 5445028 0 2024-09-13T21:40:22.077 INFO:tasks.workunit.client.0.smithi088.stdout:8/270: write db/df/d25/f28 [529689,22961] 0 2024-09-13T21:40:22.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/279: mkdir d6/da/d1a/d3a/d5c 0 2024-09-13T21:40:22.079 INFO:tasks.workunit.client.0.smithi088.stdout:8/271: rename db/df/f49 to db/d33/f5c 0 2024-09-13T21:40:22.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/280: creat d6/da/d39/f5d x:0 0 0 2024-09-13T21:40:22.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/281: readlink d6/da/l2f 0 2024-09-13T21:40:22.084 INFO:tasks.workunit.client.0.smithi088.stdout:2/360: dwrite d1/f15 [0,4194304] 0 2024-09-13T21:40:22.084 INFO:tasks.workunit.client.0.smithi088.stdout:2/361: fdatasync d1/f4 0 2024-09-13T21:40:22.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/362: symlink d1/d8/d24/d78/l81 0 2024-09-13T21:40:22.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/363: chown d1/d8/d24/f39 180 1 2024-09-13T21:40:22.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/364: truncate d1/d13/d3f/f43 1669330 0 2024-09-13T21:40:22.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/365: write d1/d13/d2a/d3c/d4a/f7a [808977,107151] 0 2024-09-13T21:40:22.087 INFO:tasks.workunit.client.0.smithi088.stdout:5/345: dwrite d4/d1c/f53 [0,4194304] 0 2024-09-13T21:40:22.087 INFO:tasks.workunit.client.0.smithi088.stdout:5/346: dread - d4/d1c/f42 zero size 2024-09-13T21:40:22.087 INFO:tasks.workunit.client.0.smithi088.stdout:8/272: dread db/df/d25/f2d [0,4194304] 0 2024-09-13T21:40:22.087 INFO:tasks.workunit.client.0.smithi088.stdout:8/273: truncate db/f23 2146756 0 2024-09-13T21:40:22.087 INFO:tasks.workunit.client.0.smithi088.stdout:8/274: creat db/d26/d2c/f5d x:0 0 0 2024-09-13T21:40:22.091 INFO:tasks.workunit.client.0.smithi088.stdout:7/282: write d6/da/d1a/f43 [2591549,11951] 0 2024-09-13T21:40:22.094 INFO:tasks.workunit.client.0.smithi088.stdout:5/347: mknod d4/d1c/d24/d26/c78 0 2024-09-13T21:40:22.097 INFO:tasks.workunit.client.0.smithi088.stdout:4/297: sync 2024-09-13T21:40:22.098 INFO:tasks.workunit.client.0.smithi088.stdout:6/367: sync 2024-09-13T21:40:22.098 INFO:tasks.workunit.client.0.smithi088.stdout:9/298: sync 2024-09-13T21:40:22.098 INFO:tasks.workunit.client.0.smithi088.stdout:8/275: rename db/d26/l4b to db/df/l5e 0 2024-09-13T21:40:22.100 INFO:tasks.workunit.client.0.smithi088.stdout:5/348: rename d4/d1c/d24/d26/c27 to d4/d1c/d24/d26/c79 0 2024-09-13T21:40:22.100 INFO:tasks.workunit.client.0.smithi088.stdout:5/349: dread - d4/d1c/f58 zero size 2024-09-13T21:40:22.101 INFO:tasks.workunit.client.0.smithi088.stdout:4/298: getdents d2/d5/d20/d60/de/d1e/d31 0 2024-09-13T21:40:22.102 INFO:tasks.workunit.client.0.smithi088.stdout:7/283: dread d6/da/d1a/f21 [0,4194304] 0 2024-09-13T21:40:22.102 INFO:tasks.workunit.client.0.smithi088.stdout:9/299: readlink l12 0 2024-09-13T21:40:22.103 INFO:tasks.workunit.client.0.smithi088.stdout:9/300: stat d1a/d34/c57 0 2024-09-13T21:40:22.103 INFO:tasks.workunit.client.0.smithi088.stdout:9/301: readlink d1a/d1b/l33 0 2024-09-13T21:40:22.103 INFO:tasks.workunit.client.0.smithi088.stdout:9/302: chown d1a 0 1 2024-09-13T21:40:22.103 INFO:tasks.workunit.client.0.smithi088.stdout:9/303: creat d1a/d3c/f5b x:0 0 0 2024-09-13T21:40:22.103 INFO:tasks.workunit.client.0.smithi088.stdout:9/304: chown d1a/d34/d3d/d41/f44 6838948 1 2024-09-13T21:40:22.103 INFO:tasks.workunit.client.0.smithi088.stdout:9/305: readlink d1a/d1b/l26 0 2024-09-13T21:40:22.104 INFO:tasks.workunit.client.0.smithi088.stdout:2/366: dwrite d1/fd [0,4194304] 0 2024-09-13T21:40:22.104 INFO:tasks.workunit.client.0.smithi088.stdout:7/284: dread d6/da/f31 [0,4194304] 0 2024-09-13T21:40:22.104 INFO:tasks.workunit.client.0.smithi088.stdout:7/285: write d6/f1c [1295276,65463] 0 2024-09-13T21:40:22.104 INFO:tasks.workunit.client.0.smithi088.stdout:6/368: creat d0/d1e/d1f/d55/f6f x:0 0 0 2024-09-13T21:40:22.104 INFO:tasks.workunit.client.0.smithi088.stdout:6/369: creat d0/d1e/d1f/f70 x:0 0 0 2024-09-13T21:40:22.104 INFO:tasks.workunit.client.0.smithi088.stdout:6/370: write d0/db/f2e [4261735,128176] 0 2024-09-13T21:40:22.105 INFO:tasks.workunit.client.0.smithi088.stdout:8/276: unlink db/le 0 2024-09-13T21:40:22.107 INFO:tasks.workunit.client.0.smithi088.stdout:5/350: symlink d4/d1c/d76/l7a 0 2024-09-13T21:40:22.107 INFO:tasks.workunit.client.0.smithi088.stdout:5/351: chown d4/d1c/c2f 409290 1 2024-09-13T21:40:22.107 INFO:tasks.workunit.client.0.smithi088.stdout:5/352: dread - d4/d1c/d24/d26/f6e zero size 2024-09-13T21:40:22.107 INFO:tasks.workunit.client.0.smithi088.stdout:5/353: dread - d4/d1c/d24/d26/d4b/d66/f77 zero size 2024-09-13T21:40:22.107 INFO:tasks.workunit.client.0.smithi088.stdout:5/354: dread - d4/d1c/d4a/d63/d6a/f6b zero size 2024-09-13T21:40:22.107 INFO:tasks.workunit.client.0.smithi088.stdout:5/355: write d4/d1c/d24/d26/d56/f64 [105815,4860] 0 2024-09-13T21:40:22.109 INFO:tasks.workunit.client.0.smithi088.stdout:4/299: symlink d2/d13/d50/l66 0 2024-09-13T21:40:22.111 INFO:tasks.workunit.client.0.smithi088.stdout:3/341: sync 2024-09-13T21:40:22.111 INFO:tasks.workunit.client.0.smithi088.stdout:0/356: sync 2024-09-13T21:40:22.111 INFO:tasks.workunit.client.0.smithi088.stdout:1/354: sync 2024-09-13T21:40:22.111 INFO:tasks.workunit.client.0.smithi088.stdout:1/355: creat d9/d10/d2a/d4b/d33/f84 x:0 0 0 2024-09-13T21:40:22.115 INFO:tasks.workunit.client.0.smithi088.stdout:2/367: mkdir d1/d13/d2a/d41/d82 0 2024-09-13T21:40:22.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/286: mknod d6/d4e/c5e 0 2024-09-13T21:40:22.116 INFO:tasks.workunit.client.0.smithi088.stdout:7/287: readlink d6/da/l2f 0 2024-09-13T21:40:22.116 INFO:tasks.workunit.client.0.smithi088.stdout:9/306: dread d1a/d1b/f28 [0,4194304] 0 2024-09-13T21:40:22.117 INFO:tasks.workunit.client.0.smithi088.stdout:9/307: write f10 [2509010,95379] 0 2024-09-13T21:40:22.117 INFO:tasks.workunit.client.0.smithi088.stdout:3/342: read d5/d26/f27 [316682,61637] 0 2024-09-13T21:40:22.117 INFO:tasks.workunit.client.0.smithi088.stdout:3/343: truncate d5/d26/f27 1584925 0 2024-09-13T21:40:22.120 INFO:tasks.workunit.client.0.smithi088.stdout:6/371: read d0/f52 [1265926,57845] 0 2024-09-13T21:40:22.120 INFO:tasks.workunit.client.0.smithi088.stdout:6/372: fsync d0/d1e/d1f/f4e 0 2024-09-13T21:40:22.120 INFO:tasks.workunit.client.0.smithi088.stdout:8/277: link db/f1a db/d26/f5f 0 2024-09-13T21:40:22.121 INFO:tasks.workunit.client.0.smithi088.stdout:8/278: stat l7 0 2024-09-13T21:40:22.122 INFO:tasks.workunit.client.0.smithi088.stdout:2/368: creat d1/d13/d2a/d41/d48/f83 x:0 0 0 2024-09-13T21:40:22.122 INFO:tasks.workunit.client.0.smithi088.stdout:5/356: read d4/d1c/d24/f39 [2287748,42082] 0 2024-09-13T21:40:22.128 INFO:tasks.workunit.client.0.smithi088.stdout:1/356: getdents d9 0 2024-09-13T21:40:22.129 INFO:tasks.workunit.client.0.smithi088.stdout:6/373: mkdir d0/d2c/d32/d39/d3f/d71 0 2024-09-13T21:40:22.132 INFO:tasks.workunit.client.0.smithi088.stdout:2/369: mkdir d1/d13/d2a/d3c/d4a/d6e/d66/d84 0 2024-09-13T21:40:22.132 INFO:tasks.workunit.client.0.smithi088.stdout:8/279: write db/f1a [1312795,112099] 0 2024-09-13T21:40:22.132 INFO:tasks.workunit.client.0.smithi088.stdout:8/280: fdatasync db/d26/d37/f46 0 2024-09-13T21:40:22.133 INFO:tasks.workunit.client.0.smithi088.stdout:7/288: mkdir d6/d5f 0 2024-09-13T21:40:22.133 INFO:tasks.workunit.client.0.smithi088.stdout:7/289: chown d6/da/c37 632097754 1 2024-09-13T21:40:22.134 INFO:tasks.workunit.client.0.smithi088.stdout:9/308: getdents d1a/d1b 0 2024-09-13T21:40:22.134 INFO:tasks.workunit.client.0.smithi088.stdout:7/290: dread d6/da/d1a/f2d [0,4194304] 0 2024-09-13T21:40:22.136 INFO:tasks.workunit.client.0.smithi088.stdout:6/374: mknod d0/d1e/d1f/c72 0 2024-09-13T21:40:22.136 INFO:tasks.workunit.client.0.smithi088.stdout:6/375: creat d0/d1e/f73 x:0 0 0 2024-09-13T21:40:22.136 INFO:tasks.workunit.client.0.smithi088.stdout:5/357: dread d4/d1b/d2a/f2d [0,4194304] 0 2024-09-13T21:40:22.137 INFO:tasks.workunit.client.0.smithi088.stdout:3/344: dwrite d5/d26/f27 [0,4194304] 0 2024-09-13T21:40:22.137 INFO:tasks.workunit.client.0.smithi088.stdout:3/345: readlink d5/l45 0 2024-09-13T21:40:22.137 INFO:tasks.workunit.client.0.smithi088.stdout:3/346: chown d5 3886596 1 2024-09-13T21:40:22.137 INFO:tasks.workunit.client.0.smithi088.stdout:3/347: fsync d5/f13 0 2024-09-13T21:40:22.138 INFO:tasks.workunit.client.0.smithi088.stdout:4/300: dwrite d2/d5/f14 [0,4194304] 0 2024-09-13T21:40:22.138 INFO:tasks.workunit.client.0.smithi088.stdout:3/348: write d5/d5a/f73 [711875,35545] 0 2024-09-13T21:40:22.138 INFO:tasks.workunit.client.0.smithi088.stdout:2/370: truncate d1/f10 4625516 0 2024-09-13T21:40:22.138 INFO:tasks.workunit.client.0.smithi088.stdout:2/371: chown d1/d13/d2a/d41/d82 420 1 2024-09-13T21:40:22.138 INFO:tasks.workunit.client.0.smithi088.stdout:7/291: mkdir d6/da/d1a/d3a/d5c/d60 0 2024-09-13T21:40:22.140 INFO:tasks.workunit.client.0.smithi088.stdout:1/357: dread d9/d10/f3f [0,4194304] 0 2024-09-13T21:40:22.141 INFO:tasks.workunit.client.0.smithi088.stdout:6/376: mknod d0/db/d37/c74 0 2024-09-13T21:40:22.141 INFO:tasks.workunit.client.0.smithi088.stdout:6/377: stat d0/d2c/d32/d39 0 2024-09-13T21:40:22.143 INFO:tasks.workunit.client.0.smithi088.stdout:4/301: dread d2/f15 [0,4194304] 0 2024-09-13T21:40:22.143 INFO:tasks.workunit.client.0.smithi088.stdout:4/302: write d2/d5/d20/d60/de/f32 [435742,29106] 0 2024-09-13T21:40:22.143 INFO:tasks.workunit.client.0.smithi088.stdout:4/303: creat d2/d5/d2d/f67 x:0 0 0 2024-09-13T21:40:22.144 INFO:tasks.workunit.client.0.smithi088.stdout:9/309: dread d1a/d1b/f25 [0,4194304] 0 2024-09-13T21:40:22.144 INFO:tasks.workunit.client.0.smithi088.stdout:5/358: link d4/d1c/d24/d26/d4b/c57 d4/c7b 0 2024-09-13T21:40:22.144 INFO:tasks.workunit.client.0.smithi088.stdout:5/359: write d4/d1b/f38 [1649662,30970] 0 2024-09-13T21:40:22.145 INFO:tasks.workunit.client.0.smithi088.stdout:5/360: fsync d4/d1c/d24/d26/f6c 0 2024-09-13T21:40:22.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/349: unlink d5/d26/f27 0 2024-09-13T21:40:22.156 INFO:tasks.workunit.client.0.smithi088.stdout:2/372: mkdir d1/d8/d24/d78/d7f/d85 0 2024-09-13T21:40:22.157 INFO:tasks.workunit.client.0.smithi088.stdout:8/281: dwrite db/df/d25/f28 [0,4194304] 0 2024-09-13T21:40:22.157 INFO:tasks.workunit.client.0.smithi088.stdout:1/358: mkdir d9/d10/d2a/d4b/d39/d43/d85 0 2024-09-13T21:40:22.159 INFO:tasks.workunit.client.0.smithi088.stdout:7/292: dwrite d6/da/f31 [0,4194304] 0 2024-09-13T21:40:22.160 INFO:tasks.workunit.client.0.smithi088.stdout:8/282: dread db/d26/d2c/f4c [0,4194304] 0 2024-09-13T21:40:22.162 INFO:tasks.workunit.client.0.smithi088.stdout:4/304: rename d2/d5/d20/d60/de/d1e/d23/d3c/l64 to d2/d5/d20/d41/d4b/l68 0 2024-09-13T21:40:22.164 INFO:tasks.workunit.client.0.smithi088.stdout:9/310: creat d1a/d1b/f5c x:0 0 0 2024-09-13T21:40:22.164 INFO:tasks.workunit.client.0.smithi088.stdout:9/311: chown d1a/d34/f58 772942 1 2024-09-13T21:40:22.165 INFO:tasks.workunit.client.0.smithi088.stdout:9/312: write d1a/d3c/f5a [383374,33306] 0 2024-09-13T21:40:22.166 INFO:tasks.workunit.client.0.smithi088.stdout:5/361: symlink d4/d1c/d24/d26/d4b/l7c 0 2024-09-13T21:40:22.167 INFO:tasks.workunit.client.0.smithi088.stdout:2/373: symlink d1/d13/d2a/d41/d48/l86 0 2024-09-13T21:40:22.168 INFO:tasks.workunit.client.0.smithi088.stdout:6/378: getdents d0/db 0 2024-09-13T21:40:22.169 INFO:tasks.workunit.client.0.smithi088.stdout:1/359: dread d9/d10/d2a/d4b/f28 [0,4194304] 0 2024-09-13T21:40:22.172 INFO:tasks.workunit.client.0.smithi088.stdout:7/293: creat d6/da/d39/d4f/f61 x:0 0 0 2024-09-13T21:40:22.173 INFO:tasks.workunit.client.0.smithi088.stdout:8/283: mknod db/d26/d2c/c60 0 2024-09-13T21:40:22.174 INFO:tasks.workunit.client.0.smithi088.stdout:5/362: symlink d4/d1c/d24/d26/d4b/l7d 0 2024-09-13T21:40:22.174 INFO:tasks.workunit.client.0.smithi088.stdout:5/363: stat d4/d1c/c2f 0 2024-09-13T21:40:22.174 INFO:tasks.workunit.client.0.smithi088.stdout:4/305: write d2/d5/d20/d60/de/f28 [2872406,118625] 0 2024-09-13T21:40:22.174 INFO:tasks.workunit.client.0.smithi088.stdout:7/294: getdents d6/da/d1a/d3a 0 2024-09-13T21:40:22.175 INFO:tasks.workunit.client.0.smithi088.stdout:3/350: dwrite d5/d14/f2c [0,4194304] 0 2024-09-13T21:40:22.175 INFO:tasks.workunit.client.0.smithi088.stdout:3/351: chown d5/d23/d2a/d63/d48/d71 1304 1 2024-09-13T21:40:22.177 INFO:tasks.workunit.client.0.smithi088.stdout:3/352: dread d5/d23/d2a/d63/d48/d49/f62 [0,4194304] 0 2024-09-13T21:40:22.177 INFO:tasks.workunit.client.0.smithi088.stdout:3/353: write d5/d23/d2a/d63/f2e [543011,43435] 0 2024-09-13T21:40:22.177 INFO:tasks.workunit.client.0.smithi088.stdout:9/313: rename d1a/d34/f58 to d1a/f5d 0 2024-09-13T21:40:22.177 INFO:tasks.workunit.client.0.smithi088.stdout:9/314: read f9 [941434,75053] 0 2024-09-13T21:40:22.179 INFO:tasks.workunit.client.0.smithi088.stdout:5/364: symlink d4/d1c/l7e 0 2024-09-13T21:40:22.181 INFO:tasks.workunit.client.0.smithi088.stdout:6/379: dread d0/d28/f40 [0,4194304] 0 2024-09-13T21:40:22.183 INFO:tasks.workunit.client.0.smithi088.stdout:4/306: getdents d2 0 2024-09-13T21:40:22.183 INFO:tasks.workunit.client.0.smithi088.stdout:7/295: mknod d6/da/d1a/d3a/d5c/c62 0 2024-09-13T21:40:22.183 INFO:tasks.workunit.client.0.smithi088.stdout:4/307: readlink d2/d5/d20/l2e 0 2024-09-13T21:40:22.183 INFO:tasks.workunit.client.0.smithi088.stdout:7/296: write d6/da/d1a/f43 [1348379,59993] 0 2024-09-13T21:40:22.183 INFO:tasks.workunit.client.0.smithi088.stdout:7/297: truncate d6/da/d39/d4f/f61 644656 0 2024-09-13T21:40:22.183 INFO:tasks.workunit.client.0.smithi088.stdout:7/298: chown d6/da/d39/d4f/l40 188938 1 2024-09-13T21:40:22.185 INFO:tasks.workunit.client.0.smithi088.stdout:3/354: dread d5/d14/f1a [0,4194304] 0 2024-09-13T21:40:22.185 INFO:tasks.workunit.client.0.smithi088.stdout:3/355: fdatasync f1 0 2024-09-13T21:40:22.185 INFO:tasks.workunit.client.0.smithi088.stdout:9/315: dread f14 [0,4194304] 0 2024-09-13T21:40:22.188 INFO:tasks.workunit.client.0.smithi088.stdout:8/284: write db/df/d25/f28 [3805329,3247] 0 2024-09-13T21:40:22.189 INFO:tasks.workunit.client.0.smithi088.stdout:1/360: rename d9/d10/d2a/d4b/c25 to d9/d4f/c86 0 2024-09-13T21:40:22.190 INFO:tasks.workunit.client.0.smithi088.stdout:2/374: dwrite d1/d13/f2c [4194304,4194304] 0 2024-09-13T21:40:22.190 INFO:tasks.workunit.client.0.smithi088.stdout:2/375: write d1/d8/f57 [926713,117401] 0 2024-09-13T21:40:22.191 INFO:tasks.workunit.client.0.smithi088.stdout:7/299: mknod d6/da/d1a/d3a/c63 0 2024-09-13T21:40:22.192 INFO:tasks.workunit.client.0.smithi088.stdout:6/380: dread d0/f17 [0,4194304] 0 2024-09-13T21:40:22.193 INFO:tasks.workunit.client.0.smithi088.stdout:6/381: readlink d0/d1e/l63 0 2024-09-13T21:40:22.193 INFO:tasks.workunit.client.0.smithi088.stdout:3/356: truncate d5/d14/f18 480279 0 2024-09-13T21:40:22.193 INFO:tasks.workunit.client.0.smithi088.stdout:3/357: dread - d5/d26/f70 zero size 2024-09-13T21:40:22.197 INFO:tasks.workunit.client.0.smithi088.stdout:8/285: mkdir db/df/d61 0 2024-09-13T21:40:22.197 INFO:tasks.workunit.client.0.smithi088.stdout:9/316: write d1a/d1b/f2e [806949,66713] 0 2024-09-13T21:40:22.201 INFO:tasks.workunit.client.0.smithi088.stdout:6/382: rename d0/c4f to d0/d1e/d1f/c75 0 2024-09-13T21:40:22.201 INFO:tasks.workunit.client.0.smithi088.stdout:6/383: write d0/ff [3146135,117773] 0 2024-09-13T21:40:22.201 INFO:tasks.workunit.client.0.smithi088.stdout:6/384: chown d0/db/d37/c74 15 1 2024-09-13T21:40:22.201 INFO:tasks.workunit.client.0.smithi088.stdout:1/361: read d9/d10/d2a/d4b/d39/d43/f4d [3420197,52686] 0 2024-09-13T21:40:22.201 INFO:tasks.workunit.client.0.smithi088.stdout:1/362: chown d9/d10/d2a/d4b/d3a/l4e 2354 1 2024-09-13T21:40:22.201 INFO:tasks.workunit.client.0.smithi088.stdout:1/363: fsync d9/fd 0 2024-09-13T21:40:22.204 INFO:tasks.workunit.client.0.smithi088.stdout:8/286: creat db/d26/d4f/f62 x:0 0 0 2024-09-13T21:40:22.205 INFO:tasks.workunit.client.0.smithi088.stdout:3/358: getdents d5/d26/d43 0 2024-09-13T21:40:22.208 INFO:tasks.workunit.client.0.smithi088.stdout:8/287: creat db/df/d61/f63 x:0 0 0 2024-09-13T21:40:22.208 INFO:tasks.workunit.client.0.smithi088.stdout:8/288: chown db/df 822 1 2024-09-13T21:40:22.208 INFO:tasks.workunit.client.0.smithi088.stdout:7/300: dread f1 [0,4194304] 0 2024-09-13T21:40:22.210 INFO:tasks.workunit.client.0.smithi088.stdout:2/376: write d1/d8/f12 [6660680,34179] 0 2024-09-13T21:40:22.210 INFO:tasks.workunit.client.0.smithi088.stdout:4/308: dwrite d2/d5/d20/d60/de/d1e/d23/f3d [0,4194304] 0 2024-09-13T21:40:22.210 INFO:tasks.workunit.client.0.smithi088.stdout:4/309: dread - d2/d5/d2d/f40 zero size 2024-09-13T21:40:22.211 INFO:tasks.workunit.client.0.smithi088.stdout:5/365: dwrite d4/d1c/d4a/d63/f6f [0,4194304] 0 2024-09-13T21:40:22.213 INFO:tasks.workunit.client.0.smithi088.stdout:3/359: mknod d5/d5a/c75 0 2024-09-13T21:40:22.213 INFO:tasks.workunit.client.0.smithi088.stdout:3/360: chown d5/l45 230658785 1 2024-09-13T21:40:22.214 INFO:tasks.workunit.client.0.smithi088.stdout:8/289: truncate db/d33/d51/f54 4103645 0 2024-09-13T21:40:22.214 INFO:tasks.workunit.client.0.smithi088.stdout:7/301: mkdir d6/da/d44/d64 0 2024-09-13T21:40:22.215 INFO:tasks.workunit.client.0.smithi088.stdout:2/377: truncate d1/d8/f4f 22011 0 2024-09-13T21:40:22.218 INFO:tasks.workunit.client.0.smithi088.stdout:1/364: dread d9/d10/d2a/d47/f50 [0,4194304] 0 2024-09-13T21:40:22.218 INFO:tasks.workunit.client.0.smithi088.stdout:1/365: dread - d9/d10/d2a/d4b/d39/f6c zero size 2024-09-13T21:40:22.218 INFO:tasks.workunit.client.0.smithi088.stdout:1/366: write d9/d10/d2a/d4b/d39/f40 [5625902,35938] 0 2024-09-13T21:40:22.219 INFO:tasks.workunit.client.0.smithi088.stdout:4/310: mkdir d2/d5/d20/d60/de/d1e/d23/d69 0 2024-09-13T21:40:22.226 INFO:tasks.workunit.client.0.smithi088.stdout:4/311: fsync d2/d5/d20/d60/de/f28 0 2024-09-13T21:40:22.226 INFO:tasks.workunit.client.0.smithi088.stdout:9/317: dwrite d1a/d1b/d3f/f4a [0,4194304] 0 2024-09-13T21:40:22.226 INFO:tasks.workunit.client.0.smithi088.stdout:6/385: dwrite d0/db/f2e [4194304,4194304] 0 2024-09-13T21:40:22.228 INFO:tasks.workunit.client.0.smithi088.stdout:5/366: rename d4/f22 to d4/d1c/d24/d26/d4b/d67/f7f 0 2024-09-13T21:40:22.229 INFO:tasks.workunit.client.0.smithi088.stdout:3/361: mkdir d5/d23/d2a/d3f/d76 0 2024-09-13T21:40:22.230 INFO:tasks.workunit.client.0.smithi088.stdout:8/290: symlink db/df/l64 0 2024-09-13T21:40:22.232 INFO:tasks.workunit.client.0.smithi088.stdout:7/302: rmdir d6/da/d44/d64 0 2024-09-13T21:40:22.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/378: link d1/d13/f17 d1/d13/d2a/d3c/d4a/f87 0 2024-09-13T21:40:22.234 INFO:tasks.workunit.client.0.smithi088.stdout:2/379: dread - d1/f77 zero size 2024-09-13T21:40:22.235 INFO:tasks.workunit.client.0.smithi088.stdout:1/367: creat d9/dc/d74/f87 x:0 0 0 2024-09-13T21:40:22.243 INFO:tasks.workunit.client.0.smithi088.stdout:9/318: dwrite d1a/d1b/f53 [0,4194304] 0 2024-09-13T21:40:22.245 INFO:tasks.workunit.client.0.smithi088.stdout:4/312: creat d2/d5/d20/d41/d4b/f6a x:0 0 0 2024-09-13T21:40:22.245 INFO:tasks.workunit.client.0.smithi088.stdout:3/362: dread d5/d14/f37 [0,4194304] 0 2024-09-13T21:40:22.245 INFO:tasks.workunit.client.0.smithi088.stdout:6/386: symlink d0/db/d37/l76 0 2024-09-13T21:40:22.247 INFO:tasks.workunit.client.0.smithi088.stdout:8/291: creat db/df/f65 x:0 0 0 2024-09-13T21:40:22.247 INFO:tasks.workunit.client.0.smithi088.stdout:8/292: creat db/d26/d4f/f66 x:0 0 0 2024-09-13T21:40:22.248 INFO:tasks.workunit.client.0.smithi088.stdout:7/303: creat d6/da/d44/f65 x:0 0 0 2024-09-13T21:40:22.249 INFO:tasks.workunit.client.0.smithi088.stdout:2/380: write d1/f68 [2381821,110294] 0 2024-09-13T21:40:22.250 INFO:tasks.workunit.client.0.smithi088.stdout:9/319: mkdir d1a/d3c/d51/d5e 0 2024-09-13T21:40:22.250 INFO:tasks.workunit.client.0.smithi088.stdout:9/320: stat d1a/d1b/d3f/f4a 0 2024-09-13T21:40:22.252 INFO:tasks.workunit.client.0.smithi088.stdout:6/387: symlink d0/d1e/d66/l77 0 2024-09-13T21:40:22.252 INFO:tasks.workunit.client.0.smithi088.stdout:6/388: dread - d0/d1e/d1f/f4d zero size 2024-09-13T21:40:22.254 INFO:tasks.workunit.client.0.smithi088.stdout:5/367: mknod d4/d1b/d2a/c80 0 2024-09-13T21:40:22.259 INFO:tasks.workunit.client.0.smithi088.stdout:7/304: dread d6/da/f1e [0,4194304] 0 2024-09-13T21:40:22.260 INFO:tasks.workunit.client.0.smithi088.stdout:2/381: rename d1/d13/d2a/d3c/d4a/f87 to d1/d13/d2a/d3c/d4a/d6e/d66/f88 0 2024-09-13T21:40:22.261 INFO:tasks.workunit.client.0.smithi088.stdout:9/321: mknod d1a/d3c/d51/c5f 0 2024-09-13T21:40:22.262 INFO:tasks.workunit.client.0.smithi088.stdout:0/357: sync 2024-09-13T21:40:22.262 INFO:tasks.workunit.client.0.smithi088.stdout:0/358: chown d7/d2c/d37/f7d 7 1 2024-09-13T21:40:22.262 INFO:tasks.workunit.client.0.smithi088.stdout:0/359: fsync d7/d1d/d27/f70 0 2024-09-13T21:40:22.262 INFO:tasks.workunit.client.0.smithi088.stdout:3/363: truncate d5/d23/d2a/d63/f2e 540388 0 2024-09-13T21:40:22.262 INFO:tasks.workunit.client.0.smithi088.stdout:3/364: readlink d5/d14/l15 0 2024-09-13T21:40:22.264 INFO:tasks.workunit.client.0.smithi088.stdout:6/389: creat d0/d28/f78 x:0 0 0 2024-09-13T21:40:22.265 INFO:tasks.workunit.client.0.smithi088.stdout:6/390: creat d0/d2c/d32/d39/d3f/f79 x:0 0 0 2024-09-13T21:40:22.266 INFO:tasks.workunit.client.0.smithi088.stdout:5/368: unlink d4/d1c/f3e 0 2024-09-13T21:40:22.266 INFO:tasks.workunit.client.0.smithi088.stdout:5/369: readlink d4/l21 0 2024-09-13T21:40:22.266 INFO:tasks.workunit.client.0.smithi088.stdout:5/370: fsync d4/f13 0 2024-09-13T21:40:22.267 INFO:tasks.workunit.client.0.smithi088.stdout:2/382: mkdir d1/d13/d2a/d3c/d4a/d6e/d5b/d89 0 2024-09-13T21:40:22.267 INFO:tasks.workunit.client.0.smithi088.stdout:2/383: dread - d1/d8/d16/d40/f60 zero size 2024-09-13T21:40:22.268 INFO:tasks.workunit.client.0.smithi088.stdout:2/384: stat d1/d8/fc 0 2024-09-13T21:40:22.268 INFO:tasks.workunit.client.0.smithi088.stdout:9/322: mkdir d1a/d3c/d60 0 2024-09-13T21:40:22.270 INFO:tasks.workunit.client.0.smithi088.stdout:7/305: write d6/da/d1a/f2b [3213134,23965] 0 2024-09-13T21:40:22.270 INFO:tasks.workunit.client.0.smithi088.stdout:7/306: write d6/da/d1a/d3a/f3f [1188656,52817] 0 2024-09-13T21:40:22.270 INFO:tasks.workunit.client.0.smithi088.stdout:7/307: fdatasync d6/f42 0 2024-09-13T21:40:22.272 INFO:tasks.workunit.client.0.smithi088.stdout:6/391: rename d0/d28/d6c to d0/d2c/d7a 0 2024-09-13T21:40:22.272 INFO:tasks.workunit.client.0.smithi088.stdout:6/392: read - d0/d1e/d1f/f70 zero size 2024-09-13T21:40:22.273 INFO:tasks.workunit.client.0.smithi088.stdout:5/371: mkdir d4/d1c/d81 0 2024-09-13T21:40:22.273 INFO:tasks.workunit.client.0.smithi088.stdout:5/372: truncate d4/d1c/d24/d26/d4b/d66/f77 928201 0 2024-09-13T21:40:22.276 INFO:tasks.workunit.client.0.smithi088.stdout:3/365: dread d5/f21 [0,4194304] 0 2024-09-13T21:40:22.276 INFO:tasks.workunit.client.0.smithi088.stdout:2/385: link d1/f4 d1/d8/d24/f8a 0 2024-09-13T21:40:22.276 INFO:tasks.workunit.client.0.smithi088.stdout:2/386: creat d1/d8/d2e/d3b/f8b x:0 0 0 2024-09-13T21:40:22.276 INFO:tasks.workunit.client.0.smithi088.stdout:3/366: write d5/f38 [2048028,44004] 0 2024-09-13T21:40:22.277 INFO:tasks.workunit.client.0.smithi088.stdout:0/360: rmdir d7/d1d/d27/d43 39 2024-09-13T21:40:22.281 INFO:tasks.workunit.client.0.smithi088.stdout:4/313: dwrite d2/d5/d20/d60/de/d1e/f37 [0,4194304] 0 2024-09-13T21:40:22.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/293: dwrite db/d26/f36 [0,4194304] 0 2024-09-13T21:40:22.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/294: chown db/f1a 0 1 2024-09-13T21:40:22.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/295: creat db/df/f67 x:0 0 0 2024-09-13T21:40:22.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/296: creat db/d26/d4f/f68 x:0 0 0 2024-09-13T21:40:22.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/297: creat db/df/f69 x:0 0 0 2024-09-13T21:40:22.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/298: creat db/df/d61/f6a x:0 0 0 2024-09-13T21:40:22.281 INFO:tasks.workunit.client.0.smithi088.stdout:8/299: dread - db/d26/d4f/f68 zero size 2024-09-13T21:40:22.282 INFO:tasks.workunit.client.0.smithi088.stdout:5/373: truncate d4/d1c/d24/f39 4145362 0 2024-09-13T21:40:22.288 INFO:tasks.workunit.client.0.smithi088.stdout:7/308: dwrite d6/da/d1a/f2d [0,4194304] 0 2024-09-13T21:40:22.289 INFO:tasks.workunit.client.0.smithi088.stdout:3/367: creat d5/d23/d2a/d3f/d76/f77 x:0 0 0 2024-09-13T21:40:22.289 INFO:tasks.workunit.client.0.smithi088.stdout:3/368: readlink d5/d23/d2a/d63/d31/l36 0 2024-09-13T21:40:22.289 INFO:tasks.workunit.client.0.smithi088.stdout:3/369: creat d5/d26/f78 x:0 0 0 2024-09-13T21:40:22.289 INFO:tasks.workunit.client.0.smithi088.stdout:3/370: chown d5/d14/f1a 8 1 2024-09-13T21:40:22.301 INFO:tasks.workunit.client.0.smithi088.stdout:8/300: creat db/f6b x:0 0 0 2024-09-13T21:40:22.304 INFO:tasks.workunit.client.0.smithi088.stdout:7/309: rename d6/da/d1a/f2d to d6/da/d1a/d3a/d5c/d60/f66 0 2024-09-13T21:40:22.307 INFO:tasks.workunit.client.0.smithi088.stdout:8/301: mknod db/d26/c6c 0 2024-09-13T21:40:22.307 INFO:tasks.workunit.client.0.smithi088.stdout:8/302: creat db/d26/d4f/f6d x:0 0 0 2024-09-13T21:40:22.307 INFO:tasks.workunit.client.0.smithi088.stdout:8/303: fsync db/df/f65 0 2024-09-13T21:40:22.307 INFO:tasks.workunit.client.0.smithi088.stdout:8/304: truncate db/d26/d37/f46 1797096 0 2024-09-13T21:40:22.307 INFO:tasks.workunit.client.0.smithi088.stdout:9/323: rename d1a/d34 to d1a/d61 0 2024-09-13T21:40:22.309 INFO:tasks.workunit.client.0.smithi088.stdout:7/310: dread d6/da/d1a/f2b [0,4194304] 0 2024-09-13T21:40:22.309 INFO:tasks.workunit.client.0.smithi088.stdout:5/374: dwrite d4/d1c/d4a/d63/d6a/f6b [0,4194304] 0 2024-09-13T21:40:22.310 INFO:tasks.workunit.client.0.smithi088.stdout:9/324: write - open d1a/f3b failed 14 2024-09-13T21:40:22.312 INFO:tasks.workunit.client.0.smithi088.stdout:4/314: dwrite d2/d5/f53 [0,4194304] 0 2024-09-13T21:40:22.314 INFO:tasks.workunit.client.0.smithi088.stdout:0/361: dwrite d7/d2c/d37/f59 [0,4194304] 0 2024-09-13T21:40:22.322 INFO:tasks.workunit.client.0.smithi088.stdout:8/305: write fa [1744015,13156] 0 2024-09-13T21:40:22.322 INFO:tasks.workunit.client.0.smithi088.stdout:8/306: chown db/df/d61/f63 242876 1 2024-09-13T21:40:22.325 INFO:tasks.workunit.client.0.smithi088.stdout:0/362: dread d7/d2c/f48 [0,4194304] 0 2024-09-13T21:40:22.325 INFO:tasks.workunit.client.0.smithi088.stdout:8/307: symlink db/d33/d51/l6e 0 2024-09-13T21:40:22.325 INFO:tasks.workunit.client.0.smithi088.stdout:8/308: chown db/d26/f48 15848 1 2024-09-13T21:40:22.326 INFO:tasks.workunit.client.0.smithi088.stdout:3/371: dwrite d5/f13 [0,4194304] 0 2024-09-13T21:40:22.326 INFO:tasks.workunit.client.0.smithi088.stdout:4/315: dread d2/d5/ff [0,4194304] 0 2024-09-13T21:40:22.327 INFO:tasks.workunit.client.0.smithi088.stdout:3/372: fsync d5/f56 0 2024-09-13T21:40:22.327 INFO:tasks.workunit.client.0.smithi088.stdout:4/316: truncate d2/d5/d20/d41/d4b/f54 345080 0 2024-09-13T21:40:22.327 INFO:tasks.workunit.client.0.smithi088.stdout:3/373: readlink d5/d23/d2a/l60 0 2024-09-13T21:40:22.327 INFO:tasks.workunit.client.0.smithi088.stdout:4/317: chown d2/d5/d20/d60/de/d1e/d31/c47 23046293 1 2024-09-13T21:40:22.327 INFO:tasks.workunit.client.0.smithi088.stdout:3/374: write d5/d23/d2a/d63/f5c [403071,13876] 0 2024-09-13T21:40:22.327 INFO:tasks.workunit.client.0.smithi088.stdout:0/363: mknod d7/d2c/d44/c8e 0 2024-09-13T21:40:22.327 INFO:tasks.workunit.client.0.smithi088.stdout:7/311: dread d6/da/f46 [0,4194304] 0 2024-09-13T21:40:22.329 INFO:tasks.workunit.client.0.smithi088.stdout:4/318: symlink d2/d5/l6b 0 2024-09-13T21:40:22.329 INFO:tasks.workunit.client.0.smithi088.stdout:4/319: read d2/f15 [224601,115330] 0 2024-09-13T21:40:22.329 INFO:tasks.workunit.client.0.smithi088.stdout:4/320: chown d2/d5/d20/d60/de/f58 790289327 1 2024-09-13T21:40:22.330 INFO:tasks.workunit.client.0.smithi088.stdout:3/375: mkdir d5/d23/d2a/d55/d79 0 2024-09-13T21:40:22.330 INFO:tasks.workunit.client.0.smithi088.stdout:3/376: dread - d5/d23/d2a/d63/d31/f5f zero size 2024-09-13T21:40:22.330 INFO:tasks.workunit.client.0.smithi088.stdout:0/364: mknod d7/d2c/c8f 0 2024-09-13T21:40:22.333 INFO:tasks.workunit.client.0.smithi088.stdout:5/375: dwrite d4/f13 [0,4194304] 0 2024-09-13T21:40:22.333 INFO:tasks.workunit.client.0.smithi088.stdout:8/309: rmdir db/df 39 2024-09-13T21:40:22.334 INFO:tasks.workunit.client.0.smithi088.stdout:8/310: stat db/d26/d37/c3a 0 2024-09-13T21:40:22.335 INFO:tasks.workunit.client.0.smithi088.stdout:9/325: dwrite d1a/d1b/f25 [0,4194304] 0 2024-09-13T21:40:22.335 INFO:tasks.workunit.client.0.smithi088.stdout:9/326: fsync d1a/d61/d3d/d41/d48/f4f 0 2024-09-13T21:40:22.335 INFO:tasks.workunit.client.0.smithi088.stdout:7/312: mknod d6/da/d39/c67 0 2024-09-13T21:40:22.337 INFO:tasks.workunit.client.0.smithi088.stdout:5/376: dread d4/d1b/d2a/f3b [0,4194304] 0 2024-09-13T21:40:22.337 INFO:tasks.workunit.client.0.smithi088.stdout:5/377: dread - d4/d1c/d24/d26/d40/f49 zero size 2024-09-13T21:40:22.337 INFO:tasks.workunit.client.0.smithi088.stdout:5/378: creat d4/d1c/d24/d26/f82 x:0 0 0 2024-09-13T21:40:22.337 INFO:tasks.workunit.client.0.smithi088.stdout:5/379: write d4/d1b/f75 [193622,7410] 0 2024-09-13T21:40:22.337 INFO:tasks.workunit.client.0.smithi088.stdout:4/321: unlink d2/d5/d20/d60/de/d12/c35 0 2024-09-13T21:40:22.338 INFO:tasks.workunit.client.0.smithi088.stdout:0/365: link d7/d1d/d27/l5a d7/d65/l90 0 2024-09-13T21:40:22.347 INFO:tasks.workunit.client.0.smithi088.stdout:8/311: link db/d26/d2c/f5a db/d33/f6f 0 2024-09-13T21:40:22.347 INFO:tasks.workunit.client.0.smithi088.stdout:0/366: write d7/d1d/f29 [352903,27653] 0 2024-09-13T21:40:22.349 INFO:tasks.workunit.client.0.smithi088.stdout:9/327: link f9 d1a/d61/d3d/f62 0 2024-09-13T21:40:22.349 INFO:tasks.workunit.client.0.smithi088.stdout:9/328: stat d1a/d61/d3d/d41/d48/f4f 0 2024-09-13T21:40:22.351 INFO:tasks.workunit.client.0.smithi088.stdout:7/313: link d6/da/l12 d6/da/d44/l68 0 2024-09-13T21:40:22.354 INFO:tasks.workunit.client.0.smithi088.stdout:5/380: mkdir d4/d1c/d83 0 2024-09-13T21:40:22.357 INFO:tasks.workunit.client.0.smithi088.stdout:9/329: truncate d1a/d1b/f53 2869824 0 2024-09-13T21:40:22.357 INFO:tasks.workunit.client.0.smithi088.stdout:0/367: write d7/d1d/f69 [3042276,93959] 0 2024-09-13T21:40:22.360 INFO:tasks.workunit.client.0.smithi088.stdout:5/381: symlink d4/d1c/d24/d26/d56/l84 0 2024-09-13T21:40:22.364 INFO:tasks.workunit.client.0.smithi088.stdout:8/312: dwrite db/d26/f35 [0,4194304] 0 2024-09-13T21:40:22.366 INFO:tasks.workunit.client.0.smithi088.stdout:4/322: rename d2/d5/d20/d60/de/d12 to d2/d5/d20/d60/de/d1e/d23/d6c 0 2024-09-13T21:40:22.367 INFO:tasks.workunit.client.0.smithi088.stdout:5/382: dread d4/d1b/d2a/f2d [0,4194304] 0 2024-09-13T21:40:22.368 INFO:tasks.workunit.client.0.smithi088.stdout:5/383: write d4/d1c/d24/d26/d4b/d67/f7f [503142,24363] 0 2024-09-13T21:40:22.368 INFO:tasks.workunit.client.0.smithi088.stdout:5/384: truncate d4/d1c/d24/d26/d4b/d66/f77 1605674 0 2024-09-13T21:40:22.370 INFO:tasks.workunit.client.0.smithi088.stdout:4/323: symlink d2/d5/l6d 0 2024-09-13T21:40:22.370 INFO:tasks.workunit.client.0.smithi088.stdout:4/324: fdatasync d2/d5/d20/d41/d4b/f54 0 2024-09-13T21:40:22.370 INFO:tasks.workunit.client.0.smithi088.stdout:9/330: write d1a/d1b/d3f/f4a [1877077,82099] 0 2024-09-13T21:40:22.371 INFO:tasks.workunit.client.0.smithi088.stdout:8/313: rmdir db/d26/d2c 39 2024-09-13T21:40:22.374 INFO:tasks.workunit.client.0.smithi088.stdout:5/385: rmdir d4/d1c/d83 0 2024-09-13T21:40:22.374 INFO:tasks.workunit.client.0.smithi088.stdout:5/386: creat d4/d1b/f85 x:0 0 0 2024-09-13T21:40:22.374 INFO:tasks.workunit.client.0.smithi088.stdout:5/387: write d4/d1b/f85 [488007,45525] 0 2024-09-13T21:40:22.374 INFO:tasks.workunit.client.0.smithi088.stdout:4/325: dread d2/d5/d20/d60/de/d1e/d23/d6c/f34 [0,4194304] 0 2024-09-13T21:40:22.375 INFO:tasks.workunit.client.0.smithi088.stdout:4/326: stat d2/d5/d2d/c62 0 2024-09-13T21:40:22.376 INFO:tasks.workunit.client.0.smithi088.stdout:0/368: dwrite d7/d1d/d26/d34/f38 [0,4194304] 0 2024-09-13T21:40:22.378 INFO:tasks.workunit.client.0.smithi088.stdout:8/314: symlink db/df/d25/l70 0 2024-09-13T21:40:22.378 INFO:tasks.workunit.client.0.smithi088.stdout:8/315: chown db/d33 338862 1 2024-09-13T21:40:22.383 INFO:tasks.workunit.client.0.smithi088.stdout:7/314: rename d6/da/d39 to d6/d5f/d69 0 2024-09-13T21:40:22.390 INFO:tasks.workunit.client.0.smithi088.stdout:4/327: symlink d2/d5/d20/d60/de/l6e 0 2024-09-13T21:40:22.390 INFO:tasks.workunit.client.0.smithi088.stdout:0/369: rmdir d7/d1d/d26/d45/d7c 39 2024-09-13T21:40:22.390 INFO:tasks.workunit.client.0.smithi088.stdout:0/370: truncate d7/f8a 643216 0 2024-09-13T21:40:22.390 INFO:tasks.workunit.client.0.smithi088.stdout:0/371: chown d7/d1d/d27/d43/f1c 0 1 2024-09-13T21:40:22.396 INFO:tasks.workunit.client.0.smithi088.stdout:4/328: dread d2/d5/d20/d60/de/d1e/f26 [0,4194304] 0 2024-09-13T21:40:22.399 INFO:tasks.workunit.client.0.smithi088.stdout:4/329: rename d2/d5/d20/d60/d19 to d2/d5/d20/d60/de/d1e/d23/d6f 0 2024-09-13T21:40:22.399 INFO:tasks.workunit.client.0.smithi088.stdout:4/330: fdatasync d2/f45 0 2024-09-13T21:40:22.399 INFO:tasks.workunit.client.0.smithi088.stdout:5/388: dwrite d4/fc [0,4194304] 0 2024-09-13T21:40:22.399 INFO:tasks.workunit.client.0.smithi088.stdout:0/372: dread d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:22.399 INFO:tasks.workunit.client.0.smithi088.stdout:5/389: dread - d4/d1c/d24/d26/d40/f49 zero size 2024-09-13T21:40:22.399 INFO:tasks.workunit.client.0.smithi088.stdout:8/316: dwrite db/d26/d4f/f62 [0,4194304] 0 2024-09-13T21:40:22.401 INFO:tasks.workunit.client.0.smithi088.stdout:5/390: mknod d4/d1b/d68/c86 0 2024-09-13T21:40:22.403 INFO:tasks.workunit.client.0.smithi088.stdout:8/317: truncate db/d26/d37/f41 772083 0 2024-09-13T21:40:22.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/331: dread d2/d5/f53 [0,4194304] 0 2024-09-13T21:40:22.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/332: read - d2/d5/d2d/f40 zero size 2024-09-13T21:40:22.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/333: write d2/d5/d2d/f40 [901491,8349] 0 2024-09-13T21:40:22.411 INFO:tasks.workunit.client.0.smithi088.stdout:5/391: rmdir d4/d1c/d24/d26/d4b/d66 39 2024-09-13T21:40:22.413 INFO:tasks.workunit.client.0.smithi088.stdout:8/318: getdents db 0 2024-09-13T21:40:22.414 INFO:tasks.workunit.client.0.smithi088.stdout:4/334: mkdir d2/d5/d2d/d70 0 2024-09-13T21:40:22.414 INFO:tasks.workunit.client.0.smithi088.stdout:4/335: truncate d2/d5/d20/d60/de/d1e/d31/f3b 5597628 0 2024-09-13T21:40:22.414 INFO:tasks.workunit.client.0.smithi088.stdout:4/336: fdatasync d2/d11/f16 0 2024-09-13T21:40:22.415 INFO:tasks.workunit.client.0.smithi088.stdout:5/392: truncate f2 5013951 0 2024-09-13T21:40:22.416 INFO:tasks.workunit.client.0.smithi088.stdout:5/393: read d4/d1b/d2a/f61 [277629,91671] 0 2024-09-13T21:40:22.416 INFO:tasks.workunit.client.0.smithi088.stdout:5/394: chown d4/d1c/d4a/d63/f6f 26 1 2024-09-13T21:40:22.417 INFO:tasks.workunit.client.0.smithi088.stdout:4/337: rename d2/d5/d20/d60/de/d1e/d23/d6c/c2b to d2/d11/c71 0 2024-09-13T21:40:22.417 INFO:tasks.workunit.client.0.smithi088.stdout:4/338: rename d2/d5/d20/d60/de/d1e/d31 to d2/d5/d20/d60/de/d1e/d31/d72 22 2024-09-13T21:40:22.418 INFO:tasks.workunit.client.0.smithi088.stdout:5/395: unlink d4/d1c/f58 0 2024-09-13T21:40:22.418 INFO:tasks.workunit.client.0.smithi088.stdout:5/396: write d4/d1c/d4a/f72 [911807,128458] 0 2024-09-13T21:40:22.418 INFO:tasks.workunit.client.0.smithi088.stdout:5/397: readlink d4/d1c/d24/d26/d56/l84 0 2024-09-13T21:40:22.421 INFO:tasks.workunit.client.0.smithi088.stdout:0/373: dwrite d7/d2c/d37/f7d [0,4194304] 0 2024-09-13T21:40:22.424 INFO:tasks.workunit.client.0.smithi088.stdout:0/374: rmdir d7/d1d/d27 39 2024-09-13T21:40:22.424 INFO:tasks.workunit.client.0.smithi088.stdout:0/375: creat d7/f91 x:0 0 0 2024-09-13T21:40:22.425 INFO:tasks.workunit.client.0.smithi088.stdout:0/376: chown d7/d1d/d27/f64 1 1 2024-09-13T21:40:22.425 INFO:tasks.workunit.client.0.smithi088.stdout:8/319: read db/d26/d2c/f32 [426956,115995] 0 2024-09-13T21:40:22.425 INFO:tasks.workunit.client.0.smithi088.stdout:8/320: fdatasync db/df/f3d 0 2024-09-13T21:40:22.426 INFO:tasks.workunit.client.0.smithi088.stdout:8/321: read db/d26/d2c/f4c [453709,50670] 0 2024-09-13T21:40:22.427 INFO:tasks.workunit.client.0.smithi088.stdout:0/377: truncate d7/d1d/d27/f39 198467 0 2024-09-13T21:40:22.427 INFO:tasks.workunit.client.0.smithi088.stdout:0/378: readlink d7/d2c/d30/d31/l71 0 2024-09-13T21:40:22.429 INFO:tasks.workunit.client.0.smithi088.stdout:8/322: rename db/f24 to db/d33/d51/f71 0 2024-09-13T21:40:22.430 INFO:tasks.workunit.client.0.smithi088.stdout:0/379: creat d7/d65/f92 x:0 0 0 2024-09-13T21:40:22.430 INFO:tasks.workunit.client.0.smithi088.stdout:0/380: write d7/d1d/d27/f3e [996677,44211] 0 2024-09-13T21:40:22.431 INFO:tasks.workunit.client.0.smithi088.stdout:8/323: mknod db/d33/c72 0 2024-09-13T21:40:22.431 INFO:tasks.workunit.client.0.smithi088.stdout:8/324: dread - db/d33/f5c zero size 2024-09-13T21:40:22.432 INFO:tasks.workunit.client.0.smithi088.stdout:0/381: symlink d7/d1d/d66/d8b/l93 0 2024-09-13T21:40:22.436 INFO:tasks.workunit.client.0.smithi088.stdout:8/325: symlink db/d26/d4f/l73 0 2024-09-13T21:40:22.436 INFO:tasks.workunit.client.0.smithi088.stdout:0/382: creat d7/d1d/d26/d45/d7c/f94 x:0 0 0 2024-09-13T21:40:22.438 INFO:tasks.workunit.client.0.smithi088.stdout:8/326: unlink db/d26/d2c/f32 0 2024-09-13T21:40:22.438 INFO:tasks.workunit.client.0.smithi088.stdout:8/327: write db/d26/d2c/f5d [645957,3853] 0 2024-09-13T21:40:22.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/339: dwrite d2/d13/d50/f59 [0,4194304] 0 2024-09-13T21:40:22.438 INFO:tasks.workunit.client.0.smithi088.stdout:4/340: creat d2/d5/d20/f73 x:0 0 0 2024-09-13T21:40:22.438 INFO:tasks.workunit.client.0.smithi088.stdout:5/398: dwrite d4/d1c/f53 [0,4194304] 0 2024-09-13T21:40:22.438 INFO:tasks.workunit.client.0.smithi088.stdout:5/399: fdatasync d4/d1c/f48 0 2024-09-13T21:40:22.438 INFO:tasks.workunit.client.0.smithi088.stdout:5/400: chown d4/d1c/d24/d26/d40/fa 3 1 2024-09-13T21:40:22.440 INFO:tasks.workunit.client.0.smithi088.stdout:8/328: unlink db/df/f18 0 2024-09-13T21:40:22.440 INFO:tasks.workunit.client.0.smithi088.stdout:8/329: write db/d26/f5f [1223481,105918] 0 2024-09-13T21:40:22.440 INFO:tasks.workunit.client.0.smithi088.stdout:8/330: write db/d26/d2c/f4c [811337,13944] 0 2024-09-13T21:40:22.442 INFO:tasks.workunit.client.0.smithi088.stdout:8/331: fdatasync db/d26/d2c/f4c 0 2024-09-13T21:40:22.442 INFO:tasks.workunit.client.0.smithi088.stdout:8/332: chown db/df/f1f 9213 1 2024-09-13T21:40:22.448 INFO:tasks.workunit.client.0.smithi088.stdout:5/401: rename d4/d1b/l52 to d4/d1c/d4a/d63/d6a/d6d/l87 0 2024-09-13T21:40:22.448 INFO:tasks.workunit.client.0.smithi088.stdout:5/402: fdatasync d4/d1b/f43 0 2024-09-13T21:40:22.449 INFO:tasks.workunit.client.0.smithi088.stdout:8/333: rmdir db/df/d25 39 2024-09-13T21:40:22.449 INFO:tasks.workunit.client.0.smithi088.stdout:8/334: readlink db/l2a 0 2024-09-13T21:40:22.452 INFO:tasks.workunit.client.0.smithi088.stdout:5/403: creat d4/d1c/d76/f88 x:0 0 0 2024-09-13T21:40:22.452 INFO:tasks.workunit.client.0.smithi088.stdout:5/404: dread - d4/d1c/d4a/d63/f74 zero size 2024-09-13T21:40:22.452 INFO:tasks.workunit.client.0.smithi088.stdout:0/383: fsync d7/d1d/d26/d45/d7c/f94 0 2024-09-13T21:40:22.457 INFO:tasks.workunit.client.0.smithi088.stdout:4/341: dwrite d2/d5/d20/d60/f2a [0,4194304] 0 2024-09-13T21:40:22.457 INFO:tasks.workunit.client.0.smithi088.stdout:4/342: fdatasync d2/d5/d20/d60/de/d1e/f26 0 2024-09-13T21:40:22.457 INFO:tasks.workunit.client.0.smithi088.stdout:4/343: truncate d2/d5/d2d/f67 1006910 0 2024-09-13T21:40:22.457 INFO:tasks.workunit.client.0.smithi088.stdout:0/384: rmdir d7/d1d/d26/d34 39 2024-09-13T21:40:22.463 INFO:tasks.workunit.client.0.smithi088.stdout:0/385: mkdir d7/d2c/d30/d31/d42/d95 0 2024-09-13T21:40:22.465 INFO:tasks.workunit.client.0.smithi088.stdout:5/405: fsync d4/d1c/d76/f88 0 2024-09-13T21:40:22.467 INFO:tasks.workunit.client.0.smithi088.stdout:8/335: dwrite db/d26/f50 [0,4194304] 0 2024-09-13T21:40:22.467 INFO:tasks.workunit.client.0.smithi088.stdout:8/336: dread - db/df/f67 zero size 2024-09-13T21:40:22.471 INFO:tasks.workunit.client.0.smithi088.stdout:0/386: symlink d7/d2c/d30/d31/d42/l96 0 2024-09-13T21:40:22.472 INFO:tasks.workunit.client.0.smithi088.stdout:5/406: mkdir d4/d1c/d81/d89 0 2024-09-13T21:40:22.475 INFO:tasks.workunit.client.0.smithi088.stdout:0/387: symlink d7/d2c/d37/l97 0 2024-09-13T21:40:22.476 INFO:tasks.workunit.client.0.smithi088.stdout:0/388: mknod d7/d2c/c98 0 2024-09-13T21:40:22.487 INFO:tasks.workunit.client.0.smithi088.stdout:1/368: sync 2024-09-13T21:40:22.487 INFO:tasks.workunit.client.0.smithi088.stdout:6/393: sync 2024-09-13T21:40:22.487 INFO:tasks.workunit.client.0.smithi088.stdout:6/394: fsync d0/f52 0 2024-09-13T21:40:22.488 INFO:tasks.workunit.client.0.smithi088.stdout:6/395: link d0/db/f10 d0/d1e/d1f/f7b 0 2024-09-13T21:40:22.489 INFO:tasks.workunit.client.0.smithi088.stdout:6/396: mkdir d0/d2c/d7a/d7c 0 2024-09-13T21:40:22.491 INFO:tasks.workunit.client.0.smithi088.stdout:6/397: rename d0/d2c/d32/d39/c64 to d0/d2c/d59/c7d 0 2024-09-13T21:40:22.495 INFO:tasks.workunit.client.0.smithi088.stdout:4/344: dwrite d2/d5/ff [0,4194304] 0 2024-09-13T21:40:22.497 INFO:tasks.workunit.client.0.smithi088.stdout:4/345: creat d2/d5/d20/d60/de/d1e/d23/f74 x:0 0 0 2024-09-13T21:40:22.504 INFO:tasks.workunit.client.0.smithi088.stdout:5/407: dwrite d4/d1c/d4a/d63/f74 [0,4194304] 0 2024-09-13T21:40:22.504 INFO:tasks.workunit.client.0.smithi088.stdout:5/408: truncate d4/d1c/d24/d26/d40/f5a 75380 0 2024-09-13T21:40:22.504 INFO:tasks.workunit.client.0.smithi088.stdout:8/337: dwrite db/d33/d51/f54 [4194304,4194304] 0 2024-09-13T21:40:22.504 INFO:tasks.workunit.client.0.smithi088.stdout:8/338: dread - db/f6b zero size 2024-09-13T21:40:22.504 INFO:tasks.workunit.client.0.smithi088.stdout:0/389: dwrite d7/d2c/d30/d31/f32 [4194304,4194304] 0 2024-09-13T21:40:22.504 INFO:tasks.workunit.client.0.smithi088.stdout:0/390: write d7/d1d/f69 [3517634,54544] 0 2024-09-13T21:40:22.504 INFO:tasks.workunit.client.0.smithi088.stdout:1/369: dwrite d9/d10/d2a/d4b/d39/d43/f79 [0,4194304] 0 2024-09-13T21:40:22.509 INFO:tasks.workunit.client.0.smithi088.stdout:4/346: read d2/d5/d20/d60/de/d1e/f26 [3955557,111236] 0 2024-09-13T21:40:22.509 INFO:tasks.workunit.client.0.smithi088.stdout:4/347: stat d2/d5/d20/d60/f2a 0 2024-09-13T21:40:22.511 INFO:tasks.workunit.client.0.smithi088.stdout:6/398: getdents d0/d1e/d1f 0 2024-09-13T21:40:22.511 INFO:tasks.workunit.client.0.smithi088.stdout:6/399: dread - d0/d1e/d1f/f70 zero size 2024-09-13T21:40:22.511 INFO:tasks.workunit.client.0.smithi088.stdout:6/400: fdatasync d0/d1e/d1f/f4e 0 2024-09-13T21:40:22.511 INFO:tasks.workunit.client.0.smithi088.stdout:6/401: read d0/d28/f35 [40374,8868] 0 2024-09-13T21:40:22.516 INFO:tasks.workunit.client.0.smithi088.stdout:5/409: mkdir d4/d1c/d4a/d8a 0 2024-09-13T21:40:22.518 INFO:tasks.workunit.client.0.smithi088.stdout:8/339: creat db/d26/d37/f74 x:0 0 0 2024-09-13T21:40:22.518 INFO:tasks.workunit.client.0.smithi088.stdout:6/402: read d0/d28/f40 [2434971,48107] 0 2024-09-13T21:40:22.519 INFO:tasks.workunit.client.0.smithi088.stdout:6/403: fdatasync d0/d1e/f49 0 2024-09-13T21:40:22.519 INFO:tasks.workunit.client.0.smithi088.stdout:1/370: symlink d9/d10/d2a/d4b/d61/l88 0 2024-09-13T21:40:22.521 INFO:tasks.workunit.client.0.smithi088.stdout:0/391: dwrite d7/d1d/d27/d43/f53 [0,4194304] 0 2024-09-13T21:40:22.521 INFO:tasks.workunit.client.0.smithi088.stdout:4/348: link d2/d5/d20/d60/de/f32 d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 0 2024-09-13T21:40:22.522 INFO:tasks.workunit.client.0.smithi088.stdout:5/410: creat d4/d1c/d4a/d8a/f8b x:0 0 0 2024-09-13T21:40:22.522 INFO:tasks.workunit.client.0.smithi088.stdout:5/411: stat d4/d1c/l51 0 2024-09-13T21:40:22.523 INFO:tasks.workunit.client.0.smithi088.stdout:8/340: rename db/df/l5e to db/d33/d51/l75 0 2024-09-13T21:40:22.523 INFO:tasks.workunit.client.0.smithi088.stdout:8/341: chown db/df/f3d 136751934 1 2024-09-13T21:40:22.523 INFO:tasks.workunit.client.0.smithi088.stdout:6/404: truncate d0/d28/f35 160141 0 2024-09-13T21:40:22.526 INFO:tasks.workunit.client.0.smithi088.stdout:3/377: sync 2024-09-13T21:40:22.526 INFO:tasks.workunit.client.0.smithi088.stdout:2/387: sync 2024-09-13T21:40:22.528 INFO:tasks.workunit.client.0.smithi088.stdout:4/349: dread d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:22.528 INFO:tasks.workunit.client.0.smithi088.stdout:4/350: dread - d2/d5/d20/d60/de/d1e/d23/f74 zero size 2024-09-13T21:40:22.530 INFO:tasks.workunit.client.0.smithi088.stdout:4/351: dread d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 [0,4194304] 0 2024-09-13T21:40:22.531 INFO:tasks.workunit.client.0.smithi088.stdout:4/352: stat d2/d5/d20/d41/d4b/f6a 0 2024-09-13T21:40:22.532 INFO:tasks.workunit.client.0.smithi088.stdout:0/392: mknod d7/d1d/c99 0 2024-09-13T21:40:22.534 INFO:tasks.workunit.client.0.smithi088.stdout:5/412: unlink d4/d1c/d24/d26/c78 0 2024-09-13T21:40:22.535 INFO:tasks.workunit.client.0.smithi088.stdout:5/413: write d4/d1c/d24/d26/d4b/d66/f77 [3048,68691] 0 2024-09-13T21:40:22.535 INFO:tasks.workunit.client.0.smithi088.stdout:5/414: write d4/d1c/d24/d26/d4b/d66/f71 [51110,51794] 0 2024-09-13T21:40:22.536 INFO:tasks.workunit.client.0.smithi088.stdout:5/415: write d4/d1b/f85 [193592,40663] 0 2024-09-13T21:40:22.536 INFO:tasks.workunit.client.0.smithi088.stdout:8/342: symlink db/d33/d51/l76 0 2024-09-13T21:40:22.536 INFO:tasks.workunit.client.0.smithi088.stdout:5/416: fdatasync d4/d1b/d2a/f3b 0 2024-09-13T21:40:22.536 INFO:tasks.workunit.client.0.smithi088.stdout:8/343: chown db/l2a 13037907 1 2024-09-13T21:40:22.536 INFO:tasks.workunit.client.0.smithi088.stdout:5/417: dread - d4/f31 zero size 2024-09-13T21:40:22.537 INFO:tasks.workunit.client.0.smithi088.stdout:1/371: getdents d9/d10/d41/d7d 0 2024-09-13T21:40:22.538 INFO:tasks.workunit.client.0.smithi088.stdout:1/372: dread - d9/d10/d41/d7d/f80 zero size 2024-09-13T21:40:22.538 INFO:tasks.workunit.client.0.smithi088.stdout:0/393: dread d7/f2b [0,4194304] 0 2024-09-13T21:40:22.538 INFO:tasks.workunit.client.0.smithi088.stdout:0/394: chown d7/d65/f76 1455 1 2024-09-13T21:40:22.541 INFO:tasks.workunit.client.0.smithi088.stdout:2/388: rename d1/d13/d2a/d3c/c3d to d1/d13/d2a/d3c/c8c 0 2024-09-13T21:40:22.543 INFO:tasks.workunit.client.0.smithi088.stdout:3/378: mknod d5/d23/d2a/d63/d48/c7a 0 2024-09-13T21:40:22.543 INFO:tasks.workunit.client.0.smithi088.stdout:6/405: dwrite d0/d1e/d1f/f4e [0,4194304] 0 2024-09-13T21:40:22.545 INFO:tasks.workunit.client.0.smithi088.stdout:4/353: creat d2/d5/d20/d60/de/f76 x:0 0 0 2024-09-13T21:40:22.545 INFO:tasks.workunit.client.0.smithi088.stdout:9/331: sync 2024-09-13T21:40:22.545 INFO:tasks.workunit.client.0.smithi088.stdout:7/315: sync 2024-09-13T21:40:22.546 INFO:tasks.workunit.client.0.smithi088.stdout:7/316: dread - d6/d5f/d69/f5d zero size 2024-09-13T21:40:22.546 INFO:tasks.workunit.client.0.smithi088.stdout:7/317: creat d6/d4e/f6a x:0 0 0 2024-09-13T21:40:22.547 INFO:tasks.workunit.client.0.smithi088.stdout:3/379: dread d5/f38 [0,4194304] 0 2024-09-13T21:40:22.547 INFO:tasks.workunit.client.0.smithi088.stdout:3/380: write d5/d5a/f6f [917457,76854] 0 2024-09-13T21:40:22.547 INFO:tasks.workunit.client.0.smithi088.stdout:8/344: mkdir db/df/d61/d77 0 2024-09-13T21:40:22.549 INFO:tasks.workunit.client.0.smithi088.stdout:2/389: rename d1/d13/d2a/d41/d48/l62 to d1/d13/d2a/d41/d82/l8d 0 2024-09-13T21:40:22.552 INFO:tasks.workunit.client.0.smithi088.stdout:6/406: mknod d0/db/c7e 0 2024-09-13T21:40:22.552 INFO:tasks.workunit.client.0.smithi088.stdout:3/381: dread d5/f22 [0,4194304] 0 2024-09-13T21:40:22.553 INFO:tasks.workunit.client.0.smithi088.stdout:4/354: creat d2/d13/f77 x:0 0 0 2024-09-13T21:40:22.554 INFO:tasks.workunit.client.0.smithi088.stdout:4/355: creat d2/d5/d20/d60/de/d1e/d23/f78 x:0 0 0 2024-09-13T21:40:22.554 INFO:tasks.workunit.client.0.smithi088.stdout:9/332: creat d1a/d3c/d51/d5e/f63 x:0 0 0 2024-09-13T21:40:22.558 INFO:tasks.workunit.client.0.smithi088.stdout:8/345: rename db/d26/d4f/f6d to db/d26/d2c/f78 0 2024-09-13T21:40:22.558 INFO:tasks.workunit.client.0.smithi088.stdout:8/346: truncate db/d26/f35 4558518 0 2024-09-13T21:40:22.558 INFO:tasks.workunit.client.0.smithi088.stdout:3/382: dread d5/f22 [0,4194304] 0 2024-09-13T21:40:22.560 INFO:tasks.workunit.client.0.smithi088.stdout:5/418: dwrite d4/d1c/d4a/d63/d6a/f6b [0,4194304] 0 2024-09-13T21:40:22.561 INFO:tasks.workunit.client.0.smithi088.stdout:4/356: mkdir d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79 0 2024-09-13T21:40:22.562 INFO:tasks.workunit.client.0.smithi088.stdout:1/373: dwrite d9/d10/d2a/d4b/f2f [0,4194304] 0 2024-09-13T21:40:22.562 INFO:tasks.workunit.client.0.smithi088.stdout:1/374: chown d9/d10/d2a/d4b/d39/f6c 55 1 2024-09-13T21:40:22.562 INFO:tasks.workunit.client.0.smithi088.stdout:1/375: chown d9/d10/d41/d7d/f80 56253 1 2024-09-13T21:40:22.562 INFO:tasks.workunit.client.0.smithi088.stdout:1/376: chown d9/d10/d2a/d4b/d39 1173770980 1 2024-09-13T21:40:22.562 INFO:tasks.workunit.client.0.smithi088.stdout:1/377: rename d9/d10/d2a/d4b/d33 to d9/d10/d2a/d4b/d33/d89 22 2024-09-13T21:40:22.562 INFO:tasks.workunit.client.0.smithi088.stdout:7/318: mknod d6/c6b 0 2024-09-13T21:40:22.563 INFO:tasks.workunit.client.0.smithi088.stdout:3/383: link d5/d5a/f6f d5/d23/d2a/d55/f7b 0 2024-09-13T21:40:22.566 INFO:tasks.workunit.client.0.smithi088.stdout:2/390: dread d1/d8/d16/f7c [0,4194304] 0 2024-09-13T21:40:22.566 INFO:tasks.workunit.client.0.smithi088.stdout:2/391: write d1/d8/d2e/d3b/f6f [1012842,11113] 0 2024-09-13T21:40:22.566 INFO:tasks.workunit.client.0.smithi088.stdout:5/419: mkdir d4/d1c/d4a/d63/d8c 0 2024-09-13T21:40:22.566 INFO:tasks.workunit.client.0.smithi088.stdout:5/420: write d4/d1c/d4a/f5d [919665,110907] 0 2024-09-13T21:40:22.572 INFO:tasks.workunit.client.0.smithi088.stdout:1/378: truncate d9/dc/f1f 1725849 0 2024-09-13T21:40:22.572 INFO:tasks.workunit.client.0.smithi088.stdout:1/379: creat d9/d10/d2a/f8a x:0 0 0 2024-09-13T21:40:22.572 INFO:tasks.workunit.client.0.smithi088.stdout:8/347: read db/df/d25/f2d [3234930,122924] 0 2024-09-13T21:40:22.574 INFO:tasks.workunit.client.0.smithi088.stdout:3/384: write d5/d14/f29 [135157,105070] 0 2024-09-13T21:40:22.574 INFO:tasks.workunit.client.0.smithi088.stdout:6/407: dwrite d0/f6 [0,4194304] 0 2024-09-13T21:40:22.575 INFO:tasks.workunit.client.0.smithi088.stdout:6/408: chown d0/d2c/d32/d39/l42 486909 1 2024-09-13T21:40:22.576 INFO:tasks.workunit.client.0.smithi088.stdout:1/380: symlink d9/d10/d2a/l8b 0 2024-09-13T21:40:22.578 INFO:tasks.workunit.client.0.smithi088.stdout:8/348: symlink db/d26/d2c/l79 0 2024-09-13T21:40:22.578 INFO:tasks.workunit.client.0.smithi088.stdout:8/349: fdatasync db/d26/f36 0 2024-09-13T21:40:22.578 INFO:tasks.workunit.client.0.smithi088.stdout:8/350: stat db/d26/l3e 0 2024-09-13T21:40:22.578 INFO:tasks.workunit.client.0.smithi088.stdout:5/421: dread d4/f13 [0,4194304] 0 2024-09-13T21:40:22.580 INFO:tasks.workunit.client.0.smithi088.stdout:7/319: rename d6/da/d1a/d3a/d5c/c62 to d6/c6c 0 2024-09-13T21:40:22.580 INFO:tasks.workunit.client.0.smithi088.stdout:7/320: chown d6/d5f/d69/d45 0 1 2024-09-13T21:40:22.580 INFO:tasks.workunit.client.0.smithi088.stdout:7/321: dread - d6/d5f/d69/f5d zero size 2024-09-13T21:40:22.580 INFO:tasks.workunit.client.0.smithi088.stdout:7/322: readlink d6/da/ld 0 2024-09-13T21:40:22.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/422: dread d4/d1c/d24/d26/d4b/d66/f77 [0,4194304] 0 2024-09-13T21:40:22.584 INFO:tasks.workunit.client.0.smithi088.stdout:1/381: stat d9/d10/d41/l83 0 2024-09-13T21:40:22.585 INFO:tasks.workunit.client.0.smithi088.stdout:8/351: getdents db/df/d61 0 2024-09-13T21:40:22.587 INFO:tasks.workunit.client.0.smithi088.stdout:4/357: dwrite d2/d5/d20/d60/f2a [0,4194304] 0 2024-09-13T21:40:22.589 INFO:tasks.workunit.client.0.smithi088.stdout:3/385: rename d5/d23/d2a/d63/f5c to d5/d23/d2a/d63/d31/f7c 0 2024-09-13T21:40:22.589 INFO:tasks.workunit.client.0.smithi088.stdout:3/386: read - d5/d23/d2a/d63/f44 zero size 2024-09-13T21:40:22.590 INFO:tasks.workunit.client.0.smithi088.stdout:6/409: write d0/db/f2e [575113,74014] 0 2024-09-13T21:40:22.591 INFO:tasks.workunit.client.0.smithi088.stdout:8/352: symlink db/df/l7a 0 2024-09-13T21:40:22.591 INFO:tasks.workunit.client.0.smithi088.stdout:6/410: write d0/d1e/f24 [463152,122960] 0 2024-09-13T21:40:22.593 INFO:tasks.workunit.client.0.smithi088.stdout:4/358: rename d2/d13/d50/f59 to d2/d5/d20/d41/d4b/f7a 0 2024-09-13T21:40:22.593 INFO:tasks.workunit.client.0.smithi088.stdout:4/359: chown d2/f48 9660 1 2024-09-13T21:40:22.594 INFO:tasks.workunit.client.0.smithi088.stdout:3/387: rmdir d5/d23/d2a/d63/d48/d49 39 2024-09-13T21:40:22.597 INFO:tasks.workunit.client.0.smithi088.stdout:2/392: dwrite d1/d8/d2e/d44/f54 [0,4194304] 0 2024-09-13T21:40:22.597 INFO:tasks.workunit.client.0.smithi088.stdout:2/393: write d1/d8/d2e/d3b/f8b [1732,78094] 0 2024-09-13T21:40:22.597 INFO:tasks.workunit.client.0.smithi088.stdout:3/388: dread d5/f38 [0,4194304] 0 2024-09-13T21:40:22.597 INFO:tasks.workunit.client.0.smithi088.stdout:3/389: dread - d5/d23/d2a/d63/f46 zero size 2024-09-13T21:40:22.598 INFO:tasks.workunit.client.0.smithi088.stdout:8/353: creat db/df/d61/f7b x:0 0 0 2024-09-13T21:40:22.600 INFO:tasks.workunit.client.0.smithi088.stdout:1/382: dread d9/d10/d2a/d4b/f2f [0,4194304] 0 2024-09-13T21:40:22.600 INFO:tasks.workunit.client.0.smithi088.stdout:1/383: chown d9/d10/d2a/d4b/d39/l63 4 1 2024-09-13T21:40:22.600 INFO:tasks.workunit.client.0.smithi088.stdout:1/384: readlink d9/d10/d2a/l3e 0 2024-09-13T21:40:22.601 INFO:tasks.workunit.client.0.smithi088.stdout:1/385: truncate d9/d10/d41/d7d/f80 967104 0 2024-09-13T21:40:22.601 INFO:tasks.workunit.client.0.smithi088.stdout:5/423: dread d4/d1c/f53 [0,4194304] 0 2024-09-13T21:40:22.601 INFO:tasks.workunit.client.0.smithi088.stdout:2/394: mknod d1/d8/d24/d78/d7f/c8e 0 2024-09-13T21:40:22.602 INFO:tasks.workunit.client.0.smithi088.stdout:7/323: dwrite d6/f18 [0,4194304] 0 2024-09-13T21:40:22.602 INFO:tasks.workunit.client.0.smithi088.stdout:7/324: creat d6/da/d44/f6d x:0 0 0 2024-09-13T21:40:22.603 INFO:tasks.workunit.client.0.smithi088.stdout:5/424: dread d4/d1c/f5c [0,4194304] 0 2024-09-13T21:40:22.605 INFO:tasks.workunit.client.0.smithi088.stdout:3/390: rename d5/d23/d2a/d63/f3b to d5/d23/d2a/d3f/f7d 0 2024-09-13T21:40:22.606 INFO:tasks.workunit.client.0.smithi088.stdout:3/391: fsync d5/d23/d2a/d63/f46 0 2024-09-13T21:40:22.609 INFO:tasks.workunit.client.0.smithi088.stdout:8/354: link db/df/d25/f2d db/d33/d51/f7c 0 2024-09-13T21:40:22.612 INFO:tasks.workunit.client.0.smithi088.stdout:1/386: chown d9/dc/l34 439704 1 2024-09-13T21:40:22.612 INFO:tasks.workunit.client.0.smithi088.stdout:1/387: write d9/dc/f35 [4302007,32286] 0 2024-09-13T21:40:22.614 INFO:tasks.workunit.client.0.smithi088.stdout:3/392: rmdir d5/d23/d2a/d63/d48/d71 0 2024-09-13T21:40:22.619 INFO:tasks.workunit.client.0.smithi088.stdout:8/355: rename db/df/d61/d77 to db/d26/d37/d7d 0 2024-09-13T21:40:22.620 INFO:tasks.workunit.client.0.smithi088.stdout:3/393: creat d5/d23/d2a/d63/d31/f7e x:0 0 0 2024-09-13T21:40:22.621 INFO:tasks.workunit.client.0.smithi088.stdout:3/394: read d5/d23/f3c [860467,44476] 0 2024-09-13T21:40:22.622 INFO:tasks.workunit.client.0.smithi088.stdout:7/325: write d6/da/d1a/d3a/d5c/d60/f66 [409170,97889] 0 2024-09-13T21:40:22.622 INFO:tasks.workunit.client.0.smithi088.stdout:7/326: chown d6/da/d1a/c4b 40231662 1 2024-09-13T21:40:22.622 INFO:tasks.workunit.client.0.smithi088.stdout:8/356: rename fa to db/d26/d4f/f7e 0 2024-09-13T21:40:22.622 INFO:tasks.workunit.client.0.smithi088.stdout:8/357: readlink db/l1c 0 2024-09-13T21:40:22.626 INFO:tasks.workunit.client.0.smithi088.stdout:3/395: dread d5/d23/d2a/d63/d48/d49/f53 [0,4194304] 0 2024-09-13T21:40:22.632 INFO:tasks.workunit.client.0.smithi088.stdout:3/396: write d5/f22 [3768472,96039] 0 2024-09-13T21:40:22.635 INFO:tasks.workunit.client.0.smithi088.stdout:3/397: rmdir d5/d23/d2a/d55/d79 0 2024-09-13T21:40:22.635 INFO:tasks.workunit.client.0.smithi088.stdout:8/358: write db/df/f3d [7869609,13534] 0 2024-09-13T21:40:22.636 INFO:tasks.workunit.client.0.smithi088.stdout:8/359: creat db/f7f x:0 0 0 2024-09-13T21:40:22.638 INFO:tasks.workunit.client.0.smithi088.stdout:8/360: rename db/f23 to db/df/f80 0 2024-09-13T21:40:22.638 INFO:tasks.workunit.client.0.smithi088.stdout:8/361: creat db/df/d61/f81 x:0 0 0 2024-09-13T21:40:22.638 INFO:tasks.workunit.client.0.smithi088.stdout:8/362: dread - db/d26/d2c/f78 zero size 2024-09-13T21:40:22.638 INFO:tasks.workunit.client.0.smithi088.stdout:8/363: read - db/df/d61/f6a zero size 2024-09-13T21:40:22.638 INFO:tasks.workunit.client.0.smithi088.stdout:8/364: write db/df/d61/f7b [869835,34072] 0 2024-09-13T21:40:22.638 INFO:tasks.workunit.client.0.smithi088.stdout:8/365: creat db/f82 x:0 0 0 2024-09-13T21:40:22.641 INFO:tasks.workunit.client.0.smithi088.stdout:5/425: dwrite d4/d1c/d24/f41 [0,4194304] 0 2024-09-13T21:40:22.642 INFO:tasks.workunit.client.0.smithi088.stdout:6/411: dwrite d0/d1e/d1f/d55/f6f [0,4194304] 0 2024-09-13T21:40:22.642 INFO:tasks.workunit.client.0.smithi088.stdout:6/412: chown d0/ff 3954650 1 2024-09-13T21:40:22.643 INFO:tasks.workunit.client.0.smithi088.stdout:1/388: dwrite d9/d10/d2a/d4b/f21 [0,4194304] 0 2024-09-13T21:40:22.644 INFO:tasks.workunit.client.0.smithi088.stdout:4/360: dwrite f1 [0,4194304] 0 2024-09-13T21:40:22.644 INFO:tasks.workunit.client.0.smithi088.stdout:4/361: write d2/d5/d20/f73 [410290,35930] 0 2024-09-13T21:40:22.645 INFO:tasks.workunit.client.0.smithi088.stdout:7/327: dwrite d6/da/d44/f6d [0,4194304] 0 2024-09-13T21:40:22.650 INFO:tasks.workunit.client.0.smithi088.stdout:3/398: write f1 [3052351,70356] 0 2024-09-13T21:40:22.656 INFO:tasks.workunit.client.0.smithi088.stdout:4/362: symlink d2/d5/d20/d60/l7b 0 2024-09-13T21:40:22.658 INFO:tasks.workunit.client.0.smithi088.stdout:8/366: read db/d26/f2b [2189200,39875] 0 2024-09-13T21:40:22.658 INFO:tasks.workunit.client.0.smithi088.stdout:8/367: fdatasync db/df/f80 0 2024-09-13T21:40:22.663 INFO:tasks.workunit.client.0.smithi088.stdout:1/389: dread d9/dc/f35 [0,4194304] 0 2024-09-13T21:40:22.664 INFO:tasks.workunit.client.0.smithi088.stdout:7/328: rename d6/d5f/d69/d4f/f61 to d6/d5f/d69/f6e 0 2024-09-13T21:40:22.665 INFO:tasks.workunit.client.0.smithi088.stdout:4/363: mknod d2/d5/d2d/d70/c7c 0 2024-09-13T21:40:22.668 INFO:tasks.workunit.client.0.smithi088.stdout:8/368: creat db/d33/f83 x:0 0 0 2024-09-13T21:40:22.669 INFO:tasks.workunit.client.0.smithi088.stdout:7/329: dread d6/da/f38 [4194304,4194304] 0 2024-09-13T21:40:22.669 INFO:tasks.workunit.client.0.smithi088.stdout:7/330: dread - d6/da/d44/f65 zero size 2024-09-13T21:40:22.670 INFO:tasks.workunit.client.0.smithi088.stdout:4/364: creat d2/d5/d20/d60/de/d1e/d31/f7d x:0 0 0 2024-09-13T21:40:22.671 INFO:tasks.workunit.client.0.smithi088.stdout:1/390: dread d9/d10/d2a/d4b/f28 [0,4194304] 0 2024-09-13T21:40:22.671 INFO:tasks.workunit.client.0.smithi088.stdout:8/369: mknod db/d26/d37/d7d/c84 0 2024-09-13T21:40:22.672 INFO:tasks.workunit.client.0.smithi088.stdout:7/331: mkdir d6/d5f/d69/d4f/d6f 0 2024-09-13T21:40:22.673 INFO:tasks.workunit.client.0.smithi088.stdout:4/365: dread d2/d5/d2d/f40 [0,4194304] 0 2024-09-13T21:40:22.674 INFO:tasks.workunit.client.0.smithi088.stdout:1/391: symlink d9/d10/d2a/d4b/d39/l8c 0 2024-09-13T21:40:22.674 INFO:tasks.workunit.client.0.smithi088.stdout:3/399: dwrite d5/d14/f18 [0,4194304] 0 2024-09-13T21:40:22.674 INFO:tasks.workunit.client.0.smithi088.stdout:3/400: fsync d5/d23/d2a/f40 0 2024-09-13T21:40:22.674 INFO:tasks.workunit.client.0.smithi088.stdout:6/413: dwrite d0/d1e/f49 [0,4194304] 0 2024-09-13T21:40:22.674 INFO:tasks.workunit.client.0.smithi088.stdout:5/426: dwrite d4/d1c/d24/d26/d40/f11 [0,4194304] 0 2024-09-13T21:40:22.833 INFO:tasks.workunit.client.0.smithi088.stdout:7/332: mkdir d6/d5f/d69/d4f/d6f/d70 0 2024-09-13T21:40:22.834 INFO:tasks.workunit.client.0.smithi088.stdout:4/366: creat d2/d5/d20/d60/de/d1e/d23/d69/f7e x:0 0 0 2024-09-13T21:40:22.838 INFO:tasks.workunit.client.0.smithi088.stdout:1/392: dwrite d9/f19 [0,4194304] 0 2024-09-13T21:40:22.838 INFO:tasks.workunit.client.0.smithi088.stdout:1/393: fsync d9/d10/f3f 0 2024-09-13T21:40:22.839 INFO:tasks.workunit.client.0.smithi088.stdout:1/394: fsync d9/dc/f1f 0 2024-09-13T21:40:22.839 INFO:tasks.workunit.client.0.smithi088.stdout:1/395: chown d9/d10/d2a/l8b 6676 1 2024-09-13T21:40:22.839 INFO:tasks.workunit.client.0.smithi088.stdout:1/396: chown d9/l3b 33159128 1 2024-09-13T21:40:22.842 INFO:tasks.workunit.client.0.smithi088.stdout:1/397: dread d9/f60 [0,4194304] 0 2024-09-13T21:40:22.846 INFO:tasks.workunit.client.0.smithi088.stdout:6/414: rmdir d0/d2c/d7a 39 2024-09-13T21:40:22.857 INFO:tasks.workunit.client.0.smithi088.stdout:7/333: mknod d6/da/d1a/d3a/d5c/c71 0 2024-09-13T21:40:22.857 INFO:tasks.workunit.client.0.smithi088.stdout:7/334: write f1 [1306602,70502] 0 2024-09-13T21:40:22.857 INFO:tasks.workunit.client.0.smithi088.stdout:7/335: chown d6/da/l34 0 1 2024-09-13T21:40:22.860 INFO:tasks.workunit.client.0.smithi088.stdout:1/398: mkdir d9/d10/d2a/d4b/d33/d8d 0 2024-09-13T21:40:22.862 INFO:tasks.workunit.client.0.smithi088.stdout:6/415: mkdir d0/d2c/d7f 0 2024-09-13T21:40:22.862 INFO:tasks.workunit.client.0.smithi088.stdout:6/416: dread - d0/d28/f78 zero size 2024-09-13T21:40:22.862 INFO:tasks.workunit.client.0.smithi088.stdout:6/417: creat d0/d28/f80 x:0 0 0 2024-09-13T21:40:22.867 INFO:tasks.workunit.client.0.smithi088.stdout:5/427: rmdir d4/d1c/d24/d26 39 2024-09-13T21:40:22.869 INFO:tasks.workunit.client.0.smithi088.stdout:0/395: sync 2024-09-13T21:40:22.869 INFO:tasks.workunit.client.0.smithi088.stdout:0/396: write d7/d2c/d30/d31/d42/f74 [558043,38476] 0 2024-09-13T21:40:22.870 INFO:tasks.workunit.client.0.smithi088.stdout:7/336: truncate d6/da/f38 1132767 0 2024-09-13T21:40:22.872 INFO:tasks.workunit.client.0.smithi088.stdout:1/399: write f1 [1083177,27337] 0 2024-09-13T21:40:22.873 INFO:tasks.workunit.client.0.smithi088.stdout:4/367: truncate d2/d5/ff 1252683 0 2024-09-13T21:40:22.873 INFO:tasks.workunit.client.0.smithi088.stdout:4/368: readlink d2/d5/d20/d60/l7b 0 2024-09-13T21:40:22.878 INFO:tasks.workunit.client.0.smithi088.stdout:6/418: mkdir d0/d2c/d32/d39/d3f/d71/d81 0 2024-09-13T21:40:22.881 INFO:tasks.workunit.client.0.smithi088.stdout:7/337: link d6/da/d1a/f33 d6/d5f/f72 0 2024-09-13T21:40:22.883 INFO:tasks.workunit.client.0.smithi088.stdout:8/370: rename db/d33 to db/d26/d2c/d85 0 2024-09-13T21:40:22.884 INFO:tasks.workunit.client.0.smithi088.stdout:1/400: mkdir d9/d10/d2a/d4b/d33/d8d/d8e 0 2024-09-13T21:40:22.885 INFO:tasks.workunit.client.0.smithi088.stdout:4/369: getdents d2/d5/d20/d60/de/d1e/d23/d6c 0 2024-09-13T21:40:22.889 INFO:tasks.workunit.client.0.smithi088.stdout:5/428: rmdir d4/d1c/d4a 39 2024-09-13T21:40:22.891 INFO:tasks.workunit.client.0.smithi088.stdout:4/370: mkdir d2/d5/d20/d7f 0 2024-09-13T21:40:22.891 INFO:tasks.workunit.client.0.smithi088.stdout:4/371: chown d2/d5/d20/f73 2458001 1 2024-09-13T21:40:22.892 INFO:tasks.workunit.client.0.smithi088.stdout:0/397: dwrite d7/d2c/d30/d31/f32 [0,4194304] 0 2024-09-13T21:40:22.892 INFO:tasks.workunit.client.0.smithi088.stdout:0/398: write d7/d1d/d26/d34/f4f [609986,50299] 0 2024-09-13T21:40:22.893 INFO:tasks.workunit.client.0.smithi088.stdout:7/338: mknod d6/c73 0 2024-09-13T21:40:22.893 INFO:tasks.workunit.client.0.smithi088.stdout:7/339: read - d6/d4e/f5b zero size 2024-09-13T21:40:22.895 INFO:tasks.workunit.client.0.smithi088.stdout:4/372: rmdir d2/d11 39 2024-09-13T21:40:22.895 INFO:tasks.workunit.client.0.smithi088.stdout:4/373: fdatasync d2/d5/d20/d60/de/f58 0 2024-09-13T21:40:22.898 INFO:tasks.workunit.client.0.smithi088.stdout:0/399: creat d7/d2c/d30/d31/d42/d95/f9a x:0 0 0 2024-09-13T21:40:22.900 INFO:tasks.workunit.client.0.smithi088.stdout:4/374: symlink d2/d13/d50/l80 0 2024-09-13T21:40:22.902 INFO:tasks.workunit.client.0.smithi088.stdout:0/400: rename d7/d1d/d66/d8b/l93 to d7/d1d/d21/d82/l9b 0 2024-09-13T21:40:22.902 INFO:tasks.workunit.client.0.smithi088.stdout:4/375: mkdir d2/d81 0 2024-09-13T21:40:22.903 INFO:tasks.workunit.client.0.smithi088.stdout:0/401: read d7/d1d/d3d/f57 [620358,1482] 0 2024-09-13T21:40:22.905 INFO:tasks.workunit.client.0.smithi088.stdout:0/402: link d7/d1d/f69 d7/d2c/d30/d31/d42/f9c 0 2024-09-13T21:40:22.907 INFO:tasks.workunit.client.0.smithi088.stdout:0/403: unlink d7/l16 0 2024-09-13T21:40:22.907 INFO:tasks.workunit.client.0.smithi088.stdout:0/404: chown d7/d2c/d37/f83 354756221 1 2024-09-13T21:40:22.908 INFO:tasks.workunit.client.0.smithi088.stdout:0/405: truncate d7/d65/f76 3252927 0 2024-09-13T21:40:22.911 INFO:tasks.workunit.client.0.smithi088.stdout:0/406: write d7/f2b [89636,79356] 0 2024-09-13T21:40:22.914 INFO:tasks.workunit.client.0.smithi088.stdout:4/376: dread d2/d5/d20/d60/de/d1e/d23/f3d [0,4194304] 0 2024-09-13T21:40:22.915 INFO:tasks.workunit.client.0.smithi088.stdout:4/377: creat d2/d81/f82 x:0 0 0 2024-09-13T21:40:22.919 INFO:tasks.workunit.client.0.smithi088.stdout:6/419: dwrite d0/d28/f35 [0,4194304] 0 2024-09-13T21:40:22.921 INFO:tasks.workunit.client.0.smithi088.stdout:9/333: sync 2024-09-13T21:40:22.921 INFO:tasks.workunit.client.0.smithi088.stdout:2/395: sync 2024-09-13T21:40:22.921 INFO:tasks.workunit.client.0.smithi088.stdout:3/401: sync 2024-09-13T21:40:22.921 INFO:tasks.workunit.client.0.smithi088.stdout:8/371: dwrite db/d26/d2c/d85/f52 [0,4194304] 0 2024-09-13T21:40:22.922 INFO:tasks.workunit.client.0.smithi088.stdout:5/429: dwrite d4/d1c/d24/d26/d40/f5a [0,4194304] 0 2024-09-13T21:40:22.922 INFO:tasks.workunit.client.0.smithi088.stdout:7/340: dwrite d6/f53 [0,4194304] 0 2024-09-13T21:40:22.922 INFO:tasks.workunit.client.0.smithi088.stdout:7/341: readlink d6/d5f/d69/d4f/l4d 0 2024-09-13T21:40:22.925 INFO:tasks.workunit.client.0.smithi088.stdout:3/402: mkdir d5/d5a/d7f 0 2024-09-13T21:40:22.925 INFO:tasks.workunit.client.0.smithi088.stdout:3/403: chown d5/f6 3203 1 2024-09-13T21:40:22.925 INFO:tasks.workunit.client.0.smithi088.stdout:3/404: stat d5/d23/d2a/d63/d31/l36 0 2024-09-13T21:40:22.926 INFO:tasks.workunit.client.0.smithi088.stdout:0/407: read d7/d2c/f2e [4071472,11612] 0 2024-09-13T21:40:22.936 INFO:tasks.workunit.client.0.smithi088.stdout:9/334: dread f9 [0,4194304] 0 2024-09-13T21:40:22.936 INFO:tasks.workunit.client.0.smithi088.stdout:9/335: write d1a/d1b/f35 [1066528,78109] 0 2024-09-13T21:40:22.940 INFO:tasks.workunit.client.0.smithi088.stdout:5/430: creat d4/d1c/d4a/d63/d6a/f8d x:0 0 0 2024-09-13T21:40:22.940 INFO:tasks.workunit.client.0.smithi088.stdout:5/431: creat d4/d1c/d24/f8e x:0 0 0 2024-09-13T21:40:22.942 INFO:tasks.workunit.client.0.smithi088.stdout:3/405: symlink d5/d23/d2a/d63/d31/l80 0 2024-09-13T21:40:22.942 INFO:tasks.workunit.client.0.smithi088.stdout:3/406: write d5/d23/d2a/d3f/f64 [78058,18907] 0 2024-09-13T21:40:22.943 INFO:tasks.workunit.client.0.smithi088.stdout:0/408: symlink d7/d2c/d37/l9d 0 2024-09-13T21:40:22.946 INFO:tasks.workunit.client.0.smithi088.stdout:7/342: getdents d6 0 2024-09-13T21:40:22.947 INFO:tasks.workunit.client.0.smithi088.stdout:7/343: symlink d6/d5f/d69/l74 0 2024-09-13T21:40:22.947 INFO:tasks.workunit.client.0.smithi088.stdout:7/344: chown d6/d5f/d69/d4f/d4c 140 1 2024-09-13T21:40:22.948 INFO:tasks.workunit.client.0.smithi088.stdout:9/336: dread d1a/d61/d3d/d41/f46 [0,4194304] 0 2024-09-13T21:40:22.948 INFO:tasks.workunit.client.0.smithi088.stdout:6/420: dwrite d0/d28/f80 [0,4194304] 0 2024-09-13T21:40:22.948 INFO:tasks.workunit.client.0.smithi088.stdout:9/337: creat d1a/d1b/d3f/f64 x:0 0 0 2024-09-13T21:40:22.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/396: dwrite d1/d13/d3f/f43 [0,4194304] 0 2024-09-13T21:40:22.951 INFO:tasks.workunit.client.0.smithi088.stdout:3/407: dread d5/f42 [0,4194304] 0 2024-09-13T21:40:22.951 INFO:tasks.workunit.client.0.smithi088.stdout:3/408: write d5/f21 [2909805,66312] 0 2024-09-13T21:40:22.953 INFO:tasks.workunit.client.0.smithi088.stdout:5/432: write d4/d1c/d4a/d63/d6a/f6b [822318,14333] 0 2024-09-13T21:40:22.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/433: readlink d4/d1c/d24/l29 0 2024-09-13T21:40:22.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/434: write d4/d1c/d24/d26/d4b/d66/f71 [634568,1690] 0 2024-09-13T21:40:22.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/435: fdatasync d4/d1c/f5c 0 2024-09-13T21:40:22.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/436: rename d4/d1c/d24 to d4/d1c/d24/d26/d40/d8f 22 2024-09-13T21:40:22.957 INFO:tasks.workunit.client.0.smithi088.stdout:9/338: rename d1a/d1b/c1f to d1a/d1b/c65 0 2024-09-13T21:40:22.958 INFO:tasks.workunit.client.0.smithi088.stdout:2/397: mknod d1/d13/d3f/c8f 0 2024-09-13T21:40:22.963 INFO:tasks.workunit.client.0.smithi088.stdout:3/409: mkdir d5/d23/d2a/d3f/d76/d81 0 2024-09-13T21:40:22.963 INFO:tasks.workunit.client.0.smithi088.stdout:3/410: fdatasync d5/d23/d2a/d6b/f5d 0 2024-09-13T21:40:22.963 INFO:tasks.workunit.client.0.smithi088.stdout:3/411: creat d5/d14/f82 x:0 0 0 2024-09-13T21:40:22.963 INFO:tasks.workunit.client.0.smithi088.stdout:3/412: write d5/f42 [2570108,3986] 0 2024-09-13T21:40:22.970 INFO:tasks.workunit.client.0.smithi088.stdout:2/398: mkdir d1/d8/d2e/d44/d90 0 2024-09-13T21:40:22.970 INFO:tasks.workunit.client.0.smithi088.stdout:2/399: getdents d1/d13/d2a/d3c/d4a/d6e/d76 0 2024-09-13T21:40:22.970 INFO:tasks.workunit.client.0.smithi088.stdout:3/413: creat d5/d26/d43/f83 x:0 0 0 2024-09-13T21:40:22.973 INFO:tasks.workunit.client.0.smithi088.stdout:3/414: unlink d5/d23/d2a/d63/d31/l80 0 2024-09-13T21:40:22.973 INFO:tasks.workunit.client.0.smithi088.stdout:3/415: chown d5/d23/d2a/d63/c66 7 1 2024-09-13T21:40:22.974 INFO:tasks.workunit.client.0.smithi088.stdout:3/416: truncate d5/f38 2194079 0 2024-09-13T21:40:22.975 INFO:tasks.workunit.client.0.smithi088.stdout:5/437: dread d4/d1c/f48 [0,4194304] 0 2024-09-13T21:40:22.976 INFO:tasks.workunit.client.0.smithi088.stdout:0/409: dwrite d7/d2c/d30/d31/f62 [0,4194304] 0 2024-09-13T21:40:22.976 INFO:tasks.workunit.client.0.smithi088.stdout:4/378: truncate d2/d5/d20/d60/de/d1e/f26 1131678 0 2024-09-13T21:40:22.977 INFO:tasks.workunit.client.0.smithi088.stdout:3/417: dread d5/d23/d2a/d63/d48/d49/f62 [0,4194304] 0 2024-09-13T21:40:22.977 INFO:tasks.workunit.client.0.smithi088.stdout:3/418: creat d5/d26/d43/f84 x:0 0 0 2024-09-13T21:40:22.977 INFO:tasks.workunit.client.0.smithi088.stdout:5/438: dread d4/d1c/f5c [0,4194304] 0 2024-09-13T21:40:22.978 INFO:tasks.workunit.client.0.smithi088.stdout:4/379: mknod d2/d5/d20/c83 0 2024-09-13T21:40:22.981 INFO:tasks.workunit.client.0.smithi088.stdout:3/419: symlink d5/d23/d2a/d63/d48/l85 0 2024-09-13T21:40:22.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/380: creat d2/d13/d50/f84 x:0 0 0 2024-09-13T21:40:22.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/381: readlink d2/d11/l38 0 2024-09-13T21:40:22.982 INFO:tasks.workunit.client.0.smithi088.stdout:2/400: dread d1/d13/f2c [0,4194304] 0 2024-09-13T21:40:22.982 INFO:tasks.workunit.client.0.smithi088.stdout:2/401: chown d1/d8/d16/f23 36334 1 2024-09-13T21:40:22.982 INFO:tasks.workunit.client.0.smithi088.stdout:2/402: fdatasync d1/d13/d2a/d3c/d4a/f7a 0 2024-09-13T21:40:22.983 INFO:tasks.workunit.client.0.smithi088.stdout:3/420: creat d5/d23/d2a/d6b/f86 x:0 0 0 2024-09-13T21:40:22.985 INFO:tasks.workunit.client.0.smithi088.stdout:4/382: getdents d2/d81 0 2024-09-13T21:40:22.986 INFO:tasks.workunit.client.0.smithi088.stdout:2/403: mkdir d1/d8/d2e/d91 0 2024-09-13T21:40:22.987 INFO:tasks.workunit.client.0.smithi088.stdout:6/421: dwrite d0/db/f43 [0,4194304] 0 2024-09-13T21:40:22.990 INFO:tasks.workunit.client.0.smithi088.stdout:2/404: creat d1/d8/d2e/d44/f92 x:0 0 0 2024-09-13T21:40:22.990 INFO:tasks.workunit.client.0.smithi088.stdout:9/339: dwrite d1a/d1b/f37 [0,4194304] 0 2024-09-13T21:40:22.990 INFO:tasks.workunit.client.0.smithi088.stdout:7/345: dwrite d6/f53 [0,4194304] 0 2024-09-13T21:40:22.990 INFO:tasks.workunit.client.0.smithi088.stdout:9/340: creat d1a/d1b/f66 x:0 0 0 2024-09-13T21:40:22.990 INFO:tasks.workunit.client.0.smithi088.stdout:7/346: creat d6/da/d44/f75 x:0 0 0 2024-09-13T21:40:22.993 INFO:tasks.workunit.client.0.smithi088.stdout:4/383: rmdir d2/d5/d20/d60/de/d1e/d23 39 2024-09-13T21:40:22.997 INFO:tasks.workunit.client.0.smithi088.stdout:7/347: mkdir d6/d5f/d69/d4f/d6f/d70/d76 0 2024-09-13T21:40:22.998 INFO:tasks.workunit.client.0.smithi088.stdout:4/384: mknod d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79/c85 0 2024-09-13T21:40:23.001 INFO:tasks.workunit.client.0.smithi088.stdout:6/422: dread d0/f52 [0,4194304] 0 2024-09-13T21:40:23.002 INFO:tasks.workunit.client.0.smithi088.stdout:5/439: dwrite d4/d1c/d24/d26/d4b/d67/f7f [0,4194304] 0 2024-09-13T21:40:23.009 INFO:tasks.workunit.client.0.smithi088.stdout:6/423: creat d0/db/f82 x:0 0 0 2024-09-13T21:40:23.009 INFO:tasks.workunit.client.0.smithi088.stdout:2/405: write d1/d8/d16/f23 [953363,71801] 0 2024-09-13T21:40:23.009 INFO:tasks.workunit.client.0.smithi088.stdout:6/424: dread - d0/d1e/f4c zero size 2024-09-13T21:40:23.010 INFO:tasks.workunit.client.0.smithi088.stdout:3/421: dwrite f0 [0,4194304] 0 2024-09-13T21:40:23.010 INFO:tasks.workunit.client.0.smithi088.stdout:3/422: fsync d5/d23/d2a/d6b/f5d 0 2024-09-13T21:40:23.010 INFO:tasks.workunit.client.0.smithi088.stdout:3/423: write d5/d23/d2a/d6b/f86 [996192,86640] 0 2024-09-13T21:40:23.016 INFO:tasks.workunit.client.0.smithi088.stdout:2/406: rmdir d1/d13/d2a/d41 39 2024-09-13T21:40:23.016 INFO:tasks.workunit.client.0.smithi088.stdout:2/407: dread - d1/d8/d2e/d44/f92 zero size 2024-09-13T21:40:23.016 INFO:tasks.workunit.client.0.smithi088.stdout:2/408: chown d1/d13/d2a/d3c/d4a/f7a 13669737 1 2024-09-13T21:40:23.017 INFO:tasks.workunit.client.0.smithi088.stdout:9/341: dwrite d1a/d1b/f66 [0,4194304] 0 2024-09-13T21:40:23.017 INFO:tasks.workunit.client.0.smithi088.stdout:6/425: truncate d0/d1e/f24 655895 0 2024-09-13T21:40:23.020 INFO:tasks.workunit.client.0.smithi088.stdout:3/424: creat d5/d23/d2a/d63/f87 x:0 0 0 2024-09-13T21:40:23.022 INFO:tasks.workunit.client.0.smithi088.stdout:2/409: unlink d1/c79 0 2024-09-13T21:40:23.022 INFO:tasks.workunit.client.0.smithi088.stdout:2/410: stat d1/d13/d2a/d3c/d4a/d6e 0 2024-09-13T21:40:23.022 INFO:tasks.workunit.client.0.smithi088.stdout:2/411: fsync d1/d13/f1a 0 2024-09-13T21:40:23.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/342: unlink d1a/d61/d3d/d41/c4b 0 2024-09-13T21:40:23.026 INFO:tasks.workunit.client.0.smithi088.stdout:2/412: symlink d1/d8/d24/d78/l93 0 2024-09-13T21:40:23.026 INFO:tasks.workunit.client.0.smithi088.stdout:9/343: creat d1a/f67 x:0 0 0 2024-09-13T21:40:23.029 INFO:tasks.workunit.client.0.smithi088.stdout:2/413: symlink d1/d8/d2e/l94 0 2024-09-13T21:40:23.029 INFO:tasks.workunit.client.0.smithi088.stdout:2/414: truncate d1/d8/d24/f39 1167053 0 2024-09-13T21:40:23.029 INFO:tasks.workunit.client.0.smithi088.stdout:2/415: chown d1/d8/d16/l1e 29810129 1 2024-09-13T21:40:23.029 INFO:tasks.workunit.client.0.smithi088.stdout:2/416: chown d1/d13/d2a/d3c/d4a/d6e/d66/f88 2517 1 2024-09-13T21:40:23.030 INFO:tasks.workunit.client.0.smithi088.stdout:9/344: getdents d1a/d3c 0 2024-09-13T21:40:23.031 INFO:tasks.workunit.client.0.smithi088.stdout:9/345: chown d1a/d1b/l1d 59416 1 2024-09-13T21:40:23.031 INFO:tasks.workunit.client.0.smithi088.stdout:5/440: dwrite d4/d1c/d24/d26/d40/fa [0,4194304] 0 2024-09-13T21:40:23.032 INFO:tasks.workunit.client.0.smithi088.stdout:2/417: rename d1/d13/f17 to d1/d8/d2e/d91/f95 0 2024-09-13T21:40:23.036 INFO:tasks.workunit.client.0.smithi088.stdout:5/441: mkdir d4/d1c/d24/d26/d40/d90 0 2024-09-13T21:40:23.038 INFO:tasks.workunit.client.0.smithi088.stdout:5/442: getdents d4/d1b/d2a 0 2024-09-13T21:40:23.042 INFO:tasks.workunit.client.0.smithi088.stdout:1/401: sync 2024-09-13T21:40:23.044 INFO:tasks.workunit.client.0.smithi088.stdout:7/348: dwrite d6/d5f/d69/f5d [0,4194304] 0 2024-09-13T21:40:23.044 INFO:tasks.workunit.client.0.smithi088.stdout:4/385: dwrite d2/d5/d20/d41/d4b/f4f [0,4194304] 0 2024-09-13T21:40:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:9/346: read d1a/d1b/f66 [2264987,75919] 0 2024-09-13T21:40:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:4/386: read - d2/d5/d20/d60/de/d1e/d23/f74 zero size 2024-09-13T21:40:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:4/387: stat d2/d5/d20/l2e 0 2024-09-13T21:40:23.045 INFO:tasks.workunit.client.0.smithi088.stdout:4/388: chown d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79 1 1 2024-09-13T21:40:23.046 INFO:tasks.workunit.client.0.smithi088.stdout:3/425: dwrite d5/d14/f54 [0,4194304] 0 2024-09-13T21:40:23.046 INFO:tasks.workunit.client.0.smithi088.stdout:6/426: dwrite d0/f52 [0,4194304] 0 2024-09-13T21:40:23.049 INFO:tasks.workunit.client.0.smithi088.stdout:7/349: getdents d6/d5f 0 2024-09-13T21:40:23.054 INFO:tasks.workunit.client.0.smithi088.stdout:9/347: creat d1a/d61/d3d/d41/d48/f68 x:0 0 0 2024-09-13T21:40:23.060 INFO:tasks.workunit.client.0.smithi088.stdout:6/427: mkdir d0/d2c/d83 0 2024-09-13T21:40:23.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/350: mkdir d6/d5f/d69/d77 0 2024-09-13T21:40:23.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/351: chown d6/da/c37 15 1 2024-09-13T21:40:23.063 INFO:tasks.workunit.client.0.smithi088.stdout:7/352: read d6/d5f/d69/f6e [365545,109568] 0 2024-09-13T21:40:23.063 INFO:tasks.workunit.client.0.smithi088.stdout:4/389: getdents d2/d13 0 2024-09-13T21:40:23.063 INFO:tasks.workunit.client.0.smithi088.stdout:4/390: stat d2/d5/d20/d60/de/l5f 0 2024-09-13T21:40:23.063 INFO:tasks.workunit.client.0.smithi088.stdout:4/391: write d2/d5/d20/d60/de/d1e/d23/d6f/f3f [667770,54621] 0 2024-09-13T21:40:23.063 INFO:tasks.workunit.client.0.smithi088.stdout:9/348: symlink d1a/d3c/l69 0 2024-09-13T21:40:23.063 INFO:tasks.workunit.client.0.smithi088.stdout:9/349: chown d1a/d1b/f25 3 1 2024-09-13T21:40:23.064 INFO:tasks.workunit.client.0.smithi088.stdout:7/353: mkdir d6/da/d1a/d78 0 2024-09-13T21:40:23.064 INFO:tasks.workunit.client.0.smithi088.stdout:4/392: creat d2/d13/f86 x:0 0 0 2024-09-13T21:40:23.064 INFO:tasks.workunit.client.0.smithi088.stdout:4/393: write d2/d11/f16 [1243680,43643] 0 2024-09-13T21:40:23.064 INFO:tasks.workunit.client.0.smithi088.stdout:4/394: write d2/d81/f82 [77664,90028] 0 2024-09-13T21:40:23.066 INFO:tasks.workunit.client.0.smithi088.stdout:4/395: mknod d2/d5/d20/d7f/c87 0 2024-09-13T21:40:23.066 INFO:tasks.workunit.client.0.smithi088.stdout:9/350: mknod d1a/c6a 0 2024-09-13T21:40:23.068 INFO:tasks.workunit.client.0.smithi088.stdout:4/396: rename d2/d5/d20/d60/de/f32 to d2/d5/d20/f88 0 2024-09-13T21:40:23.068 INFO:tasks.workunit.client.0.smithi088.stdout:2/418: dwrite d1/d13/d2a/f2b [0,4194304] 0 2024-09-13T21:40:23.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/443: dwrite d4/d1c/d24/f41 [0,4194304] 0 2024-09-13T21:40:23.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/444: chown d4/d1c/d24/d26 1 1 2024-09-13T21:40:23.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/445: write d4/d1c/d24/d26/d4b/d67/f7f [4539880,101298] 0 2024-09-13T21:40:23.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/446: chown d4/f31 10335 1 2024-09-13T21:40:23.069 INFO:tasks.workunit.client.0.smithi088.stdout:5/447: chown d4/d1c/d24/d26/d4b/c57 1840 1 2024-09-13T21:40:23.070 INFO:tasks.workunit.client.0.smithi088.stdout:3/426: dread d5/d23/d2a/d6b/f86 [0,4194304] 0 2024-09-13T21:40:23.071 INFO:tasks.workunit.client.0.smithi088.stdout:1/402: dwrite d9/d10/d2a/f55 [0,4194304] 0 2024-09-13T21:40:23.071 INFO:tasks.workunit.client.0.smithi088.stdout:1/403: write d9/d10/d2a/d4b/d61/f70 [388962,63288] 0 2024-09-13T21:40:23.071 INFO:tasks.workunit.client.0.smithi088.stdout:5/448: read d4/d1c/d4a/f5d [559070,25020] 0 2024-09-13T21:40:23.071 INFO:tasks.workunit.client.0.smithi088.stdout:4/397: creat d2/d5/d20/d60/de/d1e/d23/d3c/f89 x:0 0 0 2024-09-13T21:40:23.073 INFO:tasks.workunit.client.0.smithi088.stdout:7/354: dread f1 [0,4194304] 0 2024-09-13T21:40:23.078 INFO:tasks.workunit.client.0.smithi088.stdout:8/372: sync 2024-09-13T21:40:23.078 INFO:tasks.workunit.client.0.smithi088.stdout:8/373: readlink db/d26/l3e 0 2024-09-13T21:40:23.078 INFO:tasks.workunit.client.0.smithi088.stdout:8/374: read - db/d26/d2c/d85/f83 zero size 2024-09-13T21:40:23.078 INFO:tasks.workunit.client.0.smithi088.stdout:8/375: truncate db/df/f69 851674 0 2024-09-13T21:40:23.078 INFO:tasks.workunit.client.0.smithi088.stdout:6/428: write d0/f52 [2608265,33672] 0 2024-09-13T21:40:23.080 INFO:tasks.workunit.client.0.smithi088.stdout:1/404: creat d9/d10/d2a/d4b/d39/d43/d85/f8f x:0 0 0 2024-09-13T21:40:23.084 INFO:tasks.workunit.client.0.smithi088.stdout:5/449: unlink d4/l21 0 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:1/405: symlink d9/d10/d2a/d4b/d3a/l90 0 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/419: dread d1/f10 [0,4194304] 0 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:4/398: symlink d2/d5/d20/d60/de/d1e/d23/d6f/l8a 0 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:7/355: rename d6/c73 to d6/da/d1a/d3a/d5c/c79 0 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:4/399: write d2/d5/d20/d60/de/d1e/d23/d3c/f89 [208066,22883] 0 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:7/356: write d6/da/d1a/f30 [1006706,10248] 0 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/420: write d1/d8/d24/f72 [567563,72798] 0 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:7/357: dread - d6/d4e/f6a zero size 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:2/421: read d1/d8/f12 [7957623,91205] 0 2024-09-13T21:40:23.085 INFO:tasks.workunit.client.0.smithi088.stdout:7/358: write d6/da/f19 [4508280,84766] 0 2024-09-13T21:40:23.086 INFO:tasks.workunit.client.0.smithi088.stdout:5/450: getdents d4/d1c/d24/d26/d40 0 2024-09-13T21:40:23.089 INFO:tasks.workunit.client.0.smithi088.stdout:3/427: dread d5/f42 [0,4194304] 0 2024-09-13T21:40:23.091 INFO:tasks.workunit.client.0.smithi088.stdout:6/429: write d0/d1e/d1f/f51 [2170290,122830] 0 2024-09-13T21:40:23.093 INFO:tasks.workunit.client.0.smithi088.stdout:2/422: write d1/d8/d2e/d44/f54 [3942775,130375] 0 2024-09-13T21:40:23.093 INFO:tasks.workunit.client.0.smithi088.stdout:9/351: dwrite d1a/f67 [0,4194304] 0 2024-09-13T21:40:23.094 INFO:tasks.workunit.client.0.smithi088.stdout:9/352: dread - d1a/d3c/d51/d5e/f63 zero size 2024-09-13T21:40:23.094 INFO:tasks.workunit.client.0.smithi088.stdout:7/359: rmdir d6/da/d1a/d78 0 2024-09-13T21:40:23.097 INFO:tasks.workunit.client.0.smithi088.stdout:0/410: sync 2024-09-13T21:40:23.097 INFO:tasks.workunit.client.0.smithi088.stdout:3/428: getdents d5/d23/d2a/d55 0 2024-09-13T21:40:23.104 INFO:tasks.workunit.client.0.smithi088.stdout:9/353: unlink d1a/f1c 0 2024-09-13T21:40:23.104 INFO:tasks.workunit.client.0.smithi088.stdout:9/354: chown d1a/f20 342 1 2024-09-13T21:40:23.104 INFO:tasks.workunit.client.0.smithi088.stdout:2/423: symlink d1/d13/d2a/d3c/d4a/d6e/d66/d84/l96 0 2024-09-13T21:40:23.107 INFO:tasks.workunit.client.0.smithi088.stdout:1/406: rmdir d9/d10/d2a/d4b/d39 39 2024-09-13T21:40:23.109 INFO:tasks.workunit.client.0.smithi088.stdout:0/411: write d7/f23 [1873912,75608] 0 2024-09-13T21:40:23.109 INFO:tasks.workunit.client.0.smithi088.stdout:4/400: rmdir d2/d13 39 2024-09-13T21:40:23.109 INFO:tasks.workunit.client.0.smithi088.stdout:8/376: dwrite f8 [4194304,4194304] 0 2024-09-13T21:40:23.109 INFO:tasks.workunit.client.0.smithi088.stdout:8/377: fdatasync db/d26/d37/f41 0 2024-09-13T21:40:23.109 INFO:tasks.workunit.client.0.smithi088.stdout:8/378: write db/d26/d2c/d85/f53 [362759,83875] 0 2024-09-13T21:40:23.111 INFO:tasks.workunit.client.0.smithi088.stdout:3/429: write f0 [563304,53032] 0 2024-09-13T21:40:23.111 INFO:tasks.workunit.client.0.smithi088.stdout:3/430: read d5/d23/d2a/d3f/f64 [81956,28653] 0 2024-09-13T21:40:23.111 INFO:tasks.workunit.client.0.smithi088.stdout:7/360: mkdir d6/d5f/d7a 0 2024-09-13T21:40:23.111 INFO:tasks.workunit.client.0.smithi088.stdout:5/451: dwrite d4/d1c/d4a/d63/f6f [0,4194304] 0 2024-09-13T21:40:23.111 INFO:tasks.workunit.client.0.smithi088.stdout:5/452: stat d4/d1c/d24/d26/d56/l84 0 2024-09-13T21:40:23.112 INFO:tasks.workunit.client.0.smithi088.stdout:3/431: write d5/d5a/f73 [24805,47742] 0 2024-09-13T21:40:23.112 INFO:tasks.workunit.client.0.smithi088.stdout:9/355: mkdir d1a/d3c/d6b 0 2024-09-13T21:40:23.112 INFO:tasks.workunit.client.0.smithi088.stdout:9/356: stat d1a/d3c/f5a 0 2024-09-13T21:40:23.113 INFO:tasks.workunit.client.0.smithi088.stdout:2/424: creat d1/d8/d24/d78/d7f/d85/f97 x:0 0 0 2024-09-13T21:40:23.118 INFO:tasks.workunit.client.0.smithi088.stdout:1/407: rename d9/d10/d2a/d4b/d33/f3d to d9/d10/d2a/d4b/d33/f91 0 2024-09-13T21:40:23.120 INFO:tasks.workunit.client.0.smithi088.stdout:0/412: rename d7/d1d/d26/d34/c4a to d7/d1d/d27/d43/c9e 0 2024-09-13T21:40:23.121 INFO:tasks.workunit.client.0.smithi088.stdout:1/408: dread d9/d10/d2a/d4b/d61/f6a [0,4194304] 0 2024-09-13T21:40:23.122 INFO:tasks.workunit.client.0.smithi088.stdout:8/379: mknod db/c86 0 2024-09-13T21:40:23.129 INFO:tasks.workunit.client.0.smithi088.stdout:7/361: unlink d6/da/d1a/l27 0 2024-09-13T21:40:23.131 INFO:tasks.workunit.client.0.smithi088.stdout:1/409: write d9/dc/f42 [154928,22279] 0 2024-09-13T21:40:23.132 INFO:tasks.workunit.client.0.smithi088.stdout:5/453: creat d4/d1c/d24/d26/d56/f91 x:0 0 0 2024-09-13T21:40:23.132 INFO:tasks.workunit.client.0.smithi088.stdout:5/454: chown d4/d1c/c1e 672 1 2024-09-13T21:40:23.132 INFO:tasks.workunit.client.0.smithi088.stdout:5/455: stat d4/d1c/d24/d26/c62 0 2024-09-13T21:40:23.132 INFO:tasks.workunit.client.0.smithi088.stdout:5/456: getdents d4/d1c/d24/d26/d40 0 2024-09-13T21:40:23.134 INFO:tasks.workunit.client.0.smithi088.stdout:9/357: mknod d1a/d61/d3d/d41/d48/c6c 0 2024-09-13T21:40:23.135 INFO:tasks.workunit.client.0.smithi088.stdout:4/401: dwrite d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 [0,4194304] 0 2024-09-13T21:40:23.135 INFO:tasks.workunit.client.0.smithi088.stdout:2/425: dwrite d1/d13/f2c [4194304,4194304] 0 2024-09-13T21:40:23.136 INFO:tasks.workunit.client.0.smithi088.stdout:2/426: write d1/d8/fc [1072838,35446] 0 2024-09-13T21:40:23.136 INFO:tasks.workunit.client.0.smithi088.stdout:2/427: stat d1/d8/f12 0 2024-09-13T21:40:23.136 INFO:tasks.workunit.client.0.smithi088.stdout:0/413: mknod d7/d1d/d21/c9f 0 2024-09-13T21:40:23.137 INFO:tasks.workunit.client.0.smithi088.stdout:8/380: link db/df/f67 db/d26/d2c/f87 0 2024-09-13T21:40:23.140 INFO:tasks.workunit.client.0.smithi088.stdout:1/410: truncate d9/d10/d2a/d4b/f23 1522231 0 2024-09-13T21:40:23.141 INFO:tasks.workunit.client.0.smithi088.stdout:7/362: dread d6/da/d1a/f24 [0,4194304] 0 2024-09-13T21:40:23.141 INFO:tasks.workunit.client.0.smithi088.stdout:7/363: stat d6 0 2024-09-13T21:40:23.141 INFO:tasks.workunit.client.0.smithi088.stdout:7/364: read - d6/da/d1a/f56 zero size 2024-09-13T21:40:23.143 INFO:tasks.workunit.client.0.smithi088.stdout:5/457: rename d4/d1b/d2a to d4/d1c/d81/d89/d92 0 2024-09-13T21:40:23.144 INFO:tasks.workunit.client.0.smithi088.stdout:0/414: write d7/d2c/f48 [3724362,122670] 0 2024-09-13T21:40:23.144 INFO:tasks.workunit.client.0.smithi088.stdout:0/415: chown d7/d65 1760 1 2024-09-13T21:40:23.144 INFO:tasks.workunit.client.0.smithi088.stdout:0/416: chown d7/d65/f92 0 1 2024-09-13T21:40:23.144 INFO:tasks.workunit.client.0.smithi088.stdout:3/432: rmdir d5/d23/d2a/d6b 39 2024-09-13T21:40:23.144 INFO:tasks.workunit.client.0.smithi088.stdout:3/433: truncate f0 5612062 0 2024-09-13T21:40:23.147 INFO:tasks.workunit.client.0.smithi088.stdout:9/358: creat d1a/d61/f6d x:0 0 0 2024-09-13T21:40:23.147 INFO:tasks.workunit.client.0.smithi088.stdout:9/359: write d1a/f43 [343660,58415] 0 2024-09-13T21:40:23.147 INFO:tasks.workunit.client.0.smithi088.stdout:9/360: write f9 [4241623,38304] 0 2024-09-13T21:40:23.148 INFO:tasks.workunit.client.0.smithi088.stdout:5/458: write d4/d1c/f4d [1467427,126587] 0 2024-09-13T21:40:23.148 INFO:tasks.workunit.client.0.smithi088.stdout:5/459: write d4/d1c/d4a/f72 [1153028,123595] 0 2024-09-13T21:40:23.148 INFO:tasks.workunit.client.0.smithi088.stdout:5/460: chown d4/d1c/d81/d89/d92/c3f 31 1 2024-09-13T21:40:23.148 INFO:tasks.workunit.client.0.smithi088.stdout:5/461: readlink d4/d1c/d24/d26/l60 0 2024-09-13T21:40:23.148 INFO:tasks.workunit.client.0.smithi088.stdout:5/462: fdatasync d4/d1c/d76/f88 0 2024-09-13T21:40:23.151 INFO:tasks.workunit.client.0.smithi088.stdout:7/365: dread d6/da/f46 [0,4194304] 0 2024-09-13T21:40:23.151 INFO:tasks.workunit.client.0.smithi088.stdout:7/366: stat d6/f22 0 2024-09-13T21:40:23.152 INFO:tasks.workunit.client.0.smithi088.stdout:2/428: creat d1/d8/d16/f98 x:0 0 0 2024-09-13T21:40:23.156 INFO:tasks.workunit.client.0.smithi088.stdout:1/411: unlink d9/d10/d2a/d47/f50 0 2024-09-13T21:40:23.157 INFO:tasks.workunit.client.0.smithi088.stdout:4/402: rename d2/d5/d20/f5c to d2/d5/d20/d60/de/d1e/d31/f8b 0 2024-09-13T21:40:23.158 INFO:tasks.workunit.client.0.smithi088.stdout:4/403: chown d2/d5/f14 16 1 2024-09-13T21:40:23.159 INFO:tasks.workunit.client.0.smithi088.stdout:0/417: symlink d7/d1d/d3d/la0 0 2024-09-13T21:40:23.161 INFO:tasks.workunit.client.0.smithi088.stdout:3/434: dwrite d5/f22 [4194304,4194304] 0 2024-09-13T21:40:23.161 INFO:tasks.workunit.client.0.smithi088.stdout:8/381: dwrite db/d26/d2c/f5d [0,4194304] 0 2024-09-13T21:40:23.162 INFO:tasks.workunit.client.0.smithi088.stdout:9/361: unlink f9 0 2024-09-13T21:40:23.162 INFO:tasks.workunit.client.0.smithi088.stdout:9/362: chown d1a/d3c 13848 1 2024-09-13T21:40:23.164 INFO:tasks.workunit.client.0.smithi088.stdout:5/463: creat d4/d1c/d81/d89/d92/f93 x:0 0 0 2024-09-13T21:40:23.165 INFO:tasks.workunit.client.0.smithi088.stdout:7/367: getdents d6/d5f 0 2024-09-13T21:40:23.165 INFO:tasks.workunit.client.0.smithi088.stdout:1/412: write d9/d10/d2a/d4b/f2f [2517282,2565] 0 2024-09-13T21:40:23.167 INFO:tasks.workunit.client.0.smithi088.stdout:2/429: mkdir d1/d13/d3f/d99 0 2024-09-13T21:40:23.169 INFO:tasks.workunit.client.0.smithi088.stdout:4/404: creat d2/d5/d20/d60/de/f8c x:0 0 0 2024-09-13T21:40:23.169 INFO:tasks.workunit.client.0.smithi088.stdout:4/405: chown d2/d5/d20/d60/de/d1e/d31/f8b 515961595 1 2024-09-13T21:40:23.171 INFO:tasks.workunit.client.0.smithi088.stdout:0/418: creat d7/d1d/d66/d8b/fa1 x:0 0 0 2024-09-13T21:40:23.171 INFO:tasks.workunit.client.0.smithi088.stdout:0/419: readlink d7/d65/l3a 0 2024-09-13T21:40:23.176 INFO:tasks.workunit.client.0.smithi088.stdout:8/382: mkdir db/df/d25/d88 0 2024-09-13T21:40:23.177 INFO:tasks.workunit.client.0.smithi088.stdout:3/435: dwrite d5/d23/f6c [0,4194304] 0 2024-09-13T21:40:23.178 INFO:tasks.workunit.client.0.smithi088.stdout:5/464: symlink d4/d1c/d24/d26/d40/l94 0 2024-09-13T21:40:23.178 INFO:tasks.workunit.client.0.smithi088.stdout:5/465: stat d4/d1c/d24/f59 0 2024-09-13T21:40:23.179 INFO:tasks.workunit.client.0.smithi088.stdout:4/406: write d2/d5/d20/d60/f2a [1531214,31476] 0 2024-09-13T21:40:23.180 INFO:tasks.workunit.client.0.smithi088.stdout:7/368: link d6/da/f10 d6/d4e/f7b 0 2024-09-13T21:40:23.180 INFO:tasks.workunit.client.0.smithi088.stdout:7/369: truncate d6/d5f/d69/d4f/f41 1856936 0 2024-09-13T21:40:23.180 INFO:tasks.workunit.client.0.smithi088.stdout:7/370: dread - d6/f42 zero size 2024-09-13T21:40:23.180 INFO:tasks.workunit.client.0.smithi088.stdout:7/371: chown d6/da/d1a/f30 1 1 2024-09-13T21:40:23.185 INFO:tasks.workunit.client.0.smithi088.stdout:1/413: rename d9/d10/d2a/d4b/d33/d8d to d9/d10/d2a/d4b/d33/d92 0 2024-09-13T21:40:23.185 INFO:tasks.workunit.client.0.smithi088.stdout:1/414: write d9/d10/d2a/d4b/d39/d43/f4d [2635001,74350] 0 2024-09-13T21:40:23.186 INFO:tasks.workunit.client.0.smithi088.stdout:0/420: rename d7/d2c/d44/c5f to d7/ca2 0 2024-09-13T21:40:23.187 INFO:tasks.workunit.client.0.smithi088.stdout:3/436: dread d5/d23/f6c [0,4194304] 0 2024-09-13T21:40:23.187 INFO:tasks.workunit.client.0.smithi088.stdout:3/437: truncate d5/d23/d2a/d6b/f86 1283761 0 2024-09-13T21:40:23.190 INFO:tasks.workunit.client.0.smithi088.stdout:9/363: mknod d1a/c6e 0 2024-09-13T21:40:23.190 INFO:tasks.workunit.client.0.smithi088.stdout:3/438: dread d5/f38 [0,4194304] 0 2024-09-13T21:40:23.190 INFO:tasks.workunit.client.0.smithi088.stdout:3/439: chown d5/d23/f3c 3279 1 2024-09-13T21:40:23.190 INFO:tasks.workunit.client.0.smithi088.stdout:3/440: truncate d5/d23/d2a/d3f/f69 639099 0 2024-09-13T21:40:23.190 INFO:tasks.workunit.client.0.smithi088.stdout:4/407: write d2/d5/d20/d41/d4b/f7a [2745576,78419] 0 2024-09-13T21:40:23.191 INFO:tasks.workunit.client.0.smithi088.stdout:6/430: sync 2024-09-13T21:40:23.191 INFO:tasks.workunit.client.0.smithi088.stdout:6/431: fsync d0/f6 0 2024-09-13T21:40:23.191 INFO:tasks.workunit.client.0.smithi088.stdout:5/466: mkdir d4/d1c/d24/d95 0 2024-09-13T21:40:23.192 INFO:tasks.workunit.client.0.smithi088.stdout:5/467: dread - d4/d1c/d24/d26/d56/f70 zero size 2024-09-13T21:40:23.193 INFO:tasks.workunit.client.0.smithi088.stdout:7/372: symlink d6/d5f/l7c 0 2024-09-13T21:40:23.193 INFO:tasks.workunit.client.0.smithi088.stdout:7/373: write d6/f18 [5491382,15894] 0 2024-09-13T21:40:23.198 INFO:tasks.workunit.client.0.smithi088.stdout:2/430: symlink d1/d8/d2e/l9a 0 2024-09-13T21:40:23.198 INFO:tasks.workunit.client.0.smithi088.stdout:2/431: fsync d1/d8/d16/d40/f60 0 2024-09-13T21:40:23.198 INFO:tasks.workunit.client.0.smithi088.stdout:2/432: chown d1/d8/l5a 111 1 2024-09-13T21:40:23.201 INFO:tasks.workunit.client.0.smithi088.stdout:0/421: rename d7/f81 to d7/d2c/d30/d31/d42/d95/fa3 0 2024-09-13T21:40:23.201 INFO:tasks.workunit.client.0.smithi088.stdout:0/422: chown d7/d2c/c3f 1 1 2024-09-13T21:40:23.201 INFO:tasks.workunit.client.0.smithi088.stdout:0/423: readlink d7/d65/l3a 0 2024-09-13T21:40:23.204 INFO:tasks.workunit.client.0.smithi088.stdout:7/374: truncate d6/da/f1e 3485244 0 2024-09-13T21:40:23.206 INFO:tasks.workunit.client.0.smithi088.stdout:1/415: rmdir d9/d4f 39 2024-09-13T21:40:23.208 INFO:tasks.workunit.client.0.smithi088.stdout:2/433: symlink d1/d13/d2a/d3c/d4a/l9b 0 2024-09-13T21:40:23.208 INFO:tasks.workunit.client.0.smithi088.stdout:2/434: dread - d1/d8/d24/d78/d7f/d85/f97 zero size 2024-09-13T21:40:23.209 INFO:tasks.workunit.client.0.smithi088.stdout:2/435: write d1/d8/d24/f72 [1085227,116356] 0 2024-09-13T21:40:23.209 INFO:tasks.workunit.client.0.smithi088.stdout:2/436: chown d1/d8/d16/f37 33436288 1 2024-09-13T21:40:23.210 INFO:tasks.workunit.client.0.smithi088.stdout:9/364: rename d1a/d3c/l69 to d1a/d3c/d51/l6f 0 2024-09-13T21:40:23.210 INFO:tasks.workunit.client.0.smithi088.stdout:9/365: chown d1a/d1b/l33 54850704 1 2024-09-13T21:40:23.210 INFO:tasks.workunit.client.0.smithi088.stdout:9/366: creat d1a/d1b/d3f/f70 x:0 0 0 2024-09-13T21:40:23.211 INFO:tasks.workunit.client.0.smithi088.stdout:0/424: mknod d7/d65/d8c/ca4 0 2024-09-13T21:40:23.211 INFO:tasks.workunit.client.0.smithi088.stdout:0/425: fsync d7/d2c/d30/d31/d42/d4b/f85 0 2024-09-13T21:40:23.212 INFO:tasks.workunit.client.0.smithi088.stdout:7/375: creat d6/d5f/f7d x:0 0 0 2024-09-13T21:40:23.215 INFO:tasks.workunit.client.0.smithi088.stdout:2/437: unlink d1/d13/d2a/d3c/d4a/d6e/c61 0 2024-09-13T21:40:23.215 INFO:tasks.workunit.client.0.smithi088.stdout:2/438: readlink d1/l31 0 2024-09-13T21:40:23.216 INFO:tasks.workunit.client.0.smithi088.stdout:2/439: read d1/d13/d2a/d3c/d4a/f7a [130851,47066] 0 2024-09-13T21:40:23.216 INFO:tasks.workunit.client.0.smithi088.stdout:2/440: fsync d1/f68 0 2024-09-13T21:40:23.216 INFO:tasks.workunit.client.0.smithi088.stdout:5/468: rename d4/d1c/f53 to d4/d1c/d81/d89/d92/f96 0 2024-09-13T21:40:23.218 INFO:tasks.workunit.client.0.smithi088.stdout:9/367: symlink d1a/d1b/l71 0 2024-09-13T21:40:23.219 INFO:tasks.workunit.client.0.smithi088.stdout:4/408: dwrite d2/f15 [0,4194304] 0 2024-09-13T21:40:23.219 INFO:tasks.workunit.client.0.smithi088.stdout:3/441: dwrite d5/d23/d2a/f40 [0,4194304] 0 2024-09-13T21:40:23.219 INFO:tasks.workunit.client.0.smithi088.stdout:3/442: rename d5/d23/d2a to d5/d23/d2a/d3f/d76/d88 22 2024-09-13T21:40:23.219 INFO:tasks.workunit.client.0.smithi088.stdout:3/443: chown d5/d26/d43 50720155 1 2024-09-13T21:40:23.220 INFO:tasks.workunit.client.0.smithi088.stdout:8/383: dwrite db/d26/d2c/d85/d51/f7c [4194304,4194304] 0 2024-09-13T21:40:23.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/432: dwrite d0/d1e/d1f/f7b [0,4194304] 0 2024-09-13T21:40:23.220 INFO:tasks.workunit.client.0.smithi088.stdout:8/384: write db/f7f [637828,103199] 0 2024-09-13T21:40:23.220 INFO:tasks.workunit.client.0.smithi088.stdout:7/376: link d6/da/d1a/d3a/d5c/c79 d6/da/d1a/c7e 0 2024-09-13T21:40:23.220 INFO:tasks.workunit.client.0.smithi088.stdout:0/426: mknod d7/d2c/d30/d31/d42/d4b/ca5 0 2024-09-13T21:40:23.221 INFO:tasks.workunit.client.0.smithi088.stdout:1/416: dread d9/d10/d2a/d4b/d39/f40 [0,4194304] 0 2024-09-13T21:40:23.221 INFO:tasks.workunit.client.0.smithi088.stdout:1/417: read f1 [594531,48519] 0 2024-09-13T21:40:23.223 INFO:tasks.workunit.client.0.smithi088.stdout:4/409: dread d2/d5/d20/d41/d4b/f54 [0,4194304] 0 2024-09-13T21:40:23.224 INFO:tasks.workunit.client.0.smithi088.stdout:5/469: creat d4/d1c/d24/d95/f97 x:0 0 0 2024-09-13T21:40:23.226 INFO:tasks.workunit.client.0.smithi088.stdout:9/368: truncate d1a/d61/d3d/d41/d48/f68 545231 0 2024-09-13T21:40:23.226 INFO:tasks.workunit.client.0.smithi088.stdout:9/369: chown d1a/d1b/d3f/f55 679756 1 2024-09-13T21:40:23.234 INFO:tasks.workunit.client.0.smithi088.stdout:3/444: creat d5/d23/d2a/d6b/f89 x:0 0 0 2024-09-13T21:40:23.234 INFO:tasks.workunit.client.0.smithi088.stdout:6/433: write d0/d1e/d1f/d55/f6f [1571262,35968] 0 2024-09-13T21:40:23.234 INFO:tasks.workunit.client.0.smithi088.stdout:6/434: write d0/d1e/f73 [57101,62867] 0 2024-09-13T21:40:23.234 INFO:tasks.workunit.client.0.smithi088.stdout:6/435: read - d0/d1e/f4c zero size 2024-09-13T21:40:23.242 INFO:tasks.workunit.client.0.smithi088.stdout:8/385: unlink db/df/d25/f2d 0 2024-09-13T21:40:23.244 INFO:tasks.workunit.client.0.smithi088.stdout:0/427: mkdir d7/d65/d8c/da6 0 2024-09-13T21:40:23.244 INFO:tasks.workunit.client.0.smithi088.stdout:0/428: write d7/f91 [106397,16737] 0 2024-09-13T21:40:23.249 INFO:tasks.workunit.client.0.smithi088.stdout:1/418: dwrite d9/d10/f17 [0,4194304] 0 2024-09-13T21:40:23.253 INFO:tasks.workunit.client.0.smithi088.stdout:7/377: dwrite d6/da/f19 [0,4194304] 0 2024-09-13T21:40:23.253 INFO:tasks.workunit.client.0.smithi088.stdout:6/436: dwrite d0/ff [4194304,4194304] 0 2024-09-13T21:40:23.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/441: rmdir d1/d8 39 2024-09-13T21:40:23.258 INFO:tasks.workunit.client.0.smithi088.stdout:4/410: mknod d2/d5/d20/d60/de/d1e/d23/d3c/c8d 0 2024-09-13T21:40:23.260 INFO:tasks.workunit.client.0.smithi088.stdout:5/470: symlink d4/d1c/d24/d26/d4b/d67/l98 0 2024-09-13T21:40:23.260 INFO:tasks.workunit.client.0.smithi088.stdout:5/471: fdatasync d4/f1f 0 2024-09-13T21:40:23.261 INFO:tasks.workunit.client.0.smithi088.stdout:0/429: dwrite d7/f19 [0,4194304] 0 2024-09-13T21:40:23.261 INFO:tasks.workunit.client.0.smithi088.stdout:9/370: mkdir d1a/d3c/d51/d5e/d72 0 2024-09-13T21:40:23.264 INFO:tasks.workunit.client.0.smithi088.stdout:8/386: link db/f1a db/d26/d2c/d85/f89 0 2024-09-13T21:40:23.270 INFO:tasks.workunit.client.0.smithi088.stdout:1/419: rename d9/d10/d2a/d4b/d39/f40 to d9/d10/d2a/d4b/d39/d43/f93 0 2024-09-13T21:40:23.277 INFO:tasks.workunit.client.0.smithi088.stdout:1/420: dread d9/d10/d2a/d4b/f21 [0,4194304] 0 2024-09-13T21:40:23.280 INFO:tasks.workunit.client.0.smithi088.stdout:6/437: truncate d0/d1e/d1f/f51 275750 0 2024-09-13T21:40:23.280 INFO:tasks.workunit.client.0.smithi088.stdout:6/438: creat d0/d2c/d32/f84 x:0 0 0 2024-09-13T21:40:23.280 INFO:tasks.workunit.client.0.smithi088.stdout:6/439: write d0/d2c/d32/f84 [797370,48685] 0 2024-09-13T21:40:23.280 INFO:tasks.workunit.client.0.smithi088.stdout:6/440: chown d0/d1e/c61 2 1 2024-09-13T21:40:23.280 INFO:tasks.workunit.client.0.smithi088.stdout:6/441: dread - d0/d2c/f6b zero size 2024-09-13T21:40:23.281 INFO:tasks.workunit.client.0.smithi088.stdout:6/442: truncate d0/db/f12 7820649 0 2024-09-13T21:40:23.281 INFO:tasks.workunit.client.0.smithi088.stdout:6/443: write d0/d1e/f24 [1625621,41153] 0 2024-09-13T21:40:23.281 INFO:tasks.workunit.client.0.smithi088.stdout:2/442: mkdir d1/d13/d3f/d99/d9c 0 2024-09-13T21:40:23.281 INFO:tasks.workunit.client.0.smithi088.stdout:2/443: chown d1/d8/d16/d40/d7e 13709 1 2024-09-13T21:40:23.281 INFO:tasks.workunit.client.0.smithi088.stdout:2/444: write d1/d13/f2c [8810488,88658] 0 2024-09-13T21:40:23.281 INFO:tasks.workunit.client.0.smithi088.stdout:4/411: unlink d2/l3 0 2024-09-13T21:40:23.282 INFO:tasks.workunit.client.0.smithi088.stdout:5/472: symlink d4/d1c/d76/l99 0 2024-09-13T21:40:23.283 INFO:tasks.workunit.client.0.smithi088.stdout:0/430: creat d7/d1d/d66/fa7 x:0 0 0 2024-09-13T21:40:23.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/431: write d7/d2c/d30/d31/d42/d95/f9a [589126,68023] 0 2024-09-13T21:40:23.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/432: write d7/d1d/d27/d43/f1c [2582087,7083] 0 2024-09-13T21:40:23.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/433: write d7/f28 [1695408,112432] 0 2024-09-13T21:40:23.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/434: read d7/d1d/d27/d43/f1c [2579530,55687] 0 2024-09-13T21:40:23.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/435: stat d7/d1d/d66/fa7 0 2024-09-13T21:40:23.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/436: write d7/d1d/d27/f64 [4731327,83026] 0 2024-09-13T21:40:23.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/437: dread - d7/d1d/d27/f6f zero size 2024-09-13T21:40:23.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/438: chown d7/l36 3829132 1 2024-09-13T21:40:23.285 INFO:tasks.workunit.client.0.smithi088.stdout:7/378: rename d6/da/d1a/f43 to d6/d5f/d69/d77/f7f 0 2024-09-13T21:40:23.287 INFO:tasks.workunit.client.0.smithi088.stdout:1/421: rename d9/d10/d2a/d4b/d39/d43/f79 to d9/d10/d2a/d4b/d39/d43/f94 0 2024-09-13T21:40:23.291 INFO:tasks.workunit.client.0.smithi088.stdout:2/445: creat d1/d13/d3f/d99/f9d x:0 0 0 2024-09-13T21:40:23.293 INFO:tasks.workunit.client.0.smithi088.stdout:8/387: dread db/d26/d2c/d85/d51/f7c [4194304,4194304] 0 2024-09-13T21:40:23.293 INFO:tasks.workunit.client.0.smithi088.stdout:4/412: creat d2/d5/d20/d41/f8e x:0 0 0 2024-09-13T21:40:23.294 INFO:tasks.workunit.client.0.smithi088.stdout:2/446: write d1/d8/f57 [25118,62982] 0 2024-09-13T21:40:23.294 INFO:tasks.workunit.client.0.smithi088.stdout:2/447: chown d1/d8/d16/d40/f60 1 1 2024-09-13T21:40:23.294 INFO:tasks.workunit.client.0.smithi088.stdout:5/473: symlink d4/d1c/d24/d26/d56/l9a 0 2024-09-13T21:40:23.294 INFO:tasks.workunit.client.0.smithi088.stdout:2/448: write d1/d8/d24/f39 [977304,45398] 0 2024-09-13T21:40:23.294 INFO:tasks.workunit.client.0.smithi088.stdout:6/444: dwrite d0/ff [4194304,4194304] 0 2024-09-13T21:40:23.296 INFO:tasks.workunit.client.0.smithi088.stdout:0/439: creat d7/d2c/d30/d31/d42/fa8 x:0 0 0 2024-09-13T21:40:23.297 INFO:tasks.workunit.client.0.smithi088.stdout:0/440: creat d7/fa9 x:0 0 0 2024-09-13T21:40:23.299 INFO:tasks.workunit.client.0.smithi088.stdout:7/379: unlink d6/d5f/d69/f5d 0 2024-09-13T21:40:23.303 INFO:tasks.workunit.client.0.smithi088.stdout:2/449: dread d1/d13/d2a/f2b [0,4194304] 0 2024-09-13T21:40:23.306 INFO:tasks.workunit.client.0.smithi088.stdout:4/413: creat d2/d5/d20/d7f/f8f x:0 0 0 2024-09-13T21:40:23.309 INFO:tasks.workunit.client.0.smithi088.stdout:5/474: creat d4/d1c/d4a/d8a/f9b x:0 0 0 2024-09-13T21:40:23.309 INFO:tasks.workunit.client.0.smithi088.stdout:5/475: write d4/d1c/d81/d89/d92/f93 [647464,40988] 0 2024-09-13T21:40:23.309 INFO:tasks.workunit.client.0.smithi088.stdout:5/476: read - d4/d1c/d24/d26/f55 zero size 2024-09-13T21:40:23.309 INFO:tasks.workunit.client.0.smithi088.stdout:4/414: dread f1 [0,4194304] 0 2024-09-13T21:40:23.309 INFO:tasks.workunit.client.0.smithi088.stdout:4/415: chown d2/c5e 206014262 1 2024-09-13T21:40:23.310 INFO:tasks.workunit.client.0.smithi088.stdout:5/477: dread d4/d1c/d24/d26/f6e [0,4194304] 0 2024-09-13T21:40:23.311 INFO:tasks.workunit.client.0.smithi088.stdout:6/445: unlink d0/d1e/d1f/d55/f6f 0 2024-09-13T21:40:23.311 INFO:tasks.workunit.client.0.smithi088.stdout:6/446: creat d0/db/f85 x:0 0 0 2024-09-13T21:40:23.311 INFO:tasks.workunit.client.0.smithi088.stdout:6/447: readlink d0/d2c/l36 0 2024-09-13T21:40:23.313 INFO:tasks.workunit.client.0.smithi088.stdout:9/371: rename d1a/d61/d3d/d41/d48/l56 to d1a/d61/d3d/l73 0 2024-09-13T21:40:23.313 INFO:tasks.workunit.client.0.smithi088.stdout:9/372: fsync d1a/d1b/f28 0 2024-09-13T21:40:23.313 INFO:tasks.workunit.client.0.smithi088.stdout:9/373: stat d1a/d61/d3d/d41/f44 0 2024-09-13T21:40:23.313 INFO:tasks.workunit.client.0.smithi088.stdout:1/422: rmdir d9/d10/d2a/d4b/d33 39 2024-09-13T21:40:23.314 INFO:tasks.workunit.client.0.smithi088.stdout:1/423: write d9/f60 [1527423,51633] 0 2024-09-13T21:40:23.321 INFO:tasks.workunit.client.0.smithi088.stdout:9/374: read f18 [3433389,87472] 0 2024-09-13T21:40:23.321 INFO:tasks.workunit.client.0.smithi088.stdout:9/375: truncate d1a/d1b/d3f/f64 419934 0 2024-09-13T21:40:23.327 INFO:tasks.workunit.client.0.smithi088.stdout:2/450: mkdir d1/d13/d2a/d3c/d4a/d6e/d66/d84/d9e 0 2024-09-13T21:40:23.327 INFO:tasks.workunit.client.0.smithi088.stdout:2/451: chown d1/d13/d3f/d99/d9c 166 1 2024-09-13T21:40:23.327 INFO:tasks.workunit.client.0.smithi088.stdout:2/452: chown d1/d13/d2a/d3c/d4a/d6e/l80 451 1 2024-09-13T21:40:23.328 INFO:tasks.workunit.client.0.smithi088.stdout:2/453: write d1/d8/d16/d40/f67 [687226,121109] 0 2024-09-13T21:40:23.330 INFO:tasks.workunit.client.0.smithi088.stdout:5/478: creat d4/d1b/d68/f9c x:0 0 0 2024-09-13T21:40:23.333 INFO:tasks.workunit.client.0.smithi088.stdout:6/448: symlink d0/d1e/d1f/l86 0 2024-09-13T21:40:23.333 INFO:tasks.workunit.client.0.smithi088.stdout:6/449: getdents d0/d2c/d32/d39/d3f/d71/d81 0 2024-09-13T21:40:23.333 INFO:tasks.workunit.client.0.smithi088.stdout:6/450: dread - d0/d1e/d1f/f4d zero size 2024-09-13T21:40:23.335 INFO:tasks.workunit.client.0.smithi088.stdout:8/388: rename db/d26/d37/l5b to db/d26/d37/d7d/l8a 0 2024-09-13T21:40:23.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/376: dwrite d1a/d1b/f25 [4194304,4194304] 0 2024-09-13T21:40:23.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/377: creat d1a/d1b/f74 x:0 0 0 2024-09-13T21:40:23.340 INFO:tasks.workunit.client.0.smithi088.stdout:2/454: creat d1/d13/d2a/d3c/d4a/d6e/d66/d84/d9e/f9f x:0 0 0 2024-09-13T21:40:23.340 INFO:tasks.workunit.client.0.smithi088.stdout:2/455: read - d1/d8/d24/d78/d7f/d85/f97 zero size 2024-09-13T21:40:23.340 INFO:tasks.workunit.client.0.smithi088.stdout:2/456: truncate d1/d13/d2a/d41/d48/f83 218102 0 2024-09-13T21:40:23.341 INFO:tasks.workunit.client.0.smithi088.stdout:4/416: getdents d2/d5/d2d 0 2024-09-13T21:40:23.341 INFO:tasks.workunit.client.0.smithi088.stdout:4/417: fdatasync d2/d5/f14 0 2024-09-13T21:40:23.342 INFO:tasks.workunit.client.0.smithi088.stdout:4/418: read - d2/d5/d20/d41/d4b/f6a zero size 2024-09-13T21:40:23.342 INFO:tasks.workunit.client.0.smithi088.stdout:3/445: sync 2024-09-13T21:40:23.344 INFO:tasks.workunit.client.0.smithi088.stdout:0/441: rename d7/d2c/d30/d31/d42/f9c to d7/d1d/d26/d45/faa 0 2024-09-13T21:40:23.345 INFO:tasks.workunit.client.0.smithi088.stdout:0/442: creat d7/d1d/d66/fab x:0 0 0 2024-09-13T21:40:23.345 INFO:tasks.workunit.client.0.smithi088.stdout:0/443: fdatasync d7/d1d/d26/d45/f56 0 2024-09-13T21:40:23.346 INFO:tasks.workunit.client.0.smithi088.stdout:8/389: creat db/d26/d2c/f8b x:0 0 0 2024-09-13T21:40:23.346 INFO:tasks.workunit.client.0.smithi088.stdout:8/390: truncate db/d26/d2c/f87 100480 0 2024-09-13T21:40:23.346 INFO:tasks.workunit.client.0.smithi088.stdout:8/391: write db/df/f69 [1781814,47187] 0 2024-09-13T21:40:23.346 INFO:tasks.workunit.client.0.smithi088.stdout:8/392: dread - db/d26/d2c/f8b zero size 2024-09-13T21:40:23.347 INFO:tasks.workunit.client.0.smithi088.stdout:8/393: fsync db/d26/d4f/f62 0 2024-09-13T21:40:23.347 INFO:tasks.workunit.client.0.smithi088.stdout:1/424: getdents d9/dc/d74 0 2024-09-13T21:40:23.348 INFO:tasks.workunit.client.0.smithi088.stdout:5/479: dwrite d4/ff [4194304,4194304] 0 2024-09-13T21:40:23.350 INFO:tasks.workunit.client.0.smithi088.stdout:2/457: unlink d1/d8/l20 0 2024-09-13T21:40:23.352 INFO:tasks.workunit.client.0.smithi088.stdout:4/419: mkdir d2/d5/d20/d60/de/d1e/d23/d3c/d90 0 2024-09-13T21:40:23.352 INFO:tasks.workunit.client.0.smithi088.stdout:3/446: symlink d5/d14/l8a 0 2024-09-13T21:40:23.354 INFO:tasks.workunit.client.0.smithi088.stdout:7/380: rename d6/d4e/f5b to d6/da/d1a/f80 0 2024-09-13T21:40:23.354 INFO:tasks.workunit.client.0.smithi088.stdout:6/451: rename d0 to d0/db/d87 22 2024-09-13T21:40:23.356 INFO:tasks.workunit.client.0.smithi088.stdout:0/444: truncate d7/d1d/f69 3835204 0 2024-09-13T21:40:23.358 INFO:tasks.workunit.client.0.smithi088.stdout:8/394: symlink db/d26/d37/l8c 0 2024-09-13T21:40:23.359 INFO:tasks.workunit.client.0.smithi088.stdout:0/445: rename d7/f28 to d7/d1d/d26/d45/fac 0 2024-09-13T21:40:23.360 INFO:tasks.workunit.client.0.smithi088.stdout:0/446: creat d7/d2c/d30/d31/d42/fad x:0 0 0 2024-09-13T21:40:23.360 INFO:tasks.workunit.client.0.smithi088.stdout:0/447: read - d7/fa9 zero size 2024-09-13T21:40:23.360 INFO:tasks.workunit.client.0.smithi088.stdout:8/395: fdatasync db/d26/d2c/d85/d51/f54 0 2024-09-13T21:40:23.361 INFO:tasks.workunit.client.0.smithi088.stdout:7/381: dread d6/da/f38 [0,4194304] 0 2024-09-13T21:40:23.363 INFO:tasks.workunit.client.0.smithi088.stdout:2/458: dread d1/d13/d2a/f2b [0,4194304] 0 2024-09-13T21:40:23.363 INFO:tasks.workunit.client.0.smithi088.stdout:9/378: dwrite d1a/d1b/f74 [0,4194304] 0 2024-09-13T21:40:23.363 INFO:tasks.workunit.client.0.smithi088.stdout:9/379: dread - d1a/d1b/f5c zero size 2024-09-13T21:40:23.363 INFO:tasks.workunit.client.0.smithi088.stdout:9/380: truncate d1a/d1b/f2d 190401 0 2024-09-13T21:40:23.363 INFO:tasks.workunit.client.0.smithi088.stdout:9/381: chown d1a/d61/d3d/d41/d48/c6c 12765 1 2024-09-13T21:40:23.363 INFO:tasks.workunit.client.0.smithi088.stdout:0/448: mkdir d7/d1d/d3d/dae 0 2024-09-13T21:40:23.364 INFO:tasks.workunit.client.0.smithi088.stdout:5/480: dread d4/d1c/d81/d89/d92/f3b [0,4194304] 0 2024-09-13T21:40:23.364 INFO:tasks.workunit.client.0.smithi088.stdout:5/481: fsync d4/d1c/d4a/d8a/f9b 0 2024-09-13T21:40:23.365 INFO:tasks.workunit.client.0.smithi088.stdout:8/396: link db/d26/f45 db/d26/f8d 0 2024-09-13T21:40:23.365 INFO:tasks.workunit.client.0.smithi088.stdout:7/382: mkdir d6/d5f/d81 0 2024-09-13T21:40:23.366 INFO:tasks.workunit.client.0.smithi088.stdout:5/482: dread f2 [4194304,4194304] 0 2024-09-13T21:40:23.367 INFO:tasks.workunit.client.0.smithi088.stdout:2/459: mkdir d1/d13/d2a/d41/d48/da0 0 2024-09-13T21:40:23.367 INFO:tasks.workunit.client.0.smithi088.stdout:2/460: readlink d1/d13/d2a/d41/l42 0 2024-09-13T21:40:23.367 INFO:tasks.workunit.client.0.smithi088.stdout:2/461: write d1/d13/d2a/d3c/d4a/f7a [343062,4544] 0 2024-09-13T21:40:23.370 INFO:tasks.workunit.client.0.smithi088.stdout:9/382: rmdir d1a/d3c/d6b 0 2024-09-13T21:40:23.370 INFO:tasks.workunit.client.0.smithi088.stdout:9/383: dread - d1a/d61/f6d zero size 2024-09-13T21:40:23.372 INFO:tasks.workunit.client.0.smithi088.stdout:9/384: mkdir d1a/d61/d3d/d75 0 2024-09-13T21:40:23.373 INFO:tasks.workunit.client.0.smithi088.stdout:9/385: symlink d1a/d3c/d51/d5e/d72/l76 0 2024-09-13T21:40:23.376 INFO:tasks.workunit.client.0.smithi088.stdout:9/386: unlink d1a/c6e 0 2024-09-13T21:40:23.376 INFO:tasks.workunit.client.0.smithi088.stdout:9/387: chown d1a/d1b/l71 1353 1 2024-09-13T21:40:23.376 INFO:tasks.workunit.client.0.smithi088.stdout:9/388: dread - d1a/d1b/f5c zero size 2024-09-13T21:40:23.376 INFO:tasks.workunit.client.0.smithi088.stdout:9/389: write f14 [1058145,112352] 0 2024-09-13T21:40:23.381 INFO:tasks.workunit.client.0.smithi088.stdout:7/383: dread d6/da/d1a/f33 [0,4194304] 0 2024-09-13T21:40:23.385 INFO:tasks.workunit.client.0.smithi088.stdout:7/384: creat d6/d5f/d69/d4f/d6f/d70/d76/f82 x:0 0 0 2024-09-13T21:40:23.387 INFO:tasks.workunit.client.0.smithi088.stdout:4/420: dwrite d2/d5/d20/d60/de/d1e/d31/f7d [0,4194304] 0 2024-09-13T21:40:23.387 INFO:tasks.workunit.client.0.smithi088.stdout:4/421: chown d2/d5/d20/d60/de/f58 3 1 2024-09-13T21:40:23.387 INFO:tasks.workunit.client.0.smithi088.stdout:4/422: fdatasync d2/d5/d20/d7f/f8f 0 2024-09-13T21:40:23.387 INFO:tasks.workunit.client.0.smithi088.stdout:4/423: chown d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79/c85 37023 1 2024-09-13T21:40:23.387 INFO:tasks.workunit.client.0.smithi088.stdout:4/424: chown d2/d5/d20/d60/de/d1e/d23/d6f/l30 1484 1 2024-09-13T21:40:23.389 INFO:tasks.workunit.client.0.smithi088.stdout:7/385: truncate d6/da/f38 654809 0 2024-09-13T21:40:23.389 INFO:tasks.workunit.client.0.smithi088.stdout:7/386: write d6/d5f/f7d [28192,62244] 0 2024-09-13T21:40:23.389 INFO:tasks.workunit.client.0.smithi088.stdout:0/449: write d7/d1d/d27/d43/f53 [472401,124069] 0 2024-09-13T21:40:23.389 INFO:tasks.workunit.client.0.smithi088.stdout:1/425: dwrite d9/d10/d2a/d4b/d39/d43/f4d [0,4194304] 0 2024-09-13T21:40:23.389 INFO:tasks.workunit.client.0.smithi088.stdout:1/426: fsync d9/d10/f17 0 2024-09-13T21:40:23.390 INFO:tasks.workunit.client.0.smithi088.stdout:5/483: dread d4/d1c/f4d [0,4194304] 0 2024-09-13T21:40:23.391 INFO:tasks.workunit.client.0.smithi088.stdout:3/447: dwrite d5/d14/f54 [4194304,4194304] 0 2024-09-13T21:40:23.391 INFO:tasks.workunit.client.0.smithi088.stdout:3/448: fsync d5/d14/f1a 0 2024-09-13T21:40:23.391 INFO:tasks.workunit.client.0.smithi088.stdout:3/449: chown d5/d23/d2a/d6b/f86 64531439 1 2024-09-13T21:40:23.391 INFO:tasks.workunit.client.0.smithi088.stdout:3/450: truncate d5/d23/d2a/d3f/d76/f77 802537 0 2024-09-13T21:40:23.391 INFO:tasks.workunit.client.0.smithi088.stdout:3/451: truncate d5/d23/d2a/d63/d48/d49/f62 541229 0 2024-09-13T21:40:23.394 INFO:tasks.workunit.client.0.smithi088.stdout:1/427: rmdir d9/d4f 39 2024-09-13T21:40:23.394 INFO:tasks.workunit.client.0.smithi088.stdout:7/387: write d6/f22 [539326,69531] 0 2024-09-13T21:40:23.397 INFO:tasks.workunit.client.0.smithi088.stdout:3/452: getdents d5/d23/d2a/d63/d48 0 2024-09-13T21:40:23.405 INFO:tasks.workunit.client.0.smithi088.stdout:5/484: dread d4/f1f [0,4194304] 0 2024-09-13T21:40:23.410 INFO:tasks.workunit.client.0.smithi088.stdout:1/428: getdents d9/d10/d2a 0 2024-09-13T21:40:23.410 INFO:tasks.workunit.client.0.smithi088.stdout:1/429: dread - d9/d10/d2a/f8a zero size 2024-09-13T21:40:23.413 INFO:tasks.workunit.client.0.smithi088.stdout:7/388: dread d6/da/d1a/f21 [0,4194304] 0 2024-09-13T21:40:23.416 INFO:tasks.workunit.client.0.smithi088.stdout:7/389: rename d6/d5f/d69/d77 to d6/d5f/d69/d4f/d6f/d83 0 2024-09-13T21:40:23.418 INFO:tasks.workunit.client.0.smithi088.stdout:3/453: write d5/d14/f2c [2717877,53270] 0 2024-09-13T21:40:23.418 INFO:tasks.workunit.client.0.smithi088.stdout:3/454: stat d5/d23/d2a/d6b/f5d 0 2024-09-13T21:40:23.419 INFO:tasks.workunit.client.0.smithi088.stdout:7/390: unlink d6/d5f/d69/d4f/l3d 0 2024-09-13T21:40:23.419 INFO:tasks.workunit.client.0.smithi088.stdout:1/430: dread d9/d10/d2a/d4b/d61/f70 [0,4194304] 0 2024-09-13T21:40:23.419 INFO:tasks.workunit.client.0.smithi088.stdout:8/397: dwrite db/d26/d4f/f62 [4194304,4194304] 0 2024-09-13T21:40:23.419 INFO:tasks.workunit.client.0.smithi088.stdout:8/398: creat db/df/d61/f8e x:0 0 0 2024-09-13T21:40:23.420 INFO:tasks.workunit.client.0.smithi088.stdout:3/455: mkdir d5/d23/d2a/d6b/d8b 0 2024-09-13T21:40:23.420 INFO:tasks.workunit.client.0.smithi088.stdout:7/391: mknod d6/da/d1a/c84 0 2024-09-13T21:40:23.422 INFO:tasks.workunit.client.0.smithi088.stdout:6/452: dwrite d0/d1e/d1f/f70 [0,4194304] 0 2024-09-13T21:40:23.422 INFO:tasks.workunit.client.0.smithi088.stdout:6/453: fdatasync d0/d2c/d32/d39/d3f/f79 0 2024-09-13T21:40:23.425 INFO:tasks.workunit.client.0.smithi088.stdout:8/399: truncate db/d26/f36 4098325 0 2024-09-13T21:40:23.425 INFO:tasks.workunit.client.0.smithi088.stdout:8/400: fsync db/d26/d2c/f78 0 2024-09-13T21:40:23.427 INFO:tasks.workunit.client.0.smithi088.stdout:4/425: dwrite d2/d5/d20/d41/d4b/f54 [0,4194304] 0 2024-09-13T21:40:23.428 INFO:tasks.workunit.client.0.smithi088.stdout:0/450: dwrite d7/d2c/d30/d31/d42/d95/f9a [0,4194304] 0 2024-09-13T21:40:23.428 INFO:tasks.workunit.client.0.smithi088.stdout:3/456: rename d5/d23/d2a/d63/d48/l85 to d5/d23/d2a/d6b/d8b/l8c 0 2024-09-13T21:40:23.428 INFO:tasks.workunit.client.0.smithi088.stdout:3/457: fdatasync d5/d23/d2a/d63/f2e 0 2024-09-13T21:40:23.428 INFO:tasks.workunit.client.0.smithi088.stdout:2/462: dwrite d1/d13/f2c [0,4194304] 0 2024-09-13T21:40:23.428 INFO:tasks.workunit.client.0.smithi088.stdout:2/463: write d1/d8/d24/d78/d7f/d85/f97 [339944,33348] 0 2024-09-13T21:40:23.430 INFO:tasks.workunit.client.0.smithi088.stdout:7/392: creat d6/d5f/d81/f85 x:0 0 0 2024-09-13T21:40:23.434 INFO:tasks.workunit.client.0.smithi088.stdout:5/485: dwrite d4/d1c/d81/d89/d92/f3b [0,4194304] 0 2024-09-13T21:40:23.443 INFO:tasks.workunit.client.0.smithi088.stdout:1/431: dwrite d9/d10/d2a/d4b/f21 [0,4194304] 0 2024-09-13T21:40:23.444 INFO:tasks.workunit.client.0.smithi088.stdout:1/432: write d9/d10/d2a/d4b/d39/f6c [480668,111221] 0 2024-09-13T21:40:23.444 INFO:tasks.workunit.client.0.smithi088.stdout:1/433: read d9/d10/d2a/d4b/d39/f6c [293607,94761] 0 2024-09-13T21:40:23.444 INFO:tasks.workunit.client.0.smithi088.stdout:1/434: fsync d9/d10/f3f 0 2024-09-13T21:40:23.446 INFO:tasks.workunit.client.0.smithi088.stdout:8/401: link db/f82 db/f8f 0 2024-09-13T21:40:23.447 INFO:tasks.workunit.client.0.smithi088.stdout:8/402: dread db/d26/d2c/f87 [0,4194304] 0 2024-09-13T21:40:23.447 INFO:tasks.workunit.client.0.smithi088.stdout:8/403: read - db/d26/f8d zero size 2024-09-13T21:40:23.451 INFO:tasks.workunit.client.0.smithi088.stdout:4/426: dwrite d2/d5/d20/d41/d4b/f7a [0,4194304] 0 2024-09-13T21:40:23.451 INFO:tasks.workunit.client.0.smithi088.stdout:6/454: dwrite d0/ff [0,4194304] 0 2024-09-13T21:40:23.452 INFO:tasks.workunit.client.0.smithi088.stdout:0/451: mkdir d7/d2c/d78/daf 0 2024-09-13T21:40:23.452 INFO:tasks.workunit.client.0.smithi088.stdout:0/452: write d7/d2c/d30/d31/f62 [1823420,119518] 0 2024-09-13T21:40:23.454 INFO:tasks.workunit.client.0.smithi088.stdout:2/464: getdents d1/d8/d24/d78 0 2024-09-13T21:40:23.455 INFO:tasks.workunit.client.0.smithi088.stdout:2/465: chown d1/d13/d2a/d3c/d4a/d6e/d66 192142937 1 2024-09-13T21:40:23.455 INFO:tasks.workunit.client.0.smithi088.stdout:2/466: chown d1/d13/d3f/c8f 1159745757 1 2024-09-13T21:40:23.455 INFO:tasks.workunit.client.0.smithi088.stdout:2/467: write d1/f77 [108090,52224] 0 2024-09-13T21:40:23.456 INFO:tasks.workunit.client.0.smithi088.stdout:7/393: symlink d6/d5f/d69/d4f/d4c/l86 0 2024-09-13T21:40:23.460 INFO:tasks.workunit.client.0.smithi088.stdout:5/486: rename d4/d1c/c2f to d4/d1c/d81/d89/c9d 0 2024-09-13T21:40:23.463 INFO:tasks.workunit.client.0.smithi088.stdout:8/404: symlink db/df/d25/l90 0 2024-09-13T21:40:23.463 INFO:tasks.workunit.client.0.smithi088.stdout:8/405: creat db/d26/d4f/f91 x:0 0 0 2024-09-13T21:40:23.466 INFO:tasks.workunit.client.0.smithi088.stdout:2/468: read d1/f15 [6346510,122064] 0 2024-09-13T21:40:23.466 INFO:tasks.workunit.client.0.smithi088.stdout:2/469: write d1/d8/d24/f4c [1125133,112225] 0 2024-09-13T21:40:23.468 INFO:tasks.workunit.client.0.smithi088.stdout:6/455: symlink d0/d2c/d32/l88 0 2024-09-13T21:40:23.470 INFO:tasks.workunit.client.0.smithi088.stdout:3/458: truncate d5/d14/f2c 124399 0 2024-09-13T21:40:23.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/427: rename d2/d5/d20/d60/de/d1e/f26 to d2/d5/d20/d60/de/d1e/d31/f91 0 2024-09-13T21:40:23.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/428: truncate d2/d5/d20/d60/de/f58 239428 0 2024-09-13T21:40:23.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/429: write d2/d5/f55 [1016702,130450] 0 2024-09-13T21:40:23.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/430: stat d2/d5/d20/d60/de/f58 0 2024-09-13T21:40:23.475 INFO:tasks.workunit.client.0.smithi088.stdout:5/487: mkdir d4/d1c/d24/d95/d9e 0 2024-09-13T21:40:23.482 INFO:tasks.workunit.client.0.smithi088.stdout:2/470: mknod d1/d8/d16/d40/ca1 0 2024-09-13T21:40:23.483 INFO:tasks.workunit.client.0.smithi088.stdout:3/459: symlink d5/d23/d2a/d55/l8d 0 2024-09-13T21:40:23.485 INFO:tasks.workunit.client.0.smithi088.stdout:5/488: rmdir d4/d1c/d4a 39 2024-09-13T21:40:23.486 INFO:tasks.workunit.client.0.smithi088.stdout:1/435: link d9/dc/l22 d9/dc/l95 0 2024-09-13T21:40:23.487 INFO:tasks.workunit.client.0.smithi088.stdout:8/406: dwrite db/f1a [0,4194304] 0 2024-09-13T21:40:23.488 INFO:tasks.workunit.client.0.smithi088.stdout:2/471: unlink d1/d8/d16/f23 0 2024-09-13T21:40:23.488 INFO:tasks.workunit.client.0.smithi088.stdout:2/472: write d1/d8/d2e/d3b/f8b [1010686,23659] 0 2024-09-13T21:40:23.489 INFO:tasks.workunit.client.0.smithi088.stdout:3/460: rename d5/d23/c58 to d5/d23/d2a/d3f/c8e 0 2024-09-13T21:40:23.491 INFO:tasks.workunit.client.0.smithi088.stdout:7/394: dwrite d6/da/d1a/f56 [0,4194304] 0 2024-09-13T21:40:23.491 INFO:tasks.workunit.client.0.smithi088.stdout:5/489: symlink d4/d1c/d76/l9f 0 2024-09-13T21:40:23.493 INFO:tasks.workunit.client.0.smithi088.stdout:1/436: unlink d9/d10/d2a/d4b/d61/f70 0 2024-09-13T21:40:23.493 INFO:tasks.workunit.client.0.smithi088.stdout:1/437: fsync d9/d10/d2a/d4b/d39/f6c 0 2024-09-13T21:40:23.493 INFO:tasks.workunit.client.0.smithi088.stdout:5/490: dread d4/d1c/d24/d26/f6e [0,4194304] 0 2024-09-13T21:40:23.494 INFO:tasks.workunit.client.0.smithi088.stdout:8/407: rename db/df/l1e to db/df/d25/d88/l92 0 2024-09-13T21:40:23.496 INFO:tasks.workunit.client.0.smithi088.stdout:4/431: dwrite d2/d5/d20/d60/de/d1e/d23/d6c/f34 [0,4194304] 0 2024-09-13T21:40:23.497 INFO:tasks.workunit.client.0.smithi088.stdout:7/395: truncate d6/da/d44/f6d 3642776 0 2024-09-13T21:40:23.497 INFO:tasks.workunit.client.0.smithi088.stdout:7/396: stat d6/da/d1a/f56 0 2024-09-13T21:40:23.499 INFO:tasks.workunit.client.0.smithi088.stdout:6/456: dwrite d0/f6 [0,4194304] 0 2024-09-13T21:40:23.499 INFO:tasks.workunit.client.0.smithi088.stdout:1/438: mknod d9/c96 0 2024-09-13T21:40:23.500 INFO:tasks.workunit.client.0.smithi088.stdout:9/390: sync 2024-09-13T21:40:23.501 INFO:tasks.workunit.client.0.smithi088.stdout:9/391: read d1a/d1b/f66 [1294684,9521] 0 2024-09-13T21:40:23.501 INFO:tasks.workunit.client.0.smithi088.stdout:9/392: write d1a/d1b/d3f/f55 [954950,72745] 0 2024-09-13T21:40:23.501 INFO:tasks.workunit.client.0.smithi088.stdout:9/393: chown d1a/d61/d3d/d41/f46 12512297 1 2024-09-13T21:40:23.502 INFO:tasks.workunit.client.0.smithi088.stdout:8/408: mknod db/d26/d2c/c93 0 2024-09-13T21:40:23.504 INFO:tasks.workunit.client.0.smithi088.stdout:4/432: rmdir d2/d13 39 2024-09-13T21:40:23.507 INFO:tasks.workunit.client.0.smithi088.stdout:7/397: rename d6/da/d44/c54 to d6/da/d1a/c87 0 2024-09-13T21:40:23.508 INFO:tasks.workunit.client.0.smithi088.stdout:3/461: write d5/f13 [3402803,6865] 0 2024-09-13T21:40:23.512 INFO:tasks.workunit.client.0.smithi088.stdout:6/457: mknod d0/d28/c89 0 2024-09-13T21:40:23.512 INFO:tasks.workunit.client.0.smithi088.stdout:6/458: chown d0/l19 146525819 1 2024-09-13T21:40:23.513 INFO:tasks.workunit.client.0.smithi088.stdout:6/459: chown d0/d1e 202 1 2024-09-13T21:40:23.513 INFO:tasks.workunit.client.0.smithi088.stdout:1/439: write d9/d10/f3f [3482023,99342] 0 2024-09-13T21:40:23.513 INFO:tasks.workunit.client.0.smithi088.stdout:9/394: creat d1a/d61/d3d/d41/f77 x:0 0 0 2024-09-13T21:40:23.513 INFO:tasks.workunit.client.0.smithi088.stdout:9/395: getdents d1a/d61/d3d/d75 0 2024-09-13T21:40:23.513 INFO:tasks.workunit.client.0.smithi088.stdout:1/440: write d9/d10/d2a/f8a [58656,123975] 0 2024-09-13T21:40:23.513 INFO:tasks.workunit.client.0.smithi088.stdout:8/409: rmdir db/d26/d2c/d85/d51 39 2024-09-13T21:40:23.513 INFO:tasks.workunit.client.0.smithi088.stdout:8/410: dread - db/d26/f45 zero size 2024-09-13T21:40:23.514 INFO:tasks.workunit.client.0.smithi088.stdout:4/433: mknod d2/d5/d20/d60/de/d1e/d23/d3c/c92 0 2024-09-13T21:40:23.514 INFO:tasks.workunit.client.0.smithi088.stdout:4/434: write d2/d5/d20/d60/de/f58 [1199019,6102] 0 2024-09-13T21:40:23.514 INFO:tasks.workunit.client.0.smithi088.stdout:4/435: creat d2/d5/d20/d7f/f93 x:0 0 0 2024-09-13T21:40:23.514 INFO:tasks.workunit.client.0.smithi088.stdout:2/473: dwrite d1/d8/d2e/d3b/f6f [0,4194304] 0 2024-09-13T21:40:23.514 INFO:tasks.workunit.client.0.smithi088.stdout:2/474: creat d1/d13/d2a/d3c/d4a/fa2 x:0 0 0 2024-09-13T21:40:23.514 INFO:tasks.workunit.client.0.smithi088.stdout:2/475: write d1/d8/d2e/d44/f92 [983973,79977] 0 2024-09-13T21:40:23.515 INFO:tasks.workunit.client.0.smithi088.stdout:5/491: dwrite d4/f13 [0,4194304] 0 2024-09-13T21:40:23.518 INFO:tasks.workunit.client.0.smithi088.stdout:8/411: write f8 [5225166,37449] 0 2024-09-13T21:40:23.524 INFO:tasks.workunit.client.0.smithi088.stdout:2/476: mknod d1/d13/d2a/d41/d48/da0/ca3 0 2024-09-13T21:40:23.524 INFO:tasks.workunit.client.0.smithi088.stdout:2/477: creat d1/fa4 x:0 0 0 2024-09-13T21:40:23.526 INFO:tasks.workunit.client.0.smithi088.stdout:9/396: dread d1a/d61/d3d/f62 [0,4194304] 0 2024-09-13T21:40:23.526 INFO:tasks.workunit.client.0.smithi088.stdout:5/492: mknod d4/d1c/d4a/d63/d6a/d6d/ca0 0 2024-09-13T21:40:23.526 INFO:tasks.workunit.client.0.smithi088.stdout:5/493: write d4/d1c/d24/f59 [1125273,80491] 0 2024-09-13T21:40:23.527 INFO:tasks.workunit.client.0.smithi088.stdout:8/412: mknod db/c94 0 2024-09-13T21:40:23.529 INFO:tasks.workunit.client.0.smithi088.stdout:2/478: mknod d1/d13/d2a/d41/d82/ca5 0 2024-09-13T21:40:23.529 INFO:tasks.workunit.client.0.smithi088.stdout:2/479: dread - d1/d8/d2e/f53 zero size 2024-09-13T21:40:23.530 INFO:tasks.workunit.client.0.smithi088.stdout:3/462: dwrite d5/d23/d2a/d63/f2e [0,4194304] 0 2024-09-13T21:40:23.530 INFO:tasks.workunit.client.0.smithi088.stdout:6/460: dread d0/db/f43 [0,4194304] 0 2024-09-13T21:40:23.530 INFO:tasks.workunit.client.0.smithi088.stdout:7/398: rename d6/da/d1a/c87 to d6/da/d1a/d3a/d5c/c88 0 2024-09-13T21:40:23.530 INFO:tasks.workunit.client.0.smithi088.stdout:7/399: creat d6/da/d1a/f89 x:0 0 0 2024-09-13T21:40:23.531 INFO:tasks.workunit.client.0.smithi088.stdout:9/397: symlink d1a/d1b/l78 0 2024-09-13T21:40:23.532 INFO:tasks.workunit.client.0.smithi088.stdout:9/398: write d1a/f3b [234534,85567] 0 2024-09-13T21:40:23.532 INFO:tasks.workunit.client.0.smithi088.stdout:5/494: mkdir d4/d1c/d24/d26/da1 0 2024-09-13T21:40:23.533 INFO:tasks.workunit.client.0.smithi088.stdout:8/413: unlink db/df/d25/f2e 0 2024-09-13T21:40:23.535 INFO:tasks.workunit.client.0.smithi088.stdout:2/480: rmdir d1/d13/d2a/d3c/d75 0 2024-09-13T21:40:23.535 INFO:tasks.workunit.client.0.smithi088.stdout:2/481: dread - d1/d8/d2e/f53 zero size 2024-09-13T21:40:23.545 INFO:tasks.workunit.client.0.smithi088.stdout:3/463: mkdir d5/d23/d2a/d3f/d8f 0 2024-09-13T21:40:23.545 INFO:tasks.workunit.client.0.smithi088.stdout:3/464: write d5/f16 [4794637,8406] 0 2024-09-13T21:40:23.545 INFO:tasks.workunit.client.0.smithi088.stdout:3/465: chown c4 352712 1 2024-09-13T21:40:23.545 INFO:tasks.workunit.client.0.smithi088.stdout:3/466: truncate d5/d26/f70 579025 0 2024-09-13T21:40:23.545 INFO:tasks.workunit.client.0.smithi088.stdout:3/467: truncate d5/d14/f2c 867474 0 2024-09-13T21:40:23.545 INFO:tasks.workunit.client.0.smithi088.stdout:3/468: chown d5/d23 30 1 2024-09-13T21:40:23.546 INFO:tasks.workunit.client.0.smithi088.stdout:1/441: rename d9/d10/d2a/d4b/l48 to d9/d4f/d64/l97 0 2024-09-13T21:40:23.548 INFO:tasks.workunit.client.0.smithi088.stdout:7/400: creat d6/d5f/d69/f8a x:0 0 0 2024-09-13T21:40:23.549 INFO:tasks.workunit.client.0.smithi088.stdout:7/401: write d6/da/d1a/f30 [435178,38203] 0 2024-09-13T21:40:23.549 INFO:tasks.workunit.client.0.smithi088.stdout:9/399: creat d1a/d3c/d60/f79 x:0 0 0 2024-09-13T21:40:23.550 INFO:tasks.workunit.client.0.smithi088.stdout:5/495: creat d4/d1c/d4a/fa2 x:0 0 0 2024-09-13T21:40:23.551 INFO:tasks.workunit.client.0.smithi088.stdout:8/414: mknod db/d26/d2c/d85/c95 0 2024-09-13T21:40:23.552 INFO:tasks.workunit.client.0.smithi088.stdout:5/496: dread d4/d1c/f5c [0,4194304] 0 2024-09-13T21:40:23.553 INFO:tasks.workunit.client.0.smithi088.stdout:3/469: truncate d5/d23/d2a/f40 2685145 0 2024-09-13T21:40:23.556 INFO:tasks.workunit.client.0.smithi088.stdout:4/436: rename d2/d5/d2d/f40 to d2/d5/d20/d60/de/d1e/d23/f94 0 2024-09-13T21:40:23.556 INFO:tasks.workunit.client.0.smithi088.stdout:4/437: chown d2/d5/d20/d60/de/d1e/d23/f94 27162 1 2024-09-13T21:40:23.556 INFO:tasks.workunit.client.0.smithi088.stdout:4/438: write d2/d5/d20/d7f/f8f [844506,91772] 0 2024-09-13T21:40:23.556 INFO:tasks.workunit.client.0.smithi088.stdout:1/442: symlink d9/d10/d2a/d4b/d39/d43/l98 0 2024-09-13T21:40:23.558 INFO:tasks.workunit.client.0.smithi088.stdout:2/482: symlink d1/d8/d2e/la6 0 2024-09-13T21:40:23.560 INFO:tasks.workunit.client.0.smithi088.stdout:5/497: mkdir d4/d1c/d81/d89/da3 0 2024-09-13T21:40:23.562 INFO:tasks.workunit.client.0.smithi088.stdout:3/470: symlink d5/d23/l90 0 2024-09-13T21:40:23.562 INFO:tasks.workunit.client.0.smithi088.stdout:3/471: write d5/d26/f6e [204843,65330] 0 2024-09-13T21:40:23.563 INFO:tasks.workunit.client.0.smithi088.stdout:6/461: rename d0/c38 to d0/d1e/d1f/c8a 0 2024-09-13T21:40:23.565 INFO:tasks.workunit.client.0.smithi088.stdout:4/439: creat d2/d5/d20/d60/de/f95 x:0 0 0 2024-09-13T21:40:23.565 INFO:tasks.workunit.client.0.smithi088.stdout:2/483: read d1/d8/f19 [4458328,20906] 0 2024-09-13T21:40:23.566 INFO:tasks.workunit.client.0.smithi088.stdout:7/402: mknod d6/c8b 0 2024-09-13T21:40:23.567 INFO:tasks.workunit.client.0.smithi088.stdout:0/453: sync 2024-09-13T21:40:23.569 INFO:tasks.workunit.client.0.smithi088.stdout:3/472: mkdir d5/d23/d2a/d3f/d8f/d91 0 2024-09-13T21:40:23.569 INFO:tasks.workunit.client.0.smithi088.stdout:3/473: readlink d5/l11 0 2024-09-13T21:40:23.570 INFO:tasks.workunit.client.0.smithi088.stdout:8/415: rename db/d26/d2c/d85/f52 to db/df/f96 0 2024-09-13T21:40:23.573 INFO:tasks.workunit.client.0.smithi088.stdout:7/403: truncate d6/d5f/d69/d4f/f41 667175 0 2024-09-13T21:40:23.573 INFO:tasks.workunit.client.0.smithi088.stdout:3/474: dread d5/d23/d2a/d63/d31/f7c [0,4194304] 0 2024-09-13T21:40:23.573 INFO:tasks.workunit.client.0.smithi088.stdout:3/475: chown d5/d23/d2a/d3f/d76 5865710 1 2024-09-13T21:40:23.573 INFO:tasks.workunit.client.0.smithi088.stdout:3/476: readlink d5/l9 0 2024-09-13T21:40:23.576 INFO:tasks.workunit.client.0.smithi088.stdout:0/454: mkdir d7/d2c/d37/db0 0 2024-09-13T21:40:23.576 INFO:tasks.workunit.client.0.smithi088.stdout:0/455: write d7/d2c/d30/d31/f62 [876554,45763] 0 2024-09-13T21:40:23.576 INFO:tasks.workunit.client.0.smithi088.stdout:0/456: truncate d7/d1d/d26/d45/d7c/f94 1036359 0 2024-09-13T21:40:23.576 INFO:tasks.workunit.client.0.smithi088.stdout:6/462: write d0/db/f10 [3970857,2468] 0 2024-09-13T21:40:23.576 INFO:tasks.workunit.client.0.smithi088.stdout:9/400: dwrite d1a/d3c/d51/d5e/f63 [0,4194304] 0 2024-09-13T21:40:23.578 INFO:tasks.workunit.client.0.smithi088.stdout:4/440: rename d2/d5/d20/d7f/c87 to d2/d5/d20/d60/de/d1e/c96 0 2024-09-13T21:40:23.578 INFO:tasks.workunit.client.0.smithi088.stdout:4/441: chown d2/d5/l6b 0 1 2024-09-13T21:40:23.580 INFO:tasks.workunit.client.0.smithi088.stdout:3/477: mkdir d5/d5a/d92 0 2024-09-13T21:40:23.583 INFO:tasks.workunit.client.0.smithi088.stdout:0/457: unlink l2 0 2024-09-13T21:40:23.586 INFO:tasks.workunit.client.0.smithi088.stdout:6/463: unlink d0/ff 0 2024-09-13T21:40:23.587 INFO:tasks.workunit.client.0.smithi088.stdout:1/443: dwrite d9/d10/f17 [0,4194304] 0 2024-09-13T21:40:23.587 INFO:tasks.workunit.client.0.smithi088.stdout:1/444: chown d9/d10/d2a/l57 2026801148 1 2024-09-13T21:40:23.587 INFO:tasks.workunit.client.0.smithi088.stdout:1/445: readlink d9/dc/l34 0 2024-09-13T21:40:23.588 INFO:tasks.workunit.client.0.smithi088.stdout:1/446: fsync d9/dc/f35 0 2024-09-13T21:40:23.588 INFO:tasks.workunit.client.0.smithi088.stdout:5/498: dwrite d4/d1c/d81/d89/d92/f93 [0,4194304] 0 2024-09-13T21:40:23.590 INFO:tasks.workunit.client.0.smithi088.stdout:9/401: rename d1a/d1b/d3f/f4a to d1a/d3c/d51/d5e/f7a 0 2024-09-13T21:40:23.591 INFO:tasks.workunit.client.0.smithi088.stdout:4/442: creat d2/d5/d20/d60/f97 x:0 0 0 2024-09-13T21:40:23.593 INFO:tasks.workunit.client.0.smithi088.stdout:8/416: truncate db/d26/d2c/d85/d51/f7c 6744330 0 2024-09-13T21:40:23.593 INFO:tasks.workunit.client.0.smithi088.stdout:8/417: chown db/df/l44 1203921782 1 2024-09-13T21:40:23.593 INFO:tasks.workunit.client.0.smithi088.stdout:3/478: dwrite d5/d23/d2a/d3f/f7d [0,4194304] 0 2024-09-13T21:40:23.595 INFO:tasks.workunit.client.0.smithi088.stdout:6/464: mkdir d0/d2c/d8b 0 2024-09-13T21:40:23.595 INFO:tasks.workunit.client.0.smithi088.stdout:6/465: write d0/db/f60 [7752,123115] 0 2024-09-13T21:40:23.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:23 smithi116 ceph-mon[33391]: pgmap v251: 65 pgs: 65 active+clean; 624 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 48 MiB/s rd, 65 MiB/s wr, 670 op/s 2024-09-13T21:40:23.596 INFO:tasks.workunit.client.0.smithi088.stdout:1/447: unlink d9/dc/f35 0 2024-09-13T21:40:23.596 INFO:tasks.workunit.client.0.smithi088.stdout:1/448: dread - d9/d4f/f62 zero size 2024-09-13T21:40:23.601 INFO:tasks.workunit.client.0.smithi088.stdout:5/499: symlink d4/d1c/d24/d95/d9e/la4 0 2024-09-13T21:40:23.604 INFO:tasks.workunit.client.0.smithi088.stdout:7/404: write d6/d5f/d69/d4f/f41 [1496936,116554] 0 2024-09-13T21:40:23.612 INFO:tasks.workunit.client.0.smithi088.stdout:4/443: mkdir d2/d5/d20/d41/d4b/d98 0 2024-09-13T21:40:23.612 INFO:tasks.workunit.client.0.smithi088.stdout:3/479: dwrite d5/d23/d2a/d55/f7b [0,4194304] 0 2024-09-13T21:40:23.612 INFO:tasks.workunit.client.0.smithi088.stdout:4/444: write d2/d5/d20/d60/f97 [926712,108073] 0 2024-09-13T21:40:23.614 INFO:tasks.workunit.client.0.smithi088.stdout:8/418: mkdir db/df/d61/d97 0 2024-09-13T21:40:23.619 INFO:tasks.workunit.client.0.smithi088.stdout:1/449: mknod d9/d10/d2a/d47/c99 0 2024-09-13T21:40:23.619 INFO:tasks.workunit.client.0.smithi088.stdout:1/450: creat d9/d10/d2a/d4b/d61/f9a x:0 0 0 2024-09-13T21:40:23.619 INFO:tasks.workunit.client.0.smithi088.stdout:7/405: dwrite d6/da/d44/f6d [0,4194304] 0 2024-09-13T21:40:23.620 INFO:tasks.workunit.client.0.smithi088.stdout:5/500: truncate d4/d1c/f42 3626093 0 2024-09-13T21:40:23.620 INFO:tasks.workunit.client.0.smithi088.stdout:5/501: read d4/d1c/d24/f39 [1316725,103236] 0 2024-09-13T21:40:23.626 INFO:tasks.workunit.client.0.smithi088.stdout:9/402: rmdir d1a 39 2024-09-13T21:40:23.627 INFO:tasks.workunit.client.0.smithi088.stdout:7/406: dread d6/f53 [0,4194304] 0 2024-09-13T21:40:23.629 INFO:tasks.workunit.client.0.smithi088.stdout:3/480: mknod d5/d23/d2a/d3f/d76/d81/c93 0 2024-09-13T21:40:23.630 INFO:tasks.workunit.client.0.smithi088.stdout:3/481: write d5/d23/d2a/d3f/d76/f77 [444095,51770] 0 2024-09-13T21:40:23.630 INFO:tasks.workunit.client.0.smithi088.stdout:3/482: fsync d5/d14/f54 0 2024-09-13T21:40:23.630 INFO:tasks.workunit.client.0.smithi088.stdout:3/483: write d5/d23/d2a/d6b/f5d [450787,57780] 0 2024-09-13T21:40:23.631 INFO:tasks.workunit.client.0.smithi088.stdout:4/445: rename d2/d5/d20/d60/de/d1e/d23/d3c/d90 to d2/d5/d20/d60/de/d1e/d31/d61/d99 0 2024-09-13T21:40:23.631 INFO:tasks.workunit.client.0.smithi088.stdout:4/446: fdatasync d2/d5/d20/d60/f2a 0 2024-09-13T21:40:23.631 INFO:tasks.workunit.client.0.smithi088.stdout:8/419: mknod db/df/c98 0 2024-09-13T21:40:23.633 INFO:tasks.workunit.client.0.smithi088.stdout:6/466: truncate d0/db/f10 3416824 0 2024-09-13T21:40:23.640 INFO:tasks.workunit.client.0.smithi088.stdout:1/451: creat d9/d10/d41/f9b x:0 0 0 2024-09-13T21:40:23.642 INFO:tasks.workunit.client.0.smithi088.stdout:5/502: mknod d4/d1c/d4a/d63/d6a/d6d/ca5 0 2024-09-13T21:40:23.645 INFO:tasks.workunit.client.0.smithi088.stdout:7/407: creat d6/d5f/d7a/f8c x:0 0 0 2024-09-13T21:40:23.645 INFO:tasks.workunit.client.0.smithi088.stdout:7/408: readlink d6/l2a 0 2024-09-13T21:40:23.646 INFO:tasks.workunit.client.0.smithi088.stdout:9/403: dwrite d1a/d1b/f28 [0,4194304] 0 2024-09-13T21:40:23.647 INFO:tasks.workunit.client.0.smithi088.stdout:3/484: symlink d5/d5a/d7f/l94 0 2024-09-13T21:40:23.650 INFO:tasks.workunit.client.0.smithi088.stdout:1/452: dread d9/d10/f3f [0,4194304] 0 2024-09-13T21:40:23.653 INFO:tasks.workunit.client.0.smithi088.stdout:5/503: dread d4/d1c/f45 [0,4194304] 0 2024-09-13T21:40:23.654 INFO:tasks.workunit.client.0.smithi088.stdout:5/504: fsync d4/d1c/d4a/d63/d6a/f6b 0 2024-09-13T21:40:23.654 INFO:tasks.workunit.client.0.smithi088.stdout:5/505: readlink d4/l3a 0 2024-09-13T21:40:23.654 INFO:tasks.workunit.client.0.smithi088.stdout:5/506: write d4/d1c/d81/d89/d92/f2d [340785,31072] 0 2024-09-13T21:40:23.654 INFO:tasks.workunit.client.0.smithi088.stdout:5/507: write d4/d1c/d81/d89/d92/f61 [703720,60020] 0 2024-09-13T21:40:23.654 INFO:tasks.workunit.client.0.smithi088.stdout:5/508: chown d4/d1c/d24/f41 436319051 1 2024-09-13T21:40:23.655 INFO:tasks.workunit.client.0.smithi088.stdout:7/409: creat d6/f8d x:0 0 0 2024-09-13T21:40:23.655 INFO:tasks.workunit.client.0.smithi088.stdout:7/410: write d6/f22 [1956717,92860] 0 2024-09-13T21:40:23.661 INFO:tasks.workunit.client.0.smithi088.stdout:4/447: getdents d2/d5 0 2024-09-13T21:40:23.662 INFO:tasks.workunit.client.0.smithi088.stdout:1/453: mkdir d9/d10/d2a/d47/d9c 0 2024-09-13T21:40:23.663 INFO:tasks.workunit.client.0.smithi088.stdout:6/467: mknod d0/d2c/d83/c8c 0 2024-09-13T21:40:23.665 INFO:tasks.workunit.client.0.smithi088.stdout:5/509: mkdir d4/d1c/d24/d95/da6 0 2024-09-13T21:40:23.667 INFO:tasks.workunit.client.0.smithi088.stdout:9/404: symlink d1a/d61/d3d/l7b 0 2024-09-13T21:40:23.667 INFO:tasks.workunit.client.0.smithi088.stdout:3/485: dwrite d5/d23/d2a/d63/d31/f4e [0,4194304] 0 2024-09-13T21:40:23.671 INFO:tasks.workunit.client.0.smithi088.stdout:1/454: unlink d9/d10/d2a/d4b/d39/f6c 0 2024-09-13T21:40:23.671 INFO:tasks.workunit.client.0.smithi088.stdout:4/448: dread d2/f15 [0,4194304] 0 2024-09-13T21:40:23.674 INFO:tasks.workunit.client.0.smithi088.stdout:6/468: fsync d0/d28/f40 0 2024-09-13T21:40:23.678 INFO:tasks.workunit.client.0.smithi088.stdout:3/486: symlink d5/d5a/l95 0 2024-09-13T21:40:23.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/449: rename d2/d5/d20/d60/de/d1e/d23/d6f/f3f to d2/d5/d20/d60/de/d1e/d23/f9a 0 2024-09-13T21:40:23.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/450: chown d2/d13/l1f 86545 1 2024-09-13T21:40:23.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/451: fsync d2/d5/d20/d60/f2a 0 2024-09-13T21:40:23.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/452: getdents d2/d5/d20/d41/d4b/d98 0 2024-09-13T21:40:23.684 INFO:tasks.workunit.client.0.smithi088.stdout:4/453: fsync d2/d13/f86 0 2024-09-13T21:40:23.685 INFO:tasks.workunit.client.0.smithi088.stdout:5/510: dread d4/d1c/d24/f39 [0,4194304] 0 2024-09-13T21:40:23.685 INFO:tasks.workunit.client.0.smithi088.stdout:5/511: dread - d4/d1c/d24/d26/d40/f49 zero size 2024-09-13T21:40:23.687 INFO:tasks.workunit.client.0.smithi088.stdout:5/512: mkdir d4/da7 0 2024-09-13T21:40:23.688 INFO:tasks.workunit.client.0.smithi088.stdout:6/469: getdents d0/d1e/d1f/d55 0 2024-09-13T21:40:23.689 INFO:tasks.workunit.client.0.smithi088.stdout:5/513: rename d4/d1c/d4a/f72 to d4/d1c/d76/fa8 0 2024-09-13T21:40:23.689 INFO:tasks.workunit.client.0.smithi088.stdout:5/514: write d4/d1b/f54 [580865,111519] 0 2024-09-13T21:40:23.690 INFO:tasks.workunit.client.0.smithi088.stdout:5/515: fdatasync d4/d1c/d24/d26/d40/f11 0 2024-09-13T21:40:23.690 INFO:tasks.workunit.client.0.smithi088.stdout:6/470: mknod d0/d2c/d8b/c8d 0 2024-09-13T21:40:23.690 INFO:tasks.workunit.client.0.smithi088.stdout:5/516: mknod d4/d1c/d24/d26/d4b/d67/ca9 0 2024-09-13T21:40:23.691 INFO:tasks.workunit.client.0.smithi088.stdout:5/517: truncate d4/d1c/d24/d26/d56/f91 754543 0 2024-09-13T21:40:23.691 INFO:tasks.workunit.client.0.smithi088.stdout:6/471: symlink d0/d2c/d59/l8e 0 2024-09-13T21:40:23.692 INFO:tasks.workunit.client.0.smithi088.stdout:5/518: symlink d4/d1c/d24/d26/laa 0 2024-09-13T21:40:23.692 INFO:tasks.workunit.client.0.smithi088.stdout:5/519: readlink d4/l23 0 2024-09-13T21:40:23.692 INFO:tasks.workunit.client.0.smithi088.stdout:6/472: mkdir d0/d1e/d1f/d55/d8f 0 2024-09-13T21:40:23.693 INFO:tasks.workunit.client.0.smithi088.stdout:5/520: mknod d4/d1c/d24/d26/d40/cab 0 2024-09-13T21:40:23.694 INFO:tasks.workunit.client.0.smithi088.stdout:6/473: creat d0/d1e/d1f/f90 x:0 0 0 2024-09-13T21:40:23.704 INFO:tasks.workunit.client.0.smithi088.stdout:8/420: dwrite db/d26/d2c/d85/d51/f7c [4194304,4194304] 0 2024-09-13T21:40:23.704 INFO:tasks.workunit.client.0.smithi088.stdout:8/421: dread - db/f8f zero size 2024-09-13T21:40:23.706 INFO:tasks.workunit.client.0.smithi088.stdout:9/405: dwrite d1a/d1b/f2e [0,4194304] 0 2024-09-13T21:40:23.706 INFO:tasks.workunit.client.0.smithi088.stdout:9/406: stat d1a/d1b/d3f/f55 0 2024-09-13T21:40:23.706 INFO:tasks.workunit.client.0.smithi088.stdout:8/422: creat db/d26/d2c/d85/d51/f99 x:0 0 0 2024-09-13T21:40:23.706 INFO:tasks.workunit.client.0.smithi088.stdout:1/455: dwrite d9/d10/d2a/d4b/d33/f84 [0,4194304] 0 2024-09-13T21:40:23.707 INFO:tasks.workunit.client.0.smithi088.stdout:3/487: dwrite d5/d14/f82 [0,4194304] 0 2024-09-13T21:40:23.707 INFO:tasks.workunit.client.0.smithi088.stdout:3/488: fsync d5/d23/d2a/d3f/d76/f77 0 2024-09-13T21:40:23.707 INFO:tasks.workunit.client.0.smithi088.stdout:9/407: truncate f10 3522578 0 2024-09-13T21:40:23.707 INFO:tasks.workunit.client.0.smithi088.stdout:9/408: fsync d1a/f49 0 2024-09-13T21:40:23.709 INFO:tasks.workunit.client.0.smithi088.stdout:8/423: symlink db/df/d25/l9a 0 2024-09-13T21:40:23.709 INFO:tasks.workunit.client.0.smithi088.stdout:8/424: fdatasync db/d26/d4f/f66 0 2024-09-13T21:40:23.709 INFO:tasks.workunit.client.0.smithi088.stdout:8/425: chown db/d26/d2c/f87 2283 1 2024-09-13T21:40:23.712 INFO:tasks.workunit.client.0.smithi088.stdout:1/456: mknod d9/d10/d2a/d4b/d39/c9d 0 2024-09-13T21:40:23.715 INFO:tasks.workunit.client.0.smithi088.stdout:6/474: dwrite d0/f22 [8388608,4194304] 0 2024-09-13T21:40:23.716 INFO:tasks.workunit.client.0.smithi088.stdout:6/475: fdatasync d0/d1e/d1f/f51 0 2024-09-13T21:40:23.716 INFO:tasks.workunit.client.0.smithi088.stdout:6/476: write d0/d28/f40 [2007965,111925] 0 2024-09-13T21:40:23.716 INFO:tasks.workunit.client.0.smithi088.stdout:6/477: write d0/f22 [1918443,89836] 0 2024-09-13T21:40:23.716 INFO:tasks.workunit.client.0.smithi088.stdout:6/478: truncate d0/d1e/f4c 771300 0 2024-09-13T21:40:23.716 INFO:tasks.workunit.client.0.smithi088.stdout:6/479: creat d0/d1e/d1f/f91 x:0 0 0 2024-09-13T21:40:23.716 INFO:tasks.workunit.client.0.smithi088.stdout:9/409: write d1a/d1b/f53 [1263556,25864] 0 2024-09-13T21:40:23.718 INFO:tasks.workunit.client.0.smithi088.stdout:8/426: dread db/d26/f5f [0,4194304] 0 2024-09-13T21:40:23.718 INFO:tasks.workunit.client.0.smithi088.stdout:8/427: read db/d26/d4f/f7e [3324376,63299] 0 2024-09-13T21:40:23.718 INFO:tasks.workunit.client.0.smithi088.stdout:3/489: creat d5/d5a/d92/f96 x:0 0 0 2024-09-13T21:40:23.719 INFO:tasks.workunit.client.0.smithi088.stdout:3/490: creat d5/d23/d2a/d63/f97 x:0 0 0 2024-09-13T21:40:23.719 INFO:tasks.workunit.client.0.smithi088.stdout:3/491: write d5/d5a/d92/f96 [355165,40658] 0 2024-09-13T21:40:23.719 INFO:tasks.workunit.client.0.smithi088.stdout:3/492: dread - d5/d23/d2a/d63/f44 zero size 2024-09-13T21:40:23.720 INFO:tasks.workunit.client.0.smithi088.stdout:1/457: symlink d9/d10/d2a/d4b/d3a/l9e 0 2024-09-13T21:40:23.720 INFO:tasks.workunit.client.0.smithi088.stdout:1/458: write d9/dc/f71 [896592,16474] 0 2024-09-13T21:40:23.721 INFO:tasks.workunit.client.0.smithi088.stdout:5/521: getdents d4/d1c/d24/d26/d40 0 2024-09-13T21:40:23.724 INFO:tasks.workunit.client.0.smithi088.stdout:6/480: symlink d0/d1e/l92 0 2024-09-13T21:40:23.728 INFO:tasks.workunit.client.0.smithi088.stdout:3/493: mkdir d5/d23/d2a/d6b/d98 0 2024-09-13T21:40:23.728 INFO:tasks.workunit.client.0.smithi088.stdout:5/522: dread d4/d1c/f48 [0,4194304] 0 2024-09-13T21:40:23.728 INFO:tasks.workunit.client.0.smithi088.stdout:5/523: creat d4/d1c/d24/fac x:0 0 0 2024-09-13T21:40:23.728 INFO:tasks.workunit.client.0.smithi088.stdout:5/524: chown d4/d1c/d24/d26/d40/d90 17838 1 2024-09-13T21:40:23.729 INFO:tasks.workunit.client.0.smithi088.stdout:6/481: dread d0/d1e/d1f/f7b [0,4194304] 0 2024-09-13T21:40:23.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/459: truncate d9/d10/d2a/d4b/f23 453153 0 2024-09-13T21:40:23.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:23 smithi088 ceph-mon[27963]: pgmap v251: 65 pgs: 65 active+clean; 624 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 48 MiB/s rd, 65 MiB/s wr, 670 op/s 2024-09-13T21:40:23.732 INFO:tasks.workunit.client.0.smithi088.stdout:3/494: creat d5/d23/d2a/d63/d48/f99 x:0 0 0 2024-09-13T21:40:23.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/495: write d5/f6 [557124,74645] 0 2024-09-13T21:40:23.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/496: dread - d5/d23/d2a/d6b/f89 zero size 2024-09-13T21:40:23.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/497: write f1 [86438,26898] 0 2024-09-13T21:40:23.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/498: chown d5/d23/d2a/d63/d48/d49/f53 5 1 2024-09-13T21:40:23.735 INFO:tasks.workunit.client.0.smithi088.stdout:3/499: fdatasync d5/d5a/d92/f96 0 2024-09-13T21:40:23.735 INFO:tasks.workunit.client.0.smithi088.stdout:3/500: write d5/d23/d2a/d63/d48/d49/f53 [1916323,104670] 0 2024-09-13T21:40:23.735 INFO:tasks.workunit.client.0.smithi088.stdout:3/501: truncate d5/d23/d2a/f51 707674 0 2024-09-13T21:40:23.736 INFO:tasks.workunit.client.0.smithi088.stdout:8/428: dwrite db/df/d25/f28 [0,4194304] 0 2024-09-13T21:40:23.737 INFO:tasks.workunit.client.0.smithi088.stdout:1/460: unlink d9/d10/d2a/d4b/d33/c36 0 2024-09-13T21:40:23.737 INFO:tasks.workunit.client.0.smithi088.stdout:5/525: write d4/d1c/d24/f41 [141001,78564] 0 2024-09-13T21:40:23.737 INFO:tasks.workunit.client.0.smithi088.stdout:5/526: readlink d4/d1c/d24/d26/d56/l9a 0 2024-09-13T21:40:23.740 INFO:tasks.workunit.client.0.smithi088.stdout:8/429: dread f8 [4194304,4194304] 0 2024-09-13T21:40:23.740 INFO:tasks.workunit.client.0.smithi088.stdout:6/482: link d0/le d0/d28/l93 0 2024-09-13T21:40:23.743 INFO:tasks.workunit.client.0.smithi088.stdout:3/502: link d5/d23/f3c d5/d23/d2a/d63/d48/f9a 0 2024-09-13T21:40:23.744 INFO:tasks.workunit.client.0.smithi088.stdout:3/503: write d5/d5a/d92/f96 [281216,67190] 0 2024-09-13T21:40:23.753 INFO:tasks.workunit.client.0.smithi088.stdout:8/430: truncate f8 822641 0 2024-09-13T21:40:23.753 INFO:tasks.workunit.client.0.smithi088.stdout:8/431: truncate db/d26/f8d 566581 0 2024-09-13T21:40:23.755 INFO:tasks.workunit.client.0.smithi088.stdout:8/432: truncate db/d26/d2c/d85/d51/f7c 1958186 0 2024-09-13T21:40:23.755 INFO:tasks.workunit.client.0.smithi088.stdout:8/433: truncate db/d26/d2c/f4c 1743526 0 2024-09-13T21:40:23.755 INFO:tasks.workunit.client.0.smithi088.stdout:8/434: creat db/f9b x:0 0 0 2024-09-13T21:40:23.755 INFO:tasks.workunit.client.0.smithi088.stdout:8/435: write db/f6b [503725,121675] 0 2024-09-13T21:40:23.757 INFO:tasks.workunit.client.0.smithi088.stdout:2/484: sync 2024-09-13T21:40:23.757 INFO:tasks.workunit.client.0.smithi088.stdout:2/485: chown d1/d13/d2a/d41/c6c 954467 1 2024-09-13T21:40:23.758 INFO:tasks.workunit.client.0.smithi088.stdout:8/436: mknod db/df/d61/c9c 0 2024-09-13T21:40:23.759 INFO:tasks.workunit.client.0.smithi088.stdout:8/437: fdatasync db/df/d25/f56 0 2024-09-13T21:40:23.760 INFO:tasks.workunit.client.0.smithi088.stdout:2/486: symlink d1/d8/d2e/d44/la7 0 2024-09-13T21:40:23.760 INFO:tasks.workunit.client.0.smithi088.stdout:2/487: chown d1/d8/d24/d78/d7f 12930 1 2024-09-13T21:40:23.762 INFO:tasks.workunit.client.0.smithi088.stdout:2/488: rmdir d1/d8/d2e/d44/d90 0 2024-09-13T21:40:23.762 INFO:tasks.workunit.client.0.smithi088.stdout:2/489: write d1/d8/d2e/d3b/f6f [4535766,33817] 0 2024-09-13T21:40:23.764 INFO:tasks.workunit.client.0.smithi088.stdout:2/490: creat d1/d8/fa8 x:0 0 0 2024-09-13T21:40:23.764 INFO:tasks.workunit.client.0.smithi088.stdout:2/491: truncate d1/d13/d2a/f65 1008934 0 2024-09-13T21:40:23.780 INFO:tasks.workunit.client.0.smithi088.stdout:3/504: dwrite d5/d26/d43/f83 [0,4194304] 0 2024-09-13T21:40:23.780 INFO:tasks.workunit.client.0.smithi088.stdout:1/461: dwrite d9/f60 [0,4194304] 0 2024-09-13T21:40:23.780 INFO:tasks.workunit.client.0.smithi088.stdout:8/438: dwrite db/d26/d2c/d85/f89 [0,4194304] 0 2024-09-13T21:40:23.780 INFO:tasks.workunit.client.0.smithi088.stdout:8/439: dread - db/df/d61/f8e zero size 2024-09-13T21:40:23.780 INFO:tasks.workunit.client.0.smithi088.stdout:8/440: creat db/f9d x:0 0 0 2024-09-13T21:40:23.781 INFO:tasks.workunit.client.0.smithi088.stdout:6/483: dwrite d0/d28/f80 [0,4194304] 0 2024-09-13T21:40:23.781 INFO:tasks.workunit.client.0.smithi088.stdout:6/484: write d0/d1e/d1f/f51 [1309200,94838] 0 2024-09-13T21:40:23.783 INFO:tasks.workunit.client.0.smithi088.stdout:6/485: dread d0/d2c/d32/d39/d3f/f5c [0,4194304] 0 2024-09-13T21:40:23.801 INFO:tasks.workunit.client.0.smithi088.stdout:2/492: creat d1/d13/d2a/d41/d48/da0/fa9 x:0 0 0 2024-09-13T21:40:23.802 INFO:tasks.workunit.client.0.smithi088.stdout:2/493: dread d1/d8/d24/f25 [0,4194304] 0 2024-09-13T21:40:23.802 INFO:tasks.workunit.client.0.smithi088.stdout:2/494: readlink d1/l31 0 2024-09-13T21:40:23.804 INFO:tasks.workunit.client.0.smithi088.stdout:2/495: dread d1/f77 [0,4194304] 0 2024-09-13T21:40:23.804 INFO:tasks.workunit.client.0.smithi088.stdout:2/496: fdatasync d1/f4 0 2024-09-13T21:40:23.804 INFO:tasks.workunit.client.0.smithi088.stdout:2/497: readlink d1/d8/d2e/d44/l50 0 2024-09-13T21:40:23.804 INFO:tasks.workunit.client.0.smithi088.stdout:0/458: sync 2024-09-13T21:40:23.807 INFO:tasks.workunit.client.0.smithi088.stdout:3/505: symlink d5/d23/d2a/d63/d48/d49/l9b 0 2024-09-13T21:40:23.811 INFO:tasks.workunit.client.0.smithi088.stdout:0/459: dread d7/d1d/d26/d34/f4f [0,4194304] 0 2024-09-13T21:40:23.818 INFO:tasks.workunit.client.0.smithi088.stdout:1/462: mkdir d9/d10/d9f 0 2024-09-13T21:40:23.825 INFO:tasks.workunit.client.0.smithi088.stdout:8/441: link db/d26/d37/f46 db/d26/d4f/f9e 0 2024-09-13T21:40:23.825 INFO:tasks.workunit.client.0.smithi088.stdout:8/442: chown db/df/d25/c57 36170322 1 2024-09-13T21:40:23.829 INFO:tasks.workunit.client.0.smithi088.stdout:2/498: dwrite d1/d8/d24/f25 [0,4194304] 0 2024-09-13T21:40:23.829 INFO:tasks.workunit.client.0.smithi088.stdout:2/499: read d1/d8/d16/d40/f67 [654049,102573] 0 2024-09-13T21:40:23.832 INFO:tasks.workunit.client.0.smithi088.stdout:2/500: dread d1/d8/d24/f72 [0,4194304] 0 2024-09-13T21:40:23.840 INFO:tasks.workunit.client.0.smithi088.stdout:6/486: dread d0/db/f10 [0,4194304] 0 2024-09-13T21:40:23.850 INFO:tasks.workunit.client.0.smithi088.stdout:2/501: dwrite d1/d13/d2a/d41/d48/da0/fa9 [0,4194304] 0 2024-09-13T21:40:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:3/506: mkdir d5/d23/d2a/d63/d9c 0 2024-09-13T21:40:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:0/460: symlink d7/d1d/d66/d8b/lb1 0 2024-09-13T21:40:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:1/463: symlink d9/d10/d2a/d4b/d33/d92/d8e/la0 0 2024-09-13T21:40:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:0/461: dread d7/f12 [0,4194304] 0 2024-09-13T21:40:23.880 INFO:tasks.workunit.client.0.smithi088.stdout:6/487: mknod d0/d2c/d7f/c94 0 2024-09-13T21:40:23.883 INFO:tasks.workunit.client.0.smithi088.stdout:2/502: mkdir d1/d8/d16/d40/d7e/daa 0 2024-09-13T21:40:23.883 INFO:tasks.workunit.client.0.smithi088.stdout:2/503: truncate d1/d8/d24/f39 1692310 0 2024-09-13T21:40:23.883 INFO:tasks.workunit.client.0.smithi088.stdout:2/504: write d1/d8/d16/f98 [98036,128613] 0 2024-09-13T21:40:23.884 INFO:tasks.workunit.client.0.smithi088.stdout:2/505: stat d1/d13/d2a/d41/d48/f83 0 2024-09-13T21:40:23.884 INFO:tasks.workunit.client.0.smithi088.stdout:3/507: unlink d5/d23/d2a/d6b/f86 0 2024-09-13T21:40:23.884 INFO:tasks.workunit.client.0.smithi088.stdout:3/508: readlink d5/l11 0 2024-09-13T21:40:23.885 INFO:tasks.workunit.client.0.smithi088.stdout:3/509: write d5/d23/d2a/d6b/f5d [358214,26895] 0 2024-09-13T21:40:23.885 INFO:tasks.workunit.client.0.smithi088.stdout:3/510: write d5/d23/d2a/d63/d48/f99 [590359,23657] 0 2024-09-13T21:40:23.885 INFO:tasks.workunit.client.0.smithi088.stdout:1/464: creat d9/d10/d2a/fa1 x:0 0 0 2024-09-13T21:40:23.886 INFO:tasks.workunit.client.0.smithi088.stdout:0/462: rmdir d7/d2c/d37/db0 0 2024-09-13T21:40:23.887 INFO:tasks.workunit.client.0.smithi088.stdout:1/465: dread d9/d10/d2a/d4b/d61/f6a [0,4194304] 0 2024-09-13T21:40:23.887 INFO:tasks.workunit.client.0.smithi088.stdout:1/466: chown d9/d10 440617791 1 2024-09-13T21:40:23.888 INFO:tasks.workunit.client.0.smithi088.stdout:6/488: rename d0/d2c/d32/d39/d3f/f5c to d0/d2c/d32/d39/f95 0 2024-09-13T21:40:23.889 INFO:tasks.workunit.client.0.smithi088.stdout:2/506: mknod d1/d8/d16/d40/cab 0 2024-09-13T21:40:23.890 INFO:tasks.workunit.client.0.smithi088.stdout:3/511: symlink d5/d23/l9d 0 2024-09-13T21:40:23.890 INFO:tasks.workunit.client.0.smithi088.stdout:3/512: chown d5/d23/l9d 0 1 2024-09-13T21:40:23.891 INFO:tasks.workunit.client.0.smithi088.stdout:6/489: mkdir d0/d1e/d1f/d55/d96 0 2024-09-13T21:40:23.894 INFO:tasks.workunit.client.0.smithi088.stdout:1/467: write d9/d10/d2a/d4b/d33/f76 [1070931,29360] 0 2024-09-13T21:40:23.895 INFO:tasks.workunit.client.0.smithi088.stdout:3/513: mkdir d5/d23/d2a/d6b/d9e 0 2024-09-13T21:40:23.896 INFO:tasks.workunit.client.0.smithi088.stdout:6/490: creat d0/d2c/d32/d39/d3f/d71/f97 x:0 0 0 2024-09-13T21:40:23.896 INFO:tasks.workunit.client.0.smithi088.stdout:0/463: write d7/f19 [531977,63362] 0 2024-09-13T21:40:23.900 INFO:tasks.workunit.client.0.smithi088.stdout:1/468: write d9/d10/f29 [31464,96568] 0 2024-09-13T21:40:23.901 INFO:tasks.workunit.client.0.smithi088.stdout:0/464: truncate d7/d2c/d37/f59 1241729 0 2024-09-13T21:40:23.903 INFO:tasks.workunit.client.0.smithi088.stdout:6/491: rmdir d0/d1e/d1f/d55 39 2024-09-13T21:40:23.904 INFO:tasks.workunit.client.0.smithi088.stdout:6/492: chown d0/d2c/d32/c62 336 1 2024-09-13T21:40:23.904 INFO:tasks.workunit.client.0.smithi088.stdout:6/493: truncate d0/d1e/d1f/f91 592938 0 2024-09-13T21:40:23.904 INFO:tasks.workunit.client.0.smithi088.stdout:6/494: chown d0/d1e/d1f/d55/l5a 9987232 1 2024-09-13T21:40:23.907 INFO:tasks.workunit.client.0.smithi088.stdout:7/411: sync 2024-09-13T21:40:23.907 INFO:tasks.workunit.client.0.smithi088.stdout:4/454: sync 2024-09-13T21:40:23.907 INFO:tasks.workunit.client.0.smithi088.stdout:7/412: truncate d6/da/f19 4745625 0 2024-09-13T21:40:23.914 INFO:tasks.workunit.client.0.smithi088.stdout:1/469: dread d9/d10/d2a/d4b/f21 [0,4194304] 0 2024-09-13T21:40:23.918 INFO:tasks.workunit.client.0.smithi088.stdout:1/470: link d9/d10/d2a/l3e d9/d10/d2a/d47/d9c/la2 0 2024-09-13T21:40:23.918 INFO:tasks.workunit.client.0.smithi088.stdout:1/471: truncate d9/d10/d2a/d4b/d33/f84 4860990 0 2024-09-13T21:40:23.918 INFO:tasks.workunit.client.0.smithi088.stdout:2/507: dwrite d1/fa4 [0,4194304] 0 2024-09-13T21:40:23.926 INFO:tasks.workunit.client.0.smithi088.stdout:1/472: mknod d9/dc/ca3 0 2024-09-13T21:40:23.927 INFO:tasks.workunit.client.0.smithi088.stdout:3/514: dwrite d5/d14/f18 [0,4194304] 0 2024-09-13T21:40:23.930 INFO:tasks.workunit.client.0.smithi088.stdout:1/473: rmdir d9/d10/d2a/d4b/d39/d43/d85 39 2024-09-13T21:40:23.933 INFO:tasks.workunit.client.0.smithi088.stdout:6/495: dwrite d0/d1e/f4c [0,4194304] 0 2024-09-13T21:40:23.933 INFO:tasks.workunit.client.0.smithi088.stdout:0/465: dwrite d7/d1d/d26/d45/d7c/f86 [0,4194304] 0 2024-09-13T21:40:23.940 INFO:tasks.workunit.client.0.smithi088.stdout:2/508: dread d1/d8/d24/f4c [0,4194304] 0 2024-09-13T21:40:23.940 INFO:tasks.workunit.client.0.smithi088.stdout:2/509: chown d1/d8/d2e/d3b/c74 658 1 2024-09-13T21:40:23.940 INFO:tasks.workunit.client.0.smithi088.stdout:2/510: chown d1/d13/d2a/d41/d48/f83 26935 1 2024-09-13T21:40:23.950 INFO:tasks.workunit.client.0.smithi088.stdout:0/466: mknod d7/d2c/d30/cb2 0 2024-09-13T21:40:23.953 INFO:tasks.workunit.client.0.smithi088.stdout:2/511: creat d1/d8/d24/d78/d7f/fac x:0 0 0 2024-09-13T21:40:23.953 INFO:tasks.workunit.client.0.smithi088.stdout:2/512: creat d1/d8/fad x:0 0 0 2024-09-13T21:40:23.953 INFO:tasks.workunit.client.0.smithi088.stdout:2/513: fsync d1/d13/d2a/f2b 0 2024-09-13T21:40:23.960 INFO:tasks.workunit.client.0.smithi088.stdout:2/514: dread d1/d8/d16/f5c [0,4194304] 0 2024-09-13T21:40:23.960 INFO:tasks.workunit.client.0.smithi088.stdout:2/515: chown d1/f34 25996316 1 2024-09-13T21:40:23.961 INFO:tasks.workunit.client.0.smithi088.stdout:2/516: creat d1/d8/d2e/d91/fae x:0 0 0 2024-09-13T21:40:23.962 INFO:tasks.workunit.client.0.smithi088.stdout:7/413: rmdir d6/da 39 2024-09-13T21:40:23.964 INFO:tasks.workunit.client.0.smithi088.stdout:2/517: mknod d1/d8/d2e/caf 0 2024-09-13T21:40:23.965 INFO:tasks.workunit.client.0.smithi088.stdout:2/518: mkdir d1/d13/d2a/d41/d82/db0 0 2024-09-13T21:40:23.970 INFO:tasks.workunit.client.0.smithi088.stdout:8/443: mknod db/c9f 0 2024-09-13T21:40:23.970 INFO:tasks.workunit.client.0.smithi088.stdout:8/444: fsync db/d26/d4f/f68 0 2024-09-13T21:40:23.978 INFO:tasks.workunit.client.0.smithi088.stdout:2/519: write d1/d8/f14 [2105188,730] 0 2024-09-13T21:40:23.979 INFO:tasks.workunit.client.0.smithi088.stdout:5/527: sync 2024-09-13T21:40:23.979 INFO:tasks.workunit.client.0.smithi088.stdout:9/410: sync 2024-09-13T21:40:23.980 INFO:tasks.workunit.client.0.smithi088.stdout:8/445: dread db/d26/d2c/f5d [0,4194304] 0 2024-09-13T21:40:23.980 INFO:tasks.workunit.client.0.smithi088.stdout:8/446: write db/d26/d2c/d85/d51/f99 [727816,12054] 0 2024-09-13T21:40:23.980 INFO:tasks.workunit.client.0.smithi088.stdout:8/447: dread - db/f82 zero size 2024-09-13T21:40:23.981 INFO:tasks.workunit.client.0.smithi088.stdout:2/520: mkdir d1/d13/d3f/d99/d9c/db1 0 2024-09-13T21:40:23.981 INFO:tasks.workunit.client.0.smithi088.stdout:9/411: creat d1a/d3c/d51/d5e/f7c x:0 0 0 2024-09-13T21:40:23.982 INFO:tasks.workunit.client.0.smithi088.stdout:0/467: dwrite d7/f12 [0,4194304] 0 2024-09-13T21:40:23.982 INFO:tasks.workunit.client.0.smithi088.stdout:8/448: symlink db/df/la0 0 2024-09-13T21:40:23.983 INFO:tasks.workunit.client.0.smithi088.stdout:9/412: creat d1a/d61/d3d/f7d x:0 0 0 2024-09-13T21:40:23.985 INFO:tasks.workunit.client.0.smithi088.stdout:2/521: read d1/d8/d16/f5c [1587840,108813] 0 2024-09-13T21:40:23.985 INFO:tasks.workunit.client.0.smithi088.stdout:2/522: fsync d1/d13/d2a/d41/d48/da0/fa9 0 2024-09-13T21:40:23.985 INFO:tasks.workunit.client.0.smithi088.stdout:2/523: stat d1/d8/d2e/d3b/f6f 0 2024-09-13T21:40:23.986 INFO:tasks.workunit.client.0.smithi088.stdout:8/449: getdents db/d26/d2c/d85 0 2024-09-13T21:40:23.988 INFO:tasks.workunit.client.0.smithi088.stdout:9/413: mkdir d1a/d3c/d51/d5e/d7e 0 2024-09-13T21:40:23.990 INFO:tasks.workunit.client.0.smithi088.stdout:2/524: unlink d1/d8/d24/f25 0 2024-09-13T21:40:23.990 INFO:tasks.workunit.client.0.smithi088.stdout:5/528: dread d4/d1c/d24/d26/d40/f11 [0,4194304] 0 2024-09-13T21:40:23.990 INFO:tasks.workunit.client.0.smithi088.stdout:5/529: fdatasync d4/d1c/f42 0 2024-09-13T21:40:23.993 INFO:tasks.workunit.client.0.smithi088.stdout:2/525: symlink d1/d13/d2a/d3c/d4a/d6e/d76/lb2 0 2024-09-13T21:40:23.995 INFO:tasks.workunit.client.0.smithi088.stdout:5/530: rename d4/d1c/d81/d89/d92/c3f to d4/d1c/d81/cad 0 2024-09-13T21:40:23.996 INFO:tasks.workunit.client.0.smithi088.stdout:2/526: mkdir d1/d8/d2e/d91/db3 0 2024-09-13T21:40:23.998 INFO:tasks.workunit.client.0.smithi088.stdout:5/531: creat d4/d1c/d81/fae x:0 0 0 2024-09-13T21:40:23.998 INFO:tasks.workunit.client.0.smithi088.stdout:5/532: creat d4/d1b/faf x:0 0 0 2024-09-13T21:40:24.000 INFO:tasks.workunit.client.0.smithi088.stdout:3/515: dwrite d5/d14/f37 [0,4194304] 0 2024-09-13T21:40:24.000 INFO:tasks.workunit.client.0.smithi088.stdout:2/527: getdents d1/d8/d16 0 2024-09-13T21:40:24.002 INFO:tasks.workunit.client.0.smithi088.stdout:2/528: mkdir d1/d8/d24/db4 0 2024-09-13T21:40:24.002 INFO:tasks.workunit.client.0.smithi088.stdout:2/529: fdatasync d1/d13/d2a/d41/d48/da0/fa9 0 2024-09-13T21:40:24.013 INFO:tasks.workunit.client.0.smithi088.stdout:0/468: dwrite d7/d1d/d66/d8b/fa1 [0,4194304] 0 2024-09-13T21:40:24.016 INFO:tasks.workunit.client.0.smithi088.stdout:0/469: creat d7/d2c/d44/fb3 x:0 0 0 2024-09-13T21:40:24.017 INFO:tasks.workunit.client.0.smithi088.stdout:7/414: dwrite d6/d5f/f7d [0,4194304] 0 2024-09-13T21:40:24.017 INFO:tasks.workunit.client.0.smithi088.stdout:7/415: creat d6/d5f/d7a/f8e x:0 0 0 2024-09-13T21:40:24.017 INFO:tasks.workunit.client.0.smithi088.stdout:0/470: mknod d7/d1d/d66/d8b/cb4 0 2024-09-13T21:40:24.019 INFO:tasks.workunit.client.0.smithi088.stdout:9/414: dwrite f18 [4194304,4194304] 0 2024-09-13T21:40:24.021 INFO:tasks.workunit.client.0.smithi088.stdout:9/415: symlink d1a/d3c/l7f 0 2024-09-13T21:40:24.021 INFO:tasks.workunit.client.0.smithi088.stdout:9/416: read d1a/d3c/d51/d5e/f7a [2075198,71938] 0 2024-09-13T21:40:24.026 INFO:tasks.workunit.client.0.smithi088.stdout:9/417: dread d1a/d1b/f35 [0,4194304] 0 2024-09-13T21:40:24.026 INFO:tasks.workunit.client.0.smithi088.stdout:9/418: dread - d1a/d1b/f5c zero size 2024-09-13T21:40:24.028 INFO:tasks.workunit.client.0.smithi088.stdout:9/419: dread d1a/f3b [0,4194304] 0 2024-09-13T21:40:24.028 INFO:tasks.workunit.client.0.smithi088.stdout:5/533: dwrite d4/d1c/d4a/d8a/f8b [0,4194304] 0 2024-09-13T21:40:24.029 INFO:tasks.workunit.client.0.smithi088.stdout:3/516: dwrite d5/d23/d2a/d63/f2e [0,4194304] 0 2024-09-13T21:40:24.031 INFO:tasks.workunit.client.0.smithi088.stdout:5/534: creat d4/d1c/d24/d26/da1/fb0 x:0 0 0 2024-09-13T21:40:24.034 INFO:tasks.workunit.client.0.smithi088.stdout:3/517: link d5/d23/f3c d5/d23/d2a/d3f/d76/d81/f9f 0 2024-09-13T21:40:24.036 INFO:tasks.workunit.client.0.smithi088.stdout:9/420: rename d1a/d61/d3d/d41/f44 to d1a/f80 0 2024-09-13T21:40:24.036 INFO:tasks.workunit.client.0.smithi088.stdout:0/471: dwrite d7/d2c/d37/f59 [0,4194304] 0 2024-09-13T21:40:24.043 INFO:tasks.workunit.client.0.smithi088.stdout:3/518: rename d5/d23/d2a/d63/f2e to d5/d23/d2a/d3f/fa0 0 2024-09-13T21:40:24.045 INFO:tasks.workunit.client.0.smithi088.stdout:9/421: mkdir d1a/d3c/d51/d81 0 2024-09-13T21:40:24.048 INFO:tasks.workunit.client.0.smithi088.stdout:0/472: symlink d7/d1d/d26/d45/lb5 0 2024-09-13T21:40:24.048 INFO:tasks.workunit.client.0.smithi088.stdout:0/473: write d7/d2c/d30/d31/d42/f74 [1631321,113035] 0 2024-09-13T21:40:24.049 INFO:tasks.workunit.client.0.smithi088.stdout:0/474: write d7/d65/f76 [1787643,120078] 0 2024-09-13T21:40:24.049 INFO:tasks.workunit.client.0.smithi088.stdout:0/475: creat d7/d2c/d30/d31/fb6 x:0 0 0 2024-09-13T21:40:24.049 INFO:tasks.workunit.client.0.smithi088.stdout:5/535: dwrite d4/d1c/f48 [0,4194304] 0 2024-09-13T21:40:24.049 INFO:tasks.workunit.client.0.smithi088.stdout:5/536: write d4/d1c/d24/d26/f82 [1023955,15601] 0 2024-09-13T21:40:24.049 INFO:tasks.workunit.client.0.smithi088.stdout:5/537: write d4/d1c/d24/d26/da1/fb0 [854898,95532] 0 2024-09-13T21:40:24.049 INFO:tasks.workunit.client.0.smithi088.stdout:5/538: dread - d4/d1c/d4a/d8a/f9b zero size 2024-09-13T21:40:24.053 INFO:tasks.workunit.client.0.smithi088.stdout:0/476: creat d7/fb7 x:0 0 0 2024-09-13T21:40:24.056 INFO:tasks.workunit.client.0.smithi088.stdout:5/539: creat d4/da7/fb1 x:0 0 0 2024-09-13T21:40:24.056 INFO:tasks.workunit.client.0.smithi088.stdout:5/540: truncate d4/d1c/d24/fac 621349 0 2024-09-13T21:40:24.059 INFO:tasks.workunit.client.0.smithi088.stdout:9/422: rename f14 to d1a/f82 0 2024-09-13T21:40:24.059 INFO:tasks.workunit.client.0.smithi088.stdout:9/423: chown d1a/d3c/d51/d5e/d72/l76 105 1 2024-09-13T21:40:24.059 INFO:tasks.workunit.client.0.smithi088.stdout:9/424: truncate d1a/d3c/d51/d5e/f63 4730285 0 2024-09-13T21:40:24.060 INFO:tasks.workunit.client.0.smithi088.stdout:0/477: mkdir d7/d1d/d21/d82/db8 0 2024-09-13T21:40:24.060 INFO:tasks.workunit.client.0.smithi088.stdout:3/519: dwrite d5/d23/d2a/d63/f97 [0,4194304] 0 2024-09-13T21:40:24.142 INFO:tasks.workunit.client.0.smithi088.stdout:9/425: unlink d1a/d61/f6d 0 2024-09-13T21:40:24.145 INFO:tasks.workunit.client.0.smithi088.stdout:5/541: dwrite d4/d1b/f43 [0,4194304] 0 2024-09-13T21:40:24.146 INFO:tasks.workunit.client.0.smithi088.stdout:1/474: sync 2024-09-13T21:40:24.146 INFO:tasks.workunit.client.0.smithi088.stdout:4/455: sync 2024-09-13T21:40:24.146 INFO:tasks.workunit.client.0.smithi088.stdout:1/475: stat d9/d10/f7e 0 2024-09-13T21:40:24.146 INFO:tasks.workunit.client.0.smithi088.stdout:0/478: creat d7/d65/d8c/fb9 x:0 0 0 2024-09-13T21:40:24.149 INFO:tasks.workunit.client.0.smithi088.stdout:3/520: mkdir d5/d23/d2a/d6b/d98/da1 0 2024-09-13T21:40:24.154 INFO:tasks.workunit.client.0.smithi088.stdout:4/456: write d2/f45 [4068764,108811] 0 2024-09-13T21:40:24.154 INFO:tasks.workunit.client.0.smithi088.stdout:4/457: read - d2/d5/d20/d60/de/d1e/d23/d69/f7e zero size 2024-09-13T21:40:24.154 INFO:tasks.workunit.client.0.smithi088.stdout:4/458: stat d2/d5/d20/d60/de/d1e/f37 0 2024-09-13T21:40:24.154 INFO:tasks.workunit.client.0.smithi088.stdout:4/459: chown d2/d5/d20/d60/f2a 9611 1 2024-09-13T21:40:24.154 INFO:tasks.workunit.client.0.smithi088.stdout:0/479: dread d7/f23 [0,4194304] 0 2024-09-13T21:40:24.156 INFO:tasks.workunit.client.0.smithi088.stdout:5/542: mkdir d4/d1c/d24/d26/d4b/d67/db2 0 2024-09-13T21:40:24.158 INFO:tasks.workunit.client.0.smithi088.stdout:4/460: mknod d2/d5/d20/d60/de/d1e/d31/d61/d99/c9b 0 2024-09-13T21:40:24.159 INFO:tasks.workunit.client.0.smithi088.stdout:3/521: dread d5/d26/f33 [0,4194304] 0 2024-09-13T21:40:24.159 INFO:tasks.workunit.client.0.smithi088.stdout:3/522: chown d5/d26/f70 1 1 2024-09-13T21:40:24.159 INFO:tasks.workunit.client.0.smithi088.stdout:0/480: rename d7/d1d/d26/d45/f58 to d7/d2c/d30/d31/d42/d4b/fba 0 2024-09-13T21:40:24.160 INFO:tasks.workunit.client.0.smithi088.stdout:0/481: write d7/d1d/d3d/f57 [1422061,93304] 0 2024-09-13T21:40:24.161 INFO:tasks.workunit.client.0.smithi088.stdout:9/426: dwrite d1a/f82 [0,4194304] 0 2024-09-13T21:40:24.161 INFO:tasks.workunit.client.0.smithi088.stdout:1/476: getdents d9/d10/d2a/d4b 0 2024-09-13T21:40:24.162 INFO:tasks.workunit.client.0.smithi088.stdout:1/477: dread d9/d10/d41/d7d/f80 [0,4194304] 0 2024-09-13T21:40:24.162 INFO:tasks.workunit.client.0.smithi088.stdout:1/478: chown d9/d4f/c86 1 1 2024-09-13T21:40:24.162 INFO:tasks.workunit.client.0.smithi088.stdout:4/461: creat d2/d5/d20/d60/de/d1e/d23/d3c/d65/f9c x:0 0 0 2024-09-13T21:40:24.164 INFO:tasks.workunit.client.0.smithi088.stdout:3/523: mknod d5/d5a/d7f/ca2 0 2024-09-13T21:40:24.164 INFO:tasks.workunit.client.0.smithi088.stdout:3/524: write d5/d5a/d92/f96 [214414,51429] 0 2024-09-13T21:40:24.166 INFO:tasks.workunit.client.0.smithi088.stdout:5/543: rename d4/d1c/f4d to d4/d1c/d81/d89/da3/fb3 0 2024-09-13T21:40:24.166 INFO:tasks.workunit.client.0.smithi088.stdout:4/462: rename d2/d5/d20/d60/de/d1e/d23 to d2/d5/d20/d60/de/d1e/d23/d3c/d9d 22 2024-09-13T21:40:24.166 INFO:tasks.workunit.client.0.smithi088.stdout:5/544: fsync d4/d1c/f45 0 2024-09-13T21:40:24.166 INFO:tasks.workunit.client.0.smithi088.stdout:4/463: fsync d2/d5/d20/d60/de/d1e/d31/f91 0 2024-09-13T21:40:24.166 INFO:tasks.workunit.client.0.smithi088.stdout:5/545: write d4/d1c/d24/d26/f6c [202501,108472] 0 2024-09-13T21:40:24.166 INFO:tasks.workunit.client.0.smithi088.stdout:0/482: rmdir d7/d65/d8c/da6 0 2024-09-13T21:40:24.167 INFO:tasks.workunit.client.0.smithi088.stdout:9/427: chown d1a/c32 97022085 1 2024-09-13T21:40:24.168 INFO:tasks.workunit.client.0.smithi088.stdout:1/479: creat d9/d10/d41/d7d/fa4 x:0 0 0 2024-09-13T21:40:24.170 INFO:tasks.workunit.client.0.smithi088.stdout:3/525: unlink d5/d23/l9d 0 2024-09-13T21:40:24.171 INFO:tasks.workunit.client.0.smithi088.stdout:4/464: rmdir d2/d5/d20/d60/de/d1e/d23/d6c 39 2024-09-13T21:40:24.171 INFO:tasks.workunit.client.0.smithi088.stdout:4/465: fsync d2/d5/d20/d60/de/d1e/d23/f78 0 2024-09-13T21:40:24.173 INFO:tasks.workunit.client.0.smithi088.stdout:3/526: dread d5/f50 [0,4194304] 0 2024-09-13T21:40:24.173 INFO:tasks.workunit.client.0.smithi088.stdout:3/527: chown d5/f13 239845 1 2024-09-13T21:40:24.175 INFO:tasks.workunit.client.0.smithi088.stdout:5/546: link d4/f31 d4/d1c/d4a/d63/d6a/fb4 0 2024-09-13T21:40:24.175 INFO:tasks.workunit.client.0.smithi088.stdout:5/547: chown d4/d1c/c69 5 1 2024-09-13T21:40:24.176 INFO:tasks.workunit.client.0.smithi088.stdout:0/483: mknod d7/d1d/d3d/dae/cbb 0 2024-09-13T21:40:24.178 INFO:tasks.workunit.client.0.smithi088.stdout:4/466: symlink d2/d5/d20/d60/de/d1e/l9e 0 2024-09-13T21:40:24.179 INFO:tasks.workunit.client.0.smithi088.stdout:3/528: mkdir d5/d23/d2a/d3f/d8f/da3 0 2024-09-13T21:40:24.181 INFO:tasks.workunit.client.0.smithi088.stdout:5/548: symlink d4/d1c/d24/d26/d56/lb5 0 2024-09-13T21:40:24.181 INFO:tasks.workunit.client.0.smithi088.stdout:5/549: readlink d4/d1c/d24/d26/d40/l44 0 2024-09-13T21:40:24.181 INFO:tasks.workunit.client.0.smithi088.stdout:1/480: dread d9/f19 [4194304,4194304] 0 2024-09-13T21:40:24.183 INFO:tasks.workunit.client.0.smithi088.stdout:5/550: mkdir d4/d1c/d24/d26/d40/db6 0 2024-09-13T21:40:24.183 INFO:tasks.workunit.client.0.smithi088.stdout:5/551: fdatasync d4/d1c/d24/d26/d4b/d67/f7f 0 2024-09-13T21:40:24.188 INFO:tasks.workunit.client.0.smithi088.stdout:1/481: link d9/d10/d41/l83 d9/dc/la5 0 2024-09-13T21:40:24.188 INFO:tasks.workunit.client.0.smithi088.stdout:1/482: read - d9/d10/d41/f9b zero size 2024-09-13T21:40:24.188 INFO:tasks.workunit.client.0.smithi088.stdout:1/483: truncate d9/f81 345395 0 2024-09-13T21:40:24.188 INFO:tasks.workunit.client.0.smithi088.stdout:1/484: dread - d9/d4f/f62 zero size 2024-09-13T21:40:24.188 INFO:tasks.workunit.client.0.smithi088.stdout:9/428: dwrite d1a/f67 [0,4194304] 0 2024-09-13T21:40:24.188 INFO:tasks.workunit.client.0.smithi088.stdout:9/429: readlink d1a/d1b/l26 0 2024-09-13T21:40:24.202 INFO:tasks.workunit.client.0.smithi088.stdout:2/530: sync 2024-09-13T21:40:24.203 INFO:tasks.workunit.client.0.smithi088.stdout:8/450: sync 2024-09-13T21:40:24.203 INFO:tasks.workunit.client.0.smithi088.stdout:6/496: sync 2024-09-13T21:40:24.203 INFO:tasks.workunit.client.0.smithi088.stdout:7/416: sync 2024-09-13T21:40:24.203 INFO:tasks.workunit.client.0.smithi088.stdout:7/417: write d6/d5f/d81/f85 [661146,77607] 0 2024-09-13T21:40:24.206 INFO:tasks.workunit.client.0.smithi088.stdout:8/451: rename db/df/l22 to db/df/d61/d97/la1 0 2024-09-13T21:40:24.206 INFO:tasks.workunit.client.0.smithi088.stdout:8/452: dread - db/d26/d2c/d85/f5c zero size 2024-09-13T21:40:24.206 INFO:tasks.workunit.client.0.smithi088.stdout:8/453: chown db/d26/d4f/f7e 13 1 2024-09-13T21:40:24.206 INFO:tasks.workunit.client.0.smithi088.stdout:8/454: creat db/df/d61/fa2 x:0 0 0 2024-09-13T21:40:24.206 INFO:tasks.workunit.client.0.smithi088.stdout:8/455: fdatasync db/f6b 0 2024-09-13T21:40:24.206 INFO:tasks.workunit.client.0.smithi088.stdout:8/456: chown db/d26/d2c/d85/f83 7684223 1 2024-09-13T21:40:24.207 INFO:tasks.workunit.client.0.smithi088.stdout:2/531: mknod d1/d13/d2a/d3c/d4a/d6e/d66/cb5 0 2024-09-13T21:40:24.207 INFO:tasks.workunit.client.0.smithi088.stdout:6/497: mkdir d0/d1e/d1f/d55/d96/d98 0 2024-09-13T21:40:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:7/418: write d6/da/d1a/f21 [82256,84475] 0 2024-09-13T21:40:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:8/457: creat db/df/fa3 x:0 0 0 2024-09-13T21:40:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:8/458: dread - db/d26/d2c/d85/f5c zero size 2024-09-13T21:40:24.210 INFO:tasks.workunit.client.0.smithi088.stdout:8/459: stat db/df/d61/f63 0 2024-09-13T21:40:24.211 INFO:tasks.workunit.client.0.smithi088.stdout:6/498: mknod d0/d2c/d32/d39/d3f/d71/d81/c99 0 2024-09-13T21:40:24.212 INFO:tasks.workunit.client.0.smithi088.stdout:8/460: mknod db/df/d61/ca4 0 2024-09-13T21:40:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:6/499: mknod d0/d2c/d32/d39/c9a 0 2024-09-13T21:40:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:6/500: fdatasync d0/db/f12 0 2024-09-13T21:40:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:7/419: dread d6/f53 [0,4194304] 0 2024-09-13T21:40:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:7/420: chown d6/da/fb 14762 1 2024-09-13T21:40:24.213 INFO:tasks.workunit.client.0.smithi088.stdout:7/421: creat d6/d4e/f8f x:0 0 0 2024-09-13T21:40:24.214 INFO:tasks.workunit.client.0.smithi088.stdout:8/461: creat db/d26/fa5 x:0 0 0 2024-09-13T21:40:24.214 INFO:tasks.workunit.client.0.smithi088.stdout:6/501: mknod d0/d1e/d1f/c9b 0 2024-09-13T21:40:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:2/532: dread d1/f15 [4194304,4194304] 0 2024-09-13T21:40:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:2/533: dread - d1/d8/d24/d78/d7f/fac zero size 2024-09-13T21:40:24.216 INFO:tasks.workunit.client.0.smithi088.stdout:7/422: rename d6/da/d1a/c84 to d6/d5f/d69/d4f/d6f/c90 0 2024-09-13T21:40:24.217 INFO:tasks.workunit.client.0.smithi088.stdout:7/423: chown d6/d5f/d69/d4f/d6f/d83/f7f 369828 1 2024-09-13T21:40:24.217 INFO:tasks.workunit.client.0.smithi088.stdout:7/424: fsync d6/d5f/d69/d4f/f41 0 2024-09-13T21:40:24.219 INFO:tasks.workunit.client.0.smithi088.stdout:8/462: rename db/df/d25/f56 to db/df/d61/fa6 0 2024-09-13T21:40:24.220 INFO:tasks.workunit.client.0.smithi088.stdout:8/463: chown db/df/d25/c57 120571 1 2024-09-13T21:40:24.221 INFO:tasks.workunit.client.0.smithi088.stdout:7/425: mknod d6/d5f/d69/d4f/d4c/c91 0 2024-09-13T21:40:24.221 INFO:tasks.workunit.client.0.smithi088.stdout:2/534: getdents d1/d13/d2a/d3c/d4a 0 2024-09-13T21:40:24.223 INFO:tasks.workunit.client.0.smithi088.stdout:6/502: rename d0/d1e/f49 to d0/d2c/f9c 0 2024-09-13T21:40:24.223 INFO:tasks.workunit.client.0.smithi088.stdout:6/503: fsync d0/d2c/d32/d39/d3f/f79 0 2024-09-13T21:40:24.224 INFO:tasks.workunit.client.0.smithi088.stdout:2/535: dread d1/d8/d24/f39 [0,4194304] 0 2024-09-13T21:40:24.226 INFO:tasks.workunit.client.0.smithi088.stdout:7/426: rename d6/da/f1e to d6/d5f/d69/d4f/d6f/f92 0 2024-09-13T21:40:24.228 INFO:tasks.workunit.client.0.smithi088.stdout:7/427: mknod d6/da/d1a/c93 0 2024-09-13T21:40:24.229 INFO:tasks.workunit.client.0.smithi088.stdout:6/504: mknod d0/c9d 0 2024-09-13T21:40:24.231 INFO:tasks.workunit.client.0.smithi088.stdout:7/428: unlink d6/da/d44/l47 0 2024-09-13T21:40:24.232 INFO:tasks.workunit.client.0.smithi088.stdout:0/484: getdents d7/d1d/d3d/dae 0 2024-09-13T21:40:24.232 INFO:tasks.workunit.client.0.smithi088.stdout:0/485: write d7/d1d/d27/f6f [504524,118317] 0 2024-09-13T21:40:24.237 INFO:tasks.workunit.client.0.smithi088.stdout:9/430: dwrite d1a/f3b [0,4194304] 0 2024-09-13T21:40:24.238 INFO:tasks.workunit.client.0.smithi088.stdout:5/552: dwrite d4/d1c/d81/d89/d92/f3b [0,4194304] 0 2024-09-13T21:40:24.239 INFO:tasks.workunit.client.0.smithi088.stdout:4/467: dwrite d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 [0,4194304] 0 2024-09-13T21:40:24.239 INFO:tasks.workunit.client.0.smithi088.stdout:4/468: getdents d2/d5 0 2024-09-13T21:40:24.241 INFO:tasks.workunit.client.0.smithi088.stdout:2/536: dread d1/f4 [0,4194304] 0 2024-09-13T21:40:24.241 INFO:tasks.workunit.client.0.smithi088.stdout:2/537: truncate d1/d8/d2e/f53 764632 0 2024-09-13T21:40:24.241 INFO:tasks.workunit.client.0.smithi088.stdout:2/538: fdatasync d1/d8/d2e/d91/f95 0 2024-09-13T21:40:24.241 INFO:tasks.workunit.client.0.smithi088.stdout:0/486: write d7/d1d/d26/d45/f56 [2579376,18746] 0 2024-09-13T21:40:24.243 INFO:tasks.workunit.client.0.smithi088.stdout:9/431: creat d1a/d3c/d51/f83 x:0 0 0 2024-09-13T21:40:24.244 INFO:tasks.workunit.client.0.smithi088.stdout:7/429: dread d6/d5f/d69/d4f/d6f/d83/f7f [0,4194304] 0 2024-09-13T21:40:24.244 INFO:tasks.workunit.client.0.smithi088.stdout:5/553: link d4/d1c/d81/d89/c9d d4/d1c/d24/d26/d4b/d67/cb7 0 2024-09-13T21:40:24.245 INFO:tasks.workunit.client.0.smithi088.stdout:6/505: dread d0/d28/f40 [0,4194304] 0 2024-09-13T21:40:24.245 INFO:tasks.workunit.client.0.smithi088.stdout:3/529: dwrite d5/d23/d2a/d55/f7b [0,4194304] 0 2024-09-13T21:40:24.245 INFO:tasks.workunit.client.0.smithi088.stdout:6/506: chown d0/d1e/d1f/c8a 507712179 1 2024-09-13T21:40:24.245 INFO:tasks.workunit.client.0.smithi088.stdout:1/485: dwrite d9/f81 [0,4194304] 0 2024-09-13T21:40:24.248 INFO:tasks.workunit.client.0.smithi088.stdout:2/539: symlink d1/d8/d24/d78/d7f/lb6 0 2024-09-13T21:40:24.251 INFO:tasks.workunit.client.0.smithi088.stdout:5/554: unlink d4/d1c/d24/d26/d56/l9a 0 2024-09-13T21:40:24.251 INFO:tasks.workunit.client.0.smithi088.stdout:2/540: dread d1/d8/d24/f72 [0,4194304] 0 2024-09-13T21:40:24.253 INFO:tasks.workunit.client.0.smithi088.stdout:6/507: rmdir d0/d2c/d32/d39/d3f/d71/d81 39 2024-09-13T21:40:24.261 INFO:tasks.workunit.client.0.smithi088.stdout:1/486: truncate d9/d10/d2a/d4b/d33/f76 1965784 0 2024-09-13T21:40:24.263 INFO:tasks.workunit.client.0.smithi088.stdout:5/555: mkdir d4/db8 0 2024-09-13T21:40:24.263 INFO:tasks.workunit.client.0.smithi088.stdout:5/556: fsync d4/d1b/f75 0 2024-09-13T21:40:24.263 INFO:tasks.workunit.client.0.smithi088.stdout:5/557: readlink d4/d1c/d24/d26/d40/l94 0 2024-09-13T21:40:24.264 INFO:tasks.workunit.client.0.smithi088.stdout:2/541: creat d1/d13/fb7 x:0 0 0 2024-09-13T21:40:24.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/487: mknod d9/d10/d2a/d4b/d33/d92/ca6 0 2024-09-13T21:40:24.273 INFO:tasks.workunit.client.0.smithi088.stdout:5/558: rmdir d4/d1c/d24/d26/d4b/d66 39 2024-09-13T21:40:24.275 INFO:tasks.workunit.client.0.smithi088.stdout:5/559: rename d4/d1c/d24/d26/d40/cab to d4/d1c/d4a/d63/d6a/cb9 0 2024-09-13T21:40:24.277 INFO:tasks.workunit.client.0.smithi088.stdout:9/432: dwrite d1a/d1b/f66 [0,4194304] 0 2024-09-13T21:40:24.278 INFO:tasks.workunit.client.0.smithi088.stdout:4/469: dwrite d2/f45 [0,4194304] 0 2024-09-13T21:40:24.279 INFO:tasks.workunit.client.0.smithi088.stdout:7/430: dwrite d6/d5f/f72 [0,4194304] 0 2024-09-13T21:40:24.279 INFO:tasks.workunit.client.0.smithi088.stdout:7/431: dread - d6/d5f/d7a/f8c zero size 2024-09-13T21:40:24.280 INFO:tasks.workunit.client.0.smithi088.stdout:5/560: rename d4/d1c/d76/l99 to d4/lba 0 2024-09-13T21:40:24.281 INFO:tasks.workunit.client.0.smithi088.stdout:9/433: link d1a/d61/d3d/d41/f46 d1a/d3c/d51/d5e/f84 0 2024-09-13T21:40:24.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/508: rmdir d0/d2c/d32/d39/d3f/d71 39 2024-09-13T21:40:24.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/509: chown d0/d2c/d32/d39/c56 90 1 2024-09-13T21:40:24.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/510: truncate d0/d2c/d32/f6e 125925 0 2024-09-13T21:40:24.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/511: chown d0/d2c/d32/d39/d3f/d71/d81 26 1 2024-09-13T21:40:24.287 INFO:tasks.workunit.client.0.smithi088.stdout:6/512: dread d0/db/f60 [0,4194304] 0 2024-09-13T21:40:24.288 INFO:tasks.workunit.client.0.smithi088.stdout:6/513: truncate d0/d2c/d32/d39/d3f/d71/f97 168714 0 2024-09-13T21:40:24.291 INFO:tasks.workunit.client.0.smithi088.stdout:6/514: symlink d0/d2c/d32/d39/d3f/l9e 0 2024-09-13T21:40:24.291 INFO:tasks.workunit.client.0.smithi088.stdout:1/488: dwrite d9/d10/d2a/d4b/d61/f6a [0,4194304] 0 2024-09-13T21:40:24.291 INFO:tasks.workunit.client.0.smithi088.stdout:1/489: readlink d9/dc/d52/l66 0 2024-09-13T21:40:24.291 INFO:tasks.workunit.client.0.smithi088.stdout:1/490: chown d9/d10/d2a/d4b/c45 6 1 2024-09-13T21:40:24.291 INFO:tasks.workunit.client.0.smithi088.stdout:1/491: chown c2 0 1 2024-09-13T21:40:24.294 INFO:tasks.workunit.client.0.smithi088.stdout:6/515: stat d0/d28/c31 0 2024-09-13T21:40:24.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/492: rename d9/d4f/c86 to d9/d10/d2a/d47/d9c/ca7 0 2024-09-13T21:40:24.298 INFO:tasks.workunit.client.0.smithi088.stdout:8/464: rename db/df/d25 to db/df/da7 0 2024-09-13T21:40:24.304 INFO:tasks.workunit.client.0.smithi088.stdout:6/516: link d0/d1e/d1f/f91 d0/d2c/d7a/f9f 0 2024-09-13T21:40:24.306 INFO:tasks.workunit.client.0.smithi088.stdout:1/493: unlink f1 0 2024-09-13T21:40:24.306 INFO:tasks.workunit.client.0.smithi088.stdout:1/494: stat d9/l7b 0 2024-09-13T21:40:24.309 INFO:tasks.workunit.client.0.smithi088.stdout:6/517: unlink d0/db/f5d 0 2024-09-13T21:40:24.310 INFO:tasks.workunit.client.0.smithi088.stdout:6/518: symlink d0/d2c/d32/d39/la0 0 2024-09-13T21:40:24.321 INFO:tasks.workunit.client.0.smithi088.stdout:1/495: dwrite d9/d10/f7e [0,4194304] 0 2024-09-13T21:40:24.322 INFO:tasks.workunit.client.0.smithi088.stdout:4/470: dwrite d2/d5/d20/d60/de/d1e/d23/f94 [0,4194304] 0 2024-09-13T21:40:24.323 INFO:tasks.workunit.client.0.smithi088.stdout:5/561: dwrite d4/d1c/d76/f88 [0,4194304] 0 2024-09-13T21:40:24.328 INFO:tasks.workunit.client.0.smithi088.stdout:4/471: mknod d2/d13/d50/c9f 0 2024-09-13T21:40:24.331 INFO:tasks.workunit.client.0.smithi088.stdout:5/562: unlink d4/d1c/d24/f35 0 2024-09-13T21:40:24.333 INFO:tasks.workunit.client.0.smithi088.stdout:6/519: dwrite d0/d2c/d32/f6e [0,4194304] 0 2024-09-13T21:40:24.333 INFO:tasks.workunit.client.0.smithi088.stdout:6/520: creat d0/d1e/fa1 x:0 0 0 2024-09-13T21:40:24.333 INFO:tasks.workunit.client.0.smithi088.stdout:6/521: creat d0/d1e/d1f/fa2 x:0 0 0 2024-09-13T21:40:24.389 INFO:tasks.workunit.client.0.smithi088.stdout:4/472: creat d2/d5/d20/d60/de/d1e/fa0 x:0 0 0 2024-09-13T21:40:24.402 INFO:tasks.workunit.client.0.smithi088.stdout:8/465: rmdir db/df/da7 39 2024-09-13T21:40:24.402 INFO:tasks.workunit.client.0.smithi088.stdout:4/473: creat d2/d5/d2d/d70/fa1 x:0 0 0 2024-09-13T21:40:24.402 INFO:tasks.workunit.client.0.smithi088.stdout:8/466: chown db/c20 89105679 1 2024-09-13T21:40:24.402 INFO:tasks.workunit.client.0.smithi088.stdout:4/474: write d2/d13/d50/f84 [416812,67827] 0 2024-09-13T21:40:24.402 INFO:tasks.workunit.client.0.smithi088.stdout:5/563: dwrite d4/d1c/d81/d89/da3/fb3 [0,4194304] 0 2024-09-13T21:40:24.402 INFO:tasks.workunit.client.0.smithi088.stdout:5/564: chown d4/d1c/d4a/l4f 47094 1 2024-09-13T21:40:24.402 INFO:tasks.workunit.client.0.smithi088.stdout:5/565: write d4/d1c/d81/d89/d92/f2d [4464729,100671] 0 2024-09-13T21:40:24.403 INFO:tasks.workunit.client.0.smithi088.stdout:4/475: unlink d2/d5/d2d/c62 0 2024-09-13T21:40:24.414 INFO:tasks.workunit.client.0.smithi088.stdout:3/530: sync 2024-09-13T21:40:24.414 INFO:tasks.workunit.client.0.smithi088.stdout:0/487: sync 2024-09-13T21:40:24.414 INFO:tasks.workunit.client.0.smithi088.stdout:5/566: write d4/d1c/f48 [889725,1802] 0 2024-09-13T21:40:24.415 INFO:tasks.workunit.client.0.smithi088.stdout:0/488: write d7/d2c/d30/d31/d42/fa8 [2905,55506] 0 2024-09-13T21:40:24.417 INFO:tasks.workunit.client.0.smithi088.stdout:6/522: dwrite d0/f52 [4194304,4194304] 0 2024-09-13T21:40:24.418 INFO:tasks.workunit.client.0.smithi088.stdout:4/476: write d2/d5/d20/d60/de/d1e/d23/d6c/f34 [15035,120546] 0 2024-09-13T21:40:24.419 INFO:tasks.workunit.client.0.smithi088.stdout:0/489: rename d7/d2c/d30/d31/f32 to d7/d1d/d26/d45/fbc 0 2024-09-13T21:40:24.425 INFO:tasks.workunit.client.0.smithi088.stdout:5/567: read d4/ff [3848732,82081] 0 2024-09-13T21:40:24.426 INFO:tasks.workunit.client.0.smithi088.stdout:6/523: truncate d0/d2c/d7a/f9f 388793 0 2024-09-13T21:40:24.429 INFO:tasks.workunit.client.0.smithi088.stdout:3/531: write d5/d23/d2a/f40 [2142270,102119] 0 2024-09-13T21:40:24.429 INFO:tasks.workunit.client.0.smithi088.stdout:4/477: symlink d2/d5/d20/d41/d4b/la2 0 2024-09-13T21:40:24.432 INFO:tasks.workunit.client.0.smithi088.stdout:5/568: chown d4/d1c/d4a/d8a/f9b 225 1 2024-09-13T21:40:24.432 INFO:tasks.workunit.client.0.smithi088.stdout:5/569: stat d4/d1b/l37 0 2024-09-13T21:40:24.435 INFO:tasks.workunit.client.0.smithi088.stdout:6/524: mkdir d0/d28/da3 0 2024-09-13T21:40:24.435 INFO:tasks.workunit.client.0.smithi088.stdout:6/525: chown d0/d2c/d32/c62 260362 1 2024-09-13T21:40:24.438 INFO:tasks.workunit.client.0.smithi088.stdout:3/532: unlink d5/d23/d2a/d3f/c68 0 2024-09-13T21:40:24.444 INFO:tasks.workunit.client.0.smithi088.stdout:5/570: read d4/d1c/d4a/d8a/f8b [1170058,11202] 0 2024-09-13T21:40:24.444 INFO:tasks.workunit.client.0.smithi088.stdout:5/571: chown d4/d1c/d4a/d8a/f9b 192581275 1 2024-09-13T21:40:24.444 INFO:tasks.workunit.client.0.smithi088.stdout:6/526: creat d0/d2c/d32/d39/d3f/d71/d81/fa4 x:0 0 0 2024-09-13T21:40:24.449 INFO:tasks.workunit.client.0.smithi088.stdout:3/533: link d5/d5a/f6f d5/d5a/d92/fa4 0 2024-09-13T21:40:24.449 INFO:tasks.workunit.client.0.smithi088.stdout:5/572: stat d4/d1c/f5c 0 2024-09-13T21:40:24.450 INFO:tasks.workunit.client.0.smithi088.stdout:6/527: creat d0/db/d37/fa5 x:0 0 0 2024-09-13T21:40:24.451 INFO:tasks.workunit.client.0.smithi088.stdout:6/528: mknod d0/d2c/d32/d39/d3f/d71/d81/ca6 0 2024-09-13T21:40:24.457 INFO:tasks.workunit.client.0.smithi088.stdout:3/534: dread d5/f16 [0,4194304] 0 2024-09-13T21:40:24.457 INFO:tasks.workunit.client.0.smithi088.stdout:3/535: write d5/f21 [598019,37938] 0 2024-09-13T21:40:24.461 INFO:tasks.workunit.client.0.smithi088.stdout:0/490: dwrite d7/d2c/d30/d31/d42/d95/fa3 [0,4194304] 0 2024-09-13T21:40:24.461 INFO:tasks.workunit.client.0.smithi088.stdout:0/491: readlink d7/d2c/d30/d31/d42/l96 0 2024-09-13T21:40:24.461 INFO:tasks.workunit.client.0.smithi088.stdout:0/492: write d7/d1d/f69 [3749555,19190] 0 2024-09-13T21:40:24.461 INFO:tasks.workunit.client.0.smithi088.stdout:0/493: chown d7/d2c/d30/d31/f62 2 1 2024-09-13T21:40:24.461 INFO:tasks.workunit.client.0.smithi088.stdout:0/494: write d7/d2c/f2e [851000,28230] 0 2024-09-13T21:40:24.461 INFO:tasks.workunit.client.0.smithi088.stdout:0/495: read - d7/fb7 zero size 2024-09-13T21:40:24.462 INFO:tasks.workunit.client.0.smithi088.stdout:5/573: write d4/d1c/d81/d89/d92/f96 [3650609,105181] 0 2024-09-13T21:40:24.462 INFO:tasks.workunit.client.0.smithi088.stdout:5/574: fsync d4/d1c/d81/d89/d92/f3b 0 2024-09-13T21:40:24.462 INFO:tasks.workunit.client.0.smithi088.stdout:5/575: dread - d4/da7/fb1 zero size 2024-09-13T21:40:24.462 INFO:tasks.workunit.client.0.smithi088.stdout:5/576: stat d4/c16 0 2024-09-13T21:40:24.466 INFO:tasks.workunit.client.0.smithi088.stdout:0/496: truncate d7/d2c/d37/f59 619628 0 2024-09-13T21:40:24.470 INFO:tasks.workunit.client.0.smithi088.stdout:0/497: truncate d7/d1d/d66/d8b/fa1 33653 0 2024-09-13T21:40:24.471 INFO:tasks.workunit.client.0.smithi088.stdout:0/498: creat d7/d2c/fbd x:0 0 0 2024-09-13T21:40:24.473 INFO:tasks.workunit.client.0.smithi088.stdout:0/499: mkdir d7/d2c/d30/dbe 0 2024-09-13T21:40:24.473 INFO:tasks.workunit.client.0.smithi088.stdout:0/500: creat d7/d2c/d37/fbf x:0 0 0 2024-09-13T21:40:24.480 INFO:tasks.workunit.client.0.smithi088.stdout:6/529: dwrite d0/d1e/d1f/fa2 [0,4194304] 0 2024-09-13T21:40:24.480 INFO:tasks.workunit.client.0.smithi088.stdout:6/530: readlink d0/db/l3e 0 2024-09-13T21:40:24.483 INFO:tasks.workunit.client.0.smithi088.stdout:5/577: dread d4/d1c/d76/f88 [0,4194304] 0 2024-09-13T21:40:24.483 INFO:tasks.workunit.client.0.smithi088.stdout:3/536: dwrite d5/d23/d2a/d63/d48/d49/f62 [0,4194304] 0 2024-09-13T21:40:24.484 INFO:tasks.workunit.client.0.smithi088.stdout:6/531: truncate d0/db/f2e 7979910 0 2024-09-13T21:40:24.487 INFO:tasks.workunit.client.0.smithi088.stdout:0/501: write d7/d1d/d27/f70 [1821267,60320] 0 2024-09-13T21:40:24.487 INFO:tasks.workunit.client.0.smithi088.stdout:5/578: unlink d4/d1c/d81/d89/d92/c80 0 2024-09-13T21:40:24.490 INFO:tasks.workunit.client.0.smithi088.stdout:0/502: dread d7/d1d/d26/d45/f56 [0,4194304] 0 2024-09-13T21:40:24.491 INFO:tasks.workunit.client.0.smithi088.stdout:6/532: mknod d0/d1e/d1f/d55/d96/d98/ca7 0 2024-09-13T21:40:24.491 INFO:tasks.workunit.client.0.smithi088.stdout:6/533: creat d0/d28/fa8 x:0 0 0 2024-09-13T21:40:24.500 INFO:tasks.workunit.client.0.smithi088.stdout:5/579: creat d4/d1c/d24/d95/d9e/fbb x:0 0 0 2024-09-13T21:40:24.508 INFO:tasks.workunit.client.0.smithi088.stdout:2/542: sync 2024-09-13T21:40:24.508 INFO:tasks.workunit.client.0.smithi088.stdout:2/543: fsync d1/d8/d2e/d3b/f6f 0 2024-09-13T21:40:24.508 INFO:tasks.workunit.client.0.smithi088.stdout:7/432: sync 2024-09-13T21:40:24.508 INFO:tasks.workunit.client.0.smithi088.stdout:7/433: chown d6/f22 9 1 2024-09-13T21:40:24.509 INFO:tasks.workunit.client.0.smithi088.stdout:2/544: rename d1/d13/d3f/c8f to d1/d13/d2a/d41/d82/cb8 0 2024-09-13T21:40:24.509 INFO:tasks.workunit.client.0.smithi088.stdout:2/545: stat d1/d8/d2e/d44/l71 0 2024-09-13T21:40:24.510 INFO:tasks.workunit.client.0.smithi088.stdout:7/434: mknod d6/da/c94 0 2024-09-13T21:40:24.511 INFO:tasks.workunit.client.0.smithi088.stdout:2/546: creat d1/d13/d2a/d3c/fb9 x:0 0 0 2024-09-13T21:40:24.511 INFO:tasks.workunit.client.0.smithi088.stdout:5/580: dread d4/d1c/d4a/d63/d6a/f6b [0,4194304] 0 2024-09-13T21:40:24.511 INFO:tasks.workunit.client.0.smithi088.stdout:5/581: write d4/da7/fb1 [679967,50722] 0 2024-09-13T21:40:24.512 INFO:tasks.workunit.client.0.smithi088.stdout:7/435: unlink d6/l2a 0 2024-09-13T21:40:24.513 INFO:tasks.workunit.client.0.smithi088.stdout:7/436: symlink d6/d5f/d69/d45/l95 0 2024-09-13T21:40:24.519 INFO:tasks.workunit.client.0.smithi088.stdout:3/537: dwrite f1 [0,4194304] 0 2024-09-13T21:40:24.519 INFO:tasks.workunit.client.0.smithi088.stdout:3/538: stat d5/ld 0 2024-09-13T21:40:24.519 INFO:tasks.workunit.client.0.smithi088.stdout:6/534: dwrite d0/db/f43 [0,4194304] 0 2024-09-13T21:40:24.521 INFO:tasks.workunit.client.0.smithi088.stdout:0/503: dwrite d7/d1d/d27/d43/f53 [0,4194304] 0 2024-09-13T21:40:24.521 INFO:tasks.workunit.client.0.smithi088.stdout:3/539: mkdir d5/d5a/d92/da5 0 2024-09-13T21:40:24.523 INFO:tasks.workunit.client.0.smithi088.stdout:6/535: link d0/d2c/d32/f84 d0/d2c/d32/d39/d3f/d71/fa9 0 2024-09-13T21:40:24.525 INFO:tasks.workunit.client.0.smithi088.stdout:0/504: mkdir d7/d1d/d66/d8b/dc0 0 2024-09-13T21:40:24.525 INFO:tasks.workunit.client.0.smithi088.stdout:0/505: chown d7/d2c/c98 1701193 1 2024-09-13T21:40:24.529 INFO:tasks.workunit.client.0.smithi088.stdout:3/540: rename d5/d23/d2a/d63/d48/d49/f62 to d5/d23/d2a/d3f/fa6 0 2024-09-13T21:40:24.532 INFO:tasks.workunit.client.0.smithi088.stdout:0/506: rename d7/d65/l90 to d7/d1d/d66/lc1 0 2024-09-13T21:40:24.536 INFO:tasks.workunit.client.0.smithi088.stdout:0/507: rename d7/d1d/d27/d43/l50 to d7/d1d/d26/lc2 0 2024-09-13T21:40:24.541 INFO:tasks.workunit.client.0.smithi088.stdout:5/582: dwrite d4/d1c/d4a/d63/d6a/f8d [0,4194304] 0 2024-09-13T21:40:24.541 INFO:tasks.workunit.client.0.smithi088.stdout:5/583: chown d4/d1c/d24/d26/c62 106832575 1 2024-09-13T21:40:24.541 INFO:tasks.workunit.client.0.smithi088.stdout:2/547: dwrite d1/d8/fad [0,4194304] 0 2024-09-13T21:40:24.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/508: dread d7/d1d/d21/f4c [0,4194304] 0 2024-09-13T21:40:24.544 INFO:tasks.workunit.client.0.smithi088.stdout:0/509: chown d7/d1d/d21/f4c 26961694 1 2024-09-13T21:40:24.544 INFO:tasks.workunit.client.0.smithi088.stdout:7/437: dwrite d6/d5f/d7a/f8e [0,4194304] 0 2024-09-13T21:40:24.544 INFO:tasks.workunit.client.0.smithi088.stdout:7/438: write d6/d5f/d69/d4f/d6f/f92 [326840,451] 0 2024-09-13T21:40:24.544 INFO:tasks.workunit.client.0.smithi088.stdout:7/439: write d6/f8d [261758,116943] 0 2024-09-13T21:40:24.547 INFO:tasks.workunit.client.0.smithi088.stdout:7/440: symlink d6/da/l96 0 2024-09-13T21:40:24.547 INFO:tasks.workunit.client.0.smithi088.stdout:7/441: read - d6/d5f/d69/f8a zero size 2024-09-13T21:40:24.548 INFO:tasks.workunit.client.0.smithi088.stdout:6/536: dwrite d0/d28/f35 [0,4194304] 0 2024-09-13T21:40:24.551 INFO:tasks.workunit.client.0.smithi088.stdout:0/510: rmdir d7/d2c 39 2024-09-13T21:40:24.551 INFO:tasks.workunit.client.0.smithi088.stdout:5/584: write d4/d1c/d4a/d63/f6f [3286828,117038] 0 2024-09-13T21:40:24.551 INFO:tasks.workunit.client.0.smithi088.stdout:5/585: dread - d4/d1c/d24/f8e zero size 2024-09-13T21:40:24.555 INFO:tasks.workunit.client.0.smithi088.stdout:6/537: creat d0/d2c/d32/d39/faa x:0 0 0 2024-09-13T21:40:24.556 INFO:tasks.workunit.client.0.smithi088.stdout:0/511: mknod d7/d2c/cc3 0 2024-09-13T21:40:24.558 INFO:tasks.workunit.client.0.smithi088.stdout:5/586: symlink d4/d1c/d24/d95/da6/lbc 0 2024-09-13T21:40:24.558 INFO:tasks.workunit.client.0.smithi088.stdout:5/587: write d4/d1c/d4a/d63/d6a/fb4 [797698,95406] 0 2024-09-13T21:40:24.563 INFO:tasks.workunit.client.0.smithi088.stdout:7/442: rmdir d6/d5f/d69 39 2024-09-13T21:40:24.582 INFO:tasks.workunit.client.0.smithi088.stdout:2/548: dwrite d1/d8/d16/f5c [0,4194304] 0 2024-09-13T21:40:24.582 INFO:tasks.workunit.client.0.smithi088.stdout:3/541: dwrite d5/f42 [0,4194304] 0 2024-09-13T21:40:24.583 INFO:tasks.workunit.client.0.smithi088.stdout:6/538: dwrite d0/d2c/d32/f6e [0,4194304] 0 2024-09-13T21:40:24.583 INFO:tasks.workunit.client.0.smithi088.stdout:6/539: dread - d0/db/f82 zero size 2024-09-13T21:40:24.585 INFO:tasks.workunit.client.0.smithi088.stdout:0/512: dwrite d7/d2c/d30/d31/d42/d95/fa3 [0,4194304] 0 2024-09-13T21:40:24.585 INFO:tasks.workunit.client.0.smithi088.stdout:0/513: write d7/d1d/d26/d45/f56 [2882468,27401] 0 2024-09-13T21:40:24.589 INFO:tasks.workunit.client.0.smithi088.stdout:7/443: dwrite d6/da/d1a/d3a/d5c/d60/f66 [4194304,4194304] 0 2024-09-13T21:40:24.591 INFO:tasks.workunit.client.0.smithi088.stdout:2/549: link d1/d8/d16/c6b d1/d13/d2a/d41/cba 0 2024-09-13T21:40:24.592 INFO:tasks.workunit.client.0.smithi088.stdout:6/540: link d0/d1e/f24 d0/d2c/d32/d39/d3f/d71/fab 0 2024-09-13T21:40:24.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/444: mkdir d6/d5f/d69/d4f/d6f/d83/d97 0 2024-09-13T21:40:24.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/445: chown d6/f8d 1 1 2024-09-13T21:40:24.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/446: chown d6/d5f 4058 1 2024-09-13T21:40:24.600 INFO:tasks.workunit.client.0.smithi088.stdout:7/447: write d6/da/f10 [320948,19463] 0 2024-09-13T21:40:24.601 INFO:tasks.workunit.client.0.smithi088.stdout:7/448: write d6/f22 [1751909,111246] 0 2024-09-13T21:40:24.601 INFO:tasks.workunit.client.0.smithi088.stdout:7/449: stat d6/d5f/d69/d4f/d6f/d83 0 2024-09-13T21:40:24.601 INFO:tasks.workunit.client.0.smithi088.stdout:2/550: rename d1/fa4 to d1/d8/d24/d78/d7f/d85/fbb 0 2024-09-13T21:40:24.603 INFO:tasks.workunit.client.0.smithi088.stdout:6/541: truncate d0/d1e/d1f/fa2 2677739 0 2024-09-13T21:40:24.603 INFO:tasks.workunit.client.0.smithi088.stdout:6/542: write d0/d2c/d32/d39/faa [434217,8497] 0 2024-09-13T21:40:24.605 INFO:tasks.workunit.client.0.smithi088.stdout:7/450: symlink d6/d5f/l98 0 2024-09-13T21:40:24.606 INFO:tasks.workunit.client.0.smithi088.stdout:2/551: symlink d1/d8/d24/d78/d7f/lbc 0 2024-09-13T21:40:24.607 INFO:tasks.workunit.client.0.smithi088.stdout:1/496: sync 2024-09-13T21:40:24.607 INFO:tasks.workunit.client.0.smithi088.stdout:8/467: sync 2024-09-13T21:40:24.607 INFO:tasks.workunit.client.0.smithi088.stdout:4/478: sync 2024-09-13T21:40:24.607 INFO:tasks.workunit.client.0.smithi088.stdout:9/434: sync 2024-09-13T21:40:24.609 INFO:tasks.workunit.client.0.smithi088.stdout:4/479: truncate d2/d13/d50/f84 195691 0 2024-09-13T21:40:24.610 INFO:tasks.workunit.client.0.smithi088.stdout:8/468: mkdir db/df/da7/d88/da8 0 2024-09-13T21:40:24.614 INFO:tasks.workunit.client.0.smithi088.stdout:1/497: link d9/dc/l46 d9/d10/d2a/d4b/d33/d92/d8e/la8 0 2024-09-13T21:40:24.614 INFO:tasks.workunit.client.0.smithi088.stdout:4/480: mknod d2/d81/ca3 0 2024-09-13T21:40:24.614 INFO:tasks.workunit.client.0.smithi088.stdout:7/451: dread d6/da/fb [0,4194304] 0 2024-09-13T21:40:24.617 INFO:tasks.workunit.client.0.smithi088.stdout:0/514: dwrite d7/d1d/d66/fab [0,4194304] 0 2024-09-13T21:40:24.617 INFO:tasks.workunit.client.0.smithi088.stdout:0/515: truncate d7/d1d/d26/d45/f56 4650841 0 2024-09-13T21:40:24.618 INFO:tasks.workunit.client.0.smithi088.stdout:3/542: dwrite d5/d23/d2a/d63/d48/f99 [0,4194304] 0 2024-09-13T21:40:24.618 INFO:tasks.workunit.client.0.smithi088.stdout:8/469: truncate db/f7f 376047 0 2024-09-13T21:40:24.619 INFO:tasks.workunit.client.0.smithi088.stdout:6/543: write d0/d1e/d1f/f4e [1532831,46126] 0 2024-09-13T21:40:24.619 INFO:tasks.workunit.client.0.smithi088.stdout:1/498: rename d9/d4f/f67 to d9/d10/d2a/d4b/d33/d92/d8e/fa9 0 2024-09-13T21:40:24.620 INFO:tasks.workunit.client.0.smithi088.stdout:4/481: symlink d2/d5/d20/d41/d4b/d98/la4 0 2024-09-13T21:40:24.620 INFO:tasks.workunit.client.0.smithi088.stdout:4/482: truncate d2/d5/d20/d60/de/d1e/d23/f94 4608394 0 2024-09-13T21:40:24.624 INFO:tasks.workunit.client.0.smithi088.stdout:0/516: link d7/d2c/d37/f59 d7/d2c/d30/d31/d42/d95/fc4 0 2024-09-13T21:40:24.624 INFO:tasks.workunit.client.0.smithi088.stdout:0/517: truncate d7/d2c/d30/d31/d42/fa8 840173 0 2024-09-13T21:40:24.625 INFO:tasks.workunit.client.0.smithi088.stdout:0/518: chown d7/d2c/fbd 55 1 2024-09-13T21:40:24.631 INFO:tasks.workunit.client.0.smithi088.stdout:6/544: symlink d0/d2c/d32/d39/d3f/lac 0 2024-09-13T21:40:24.634 INFO:tasks.workunit.client.0.smithi088.stdout:8/470: rename db/f9d to db/df/d61/fa9 0 2024-09-13T21:40:24.634 INFO:tasks.workunit.client.0.smithi088.stdout:8/471: dread - db/d26/d4f/f91 zero size 2024-09-13T21:40:24.634 INFO:tasks.workunit.client.0.smithi088.stdout:8/472: fsync db/d26/d37/f41 0 2024-09-13T21:40:24.634 INFO:tasks.workunit.client.0.smithi088.stdout:2/552: dwrite d1/d8/d2e/f38 [0,4194304] 0 2024-09-13T21:40:24.635 INFO:tasks.workunit.client.0.smithi088.stdout:9/435: dwrite d1a/f3b [0,4194304] 0 2024-09-13T21:40:24.635 INFO:tasks.workunit.client.0.smithi088.stdout:2/553: dread - d1/d8/d2e/d91/fae zero size 2024-09-13T21:40:24.635 INFO:tasks.workunit.client.0.smithi088.stdout:2/554: chown d1/d8/d24/d78/d7f/d85 344504 1 2024-09-13T21:40:24.635 INFO:tasks.workunit.client.0.smithi088.stdout:1/499: creat d9/d4f/faa x:0 0 0 2024-09-13T21:40:24.638 INFO:tasks.workunit.client.0.smithi088.stdout:6/545: readlink d0/l5f 0 2024-09-13T21:40:24.639 INFO:tasks.workunit.client.0.smithi088.stdout:6/546: dread - d0/db/f82 zero size 2024-09-13T21:40:24.639 INFO:tasks.workunit.client.0.smithi088.stdout:0/519: dwrite d7/d2c/d30/d31/d42/d95/fa3 [4194304,4194304] 0 2024-09-13T21:40:24.643 INFO:tasks.workunit.client.0.smithi088.stdout:3/543: rename d5/d14/f2c to d5/d23/d2a/d63/d48/d49/fa7 0 2024-09-13T21:40:24.646 INFO:tasks.workunit.client.0.smithi088.stdout:9/436: mkdir d1a/d3c/d85 0 2024-09-13T21:40:24.646 INFO:tasks.workunit.client.0.smithi088.stdout:9/437: stat f17 0 2024-09-13T21:40:24.647 INFO:tasks.workunit.client.0.smithi088.stdout:1/500: mknod d9/d10/d2a/d4b/cab 0 2024-09-13T21:40:24.649 INFO:tasks.workunit.client.0.smithi088.stdout:6/547: mkdir d0/d2c/dad 0 2024-09-13T21:40:24.652 INFO:tasks.workunit.client.0.smithi088.stdout:8/473: dwrite db/df/f1f [4194304,4194304] 0 2024-09-13T21:40:24.654 INFO:tasks.workunit.client.0.smithi088.stdout:0/520: creat d7/d1d/d21/d82/fc5 x:0 0 0 2024-09-13T21:40:24.657 INFO:tasks.workunit.client.0.smithi088.stdout:4/483: rename d2/d5/d20/d60/de/d1e/d31/c47 to d2/d5/d20/d7f/ca5 0 2024-09-13T21:40:24.657 INFO:tasks.workunit.client.0.smithi088.stdout:4/484: stat d2/d5/d20/d60/de/d1e/d23/d3c/c92 0 2024-09-13T21:40:24.658 INFO:tasks.workunit.client.0.smithi088.stdout:3/544: mkdir d5/d23/d2a/d3f/d8f/da8 0 2024-09-13T21:40:24.660 INFO:tasks.workunit.client.0.smithi088.stdout:9/438: rmdir d1a/d3c/d51/d81 0 2024-09-13T21:40:24.661 INFO:tasks.workunit.client.0.smithi088.stdout:6/548: mknod d0/db/d37/cae 0 2024-09-13T21:40:24.671 INFO:tasks.workunit.client.0.smithi088.stdout:8/474: mkdir db/df/da7/daa 0 2024-09-13T21:40:24.671 INFO:tasks.workunit.client.0.smithi088.stdout:8/475: readlink db/df/da7/l34 0 2024-09-13T21:40:24.673 INFO:tasks.workunit.client.0.smithi088.stdout:0/521: unlink d7/d2c/cc3 0 2024-09-13T21:40:24.676 INFO:tasks.workunit.client.0.smithi088.stdout:2/555: rename d1/d8/d2e/d44/l71 to d1/d8/d24/lbd 0 2024-09-13T21:40:24.676 INFO:tasks.workunit.client.0.smithi088.stdout:2/556: truncate d1/d13/d3f/d99/f9d 422596 0 2024-09-13T21:40:24.677 INFO:tasks.workunit.client.0.smithi088.stdout:9/439: mkdir d1a/d61/d3d/d41/d48/d86 0 2024-09-13T21:40:24.678 INFO:tasks.workunit.client.0.smithi088.stdout:6/549: chown d0/l8 14571805 1 2024-09-13T21:40:24.680 INFO:tasks.workunit.client.0.smithi088.stdout:8/476: creat db/df/da7/d88/da8/fab x:0 0 0 2024-09-13T21:40:24.681 INFO:tasks.workunit.client.0.smithi088.stdout:0/522: unlink d7/d2c/d44/c72 0 2024-09-13T21:40:24.681 INFO:tasks.workunit.client.0.smithi088.stdout:0/523: chown d7/d1d/d26/d45/fbc 72 1 2024-09-13T21:40:24.683 INFO:tasks.workunit.client.0.smithi088.stdout:9/440: link d1a/d1b/c2f d1a/d3c/d85/c87 0 2024-09-13T21:40:24.685 INFO:tasks.workunit.client.0.smithi088.stdout:6/550: mkdir d0/d2c/d7a/daf 0 2024-09-13T21:40:24.685 INFO:tasks.workunit.client.0.smithi088.stdout:6/551: chown d0/d1e/l2f 452 1 2024-09-13T21:40:24.685 INFO:tasks.workunit.client.0.smithi088.stdout:6/552: truncate d0/d1e/f73 996384 0 2024-09-13T21:40:24.685 INFO:tasks.workunit.client.0.smithi088.stdout:6/553: write d0/d1e/f73 [1087964,103805] 0 2024-09-13T21:40:24.685 INFO:tasks.workunit.client.0.smithi088.stdout:8/477: creat db/d26/d37/d7d/fac x:0 0 0 2024-09-13T21:40:24.688 INFO:tasks.workunit.client.0.smithi088.stdout:2/557: write d1/d13/d3f/f43 [13454,12079] 0 2024-09-13T21:40:24.688 INFO:tasks.workunit.client.0.smithi088.stdout:2/558: chown d1/d8/d16/c28 415202 1 2024-09-13T21:40:24.688 INFO:tasks.workunit.client.0.smithi088.stdout:3/545: dwrite d5/d26/d43/f84 [0,4194304] 0 2024-09-13T21:40:24.688 INFO:tasks.workunit.client.0.smithi088.stdout:2/559: readlink d1/d8/d2e/d3b/l55 0 2024-09-13T21:40:24.688 INFO:tasks.workunit.client.0.smithi088.stdout:4/485: dwrite d2/d5/d20/d60/de/d1e/d23/f94 [0,4194304] 0 2024-09-13T21:40:24.688 INFO:tasks.workunit.client.0.smithi088.stdout:3/546: truncate d5/d23/d2a/d6b/f89 593577 0 2024-09-13T21:40:24.688 INFO:tasks.workunit.client.0.smithi088.stdout:4/486: write d2/d5/d20/d60/f2a [2254238,49776] 0 2024-09-13T21:40:24.689 INFO:tasks.workunit.client.0.smithi088.stdout:9/441: mknod d1a/d3c/c88 0 2024-09-13T21:40:24.689 INFO:tasks.workunit.client.0.smithi088.stdout:1/501: dwrite d9/d10/f11 [0,4194304] 0 2024-09-13T21:40:24.690 INFO:tasks.workunit.client.0.smithi088.stdout:8/478: mkdir db/d26/d2c/d85/dad 0 2024-09-13T21:40:24.695 INFO:tasks.workunit.client.0.smithi088.stdout:9/442: creat d1a/d61/f89 x:0 0 0 2024-09-13T21:40:24.696 INFO:tasks.workunit.client.0.smithi088.stdout:3/547: write d5/f22 [7074157,30122] 0 2024-09-13T21:40:24.697 INFO:tasks.workunit.client.0.smithi088.stdout:1/502: symlink d9/d4f/d64/lac 0 2024-09-13T21:40:24.697 INFO:tasks.workunit.client.0.smithi088.stdout:1/503: fsync d9/dc/f71 0 2024-09-13T21:40:24.697 INFO:tasks.workunit.client.0.smithi088.stdout:1/504: read d9/dc/f1f [1021185,2529] 0 2024-09-13T21:40:24.699 INFO:tasks.workunit.client.0.smithi088.stdout:2/560: rename d1/d8/d2e/d44/f54 to d1/d8/d2e/fbe 0 2024-09-13T21:40:24.700 INFO:tasks.workunit.client.0.smithi088.stdout:9/443: rmdir d1a/d61/d3d/d41/d48 39 2024-09-13T21:40:24.701 INFO:tasks.workunit.client.0.smithi088.stdout:9/444: chown d1a/d61/d3d/d41/f77 27 1 2024-09-13T21:40:24.701 INFO:tasks.workunit.client.0.smithi088.stdout:9/445: write f10 [3974779,111852] 0 2024-09-13T21:40:24.702 INFO:tasks.workunit.client.0.smithi088.stdout:1/505: mkdir d9/d10/d2a/d4b/d33/dad 0 2024-09-13T21:40:24.702 INFO:tasks.workunit.client.0.smithi088.stdout:1/506: stat d9/d10/d2a/d4b/d33/f59 0 2024-09-13T21:40:24.705 INFO:tasks.workunit.client.0.smithi088.stdout:4/487: rename d2/d5/d2d/f67 to d2/d13/fa6 0 2024-09-13T21:40:24.705 INFO:tasks.workunit.client.0.smithi088.stdout:9/446: creat d1a/d61/d3d/d41/f8a x:0 0 0 2024-09-13T21:40:24.709 INFO:tasks.workunit.client.0.smithi088.stdout:8/479: dread db/f17 [0,4194304] 0 2024-09-13T21:40:24.709 INFO:tasks.workunit.client.0.smithi088.stdout:8/480: write db/d26/fa5 [1002008,19152] 0 2024-09-13T21:40:24.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/524: dwrite d7/d1d/d27/f6f [0,4194304] 0 2024-09-13T21:40:24.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/525: write d7/d1d/f29 [3594033,4918] 0 2024-09-13T21:40:24.709 INFO:tasks.workunit.client.0.smithi088.stdout:4/488: link d2/d5/d20/d60/de/d1e/c96 d2/d5/d20/d60/de/d1e/d31/d61/ca7 0 2024-09-13T21:40:24.709 INFO:tasks.workunit.client.0.smithi088.stdout:1/507: rmdir d9/d10/d41/d7d 39 2024-09-13T21:40:24.711 INFO:tasks.workunit.client.0.smithi088.stdout:8/481: symlink db/d26/d2c/d85/dad/lae 0 2024-09-13T21:40:24.712 INFO:tasks.workunit.client.0.smithi088.stdout:1/508: read d9/d10/f11 [5636886,100677] 0 2024-09-13T21:40:24.714 INFO:tasks.workunit.client.0.smithi088.stdout:6/554: dwrite d0/db/f2e [0,4194304] 0 2024-09-13T21:40:24.715 INFO:tasks.workunit.client.0.smithi088.stdout:2/561: dread d1/f10 [0,4194304] 0 2024-09-13T21:40:24.723 INFO:tasks.workunit.client.0.smithi088.stdout:8/482: creat db/df/d61/d97/faf x:0 0 0 2024-09-13T21:40:24.725 INFO:tasks.workunit.client.0.smithi088.stdout:1/509: mkdir d9/d10/d2a/d4b/d33/d92/d8e/dae 0 2024-09-13T21:40:24.728 INFO:tasks.workunit.client.0.smithi088.stdout:0/526: rmdir d7/d1d/d21/d82 39 2024-09-13T21:40:24.730 INFO:tasks.workunit.client.0.smithi088.stdout:6/555: getdents d0/db 0 2024-09-13T21:40:24.730 INFO:tasks.workunit.client.0.smithi088.stdout:6/556: readlink d0/d2c/d32/d39/d3f/l4a 0 2024-09-13T21:40:24.737 INFO:tasks.workunit.client.0.smithi088.stdout:8/483: write db/df/f1f [2293900,120185] 0 2024-09-13T21:40:24.737 INFO:tasks.workunit.client.0.smithi088.stdout:8/484: mknod db/df/da7/d88/cb0 0 2024-09-13T21:40:24.737 INFO:tasks.workunit.client.0.smithi088.stdout:4/489: dwrite d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:24.738 INFO:tasks.workunit.client.0.smithi088.stdout:9/447: dwrite d1a/f49 [0,4194304] 0 2024-09-13T21:40:24.738 INFO:tasks.workunit.client.0.smithi088.stdout:9/448: stat d1a/d3c/d51/d5e/f7c 0 2024-09-13T21:40:24.738 INFO:tasks.workunit.client.0.smithi088.stdout:3/548: dwrite d5/d23/d2a/d3f/d76/d81/f9f [0,4194304] 0 2024-09-13T21:40:24.738 INFO:tasks.workunit.client.0.smithi088.stdout:3/549: stat d5/d23/d2a/d6b/d8b 0 2024-09-13T21:40:24.745 INFO:tasks.workunit.client.0.smithi088.stdout:0/527: write d7/d2c/d37/f7d [1769868,122491] 0 2024-09-13T21:40:24.749 INFO:tasks.workunit.client.0.smithi088.stdout:9/449: read d1a/d1b/f66 [2108901,97515] 0 2024-09-13T21:40:24.749 INFO:tasks.workunit.client.0.smithi088.stdout:1/510: dwrite d9/d10/d41/f9b [0,4194304] 0 2024-09-13T21:40:24.749 INFO:tasks.workunit.client.0.smithi088.stdout:1/511: fdatasync d9/f14 0 2024-09-13T21:40:24.749 INFO:tasks.workunit.client.0.smithi088.stdout:9/450: write f17 [1229562,96611] 0 2024-09-13T21:40:24.759 INFO:tasks.workunit.client.0.smithi088.stdout:0/528: write d7/d1d/d66/fab [3163284,73859] 0 2024-09-13T21:40:24.759 INFO:tasks.workunit.client.0.smithi088.stdout:5/588: sync 2024-09-13T21:40:24.762 INFO:tasks.workunit.client.0.smithi088.stdout:0/529: creat d7/d1d/d27/d43/fc6 x:0 0 0 2024-09-13T21:40:24.762 INFO:tasks.workunit.client.0.smithi088.stdout:0/530: fsync d7/d1d/d26/d34/f38 0 2024-09-13T21:40:24.763 INFO:tasks.workunit.client.0.smithi088.stdout:0/531: truncate d7/d1d/d26/d45/d7c/f86 2082526 0 2024-09-13T21:40:24.766 INFO:tasks.workunit.client.0.smithi088.stdout:3/550: truncate d5/d23/d2a/d3f/d76/d81/f9f 910292 0 2024-09-13T21:40:24.772 INFO:tasks.workunit.client.0.smithi088.stdout:7/452: sync 2024-09-13T21:40:24.772 INFO:tasks.workunit.client.0.smithi088.stdout:7/453: truncate d6/da/f10 1548943 0 2024-09-13T21:40:24.772 INFO:tasks.workunit.client.0.smithi088.stdout:7/454: stat d6/da/d1a/c4b 0 2024-09-13T21:40:24.778 INFO:tasks.workunit.client.0.smithi088.stdout:3/551: dread d5/d23/d2a/d3f/f7d [0,4194304] 0 2024-09-13T21:40:24.780 INFO:tasks.workunit.client.0.smithi088.stdout:3/552: unlink d5/d14/f54 0 2024-09-13T21:40:24.780 INFO:tasks.workunit.client.0.smithi088.stdout:7/455: write d6/da/fb [5183963,46703] 0 2024-09-13T21:40:24.783 INFO:tasks.workunit.client.0.smithi088.stdout:4/490: dwrite d2/d5/d20/d41/d4b/f7a [0,4194304] 0 2024-09-13T21:40:24.783 INFO:tasks.workunit.client.0.smithi088.stdout:4/491: stat d2/c5e 0 2024-09-13T21:40:24.783 INFO:tasks.workunit.client.0.smithi088.stdout:4/492: readlink d2/d13/l1f 0 2024-09-13T21:40:24.783 INFO:tasks.workunit.client.0.smithi088.stdout:4/493: write d2/d13/f86 [123877,12055] 0 2024-09-13T21:40:24.784 INFO:tasks.workunit.client.0.smithi088.stdout:2/562: dwrite d1/d13/d3f/f43 [0,4194304] 0 2024-09-13T21:40:24.784 INFO:tasks.workunit.client.0.smithi088.stdout:2/563: chown d1/fd 638 1 2024-09-13T21:40:24.784 INFO:tasks.workunit.client.0.smithi088.stdout:1/512: dwrite d9/d4f/f62 [0,4194304] 0 2024-09-13T21:40:24.785 INFO:tasks.workunit.client.0.smithi088.stdout:8/485: dwrite db/d26/f45 [0,4194304] 0 2024-09-13T21:40:24.785 INFO:tasks.workunit.client.0.smithi088.stdout:8/486: creat db/d26/d2c/fb1 x:0 0 0 2024-09-13T21:40:24.787 INFO:tasks.workunit.client.0.smithi088.stdout:2/564: truncate d1/d8/f57 684501 0 2024-09-13T21:40:24.793 INFO:tasks.workunit.client.0.smithi088.stdout:8/487: unlink db/c86 0 2024-09-13T21:40:24.799 INFO:tasks.workunit.client.0.smithi088.stdout:4/494: rmdir d2/d5/d20/d60 39 2024-09-13T21:40:24.801 INFO:tasks.workunit.client.0.smithi088.stdout:1/513: write d9/d10/d2a/d4b/d33/f84 [2086384,53994] 0 2024-09-13T21:40:24.801 INFO:tasks.workunit.client.0.smithi088.stdout:8/488: unlink db/d26/d2c/f4c 0 2024-09-13T21:40:24.801 INFO:tasks.workunit.client.0.smithi088.stdout:5/589: dwrite d4/d1c/d76/fa8 [0,4194304] 0 2024-09-13T21:40:24.801 INFO:tasks.workunit.client.0.smithi088.stdout:5/590: fsync f2 0 2024-09-13T21:40:24.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/514: rename d9/d10/d2a/f55 to d9/d10/d2a/d47/d9c/faf 0 2024-09-13T21:40:24.802 INFO:tasks.workunit.client.0.smithi088.stdout:8/489: truncate db/d26/d4f/f62 3756288 0 2024-09-13T21:40:24.802 INFO:tasks.workunit.client.0.smithi088.stdout:8/490: creat db/df/fb2 x:0 0 0 2024-09-13T21:40:24.804 INFO:tasks.workunit.client.0.smithi088.stdout:5/591: mknod d4/d1c/d24/d26/d40/cbd 0 2024-09-13T21:40:24.804 INFO:tasks.workunit.client.0.smithi088.stdout:1/515: creat d9/d10/d2a/d4b/d39/fb0 x:0 0 0 2024-09-13T21:40:24.806 INFO:tasks.workunit.client.0.smithi088.stdout:8/491: mkdir db/df/da7/d88/db3 0 2024-09-13T21:40:24.806 INFO:tasks.workunit.client.0.smithi088.stdout:8/492: truncate db/d26/fa5 1456913 0 2024-09-13T21:40:24.815 INFO:tasks.workunit.client.0.smithi088.stdout:0/532: dwrite d7/d1d/d27/f6f [4194304,4194304] 0 2024-09-13T21:40:24.815 INFO:tasks.workunit.client.0.smithi088.stdout:0/533: fdatasync d7/f46 0 2024-09-13T21:40:24.816 INFO:tasks.workunit.client.0.smithi088.stdout:4/495: write d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 [3933022,31319] 0 2024-09-13T21:40:24.816 INFO:tasks.workunit.client.0.smithi088.stdout:4/496: creat d2/d5/d2d/d70/fa8 x:0 0 0 2024-09-13T21:40:24.816 INFO:tasks.workunit.client.0.smithi088.stdout:9/451: dwrite f17 [0,4194304] 0 2024-09-13T21:40:24.816 INFO:tasks.workunit.client.0.smithi088.stdout:9/452: write d1a/f31 [4829493,75463] 0 2024-09-13T21:40:24.818 INFO:tasks.workunit.client.0.smithi088.stdout:0/534: creat d7/d2c/d78/daf/fc7 x:0 0 0 2024-09-13T21:40:24.818 INFO:tasks.workunit.client.0.smithi088.stdout:3/553: dwrite d5/d26/f70 [0,4194304] 0 2024-09-13T21:40:24.819 INFO:tasks.workunit.client.0.smithi088.stdout:2/565: dwrite d1/d8/d2e/f53 [0,4194304] 0 2024-09-13T21:40:24.819 INFO:tasks.workunit.client.0.smithi088.stdout:3/554: write d5/d23/d2a/f59 [3593209,118437] 0 2024-09-13T21:40:24.819 INFO:tasks.workunit.client.0.smithi088.stdout:5/592: dwrite d4/d1c/d24/fac [0,4194304] 0 2024-09-13T21:40:24.827 INFO:tasks.workunit.client.0.smithi088.stdout:0/535: symlink d7/d2c/d30/lc8 0 2024-09-13T21:40:24.839 INFO:tasks.workunit.client.0.smithi088.stdout:1/516: fsync d9/d10/d2a/d47/d9c/faf 0 2024-09-13T21:40:24.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/593: dread d4/d1c/d81/d89/d92/f3b [0,4194304] 0 2024-09-13T21:40:24.841 INFO:tasks.workunit.client.0.smithi088.stdout:5/594: write d4/d1c/d81/fae [468646,61498] 0 2024-09-13T21:40:24.842 INFO:tasks.workunit.client.0.smithi088.stdout:5/595: creat d4/d1c/d4a/fbe x:0 0 0 2024-09-13T21:40:24.845 INFO:tasks.workunit.client.0.smithi088.stdout:3/555: dwrite d5/d23/d2a/d3f/fa0 [0,4194304] 0 2024-09-13T21:40:24.850 INFO:tasks.workunit.client.0.smithi088.stdout:9/453: mknod d1a/c8b 0 2024-09-13T21:40:24.854 INFO:tasks.workunit.client.0.smithi088.stdout:0/536: rename d7/d1d/d26/lc2 to d7/d2c/d30/lc9 0 2024-09-13T21:40:24.854 INFO:tasks.workunit.client.0.smithi088.stdout:0/537: write d7/d2c/d30/d31/d42/d4b/f85 [736877,12201] 0 2024-09-13T21:40:24.854 INFO:tasks.workunit.client.0.smithi088.stdout:0/538: dread - d7/fa9 zero size 2024-09-13T21:40:24.857 INFO:tasks.workunit.client.0.smithi088.stdout:8/493: write db/d26/d4f/f62 [480237,20787] 0 2024-09-13T21:40:24.857 INFO:tasks.workunit.client.0.smithi088.stdout:8/494: fsync db/d26/d2c/d85/f5c 0 2024-09-13T21:40:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:9/454: creat d1a/d1b/f8c x:0 0 0 2024-09-13T21:40:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:9/455: chown d1a/d3c/d85 12599 1 2024-09-13T21:40:24.858 INFO:tasks.workunit.client.0.smithi088.stdout:9/456: dread - d1a/d61/d3d/d41/f8a zero size 2024-09-13T21:40:24.861 INFO:tasks.workunit.client.0.smithi088.stdout:2/566: dwrite d1/d8/d2e/fbe [0,4194304] 0 2024-09-13T21:40:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:8/495: dread db/d26/d37/f46 [0,4194304] 0 2024-09-13T21:40:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:8/496: chown db/d26/d2c/l31 44 1 2024-09-13T21:40:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:1/517: dwrite d9/d10/d2a/fa1 [0,4194304] 0 2024-09-13T21:40:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:1/518: dread - d9/d10/d2a/d4b/d39/fb0 zero size 2024-09-13T21:40:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:1/519: truncate d9/dc/d74/f87 1036377 0 2024-09-13T21:40:24.862 INFO:tasks.workunit.client.0.smithi088.stdout:3/556: mkdir d5/d5a/d92/da9 0 2024-09-13T21:40:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:9/457: getdents d1a/d3c/d51/d5e/d72 0 2024-09-13T21:40:24.864 INFO:tasks.workunit.client.0.smithi088.stdout:9/458: chown d1a/d1b/f28 477531217 1 2024-09-13T21:40:24.867 INFO:tasks.workunit.client.0.smithi088.stdout:8/497: mkdir db/df/da7/d88/da8/db4 0 2024-09-13T21:40:24.870 INFO:tasks.workunit.client.0.smithi088.stdout:2/567: write d1/d13/d2a/d41/d48/da0/fa9 [2151383,120382] 0 2024-09-13T21:40:24.871 INFO:tasks.workunit.client.0.smithi088.stdout:0/539: dwrite d7/d1d/d27/f6f [4194304,4194304] 0 2024-09-13T21:40:24.874 INFO:tasks.workunit.client.0.smithi088.stdout:1/520: unlink d9/dc/l2d 0 2024-09-13T21:40:24.877 INFO:tasks.workunit.client.0.smithi088.stdout:9/459: link d1a/d1b/l71 d1a/d61/d3d/d75/l8d 0 2024-09-13T21:40:24.881 INFO:tasks.workunit.client.0.smithi088.stdout:5/596: rename d4/d1c/d81 to d4/d1c/d24/d26/dbf 0 2024-09-13T21:40:24.883 INFO:tasks.workunit.client.0.smithi088.stdout:8/498: read db/d26/d2c/d85/d51/f71 [2199810,79683] 0 2024-09-13T21:40:24.885 INFO:tasks.workunit.client.0.smithi088.stdout:5/597: dread d4/d1c/d24/d26/dbf/fae [0,4194304] 0 2024-09-13T21:40:24.885 INFO:tasks.workunit.client.0.smithi088.stdout:5/598: chown d4/d1c/d24/l29 2 1 2024-09-13T21:40:24.888 INFO:tasks.workunit.client.0.smithi088.stdout:2/568: creat d1/d13/d3f/d99/d9c/fbf x:0 0 0 2024-09-13T21:40:24.890 INFO:tasks.workunit.client.0.smithi088.stdout:1/521: mknod d9/d10/d2a/d4b/d33/d92/d8e/dae/cb1 0 2024-09-13T21:40:24.894 INFO:tasks.workunit.client.0.smithi088.stdout:5/599: creat d4/d1c/d24/d26/d4b/d67/db2/fc0 x:0 0 0 2024-09-13T21:40:24.895 INFO:tasks.workunit.client.0.smithi088.stdout:2/569: symlink d1/d8/d16/d40/d7e/lc0 0 2024-09-13T21:40:24.896 INFO:tasks.workunit.client.0.smithi088.stdout:1/522: mkdir d9/d10/d2a/d4b/d39/d43/db2 0 2024-09-13T21:40:24.896 INFO:tasks.workunit.client.0.smithi088.stdout:1/523: write d9/d10/d2a/d4b/d39/d43/f93 [1143788,1370] 0 2024-09-13T21:40:24.900 INFO:tasks.workunit.client.0.smithi088.stdout:3/557: dwrite d5/d23/d2a/d3f/f64 [0,4194304] 0 2024-09-13T21:40:24.902 INFO:tasks.workunit.client.0.smithi088.stdout:9/460: dwrite d1a/f49 [0,4194304] 0 2024-09-13T21:40:24.903 INFO:tasks.workunit.client.0.smithi088.stdout:8/499: dwrite db/d26/d2c/d85/d51/f71 [4194304,4194304] 0 2024-09-13T21:40:24.903 INFO:tasks.workunit.client.0.smithi088.stdout:8/500: chown db/df/l44 55006577 1 2024-09-13T21:40:24.904 INFO:tasks.workunit.client.0.smithi088.stdout:6/557: sync 2024-09-13T21:40:24.905 INFO:tasks.workunit.client.0.smithi088.stdout:2/570: dread d1/d8/d2e/d3b/f6f [0,4194304] 0 2024-09-13T21:40:24.906 INFO:tasks.workunit.client.0.smithi088.stdout:2/571: readlink d1/d13/d2a/d3c/d4a/l9b 0 2024-09-13T21:40:24.907 INFO:tasks.workunit.client.0.smithi088.stdout:8/501: mknod db/df/da7/d88/db3/cb5 0 2024-09-13T21:40:24.907 INFO:tasks.workunit.client.0.smithi088.stdout:8/502: dread - db/f82 zero size 2024-09-13T21:40:24.907 INFO:tasks.workunit.client.0.smithi088.stdout:8/503: truncate db/f9b 462287 0 2024-09-13T21:40:24.908 INFO:tasks.workunit.client.0.smithi088.stdout:1/524: getdents d9/d10/d2a/d4b/d33/d92/d8e/dae 0 2024-09-13T21:40:24.911 INFO:tasks.workunit.client.0.smithi088.stdout:6/558: truncate d0/d1e/d1f/f4e 1362786 0 2024-09-13T21:40:24.914 INFO:tasks.workunit.client.0.smithi088.stdout:2/572: symlink d1/d13/d2a/d3c/d4a/d6e/d76/lc1 0 2024-09-13T21:40:24.914 INFO:tasks.workunit.client.0.smithi088.stdout:2/573: chown d1/d13/d2a/d3c/fb9 49947 1 2024-09-13T21:40:24.914 INFO:tasks.workunit.client.0.smithi088.stdout:2/574: stat d1/d8/d2e/d91/f95 0 2024-09-13T21:40:24.915 INFO:tasks.workunit.client.0.smithi088.stdout:8/504: getdents db/df/da7 0 2024-09-13T21:40:24.916 INFO:tasks.workunit.client.0.smithi088.stdout:3/558: rename d5/d26 to d5/d23/d2a/d6b/d98/da1/daa 0 2024-09-13T21:40:24.916 INFO:tasks.workunit.client.0.smithi088.stdout:1/525: dread d9/f60 [0,4194304] 0 2024-09-13T21:40:24.917 INFO:tasks.workunit.client.0.smithi088.stdout:6/559: symlink d0/d2c/dad/lb0 0 2024-09-13T21:40:24.919 INFO:tasks.workunit.client.0.smithi088.stdout:2/575: symlink d1/d13/d2a/d41/d48/da0/lc2 0 2024-09-13T21:40:24.919 INFO:tasks.workunit.client.0.smithi088.stdout:2/576: fdatasync d1/d13/f1a 0 2024-09-13T21:40:24.919 INFO:tasks.workunit.client.0.smithi088.stdout:3/559: dread d5/d23/d2a/d6b/f5d [0,4194304] 0 2024-09-13T21:40:24.920 INFO:tasks.workunit.client.0.smithi088.stdout:6/560: mkdir d0/d2c/d7f/db1 0 2024-09-13T21:40:24.926 INFO:tasks.workunit.client.0.smithi088.stdout:1/526: dread d9/d10/d41/f9b [0,4194304] 0 2024-09-13T21:40:24.933 INFO:tasks.workunit.client.0.smithi088.stdout:3/560: write d5/d14/f37 [2499301,47150] 0 2024-09-13T21:40:24.933 INFO:tasks.workunit.client.0.smithi088.stdout:3/561: write d5/d5a/f73 [1518077,4694] 0 2024-09-13T21:40:24.933 INFO:tasks.workunit.client.0.smithi088.stdout:3/562: chown d5/d23/d2a/d55/f7b 23517116 1 2024-09-13T21:40:24.933 INFO:tasks.workunit.client.0.smithi088.stdout:3/563: chown d5/d23/d2a/d63/f46 0 1 2024-09-13T21:40:24.934 INFO:tasks.workunit.client.0.smithi088.stdout:3/564: write d5/f22 [4834649,130979] 0 2024-09-13T21:40:24.940 INFO:tasks.workunit.client.0.smithi088.stdout:2/577: dread d1/d8/d16/f5c [0,4194304] 0 2024-09-13T21:40:24.944 INFO:tasks.workunit.client.0.smithi088.stdout:8/505: dwrite db/df/f3d [0,4194304] 0 2024-09-13T21:40:24.945 INFO:tasks.workunit.client.0.smithi088.stdout:8/506: mknod db/d26/d4f/cb6 0 2024-09-13T21:40:24.946 INFO:tasks.workunit.client.0.smithi088.stdout:8/507: mkdir db/d26/d2c/db7 0 2024-09-13T21:40:24.947 INFO:tasks.workunit.client.0.smithi088.stdout:8/508: stat db/d26/d37/d7d/l8a 0 2024-09-13T21:40:24.947 INFO:tasks.workunit.client.0.smithi088.stdout:8/509: write db/df/d61/fa2 [911249,95800] 0 2024-09-13T21:40:24.947 INFO:tasks.workunit.client.0.smithi088.stdout:8/510: stat db/df/d61/fa2 0 2024-09-13T21:40:24.947 INFO:tasks.workunit.client.0.smithi088.stdout:8/511: chown db/d26/f35 0 1 2024-09-13T21:40:24.950 INFO:tasks.workunit.client.0.smithi088.stdout:6/561: dwrite d0/d28/f80 [4194304,4194304] 0 2024-09-13T21:40:24.956 INFO:tasks.workunit.client.0.smithi088.stdout:1/527: dwrite d9/d10/d41/d7d/fa4 [0,4194304] 0 2024-09-13T21:40:24.957 INFO:tasks.workunit.client.0.smithi088.stdout:3/565: dwrite d5/d23/d2a/d63/d48/d49/fa7 [0,4194304] 0 2024-09-13T21:40:24.959 INFO:tasks.workunit.client.0.smithi088.stdout:6/562: write d0/d1e/d1f/fa2 [965847,1245] 0 2024-09-13T21:40:24.963 INFO:tasks.workunit.client.0.smithi088.stdout:6/563: link d0/d1e/d1f/f90 d0/d2c/d32/d39/d3f/d71/d81/fb2 0 2024-09-13T21:40:24.963 INFO:tasks.workunit.client.0.smithi088.stdout:6/564: fsync d0/d1e/f73 0 2024-09-13T21:40:24.965 INFO:tasks.workunit.client.0.smithi088.stdout:6/565: write d0/d1e/f24 [612317,52433] 0 2024-09-13T21:40:24.965 INFO:tasks.workunit.client.0.smithi088.stdout:8/512: dwrite db/df/d61/f6a [0,4194304] 0 2024-09-13T21:40:24.965 INFO:tasks.workunit.client.0.smithi088.stdout:6/566: mkdir d0/d2c/dad/db3 0 2024-09-13T21:40:24.969 INFO:tasks.workunit.client.0.smithi088.stdout:8/513: rename db/c94 to db/df/da7/cb8 0 2024-09-13T21:40:24.969 INFO:tasks.workunit.client.0.smithi088.stdout:8/514: chown db/df/d61/d97 188335470 1 2024-09-13T21:40:24.969 INFO:tasks.workunit.client.0.smithi088.stdout:8/515: read - db/d26/d2c/f5a zero size 2024-09-13T21:40:24.970 INFO:tasks.workunit.client.0.smithi088.stdout:8/516: write db/d26/d2c/f87 [740615,11192] 0 2024-09-13T21:40:24.970 INFO:tasks.workunit.client.0.smithi088.stdout:7/456: sync 2024-09-13T21:40:24.971 INFO:tasks.workunit.client.0.smithi088.stdout:8/517: mknod db/df/d61/cb9 0 2024-09-13T21:40:24.972 INFO:tasks.workunit.client.0.smithi088.stdout:7/457: mknod d6/d5f/d69/d4f/d6f/c99 0 2024-09-13T21:40:24.973 INFO:tasks.workunit.client.0.smithi088.stdout:7/458: write d6/da/d44/f75 [691623,41181] 0 2024-09-13T21:40:24.973 INFO:tasks.workunit.client.0.smithi088.stdout:7/459: truncate d6/f53 3267869 0 2024-09-13T21:40:24.976 INFO:tasks.workunit.client.0.smithi088.stdout:7/460: creat d6/d5f/d69/f9a x:0 0 0 2024-09-13T21:40:24.976 INFO:tasks.workunit.client.0.smithi088.stdout:7/461: write d6/d5f/d81/f85 [1431394,27322] 0 2024-09-13T21:40:24.976 INFO:tasks.workunit.client.0.smithi088.stdout:7/462: creat d6/d4e/f9b x:0 0 0 2024-09-13T21:40:24.978 INFO:tasks.workunit.client.0.smithi088.stdout:7/463: rmdir d6/d5f/d81 39 2024-09-13T21:40:24.979 INFO:tasks.workunit.client.0.smithi088.stdout:7/464: rmdir d6/da 39 2024-09-13T21:40:24.979 INFO:tasks.workunit.client.0.smithi088.stdout:3/566: dwrite d5/d5a/d92/f96 [0,4194304] 0 2024-09-13T21:40:24.981 INFO:tasks.workunit.client.0.smithi088.stdout:1/528: dwrite d9/d10/d2a/d4b/d33/f76 [0,4194304] 0 2024-09-13T21:40:24.982 INFO:tasks.workunit.client.0.smithi088.stdout:7/465: symlink d6/da/d1a/d3a/d5c/l9c 0 2024-09-13T21:40:24.982 INFO:tasks.workunit.client.0.smithi088.stdout:7/466: fsync d6/f1c 0 2024-09-13T21:40:24.988 INFO:tasks.workunit.client.0.smithi088.stdout:3/567: link d5/d23/d2a/d6b/d98/da1/daa/d43/f83 d5/d23/d2a/d3f/d8f/da3/fab 0 2024-09-13T21:40:24.989 INFO:tasks.workunit.client.0.smithi088.stdout:3/568: dread - d5/d23/f57 zero size 2024-09-13T21:40:24.994 INFO:tasks.workunit.client.0.smithi088.stdout:3/569: dread d5/d23/d2a/d63/d48/f9a [0,4194304] 0 2024-09-13T21:40:24.996 INFO:tasks.workunit.client.0.smithi088.stdout:1/529: symlink d9/d10/d2a/d4b/d33/d92/d8e/dae/lb3 0 2024-09-13T21:40:24.997 INFO:tasks.workunit.client.0.smithi088.stdout:7/467: symlink d6/d5f/l9d 0 2024-09-13T21:40:24.999 INFO:tasks.workunit.client.0.smithi088.stdout:3/570: creat d5/d23/d2a/d55/fac x:0 0 0 2024-09-13T21:40:24.999 INFO:tasks.workunit.client.0.smithi088.stdout:3/571: write d5/d23/d2a/d6b/d98/da1/daa/d43/f83 [4687248,13234] 0 2024-09-13T21:40:25.000 INFO:tasks.workunit.client.0.smithi088.stdout:3/572: readlink d5/l45 0 2024-09-13T21:40:25.001 INFO:tasks.workunit.client.0.smithi088.stdout:6/567: dwrite d0/d1e/d1f/fa2 [0,4194304] 0 2024-09-13T21:40:25.001 INFO:tasks.workunit.client.0.smithi088.stdout:6/568: write d0/db/f82 [919543,64102] 0 2024-09-13T21:40:25.002 INFO:tasks.workunit.client.0.smithi088.stdout:3/573: rename d5/d23/d2a/d6b/d98/da1/daa/c4b to d5/d23/d2a/d6b/d98/da1/cad 0 2024-09-13T21:40:25.002 INFO:tasks.workunit.client.0.smithi088.stdout:3/574: creat d5/d23/d2a/d6b/fae x:0 0 0 2024-09-13T21:40:25.017 INFO:tasks.workunit.client.0.smithi088.stdout:8/518: dwrite db/d26/d2c/f87 [0,4194304] 0 2024-09-13T21:40:25.017 INFO:tasks.workunit.client.0.smithi088.stdout:1/530: write d9/d10/d2a/d4b/d33/f91 [460616,43852] 0 2024-09-13T21:40:25.022 INFO:tasks.workunit.client.0.smithi088.stdout:1/531: rename d9/d10/d2a/d4b/d61/f9a to d9/d10/d9f/fb4 0 2024-09-13T21:40:25.022 INFO:tasks.workunit.client.0.smithi088.stdout:1/532: readlink d9/dc/l95 0 2024-09-13T21:40:25.022 INFO:tasks.workunit.client.0.smithi088.stdout:7/468: dread d6/da/f19 [0,4194304] 0 2024-09-13T21:40:25.024 INFO:tasks.workunit.client.0.smithi088.stdout:7/469: creat d6/da/d1a/d3a/d5c/d60/f9e x:0 0 0 2024-09-13T21:40:25.024 INFO:tasks.workunit.client.0.smithi088.stdout:7/470: chown d6/da/d1a/c23 2918581 1 2024-09-13T21:40:25.036 INFO:tasks.workunit.client.0.smithi088.stdout:1/533: dread d9/f19 [0,4194304] 0 2024-09-13T21:40:25.036 INFO:tasks.workunit.client.0.smithi088.stdout:1/534: fdatasync d9/d10/d41/d7d/fa4 0 2024-09-13T21:40:25.036 INFO:tasks.workunit.client.0.smithi088.stdout:1/535: mkdir d9/d10/d2a/d47/d9c/db5 0 2024-09-13T21:40:25.037 INFO:tasks.workunit.client.0.smithi088.stdout:1/536: symlink d9/d10/d2a/d4b/d3a/lb6 0 2024-09-13T21:40:25.038 INFO:tasks.workunit.client.0.smithi088.stdout:1/537: mkdir d9/d10/d2a/d47/d9c/db7 0 2024-09-13T21:40:25.052 INFO:tasks.workunit.client.0.smithi088.stdout:8/519: dwrite db/d26/d4f/f66 [0,4194304] 0 2024-09-13T21:40:25.052 INFO:tasks.workunit.client.0.smithi088.stdout:7/471: dwrite d6/da/f10 [0,4194304] 0 2024-09-13T21:40:25.053 INFO:tasks.workunit.client.0.smithi088.stdout:6/569: dwrite d0/d1e/d1f/f70 [0,4194304] 0 2024-09-13T21:40:25.054 INFO:tasks.workunit.client.0.smithi088.stdout:8/520: mkdir db/d26/d2c/db7/dba 0 2024-09-13T21:40:25.054 INFO:tasks.workunit.client.0.smithi088.stdout:3/575: dwrite d5/d23/f57 [0,4194304] 0 2024-09-13T21:40:25.064 INFO:tasks.workunit.client.0.smithi088.stdout:1/538: dwrite d9/d10/d2a/d4b/d33/d92/d8e/fa9 [0,4194304] 0 2024-09-13T21:40:25.064 INFO:tasks.workunit.client.0.smithi088.stdout:1/539: write d9/d10/d2a/d4b/d39/d43/f93 [5839774,62988] 0 2024-09-13T21:40:25.065 INFO:tasks.workunit.client.0.smithi088.stdout:8/521: rename db/d26/d2c/d85/f53 to db/d26/d2c/db7/fbb 0 2024-09-13T21:40:25.069 INFO:tasks.workunit.client.0.smithi088.stdout:6/570: getdents d0/db/d37 0 2024-09-13T21:40:25.072 INFO:tasks.workunit.client.0.smithi088.stdout:4/497: sync 2024-09-13T21:40:25.072 INFO:tasks.workunit.client.0.smithi088.stdout:0/540: sync 2024-09-13T21:40:25.072 INFO:tasks.workunit.client.0.smithi088.stdout:2/578: sync 2024-09-13T21:40:25.072 INFO:tasks.workunit.client.0.smithi088.stdout:0/541: read d7/d1d/d27/f64 [723513,13667] 0 2024-09-13T21:40:25.072 INFO:tasks.workunit.client.0.smithi088.stdout:0/542: dread - d7/d65/d8c/fb9 zero size 2024-09-13T21:40:25.072 INFO:tasks.workunit.client.0.smithi088.stdout:0/543: truncate d7/f91 870016 0 2024-09-13T21:40:25.072 INFO:tasks.workunit.client.0.smithi088.stdout:0/544: write d7/d65/f92 [764466,35008] 0 2024-09-13T21:40:25.074 INFO:tasks.workunit.client.0.smithi088.stdout:6/571: rename d0/d2c/d32/d39/d3f/d71/d81/c99 to d0/d2c/d7f/cb4 0 2024-09-13T21:40:25.074 INFO:tasks.workunit.client.0.smithi088.stdout:6/572: creat d0/d2c/fb5 x:0 0 0 2024-09-13T21:40:25.075 INFO:tasks.workunit.client.0.smithi088.stdout:6/573: read d0/d2c/d32/d39/faa [51115,78849] 0 2024-09-13T21:40:25.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/579: mkdir d1/d13/d2a/d3c/d4a/d6e/d5b/dc3 0 2024-09-13T21:40:25.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/580: chown d1/d13/d2a/l63 48990 1 2024-09-13T21:40:25.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/581: fdatasync d1/d13/d3f/f43 0 2024-09-13T21:40:25.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/582: chown d1/d13/d2a/d3c/d4a/d6e/d5b/l6d 107561243 1 2024-09-13T21:40:25.079 INFO:tasks.workunit.client.0.smithi088.stdout:7/472: dwrite d6/d4e/f8f [0,4194304] 0 2024-09-13T21:40:25.079 INFO:tasks.workunit.client.0.smithi088.stdout:0/545: mkdir d7/d1d/d21/d82/dca 0 2024-09-13T21:40:25.079 INFO:tasks.workunit.client.0.smithi088.stdout:6/574: dread d0/d2c/d32/d39/d3f/d71/fab [0,4194304] 0 2024-09-13T21:40:25.080 INFO:tasks.workunit.client.0.smithi088.stdout:3/576: dwrite d5/d23/d2a/d63/f97 [0,4194304] 0 2024-09-13T21:40:25.080 INFO:tasks.workunit.client.0.smithi088.stdout:4/498: rename d2/d5/d20/d41/d4b/f4f to d2/d5/d20/d60/de/d1e/fa9 0 2024-09-13T21:40:25.082 INFO:tasks.workunit.client.0.smithi088.stdout:2/583: symlink d1/d13/d2a/d3c/d4a/d6e/d5b/dc3/lc4 0 2024-09-13T21:40:25.082 INFO:tasks.workunit.client.0.smithi088.stdout:5/600: sync 2024-09-13T21:40:25.082 INFO:tasks.workunit.client.0.smithi088.stdout:9/461: sync 2024-09-13T21:40:25.083 INFO:tasks.workunit.client.0.smithi088.stdout:9/462: fdatasync d1a/d1b/f22 0 2024-09-13T21:40:25.084 INFO:tasks.workunit.client.0.smithi088.stdout:7/473: unlink d6/l7 0 2024-09-13T21:40:25.085 INFO:tasks.workunit.client.0.smithi088.stdout:6/575: creat d0/d2c/d7a/fb6 x:0 0 0 2024-09-13T21:40:25.085 INFO:tasks.workunit.client.0.smithi088.stdout:6/576: truncate d0/d1e/fa1 100203 0 2024-09-13T21:40:25.085 INFO:tasks.workunit.client.0.smithi088.stdout:6/577: fdatasync d0/d1e/d1f/f51 0 2024-09-13T21:40:25.085 INFO:tasks.workunit.client.0.smithi088.stdout:6/578: readlink d0/d1e/l44 0 2024-09-13T21:40:25.086 INFO:tasks.workunit.client.0.smithi088.stdout:4/499: creat d2/d5/d20/d41/d4b/d98/faa x:0 0 0 2024-09-13T21:40:25.086 INFO:tasks.workunit.client.0.smithi088.stdout:2/584: rmdir d1/d8/d16/d40 39 2024-09-13T21:40:25.086 INFO:tasks.workunit.client.0.smithi088.stdout:2/585: truncate d1/d13/d2a/d3c/d4a/fa2 979906 0 2024-09-13T21:40:25.088 INFO:tasks.workunit.client.0.smithi088.stdout:5/601: link d4/d1c/d24/d26/d4b/c5b d4/d1b/d68/cc1 0 2024-09-13T21:40:25.089 INFO:tasks.workunit.client.0.smithi088.stdout:4/500: mkdir d2/d11/dab 0 2024-09-13T21:40:25.089 INFO:tasks.workunit.client.0.smithi088.stdout:4/501: readlink d2/d5/d20/d41/l42 0 2024-09-13T21:40:25.089 INFO:tasks.workunit.client.0.smithi088.stdout:2/586: symlink d1/d13/d2a/d3c/d4a/d6e/d5b/lc5 0 2024-09-13T21:40:25.090 INFO:tasks.workunit.client.0.smithi088.stdout:0/546: read d7/d1d/d27/d43/f17 [1507235,114378] 0 2024-09-13T21:40:25.091 INFO:tasks.workunit.client.0.smithi088.stdout:3/577: write d5/d23/d2a/d3f/d8f/da3/fab [2483020,84472] 0 2024-09-13T21:40:25.091 INFO:tasks.workunit.client.0.smithi088.stdout:4/502: mknod d2/d13/cac 0 2024-09-13T21:40:25.091 INFO:tasks.workunit.client.0.smithi088.stdout:3/578: chown d5/d23/d2a/d6b/d98/da1/daa/d43/f83 9 1 2024-09-13T21:40:25.093 INFO:tasks.workunit.client.0.smithi088.stdout:0/547: rmdir d7/d2c/d37 39 2024-09-13T21:40:25.093 INFO:tasks.workunit.client.0.smithi088.stdout:0/548: truncate d7/d2c/d30/d31/d42/d95/fc4 735642 0 2024-09-13T21:40:25.096 INFO:tasks.workunit.client.0.smithi088.stdout:5/602: rmdir d4/d1c/d24/d26/d4b/d67/db2 39 2024-09-13T21:40:25.097 INFO:tasks.workunit.client.0.smithi088.stdout:2/587: rmdir d1/d13/d3f/d99 39 2024-09-13T21:40:25.097 INFO:tasks.workunit.client.0.smithi088.stdout:2/588: chown d1/d8/d24/f39 692422 1 2024-09-13T21:40:25.101 INFO:tasks.workunit.client.0.smithi088.stdout:0/549: link d7/f9 d7/d1d/d21/d82/dca/fcb 0 2024-09-13T21:40:25.104 INFO:tasks.workunit.client.0.smithi088.stdout:5/603: link d4/d1c/d24/d26/d40/fa d4/da7/fc2 0 2024-09-13T21:40:25.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/589: creat d1/d8/d24/fc6 x:0 0 0 2024-09-13T21:40:25.108 INFO:tasks.workunit.client.0.smithi088.stdout:2/590: readlink d1/d8/d24/lbd 0 2024-09-13T21:40:25.110 INFO:tasks.workunit.client.0.smithi088.stdout:0/550: mknod d7/d2c/d78/daf/ccc 0 2024-09-13T21:40:25.112 INFO:tasks.workunit.client.0.smithi088.stdout:8/522: dwrite db/df/d61/f81 [0,4194304] 0 2024-09-13T21:40:25.113 INFO:tasks.workunit.client.0.smithi088.stdout:5/604: creat d4/d1c/d24/d95/da6/fc3 x:0 0 0 2024-09-13T21:40:25.113 INFO:tasks.workunit.client.0.smithi088.stdout:5/605: stat d4/d1c/d4a/fa2 0 2024-09-13T21:40:25.116 INFO:tasks.workunit.client.0.smithi088.stdout:2/591: creat d1/d13/d2a/d3c/d4a/d6e/fc7 x:0 0 0 2024-09-13T21:40:25.118 INFO:tasks.workunit.client.0.smithi088.stdout:2/592: dread d1/d8/d24/f39 [0,4194304] 0 2024-09-13T21:40:25.118 INFO:tasks.workunit.client.0.smithi088.stdout:2/593: stat d1/d8/d16/d40/d7e/lc0 0 2024-09-13T21:40:25.120 INFO:tasks.workunit.client.0.smithi088.stdout:1/540: dwrite d9/d10/f11 [0,4194304] 0 2024-09-13T21:40:25.123 INFO:tasks.workunit.client.0.smithi088.stdout:2/594: rename d1/d8/d24/lbd to d1/d13/d2a/d3c/d4a/d6e/d66/lc8 0 2024-09-13T21:40:25.125 INFO:tasks.workunit.client.0.smithi088.stdout:3/579: dwrite d5/d23/d2a/d6b/f89 [0,4194304] 0 2024-09-13T21:40:25.127 INFO:tasks.workunit.client.0.smithi088.stdout:1/541: symlink d9/d10/d41/d7d/lb8 0 2024-09-13T21:40:25.132 INFO:tasks.workunit.client.0.smithi088.stdout:1/542: creat d9/dc/fb9 x:0 0 0 2024-09-13T21:40:25.138 INFO:tasks.workunit.client.0.smithi088.stdout:1/543: dread d9/d10/d2a/d4b/f23 [0,4194304] 0 2024-09-13T21:40:25.144 INFO:tasks.workunit.client.0.smithi088.stdout:1/544: write d9/d10/d41/f9b [2616180,56456] 0 2024-09-13T21:40:25.144 INFO:tasks.workunit.client.0.smithi088.stdout:7/474: dwrite d6/da/f19 [4194304,4194304] 0 2024-09-13T21:40:25.144 INFO:tasks.workunit.client.0.smithi088.stdout:4/503: dwrite d2/f15 [4194304,4194304] 0 2024-09-13T21:40:25.145 INFO:tasks.workunit.client.0.smithi088.stdout:7/475: link d6/d5f/d69/d4f/c3e d6/d5f/d69/d45/c9f 0 2024-09-13T21:40:25.145 INFO:tasks.workunit.client.0.smithi088.stdout:7/476: getdents d6/da/d1a/d3a/d5c 0 2024-09-13T21:40:25.152 INFO:tasks.workunit.client.0.smithi088.stdout:2/595: dwrite d1/d8/d16/f5c [0,4194304] 0 2024-09-13T21:40:25.152 INFO:tasks.workunit.client.0.smithi088.stdout:4/504: dread d2/d11/f16 [0,4194304] 0 2024-09-13T21:40:25.154 INFO:tasks.workunit.client.0.smithi088.stdout:8/523: dwrite db/f17 [4194304,4194304] 0 2024-09-13T21:40:25.154 INFO:tasks.workunit.client.0.smithi088.stdout:9/463: dwrite d1a/f80 [0,4194304] 0 2024-09-13T21:40:25.156 INFO:tasks.workunit.client.0.smithi088.stdout:2/596: mknod d1/d13/d2a/d3c/d4a/d6e/d66/d84/cc9 0 2024-09-13T21:40:25.156 INFO:tasks.workunit.client.0.smithi088.stdout:4/505: unlink d2/d5/d20/d60/de/d1e/d23/d6f/l8a 0 2024-09-13T21:40:25.156 INFO:tasks.workunit.client.0.smithi088.stdout:3/580: dwrite d5/d23/d2a/d63/d31/f5f [0,4194304] 0 2024-09-13T21:40:25.156 INFO:tasks.workunit.client.0.smithi088.stdout:3/581: dread - d5/d23/d2a/d63/d31/f7e zero size 2024-09-13T21:40:25.159 INFO:tasks.workunit.client.0.smithi088.stdout:1/545: dread d9/d10/d2a/d4b/d33/d92/d8e/fa9 [0,4194304] 0 2024-09-13T21:40:25.159 INFO:tasks.workunit.client.0.smithi088.stdout:0/551: dwrite d7/d2c/d30/d31/d42/fad [0,4194304] 0 2024-09-13T21:40:25.160 INFO:tasks.workunit.client.0.smithi088.stdout:5/606: rmdir d4/da7 39 2024-09-13T21:40:25.162 INFO:tasks.workunit.client.0.smithi088.stdout:8/524: creat db/df/da7/d88/da8/db4/fbc x:0 0 0 2024-09-13T21:40:25.166 INFO:tasks.workunit.client.0.smithi088.stdout:4/506: rmdir d2/d5/d20/d60/de/d1e/d31 39 2024-09-13T21:40:25.166 INFO:tasks.workunit.client.0.smithi088.stdout:4/507: readlink d2/d5/d20/d60/de/d1e/d23/d6f/l36 0 2024-09-13T21:40:25.167 INFO:tasks.workunit.client.0.smithi088.stdout:4/508: write d2/d5/d20/d60/f2a [1265758,89070] 0 2024-09-13T21:40:25.167 INFO:tasks.workunit.client.0.smithi088.stdout:7/477: dwrite d6/d5f/d69/d4f/d6f/f92 [0,4194304] 0 2024-09-13T21:40:25.167 INFO:tasks.workunit.client.0.smithi088.stdout:7/478: creat d6/da/d44/fa0 x:0 0 0 2024-09-13T21:40:25.171 INFO:tasks.workunit.client.0.smithi088.stdout:3/582: symlink d5/d23/d2a/d3f/d8f/da8/laf 0 2024-09-13T21:40:25.172 INFO:tasks.workunit.client.0.smithi088.stdout:7/479: read d6/da/d1a/d3a/f3f [471034,15664] 0 2024-09-13T21:40:25.175 INFO:tasks.workunit.client.0.smithi088.stdout:1/546: getdents d9/d10/d2a/d4b/d39/d43 0 2024-09-13T21:40:25.177 INFO:tasks.workunit.client.0.smithi088.stdout:5/607: link d4/d1c/d4a/d63/f74 d4/d1c/d24/d95/fc4 0 2024-09-13T21:40:25.178 INFO:tasks.workunit.client.0.smithi088.stdout:5/608: write d4/d1c/d24/d26/f82 [1217432,129623] 0 2024-09-13T21:40:25.179 INFO:tasks.workunit.client.0.smithi088.stdout:2/597: rename d1/d13/d2a/d41/cba to d1/d8/d2e/cca 0 2024-09-13T21:40:25.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/464: dwrite d1a/d61/d3d/f7d [0,4194304] 0 2024-09-13T21:40:25.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/465: write d1a/d1b/f8c [690556,71796] 0 2024-09-13T21:40:25.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/466: fdatasync d1a/d1b/f35 0 2024-09-13T21:40:25.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/467: chown d1a/d3c/l50 225 1 2024-09-13T21:40:25.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/468: fdatasync d1a/d1b/f25 0 2024-09-13T21:40:25.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/469: fdatasync d1a/d1b/f40 0 2024-09-13T21:40:25.183 INFO:tasks.workunit.client.0.smithi088.stdout:8/525: dwrite db/f7f [0,4194304] 0 2024-09-13T21:40:25.193 INFO:tasks.workunit.client.0.smithi088.stdout:3/583: creat d5/d23/d2a/d3f/d8f/d91/fb0 x:0 0 0 2024-09-13T21:40:25.193 INFO:tasks.workunit.client.0.smithi088.stdout:3/584: write d5/d14/f37 [1599715,25772] 0 2024-09-13T21:40:25.196 INFO:tasks.workunit.client.0.smithi088.stdout:5/609: mknod d4/d1c/d24/d26/d56/cc5 0 2024-09-13T21:40:25.196 INFO:tasks.workunit.client.0.smithi088.stdout:5/610: chown d4/d1c/d24/d26/d40/cbd 0 1 2024-09-13T21:40:25.199 INFO:tasks.workunit.client.0.smithi088.stdout:2/598: mknod d1/d13/d3f/d99/d9c/db1/ccb 0 2024-09-13T21:40:25.204 INFO:tasks.workunit.client.0.smithi088.stdout:7/480: dwrite d6/f42 [0,4194304] 0 2024-09-13T21:40:25.205 INFO:tasks.workunit.client.0.smithi088.stdout:4/509: rmdir d2/d5/d20/d41 39 2024-09-13T21:40:25.208 INFO:tasks.workunit.client.0.smithi088.stdout:3/585: write d5/f16 [528794,93116] 0 2024-09-13T21:40:25.208 INFO:tasks.workunit.client.0.smithi088.stdout:3/586: creat d5/d23/d2a/d55/fb1 x:0 0 0 2024-09-13T21:40:25.208 INFO:tasks.workunit.client.0.smithi088.stdout:3/587: creat d5/d23/d2a/fb2 x:0 0 0 2024-09-13T21:40:25.208 INFO:tasks.workunit.client.0.smithi088.stdout:9/470: dwrite d1a/d1b/f40 [0,4194304] 0 2024-09-13T21:40:25.209 INFO:tasks.workunit.client.0.smithi088.stdout:5/611: mkdir d4/d1c/d24/d26/dbf/dc6 0 2024-09-13T21:40:25.211 INFO:tasks.workunit.client.0.smithi088.stdout:8/526: dwrite db/d26/d2c/f8b [0,4194304] 0 2024-09-13T21:40:25.212 INFO:tasks.workunit.client.0.smithi088.stdout:2/599: mkdir d1/d13/d2a/d3c/d4a/d6e/d5b/d89/dcc 0 2024-09-13T21:40:25.221 INFO:tasks.workunit.client.0.smithi088.stdout:7/481: mknod d6/da/d1a/d3a/ca1 0 2024-09-13T21:40:25.227 INFO:tasks.workunit.client.0.smithi088.stdout:5/612: mkdir d4/d1c/d24/d26/dbf/dc6/dc7 0 2024-09-13T21:40:25.229 INFO:tasks.workunit.client.0.smithi088.stdout:1/547: rename d9/d10/d41 to d9/dc/d52/dba 0 2024-09-13T21:40:25.229 INFO:tasks.workunit.client.0.smithi088.stdout:1/548: fsync d9/dc/d74/f87 0 2024-09-13T21:40:25.231 INFO:tasks.workunit.client.0.smithi088.stdout:9/471: write d1a/d1b/f2e [3891181,14048] 0 2024-09-13T21:40:25.231 INFO:tasks.workunit.client.0.smithi088.stdout:9/472: stat d1a/d1b/f2e 0 2024-09-13T21:40:25.235 INFO:tasks.workunit.client.0.smithi088.stdout:7/482: dread d6/f22 [0,4194304] 0 2024-09-13T21:40:25.235 INFO:tasks.workunit.client.0.smithi088.stdout:5/613: truncate d4/d1c/d76/fa8 3265792 0 2024-09-13T21:40:25.237 INFO:tasks.workunit.client.0.smithi088.stdout:1/549: mkdir d9/d10/d2a/d4b/d33/dad/dbb 0 2024-09-13T21:40:25.239 INFO:tasks.workunit.client.0.smithi088.stdout:9/473: truncate d1a/f80 1420854 0 2024-09-13T21:40:25.239 INFO:tasks.workunit.client.0.smithi088.stdout:9/474: truncate d1a/d61/f89 697662 0 2024-09-13T21:40:25.239 INFO:tasks.workunit.client.0.smithi088.stdout:9/475: readlink d1a/d61/d3d/d75/l8d 0 2024-09-13T21:40:25.239 INFO:tasks.workunit.client.0.smithi088.stdout:9/476: write d1a/d1b/d3f/f55 [989874,87518] 0 2024-09-13T21:40:25.240 INFO:tasks.workunit.client.0.smithi088.stdout:5/614: creat d4/d1c/d24/d26/d4b/d66/fc8 x:0 0 0 2024-09-13T21:40:25.240 INFO:tasks.workunit.client.0.smithi088.stdout:9/477: truncate d1a/d1b/f22 2265258 0 2024-09-13T21:40:25.241 INFO:tasks.workunit.client.0.smithi088.stdout:5/615: mkdir d4/d1c/d24/d26/dbf/d89/dc9 0 2024-09-13T21:40:25.242 INFO:tasks.workunit.client.0.smithi088.stdout:9/478: mkdir d1a/d61/d3d/d41/d48/d86/d8e 0 2024-09-13T21:40:25.242 INFO:tasks.workunit.client.0.smithi088.stdout:5/616: rmdir d4/d1c/d4a/d63/d6a/d6d 39 2024-09-13T21:40:25.243 INFO:tasks.workunit.client.0.smithi088.stdout:4/510: dwrite d2/d5/d2d/f3e [0,4194304] 0 2024-09-13T21:40:25.244 INFO:tasks.workunit.client.0.smithi088.stdout:5/617: mknod d4/d1c/d24/d26/dbf/cca 0 2024-09-13T21:40:25.246 INFO:tasks.workunit.client.0.smithi088.stdout:7/483: write d6/f53 [1311081,57907] 0 2024-09-13T21:40:25.246 INFO:tasks.workunit.client.0.smithi088.stdout:8/527: dwrite db/df/f65 [0,4194304] 0 2024-09-13T21:40:25.247 INFO:tasks.workunit.client.0.smithi088.stdout:2/600: dwrite d1/d8/d24/d78/d7f/d85/fbb [0,4194304] 0 2024-09-13T21:40:25.247 INFO:tasks.workunit.client.0.smithi088.stdout:5/618: getdents d4/d1c/d24/d26/dbf/d89/d92 0 2024-09-13T21:40:25.251 INFO:tasks.workunit.client.0.smithi088.stdout:8/528: mkdir db/d26/d2c/db7/dbd 0 2024-09-13T21:40:25.254 INFO:tasks.workunit.client.0.smithi088.stdout:1/550: write d9/dc/d52/dba/d7d/fa4 [1818823,38848] 0 2024-09-13T21:40:25.254 INFO:tasks.workunit.client.0.smithi088.stdout:1/551: write d9/d10/d2a/f8a [1117930,18684] 0 2024-09-13T21:40:25.255 INFO:tasks.workunit.client.0.smithi088.stdout:1/552: creat d9/d4f/fbc x:0 0 0 2024-09-13T21:40:25.255 INFO:tasks.workunit.client.0.smithi088.stdout:9/479: dread f15 [0,4194304] 0 2024-09-13T21:40:25.256 INFO:tasks.workunit.client.0.smithi088.stdout:5/619: mkdir d4/d1c/d24/d26/dbf/d89/dc9/dcb 0 2024-09-13T21:40:25.256 INFO:tasks.workunit.client.0.smithi088.stdout:5/620: chown d4/d1c/d4a/d8a 28527839 1 2024-09-13T21:40:25.256 INFO:tasks.workunit.client.0.smithi088.stdout:5/621: stat d4/d1c/d4a/d63/d6a/f8d 0 2024-09-13T21:40:25.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/601: read d1/d8/fad [3988528,13332] 0 2024-09-13T21:40:25.259 INFO:tasks.workunit.client.0.smithi088.stdout:7/484: dread d6/f53 [0,4194304] 0 2024-09-13T21:40:25.261 INFO:tasks.workunit.client.0.smithi088.stdout:1/553: rename d9/d10/d2a/d4b/d61/c77 to d9/d10/d2a/cbd 0 2024-09-13T21:40:25.263 INFO:tasks.workunit.client.0.smithi088.stdout:9/480: symlink d1a/d61/d3d/d41/l8f 0 2024-09-13T21:40:25.264 INFO:tasks.workunit.client.0.smithi088.stdout:7/485: unlink d6/da/l2f 0 2024-09-13T21:40:25.267 INFO:tasks.workunit.client.0.smithi088.stdout:5/622: rename d4/c3d to d4/d1c/d24/d26/dbf/d89/d92/ccc 0 2024-09-13T21:40:25.267 INFO:tasks.workunit.client.0.smithi088.stdout:5/623: read - d4/d1c/d24/d26/d40/f49 zero size 2024-09-13T21:40:25.267 INFO:tasks.workunit.client.0.smithi088.stdout:5/624: write d4/d1c/d24/d26/d56/f91 [454043,78575] 0 2024-09-13T21:40:25.269 INFO:tasks.workunit.client.0.smithi088.stdout:9/481: link d1a/d1b/d3f/f70 d1a/d3c/f90 0 2024-09-13T21:40:25.270 INFO:tasks.workunit.client.0.smithi088.stdout:7/486: creat d6/da/fa2 x:0 0 0 2024-09-13T21:40:25.271 INFO:tasks.workunit.client.0.smithi088.stdout:8/529: dwrite db/df/da7/f28 [0,4194304] 0 2024-09-13T21:40:25.275 INFO:tasks.workunit.client.0.smithi088.stdout:7/487: mknod d6/d5f/d69/d4f/d6f/d70/ca3 0 2024-09-13T21:40:25.275 INFO:tasks.workunit.client.0.smithi088.stdout:7/488: write d6/f1c [1919239,58615] 0 2024-09-13T21:40:25.277 INFO:tasks.workunit.client.0.smithi088.stdout:6/579: sync 2024-09-13T21:40:25.286 INFO:tasks.workunit.client.0.smithi088.stdout:1/554: dwrite d9/d10/d2a/d4b/d39/d43/f4d [0,4194304] 0 2024-09-13T21:40:25.293 INFO:tasks.workunit.client.0.smithi088.stdout:8/530: symlink db/d26/d2c/d85/lbe 0 2024-09-13T21:40:25.297 INFO:tasks.workunit.client.0.smithi088.stdout:8/531: dread f8 [0,4194304] 0 2024-09-13T21:40:25.297 INFO:tasks.workunit.client.0.smithi088.stdout:8/532: dread - db/d26/d2c/f78 zero size 2024-09-13T21:40:25.297 INFO:tasks.workunit.client.0.smithi088.stdout:2/602: rename d1/d13/d2a/d3c/d4a/d6e/d66/d84 to d1/d13/d3f/d99/d9c/db1/dcd 0 2024-09-13T21:40:25.297 INFO:tasks.workunit.client.0.smithi088.stdout:2/603: dread - d1/d13/d3f/d99/d9c/fbf zero size 2024-09-13T21:40:25.297 INFO:tasks.workunit.client.0.smithi088.stdout:2/604: write d1/d8/d16/f5c [5212998,3901] 0 2024-09-13T21:40:25.297 INFO:tasks.workunit.client.0.smithi088.stdout:2/605: dread - d1/d8/d2e/d91/fae zero size 2024-09-13T21:40:25.297 INFO:tasks.workunit.client.0.smithi088.stdout:2/606: chown d1/d13/d2a/d41/d82/ca5 30568048 1 2024-09-13T21:40:25.297 INFO:tasks.workunit.client.0.smithi088.stdout:2/607: chown d1/d13/d3f/d99/d9c/db1/dcd/cc9 6163 1 2024-09-13T21:40:25.298 INFO:tasks.workunit.client.0.smithi088.stdout:5/625: getdents d4/d1b/d68 0 2024-09-13T21:40:25.301 INFO:tasks.workunit.client.0.smithi088.stdout:7/489: unlink d6/da/d1a/c7e 0 2024-09-13T21:40:25.301 INFO:tasks.workunit.client.0.smithi088.stdout:7/490: fdatasync d6/f42 0 2024-09-13T21:40:25.301 INFO:tasks.workunit.client.0.smithi088.stdout:7/491: truncate d6/d4e/f9b 363860 0 2024-09-13T21:40:25.302 INFO:tasks.workunit.client.0.smithi088.stdout:6/580: symlink d0/d2c/d32/lb7 0 2024-09-13T21:40:25.304 INFO:tasks.workunit.client.0.smithi088.stdout:2/608: rename d1/d13/d2a/d3c/d4a/d6e/d76/lb2 to d1/d13/d2a/d3c/d4a/d6e/d76/lce 0 2024-09-13T21:40:25.305 INFO:tasks.workunit.client.0.smithi088.stdout:4/511: dwrite d2/d5/d20/d60/de/f58 [0,4194304] 0 2024-09-13T21:40:25.305 INFO:tasks.workunit.client.0.smithi088.stdout:4/512: readlink d2/d5/d20/d60/de/d1e/d31/l4c 0 2024-09-13T21:40:25.305 INFO:tasks.workunit.client.0.smithi088.stdout:1/555: dwrite d9/d10/d2a/d4b/f28 [0,4194304] 0 2024-09-13T21:40:25.305 INFO:tasks.workunit.client.0.smithi088.stdout:5/626: mknod d4/d1c/d24/d95/da6/ccd 0 2024-09-13T21:40:25.305 INFO:tasks.workunit.client.0.smithi088.stdout:8/533: dread db/d26/f35 [0,4194304] 0 2024-09-13T21:40:25.306 INFO:tasks.workunit.client.0.smithi088.stdout:7/492: mkdir d6/d5f/d69/d4f/d6f/da4 0 2024-09-13T21:40:25.306 INFO:tasks.workunit.client.0.smithi088.stdout:7/493: chown d6/d5f/d69/d45 984639 1 2024-09-13T21:40:25.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/581: mkdir d0/d2c/dad/db8 0 2024-09-13T21:40:25.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/582: truncate d0/d2c/d32/d39/f95 4374001 0 2024-09-13T21:40:25.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/583: dread - d0/d28/fa8 zero size 2024-09-13T21:40:25.308 INFO:tasks.workunit.client.0.smithi088.stdout:6/584: dread - d0/d2c/d7a/fb6 zero size 2024-09-13T21:40:25.308 INFO:tasks.workunit.client.0.smithi088.stdout:6/585: fdatasync d0/d1e/d1f/f7b 0 2024-09-13T21:40:25.308 INFO:tasks.workunit.client.0.smithi088.stdout:6/586: getdents d0/d1e/d1f/d55/d8f 0 2024-09-13T21:40:25.308 INFO:tasks.workunit.client.0.smithi088.stdout:6/587: stat d0/d2c/d32/lb7 0 2024-09-13T21:40:25.308 INFO:tasks.workunit.client.0.smithi088.stdout:9/482: dwrite d1a/d3c/d51/d5e/f7c [0,4194304] 0 2024-09-13T21:40:25.309 INFO:tasks.workunit.client.0.smithi088.stdout:2/609: mkdir d1/d8/d2e/d91/db3/dcf 0 2024-09-13T21:40:25.317 INFO:tasks.workunit.client.0.smithi088.stdout:5/627: dwrite d4/d1b/d68/f9c [0,4194304] 0 2024-09-13T21:40:25.317 INFO:tasks.workunit.client.0.smithi088.stdout:5/628: creat d4/d1c/d24/d26/da1/fce x:0 0 0 2024-09-13T21:40:25.317 INFO:tasks.workunit.client.0.smithi088.stdout:5/629: creat d4/d1c/d24/d95/fcf x:0 0 0 2024-09-13T21:40:25.320 INFO:tasks.workunit.client.0.smithi088.stdout:4/513: symlink d2/d5/d20/d60/de/d1e/d23/d69/lad 0 2024-09-13T21:40:25.324 INFO:tasks.workunit.client.0.smithi088.stdout:1/556: mkdir d9/d10/d2a/d4b/d33/d92/dbe 0 2024-09-13T21:40:25.324 INFO:tasks.workunit.client.0.smithi088.stdout:1/557: fsync d9/dc/fb9 0 2024-09-13T21:40:25.327 INFO:tasks.workunit.client.0.smithi088.stdout:8/534: rename db/df/c1b to db/df/da7/d88/db3/cbf 0 2024-09-13T21:40:25.328 INFO:tasks.workunit.client.0.smithi088.stdout:7/494: truncate d6/da/d1a/f24 615833 0 2024-09-13T21:40:25.330 INFO:tasks.workunit.client.0.smithi088.stdout:6/588: mkdir d0/d28/da3/db9 0 2024-09-13T21:40:25.333 INFO:tasks.workunit.client.0.smithi088.stdout:4/514: write d2/d5/d20/d41/d4b/f54 [3836857,8281] 0 2024-09-13T21:40:25.333 INFO:tasks.workunit.client.0.smithi088.stdout:4/515: dread - d2/d5/d20/d41/f8e zero size 2024-09-13T21:40:25.336 INFO:tasks.workunit.client.0.smithi088.stdout:7/495: write d6/f1c [1764687,106642] 0 2024-09-13T21:40:25.336 INFO:tasks.workunit.client.0.smithi088.stdout:1/558: write d9/d10/d2a/d4b/d33/f91 [6101925,67705] 0 2024-09-13T21:40:25.336 INFO:tasks.workunit.client.0.smithi088.stdout:5/630: dwrite d4/d1c/d24/d26/d4b/d67/db2/fc0 [0,4194304] 0 2024-09-13T21:40:25.337 INFO:tasks.workunit.client.0.smithi088.stdout:9/483: mknod d1a/d61/d3d/d75/c91 0 2024-09-13T21:40:25.338 INFO:tasks.workunit.client.0.smithi088.stdout:2/610: symlink d1/d8/d16/d40/d7e/daa/ld0 0 2024-09-13T21:40:25.338 INFO:tasks.workunit.client.0.smithi088.stdout:9/484: dread d1a/d61/d3d/d41/d48/f68 [0,4194304] 0 2024-09-13T21:40:25.344 INFO:tasks.workunit.client.0.smithi088.stdout:9/485: read d1a/d61/d3d/d41/d48/f4f [190936,26589] 0 2024-09-13T21:40:25.347 INFO:tasks.workunit.client.0.smithi088.stdout:8/535: symlink db/d26/d2c/lc0 0 2024-09-13T21:40:25.349 INFO:tasks.workunit.client.0.smithi088.stdout:6/589: creat d0/d2c/d59/fba x:0 0 0 2024-09-13T21:40:25.351 INFO:tasks.workunit.client.0.smithi088.stdout:8/536: dread db/d26/d2c/d85/d51/f99 [0,4194304] 0 2024-09-13T21:40:25.352 INFO:tasks.workunit.client.0.smithi088.stdout:7/496: dwrite d6/d5f/d69/f8a [0,4194304] 0 2024-09-13T21:40:25.352 INFO:tasks.workunit.client.0.smithi088.stdout:4/516: creat d2/fae x:0 0 0 2024-09-13T21:40:25.355 INFO:tasks.workunit.client.0.smithi088.stdout:1/559: mknod d9/d10/d2a/d4b/d33/dad/cbf 0 2024-09-13T21:40:25.357 INFO:tasks.workunit.client.0.smithi088.stdout:0/552: sync 2024-09-13T21:40:25.357 INFO:tasks.workunit.client.0.smithi088.stdout:0/553: read d7/d2c/d30/d31/f62 [3582270,113001] 0 2024-09-13T21:40:25.359 INFO:tasks.workunit.client.0.smithi088.stdout:9/486: mkdir d1a/d3c/d51/d5e/d7e/d92 0 2024-09-13T21:40:25.362 INFO:tasks.workunit.client.0.smithi088.stdout:6/590: truncate d0/d1e/f4c 202102 0 2024-09-13T21:40:25.363 INFO:tasks.workunit.client.0.smithi088.stdout:6/591: dread - d0/d1e/d1f/f90 zero size 2024-09-13T21:40:25.375 INFO:tasks.workunit.client.0.smithi088.stdout:4/517: unlink d2/d5/d20/d60/de/c29 0 2024-09-13T21:40:25.380 INFO:tasks.workunit.client.0.smithi088.stdout:4/518: mknod d2/d5/d20/d7f/caf 0 2024-09-13T21:40:25.380 INFO:tasks.workunit.client.0.smithi088.stdout:6/592: rename d0/db/d37/c50 to d0/d2c/d8b/cbb 0 2024-09-13T21:40:25.383 INFO:tasks.workunit.client.0.smithi088.stdout:4/519: read d2/d11/f16 [1704378,75939] 0 2024-09-13T21:40:25.383 INFO:tasks.workunit.client.0.smithi088.stdout:6/593: rename d0/d2c/d32/d39/d3f/l9e to d0/d1e/d1f/d55/d8f/lbc 0 2024-09-13T21:40:25.384 INFO:tasks.workunit.client.0.smithi088.stdout:3/588: sync 2024-09-13T21:40:25.385 INFO:tasks.workunit.client.0.smithi088.stdout:8/537: dwrite db/d26/d4f/f62 [0,4194304] 0 2024-09-13T21:40:25.387 INFO:tasks.workunit.client.0.smithi088.stdout:3/589: unlink d5/d5a/f6f 0 2024-09-13T21:40:25.389 INFO:tasks.workunit.client.0.smithi088.stdout:3/590: getdents d5/d23/d2a/d3f/d8f/da8 0 2024-09-13T21:40:25.396 INFO:tasks.workunit.client.0.smithi088.stdout:6/594: dread d0/db/f12 [0,4194304] 0 2024-09-13T21:40:25.396 INFO:tasks.workunit.client.0.smithi088.stdout:6/595: creat d0/d1e/fbd x:0 0 0 2024-09-13T21:40:25.396 INFO:tasks.workunit.client.0.smithi088.stdout:6/596: chown d0/d1e/d1f/c8a 1594 1 2024-09-13T21:40:25.399 INFO:tasks.workunit.client.0.smithi088.stdout:6/597: rmdir d0/d2c/d32/d39/d3f/d71/d81 39 2024-09-13T21:40:25.399 INFO:tasks.workunit.client.0.smithi088.stdout:6/598: write d0/d2c/d32/d39/faa [1345410,67606] 0 2024-09-13T21:40:25.399 INFO:tasks.workunit.client.0.smithi088.stdout:6/599: stat d0/d28/f40 0 2024-09-13T21:40:25.406 INFO:tasks.workunit.client.0.smithi088.stdout:3/591: write d5/d23/d2a/d63/d48/d49/f53 [52802,23171] 0 2024-09-13T21:40:25.406 INFO:tasks.workunit.client.0.smithi088.stdout:3/592: fdatasync d5/f22 0 2024-09-13T21:40:25.408 INFO:tasks.workunit.client.0.smithi088.stdout:3/593: getdents d5/d23/d2a/d6b/d98/da1 0 2024-09-13T21:40:25.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/520: write d2/d5/d20/d60/de/d1e/fa9 [358740,39270] 0 2024-09-13T21:40:25.412 INFO:tasks.workunit.client.0.smithi088.stdout:4/521: rename d2/d5/d20/d60/de/d1e/d23/d6f/l25 to d2/d5/d20/d60/de/d1e/d23/d6f/lb0 0 2024-09-13T21:40:25.412 INFO:tasks.workunit.client.0.smithi088.stdout:4/522: chown d2 37991040 1 2024-09-13T21:40:25.412 INFO:tasks.workunit.client.0.smithi088.stdout:7/497: dwrite d6/d5f/f72 [0,4194304] 0 2024-09-13T21:40:25.413 INFO:tasks.workunit.client.0.smithi088.stdout:7/498: mknod d6/d5f/d69/d4f/d6f/d70/d76/ca5 0 2024-09-13T21:40:25.416 INFO:tasks.workunit.client.0.smithi088.stdout:3/594: dread d5/f16 [0,4194304] 0 2024-09-13T21:40:25.417 INFO:tasks.workunit.client.0.smithi088.stdout:4/523: dread d2/d5/d20/d60/de/d1e/d23/f9a [0,4194304] 0 2024-09-13T21:40:25.417 INFO:tasks.workunit.client.0.smithi088.stdout:3/595: rmdir d5/d23/d2a/d6b/d98/da1/daa 39 2024-09-13T21:40:25.417 INFO:tasks.workunit.client.0.smithi088.stdout:3/596: readlink d5/l45 0 2024-09-13T21:40:25.418 INFO:tasks.workunit.client.0.smithi088.stdout:1/560: dwrite d9/d10/d2a/d4b/d39/d43/f4d [0,4194304] 0 2024-09-13T21:40:25.418 INFO:tasks.workunit.client.0.smithi088.stdout:4/524: rmdir d2/d5 39 2024-09-13T21:40:25.419 INFO:tasks.workunit.client.0.smithi088.stdout:5/631: dwrite d4/d1c/f45 [0,4194304] 0 2024-09-13T21:40:25.419 INFO:tasks.workunit.client.0.smithi088.stdout:5/632: dread - d4/d1c/d24/d26/d40/f49 zero size 2024-09-13T21:40:25.419 INFO:tasks.workunit.client.0.smithi088.stdout:5/633: chown d4/d1c/d24/d26/f6e 3 1 2024-09-13T21:40:25.420 INFO:tasks.workunit.client.0.smithi088.stdout:0/554: dwrite d7/f7b [0,4194304] 0 2024-09-13T21:40:25.420 INFO:tasks.workunit.client.0.smithi088.stdout:4/525: symlink d2/d5/d2d/lb1 0 2024-09-13T21:40:25.421 INFO:tasks.workunit.client.0.smithi088.stdout:0/555: read d7/f23 [3905684,17904] 0 2024-09-13T21:40:25.423 INFO:tasks.workunit.client.0.smithi088.stdout:6/600: dwrite d0/d2c/d32/d39/d3f/f79 [0,4194304] 0 2024-09-13T21:40:25.423 INFO:tasks.workunit.client.0.smithi088.stdout:6/601: creat d0/d2c/d32/fbe x:0 0 0 2024-09-13T21:40:25.423 INFO:tasks.workunit.client.0.smithi088.stdout:8/538: dwrite db/d26/d2c/f78 [0,4194304] 0 2024-09-13T21:40:25.424 INFO:tasks.workunit.client.0.smithi088.stdout:5/634: write d4/d1c/f42 [2542326,98400] 0 2024-09-13T21:40:25.428 INFO:tasks.workunit.client.0.smithi088.stdout:3/597: rename d5/d5a/d92 to d5/d23/d2a/d3f/d76/db3 0 2024-09-13T21:40:25.428 INFO:tasks.workunit.client.0.smithi088.stdout:0/556: dread d7/d2c/d30/d31/d42/f74 [0,4194304] 0 2024-09-13T21:40:25.429 INFO:tasks.workunit.client.0.smithi088.stdout:9/487: dwrite d1a/d3c/d60/f79 [0,4194304] 0 2024-09-13T21:40:25.429 INFO:tasks.workunit.client.0.smithi088.stdout:1/561: write d9/f81 [1527880,109358] 0 2024-09-13T21:40:25.432 INFO:tasks.workunit.client.0.smithi088.stdout:5/635: dread d4/d1c/d24/d26/d40/f5a [0,4194304] 0 2024-09-13T21:40:25.432 INFO:tasks.workunit.client.0.smithi088.stdout:5/636: write d4/d1c/d24/d95/da6/fc3 [512812,685] 0 2024-09-13T21:40:25.438 INFO:tasks.workunit.client.0.smithi088.stdout:6/602: mknod d0/d1e/d1f/d55/d96/d98/cbf 0 2024-09-13T21:40:25.439 INFO:tasks.workunit.client.0.smithi088.stdout:6/603: write d0/d28/f40 [901758,97660] 0 2024-09-13T21:40:25.439 INFO:tasks.workunit.client.0.smithi088.stdout:4/526: dwrite d2/d5/d20/d60/de/d1e/f37 [0,4194304] 0 2024-09-13T21:40:25.444 INFO:tasks.workunit.client.0.smithi088.stdout:8/539: write db/d26/f50 [3566538,47582] 0 2024-09-13T21:40:25.444 INFO:tasks.workunit.client.0.smithi088.stdout:3/598: mkdir d5/d23/d2a/d3f/db4 0 2024-09-13T21:40:25.446 INFO:tasks.workunit.client.0.smithi088.stdout:0/557: mkdir d7/d1d/d26/dcd 0 2024-09-13T21:40:25.446 INFO:tasks.workunit.client.0.smithi088.stdout:0/558: fdatasync d7/d1d/d27/f3e 0 2024-09-13T21:40:25.450 INFO:tasks.workunit.client.0.smithi088.stdout:9/488: creat d1a/d61/d3d/d75/f93 x:0 0 0 2024-09-13T21:40:25.451 INFO:tasks.workunit.client.0.smithi088.stdout:5/637: mkdir d4/d1c/d4a/d63/dd0 0 2024-09-13T21:40:25.454 INFO:tasks.workunit.client.0.smithi088.stdout:1/562: dwrite d9/d10/f11 [0,4194304] 0 2024-09-13T21:40:25.455 INFO:tasks.workunit.client.0.smithi088.stdout:6/604: mknod d0/d2c/d32/d39/d3f/cc0 0 2024-09-13T21:40:25.457 INFO:tasks.workunit.client.0.smithi088.stdout:4/527: creat d2/d5/d20/d41/d4b/d98/fb2 x:0 0 0 2024-09-13T21:40:25.457 INFO:tasks.workunit.client.0.smithi088.stdout:4/528: read d2/d11/f16 [2807530,112477] 0 2024-09-13T21:40:25.457 INFO:tasks.workunit.client.0.smithi088.stdout:4/529: write d2/d5/d20/d60/de/d1e/d23/d6c/f34 [3432204,26672] 0 2024-09-13T21:40:25.459 INFO:tasks.workunit.client.0.smithi088.stdout:3/599: unlink d5/d23/d2a/d6b/fae 0 2024-09-13T21:40:25.462 INFO:tasks.workunit.client.0.smithi088.stdout:0/559: mkdir d7/d2c/d30/dbe/dce 0 2024-09-13T21:40:25.462 INFO:tasks.workunit.client.0.smithi088.stdout:0/560: fdatasync d7/d2c/f48 0 2024-09-13T21:40:25.466 INFO:tasks.workunit.client.0.smithi088.stdout:9/489: read d1a/f23 [765457,95682] 0 2024-09-13T21:40:25.466 INFO:tasks.workunit.client.0.smithi088.stdout:5/638: mkdir d4/d1c/d24/d26/dbf/d89/dc9/dd1 0 2024-09-13T21:40:25.469 INFO:tasks.workunit.client.0.smithi088.stdout:2/611: sync 2024-09-13T21:40:25.473 INFO:tasks.workunit.client.0.smithi088.stdout:1/563: creat d9/d10/d2a/d47/d9c/fc0 x:0 0 0 2024-09-13T21:40:25.473 INFO:tasks.workunit.client.0.smithi088.stdout:6/605: dwrite d0/db/f43 [0,4194304] 0 2024-09-13T21:40:25.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/530: mknod d2/d11/dab/cb3 0 2024-09-13T21:40:25.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/531: truncate d2/d5/d20/d7f/f8f 1330063 0 2024-09-13T21:40:25.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/532: fdatasync d2/d5/d20/d60/de/f28 0 2024-09-13T21:40:25.475 INFO:tasks.workunit.client.0.smithi088.stdout:3/600: symlink d5/d23/d2a/d3f/d8f/da3/lb5 0 2024-09-13T21:40:25.479 INFO:tasks.workunit.client.0.smithi088.stdout:0/561: rename d7/d2c/d37/f83 to d7/d1d/d66/d8b/fcf 0 2024-09-13T21:40:25.479 INFO:tasks.workunit.client.0.smithi088.stdout:0/562: chown d7/d65/d8c 8150457 1 2024-09-13T21:40:25.479 INFO:tasks.workunit.client.0.smithi088.stdout:0/563: truncate d7/d2c/fbd 160956 0 2024-09-13T21:40:25.479 INFO:tasks.workunit.client.0.smithi088.stdout:0/564: write d7/d65/d8c/fb9 [356574,127704] 0 2024-09-13T21:40:25.480 INFO:tasks.workunit.client.0.smithi088.stdout:9/490: creat d1a/d3c/f94 x:0 0 0 2024-09-13T21:40:25.483 INFO:tasks.workunit.client.0.smithi088.stdout:1/564: creat d9/d10/d2a/d47/fc1 x:0 0 0 2024-09-13T21:40:25.483 INFO:tasks.workunit.client.0.smithi088.stdout:1/565: write d9/d10/d2a/d4b/d39/fb0 [1011720,21485] 0 2024-09-13T21:40:25.483 INFO:tasks.workunit.client.0.smithi088.stdout:1/566: readlink d9/d10/d2a/d4b/d3a/l90 0 2024-09-13T21:40:25.483 INFO:tasks.workunit.client.0.smithi088.stdout:6/606: mknod d0/d2c/d8b/cc1 0 2024-09-13T21:40:25.483 INFO:tasks.workunit.client.0.smithi088.stdout:6/607: chown d0/d2c/d32/d39/d3f/d71/d81/ca6 471033121 1 2024-09-13T21:40:25.484 INFO:tasks.workunit.client.0.smithi088.stdout:3/601: symlink d5/d23/d2a/d3f/d76/d81/lb6 0 2024-09-13T21:40:25.485 INFO:tasks.workunit.client.0.smithi088.stdout:5/639: dwrite d4/f1f [4194304,4194304] 0 2024-09-13T21:40:25.486 INFO:tasks.workunit.client.0.smithi088.stdout:0/565: truncate d7/d2c/d37/f7d 834673 0 2024-09-13T21:40:25.488 INFO:tasks.workunit.client.0.smithi088.stdout:4/533: read d2/d5/ff [1028097,45282] 0 2024-09-13T21:40:25.488 INFO:tasks.workunit.client.0.smithi088.stdout:4/534: getdents d2/d5/d20/d60/de/d1e/d23/d6c 0 2024-09-13T21:40:25.488 INFO:tasks.workunit.client.0.smithi088.stdout:4/535: dread - d2/d5/d20/d41/d4b/d98/faa zero size 2024-09-13T21:40:25.491 INFO:tasks.workunit.client.0.smithi088.stdout:1/567: link d9/d10/d2a/d4b/d61/l88 d9/d10/d2a/d47/d9c/lc2 0 2024-09-13T21:40:25.491 INFO:tasks.workunit.client.0.smithi088.stdout:1/568: stat d9/d4f/d64/c78 0 2024-09-13T21:40:25.491 INFO:tasks.workunit.client.0.smithi088.stdout:1/569: dread - d9/dc/fb9 zero size 2024-09-13T21:40:25.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/602: rename d5/d23/d2a/d3f/l47 to d5/d23/d2a/d6b/d98/da1/daa/d43/lb7 0 2024-09-13T21:40:25.492 INFO:tasks.workunit.client.0.smithi088.stdout:3/603: chown d5/d23/d2a/d63/d48/l52 351742 1 2024-09-13T21:40:25.496 INFO:tasks.workunit.client.0.smithi088.stdout:5/640: link d4/d1c/d24/d26/l60 d4/d1c/d4a/d63/dd0/ld2 0 2024-09-13T21:40:25.497 INFO:tasks.workunit.client.0.smithi088.stdout:4/536: mknod d2/d5/d20/d41/cb4 0 2024-09-13T21:40:25.498 INFO:tasks.workunit.client.0.smithi088.stdout:4/537: chown d2/d11/l46 2244 1 2024-09-13T21:40:25.502 INFO:tasks.workunit.client.0.smithi088.stdout:3/604: mkdir d5/d5a/db8 0 2024-09-13T21:40:25.502 INFO:tasks.workunit.client.0.smithi088.stdout:3/605: write d5/d23/d2a/d3f/fa0 [4966539,116947] 0 2024-09-13T21:40:25.502 INFO:tasks.workunit.client.0.smithi088.stdout:3/606: getdents d5/d23/d2a/d6b/d98/da1 0 2024-09-13T21:40:25.502 INFO:tasks.workunit.client.0.smithi088.stdout:3/607: dread - d5/d23/d2a/d63/f87 zero size 2024-09-13T21:40:25.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/538: rename d2/d5/d20/d60/de/d1e/d23/f74 to d2/d5/d2d/d70/fb5 0 2024-09-13T21:40:25.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/539: readlink d2/d5/d20/d60/de/d1e/d23/d3c/l63 0 2024-09-13T21:40:25.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/540: readlink d2/d5/d20/l2e 0 2024-09-13T21:40:25.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/541: stat d2/d5/d2d/d70/c7c 0 2024-09-13T21:40:25.506 INFO:tasks.workunit.client.0.smithi088.stdout:1/570: write d9/d10/d2a/d4b/d61/f6a [2807156,106708] 0 2024-09-13T21:40:25.506 INFO:tasks.workunit.client.0.smithi088.stdout:1/571: write d9/d10/f3f [3453134,47377] 0 2024-09-13T21:40:25.506 INFO:tasks.workunit.client.0.smithi088.stdout:1/572: write d9/d10/d2a/d4b/d33/f84 [1559656,67531] 0 2024-09-13T21:40:25.506 INFO:tasks.workunit.client.0.smithi088.stdout:1/573: chown d9/dc/d52/dba 14075126 1 2024-09-13T21:40:25.506 INFO:tasks.workunit.client.0.smithi088.stdout:1/574: chown d9/d10/d2a/d47/d9c/db7 1670 1 2024-09-13T21:40:25.506 INFO:tasks.workunit.client.0.smithi088.stdout:3/608: truncate d5/d23/d2a/d63/d31/f4e 3216601 0 2024-09-13T21:40:25.510 INFO:tasks.workunit.client.0.smithi088.stdout:4/542: creat d2/d5/d20/d60/fb6 x:0 0 0 2024-09-13T21:40:25.510 INFO:tasks.workunit.client.0.smithi088.stdout:4/543: creat d2/d5/d20/d41/d4b/d98/fb7 x:0 0 0 2024-09-13T21:40:25.510 INFO:tasks.workunit.client.0.smithi088.stdout:4/544: fdatasync d2/f48 0 2024-09-13T21:40:25.510 INFO:tasks.workunit.client.0.smithi088.stdout:3/609: unlink d5/d23/d2a/d63/d31/l36 0 2024-09-13T21:40:25.511 INFO:tasks.workunit.client.0.smithi088.stdout:5/641: dread d4/fc [4194304,4194304] 0 2024-09-13T21:40:25.511 INFO:tasks.workunit.client.0.smithi088.stdout:5/642: chown d4/d1c/d4a/l4f 48896 1 2024-09-13T21:40:25.511 INFO:tasks.workunit.client.0.smithi088.stdout:5/643: creat d4/d1c/d24/d26/d56/fd3 x:0 0 0 2024-09-13T21:40:25.513 INFO:tasks.workunit.client.0.smithi088.stdout:2/612: dwrite d1/f10 [0,4194304] 0 2024-09-13T21:40:25.516 INFO:tasks.workunit.client.0.smithi088.stdout:9/491: dwrite d1a/f20 [0,4194304] 0 2024-09-13T21:40:25.516 INFO:tasks.workunit.client.0.smithi088.stdout:9/492: chown d1a/d3c/d51 0 1 2024-09-13T21:40:25.517 INFO:tasks.workunit.client.0.smithi088.stdout:6/608: dwrite d0/f22 [0,4194304] 0 2024-09-13T21:40:25.518 INFO:tasks.workunit.client.0.smithi088.stdout:6/609: chown d0/db 17 1 2024-09-13T21:40:25.518 INFO:tasks.workunit.client.0.smithi088.stdout:1/575: write d9/d10/d2a/d4b/d33/f76 [2379662,129183] 0 2024-09-13T21:40:25.520 INFO:tasks.workunit.client.0.smithi088.stdout:9/493: dread d1a/d1b/d3f/f55 [0,4194304] 0 2024-09-13T21:40:25.521 INFO:tasks.workunit.client.0.smithi088.stdout:9/494: chown d1a/d1b/c65 861 1 2024-09-13T21:40:25.543 INFO:tasks.workunit.client.0.smithi088.stdout:0/566: dwrite d7/d1d/d21/d82/f87 [4194304,4194304] 0 2024-09-13T21:40:25.544 INFO:tasks.workunit.client.0.smithi088.stdout:4/545: symlink d2/d5/d20/lb8 0 2024-09-13T21:40:25.545 INFO:tasks.workunit.client.0.smithi088.stdout:3/610: link d5/d14/f1a d5/d23/d2a/d6b/d98/da1/daa/d43/fb9 0 2024-09-13T21:40:25.546 INFO:tasks.workunit.client.0.smithi088.stdout:5/644: getdents d4/d1c 0 2024-09-13T21:40:25.548 INFO:tasks.workunit.client.0.smithi088.stdout:2/613: mknod d1/d8/d2e/d3b/cd1 0 2024-09-13T21:40:25.548 INFO:tasks.workunit.client.0.smithi088.stdout:2/614: write d1/d13/fb7 [54033,84624] 0 2024-09-13T21:40:25.548 INFO:tasks.workunit.client.0.smithi088.stdout:2/615: stat d1/d13/d2a/d3c/d4a 0 2024-09-13T21:40:25.553 INFO:tasks.workunit.client.0.smithi088.stdout:6/610: chown d0/c2d 764 1 2024-09-13T21:40:25.555 INFO:tasks.workunit.client.0.smithi088.stdout:1/576: symlink d9/d10/d2a/d4b/d33/dad/dbb/lc3 0 2024-09-13T21:40:25.558 INFO:tasks.workunit.client.0.smithi088.stdout:2/616: dread d1/d8/d2e/fbe [0,4194304] 0 2024-09-13T21:40:25.570 INFO:tasks.workunit.client.0.smithi088.stdout:0/567: symlink d7/d2c/d30/dbe/ld0 0 2024-09-13T21:40:25.570 INFO:tasks.workunit.client.0.smithi088.stdout:0/568: truncate d7/d2c/d30/d31/d42/d95/fc4 1607562 0 2024-09-13T21:40:25.570 INFO:tasks.workunit.client.0.smithi088.stdout:0/569: fdatasync d7/d1d/d27/f54 0 2024-09-13T21:40:25.571 INFO:tasks.workunit.client.0.smithi088.stdout:4/546: rename d2/d5/d20/d41/d4b/d98/faa to d2/fb9 0 2024-09-13T21:40:25.572 INFO:tasks.workunit.client.0.smithi088.stdout:3/611: symlink d5/d23/d2a/d6b/d98/lba 0 2024-09-13T21:40:25.574 INFO:tasks.workunit.client.0.smithi088.stdout:5/645: creat d4/d1c/d24/d26/dbf/dc6/dc7/fd4 x:0 0 0 2024-09-13T21:40:25.574 INFO:tasks.workunit.client.0.smithi088.stdout:5/646: dread - d4/d1c/d4a/fbe zero size 2024-09-13T21:40:25.574 INFO:tasks.workunit.client.0.smithi088.stdout:6/611: chown d0/c15 503003 1 2024-09-13T21:40:25.574 INFO:tasks.workunit.client.0.smithi088.stdout:6/612: dread - d0/d2c/f6b zero size 2024-09-13T21:40:25.574 INFO:tasks.workunit.client.0.smithi088.stdout:6/613: chown d0/d2c/d32/d39/c5e 31 1 2024-09-13T21:40:25.574 INFO:tasks.workunit.client.0.smithi088.stdout:6/614: truncate d0/d1e/f4c 738100 0 2024-09-13T21:40:25.575 INFO:tasks.workunit.client.0.smithi088.stdout:9/495: symlink d1a/l95 0 2024-09-13T21:40:25.576 INFO:tasks.workunit.client.0.smithi088.stdout:2/617: dwrite d1/d8/d16/d40/f60 [0,4194304] 0 2024-09-13T21:40:25.578 INFO:tasks.workunit.client.0.smithi088.stdout:1/577: rename d9/d10/d2a/d4b/d61/l88 to d9/d10/d2a/d4b/d33/dad/lc4 0 2024-09-13T21:40:25.578 INFO:tasks.workunit.client.0.smithi088.stdout:1/578: creat d9/d10/d2a/fc5 x:0 0 0 2024-09-13T21:40:25.578 INFO:tasks.workunit.client.0.smithi088.stdout:1/579: read d9/d10/d2a/d4b/d61/f6a [1474741,109022] 0 2024-09-13T21:40:25.580 INFO:tasks.workunit.client.0.smithi088.stdout:4/547: creat d2/d5/d20/d60/de/fba x:0 0 0 2024-09-13T21:40:25.582 INFO:tasks.workunit.client.0.smithi088.stdout:6/615: symlink d0/d2c/d83/lc2 0 2024-09-13T21:40:25.582 INFO:tasks.workunit.client.0.smithi088.stdout:6/616: write d0/d1e/d1f/f4d [692473,11070] 0 2024-09-13T21:40:25.582 INFO:tasks.workunit.client.0.smithi088.stdout:0/570: dread d7/d1d/d27/d43/f1c [0,4194304] 0 2024-09-13T21:40:25.583 INFO:tasks.workunit.client.0.smithi088.stdout:9/496: creat d1a/d61/d3d/d41/d48/f96 x:0 0 0 2024-09-13T21:40:25.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/647: write d4/d1c/d4a/d63/f74 [1494796,95579] 0 2024-09-13T21:40:25.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/648: dread - d4/d1b/faf zero size 2024-09-13T21:40:25.592 INFO:tasks.workunit.client.0.smithi088.stdout:4/548: mknod d2/d5/d20/d60/de/d1e/d23/d69/cbb 0 2024-09-13T21:40:25.595 INFO:tasks.workunit.client.0.smithi088.stdout:0/571: unlink d7/d1d/d66/d8b/fcf 0 2024-09-13T21:40:25.595 INFO:tasks.workunit.client.0.smithi088.stdout:0/572: dread - d7/d1d/d66/fa7 zero size 2024-09-13T21:40:25.596 INFO:tasks.workunit.client.0.smithi088.stdout:9/497: getdents d1a/d3c/d85 0 2024-09-13T21:40:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:25 smithi116 ceph-mon[33391]: pgmap v252: 65 pgs: 65 active+clean; 831 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 75 MiB/s rd, 101 MiB/s wr, 716 op/s 2024-09-13T21:40:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:25 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:25.597 INFO:tasks.workunit.client.0.smithi088.stdout:6/617: dread d0/d28/f80 [0,4194304] 0 2024-09-13T21:40:25.597 INFO:tasks.workunit.client.0.smithi088.stdout:7/499: sync 2024-09-13T21:40:25.600 INFO:tasks.workunit.client.0.smithi088.stdout:4/549: symlink d2/d5/d20/d41/d4b/d98/lbc 0 2024-09-13T21:40:25.601 INFO:tasks.workunit.client.0.smithi088.stdout:4/550: fdatasync d2/d5/d20/d60/de/d1e/d23/d69/f7e 0 2024-09-13T21:40:25.604 INFO:tasks.workunit.client.0.smithi088.stdout:7/500: creat d6/fa6 x:0 0 0 2024-09-13T21:40:25.604 INFO:tasks.workunit.client.0.smithi088.stdout:3/612: write d5/d23/d2a/d55/f7b [4122198,88542] 0 2024-09-13T21:40:25.605 INFO:tasks.workunit.client.0.smithi088.stdout:7/501: fdatasync d6/da/d1a/f30 0 2024-09-13T21:40:25.605 INFO:tasks.workunit.client.0.smithi088.stdout:7/502: read d6/d5f/d69/f6e [76768,99992] 0 2024-09-13T21:40:25.605 INFO:tasks.workunit.client.0.smithi088.stdout:7/503: stat d6/da/f38 0 2024-09-13T21:40:25.606 INFO:tasks.workunit.client.0.smithi088.stdout:4/551: rename d2/l57 to d2/d5/d20/d60/de/d1e/d31/d61/lbd 0 2024-09-13T21:40:25.607 INFO:tasks.workunit.client.0.smithi088.stdout:6/618: rmdir d0/d1e/d1f 39 2024-09-13T21:40:25.608 INFO:tasks.workunit.client.0.smithi088.stdout:2/618: dwrite d1/d8/fe [4194304,4194304] 0 2024-09-13T21:40:25.608 INFO:tasks.workunit.client.0.smithi088.stdout:2/619: chown d1/d13/d3f/d99 104 1 2024-09-13T21:40:25.608 INFO:tasks.workunit.client.0.smithi088.stdout:2/620: fdatasync d1/d8/d24/d78/d7f/fac 0 2024-09-13T21:40:25.611 INFO:tasks.workunit.client.0.smithi088.stdout:4/552: symlink d2/d5/d20/d60/de/d1e/d31/d61/d99/lbe 0 2024-09-13T21:40:25.611 INFO:tasks.workunit.client.0.smithi088.stdout:4/553: fdatasync d2/d5/d20/f88 0 2024-09-13T21:40:25.611 INFO:tasks.workunit.client.0.smithi088.stdout:4/554: chown d2/d5/d20/d60/de/f28 1 1 2024-09-13T21:40:25.614 INFO:tasks.workunit.client.0.smithi088.stdout:6/619: creat d0/db/d37/fc3 x:0 0 0 2024-09-13T21:40:25.614 INFO:tasks.workunit.client.0.smithi088.stdout:2/621: mknod d1/d8/d24/d78/d7f/d85/cd2 0 2024-09-13T21:40:25.616 INFO:tasks.workunit.client.0.smithi088.stdout:5/649: dwrite d4/d1c/d24/d26/dbf/fae [0,4194304] 0 2024-09-13T21:40:25.616 INFO:tasks.workunit.client.0.smithi088.stdout:6/620: symlink d0/d2c/d7f/lc4 0 2024-09-13T21:40:25.617 INFO:tasks.workunit.client.0.smithi088.stdout:6/621: dread - d0/db/d37/fc3 zero size 2024-09-13T21:40:25.617 INFO:tasks.workunit.client.0.smithi088.stdout:6/622: write d0/d1e/d1f/fa2 [4810652,89645] 0 2024-09-13T21:40:25.617 INFO:tasks.workunit.client.0.smithi088.stdout:3/613: write d5/d23/d2a/d6b/d98/da1/daa/f70 [3257425,86386] 0 2024-09-13T21:40:25.618 INFO:tasks.workunit.client.0.smithi088.stdout:1/580: dwrite d9/d10/d2a/d4b/d33/f84 [0,4194304] 0 2024-09-13T21:40:25.618 INFO:tasks.workunit.client.0.smithi088.stdout:1/581: creat d9/d10/d2a/d47/d9c/fc6 x:0 0 0 2024-09-13T21:40:25.620 INFO:tasks.workunit.client.0.smithi088.stdout:2/622: dread d1/d8/d24/d78/d7f/d85/f97 [0,4194304] 0 2024-09-13T21:40:25.622 INFO:tasks.workunit.client.0.smithi088.stdout:5/650: unlink d4/d1c/d24/d26/d4b/d67/ca9 0 2024-09-13T21:40:25.622 INFO:tasks.workunit.client.0.smithi088.stdout:5/651: fdatasync d4/d1c/f48 0 2024-09-13T21:40:25.622 INFO:tasks.workunit.client.0.smithi088.stdout:5/652: truncate d4/d1c/d24/d26/d40/f5a 4852326 0 2024-09-13T21:40:25.622 INFO:tasks.workunit.client.0.smithi088.stdout:8/540: sync 2024-09-13T21:40:25.623 INFO:tasks.workunit.client.0.smithi088.stdout:6/623: creat d0/d1e/d1f/d55/fc5 x:0 0 0 2024-09-13T21:40:25.630 INFO:tasks.workunit.client.0.smithi088.stdout:2/623: link d1/d13/d3f/c58 d1/d8/d2e/d3b/cd3 0 2024-09-13T21:40:25.632 INFO:tasks.workunit.client.0.smithi088.stdout:5/653: rmdir d4/d1c/d4a/d63/d8c 0 2024-09-13T21:40:25.633 INFO:tasks.workunit.client.0.smithi088.stdout:8/541: creat db/d26/d2c/db7/fc1 x:0 0 0 2024-09-13T21:40:25.633 INFO:tasks.workunit.client.0.smithi088.stdout:8/542: truncate db/df/da7/d88/da8/fab 414535 0 2024-09-13T21:40:25.634 INFO:tasks.workunit.client.0.smithi088.stdout:8/543: write db/d26/d4f/f68 [853312,78885] 0 2024-09-13T21:40:25.634 INFO:tasks.workunit.client.0.smithi088.stdout:8/544: dread - db/d26/f48 zero size 2024-09-13T21:40:25.634 INFO:tasks.workunit.client.0.smithi088.stdout:8/545: read db/d26/f50 [3712590,129791] 0 2024-09-13T21:40:25.634 INFO:tasks.workunit.client.0.smithi088.stdout:3/614: mknod d5/d23/d2a/d3f/d76/db3/da5/cbb 0 2024-09-13T21:40:25.635 INFO:tasks.workunit.client.0.smithi088.stdout:0/573: dwrite d7/d2c/d30/f35 [0,4194304] 0 2024-09-13T21:40:25.636 INFO:tasks.workunit.client.0.smithi088.stdout:2/624: rename d1/d13/d2a/d3c/fb9 to d1/fd4 0 2024-09-13T21:40:25.636 INFO:tasks.workunit.client.0.smithi088.stdout:2/625: write d1/d13/d2a/d41/d48/f83 [901925,59676] 0 2024-09-13T21:40:25.636 INFO:tasks.workunit.client.0.smithi088.stdout:5/654: symlink d4/d1b/ld5 0 2024-09-13T21:40:25.637 INFO:tasks.workunit.client.0.smithi088.stdout:3/615: chown d5/c1d 8719498 1 2024-09-13T21:40:25.639 INFO:tasks.workunit.client.0.smithi088.stdout:2/626: symlink d1/d13/d2a/d3c/d4a/d6e/d5b/d89/dcc/ld5 0 2024-09-13T21:40:25.640 INFO:tasks.workunit.client.0.smithi088.stdout:2/627: creat d1/d8/d24/d78/d7f/fd6 x:0 0 0 2024-09-13T21:40:25.640 INFO:tasks.workunit.client.0.smithi088.stdout:2/628: readlink d1/d8/l49 0 2024-09-13T21:40:25.640 INFO:tasks.workunit.client.0.smithi088.stdout:8/546: getdents db/df/da7/d88/da8 0 2024-09-13T21:40:25.642 INFO:tasks.workunit.client.0.smithi088.stdout:2/629: mknod d1/d13/d3f/d99/d9c/cd7 0 2024-09-13T21:40:25.643 INFO:tasks.workunit.client.0.smithi088.stdout:8/547: creat db/d26/d2c/db7/dbd/fc2 x:0 0 0 2024-09-13T21:40:25.645 INFO:tasks.workunit.client.0.smithi088.stdout:3/616: rename d5/d5a/c75 to d5/cbc 0 2024-09-13T21:40:25.649 INFO:tasks.workunit.client.0.smithi088.stdout:5/655: dread d4/d1c/f42 [0,4194304] 0 2024-09-13T21:40:25.650 INFO:tasks.workunit.client.0.smithi088.stdout:3/617: dread d5/d14/f1a [0,4194304] 0 2024-09-13T21:40:25.651 INFO:tasks.workunit.client.0.smithi088.stdout:5/656: rename d4/d1c/d24/fac to d4/db8/fd6 0 2024-09-13T21:40:25.652 INFO:tasks.workunit.client.0.smithi088.stdout:3/618: truncate d5/d23/d2a/d3f/fa0 628797 0 2024-09-13T21:40:25.655 INFO:tasks.workunit.client.0.smithi088.stdout:5/657: unlink d4/d1c/d24/d26/d4b/d67/cb7 0 2024-09-13T21:40:25.655 INFO:tasks.workunit.client.0.smithi088.stdout:5/658: chown d4/d1c/d4a/d63/d6a/d6d/ca5 4 1 2024-09-13T21:40:25.655 INFO:tasks.workunit.client.0.smithi088.stdout:9/498: dwrite d1a/d3c/d51/f83 [0,4194304] 0 2024-09-13T21:40:25.655 INFO:tasks.workunit.client.0.smithi088.stdout:7/504: dwrite d6/da/d1a/f80 [0,4194304] 0 2024-09-13T21:40:25.656 INFO:tasks.workunit.client.0.smithi088.stdout:3/619: link d5/d23/d2a/d55/fac d5/d23/d2a/fbd 0 2024-09-13T21:40:25.657 INFO:tasks.workunit.client.0.smithi088.stdout:4/555: dwrite d2/d5/d20/d60/de/f58 [0,4194304] 0 2024-09-13T21:40:25.659 INFO:tasks.workunit.client.0.smithi088.stdout:5/659: unlink d4/d1c/d24/d26/dbf/d89/d92/f3b 0 2024-09-13T21:40:25.660 INFO:tasks.workunit.client.0.smithi088.stdout:1/582: dread d9/d10/d2a/d4b/d33/f76 [0,4194304] 0 2024-09-13T21:40:25.661 INFO:tasks.workunit.client.0.smithi088.stdout:6/624: dwrite d0/d2c/d32/f84 [0,4194304] 0 2024-09-13T21:40:25.664 INFO:tasks.workunit.client.0.smithi088.stdout:3/620: creat d5/d23/d2a/d6b/d98/fbe x:0 0 0 2024-09-13T21:40:25.667 INFO:tasks.workunit.client.0.smithi088.stdout:1/583: read d9/d10/d2a/d4b/d33/d92/d8e/fa9 [681250,53943] 0 2024-09-13T21:40:25.668 INFO:tasks.workunit.client.0.smithi088.stdout:4/556: symlink d2/d5/d20/d41/lbf 0 2024-09-13T21:40:25.669 INFO:tasks.workunit.client.0.smithi088.stdout:9/499: dread d1a/f49 [0,4194304] 0 2024-09-13T21:40:25.671 INFO:tasks.workunit.client.0.smithi088.stdout:5/660: write d4/d1c/d76/f88 [2773971,68119] 0 2024-09-13T21:40:25.673 INFO:tasks.workunit.client.0.smithi088.stdout:2/630: dwrite d1/d13/d2a/f65 [0,4194304] 0 2024-09-13T21:40:25.674 INFO:tasks.workunit.client.0.smithi088.stdout:6/625: chown d0/l19 61 1 2024-09-13T21:40:25.674 INFO:tasks.workunit.client.0.smithi088.stdout:0/574: dwrite d7/d1d/d26/d45/fbc [0,4194304] 0 2024-09-13T21:40:25.677 INFO:tasks.workunit.client.0.smithi088.stdout:8/548: dwrite db/d26/d37/f46 [0,4194304] 0 2024-09-13T21:40:25.678 INFO:tasks.workunit.client.0.smithi088.stdout:3/621: creat d5/d23/d2a/d6b/d8b/fbf x:0 0 0 2024-09-13T21:40:25.678 INFO:tasks.workunit.client.0.smithi088.stdout:3/622: write d5/d23/d2a/f51 [1432230,106425] 0 2024-09-13T21:40:25.679 INFO:tasks.workunit.client.0.smithi088.stdout:3/623: truncate d5/f22 8700994 0 2024-09-13T21:40:25.679 INFO:tasks.workunit.client.0.smithi088.stdout:3/624: write d5/d23/d2a/d63/f87 [209045,62936] 0 2024-09-13T21:40:25.679 INFO:tasks.workunit.client.0.smithi088.stdout:3/625: write d5/d23/d2a/d6b/d98/fbe [1028650,76418] 0 2024-09-13T21:40:25.685 INFO:tasks.workunit.client.0.smithi088.stdout:5/661: dread d4/d1c/d4a/d63/f6f [0,4194304] 0 2024-09-13T21:40:25.687 INFO:tasks.workunit.client.0.smithi088.stdout:2/631: mkdir d1/d13/d3f/d99/d9c/db1/dd8 0 2024-09-13T21:40:25.690 INFO:tasks.workunit.client.0.smithi088.stdout:7/505: dwrite d6/da/d1a/f56 [0,4194304] 0 2024-09-13T21:40:25.690 INFO:tasks.workunit.client.0.smithi088.stdout:7/506: fsync d6/da/d1a/d3a/d5c/d60/f66 0 2024-09-13T21:40:25.690 INFO:tasks.workunit.client.0.smithi088.stdout:7/507: write d6/d5f/d69/d4f/d6f/d70/d76/f82 [318648,42445] 0 2024-09-13T21:40:25.692 INFO:tasks.workunit.client.0.smithi088.stdout:0/575: rename d7/d2c/d44/l63 to d7/d1d/ld1 0 2024-09-13T21:40:25.695 INFO:tasks.workunit.client.0.smithi088.stdout:8/549: mknod db/df/da7/d88/da8/cc3 0 2024-09-13T21:40:25.700 INFO:tasks.workunit.client.0.smithi088.stdout:2/632: mkdir d1/d8/d2e/d91/db3/dd9 0 2024-09-13T21:40:25.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/550: dread db/d26/d2c/db7/fbb [0,4194304] 0 2024-09-13T21:40:25.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/551: chown db/d26/d2c/d85/c43 45037 1 2024-09-13T21:40:25.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/552: write f8 [935150,94021] 0 2024-09-13T21:40:25.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/553: creat db/d26/d2c/db7/dbd/fc4 x:0 0 0 2024-09-13T21:40:25.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/554: creat db/d26/d2c/db7/fc5 x:0 0 0 2024-09-13T21:40:25.701 INFO:tasks.workunit.client.0.smithi088.stdout:8/555: creat db/df/da7/d88/da8/db4/fc6 x:0 0 0 2024-09-13T21:40:25.703 INFO:tasks.workunit.client.0.smithi088.stdout:2/633: dread d1/d8/f57 [0,4194304] 0 2024-09-13T21:40:25.703 INFO:tasks.workunit.client.0.smithi088.stdout:2/634: fdatasync d1/d8/d24/f4c 0 2024-09-13T21:40:25.703 INFO:tasks.workunit.client.0.smithi088.stdout:2/635: dread - d1/d13/d3f/d99/d9c/fbf zero size 2024-09-13T21:40:25.704 INFO:tasks.workunit.client.0.smithi088.stdout:2/636: write d1/d8/d24/d78/d7f/d85/f97 [1377681,10782] 0 2024-09-13T21:40:25.705 INFO:tasks.workunit.client.0.smithi088.stdout:7/508: mkdir d6/da/d44/da7 0 2024-09-13T21:40:25.709 INFO:tasks.workunit.client.0.smithi088.stdout:9/500: dwrite d1a/d1b/f40 [0,4194304] 0 2024-09-13T21:40:25.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/576: creat d7/d1d/d26/d34/fd2 x:0 0 0 2024-09-13T21:40:25.710 INFO:tasks.workunit.client.0.smithi088.stdout:3/626: dwrite d5/d23/d2a/d3f/d8f/d91/fb0 [0,4194304] 0 2024-09-13T21:40:25.711 INFO:tasks.workunit.client.0.smithi088.stdout:1/584: dwrite d9/d10/d2a/d4b/d33/f84 [0,4194304] 0 2024-09-13T21:40:25.712 INFO:tasks.workunit.client.0.smithi088.stdout:6/626: dwrite d0/d1e/f73 [0,4194304] 0 2024-09-13T21:40:25.717 INFO:tasks.workunit.client.0.smithi088.stdout:9/501: dread d1a/d3c/d51/d5e/f84 [0,4194304] 0 2024-09-13T21:40:25.717 INFO:tasks.workunit.client.0.smithi088.stdout:9/502: fsync d1a/f82 0 2024-09-13T21:40:25.723 INFO:tasks.workunit.client.0.smithi088.stdout:5/662: rmdir d4/d1c/d24/d26/d4b/d67 39 2024-09-13T21:40:25.723 INFO:tasks.workunit.client.0.smithi088.stdout:5/663: truncate d4/d1c/d24/d26/d40/f11 4321810 0 2024-09-13T21:40:25.728 INFO:tasks.workunit.client.0.smithi088.stdout:8/556: link db/d26/f8d db/d26/d2c/db7/dbd/fc7 0 2024-09-13T21:40:25.728 INFO:tasks.workunit.client.0.smithi088.stdout:8/557: write db/df/da7/d88/da8/fab [996402,34567] 0 2024-09-13T21:40:25.732 INFO:tasks.workunit.client.0.smithi088.stdout:1/585: dwrite d9/d10/f11 [0,4194304] 0 2024-09-13T21:40:25.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:25 smithi088 ceph-mon[27963]: pgmap v252: 65 pgs: 65 active+clean; 831 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 75 MiB/s rd, 101 MiB/s wr, 716 op/s 2024-09-13T21:40:25.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:25 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:25.733 INFO:tasks.workunit.client.0.smithi088.stdout:0/577: link d7/d1d/d27/f54 d7/d65/fd3 0 2024-09-13T21:40:25.733 INFO:tasks.workunit.client.0.smithi088.stdout:0/578: truncate d7/d2c/d30/d31/d42/d4b/fba 807880 0 2024-09-13T21:40:25.739 INFO:tasks.workunit.client.0.smithi088.stdout:8/558: write db/d26/f8d [3022037,100726] 0 2024-09-13T21:40:25.739 INFO:tasks.workunit.client.0.smithi088.stdout:8/559: fdatasync db/d26/d4f/f91 0 2024-09-13T21:40:25.739 INFO:tasks.workunit.client.0.smithi088.stdout:6/627: mkdir d0/d1e/d1f/d55/d8f/dc6 0 2024-09-13T21:40:25.743 INFO:tasks.workunit.client.0.smithi088.stdout:0/579: dread d7/d1d/d27/f70 [0,4194304] 0 2024-09-13T21:40:25.743 INFO:tasks.workunit.client.0.smithi088.stdout:0/580: chown d7/d2c/c8f 229063457 1 2024-09-13T21:40:25.743 INFO:tasks.workunit.client.0.smithi088.stdout:0/581: truncate d7/fa9 682389 0 2024-09-13T21:40:25.743 INFO:tasks.workunit.client.0.smithi088.stdout:0/582: write d7/d2c/d78/daf/fc7 [708613,20312] 0 2024-09-13T21:40:25.749 INFO:tasks.workunit.client.0.smithi088.stdout:7/509: getdents d6/d5f/d69 0 2024-09-13T21:40:25.749 INFO:tasks.workunit.client.0.smithi088.stdout:7/510: chown d6/da/d44/l68 508 1 2024-09-13T21:40:25.751 INFO:tasks.workunit.client.0.smithi088.stdout:1/586: unlink d9/d10/f11 0 2024-09-13T21:40:25.751 INFO:tasks.workunit.client.0.smithi088.stdout:1/587: chown d9/d10/d2a/d4b/d39/d43/d85 29580078 1 2024-09-13T21:40:25.752 INFO:tasks.workunit.client.0.smithi088.stdout:1/588: truncate d9/d10/d2a/f8a 1917039 0 2024-09-13T21:40:25.753 INFO:tasks.workunit.client.0.smithi088.stdout:3/627: rename d5/ld to d5/d23/d2a/d63/d31/lc0 0 2024-09-13T21:40:25.756 INFO:tasks.workunit.client.0.smithi088.stdout:0/583: mkdir d7/d65/dd4 0 2024-09-13T21:40:25.757 INFO:tasks.workunit.client.0.smithi088.stdout:9/503: getdents d1a/d1b 0 2024-09-13T21:40:25.758 INFO:tasks.workunit.client.0.smithi088.stdout:5/664: rmdir d4/d1c/d24/d26/d4b/d66 39 2024-09-13T21:40:25.758 INFO:tasks.workunit.client.0.smithi088.stdout:5/665: chown d4/d1c/d24/d26/d4b/l7d 5648586 1 2024-09-13T21:40:25.760 INFO:tasks.workunit.client.0.smithi088.stdout:7/511: truncate d6/da/d1a/f56 2855201 0 2024-09-13T21:40:25.761 INFO:tasks.workunit.client.0.smithi088.stdout:1/589: symlink d9/d10/d2a/d47/d9c/lc7 0 2024-09-13T21:40:25.763 INFO:tasks.workunit.client.0.smithi088.stdout:3/628: mknod d5/d23/d2a/d6b/d98/da1/cc1 0 2024-09-13T21:40:25.764 INFO:tasks.workunit.client.0.smithi088.stdout:5/666: dread d4/d1c/d4a/f5d [0,4194304] 0 2024-09-13T21:40:25.764 INFO:tasks.workunit.client.0.smithi088.stdout:0/584: truncate d7/d65/f76 2485999 0 2024-09-13T21:40:25.765 INFO:tasks.workunit.client.0.smithi088.stdout:9/504: mkdir d1a/d61/d3d/d41/d48/d86/d97 0 2024-09-13T21:40:25.766 INFO:tasks.workunit.client.0.smithi088.stdout:1/590: rmdir d9/d10/d2a/d47/d9c/db7 0 2024-09-13T21:40:25.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/560: dwrite db/f8f [0,4194304] 0 2024-09-13T21:40:25.768 INFO:tasks.workunit.client.0.smithi088.stdout:6/628: dwrite d0/f52 [4194304,4194304] 0 2024-09-13T21:40:25.774 INFO:tasks.workunit.client.0.smithi088.stdout:1/591: dread d9/f81 [0,4194304] 0 2024-09-13T21:40:25.774 INFO:tasks.workunit.client.0.smithi088.stdout:1/592: readlink d9/d10/d2a/d4b/d33/dad/lc4 0 2024-09-13T21:40:25.778 INFO:tasks.workunit.client.0.smithi088.stdout:3/629: unlink d5/d5a/d7f/ca2 0 2024-09-13T21:40:25.779 INFO:tasks.workunit.client.0.smithi088.stdout:5/667: link d4/d1c/d24/l4c d4/d1c/d24/d26/d4b/d66/ld7 0 2024-09-13T21:40:25.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/585: rmdir d7/d2c/d30 39 2024-09-13T21:40:25.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/586: readlink d7/d1d/d66/d8b/lb1 0 2024-09-13T21:40:25.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/587: fdatasync d7/d2c/d37/fbf 0 2024-09-13T21:40:25.782 INFO:tasks.workunit.client.0.smithi088.stdout:9/505: creat d1a/d61/d3d/d41/d48/d86/d97/f98 x:0 0 0 2024-09-13T21:40:25.786 INFO:tasks.workunit.client.0.smithi088.stdout:7/512: dwrite d6/da/d44/f6d [4194304,4194304] 0 2024-09-13T21:40:25.786 INFO:tasks.workunit.client.0.smithi088.stdout:6/629: dwrite d0/d2c/d32/f6e [0,4194304] 0 2024-09-13T21:40:25.793 INFO:tasks.workunit.client.0.smithi088.stdout:8/561: creat db/d26/d37/d7d/fc8 x:0 0 0 2024-09-13T21:40:25.795 INFO:tasks.workunit.client.0.smithi088.stdout:1/593: rename d9/d10/d2a/d4b/d33/d92/d8e/dae to d9/d10/d2a/d47/dc8 0 2024-09-13T21:40:25.796 INFO:tasks.workunit.client.0.smithi088.stdout:1/594: chown d9/d10/d2a/d4b/d33/dad 899 1 2024-09-13T21:40:25.796 INFO:tasks.workunit.client.0.smithi088.stdout:1/595: chown d9/d10/d2a/d4b/d33/f59 408282322 1 2024-09-13T21:40:25.796 INFO:tasks.workunit.client.0.smithi088.stdout:1/596: readlink d9/dc/d52/l66 0 2024-09-13T21:40:25.796 INFO:tasks.workunit.client.0.smithi088.stdout:1/597: readlink d9/d10/d2a/d4b/d33/dad/dbb/lc3 0 2024-09-13T21:40:25.798 INFO:tasks.workunit.client.0.smithi088.stdout:5/668: symlink d4/ld8 0 2024-09-13T21:40:25.800 INFO:tasks.workunit.client.0.smithi088.stdout:0/588: creat d7/d1d/d66/d8b/dc0/fd5 x:0 0 0 2024-09-13T21:40:25.801 INFO:tasks.workunit.client.0.smithi088.stdout:9/506: symlink d1a/d3c/d51/d5e/d7e/l99 0 2024-09-13T21:40:25.805 INFO:tasks.workunit.client.0.smithi088.stdout:7/513: mkdir d6/d5f/d69/da8 0 2024-09-13T21:40:25.808 INFO:tasks.workunit.client.0.smithi088.stdout:6/630: unlink d0/d2c/d59/fba 0 2024-09-13T21:40:25.810 INFO:tasks.workunit.client.0.smithi088.stdout:1/598: creat d9/d10/d2a/d4b/d33/dad/dbb/fc9 x:0 0 0 2024-09-13T21:40:25.811 INFO:tasks.workunit.client.0.smithi088.stdout:3/630: truncate d5/f21 4977030 0 2024-09-13T21:40:25.811 INFO:tasks.workunit.client.0.smithi088.stdout:3/631: creat d5/d23/d2a/d6b/fc2 x:0 0 0 2024-09-13T21:40:25.812 INFO:tasks.workunit.client.0.smithi088.stdout:5/669: rmdir d4/da7 39 2024-09-13T21:40:25.812 INFO:tasks.workunit.client.0.smithi088.stdout:5/670: chown d4/d1c/d24/d26/d56/cc5 154971 1 2024-09-13T21:40:25.812 INFO:tasks.workunit.client.0.smithi088.stdout:4/557: sync 2024-09-13T21:40:25.812 INFO:tasks.workunit.client.0.smithi088.stdout:4/558: truncate d2/fae 990418 0 2024-09-13T21:40:25.813 INFO:tasks.workunit.client.0.smithi088.stdout:0/589: link d7/d1d/d21/c52 d7/d2c/d30/dbe/cd6 0 2024-09-13T21:40:25.813 INFO:tasks.workunit.client.0.smithi088.stdout:0/590: chown d7/f23 77 1 2024-09-13T21:40:25.815 INFO:tasks.workunit.client.0.smithi088.stdout:9/507: creat d1a/d61/d3d/d41/d48/d86/f9a x:0 0 0 2024-09-13T21:40:25.815 INFO:tasks.workunit.client.0.smithi088.stdout:9/508: fdatasync f13 0 2024-09-13T21:40:25.815 INFO:tasks.workunit.client.0.smithi088.stdout:9/509: truncate d1a/d1b/d3f/f70 78384 0 2024-09-13T21:40:25.816 INFO:tasks.workunit.client.0.smithi088.stdout:7/514: mkdir d6/d5f/da9 0 2024-09-13T21:40:25.817 INFO:tasks.workunit.client.0.smithi088.stdout:6/631: mkdir d0/d2c/d7a/daf/dc7 0 2024-09-13T21:40:25.819 INFO:tasks.workunit.client.0.smithi088.stdout:8/562: rmdir db/d26/d2c/d85/d51 39 2024-09-13T21:40:25.821 INFO:tasks.workunit.client.0.smithi088.stdout:1/599: creat d9/d10/d2a/d4b/d33/dad/fca x:0 0 0 2024-09-13T21:40:25.823 INFO:tasks.workunit.client.0.smithi088.stdout:2/637: sync 2024-09-13T21:40:25.824 INFO:tasks.workunit.client.0.smithi088.stdout:7/515: write d6/da/f38 [3939262,1330] 0 2024-09-13T21:40:25.824 INFO:tasks.workunit.client.0.smithi088.stdout:3/632: mkdir d5/d23/d2a/d3f/d76/db3/da5/dc3 0 2024-09-13T21:40:25.824 INFO:tasks.workunit.client.0.smithi088.stdout:3/633: fdatasync d5/f21 0 2024-09-13T21:40:25.826 INFO:tasks.workunit.client.0.smithi088.stdout:2/638: write d1/d8/f47 [290642,96054] 0 2024-09-13T21:40:25.826 INFO:tasks.workunit.client.0.smithi088.stdout:2/639: chown d1/f34 5252686 1 2024-09-13T21:40:25.826 INFO:tasks.workunit.client.0.smithi088.stdout:0/591: write d7/f7b [4049726,57360] 0 2024-09-13T21:40:25.827 INFO:tasks.workunit.client.0.smithi088.stdout:4/559: link d2/d5/d20/d60/de/f28 d2/d81/fc0 0 2024-09-13T21:40:25.828 INFO:tasks.workunit.client.0.smithi088.stdout:9/510: getdents d1a/d1b/d3f 0 2024-09-13T21:40:25.829 INFO:tasks.workunit.client.0.smithi088.stdout:8/563: rmdir db/d26/d2c/d85/dad 39 2024-09-13T21:40:25.831 INFO:tasks.workunit.client.0.smithi088.stdout:6/632: dread d0/db/f2e [0,4194304] 0 2024-09-13T21:40:25.831 INFO:tasks.workunit.client.0.smithi088.stdout:5/671: dwrite d4/d1c/d24/d26/da1/fb0 [0,4194304] 0 2024-09-13T21:40:25.831 INFO:tasks.workunit.client.0.smithi088.stdout:5/672: write d4/d1c/d4a/f5d [1031809,112900] 0 2024-09-13T21:40:25.831 INFO:tasks.workunit.client.0.smithi088.stdout:5/673: write d4/f1f [9255118,63877] 0 2024-09-13T21:40:25.831 INFO:tasks.workunit.client.0.smithi088.stdout:1/600: rename d9/d10/f17 to d9/d10/d2a/d4b/d33/d92/dbe/fcb 0 2024-09-13T21:40:25.835 INFO:tasks.workunit.client.0.smithi088.stdout:2/640: creat d1/d8/d16/d40/d7e/daa/fda x:0 0 0 2024-09-13T21:40:25.838 INFO:tasks.workunit.client.0.smithi088.stdout:0/592: link d7/d1d/d66/d8b/dc0/fd5 d7/d1d/d21/d82/fd7 0 2024-09-13T21:40:25.838 INFO:tasks.workunit.client.0.smithi088.stdout:0/593: fsync d7/d1d/d66/d8b/fa1 0 2024-09-13T21:40:25.840 INFO:tasks.workunit.client.0.smithi088.stdout:4/560: truncate d2/d5/d20/d60/de/d1e/d23/f94 1458422 0 2024-09-13T21:40:25.840 INFO:tasks.workunit.client.0.smithi088.stdout:4/561: write d2/d5/d20/f73 [758040,75705] 0 2024-09-13T21:40:25.841 INFO:tasks.workunit.client.0.smithi088.stdout:8/564: truncate f8 101387 0 2024-09-13T21:40:25.841 INFO:tasks.workunit.client.0.smithi088.stdout:8/565: chown db/d26/d2c/f5a 45 1 2024-09-13T21:40:25.844 INFO:tasks.workunit.client.0.smithi088.stdout:8/566: dread db/d26/d37/f41 [0,4194304] 0 2024-09-13T21:40:25.844 INFO:tasks.workunit.client.0.smithi088.stdout:8/567: fsync db/d26/d4f/f68 0 2024-09-13T21:40:25.844 INFO:tasks.workunit.client.0.smithi088.stdout:9/511: dwrite d1a/d3c/f5a [0,4194304] 0 2024-09-13T21:40:25.844 INFO:tasks.workunit.client.0.smithi088.stdout:9/512: write d1a/f5d [240906,2728] 0 2024-09-13T21:40:25.845 INFO:tasks.workunit.client.0.smithi088.stdout:9/513: getdents d1a/d3c/d51/d5e/d72 0 2024-09-13T21:40:25.845 INFO:tasks.workunit.client.0.smithi088.stdout:6/633: chown d0/f6 6 1 2024-09-13T21:40:25.853 INFO:tasks.workunit.client.0.smithi088.stdout:5/674: unlink d4/d1c/c2c 0 2024-09-13T21:40:25.855 INFO:tasks.workunit.client.0.smithi088.stdout:1/601: creat d9/d10/d2a/d4b/d33/fcc x:0 0 0 2024-09-13T21:40:25.856 INFO:tasks.workunit.client.0.smithi088.stdout:1/602: write d9/dc/d52/dba/d7d/f80 [552205,125219] 0 2024-09-13T21:40:25.857 INFO:tasks.workunit.client.0.smithi088.stdout:3/634: getdents d5/d14 0 2024-09-13T21:40:25.859 INFO:tasks.workunit.client.0.smithi088.stdout:2/641: creat d1/d13/d2a/d3c/d4a/d6e/d5b/d89/dcc/fdb x:0 0 0 2024-09-13T21:40:25.859 INFO:tasks.workunit.client.0.smithi088.stdout:2/642: getdents d1/d13/d2a/d41/d82/db0 0 2024-09-13T21:40:25.859 INFO:tasks.workunit.client.0.smithi088.stdout:2/643: write d1/d8/d16/f37 [161851,101744] 0 2024-09-13T21:40:25.860 INFO:tasks.workunit.client.0.smithi088.stdout:0/594: truncate d7/d1d/d27/d43/f1c 2839324 0 2024-09-13T21:40:25.862 INFO:tasks.workunit.client.0.smithi088.stdout:4/562: symlink d2/d81/lc1 0 2024-09-13T21:40:25.863 INFO:tasks.workunit.client.0.smithi088.stdout:4/563: read d2/d13/d50/f84 [150655,119885] 0 2024-09-13T21:40:25.863 INFO:tasks.workunit.client.0.smithi088.stdout:9/514: dwrite d1a/d1b/f28 [0,4194304] 0 2024-09-13T21:40:25.863 INFO:tasks.workunit.client.0.smithi088.stdout:9/515: write f15 [4120239,35114] 0 2024-09-13T21:40:25.863 INFO:tasks.workunit.client.0.smithi088.stdout:8/568: creat db/df/da7/d88/db3/fc9 x:0 0 0 2024-09-13T21:40:25.868 INFO:tasks.workunit.client.0.smithi088.stdout:6/634: rmdir d0/d28/da3/db9 0 2024-09-13T21:40:25.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/675: rmdir d4 39 2024-09-13T21:40:25.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/676: stat d4/d1c/d24/d26/dbf/d89/dc9/dcb 0 2024-09-13T21:40:25.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/677: truncate d4/d1c/d24/d26/d40/f46 4817116 0 2024-09-13T21:40:25.869 INFO:tasks.workunit.client.0.smithi088.stdout:5/678: write d4/d1c/d4a/d63/d6a/fb4 [1806329,78260] 0 2024-09-13T21:40:25.872 INFO:tasks.workunit.client.0.smithi088.stdout:1/603: mkdir d9/d10/d2a/d4b/d3a/dcd 0 2024-09-13T21:40:25.872 INFO:tasks.workunit.client.0.smithi088.stdout:1/604: fsync d9/d10/d2a/d4b/d39/d43/f94 0 2024-09-13T21:40:25.872 INFO:tasks.workunit.client.0.smithi088.stdout:1/605: fsync d9/d10/d2a/f8a 0 2024-09-13T21:40:25.874 INFO:tasks.workunit.client.0.smithi088.stdout:3/635: creat d5/d5a/db8/fc4 x:0 0 0 2024-09-13T21:40:25.875 INFO:tasks.workunit.client.0.smithi088.stdout:2/644: creat d1/d13/d2a/d3c/d4a/d6e/d5b/fdc x:0 0 0 2024-09-13T21:40:25.876 INFO:tasks.workunit.client.0.smithi088.stdout:2/645: chown d1/d8/d16/f7c 1557772011 1 2024-09-13T21:40:25.876 INFO:tasks.workunit.client.0.smithi088.stdout:0/595: symlink d7/d2c/d30/dbe/dce/ld8 0 2024-09-13T21:40:25.878 INFO:tasks.workunit.client.0.smithi088.stdout:4/564: symlink d2/d5/d20/d41/d4b/lc2 0 2024-09-13T21:40:25.878 INFO:tasks.workunit.client.0.smithi088.stdout:4/565: read - d2/fb9 zero size 2024-09-13T21:40:25.878 INFO:tasks.workunit.client.0.smithi088.stdout:4/566: stat d2/d5/d20/d60/de/d1e/d31/f8b 0 2024-09-13T21:40:25.878 INFO:tasks.workunit.client.0.smithi088.stdout:4/567: fdatasync d2/d11/f16 0 2024-09-13T21:40:25.881 INFO:tasks.workunit.client.0.smithi088.stdout:9/516: unlink d1a/d1b/f40 0 2024-09-13T21:40:25.882 INFO:tasks.workunit.client.0.smithi088.stdout:9/517: stat d1a/d61/d3d/d41/d48/d86/d97 0 2024-09-13T21:40:25.882 INFO:tasks.workunit.client.0.smithi088.stdout:9/518: fsync d1a/d61/d3d/d75/f93 0 2024-09-13T21:40:25.882 INFO:tasks.workunit.client.0.smithi088.stdout:0/596: dread d7/d1d/d3d/f57 [0,4194304] 0 2024-09-13T21:40:25.883 INFO:tasks.workunit.client.0.smithi088.stdout:6/635: symlink d0/d1e/d1f/d55/d96/lc8 0 2024-09-13T21:40:25.883 INFO:tasks.workunit.client.0.smithi088.stdout:6/636: fdatasync d0/d2c/d32/d39/faa 0 2024-09-13T21:40:25.884 INFO:tasks.workunit.client.0.smithi088.stdout:0/597: dread d7/d2c/d30/d31/d42/d4b/f85 [0,4194304] 0 2024-09-13T21:40:25.884 INFO:tasks.workunit.client.0.smithi088.stdout:8/569: dwrite db/d26/f36 [0,4194304] 0 2024-09-13T21:40:25.884 INFO:tasks.workunit.client.0.smithi088.stdout:8/570: readlink db/l38 0 2024-09-13T21:40:25.885 INFO:tasks.workunit.client.0.smithi088.stdout:1/606: creat d9/d10/d2a/d4b/d39/d43/db2/fce x:0 0 0 2024-09-13T21:40:25.885 INFO:tasks.workunit.client.0.smithi088.stdout:1/607: fdatasync d9/d10/d2a/d4b/d33/f59 0 2024-09-13T21:40:25.887 INFO:tasks.workunit.client.0.smithi088.stdout:3/636: truncate d5/d23/d2a/f59 4037938 0 2024-09-13T21:40:25.887 INFO:tasks.workunit.client.0.smithi088.stdout:3/637: fdatasync d5/d23/d2a/d6b/d98/da1/daa/f6e 0 2024-09-13T21:40:25.889 INFO:tasks.workunit.client.0.smithi088.stdout:0/598: dread d7/d2c/d78/daf/fc7 [0,4194304] 0 2024-09-13T21:40:25.889 INFO:tasks.workunit.client.0.smithi088.stdout:0/599: write d7/d1d/d27/f3e [1726498,28439] 0 2024-09-13T21:40:25.889 INFO:tasks.workunit.client.0.smithi088.stdout:4/568: link d2/d5/d20/d60/de/d1e/d31/f3b d2/d5/d20/d60/de/d1e/d23/fc3 0 2024-09-13T21:40:25.889 INFO:tasks.workunit.client.0.smithi088.stdout:4/569: write d2/f45 [3445148,87190] 0 2024-09-13T21:40:25.891 INFO:tasks.workunit.client.0.smithi088.stdout:6/637: creat d0/d28/da3/fc9 x:0 0 0 2024-09-13T21:40:25.891 INFO:tasks.workunit.client.0.smithi088.stdout:6/638: read d0/d28/f40 [1211359,7802] 0 2024-09-13T21:40:25.893 INFO:tasks.workunit.client.0.smithi088.stdout:5/679: getdents d4/d1c/d4a 0 2024-09-13T21:40:25.899 INFO:tasks.workunit.client.0.smithi088.stdout:0/600: mknod d7/d1d/d21/d82/db8/cd9 0 2024-09-13T21:40:25.901 INFO:tasks.workunit.client.0.smithi088.stdout:4/570: creat d2/d5/d20/d60/de/fc4 x:0 0 0 2024-09-13T21:40:25.901 INFO:tasks.workunit.client.0.smithi088.stdout:4/571: chown d2/d5/d20/d60/de/d1e/d23/d69/f7e 234 1 2024-09-13T21:40:25.902 INFO:tasks.workunit.client.0.smithi088.stdout:4/572: fsync d2/d5/d20/d60/de/f8c 0 2024-09-13T21:40:25.903 INFO:tasks.workunit.client.0.smithi088.stdout:9/519: link d1a/l2c d1a/d61/d3d/d41/d48/d86/d8e/l9b 0 2024-09-13T21:40:25.905 INFO:tasks.workunit.client.0.smithi088.stdout:6/639: symlink d0/d2c/d8b/lca 0 2024-09-13T21:40:25.907 INFO:tasks.workunit.client.0.smithi088.stdout:5/680: rename d4/d1c/d24/d26/da1/fce to d4/d1c/d24/d26/dbf/d89/fd9 0 2024-09-13T21:40:25.909 INFO:tasks.workunit.client.0.smithi088.stdout:8/571: mkdir db/d26/d2c/d85/d51/dca 0 2024-09-13T21:40:25.909 INFO:tasks.workunit.client.0.smithi088.stdout:8/572: getdents db/df/da7/daa 0 2024-09-13T21:40:25.911 INFO:tasks.workunit.client.0.smithi088.stdout:0/601: mknod d7/d1d/d27/d43/cda 0 2024-09-13T21:40:25.911 INFO:tasks.workunit.client.0.smithi088.stdout:0/602: chown d7/d65/d8c 3589 1 2024-09-13T21:40:25.913 INFO:tasks.workunit.client.0.smithi088.stdout:9/520: symlink d1a/d61/d3d/d41/d48/d86/d97/l9c 0 2024-09-13T21:40:25.913 INFO:tasks.workunit.client.0.smithi088.stdout:9/521: write d1a/d3c/d51/f52 [169420,617] 0 2024-09-13T21:40:25.914 INFO:tasks.workunit.client.0.smithi088.stdout:6/640: unlink d0/d2c/d32/d39/l6a 0 2024-09-13T21:40:25.915 INFO:tasks.workunit.client.0.smithi088.stdout:2/646: dwrite d1/d8/d16/f37 [0,4194304] 0 2024-09-13T21:40:25.915 INFO:tasks.workunit.client.0.smithi088.stdout:5/681: symlink d4/d1b/d68/lda 0 2024-09-13T21:40:25.917 INFO:tasks.workunit.client.0.smithi088.stdout:0/603: creat d7/d65/dd4/fdb x:0 0 0 2024-09-13T21:40:25.917 INFO:tasks.workunit.client.0.smithi088.stdout:0/604: readlink d7/d2c/l4d 0 2024-09-13T21:40:25.917 INFO:tasks.workunit.client.0.smithi088.stdout:0/605: dread - d7/d1d/d66/fa7 zero size 2024-09-13T21:40:25.917 INFO:tasks.workunit.client.0.smithi088.stdout:0/606: chown d7/d65/c88 800292481 1 2024-09-13T21:40:25.918 INFO:tasks.workunit.client.0.smithi088.stdout:0/607: truncate d7/d1d/d27/f6f 1810013 0 2024-09-13T21:40:25.918 INFO:tasks.workunit.client.0.smithi088.stdout:0/608: fdatasync d7/d1d/d27/f64 0 2024-09-13T21:40:25.918 INFO:tasks.workunit.client.0.smithi088.stdout:0/609: dread - d7/d1d/d66/d8b/dc0/fd5 zero size 2024-09-13T21:40:25.923 INFO:tasks.workunit.client.0.smithi088.stdout:8/573: dread db/d26/d2c/d85/d51/f54 [4194304,4194304] 0 2024-09-13T21:40:25.925 INFO:tasks.workunit.client.0.smithi088.stdout:4/573: dwrite d2/d5/d20/d60/de/d1e/d23/d3c/f89 [0,4194304] 0 2024-09-13T21:40:25.926 INFO:tasks.workunit.client.0.smithi088.stdout:1/608: dwrite d9/d10/d2a/d4b/d39/d43/db2/fce [0,4194304] 0 2024-09-13T21:40:25.926 INFO:tasks.workunit.client.0.smithi088.stdout:1/609: stat d9/d4f/faa 0 2024-09-13T21:40:25.926 INFO:tasks.workunit.client.0.smithi088.stdout:8/574: mkdir db/d26/d2c/d85/d51/dca/dcb 0 2024-09-13T21:40:25.926 INFO:tasks.workunit.client.0.smithi088.stdout:9/522: dread d1a/f5d [0,4194304] 0 2024-09-13T21:40:25.934 INFO:tasks.workunit.client.0.smithi088.stdout:3/638: dwrite d5/d23/d2a/d3f/f69 [0,4194304] 0 2024-09-13T21:40:25.941 INFO:tasks.workunit.client.0.smithi088.stdout:8/575: symlink db/df/da7/daa/lcc 0 2024-09-13T21:40:25.947 INFO:tasks.workunit.client.0.smithi088.stdout:9/523: symlink d1a/d61/d3d/d41/d48/l9d 0 2024-09-13T21:40:25.947 INFO:tasks.workunit.client.0.smithi088.stdout:9/524: dread - d1a/d61/d3d/d41/d48/d86/d97/f98 zero size 2024-09-13T21:40:25.947 INFO:tasks.workunit.client.0.smithi088.stdout:9/525: write d1a/d1b/f66 [720560,96999] 0 2024-09-13T21:40:25.950 INFO:tasks.workunit.client.0.smithi088.stdout:4/574: mknod d2/d5/d20/d60/de/cc5 0 2024-09-13T21:40:25.951 INFO:tasks.workunit.client.0.smithi088.stdout:8/576: creat db/df/da7/fcd x:0 0 0 2024-09-13T21:40:25.951 INFO:tasks.workunit.client.0.smithi088.stdout:4/575: getdents d2/d5/d20/d60/de/d1e/d23/d3c/d65 0 2024-09-13T21:40:25.952 INFO:tasks.workunit.client.0.smithi088.stdout:8/577: creat db/df/da7/daa/fce x:0 0 0 2024-09-13T21:40:25.980 INFO:tasks.workunit.client.0.smithi088.stdout:8/578: write db/d26/d4f/f9e [3225853,6061] 0 2024-09-13T21:40:25.980 INFO:tasks.workunit.client.0.smithi088.stdout:8/579: dread - db/d26/d37/d7d/fac zero size 2024-09-13T21:40:25.982 INFO:tasks.workunit.client.0.smithi088.stdout:8/580: getdents db 0 2024-09-13T21:40:25.982 INFO:tasks.workunit.client.0.smithi088.stdout:8/581: read db/d26/f2b [2202164,36015] 0 2024-09-13T21:40:25.984 INFO:tasks.workunit.client.0.smithi088.stdout:8/582: link db/df/f69 db/d26/d2c/fcf 0 2024-09-13T21:40:25.986 INFO:tasks.workunit.client.0.smithi088.stdout:8/583: getdents db/d26/d37/d7d 0 2024-09-13T21:40:25.993 INFO:tasks.workunit.client.0.smithi088.stdout:8/584: dread db/d26/f45 [0,4194304] 0 2024-09-13T21:40:25.994 INFO:tasks.workunit.client.0.smithi088.stdout:8/585: mkdir db/d26/d4f/dd0 0 2024-09-13T21:40:25.994 INFO:tasks.workunit.client.0.smithi088.stdout:8/586: fsync db/d26/fa5 0 2024-09-13T21:40:25.997 INFO:tasks.workunit.client.0.smithi088.stdout:8/587: rmdir db/df/da7 39 2024-09-13T21:40:26.000 INFO:tasks.workunit.client.0.smithi088.stdout:8/588: unlink db/d26/d4f/l73 0 2024-09-13T21:40:26.000 INFO:tasks.workunit.client.0.smithi088.stdout:8/589: write db/d26/f48 [78991,103480] 0 2024-09-13T21:40:26.000 INFO:tasks.workunit.client.0.smithi088.stdout:8/590: chown db/d26/f35 51987291 1 2024-09-13T21:40:26.000 INFO:tasks.workunit.client.0.smithi088.stdout:8/591: creat db/d26/d2c/db7/dbd/fd1 x:0 0 0 2024-09-13T21:40:26.013 INFO:tasks.workunit.client.0.smithi088.stdout:5/682: dwrite d4/d1c/d24/d95/f97 [0,4194304] 0 2024-09-13T21:40:26.017 INFO:tasks.workunit.client.0.smithi088.stdout:5/683: creat d4/d1c/d24/d26/dbf/d89/fdb x:0 0 0 2024-09-13T21:40:26.017 INFO:tasks.workunit.client.0.smithi088.stdout:5/684: truncate d4/d1c/d24/d95/fcf 540556 0 2024-09-13T21:40:26.017 INFO:tasks.workunit.client.0.smithi088.stdout:6/641: dwrite d0/d1e/f73 [0,4194304] 0 2024-09-13T21:40:26.017 INFO:tasks.workunit.client.0.smithi088.stdout:3/639: dwrite d5/d23/d2a/d3f/d8f/da3/fab [0,4194304] 0 2024-09-13T21:40:26.017 INFO:tasks.workunit.client.0.smithi088.stdout:1/610: dwrite d9/d10/d2a/d4b/d33/d92/dbe/fcb [0,4194304] 0 2024-09-13T21:40:26.019 INFO:tasks.workunit.client.0.smithi088.stdout:5/685: mkdir d4/d1c/d24/d26/dbf/d89/ddc 0 2024-09-13T21:40:26.019 INFO:tasks.workunit.client.0.smithi088.stdout:3/640: dread d5/d23/d2a/d3f/d76/d81/f9f [0,4194304] 0 2024-09-13T21:40:26.019 INFO:tasks.workunit.client.0.smithi088.stdout:5/686: dread - d4/d1c/d24/d26/dbf/d89/fd9 zero size 2024-09-13T21:40:26.021 INFO:tasks.workunit.client.0.smithi088.stdout:6/642: link d0/d1e/f73 d0/d2c/d59/fcb 0 2024-09-13T21:40:26.022 INFO:tasks.workunit.client.0.smithi088.stdout:9/526: dwrite d1a/d3c/d51/f52 [0,4194304] 0 2024-09-13T21:40:26.022 INFO:tasks.workunit.client.0.smithi088.stdout:0/610: dwrite d7/d1d/d27/d43/f17 [4194304,4194304] 0 2024-09-13T21:40:26.022 INFO:tasks.workunit.client.0.smithi088.stdout:4/576: dwrite d2/d5/ff [0,4194304] 0 2024-09-13T21:40:26.022 INFO:tasks.workunit.client.0.smithi088.stdout:8/592: dwrite db/d26/d4f/f7e [4194304,4194304] 0 2024-09-13T21:40:26.023 INFO:tasks.workunit.client.0.smithi088.stdout:4/577: write d2/d5/d20/d60/f97 [578628,116722] 0 2024-09-13T21:40:26.025 INFO:tasks.workunit.client.0.smithi088.stdout:3/641: mknod d5/d23/d2a/d55/cc5 0 2024-09-13T21:40:26.026 INFO:tasks.workunit.client.0.smithi088.stdout:6/643: mkdir d0/d2c/dad/db8/dcc 0 2024-09-13T21:40:26.029 INFO:tasks.workunit.client.0.smithi088.stdout:0/611: symlink d7/d65/dd4/ldc 0 2024-09-13T21:40:26.036 INFO:tasks.workunit.client.0.smithi088.stdout:3/642: creat d5/d14/fc6 x:0 0 0 2024-09-13T21:40:26.036 INFO:tasks.workunit.client.0.smithi088.stdout:3/643: creat d5/d23/d2a/d63/d48/fc7 x:0 0 0 2024-09-13T21:40:26.036 INFO:tasks.workunit.client.0.smithi088.stdout:3/644: truncate d5/d23/d2a/d63/f87 412600 0 2024-09-13T21:40:26.036 INFO:tasks.workunit.client.0.smithi088.stdout:3/645: truncate d5/f16 5038977 0 2024-09-13T21:40:26.036 INFO:tasks.workunit.client.0.smithi088.stdout:5/687: truncate d4/d1c/d24/d95/fcf 386891 0 2024-09-13T21:40:26.039 INFO:tasks.workunit.client.0.smithi088.stdout:9/527: mkdir d1a/d9e 0 2024-09-13T21:40:26.040 INFO:tasks.workunit.client.0.smithi088.stdout:0/612: truncate d7/d2c/d30/d31/d42/d95/fc4 1520272 0 2024-09-13T21:40:26.040 INFO:tasks.workunit.client.0.smithi088.stdout:0/613: write d7/d2c/f48 [1085988,46154] 0 2024-09-13T21:40:26.041 INFO:tasks.workunit.client.0.smithi088.stdout:8/593: dwrite db/df/f1f [0,4194304] 0 2024-09-13T21:40:26.043 INFO:tasks.workunit.client.0.smithi088.stdout:3/646: unlink d5/d14/l15 0 2024-09-13T21:40:26.043 INFO:tasks.workunit.client.0.smithi088.stdout:3/647: dread - d5/d14/fc6 zero size 2024-09-13T21:40:26.045 INFO:tasks.workunit.client.0.smithi088.stdout:5/688: creat d4/d1c/d4a/d63/d6a/d6d/fdd x:0 0 0 2024-09-13T21:40:26.045 INFO:tasks.workunit.client.0.smithi088.stdout:5/689: chown d4/d1c/d24/d26/c79 11251213 1 2024-09-13T21:40:26.045 INFO:tasks.workunit.client.0.smithi088.stdout:6/644: rmdir d0/d28/da3 39 2024-09-13T21:40:26.047 INFO:tasks.workunit.client.0.smithi088.stdout:9/528: mknod d1a/d3c/d51/d5e/d7e/d92/c9f 0 2024-09-13T21:40:26.049 INFO:tasks.workunit.client.0.smithi088.stdout:4/578: truncate d2/d5/d20/d60/de/d1e/d31/f91 4088246 0 2024-09-13T21:40:26.052 INFO:tasks.workunit.client.0.smithi088.stdout:8/594: rename db/d26/d2c/db7/fc1 to db/fd2 0 2024-09-13T21:40:26.053 INFO:tasks.workunit.client.0.smithi088.stdout:3/648: truncate d5/d23/d2a/d63/d48/f99 2602748 0 2024-09-13T21:40:26.053 INFO:tasks.workunit.client.0.smithi088.stdout:3/649: truncate d5/d23/d2a/fb2 442289 0 2024-09-13T21:40:26.053 INFO:tasks.workunit.client.0.smithi088.stdout:7/516: sync 2024-09-13T21:40:26.055 INFO:tasks.workunit.client.0.smithi088.stdout:5/690: unlink d4/d1c/d24/f59 0 2024-09-13T21:40:26.056 INFO:tasks.workunit.client.0.smithi088.stdout:9/529: symlink d1a/d3c/d51/d5e/la0 0 2024-09-13T21:40:26.056 INFO:tasks.workunit.client.0.smithi088.stdout:9/530: stat d1a/d61/d3d/f7d 0 2024-09-13T21:40:26.057 INFO:tasks.workunit.client.0.smithi088.stdout:9/531: fdatasync d1a/d3c/d51/d5e/f7c 0 2024-09-13T21:40:26.058 INFO:tasks.workunit.client.0.smithi088.stdout:4/579: rmdir d2/d5/d20/d60/de/d1e/d23/d69 39 2024-09-13T21:40:26.058 INFO:tasks.workunit.client.0.smithi088.stdout:0/614: dwrite d7/d1d/d27/f6f [0,4194304] 0 2024-09-13T21:40:26.061 INFO:tasks.workunit.client.0.smithi088.stdout:6/645: rename d0/f6 to d0/d2c/fcd 0 2024-09-13T21:40:26.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/517: getdents d6/d5f/d69 0 2024-09-13T21:40:26.064 INFO:tasks.workunit.client.0.smithi088.stdout:0/615: unlink d7/d1d/d27/d43/f1c 0 2024-09-13T21:40:26.064 INFO:tasks.workunit.client.0.smithi088.stdout:0/616: chown d7/d2c/d30/cb2 6 1 2024-09-13T21:40:26.064 INFO:tasks.workunit.client.0.smithi088.stdout:0/617: creat d7/d65/d8c/fdd x:0 0 0 2024-09-13T21:40:26.064 INFO:tasks.workunit.client.0.smithi088.stdout:0/618: write d7/d65/d8c/fb9 [1331985,14094] 0 2024-09-13T21:40:26.066 INFO:tasks.workunit.client.0.smithi088.stdout:4/580: creat d2/d5/d20/d60/de/d1e/d23/d3c/fc6 x:0 0 0 2024-09-13T21:40:26.066 INFO:tasks.workunit.client.0.smithi088.stdout:4/581: write d2/d5/d20/d60/de/f95 [901595,15957] 0 2024-09-13T21:40:26.067 INFO:tasks.workunit.client.0.smithi088.stdout:4/582: write d2/d5/d20/d60/f97 [743917,120941] 0 2024-09-13T21:40:26.067 INFO:tasks.workunit.client.0.smithi088.stdout:4/583: chown d2/d5/d20/d60/de/d1e/d23/f94 934 1 2024-09-13T21:40:26.067 INFO:tasks.workunit.client.0.smithi088.stdout:4/584: write d2/d5/d20/d60/fb6 [147349,68822] 0 2024-09-13T21:40:26.069 INFO:tasks.workunit.client.0.smithi088.stdout:8/595: rename db/d26/d2c/db7/fc5 to db/df/d61/d97/fd3 0 2024-09-13T21:40:26.069 INFO:tasks.workunit.client.0.smithi088.stdout:8/596: chown db/l42 0 1 2024-09-13T21:40:26.069 INFO:tasks.workunit.client.0.smithi088.stdout:8/597: fsync db/f82 0 2024-09-13T21:40:26.069 INFO:tasks.workunit.client.0.smithi088.stdout:8/598: stat db/l1c 0 2024-09-13T21:40:26.071 INFO:tasks.workunit.client.0.smithi088.stdout:7/518: link d6/l35 d6/d5f/d69/d4f/d6f/laa 0 2024-09-13T21:40:26.072 INFO:tasks.workunit.client.0.smithi088.stdout:7/519: readlink d6/d5f/d69/l74 0 2024-09-13T21:40:26.072 INFO:tasks.workunit.client.0.smithi088.stdout:7/520: fdatasync d6/da/f46 0 2024-09-13T21:40:26.074 INFO:tasks.workunit.client.0.smithi088.stdout:3/650: dwrite d5/d23/d2a/d6b/fc2 [0,4194304] 0 2024-09-13T21:40:26.075 INFO:tasks.workunit.client.0.smithi088.stdout:0/619: creat d7/d1d/d26/dcd/fde x:0 0 0 2024-09-13T21:40:26.076 INFO:tasks.workunit.client.0.smithi088.stdout:5/691: dwrite d4/d1c/d4a/d63/f74 [0,4194304] 0 2024-09-13T21:40:26.078 INFO:tasks.workunit.client.0.smithi088.stdout:9/532: rename d1a/d1b/f28 to d1a/d61/d3d/d41/d48/d86/fa1 0 2024-09-13T21:40:26.081 INFO:tasks.workunit.client.0.smithi088.stdout:5/692: dread d4/d1c/d24/d26/d4b/d66/f71 [0,4194304] 0 2024-09-13T21:40:26.081 INFO:tasks.workunit.client.0.smithi088.stdout:5/693: write d4/d1c/d24/d26/dbf/d89/d92/f61 [883980,55717] 0 2024-09-13T21:40:26.081 INFO:tasks.workunit.client.0.smithi088.stdout:5/694: fdatasync d4/d1c/d24/d26/d40/f46 0 2024-09-13T21:40:26.085 INFO:tasks.workunit.client.0.smithi088.stdout:3/651: unlink d5/d5a/f73 0 2024-09-13T21:40:26.089 INFO:tasks.workunit.client.0.smithi088.stdout:0/620: getdents d7/d2c/d30/d31/d42 0 2024-09-13T21:40:26.094 INFO:tasks.workunit.client.0.smithi088.stdout:8/599: dwrite db/df/f69 [0,4194304] 0 2024-09-13T21:40:26.094 INFO:tasks.workunit.client.0.smithi088.stdout:7/521: dwrite d6/f18 [0,4194304] 0 2024-09-13T21:40:26.098 INFO:tasks.workunit.client.0.smithi088.stdout:6/646: rename d0/d28/c89 to d0/d1e/d1f/d55/d8f/cce 0 2024-09-13T21:40:26.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/695: symlink d4/d1c/d24/d26/d4b/d67/lde 0 2024-09-13T21:40:26.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/696: dread - d4/d1c/d4a/d8a/f9b zero size 2024-09-13T21:40:26.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/697: dread - d4/d1c/d24/d26/f55 zero size 2024-09-13T21:40:26.102 INFO:tasks.workunit.client.0.smithi088.stdout:5/698: write d4/d1c/d24/d26/dbf/d89/fd9 [446993,38321] 0 2024-09-13T21:40:26.104 INFO:tasks.workunit.client.0.smithi088.stdout:0/621: link d7/d2c/d30/dbe/dce/ld8 d7/d2c/d30/d31/ldf 0 2024-09-13T21:40:26.105 INFO:tasks.workunit.client.0.smithi088.stdout:3/652: dread d5/f50 [0,4194304] 0 2024-09-13T21:40:26.105 INFO:tasks.workunit.client.0.smithi088.stdout:3/653: creat d5/d14/fc8 x:0 0 0 2024-09-13T21:40:26.107 INFO:tasks.workunit.client.0.smithi088.stdout:8/600: symlink db/d26/d2c/db7/dba/ld4 0 2024-09-13T21:40:26.108 INFO:tasks.workunit.client.0.smithi088.stdout:7/522: symlink d6/da/d44/lab 0 2024-09-13T21:40:26.110 INFO:tasks.workunit.client.0.smithi088.stdout:9/533: rename d1a/d1b/f38 to d1a/d3c/d60/fa2 0 2024-09-13T21:40:26.110 INFO:tasks.workunit.client.0.smithi088.stdout:9/534: stat d1a/d61/d3d/d41/d48/d86/d97/l9c 0 2024-09-13T21:40:26.111 INFO:tasks.workunit.client.0.smithi088.stdout:6/647: mknod d0/d2c/d32/d39/d3f/d71/d81/ccf 0 2024-09-13T21:40:26.111 INFO:tasks.workunit.client.0.smithi088.stdout:6/648: write d0/d28/f78 [748099,38709] 0 2024-09-13T21:40:26.111 INFO:tasks.workunit.client.0.smithi088.stdout:6/649: chown d0/d2c/d32/d39/c5e 80480344 1 2024-09-13T21:40:26.111 INFO:tasks.workunit.client.0.smithi088.stdout:5/699: creat d4/fdf x:0 0 0 2024-09-13T21:40:26.117 INFO:tasks.workunit.client.0.smithi088.stdout:0/622: link d7/d1d/d3d/la0 d7/d2c/d30/d31/d42/d95/le0 0 2024-09-13T21:40:26.117 INFO:tasks.workunit.client.0.smithi088.stdout:8/601: write db/d26/f2b [7390709,7489] 0 2024-09-13T21:40:26.117 INFO:tasks.workunit.client.0.smithi088.stdout:7/523: creat d6/d5f/d69/d4f/d6f/d70/fac x:0 0 0 2024-09-13T21:40:26.117 INFO:tasks.workunit.client.0.smithi088.stdout:3/654: rmdir d5/d23/d2a/d3f/d8f/da8 39 2024-09-13T21:40:26.118 INFO:tasks.workunit.client.0.smithi088.stdout:3/655: creat d5/d23/fc9 x:0 0 0 2024-09-13T21:40:26.119 INFO:tasks.workunit.client.0.smithi088.stdout:0/623: mkdir d7/d2c/d30/dbe/dce/de1 0 2024-09-13T21:40:26.121 INFO:tasks.workunit.client.0.smithi088.stdout:8/602: creat db/df/da7/d88/fd5 x:0 0 0 2024-09-13T21:40:26.123 INFO:tasks.workunit.client.0.smithi088.stdout:3/656: read d5/f6 [124437,64108] 0 2024-09-13T21:40:26.124 INFO:tasks.workunit.client.0.smithi088.stdout:5/700: rmdir d4/d1c/d4a/d8a 39 2024-09-13T21:40:26.125 INFO:tasks.workunit.client.0.smithi088.stdout:5/701: chown d4/d1c/d24/d26/d4b/d66/f77 173249722 1 2024-09-13T21:40:26.125 INFO:tasks.workunit.client.0.smithi088.stdout:5/702: dread - d4/d1c/d24/d26/dbf/d89/fdb zero size 2024-09-13T21:40:26.127 INFO:tasks.workunit.client.0.smithi088.stdout:0/624: rename d7/d2c/d44 to d7/d2c/d30/d31/d42/de2 0 2024-09-13T21:40:26.127 INFO:tasks.workunit.client.0.smithi088.stdout:0/625: write d7/d2c/d30/d31/fb6 [711811,111076] 0 2024-09-13T21:40:26.127 INFO:tasks.workunit.client.0.smithi088.stdout:7/524: dread d6/d5f/d69/d4f/d6f/f92 [0,4194304] 0 2024-09-13T21:40:26.127 INFO:tasks.workunit.client.0.smithi088.stdout:0/626: write d7/d2c/d30/f35 [4520346,130520] 0 2024-09-13T21:40:26.128 INFO:tasks.workunit.client.0.smithi088.stdout:0/627: truncate d7/d65/f92 1599299 0 2024-09-13T21:40:26.128 INFO:tasks.workunit.client.0.smithi088.stdout:8/603: getdents db/df/da7 0 2024-09-13T21:40:26.129 INFO:tasks.workunit.client.0.smithi088.stdout:3/657: truncate d5/d23/d2a/f40 1835437 0 2024-09-13T21:40:26.129 INFO:tasks.workunit.client.0.smithi088.stdout:3/658: truncate d5/d23/d2a/d6b/d98/fbe 1217688 0 2024-09-13T21:40:26.130 INFO:tasks.workunit.client.0.smithi088.stdout:5/703: creat d4/d1c/d24/d26/fe0 x:0 0 0 2024-09-13T21:40:26.131 INFO:tasks.workunit.client.0.smithi088.stdout:7/525: symlink d6/da/lad 0 2024-09-13T21:40:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:6/650: dwrite d0/d2c/d32/d39/faa [0,4194304] 0 2024-09-13T21:40:26.133 INFO:tasks.workunit.client.0.smithi088.stdout:6/651: write d0/db/d37/fc3 [175998,8510] 0 2024-09-13T21:40:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:0/628: truncate d7/d2c/d30/d31/d42/d4b/fba 466157 0 2024-09-13T21:40:26.134 INFO:tasks.workunit.client.0.smithi088.stdout:0/629: write d7/d1d/d26/dcd/fde [430486,90474] 0 2024-09-13T21:40:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:9/535: dwrite d1a/d3c/d51/d5e/f7c [0,4194304] 0 2024-09-13T21:40:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:9/536: write d1a/d3c/f94 [236193,81935] 0 2024-09-13T21:40:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:9/537: write f15 [3064768,102409] 0 2024-09-13T21:40:26.139 INFO:tasks.workunit.client.0.smithi088.stdout:5/704: mknod d4/d1c/d4a/d63/dd0/ce1 0 2024-09-13T21:40:26.140 INFO:tasks.workunit.client.0.smithi088.stdout:8/604: dread db/d26/d2c/fcf [0,4194304] 0 2024-09-13T21:40:26.140 INFO:tasks.workunit.client.0.smithi088.stdout:8/605: chown db/d26/d2c/db7/dba/ld4 53 1 2024-09-13T21:40:26.143 INFO:tasks.workunit.client.0.smithi088.stdout:6/652: truncate d0/d1e/fa1 83254 0 2024-09-13T21:40:26.143 INFO:tasks.workunit.client.0.smithi088.stdout:6/653: creat d0/d1e/fd0 x:0 0 0 2024-09-13T21:40:26.150 INFO:tasks.workunit.client.0.smithi088.stdout:5/705: dread d4/ff [4194304,4194304] 0 2024-09-13T21:40:26.156 INFO:tasks.workunit.client.0.smithi088.stdout:8/606: dwrite db/d26/d4f/f7e [4194304,4194304] 0 2024-09-13T21:40:26.160 INFO:tasks.workunit.client.0.smithi088.stdout:9/538: unlink d1a/d1b/l78 0 2024-09-13T21:40:26.163 INFO:tasks.workunit.client.0.smithi088.stdout:3/659: link d5/l1f d5/d5a/db8/lca 0 2024-09-13T21:40:26.172 INFO:tasks.workunit.client.0.smithi088.stdout:6/654: unlink d0/d1e/d1f/d55/c67 0 2024-09-13T21:40:26.173 INFO:tasks.workunit.client.0.smithi088.stdout:0/630: getdents d7/d1d/d26 0 2024-09-13T21:40:26.174 INFO:tasks.workunit.client.0.smithi088.stdout:5/706: dwrite d4/d1c/d24/f41 [0,4194304] 0 2024-09-13T21:40:26.175 INFO:tasks.workunit.client.0.smithi088.stdout:0/631: mknod d7/d2c/d30/dbe/dce/de1/ce3 0 2024-09-13T21:40:26.177 INFO:tasks.workunit.client.0.smithi088.stdout:3/660: rename d5/l1f to d5/d23/d2a/d3f/d76/db3/lcb 0 2024-09-13T21:40:26.177 INFO:tasks.workunit.client.0.smithi088.stdout:1/611: sync 2024-09-13T21:40:26.177 INFO:tasks.workunit.client.0.smithi088.stdout:4/585: sync 2024-09-13T21:40:26.177 INFO:tasks.workunit.client.0.smithi088.stdout:2/647: sync 2024-09-13T21:40:26.177 INFO:tasks.workunit.client.0.smithi088.stdout:1/612: creat d9/d10/d2a/d4b/d39/d43/db2/fcf x:0 0 0 2024-09-13T21:40:26.179 INFO:tasks.workunit.client.0.smithi088.stdout:5/707: unlink d4/d1c/d24/d26/d4b/d66/fc8 0 2024-09-13T21:40:26.180 INFO:tasks.workunit.client.0.smithi088.stdout:0/632: truncate d7/d2c/d30/d31/fb6 367067 0 2024-09-13T21:40:26.182 INFO:tasks.workunit.client.0.smithi088.stdout:3/661: rename d5/d23/d2a/d6b/d98/da1/daa/f33 to d5/d23/d2a/d3f/d8f/da8/fcc 0 2024-09-13T21:40:26.185 INFO:tasks.workunit.client.0.smithi088.stdout:5/708: link d4/d1c/d24/d26/d4b/d66/f77 d4/d1c/d4a/d63/dd0/fe2 0 2024-09-13T21:40:26.185 INFO:tasks.workunit.client.0.smithi088.stdout:5/709: dread - d4/d1c/d4a/d8a/f9b zero size 2024-09-13T21:40:26.186 INFO:tasks.workunit.client.0.smithi088.stdout:0/633: mknod d7/d2c/d37/ce4 0 2024-09-13T21:40:26.186 INFO:tasks.workunit.client.0.smithi088.stdout:6/655: dread d0/d2c/d59/fcb [0,4194304] 0 2024-09-13T21:40:26.188 INFO:tasks.workunit.client.0.smithi088.stdout:3/662: mkdir d5/d23/d2a/d6b/d98/dcd 0 2024-09-13T21:40:26.188 INFO:tasks.workunit.client.0.smithi088.stdout:8/607: dwrite db/d26/f2b [4194304,4194304] 0 2024-09-13T21:40:26.188 INFO:tasks.workunit.client.0.smithi088.stdout:8/608: chown db/d26/d2c/f5a 45 1 2024-09-13T21:40:26.188 INFO:tasks.workunit.client.0.smithi088.stdout:8/609: chown db/d26/d2c/f5a 10739870 1 2024-09-13T21:40:26.189 INFO:tasks.workunit.client.0.smithi088.stdout:5/710: symlink d4/d1c/d24/d26/d40/le3 0 2024-09-13T21:40:26.189 INFO:tasks.workunit.client.0.smithi088.stdout:9/539: dwrite d1a/d3c/f94 [0,4194304] 0 2024-09-13T21:40:26.190 INFO:tasks.workunit.client.0.smithi088.stdout:0/634: mkdir d7/d1d/d21/d82/db8/de5 0 2024-09-13T21:40:26.191 INFO:tasks.workunit.client.0.smithi088.stdout:6/656: rmdir d0/d1e/d1f/d55/d96/d98 39 2024-09-13T21:40:26.191 INFO:tasks.workunit.client.0.smithi088.stdout:6/657: write d0/d2c/d7a/f9f [1238059,124856] 0 2024-09-13T21:40:26.191 INFO:tasks.workunit.client.0.smithi088.stdout:4/586: dread d2/d5/d20/d60/de/d1e/d23/f3d [0,4194304] 0 2024-09-13T21:40:26.194 INFO:tasks.workunit.client.0.smithi088.stdout:3/663: mknod d5/d23/d2a/d6b/d98/da1/daa/d43/cce 0 2024-09-13T21:40:26.194 INFO:tasks.workunit.client.0.smithi088.stdout:6/658: dread d0/d1e/d1f/f4e [0,4194304] 0 2024-09-13T21:40:26.194 INFO:tasks.workunit.client.0.smithi088.stdout:3/664: stat d5/d23/d2a/d63/d48/d49/l9b 0 2024-09-13T21:40:26.194 INFO:tasks.workunit.client.0.smithi088.stdout:6/659: stat d0/d28/f78 0 2024-09-13T21:40:26.194 INFO:tasks.workunit.client.0.smithi088.stdout:6/660: read d0/db/f10 [1465960,20195] 0 2024-09-13T21:40:26.194 INFO:tasks.workunit.client.0.smithi088.stdout:8/610: symlink db/df/d61/ld6 0 2024-09-13T21:40:26.196 INFO:tasks.workunit.client.0.smithi088.stdout:4/587: symlink d2/d81/lc7 0 2024-09-13T21:40:26.196 INFO:tasks.workunit.client.0.smithi088.stdout:4/588: write d2/d5/d20/d41/d4b/f54 [4088328,83224] 0 2024-09-13T21:40:26.197 INFO:tasks.workunit.client.0.smithi088.stdout:4/589: read d2/d5/d20/d60/de/d1e/d23/fc3 [4364427,111943] 0 2024-09-13T21:40:26.197 INFO:tasks.workunit.client.0.smithi088.stdout:4/590: read - d2/d5/d20/d60/de/d1e/d31/f8b zero size 2024-09-13T21:40:26.197 INFO:tasks.workunit.client.0.smithi088.stdout:4/591: fsync d2/d5/d20/d60/de/f28 0 2024-09-13T21:40:26.197 INFO:tasks.workunit.client.0.smithi088.stdout:4/592: dread - d2/d5/d20/d41/d4b/d98/fb2 zero size 2024-09-13T21:40:26.204 INFO:tasks.workunit.client.0.smithi088.stdout:0/635: dread d7/d65/f22 [0,4194304] 0 2024-09-13T21:40:26.205 INFO:tasks.workunit.client.0.smithi088.stdout:5/711: dread d4/fc [0,4194304] 0 2024-09-13T21:40:26.206 INFO:tasks.workunit.client.0.smithi088.stdout:5/712: creat d4/d1c/d4a/fe4 x:0 0 0 2024-09-13T21:40:26.207 INFO:tasks.workunit.client.0.smithi088.stdout:5/713: creat d4/d1c/d4a/d63/fe5 x:0 0 0 2024-09-13T21:40:26.207 INFO:tasks.workunit.client.0.smithi088.stdout:5/714: chown d4/d1b/ld5 38169 1 2024-09-13T21:40:26.207 INFO:tasks.workunit.client.0.smithi088.stdout:5/715: stat d4/d1c/d4a/d63/d6a/d6d/l87 0 2024-09-13T21:40:26.209 INFO:tasks.workunit.client.0.smithi088.stdout:5/716: rmdir d4/d1c/d24/d95/d9e 39 2024-09-13T21:40:26.209 INFO:tasks.workunit.client.0.smithi088.stdout:5/717: creat d4/d1b/fe6 x:0 0 0 2024-09-13T21:40:26.214 INFO:tasks.workunit.client.0.smithi088.stdout:4/593: write d2/d5/d20/d60/de/d1e/d31/f7d [2946048,125866] 0 2024-09-13T21:40:26.218 INFO:tasks.workunit.client.0.smithi088.stdout:4/594: link d2/d5/d20/d60/de/f76 d2/d5/d2d/d70/fc8 0 2024-09-13T21:40:26.218 INFO:tasks.workunit.client.0.smithi088.stdout:4/595: truncate d2/d13/f86 830078 0 2024-09-13T21:40:26.218 INFO:tasks.workunit.client.0.smithi088.stdout:4/596: chown d2/d5/d20/d60/de/d1e/d23/d6f 2124893791 1 2024-09-13T21:40:26.218 INFO:tasks.workunit.client.0.smithi088.stdout:0/636: dread d7/f7b [0,4194304] 0 2024-09-13T21:40:26.219 INFO:tasks.workunit.client.0.smithi088.stdout:4/597: rmdir d2/d5/d20/d60/de/d1e/d23/d6c 39 2024-09-13T21:40:26.221 INFO:tasks.workunit.client.0.smithi088.stdout:0/637: creat d7/d2c/d30/d31/d42/d95/fe6 x:0 0 0 2024-09-13T21:40:26.222 INFO:tasks.workunit.client.0.smithi088.stdout:4/598: creat d2/d5/d20/d60/de/d1e/d23/d3c/d65/fc9 x:0 0 0 2024-09-13T21:40:26.222 INFO:tasks.workunit.client.0.smithi088.stdout:4/599: chown d2/d5/d20/d60/de/d1e/d23/f3d 6 1 2024-09-13T21:40:26.223 INFO:tasks.workunit.client.0.smithi088.stdout:1/613: dwrite d9/d10/d2a/d4b/d33/f76 [0,4194304] 0 2024-09-13T21:40:26.224 INFO:tasks.workunit.client.0.smithi088.stdout:2/648: dwrite d1/d8/d16/f5c [0,4194304] 0 2024-09-13T21:40:26.224 INFO:tasks.workunit.client.0.smithi088.stdout:2/649: chown d1/d13/d3f/c5f 264262425 1 2024-09-13T21:40:26.224 INFO:tasks.workunit.client.0.smithi088.stdout:6/661: dwrite d0/db/f10 [4194304,4194304] 0 2024-09-13T21:40:26.225 INFO:tasks.workunit.client.0.smithi088.stdout:9/540: dwrite d1a/f80 [0,4194304] 0 2024-09-13T21:40:26.225 INFO:tasks.workunit.client.0.smithi088.stdout:9/541: chown d1a/c32 54 1 2024-09-13T21:40:26.226 INFO:tasks.workunit.client.0.smithi088.stdout:2/650: mknod d1/d8/d24/d78/d7f/d85/cdd 0 2024-09-13T21:40:26.230 INFO:tasks.workunit.client.0.smithi088.stdout:5/718: dwrite d4/d1c/d4a/d63/d6a/d6d/fdd [0,4194304] 0 2024-09-13T21:40:26.231 INFO:tasks.workunit.client.0.smithi088.stdout:9/542: link d1a/d3c/d51/f52 d1a/d61/d3d/d41/d48/d86/fa3 0 2024-09-13T21:40:26.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/651: creat d1/d13/d2a/d3c/d4a/fde x:0 0 0 2024-09-13T21:40:26.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/652: readlink d1/d8/d2e/d44/la7 0 2024-09-13T21:40:26.233 INFO:tasks.workunit.client.0.smithi088.stdout:2/653: write d1/d8/f12 [9152911,112799] 0 2024-09-13T21:40:26.237 INFO:tasks.workunit.client.0.smithi088.stdout:5/719: mknod d4/d1c/d24/d26/d40/ce7 0 2024-09-13T21:40:26.237 INFO:tasks.workunit.client.0.smithi088.stdout:5/720: chown d4/d1c/d24/d95/da6/lbc 5881 1 2024-09-13T21:40:26.237 INFO:tasks.workunit.client.0.smithi088.stdout:5/721: readlink d4/d1c/l51 0 2024-09-13T21:40:26.239 INFO:tasks.workunit.client.0.smithi088.stdout:9/543: link d1a/c8b d1a/d9e/ca4 0 2024-09-13T21:40:26.239 INFO:tasks.workunit.client.0.smithi088.stdout:9/544: chown d1a/d61/d3d/d41/c4c 380289 1 2024-09-13T21:40:26.242 INFO:tasks.workunit.client.0.smithi088.stdout:2/654: rename d1/d13/d2a/d3c/d4a/d6e/d5b/c70 to d1/d8/d16/d40/d7e/daa/cdf 0 2024-09-13T21:40:26.243 INFO:tasks.workunit.client.0.smithi088.stdout:5/722: chown d4/d1c/d76/f88 27551037 1 2024-09-13T21:40:26.243 INFO:tasks.workunit.client.0.smithi088.stdout:5/723: readlink d4/d1c/d24/d26/d40/l44 0 2024-09-13T21:40:26.243 INFO:tasks.workunit.client.0.smithi088.stdout:5/724: write d4/d1c/d4a/d8a/f9b [595611,104014] 0 2024-09-13T21:40:26.244 INFO:tasks.workunit.client.0.smithi088.stdout:9/545: rmdir d1a 39 2024-09-13T21:40:26.246 INFO:tasks.workunit.client.0.smithi088.stdout:5/725: rename d4/d1c/d24/d95/d9e to d4/d1c/d24/d26/dbf/de8 0 2024-09-13T21:40:26.247 INFO:tasks.workunit.client.0.smithi088.stdout:9/546: mknod d1a/d3c/d51/ca5 0 2024-09-13T21:40:26.250 INFO:tasks.workunit.client.0.smithi088.stdout:0/638: dwrite d7/d65/d8c/fdd [0,4194304] 0 2024-09-13T21:40:26.250 INFO:tasks.workunit.client.0.smithi088.stdout:0/639: truncate d7/d1d/d66/fab 4726599 0 2024-09-13T21:40:26.250 INFO:tasks.workunit.client.0.smithi088.stdout:9/547: unlink d1a/d61/d3d/d41/f46 0 2024-09-13T21:40:26.254 INFO:tasks.workunit.client.0.smithi088.stdout:0/640: unlink d7/d2c/d30/d31/d42/d4b/ca5 0 2024-09-13T21:40:26.255 INFO:tasks.workunit.client.0.smithi088.stdout:1/614: dwrite d9/dc/d52/dba/d7d/f80 [0,4194304] 0 2024-09-13T21:40:26.255 INFO:tasks.workunit.client.0.smithi088.stdout:6/662: dwrite d0/d2c/d32/d39/d3f/d71/fab [0,4194304] 0 2024-09-13T21:40:26.258 INFO:tasks.workunit.client.0.smithi088.stdout:2/655: rmdir d1/d8/d24 39 2024-09-13T21:40:26.263 INFO:tasks.workunit.client.0.smithi088.stdout:6/663: creat d0/d2c/d7a/daf/dc7/fd1 x:0 0 0 2024-09-13T21:40:26.265 INFO:tasks.workunit.client.0.smithi088.stdout:2/656: rmdir d1/d13/d3f/d99/d9c/db1/dcd 39 2024-09-13T21:40:26.265 INFO:tasks.workunit.client.0.smithi088.stdout:1/615: dread d9/f14 [0,4194304] 0 2024-09-13T21:40:26.265 INFO:tasks.workunit.client.0.smithi088.stdout:1/616: stat d9/dc 0 2024-09-13T21:40:26.272 INFO:tasks.workunit.client.0.smithi088.stdout:6/664: dread d0/d1e/f24 [0,4194304] 0 2024-09-13T21:40:26.272 INFO:tasks.workunit.client.0.smithi088.stdout:6/665: mkdir d0/d2c/d32/d39/d3f/d71/dd2 0 2024-09-13T21:40:26.273 INFO:tasks.workunit.client.0.smithi088.stdout:5/726: dwrite d4/d1c/d24/d26/f6c [0,4194304] 0 2024-09-13T21:40:26.274 INFO:tasks.workunit.client.0.smithi088.stdout:1/617: read d9/d10/d2a/d4b/f28 [269260,14767] 0 2024-09-13T21:40:26.274 INFO:tasks.workunit.client.0.smithi088.stdout:1/618: getdents d9/d10/d2a/d47/d9c/db5 0 2024-09-13T21:40:26.276 INFO:tasks.workunit.client.0.smithi088.stdout:6/666: dread d0/d2c/d32/d39/d3f/d71/fab [0,4194304] 0 2024-09-13T21:40:26.276 INFO:tasks.workunit.client.0.smithi088.stdout:9/548: dwrite d1a/d1b/f53 [0,4194304] 0 2024-09-13T21:40:26.276 INFO:tasks.workunit.client.0.smithi088.stdout:0/641: dwrite d7/d2c/d30/d31/f6e [0,4194304] 0 2024-09-13T21:40:26.277 INFO:tasks.workunit.client.0.smithi088.stdout:5/727: symlink d4/d1c/d24/d26/da1/le9 0 2024-09-13T21:40:26.277 INFO:tasks.workunit.client.0.smithi088.stdout:5/728: readlink d4/d1b/d68/lda 0 2024-09-13T21:40:26.278 INFO:tasks.workunit.client.0.smithi088.stdout:1/619: symlink d9/d10/d2a/d4b/d3a/dcd/ld0 0 2024-09-13T21:40:26.282 INFO:tasks.workunit.client.0.smithi088.stdout:6/667: truncate d0/d2c/d32/d39/d3f/d71/fa9 89500 0 2024-09-13T21:40:26.286 INFO:tasks.workunit.client.0.smithi088.stdout:0/642: rename d7/d65/c25 to d7/d2c/d30/dbe/dce/de1/ce7 0 2024-09-13T21:40:26.294 INFO:tasks.workunit.client.0.smithi088.stdout:5/729: truncate d4/d1c/d4a/d63/f74 2673531 0 2024-09-13T21:40:26.294 INFO:tasks.workunit.client.0.smithi088.stdout:5/730: chown d4/d1c/d24/d26/laa 16185 1 2024-09-13T21:40:26.294 INFO:tasks.workunit.client.0.smithi088.stdout:5/731: stat d4/d1b/f85 0 2024-09-13T21:40:26.294 INFO:tasks.workunit.client.0.smithi088.stdout:5/732: read d4/d1c/d24/f39 [482811,102679] 0 2024-09-13T21:40:26.295 INFO:tasks.workunit.client.0.smithi088.stdout:9/549: dwrite f18 [4194304,4194304] 0 2024-09-13T21:40:26.295 INFO:tasks.workunit.client.0.smithi088.stdout:6/668: write d0/d1e/d1f/fa2 [827725,101645] 0 2024-09-13T21:40:26.295 INFO:tasks.workunit.client.0.smithi088.stdout:6/669: write d0/d1e/fd0 [277385,35051] 0 2024-09-13T21:40:26.295 INFO:tasks.workunit.client.0.smithi088.stdout:6/670: dread - d0/db/f85 zero size 2024-09-13T21:40:26.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/620: mknod d9/d10/d2a/d47/d9c/cd1 0 2024-09-13T21:40:26.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/621: readlink d9/d10/d2a/d47/l73 0 2024-09-13T21:40:26.296 INFO:tasks.workunit.client.0.smithi088.stdout:1/622: chown d9/fd 481580 1 2024-09-13T21:40:26.301 INFO:tasks.workunit.client.0.smithi088.stdout:0/643: unlink d7/d2c/d30/d31/f62 0 2024-09-13T21:40:26.303 INFO:tasks.workunit.client.0.smithi088.stdout:9/550: dread d1a/d1b/f53 [0,4194304] 0 2024-09-13T21:40:26.303 INFO:tasks.workunit.client.0.smithi088.stdout:9/551: fdatasync d1a/d61/d3d/d41/d48/d86/fa1 0 2024-09-13T21:40:26.304 INFO:tasks.workunit.client.0.smithi088.stdout:1/623: rmdir d9/d10/d2a/d4b/d33/d92 39 2024-09-13T21:40:26.305 INFO:tasks.workunit.client.0.smithi088.stdout:6/671: dread d0/d28/f35 [0,4194304] 0 2024-09-13T21:40:26.305 INFO:tasks.workunit.client.0.smithi088.stdout:5/733: symlink d4/d1c/d4a/d63/d6a/lea 0 2024-09-13T21:40:26.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/672: dread d0/d2c/d32/f84 [0,4194304] 0 2024-09-13T21:40:26.307 INFO:tasks.workunit.client.0.smithi088.stdout:6/673: write d0/db/f60 [1088962,83037] 0 2024-09-13T21:40:26.309 INFO:tasks.workunit.client.0.smithi088.stdout:5/734: creat d4/d1c/d24/d26/dbf/d89/d92/feb x:0 0 0 2024-09-13T21:40:26.311 INFO:tasks.workunit.client.0.smithi088.stdout:0/644: dread d7/d1d/d21/d82/f87 [0,4194304] 0 2024-09-13T21:40:26.312 INFO:tasks.workunit.client.0.smithi088.stdout:6/674: truncate d0/d1e/f4c 734709 0 2024-09-13T21:40:26.314 INFO:tasks.workunit.client.0.smithi088.stdout:0/645: dread d7/d2c/d30/d31/d42/fa8 [0,4194304] 0 2024-09-13T21:40:26.315 INFO:tasks.workunit.client.0.smithi088.stdout:5/735: symlink d4/lec 0 2024-09-13T21:40:26.316 INFO:tasks.workunit.client.0.smithi088.stdout:6/675: link d0/db/f12 d0/db/d37/fd3 0 2024-09-13T21:40:26.319 INFO:tasks.workunit.client.0.smithi088.stdout:7/526: sync 2024-09-13T21:40:26.319 INFO:tasks.workunit.client.0.smithi088.stdout:7/527: chown d6/da/d1a/l1d 644269268 1 2024-09-13T21:40:26.319 INFO:tasks.workunit.client.0.smithi088.stdout:7/528: write d6/fa6 [381218,121561] 0 2024-09-13T21:40:26.320 INFO:tasks.workunit.client.0.smithi088.stdout:7/529: write d6/fa6 [1054759,46725] 0 2024-09-13T21:40:26.388 INFO:tasks.workunit.client.0.smithi088.stdout:5/736: truncate d4/d1c/d24/d26/dbf/d89/d92/f93 3700039 0 2024-09-13T21:40:26.388 INFO:tasks.workunit.client.0.smithi088.stdout:5/737: stat d4/d1c/d4a/d63/d6a/d6d/ca5 0 2024-09-13T21:40:26.388 INFO:tasks.workunit.client.0.smithi088.stdout:5/738: write d4/d1c/d24/d26/d40/f49 [306270,79612] 0 2024-09-13T21:40:26.389 INFO:tasks.workunit.client.0.smithi088.stdout:6/676: link d0/d2c/d83/c8c d0/d2c/dad/db8/cd4 0 2024-09-13T21:40:26.389 INFO:tasks.workunit.client.0.smithi088.stdout:6/677: write d0/d2c/fb5 [595532,81918] 0 2024-09-13T21:40:26.390 INFO:tasks.workunit.client.0.smithi088.stdout:7/530: creat d6/d5f/d69/d4f/fae x:0 0 0 2024-09-13T21:40:26.390 INFO:tasks.workunit.client.0.smithi088.stdout:7/531: write d6/da/f38 [4408836,58194] 0 2024-09-13T21:40:26.390 INFO:tasks.workunit.client.0.smithi088.stdout:9/552: dwrite d1a/d1b/f37 [0,4194304] 0 2024-09-13T21:40:26.392 INFO:tasks.workunit.client.0.smithi088.stdout:5/739: mknod d4/d1c/d4a/d63/d6a/d6d/ced 0 2024-09-13T21:40:26.395 INFO:tasks.workunit.client.0.smithi088.stdout:6/678: unlink d0/db/f10 0 2024-09-13T21:40:26.403 INFO:tasks.workunit.client.0.smithi088.stdout:9/553: mknod d1a/d3c/d51/ca6 0 2024-09-13T21:40:26.404 INFO:tasks.workunit.client.0.smithi088.stdout:5/740: truncate d4/d1c/d24/d26/f6c 3261558 0 2024-09-13T21:40:26.407 INFO:tasks.workunit.client.0.smithi088.stdout:0/646: dwrite d7/d1d/d21/f4c [0,4194304] 0 2024-09-13T21:40:26.412 INFO:tasks.workunit.client.0.smithi088.stdout:0/647: mkdir d7/d2c/d37/de8 0 2024-09-13T21:40:26.412 INFO:tasks.workunit.client.0.smithi088.stdout:0/648: write d7/d1d/d27/d43/fc6 [745328,5939] 0 2024-09-13T21:40:26.412 INFO:tasks.workunit.client.0.smithi088.stdout:0/649: truncate d7/d2c/d30/d31/d42/d95/fc4 1716498 0 2024-09-13T21:40:26.412 INFO:tasks.workunit.client.0.smithi088.stdout:0/650: write d7/d2c/d30/d31/fb6 [649014,116129] 0 2024-09-13T21:40:26.429 INFO:tasks.workunit.client.0.smithi088.stdout:7/532: dwrite d6/d5f/d69/f9a [0,4194304] 0 2024-09-13T21:40:26.430 INFO:tasks.workunit.client.0.smithi088.stdout:7/533: creat d6/da/d44/faf x:0 0 0 2024-09-13T21:40:26.430 INFO:tasks.workunit.client.0.smithi088.stdout:6/679: dwrite d0/f52 [4194304,4194304] 0 2024-09-13T21:40:26.432 INFO:tasks.workunit.client.0.smithi088.stdout:3/665: sync 2024-09-13T21:40:26.432 INFO:tasks.workunit.client.0.smithi088.stdout:9/554: dwrite d1a/f82 [0,4194304] 0 2024-09-13T21:40:26.434 INFO:tasks.workunit.client.0.smithi088.stdout:7/534: rename d6/da/d1a/l3b to d6/d5f/d69/d4f/d4c/lb0 0 2024-09-13T21:40:26.435 INFO:tasks.workunit.client.0.smithi088.stdout:6/680: mknod d0/d2c/d7a/cd5 0 2024-09-13T21:40:26.436 INFO:tasks.workunit.client.0.smithi088.stdout:3/666: dread d5/d23/d2a/d6b/d98/da1/daa/f6e [0,4194304] 0 2024-09-13T21:40:26.440 INFO:tasks.workunit.client.0.smithi088.stdout:5/741: dwrite d4/d1c/d76/fa8 [0,4194304] 0 2024-09-13T21:40:26.440 INFO:tasks.workunit.client.0.smithi088.stdout:5/742: stat d4/d1c/d24/d26/d56/l84 0 2024-09-13T21:40:26.441 INFO:tasks.workunit.client.0.smithi088.stdout:0/651: dwrite d7/f2b [0,4194304] 0 2024-09-13T21:40:26.444 INFO:tasks.workunit.client.0.smithi088.stdout:7/535: rename d6/da/d1a/c20 to d6/da/d1a/d3a/cb1 0 2024-09-13T21:40:26.445 INFO:tasks.workunit.client.0.smithi088.stdout:7/536: read d6/fa6 [967775,128835] 0 2024-09-13T21:40:26.445 INFO:tasks.workunit.client.0.smithi088.stdout:6/681: symlink d0/db/d37/ld6 0 2024-09-13T21:40:26.446 INFO:tasks.workunit.client.0.smithi088.stdout:6/682: creat d0/d2c/fd7 x:0 0 0 2024-09-13T21:40:26.446 INFO:tasks.workunit.client.0.smithi088.stdout:6/683: chown d0/l19 2429 1 2024-09-13T21:40:26.447 INFO:tasks.workunit.client.0.smithi088.stdout:3/667: mkdir d5/d5a/dcf 0 2024-09-13T21:40:26.447 INFO:tasks.workunit.client.0.smithi088.stdout:3/668: readlink d5/d23/d2a/d3f/d8f/da3/lb5 0 2024-09-13T21:40:26.448 INFO:tasks.workunit.client.0.smithi088.stdout:9/555: read d1a/d61/d3d/f7d [71143,123065] 0 2024-09-13T21:40:26.448 INFO:tasks.workunit.client.0.smithi088.stdout:9/556: dread - d1a/d61/d3d/d41/f77 zero size 2024-09-13T21:40:26.455 INFO:tasks.workunit.client.0.smithi088.stdout:7/537: write d6/d5f/f72 [2600057,88738] 0 2024-09-13T21:40:26.455 INFO:tasks.workunit.client.0.smithi088.stdout:7/538: truncate d6/da/d1a/f33 4959217 0 2024-09-13T21:40:26.457 INFO:tasks.workunit.client.0.smithi088.stdout:8/611: sync 2024-09-13T21:40:26.457 INFO:tasks.workunit.client.0.smithi088.stdout:7/539: read d6/f1c [258510,98264] 0 2024-09-13T21:40:26.457 INFO:tasks.workunit.client.0.smithi088.stdout:7/540: write d6/d5f/d69/f6e [277546,122459] 0 2024-09-13T21:40:26.457 INFO:tasks.workunit.client.0.smithi088.stdout:7/541: chown d6/d5f/l7c 314 1 2024-09-13T21:40:26.457 INFO:tasks.workunit.client.0.smithi088.stdout:3/669: rename d5/d23/d2a/d3f/d8f/da8 to d5/d23/d2a/d3f/dd0 0 2024-09-13T21:40:26.457 INFO:tasks.workunit.client.0.smithi088.stdout:3/670: chown d5/d23/d2a/fbd 60009822 1 2024-09-13T21:40:26.457 INFO:tasks.workunit.client.0.smithi088.stdout:3/671: creat d5/d23/d2a/d63/fd1 x:0 0 0 2024-09-13T21:40:26.459 INFO:tasks.workunit.client.0.smithi088.stdout:8/612: unlink db/d26/f50 0 2024-09-13T21:40:26.459 INFO:tasks.workunit.client.0.smithi088.stdout:8/613: creat db/df/da7/d88/fd7 x:0 0 0 2024-09-13T21:40:26.459 INFO:tasks.workunit.client.0.smithi088.stdout:8/614: dread - db/d26/d2c/d85/f83 zero size 2024-09-13T21:40:26.459 INFO:tasks.workunit.client.0.smithi088.stdout:6/684: dread d0/d2c/d32/d39/d3f/f79 [0,4194304] 0 2024-09-13T21:40:26.460 INFO:tasks.workunit.client.0.smithi088.stdout:7/542: mkdir d6/d5f/d69/d4f/d6f/db2 0 2024-09-13T21:40:26.464 INFO:tasks.workunit.client.0.smithi088.stdout:9/557: symlink d1a/d3c/d51/d5e/la7 0 2024-09-13T21:40:26.465 INFO:tasks.workunit.client.0.smithi088.stdout:5/743: dwrite d4/d1c/d24/d26/da1/fb0 [0,4194304] 0 2024-09-13T21:40:26.468 INFO:tasks.workunit.client.0.smithi088.stdout:9/558: link d1a/l95 d1a/d61/d3d/d41/d48/la8 0 2024-09-13T21:40:26.470 INFO:tasks.workunit.client.0.smithi088.stdout:7/543: getdents d6/d5f 0 2024-09-13T21:40:26.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/544: mknod d6/d5f/cb3 0 2024-09-13T21:40:26.474 INFO:tasks.workunit.client.0.smithi088.stdout:7/545: write d6/d4e/f7b [357601,13106] 0 2024-09-13T21:40:26.476 INFO:tasks.workunit.client.0.smithi088.stdout:0/652: dwrite d7/d2c/d78/f7a [0,4194304] 0 2024-09-13T21:40:26.476 INFO:tasks.workunit.client.0.smithi088.stdout:7/546: creat d6/d5f/da9/fb4 x:0 0 0 2024-09-13T21:40:26.476 INFO:tasks.workunit.client.0.smithi088.stdout:7/547: chown d6/da/d1a/f24 6683435 1 2024-09-13T21:40:26.477 INFO:tasks.workunit.client.0.smithi088.stdout:4/600: sync 2024-09-13T21:40:26.477 INFO:tasks.workunit.client.0.smithi088.stdout:1/624: sync 2024-09-13T21:40:26.477 INFO:tasks.workunit.client.0.smithi088.stdout:2/657: sync 2024-09-13T21:40:26.477 INFO:tasks.workunit.client.0.smithi088.stdout:1/625: write d9/d10/d2a/d4b/d33/f91 [698204,93204] 0 2024-09-13T21:40:26.478 INFO:tasks.workunit.client.0.smithi088.stdout:9/559: dread d1a/f80 [0,4194304] 0 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:4/601: mkdir d2/d5/d20/d60/de/d1e/d23/dca 0 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:4/602: truncate d2/d5/d20/d60/de/f8c 477249 0 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:4/603: getdents d2/d5/d20/d60/de/d1e/d23/d6c 0 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:4/604: write d2/d81/fc0 [5115431,69857] 0 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:4/605: truncate d2/d5/d20/d41/f8e 604357 0 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:4/606: readlink d2/d13/l5d 0 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:4/607: chown d2/d5/d20/d60/de/d1e/l9e 637624970 1 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:6/685: dread d0/d1e/d1f/f70 [0,4194304] 0 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:6/686: getdents d0/d2c/d32/d39/d3f/d71/dd2 0 2024-09-13T21:40:26.481 INFO:tasks.workunit.client.0.smithi088.stdout:2/658: creat d1/d8/d24/d78/fe0 x:0 0 0 2024-09-13T21:40:26.482 INFO:tasks.workunit.client.0.smithi088.stdout:2/659: read d1/d8/d24/d78/d7f/d85/f97 [451127,50281] 0 2024-09-13T21:40:26.482 INFO:tasks.workunit.client.0.smithi088.stdout:2/660: readlink d1/d8/d24/d78/l93 0 2024-09-13T21:40:26.482 INFO:tasks.workunit.client.0.smithi088.stdout:2/661: dread - d1/d13/d2a/d3c/d4a/d6e/d5b/d89/dcc/fdb zero size 2024-09-13T21:40:26.483 INFO:tasks.workunit.client.0.smithi088.stdout:1/626: creat d9/fd2 x:0 0 0 2024-09-13T21:40:26.484 INFO:tasks.workunit.client.0.smithi088.stdout:0/653: rmdir d7/d2c 39 2024-09-13T21:40:26.484 INFO:tasks.workunit.client.0.smithi088.stdout:0/654: write d7/f46 [1719239,1247] 0 2024-09-13T21:40:26.485 INFO:tasks.workunit.client.0.smithi088.stdout:0/655: read d7/d1d/d26/d45/d7c/f94 [402784,53326] 0 2024-09-13T21:40:26.486 INFO:tasks.workunit.client.0.smithi088.stdout:7/548: mkdir d6/d5f/d7a/db5 0 2024-09-13T21:40:26.486 INFO:tasks.workunit.client.0.smithi088.stdout:7/549: fdatasync d6/da/d44/fa0 0 2024-09-13T21:40:26.486 INFO:tasks.workunit.client.0.smithi088.stdout:6/687: mknod d0/d2c/d7a/daf/cd8 0 2024-09-13T21:40:26.489 INFO:tasks.workunit.client.0.smithi088.stdout:1/627: creat d9/d4f/d64/fd3 x:0 0 0 2024-09-13T21:40:26.489 INFO:tasks.workunit.client.0.smithi088.stdout:3/672: dwrite d5/f50 [0,4194304] 0 2024-09-13T21:40:26.489 INFO:tasks.workunit.client.0.smithi088.stdout:3/673: readlink d5/l45 0 2024-09-13T21:40:26.490 INFO:tasks.workunit.client.0.smithi088.stdout:5/744: dwrite d4/d1c/d4a/d8a/f8b [0,4194304] 0 2024-09-13T21:40:26.493 INFO:tasks.workunit.client.0.smithi088.stdout:7/550: chown d6/d5f/d69/d4f/f48 1 1 2024-09-13T21:40:26.493 INFO:tasks.workunit.client.0.smithi088.stdout:6/688: creat d0/d2c/d32/d39/d3f/d71/d81/fd9 x:0 0 0 2024-09-13T21:40:26.493 INFO:tasks.workunit.client.0.smithi088.stdout:6/689: getdents d0/d2c/d7a/d7c 0 2024-09-13T21:40:26.494 INFO:tasks.workunit.client.0.smithi088.stdout:9/560: dwrite f10 [0,4194304] 0 2024-09-13T21:40:26.495 INFO:tasks.workunit.client.0.smithi088.stdout:2/662: getdents d1/d13/d2a/d3c/d4a/d6e/d5b 0 2024-09-13T21:40:26.496 INFO:tasks.workunit.client.0.smithi088.stdout:2/663: fsync d1/d8/f7d 0 2024-09-13T21:40:26.496 INFO:tasks.workunit.client.0.smithi088.stdout:2/664: truncate d1/d8/d2e/d91/fae 475915 0 2024-09-13T21:40:26.498 INFO:tasks.workunit.client.0.smithi088.stdout:1/628: mkdir d9/dc/d52/dba/dd4 0 2024-09-13T21:40:26.498 INFO:tasks.workunit.client.0.smithi088.stdout:1/629: readlink d9/d10/d2a/l3e 0 2024-09-13T21:40:26.502 INFO:tasks.workunit.client.0.smithi088.stdout:3/674: symlink d5/d23/d2a/d63/d48/ld2 0 2024-09-13T21:40:26.502 INFO:tasks.workunit.client.0.smithi088.stdout:3/675: stat d5/d5a/dcf 0 2024-09-13T21:40:26.502 INFO:tasks.workunit.client.0.smithi088.stdout:4/608: dread d2/d5/d20/d60/de/f58 [0,4194304] 0 2024-09-13T21:40:26.509 INFO:tasks.workunit.client.0.smithi088.stdout:0/656: dwrite d7/d2c/fbd [0,4194304] 0 2024-09-13T21:40:26.509 INFO:tasks.workunit.client.0.smithi088.stdout:5/745: unlink d4/d1c/d24/d26/dbf/d89/da3/fb3 0 2024-09-13T21:40:26.510 INFO:tasks.workunit.client.0.smithi088.stdout:7/551: mknod d6/d5f/d69/d4f/cb6 0 2024-09-13T21:40:26.510 INFO:tasks.workunit.client.0.smithi088.stdout:7/552: write d6/da/d1a/d3a/d5c/d60/f66 [1480662,119972] 0 2024-09-13T21:40:26.511 INFO:tasks.workunit.client.0.smithi088.stdout:6/690: getdents d0/d2c/dad 0 2024-09-13T21:40:26.516 INFO:tasks.workunit.client.0.smithi088.stdout:5/746: dread d4/db8/fd6 [0,4194304] 0 2024-09-13T21:40:26.516 INFO:tasks.workunit.client.0.smithi088.stdout:5/747: fdatasync d4/d1c/d24/d95/f97 0 2024-09-13T21:40:26.518 INFO:tasks.workunit.client.0.smithi088.stdout:1/630: mkdir d9/d4f/dd5 0 2024-09-13T21:40:26.518 INFO:tasks.workunit.client.0.smithi088.stdout:1/631: write d9/d4f/fbc [960084,29509] 0 2024-09-13T21:40:26.519 INFO:tasks.workunit.client.0.smithi088.stdout:3/676: mknod d5/d23/d2a/d63/cd3 0 2024-09-13T21:40:26.519 INFO:tasks.workunit.client.0.smithi088.stdout:3/677: read d5/d14/f37 [231052,63115] 0 2024-09-13T21:40:26.520 INFO:tasks.workunit.client.0.smithi088.stdout:4/609: rmdir d2/d5/d20/d60/de/d1e/d23/d69 39 2024-09-13T21:40:26.524 INFO:tasks.workunit.client.0.smithi088.stdout:0/657: mknod d7/d2c/d30/d31/d42/d95/ce9 0 2024-09-13T21:40:26.524 INFO:tasks.workunit.client.0.smithi088.stdout:0/658: dread - d7/d2c/d37/f6a zero size 2024-09-13T21:40:26.525 INFO:tasks.workunit.client.0.smithi088.stdout:7/553: rmdir d6/d5f/d69/d45 39 2024-09-13T21:40:26.525 INFO:tasks.workunit.client.0.smithi088.stdout:7/554: getdents d6/d5f/d7a/db5 0 2024-09-13T21:40:26.526 INFO:tasks.workunit.client.0.smithi088.stdout:9/561: symlink d1a/d3c/d51/d5e/d7e/la9 0 2024-09-13T21:40:26.526 INFO:tasks.workunit.client.0.smithi088.stdout:4/610: dread d2/d5/d20/d7f/f8f [0,4194304] 0 2024-09-13T21:40:26.528 INFO:tasks.workunit.client.0.smithi088.stdout:5/748: write d4/d1c/d24/d26/d40/f11 [1796565,279] 0 2024-09-13T21:40:26.528 INFO:tasks.workunit.client.0.smithi088.stdout:5/749: readlink d4/d1b/ld5 0 2024-09-13T21:40:26.529 INFO:tasks.workunit.client.0.smithi088.stdout:6/691: dwrite d0/d2c/d32/d39/d3f/d71/f97 [0,4194304] 0 2024-09-13T21:40:26.530 INFO:tasks.workunit.client.0.smithi088.stdout:2/665: rmdir d1/d8 39 2024-09-13T21:40:26.530 INFO:tasks.workunit.client.0.smithi088.stdout:2/666: truncate d1/d8/d24/d78/fe0 27442 0 2024-09-13T21:40:26.530 INFO:tasks.workunit.client.0.smithi088.stdout:2/667: creat d1/d13/d2a/d41/d48/da0/fe1 x:0 0 0 2024-09-13T21:40:26.532 INFO:tasks.workunit.client.0.smithi088.stdout:1/632: symlink d9/d10/d2a/d4b/ld6 0 2024-09-13T21:40:26.534 INFO:tasks.workunit.client.0.smithi088.stdout:3/678: creat d5/fd4 x:0 0 0 2024-09-13T21:40:26.534 INFO:tasks.workunit.client.0.smithi088.stdout:3/679: fdatasync d5/d5a/db8/fc4 0 2024-09-13T21:40:26.535 INFO:tasks.workunit.client.0.smithi088.stdout:0/659: unlink d7/d1d/d26/d34/f4f 0 2024-09-13T21:40:26.536 INFO:tasks.workunit.client.0.smithi088.stdout:5/750: creat d4/da7/fee x:0 0 0 2024-09-13T21:40:26.544 INFO:tasks.workunit.client.0.smithi088.stdout:2/668: symlink d1/d13/d2a/d41/d48/le2 0 2024-09-13T21:40:26.545 INFO:tasks.workunit.client.0.smithi088.stdout:0/660: dread d7/d2c/d30/f35 [0,4194304] 0 2024-09-13T21:40:26.545 INFO:tasks.workunit.client.0.smithi088.stdout:1/633: truncate d9/dc/f42 1621764 0 2024-09-13T21:40:26.549 INFO:tasks.workunit.client.0.smithi088.stdout:1/634: symlink d9/dc/d52/ld7 0 2024-09-13T21:40:26.549 INFO:tasks.workunit.client.0.smithi088.stdout:3/680: rmdir d5/d23/d2a/d63/d31 39 2024-09-13T21:40:26.550 INFO:tasks.workunit.client.0.smithi088.stdout:6/692: dwrite d0/d2c/d7a/daf/dc7/fd1 [0,4194304] 0 2024-09-13T21:40:26.550 INFO:tasks.workunit.client.0.smithi088.stdout:5/751: getdents d4/d1c/d24/d26/dbf/d89 0 2024-09-13T21:40:26.552 INFO:tasks.workunit.client.0.smithi088.stdout:3/681: mknod d5/d23/d2a/d3f/db4/cd5 0 2024-09-13T21:40:26.554 INFO:tasks.workunit.client.0.smithi088.stdout:6/693: creat d0/db/fda x:0 0 0 2024-09-13T21:40:26.554 INFO:tasks.workunit.client.0.smithi088.stdout:4/611: dwrite d2/d5/d20/d41/d4b/f7a [0,4194304] 0 2024-09-13T21:40:26.555 INFO:tasks.workunit.client.0.smithi088.stdout:5/752: mknod d4/d1c/d24/d26/dbf/d89/cef 0 2024-09-13T21:40:26.557 INFO:tasks.workunit.client.0.smithi088.stdout:4/612: rename d2/d5/d20/d60/de/d1e/d23/d3c/fc6 to d2/d5/d20/d60/de/d1e/d23/d3c/d65/fcb 0 2024-09-13T21:40:26.557 INFO:tasks.workunit.client.0.smithi088.stdout:4/613: write d2/d5/d20/d60/de/d1e/d23/d3c/d65/fcb [360027,76360] 0 2024-09-13T21:40:26.559 INFO:tasks.workunit.client.0.smithi088.stdout:5/753: mkdir d4/d1c/d24/d26/d4b/d66/df0 0 2024-09-13T21:40:26.560 INFO:tasks.workunit.client.0.smithi088.stdout:4/614: rmdir d2/d5/d20/d60/de/d1e 39 2024-09-13T21:40:26.562 INFO:tasks.workunit.client.0.smithi088.stdout:5/754: unlink d4/d1c/d4a/fbe 0 2024-09-13T21:40:26.563 INFO:tasks.workunit.client.0.smithi088.stdout:4/615: creat d2/d13/d50/fcc x:0 0 0 2024-09-13T21:40:26.564 INFO:tasks.workunit.client.0.smithi088.stdout:4/616: fsync d2/d5/d20/d60/de/d1e/f37 0 2024-09-13T21:40:26.564 INFO:tasks.workunit.client.0.smithi088.stdout:4/617: write d2/d5/d20/d7f/f93 [502259,52318] 0 2024-09-13T21:40:26.564 INFO:tasks.workunit.client.0.smithi088.stdout:3/682: write d5/d23/d2a/d6b/d98/da1/daa/d43/f84 [2781369,129835] 0 2024-09-13T21:40:26.565 INFO:tasks.workunit.client.0.smithi088.stdout:4/618: mkdir d2/d5/d20/d41/d4b/d98/dcd 0 2024-09-13T21:40:26.567 INFO:tasks.workunit.client.0.smithi088.stdout:6/694: write d0/d2c/f9c [2579730,110283] 0 2024-09-13T21:40:26.567 INFO:tasks.workunit.client.0.smithi088.stdout:6/695: stat d0/d2c/d32/l88 0 2024-09-13T21:40:26.567 INFO:tasks.workunit.client.0.smithi088.stdout:8/615: sync 2024-09-13T21:40:26.568 INFO:tasks.workunit.client.0.smithi088.stdout:3/683: dread d5/d23/d2a/d63/f87 [0,4194304] 0 2024-09-13T21:40:26.569 INFO:tasks.workunit.client.0.smithi088.stdout:8/616: symlink db/d26/d2c/db7/ld8 0 2024-09-13T21:40:26.570 INFO:tasks.workunit.client.0.smithi088.stdout:6/696: dread d0/d1e/f24 [0,4194304] 0 2024-09-13T21:40:26.572 INFO:tasks.workunit.client.0.smithi088.stdout:3/684: mknod d5/d23/d2a/d3f/db4/cd6 0 2024-09-13T21:40:26.572 INFO:tasks.workunit.client.0.smithi088.stdout:3/685: fsync d5/d23/d2a/d63/d31/f7c 0 2024-09-13T21:40:26.573 INFO:tasks.workunit.client.0.smithi088.stdout:2/669: dwrite d1/d13/d2a/d3c/d4a/f7a [0,4194304] 0 2024-09-13T21:40:26.573 INFO:tasks.workunit.client.0.smithi088.stdout:2/670: chown d1/d13/d2a/d41/d48 405099104 1 2024-09-13T21:40:26.574 INFO:tasks.workunit.client.0.smithi088.stdout:1/635: dwrite d9/d10/d2a/d4b/d39/d43/db2/fce [4194304,4194304] 0 2024-09-13T21:40:26.574 INFO:tasks.workunit.client.0.smithi088.stdout:1/636: truncate d9/d10/d2a/fc5 739392 0 2024-09-13T21:40:26.576 INFO:tasks.workunit.client.0.smithi088.stdout:5/755: write d4/d1c/d24/d26/dbf/fae [849893,49728] 0 2024-09-13T21:40:26.576 INFO:tasks.workunit.client.0.smithi088.stdout:5/756: creat d4/da7/ff1 x:0 0 0 2024-09-13T21:40:26.577 INFO:tasks.workunit.client.0.smithi088.stdout:6/697: mkdir d0/d2c/d8b/ddb 0 2024-09-13T21:40:26.577 INFO:tasks.workunit.client.0.smithi088.stdout:0/661: write d7/d2c/d30/d31/d42/d4b/fba [1397427,123061] 0 2024-09-13T21:40:26.577 INFO:tasks.workunit.client.0.smithi088.stdout:0/662: readlink d7/d2c/d30/d31/l71 0 2024-09-13T21:40:26.577 INFO:tasks.workunit.client.0.smithi088.stdout:6/698: creat d0/d2c/fdc x:0 0 0 2024-09-13T21:40:26.578 INFO:tasks.workunit.client.0.smithi088.stdout:0/663: chown d7/f19 1416009 1 2024-09-13T21:40:26.578 INFO:tasks.workunit.client.0.smithi088.stdout:8/617: mkdir db/d26/d37/dd9 0 2024-09-13T21:40:26.578 INFO:tasks.workunit.client.0.smithi088.stdout:0/664: truncate d7/d2c/d37/f7d 1366380 0 2024-09-13T21:40:26.582 INFO:tasks.workunit.client.0.smithi088.stdout:2/671: write d1/d8/d2e/d3b/f8b [939847,39838] 0 2024-09-13T21:40:26.582 INFO:tasks.workunit.client.0.smithi088.stdout:2/672: chown d1/d13/d2a/d41/d82/ca5 12720611 1 2024-09-13T21:40:26.583 INFO:tasks.workunit.client.0.smithi088.stdout:0/665: dread d7/d1d/d26/d45/f56 [0,4194304] 0 2024-09-13T21:40:26.584 INFO:tasks.workunit.client.0.smithi088.stdout:1/637: link d9/d10/d2a/d47/d9c/lc2 d9/d10/d2a/d4b/d3a/ld8 0 2024-09-13T21:40:26.585 INFO:tasks.workunit.client.0.smithi088.stdout:1/638: creat d9/d10/d2a/d4b/d33/dad/dbb/fd9 x:0 0 0 2024-09-13T21:40:26.591 INFO:tasks.workunit.client.0.smithi088.stdout:5/757: link d4/d1c/d4a/d63/d6a/f6b d4/d1c/d4a/d8a/ff2 0 2024-09-13T21:40:26.594 INFO:tasks.workunit.client.0.smithi088.stdout:8/618: unlink db/df/da7/d88/fd5 0 2024-09-13T21:40:26.595 INFO:tasks.workunit.client.0.smithi088.stdout:2/673: creat d1/d13/d2a/d3c/d4a/d6e/d5b/fe3 x:0 0 0 2024-09-13T21:40:26.599 INFO:tasks.workunit.client.0.smithi088.stdout:1/639: mkdir d9/d10/d2a/d4b/d39/dda 0 2024-09-13T21:40:26.599 INFO:tasks.workunit.client.0.smithi088.stdout:1/640: write d9/d10/d2a/d47/d9c/fc6 [220856,33211] 0 2024-09-13T21:40:26.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/686: dwrite d5/f16 [0,4194304] 0 2024-09-13T21:40:26.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/687: stat d5/d14/l8a 0 2024-09-13T21:40:26.599 INFO:tasks.workunit.client.0.smithi088.stdout:3/688: creat d5/d5a/fd7 x:0 0 0 2024-09-13T21:40:26.601 INFO:tasks.workunit.client.0.smithi088.stdout:6/699: creat d0/d1e/d1f/d55/d8f/fdd x:0 0 0 2024-09-13T21:40:26.601 INFO:tasks.workunit.client.0.smithi088.stdout:6/700: fsync d0/d2c/f6b 0 2024-09-13T21:40:26.601 INFO:tasks.workunit.client.0.smithi088.stdout:6/701: read - d0/db/f85 zero size 2024-09-13T21:40:26.603 INFO:tasks.workunit.client.0.smithi088.stdout:8/619: unlink l7 0 2024-09-13T21:40:26.603 INFO:tasks.workunit.client.0.smithi088.stdout:8/620: fdatasync db/f8f 0 2024-09-13T21:40:26.603 INFO:tasks.workunit.client.0.smithi088.stdout:8/621: fsync db/d26/d4f/f7e 0 2024-09-13T21:40:26.603 INFO:tasks.workunit.client.0.smithi088.stdout:8/622: truncate db/d26/d2c/d85/f6f 970975 0 2024-09-13T21:40:26.604 INFO:tasks.workunit.client.0.smithi088.stdout:8/623: fsync db/df/d61/f7b 0 2024-09-13T21:40:26.604 INFO:tasks.workunit.client.0.smithi088.stdout:0/666: rmdir d7/d1d/d26/d45/d7c 39 2024-09-13T21:40:26.604 INFO:tasks.workunit.client.0.smithi088.stdout:0/667: read d7/f19 [3027497,13512] 0 2024-09-13T21:40:26.606 INFO:tasks.workunit.client.0.smithi088.stdout:1/641: rmdir d9/d10/d2a/d4b 39 2024-09-13T21:40:26.607 INFO:tasks.workunit.client.0.smithi088.stdout:3/689: write d5/d23/d2a/d3f/d76/db3/fa4 [962250,112874] 0 2024-09-13T21:40:26.614 INFO:tasks.workunit.client.0.smithi088.stdout:5/758: mkdir d4/d1c/d24/d26/dbf/d89/d92/df3 0 2024-09-13T21:40:26.615 INFO:tasks.workunit.client.0.smithi088.stdout:6/702: write d0/d1e/d1f/f51 [1374979,15549] 0 2024-09-13T21:40:26.616 INFO:tasks.workunit.client.0.smithi088.stdout:1/642: mknod d9/d10/d2a/d4b/d61/cdb 0 2024-09-13T21:40:26.617 INFO:tasks.workunit.client.0.smithi088.stdout:5/759: link d4/d1c/d24/d26/dbf/de8/la4 d4/d1c/d4a/d63/d6a/lf4 0 2024-09-13T21:40:26.617 INFO:tasks.workunit.client.0.smithi088.stdout:3/690: dread d5/d23/d2a/d3f/dd0/fcc [0,4194304] 0 2024-09-13T21:40:26.617 INFO:tasks.workunit.client.0.smithi088.stdout:6/703: readlink d0/d1e/d1f/l86 0 2024-09-13T21:40:26.618 INFO:tasks.workunit.client.0.smithi088.stdout:0/668: dwrite d7/d1d/d21/f80 [4194304,4194304] 0 2024-09-13T21:40:26.618 INFO:tasks.workunit.client.0.smithi088.stdout:1/643: unlink d9/d10/d2a/l57 0 2024-09-13T21:40:26.621 INFO:tasks.workunit.client.0.smithi088.stdout:3/691: unlink d5/d23/d2a/d3f/d76/d81/c93 0 2024-09-13T21:40:26.622 INFO:tasks.workunit.client.0.smithi088.stdout:6/704: rename d0/d2c/d32/d39/d3f/d71/dd2 to d0/d1e/d1f/d55/d96/dde 0 2024-09-13T21:40:26.624 INFO:tasks.workunit.client.0.smithi088.stdout:6/705: dread d0/d1e/fd0 [0,4194304] 0 2024-09-13T21:40:26.628 INFO:tasks.workunit.client.0.smithi088.stdout:1/644: mknod d9/d10/d2a/d47/dc8/cdc 0 2024-09-13T21:40:26.632 INFO:tasks.workunit.client.0.smithi088.stdout:0/669: rename d7/fa9 to d7/d1d/d66/d8b/dc0/fea 0 2024-09-13T21:40:26.633 INFO:tasks.workunit.client.0.smithi088.stdout:0/670: stat d7/d1d/d27/d43/f53 0 2024-09-13T21:40:26.634 INFO:tasks.workunit.client.0.smithi088.stdout:0/671: dread d7/d65/f92 [0,4194304] 0 2024-09-13T21:40:26.636 INFO:tasks.workunit.client.0.smithi088.stdout:1/645: mknod d9/d10/d2a/d47/dc8/cdd 0 2024-09-13T21:40:26.638 INFO:tasks.workunit.client.0.smithi088.stdout:3/692: rmdir d5/d23/d2a/d3f/d76 39 2024-09-13T21:40:26.638 INFO:tasks.workunit.client.0.smithi088.stdout:3/693: readlink d5/d23/d2a/d3f/l41 0 2024-09-13T21:40:26.638 INFO:tasks.workunit.client.0.smithi088.stdout:3/694: dread - d5/d23/d2a/d6b/d98/da1/daa/f78 zero size 2024-09-13T21:40:26.640 INFO:tasks.workunit.client.0.smithi088.stdout:3/695: dread d5/d23/d2a/d63/d31/f7c [0,4194304] 0 2024-09-13T21:40:26.641 INFO:tasks.workunit.client.0.smithi088.stdout:5/760: rename d4/d1c/d24/d26/d40/cbd to d4/d1c/d24/d26/dbf/d89/dc9/dcb/cf5 0 2024-09-13T21:40:26.642 INFO:tasks.workunit.client.0.smithi088.stdout:6/706: rmdir d0/d2c/d32/d39/d3f 39 2024-09-13T21:40:26.643 INFO:tasks.workunit.client.0.smithi088.stdout:6/707: creat d0/d2c/d32/fdf x:0 0 0 2024-09-13T21:40:26.644 INFO:tasks.workunit.client.0.smithi088.stdout:0/672: mkdir d7/d65/d8c/deb 0 2024-09-13T21:40:26.646 INFO:tasks.workunit.client.0.smithi088.stdout:3/696: fdatasync d5/f13 0 2024-09-13T21:40:26.646 INFO:tasks.workunit.client.0.smithi088.stdout:3/697: chown d5/d23/d2a/d55/f7b 220391439 1 2024-09-13T21:40:26.649 INFO:tasks.workunit.client.0.smithi088.stdout:1/646: rename d9/d10/d2a/d47/l73 to d9/d10/d2a/d4b/d39/d43/lde 0 2024-09-13T21:40:26.651 INFO:tasks.workunit.client.0.smithi088.stdout:5/761: unlink d4/d1c/d4a/d63/dd0/ce1 0 2024-09-13T21:40:26.651 INFO:tasks.workunit.client.0.smithi088.stdout:5/762: readlink d4/lec 0 2024-09-13T21:40:26.653 INFO:tasks.workunit.client.0.smithi088.stdout:0/673: creat d7/d2c/d30/d31/d42/fec x:0 0 0 2024-09-13T21:40:26.654 INFO:tasks.workunit.client.0.smithi088.stdout:3/698: mkdir d5/d23/d2a/d63/d48/d49/dd8 0 2024-09-13T21:40:26.656 INFO:tasks.workunit.client.0.smithi088.stdout:1/647: link d9/l7b d9/d10/d2a/d4b/ldf 0 2024-09-13T21:40:26.656 INFO:tasks.workunit.client.0.smithi088.stdout:1/648: creat d9/d10/d2a/d47/fe0 x:0 0 0 2024-09-13T21:40:26.656 INFO:tasks.workunit.client.0.smithi088.stdout:1/649: chown d9/d10/d2a/d4b/d33/dad/dbb/fc9 13574818 1 2024-09-13T21:40:26.656 INFO:tasks.workunit.client.0.smithi088.stdout:1/650: getdents d9/d4f/dd5 0 2024-09-13T21:40:26.657 INFO:tasks.workunit.client.0.smithi088.stdout:9/562: sync 2024-09-13T21:40:26.657 INFO:tasks.workunit.client.0.smithi088.stdout:9/563: creat d1a/d3c/faa x:0 0 0 2024-09-13T21:40:26.658 INFO:tasks.workunit.client.0.smithi088.stdout:7/555: sync 2024-09-13T21:40:26.658 INFO:tasks.workunit.client.0.smithi088.stdout:5/763: rename d4/d1c/d24/d26/dbf/d89/d92/feb to d4/d1c/d24/d26/dbf/d89/dc9/dd1/ff6 0 2024-09-13T21:40:26.659 INFO:tasks.workunit.client.0.smithi088.stdout:0/674: dread d7/d2c/d37/f59 [0,4194304] 0 2024-09-13T21:40:26.659 INFO:tasks.workunit.client.0.smithi088.stdout:0/675: creat d7/d1d/d26/dcd/fed x:0 0 0 2024-09-13T21:40:26.663 INFO:tasks.workunit.client.0.smithi088.stdout:1/651: mkdir d9/d10/d2a/d4b/d33/dad/dbb/de1 0 2024-09-13T21:40:26.663 INFO:tasks.workunit.client.0.smithi088.stdout:6/708: dwrite d0/d2c/fcd [0,4194304] 0 2024-09-13T21:40:26.663 INFO:tasks.workunit.client.0.smithi088.stdout:6/709: chown d0/d1e/c61 262 1 2024-09-13T21:40:26.664 INFO:tasks.workunit.client.0.smithi088.stdout:7/556: mkdir d6/da/db7 0 2024-09-13T21:40:26.664 INFO:tasks.workunit.client.0.smithi088.stdout:7/557: creat d6/d5f/d69/d4f/fb8 x:0 0 0 2024-09-13T21:40:26.667 INFO:tasks.workunit.client.0.smithi088.stdout:5/764: dread d4/d1c/f45 [0,4194304] 0 2024-09-13T21:40:26.667 INFO:tasks.workunit.client.0.smithi088.stdout:5/765: write d4/d1c/d24/d26/dbf/d89/d92/f2d [5327297,110987] 0 2024-09-13T21:40:26.667 INFO:tasks.workunit.client.0.smithi088.stdout:0/676: symlink d7/d2c/d30/lee 0 2024-09-13T21:40:26.667 INFO:tasks.workunit.client.0.smithi088.stdout:5/766: chown d4/l19 7 1 2024-09-13T21:40:26.667 INFO:tasks.workunit.client.0.smithi088.stdout:5/767: dread - d4/d1c/d4a/f50 zero size 2024-09-13T21:40:26.675 INFO:tasks.workunit.client.0.smithi088.stdout:0/677: dread d7/d1d/d26/d45/faa [0,4194304] 0 2024-09-13T21:40:26.680 INFO:tasks.workunit.client.0.smithi088.stdout:3/699: rmdir d5 39 2024-09-13T21:40:26.680 INFO:tasks.workunit.client.0.smithi088.stdout:3/700: chown d5/f13 1609743 1 2024-09-13T21:40:26.680 INFO:tasks.workunit.client.0.smithi088.stdout:3/701: truncate d5/d5a/db8/fc4 664826 0 2024-09-13T21:40:26.682 INFO:tasks.workunit.client.0.smithi088.stdout:1/652: unlink d9/d4f/fbc 0 2024-09-13T21:40:26.684 INFO:tasks.workunit.client.0.smithi088.stdout:7/558: mkdir d6/d5f/d69/d4f/d4c/db9 0 2024-09-13T21:40:26.686 INFO:tasks.workunit.client.0.smithi088.stdout:0/678: rmdir d7/d2c 39 2024-09-13T21:40:26.688 INFO:tasks.workunit.client.0.smithi088.stdout:3/702: symlink d5/d23/d2a/d6b/d98/dcd/ld9 0 2024-09-13T21:40:26.689 INFO:tasks.workunit.client.0.smithi088.stdout:1/653: rename d9/d10/d2a/d4b/d39/l5b to d9/d4f/le2 0 2024-09-13T21:40:26.689 INFO:tasks.workunit.client.0.smithi088.stdout:1/654: creat d9/fe3 x:0 0 0 2024-09-13T21:40:26.691 INFO:tasks.workunit.client.0.smithi088.stdout:7/559: getdents d6/d5f/d69/d45 0 2024-09-13T21:40:26.691 INFO:tasks.workunit.client.0.smithi088.stdout:7/560: creat d6/da/d1a/fba x:0 0 0 2024-09-13T21:40:26.691 INFO:tasks.workunit.client.0.smithi088.stdout:7/561: readlink d6/da/d1a/d3a/d5c/l9c 0 2024-09-13T21:40:26.691 INFO:tasks.workunit.client.0.smithi088.stdout:7/562: chown d6/d5f/d69/d4f/d6f/d83/f7f 51839748 1 2024-09-13T21:40:26.692 INFO:tasks.workunit.client.0.smithi088.stdout:5/768: getdents d4/da7 0 2024-09-13T21:40:26.692 INFO:tasks.workunit.client.0.smithi088.stdout:4/619: sync 2024-09-13T21:40:26.693 INFO:tasks.workunit.client.0.smithi088.stdout:4/620: stat d2/d5/d20/d41/d4b/d98 0 2024-09-13T21:40:26.693 INFO:tasks.workunit.client.0.smithi088.stdout:4/621: fdatasync d2/d5/d20/d41/d4b/f54 0 2024-09-13T21:40:26.693 INFO:tasks.workunit.client.0.smithi088.stdout:0/679: mknod d7/d65/cef 0 2024-09-13T21:40:26.694 INFO:tasks.workunit.client.0.smithi088.stdout:3/703: mknod d5/d23/d2a/d3f/cda 0 2024-09-13T21:40:26.696 INFO:tasks.workunit.client.0.smithi088.stdout:7/563: mknod d6/da/d44/cbb 0 2024-09-13T21:40:26.698 INFO:tasks.workunit.client.0.smithi088.stdout:5/769: creat d4/d1c/d24/d26/dbf/d89/dc9/dcb/ff7 x:0 0 0 2024-09-13T21:40:26.699 INFO:tasks.workunit.client.0.smithi088.stdout:0/680: symlink d7/d1d/d66/d8b/dc0/lf0 0 2024-09-13T21:40:26.700 INFO:tasks.workunit.client.0.smithi088.stdout:4/622: write d2/d5/d20/d60/de/d1e/d23/f3d [3886528,30251] 0 2024-09-13T21:40:26.701 INFO:tasks.workunit.client.0.smithi088.stdout:5/770: symlink d4/d1c/d4a/d8a/lf8 0 2024-09-13T21:40:26.701 INFO:tasks.workunit.client.0.smithi088.stdout:0/681: stat d7/f23 0 2024-09-13T21:40:26.706 INFO:tasks.workunit.client.0.smithi088.stdout:6/710: dwrite d0/d1e/d1f/f91 [0,4194304] 0 2024-09-13T21:40:26.707 INFO:tasks.workunit.client.0.smithi088.stdout:5/771: rename d4/d1c/d24/d26/d4b/c57 to d4/d1c/d24/d26/cf9 0 2024-09-13T21:40:26.709 INFO:tasks.workunit.client.0.smithi088.stdout:3/704: read d5/d23/f57 [1339206,40182] 0 2024-09-13T21:40:26.709 INFO:tasks.workunit.client.0.smithi088.stdout:3/705: stat d5/f13 0 2024-09-13T21:40:26.714 INFO:tasks.workunit.client.0.smithi088.stdout:3/706: rename d5/d23/d2a/d63/d48/fc7 to d5/d23/d2a/d55/fdb 0 2024-09-13T21:40:26.714 INFO:tasks.workunit.client.0.smithi088.stdout:0/682: read d7/d1d/d26/dcd/fde [309781,91379] 0 2024-09-13T21:40:26.714 INFO:tasks.workunit.client.0.smithi088.stdout:1/655: dwrite d9/dc/d52/dba/d7d/fa4 [0,4194304] 0 2024-09-13T21:40:26.714 INFO:tasks.workunit.client.0.smithi088.stdout:0/683: readlink d7/d1d/d66/d8b/dc0/lf0 0 2024-09-13T21:40:26.718 INFO:tasks.workunit.client.0.smithi088.stdout:0/684: link d7/d2c/d30/d31/d42/fad d7/d2c/d37/ff1 0 2024-09-13T21:40:26.719 INFO:tasks.workunit.client.0.smithi088.stdout:1/656: symlink d9/d10/d2a/d4b/d33/d92/le4 0 2024-09-13T21:40:26.719 INFO:tasks.workunit.client.0.smithi088.stdout:1/657: fdatasync d9/d10/d2a/d4b/d61/f6a 0 2024-09-13T21:40:26.720 INFO:tasks.workunit.client.0.smithi088.stdout:7/564: rmdir d6/da 39 2024-09-13T21:40:26.722 INFO:tasks.workunit.client.0.smithi088.stdout:0/685: unlink d7/d1d/c6d 0 2024-09-13T21:40:26.724 INFO:tasks.workunit.client.0.smithi088.stdout:1/658: link d9/d4f/d64/lac d9/d10/d2a/d4b/d33/dad/dbb/le5 0 2024-09-13T21:40:26.725 INFO:tasks.workunit.client.0.smithi088.stdout:0/686: dread d7/f91 [0,4194304] 0 2024-09-13T21:40:26.725 INFO:tasks.workunit.client.0.smithi088.stdout:0/687: write d7/d1d/d27/d43/f17 [8491327,58504] 0 2024-09-13T21:40:26.725 INFO:tasks.workunit.client.0.smithi088.stdout:0/688: readlink d7/d2c/l4d 0 2024-09-13T21:40:26.725 INFO:tasks.workunit.client.0.smithi088.stdout:7/565: getdents d6/da/d1a/d3a/d5c/d60 0 2024-09-13T21:40:26.726 INFO:tasks.workunit.client.0.smithi088.stdout:1/659: mkdir d9/d10/d2a/d47/d9c/db5/de6 0 2024-09-13T21:40:26.728 INFO:tasks.workunit.client.0.smithi088.stdout:0/689: unlink d7/d1d/d21/d82/db8/cd9 0 2024-09-13T21:40:26.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/660: mknod d9/d10/d2a/d4b/d61/ce7 0 2024-09-13T21:40:26.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/661: creat d9/d10/d2a/d4b/d33/dad/dbb/fe8 x:0 0 0 2024-09-13T21:40:26.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/662: readlink d9/dc/l22 0 2024-09-13T21:40:26.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/663: creat d9/d4f/d64/fe9 x:0 0 0 2024-09-13T21:40:26.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/664: dread - d9/d10/d2a/d4b/d39/d43/d85/f8f zero size 2024-09-13T21:40:26.733 INFO:tasks.workunit.client.0.smithi088.stdout:1/665: truncate d9/dc/f1f 1570368 0 2024-09-13T21:40:26.733 INFO:tasks.workunit.client.0.smithi088.stdout:1/666: chown d9/dc/l22 319 1 2024-09-13T21:40:26.735 INFO:tasks.workunit.client.0.smithi088.stdout:4/623: dwrite d2/d5/d2d/f3e [0,4194304] 0 2024-09-13T21:40:26.736 INFO:tasks.workunit.client.0.smithi088.stdout:5/772: dwrite d4/d1c/d4a/d63/f6f [0,4194304] 0 2024-09-13T21:40:26.736 INFO:tasks.workunit.client.0.smithi088.stdout:6/711: dwrite d0/d28/fa8 [0,4194304] 0 2024-09-13T21:40:26.736 INFO:tasks.workunit.client.0.smithi088.stdout:6/712: chown d0/d2c/d32/d39/d3f/d71/d81/fb2 971062 1 2024-09-13T21:40:26.736 INFO:tasks.workunit.client.0.smithi088.stdout:3/707: rename d5/d23/d2a/d55 to d5/d23/d2a/d6b/d98/ddc 0 2024-09-13T21:40:26.736 INFO:tasks.workunit.client.0.smithi088.stdout:3/708: fsync d5/d14/f82 0 2024-09-13T21:40:26.736 INFO:tasks.workunit.client.0.smithi088.stdout:3/709: chown d5/d23/d2a/d3f/d8f 0 1 2024-09-13T21:40:26.736 INFO:tasks.workunit.client.0.smithi088.stdout:3/710: write d5/d23/d2a/d3f/d76/f77 [738652,123505] 0 2024-09-13T21:40:26.737 INFO:tasks.workunit.client.0.smithi088.stdout:1/667: creat d9/d10/d2a/d47/d9c/db5/fea x:0 0 0 2024-09-13T21:40:26.738 INFO:tasks.workunit.client.0.smithi088.stdout:5/773: symlink d4/d1c/d24/d26/dbf/d89/d92/lfa 0 2024-09-13T21:40:26.740 INFO:tasks.workunit.client.0.smithi088.stdout:6/713: fsync d0/d1e/d1f/fa2 0 2024-09-13T21:40:26.742 INFO:tasks.workunit.client.0.smithi088.stdout:3/711: symlink d5/d23/d2a/d6b/d9e/ldd 0 2024-09-13T21:40:26.745 INFO:tasks.workunit.client.0.smithi088.stdout:1/668: rename d9/dc/l5a to d9/dc/d52/dba/dd4/leb 0 2024-09-13T21:40:26.745 INFO:tasks.workunit.client.0.smithi088.stdout:3/712: chown d5/d23/d2a/d3f/d76/db3/f96 17763618 1 2024-09-13T21:40:26.745 INFO:tasks.workunit.client.0.smithi088.stdout:6/714: mknod d0/d2c/d7f/ce0 0 2024-09-13T21:40:26.746 INFO:tasks.workunit.client.0.smithi088.stdout:3/713: write d5/d23/d2a/fb2 [901431,32468] 0 2024-09-13T21:40:26.747 INFO:tasks.workunit.client.0.smithi088.stdout:4/624: dread d2/d5/d20/d60/de/d1e/d31/f7d [0,4194304] 0 2024-09-13T21:40:26.747 INFO:tasks.workunit.client.0.smithi088.stdout:4/625: write d2/d5/d20/d60/de/f76 [451823,80207] 0 2024-09-13T21:40:26.748 INFO:tasks.workunit.client.0.smithi088.stdout:1/669: rename d9/d10/d2a/d4b/d33/d92/d8e/la0 to d9/d4f/lec 0 2024-09-13T21:40:26.748 INFO:tasks.workunit.client.0.smithi088.stdout:1/670: truncate d9/dc/fb9 661720 0 2024-09-13T21:40:26.748 INFO:tasks.workunit.client.0.smithi088.stdout:4/626: getdents d2/d11/dab 0 2024-09-13T21:40:26.749 INFO:tasks.workunit.client.0.smithi088.stdout:4/627: write d2/d5/d20/f73 [471321,53138] 0 2024-09-13T21:40:26.751 INFO:tasks.workunit.client.0.smithi088.stdout:4/628: unlink d2/d5/d2d/d70/c7c 0 2024-09-13T21:40:26.752 INFO:tasks.workunit.client.0.smithi088.stdout:4/629: mknod d2/d81/cce 0 2024-09-13T21:40:26.752 INFO:tasks.workunit.client.0.smithi088.stdout:4/630: chown d2/d11/dab/cb3 505737 1 2024-09-13T21:40:26.754 INFO:tasks.workunit.client.0.smithi088.stdout:7/566: dwrite d6/da/d1a/f89 [0,4194304] 0 2024-09-13T21:40:26.758 INFO:tasks.workunit.client.0.smithi088.stdout:7/567: truncate f1 5627095 0 2024-09-13T21:40:26.758 INFO:tasks.workunit.client.0.smithi088.stdout:3/714: write d5/d23/d2a/d6b/fc2 [1452243,99360] 0 2024-09-13T21:40:26.758 INFO:tasks.workunit.client.0.smithi088.stdout:6/715: write d0/d2c/d32/d39/faa [2508474,7693] 0 2024-09-13T21:40:26.758 INFO:tasks.workunit.client.0.smithi088.stdout:6/716: stat d0/d28/c31 0 2024-09-13T21:40:26.760 INFO:tasks.workunit.client.0.smithi088.stdout:0/690: dwrite d7/d1d/d26/dcd/fde [0,4194304] 0 2024-09-13T21:40:26.760 INFO:tasks.workunit.client.0.smithi088.stdout:0/691: chown d7/d2c/d30/d31/d42 192 1 2024-09-13T21:40:26.761 INFO:tasks.workunit.client.0.smithi088.stdout:1/671: dread d9/d10/d2a/d4b/d33/f76 [0,4194304] 0 2024-09-13T21:40:26.761 INFO:tasks.workunit.client.0.smithi088.stdout:5/774: dwrite d4/d1c/d4a/d8a/f8b [0,4194304] 0 2024-09-13T21:40:26.761 INFO:tasks.workunit.client.0.smithi088.stdout:1/672: read d9/d10/d2a/d4b/d61/f6a [1276566,57728] 0 2024-09-13T21:40:26.761 INFO:tasks.workunit.client.0.smithi088.stdout:1/673: dread - d9/d10/d2a/d4b/d33/dad/dbb/fc9 zero size 2024-09-13T21:40:26.761 INFO:tasks.workunit.client.0.smithi088.stdout:7/568: dread d6/d5f/d69/d4f/d6f/d70/d76/f82 [0,4194304] 0 2024-09-13T21:40:26.768 INFO:tasks.workunit.client.0.smithi088.stdout:0/692: creat d7/d2c/d30/dbe/dce/ff2 x:0 0 0 2024-09-13T21:40:26.770 INFO:tasks.workunit.client.0.smithi088.stdout:3/715: dread d5/d23/d2a/d63/d48/d49/fa7 [0,4194304] 0 2024-09-13T21:40:26.774 INFO:tasks.workunit.client.0.smithi088.stdout:4/631: dwrite d2/d5/f55 [0,4194304] 0 2024-09-13T21:40:26.774 INFO:tasks.workunit.client.0.smithi088.stdout:4/632: creat d2/d5/d20/d7f/fcf x:0 0 0 2024-09-13T21:40:26.781 INFO:tasks.workunit.client.0.smithi088.stdout:0/693: write d7/d2c/fbd [335948,17771] 0 2024-09-13T21:40:26.781 INFO:tasks.workunit.client.0.smithi088.stdout:5/775: mknod d4/d1c/d24/d26/dbf/d89/d92/cfb 0 2024-09-13T21:40:26.781 INFO:tasks.workunit.client.0.smithi088.stdout:5/776: write d4/d1c/d24/d95/fc4 [2968949,31770] 0 2024-09-13T21:40:26.782 INFO:tasks.workunit.client.0.smithi088.stdout:6/717: rename d0/d1e/d1f/f4e to d0/d2c/dad/db8/dcc/fe1 0 2024-09-13T21:40:26.784 INFO:tasks.workunit.client.0.smithi088.stdout:7/569: mknod d6/da/d1a/d3a/cbc 0 2024-09-13T21:40:26.785 INFO:tasks.workunit.client.0.smithi088.stdout:3/716: chown d5/f56 8 1 2024-09-13T21:40:26.785 INFO:tasks.workunit.client.0.smithi088.stdout:3/717: write d5/d23/d2a/d3f/f7d [4818566,58069] 0 2024-09-13T21:40:26.786 INFO:tasks.workunit.client.0.smithi088.stdout:3/718: write f0 [1640555,102018] 0 2024-09-13T21:40:26.790 INFO:tasks.workunit.client.0.smithi088.stdout:4/633: truncate d2/d5/d20/d60/f97 865967 0 2024-09-13T21:40:26.794 INFO:tasks.workunit.client.0.smithi088.stdout:1/674: getdents d9/d10/d2a/d47/d9c 0 2024-09-13T21:40:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:4/634: dread d2/d5/d20/d60/de/d1e/d23/f94 [0,4194304] 0 2024-09-13T21:40:26.795 INFO:tasks.workunit.client.0.smithi088.stdout:0/694: rename d7/d2c/d78/daf to d7/d65/d8c/df3 0 2024-09-13T21:40:26.796 INFO:tasks.workunit.client.0.smithi088.stdout:3/719: creat d5/d23/d2a/d3f/d76/fde x:0 0 0 2024-09-13T21:40:26.799 INFO:tasks.workunit.client.0.smithi088.stdout:0/695: link d7/f7b d7/d1d/d27/d43/ff4 0 2024-09-13T21:40:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:2/674: sync 2024-09-13T21:40:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:8/624: sync 2024-09-13T21:40:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:8/625: truncate db/df/d61/f63 456773 0 2024-09-13T21:40:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:8/626: write db/d26/d37/f46 [4216262,50568] 0 2024-09-13T21:40:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:8/627: getdents db/d26/d2c/d85/d51/dca/dcb 0 2024-09-13T21:40:26.800 INFO:tasks.workunit.client.0.smithi088.stdout:1/675: read d9/f14 [3267909,9556] 0 2024-09-13T21:40:26.801 INFO:tasks.workunit.client.0.smithi088.stdout:5/777: getdents d4/d1c/d24/d26/dbf/d89/d92 0 2024-09-13T21:40:26.802 INFO:tasks.workunit.client.0.smithi088.stdout:0/696: getdents d7/d2c/d30/dbe/dce 0 2024-09-13T21:40:26.802 INFO:tasks.workunit.client.0.smithi088.stdout:0/697: dread - d7/d1d/d21/d82/fd7 zero size 2024-09-13T21:40:26.804 INFO:tasks.workunit.client.0.smithi088.stdout:4/635: dread d2/f15 [4194304,4194304] 0 2024-09-13T21:40:26.804 INFO:tasks.workunit.client.0.smithi088.stdout:1/676: rename d9/c54 to d9/d10/d2a/d4b/d33/dad/ced 0 2024-09-13T21:40:26.806 INFO:tasks.workunit.client.0.smithi088.stdout:0/698: mknod d7/d2c/d30/cf5 0 2024-09-13T21:40:26.807 INFO:tasks.workunit.client.0.smithi088.stdout:3/720: dread d5/d23/d2a/d3f/f64 [0,4194304] 0 2024-09-13T21:40:26.807 INFO:tasks.workunit.client.0.smithi088.stdout:0/699: mknod d7/d2c/d30/d31/d42/d4b/cf6 0 2024-09-13T21:40:26.807 INFO:tasks.workunit.client.0.smithi088.stdout:0/700: stat d7/d2c/d37/l97 0 2024-09-13T21:40:26.807 INFO:tasks.workunit.client.0.smithi088.stdout:0/701: chown d7/d1d/d27/f70 2 1 2024-09-13T21:40:26.808 INFO:tasks.workunit.client.0.smithi088.stdout:3/721: creat d5/d23/d2a/d6b/d98/fdf x:0 0 0 2024-09-13T21:40:26.808 INFO:tasks.workunit.client.0.smithi088.stdout:7/570: dwrite d6/d5f/d69/d4f/f41 [0,4194304] 0 2024-09-13T21:40:26.810 INFO:tasks.workunit.client.0.smithi088.stdout:2/675: dread d1/d8/d16/f7c [0,4194304] 0 2024-09-13T21:40:26.810 INFO:tasks.workunit.client.0.smithi088.stdout:3/722: link d5/d23/d2a/d6b/d98/da1/daa/d43/fb9 d5/d5a/d7f/fe0 0 2024-09-13T21:40:26.814 INFO:tasks.workunit.client.0.smithi088.stdout:7/571: mkdir d6/d5f/d69/d4f/d6f/d70/d76/dbd 0 2024-09-13T21:40:26.814 INFO:tasks.workunit.client.0.smithi088.stdout:7/572: readlink d6/da/l2c 0 2024-09-13T21:40:26.816 INFO:tasks.workunit.client.0.smithi088.stdout:3/723: rename d5/f6 to d5/d23/d2a/d3f/db4/fe1 0 2024-09-13T21:40:26.817 INFO:tasks.workunit.client.0.smithi088.stdout:7/573: creat d6/da/d44/fbe x:0 0 0 2024-09-13T21:40:26.818 INFO:tasks.workunit.client.0.smithi088.stdout:3/724: symlink d5/d5a/d7f/le2 0 2024-09-13T21:40:26.818 INFO:tasks.workunit.client.0.smithi088.stdout:3/725: write d5/d23/d2a/d6b/d8b/fbf [544361,68058] 0 2024-09-13T21:40:26.820 INFO:tasks.workunit.client.0.smithi088.stdout:3/726: unlink d5/d14/l20 0 2024-09-13T21:40:26.820 INFO:tasks.workunit.client.0.smithi088.stdout:3/727: chown d5/d23/d2a/d6b/d98/ddc/f7b 1909052 1 2024-09-13T21:40:26.822 INFO:tasks.workunit.client.0.smithi088.stdout:3/728: unlink d5/d23/d2a/d6b/fc2 0 2024-09-13T21:40:26.823 INFO:tasks.workunit.client.0.smithi088.stdout:3/729: creat d5/d23/d2a/d63/fe3 x:0 0 0 2024-09-13T21:40:26.824 INFO:tasks.workunit.client.0.smithi088.stdout:3/730: truncate d5/d23/d2a/d3f/d76/db3/fa4 3403664 0 2024-09-13T21:40:26.824 INFO:tasks.workunit.client.0.smithi088.stdout:3/731: fdatasync d5/d23/d2a/d6b/d98/da1/daa/d43/f83 0 2024-09-13T21:40:26.838 INFO:tasks.workunit.client.0.smithi088.stdout:2/676: dwrite d1/d13/d2a/f65 [0,4194304] 0 2024-09-13T21:40:26.838 INFO:tasks.workunit.client.0.smithi088.stdout:4/636: dwrite d2/d81/fc0 [0,4194304] 0 2024-09-13T21:40:26.838 INFO:tasks.workunit.client.0.smithi088.stdout:5/778: dwrite d4/d1c/d24/d26/dbf/d89/fdb [0,4194304] 0 2024-09-13T21:40:26.838 INFO:tasks.workunit.client.0.smithi088.stdout:5/779: dread - d4/d1c/d24/d26/fe0 zero size 2024-09-13T21:40:26.839 INFO:tasks.workunit.client.0.smithi088.stdout:2/677: mkdir d1/de4 0 2024-09-13T21:40:26.842 INFO:tasks.workunit.client.0.smithi088.stdout:4/637: rename d2/d5/d20/d60/l7b to d2/d5/d20/d60/de/d1e/d23/d6c/ld0 0 2024-09-13T21:40:26.843 INFO:tasks.workunit.client.0.smithi088.stdout:5/780: truncate d4/d1c/d24/f39 1463954 0 2024-09-13T21:40:26.843 INFO:tasks.workunit.client.0.smithi088.stdout:5/781: truncate d4/d1c/d24/d26/d56/f64 188741 0 2024-09-13T21:40:26.843 INFO:tasks.workunit.client.0.smithi088.stdout:5/782: readlink d4/d1c/d4a/d8a/lf8 0 2024-09-13T21:40:26.844 INFO:tasks.workunit.client.0.smithi088.stdout:4/638: creat d2/d5/d20/d60/de/d1e/d23/dca/fd1 x:0 0 0 2024-09-13T21:40:26.846 INFO:tasks.workunit.client.0.smithi088.stdout:2/678: rename d1/d13/d3f/d99/d9c/db1/dcd/l96 to d1/d13/d2a/d3c/d4a/d6e/d5b/d89/dcc/le5 0 2024-09-13T21:40:26.846 INFO:tasks.workunit.client.0.smithi088.stdout:4/639: creat d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79/fd2 x:0 0 0 2024-09-13T21:40:26.848 INFO:tasks.workunit.client.0.smithi088.stdout:5/783: rename d4/f13 to d4/d1c/d24/d26/dbf/d89/d92/df3/ffc 0 2024-09-13T21:40:26.848 INFO:tasks.workunit.client.0.smithi088.stdout:2/679: rmdir d1/d8 39 2024-09-13T21:40:26.849 INFO:tasks.workunit.client.0.smithi088.stdout:4/640: rmdir d2/d5/d20/d60/de/d1e/d23/d6c 39 2024-09-13T21:40:26.849 INFO:tasks.workunit.client.0.smithi088.stdout:4/641: chown d2/d5/d20/d60/de/fba 79 1 2024-09-13T21:40:26.849 INFO:tasks.workunit.client.0.smithi088.stdout:5/784: write d4/d1b/f54 [369353,111527] 0 2024-09-13T21:40:26.849 INFO:tasks.workunit.client.0.smithi088.stdout:5/785: creat d4/d1b/ffd x:0 0 0 2024-09-13T21:40:26.850 INFO:tasks.workunit.client.0.smithi088.stdout:4/642: creat d2/d13/d50/fd3 x:0 0 0 2024-09-13T21:40:26.850 INFO:tasks.workunit.client.0.smithi088.stdout:2/680: dread d1/d8/d16/f98 [0,4194304] 0 2024-09-13T21:40:26.851 INFO:tasks.workunit.client.0.smithi088.stdout:5/786: unlink d4/d1c/d4a/d63/d6a/d6d/ca0 0 2024-09-13T21:40:26.852 INFO:tasks.workunit.client.0.smithi088.stdout:2/681: rmdir d1/d13/d3f/d99/d9c 39 2024-09-13T21:40:26.852 INFO:tasks.workunit.client.0.smithi088.stdout:2/682: fdatasync d1/d8/d2e/d3b/f8b 0 2024-09-13T21:40:26.852 INFO:tasks.workunit.client.0.smithi088.stdout:2/683: chown d1/d13/d3f/d99 489 1 2024-09-13T21:40:26.853 INFO:tasks.workunit.client.0.smithi088.stdout:5/787: mkdir d4/d1c/d24/d26/dfe 0 2024-09-13T21:40:26.853 INFO:tasks.workunit.client.0.smithi088.stdout:5/788: write d4/d1c/d4a/fe4 [1037692,18777] 0 2024-09-13T21:40:26.853 INFO:tasks.workunit.client.0.smithi088.stdout:4/643: symlink d2/d5/d20/d60/de/ld4 0 2024-09-13T21:40:26.854 INFO:tasks.workunit.client.0.smithi088.stdout:2/684: creat d1/d8/d24/d78/d7f/fe6 x:0 0 0 2024-09-13T21:40:26.855 INFO:tasks.workunit.client.0.smithi088.stdout:4/644: mkdir d2/d5/d20/d60/de/d1e/d23/dd5 0 2024-09-13T21:40:26.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/685: symlink d1/d13/d2a/d3c/d4a/d6e/d66/le7 0 2024-09-13T21:40:26.856 INFO:tasks.workunit.client.0.smithi088.stdout:2/686: stat d1/d8/d24/fc6 0 2024-09-13T21:40:26.857 INFO:tasks.workunit.client.0.smithi088.stdout:5/789: creat d4/d1c/d24/d26/dbf/d89/da3/fff x:0 0 0 2024-09-13T21:40:26.857 INFO:tasks.workunit.client.0.smithi088.stdout:2/687: symlink d1/d13/d2a/d3c/d4a/d6e/d5b/d89/dcc/le8 0 2024-09-13T21:40:26.858 INFO:tasks.workunit.client.0.smithi088.stdout:5/790: mkdir d4/d1c/d24/d26/d56/d100 0 2024-09-13T21:40:26.859 INFO:tasks.workunit.client.0.smithi088.stdout:2/688: mkdir d1/d13/d2a/d3c/de9 0 2024-09-13T21:40:26.859 INFO:tasks.workunit.client.0.smithi088.stdout:2/689: creat d1/d13/d2a/d41/d48/fea x:0 0 0 2024-09-13T21:40:26.859 INFO:tasks.workunit.client.0.smithi088.stdout:5/791: mkdir d4/d1c/d24/d26/d4b/d67/db2/d101 0 2024-09-13T21:40:26.860 INFO:tasks.workunit.client.0.smithi088.stdout:2/690: stat d1/d8/d2e/d3b/cd3 0 2024-09-13T21:40:26.861 INFO:tasks.workunit.client.0.smithi088.stdout:5/792: symlink d4/d1b/d68/l102 0 2024-09-13T21:40:26.861 INFO:tasks.workunit.client.0.smithi088.stdout:5/793: creat d4/d1c/d24/d95/f103 x:0 0 0 2024-09-13T21:40:26.867 INFO:tasks.workunit.client.0.smithi088.stdout:2/691: read d1/d13/d2a/f65 [601983,125269] 0 2024-09-13T21:40:26.868 INFO:tasks.workunit.client.0.smithi088.stdout:2/692: truncate d1/d13/d2a/d41/d48/da0/fa9 3716168 0 2024-09-13T21:40:26.870 INFO:tasks.workunit.client.0.smithi088.stdout:0/702: dread d7/f91 [0,4194304] 0 2024-09-13T21:40:26.871 INFO:tasks.workunit.client.0.smithi088.stdout:4/645: dwrite d2/d5/d20/d60/de/d1e/d23/d3c/f89 [0,4194304] 0 2024-09-13T21:40:26.872 INFO:tasks.workunit.client.0.smithi088.stdout:0/703: link d7/d1d/d3d/f57 d7/d65/ff7 0 2024-09-13T21:40:26.874 INFO:tasks.workunit.client.0.smithi088.stdout:4/646: mknod d2/d5/d2d/d70/cd6 0 2024-09-13T21:40:26.874 INFO:tasks.workunit.client.0.smithi088.stdout:0/704: truncate d7/f8a 71160 0 2024-09-13T21:40:26.874 INFO:tasks.workunit.client.0.smithi088.stdout:0/705: creat d7/d1d/d66/ff8 x:0 0 0 2024-09-13T21:40:26.876 INFO:tasks.workunit.client.0.smithi088.stdout:4/647: rename d2/d5/d20/d60/de/f8c to d2/d13/fd7 0 2024-09-13T21:40:26.881 INFO:tasks.workunit.client.0.smithi088.stdout:8/628: write db/f1a [2073139,30636] 0 2024-09-13T21:40:26.881 INFO:tasks.workunit.client.0.smithi088.stdout:8/629: write db/df/da7/d88/da8/db4/fc6 [137639,51884] 0 2024-09-13T21:40:26.882 INFO:tasks.workunit.client.0.smithi088.stdout:8/630: dread - db/df/d61/fa6 zero size 2024-09-13T21:40:26.882 INFO:tasks.workunit.client.0.smithi088.stdout:8/631: write db/df/d61/f8e [691148,60639] 0 2024-09-13T21:40:26.882 INFO:tasks.workunit.client.0.smithi088.stdout:8/632: fsync db/d26/d2c/db7/dbd/fd1 0 2024-09-13T21:40:26.883 INFO:tasks.workunit.client.0.smithi088.stdout:3/732: read d5/d23/d2a/d3f/d76/db3/f96 [381814,29317] 0 2024-09-13T21:40:26.884 INFO:tasks.workunit.client.0.smithi088.stdout:3/733: truncate d5/d23/d2a/d3f/f69 691746 0 2024-09-13T21:40:26.886 INFO:tasks.workunit.client.0.smithi088.stdout:0/706: write d7/d2c/d30/d31/d42/fad [3377413,52402] 0 2024-09-13T21:40:26.886 INFO:tasks.workunit.client.0.smithi088.stdout:4/648: write d2/fae [824421,54259] 0 2024-09-13T21:40:26.886 INFO:tasks.workunit.client.0.smithi088.stdout:4/649: write d2/d13/d50/f84 [761654,20163] 0 2024-09-13T21:40:26.886 INFO:tasks.workunit.client.0.smithi088.stdout:3/734: creat d5/d23/d2a/d3f/d8f/da3/fe4 x:0 0 0 2024-09-13T21:40:26.886 INFO:tasks.workunit.client.0.smithi088.stdout:3/735: chown d5/d23/l90 1194 1 2024-09-13T21:40:26.887 INFO:tasks.workunit.client.0.smithi088.stdout:0/707: truncate d7/d1d/d66/d8b/dc0/fea 484494 0 2024-09-13T21:40:26.889 INFO:tasks.workunit.client.0.smithi088.stdout:4/650: mknod d2/d5/d20/d60/de/d1e/d23/d3c/cd8 0 2024-09-13T21:40:26.889 INFO:tasks.workunit.client.0.smithi088.stdout:4/651: dread - d2/d13/f77 zero size 2024-09-13T21:40:26.891 INFO:tasks.workunit.client.0.smithi088.stdout:5/794: write d4/d1c/d4a/d8a/f9b [491192,64154] 0 2024-09-13T21:40:26.891 INFO:tasks.workunit.client.0.smithi088.stdout:1/677: dread d9/d10/d2a/d4b/d33/d92/dbe/fcb [0,4194304] 0 2024-09-13T21:40:26.891 INFO:tasks.workunit.client.0.smithi088.stdout:1/678: creat d9/d10/d2a/d4b/d39/d43/db2/fee x:0 0 0 2024-09-13T21:40:26.899 INFO:tasks.workunit.client.0.smithi088.stdout:2/693: dwrite d1/d8/d16/f5c [0,4194304] 0 2024-09-13T21:40:26.916 INFO:tasks.workunit.client.0.smithi088.stdout:2/694: creat d1/d8/d16/d40/d7e/daa/feb x:0 0 0 2024-09-13T21:40:26.934 INFO:tasks.workunit.client.0.smithi088.stdout:3/736: dwrite d5/d23/d2a/d63/f87 [0,4194304] 0 2024-09-13T21:40:26.939 INFO:tasks.workunit.client.0.smithi088.stdout:8/633: dwrite db/df/f67 [0,4194304] 0 2024-09-13T21:40:26.939 INFO:tasks.workunit.client.0.smithi088.stdout:8/634: write db/d26/d4f/f68 [1597825,16276] 0 2024-09-13T21:40:26.939 INFO:tasks.workunit.client.0.smithi088.stdout:8/635: fsync db/df/da7/d88/fd7 0 2024-09-13T21:40:26.940 INFO:tasks.workunit.client.0.smithi088.stdout:8/636: mknod db/d26/d37/d7d/cda 0 2024-09-13T21:40:26.940 INFO:tasks.workunit.client.0.smithi088.stdout:8/637: chown db/df/da7/l70 129654662 1 2024-09-13T21:40:26.940 INFO:tasks.workunit.client.0.smithi088.stdout:8/638: write db/df/da7/d88/da8/db4/fc6 [474326,122520] 0 2024-09-13T21:40:26.940 INFO:tasks.workunit.client.0.smithi088.stdout:8/639: readlink db/df/da7/daa/lcc 0 2024-09-13T21:40:26.943 INFO:tasks.workunit.client.0.smithi088.stdout:5/795: dwrite d4/d1c/d4a/d63/f6f [0,4194304] 0 2024-09-13T21:40:26.943 INFO:tasks.workunit.client.0.smithi088.stdout:5/796: stat d4/d1c/d24/d26/dbf/d89/d92/f96 0 2024-09-13T21:40:26.943 INFO:tasks.workunit.client.0.smithi088.stdout:1/679: dwrite d9/d10/d2a/d4b/d39/d43/db2/fee [0,4194304] 0 2024-09-13T21:40:26.943 INFO:tasks.workunit.client.0.smithi088.stdout:1/680: chown d9/d10/d2a/d47/dc8/cdc 1866932 1 2024-09-13T21:40:26.943 INFO:tasks.workunit.client.0.smithi088.stdout:1/681: truncate d9/d10/d2a/d4b/d33/dad/dbb/fd9 555135 0 2024-09-13T21:40:26.944 INFO:tasks.workunit.client.0.smithi088.stdout:0/708: dwrite d7/d2c/d37/ff1 [0,4194304] 0 2024-09-13T21:40:26.944 INFO:tasks.workunit.client.0.smithi088.stdout:2/695: dwrite d1/d8/fc [8388608,4194304] 0 2024-09-13T21:40:26.944 INFO:tasks.workunit.client.0.smithi088.stdout:2/696: dread - d1/d8/f7d zero size 2024-09-13T21:40:26.944 INFO:tasks.workunit.client.0.smithi088.stdout:2/697: chown d1/d8/f7d 51436048 1 2024-09-13T21:40:26.944 INFO:tasks.workunit.client.0.smithi088.stdout:2/698: fsync d1/d8/f12 0 2024-09-13T21:40:26.945 INFO:tasks.workunit.client.0.smithi088.stdout:4/652: dwrite d2/d5/d20/d60/de/f28 [0,4194304] 0 2024-09-13T21:40:26.945 INFO:tasks.workunit.client.0.smithi088.stdout:4/653: fsync d2/d5/d20/d41/d4b/d98/fb2 0 2024-09-13T21:40:26.945 INFO:tasks.workunit.client.0.smithi088.stdout:4/654: fsync d2/d5/d20/d60/de/f58 0 2024-09-13T21:40:26.948 INFO:tasks.workunit.client.0.smithi088.stdout:1/682: rmdir d9/d10/d2a/d4b/d39/d43 39 2024-09-13T21:40:26.948 INFO:tasks.workunit.client.0.smithi088.stdout:1/683: truncate d9/d4f/faa 312656 0 2024-09-13T21:40:26.948 INFO:tasks.workunit.client.0.smithi088.stdout:1/684: write d9/d10/d2a/d4b/d33/dad/fca [85161,90075] 0 2024-09-13T21:40:26.948 INFO:tasks.workunit.client.0.smithi088.stdout:1/685: chown d9/d10/d2a/d47/d9c/la2 8173 1 2024-09-13T21:40:26.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/699: link d1/d8/d24/d78/d7f/fac d1/d8/d2e/d3b/fec 0 2024-09-13T21:40:26.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/700: write d1/d13/d2a/d41/d48/fea [1030861,108583] 0 2024-09-13T21:40:26.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/701: fsync d1/d8/fa8 0 2024-09-13T21:40:26.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/702: read - d1/fd4 zero size 2024-09-13T21:40:26.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/703: getdents d1/d8/d16 0 2024-09-13T21:40:26.951 INFO:tasks.workunit.client.0.smithi088.stdout:8/640: write db/d26/d2c/d85/d51/f71 [7386204,92974] 0 2024-09-13T21:40:26.953 INFO:tasks.workunit.client.0.smithi088.stdout:4/655: unlink d2/d13/d50/c9f 0 2024-09-13T21:40:26.955 INFO:tasks.workunit.client.0.smithi088.stdout:3/737: dwrite d5/d23/d2a/d6b/f89 [4194304,4194304] 0 2024-09-13T21:40:26.955 INFO:tasks.workunit.client.0.smithi088.stdout:3/738: chown d5/d5a/l95 1 1 2024-09-13T21:40:26.955 INFO:tasks.workunit.client.0.smithi088.stdout:3/739: chown d5/d23/d2a/d6b/f89 37095 1 2024-09-13T21:40:26.957 INFO:tasks.workunit.client.0.smithi088.stdout:5/797: rmdir d4/d1c/d4a/d63 39 2024-09-13T21:40:26.957 INFO:tasks.workunit.client.0.smithi088.stdout:5/798: truncate d4/d1c/d24/d26/dbf/d89/fdb 5157635 0 2024-09-13T21:40:26.958 INFO:tasks.workunit.client.0.smithi088.stdout:1/686: link d9/d10/d2a/d4b/f21 d9/dc/d74/fef 0 2024-09-13T21:40:26.960 INFO:tasks.workunit.client.0.smithi088.stdout:2/704: creat d1/d13/d2a/d41/d82/fed x:0 0 0 2024-09-13T21:40:26.965 INFO:tasks.workunit.client.0.smithi088.stdout:0/709: dwrite d7/d2c/d30/d31/d42/d95/fc4 [0,4194304] 0 2024-09-13T21:40:26.965 INFO:tasks.workunit.client.0.smithi088.stdout:0/710: creat d7/d1d/d21/ff9 x:0 0 0 2024-09-13T21:40:26.965 INFO:tasks.workunit.client.0.smithi088.stdout:2/705: write d1/d8/d16/f7c [1829219,87746] 0 2024-09-13T21:40:26.966 INFO:tasks.workunit.client.0.smithi088.stdout:3/740: dread d5/d14/f29 [0,4194304] 0 2024-09-13T21:40:26.966 INFO:tasks.workunit.client.0.smithi088.stdout:4/656: getdents d2/d5/d20/d41/d4b 0 2024-09-13T21:40:26.967 INFO:tasks.workunit.client.0.smithi088.stdout:9/564: sync 2024-09-13T21:40:26.968 INFO:tasks.workunit.client.0.smithi088.stdout:3/741: write d5/d23/d2a/d3f/fa0 [2116,46275] 0 2024-09-13T21:40:26.969 INFO:tasks.workunit.client.0.smithi088.stdout:3/742: dread - d5/d23/d2a/fbd zero size 2024-09-13T21:40:26.969 INFO:tasks.workunit.client.0.smithi088.stdout:4/657: dread d2/d5/d20/d60/de/d1e/d31/f7d [0,4194304] 0 2024-09-13T21:40:26.979 INFO:tasks.workunit.client.0.smithi088.stdout:5/799: getdents d4/d1c/d24/d26/dbf/dc6 0 2024-09-13T21:40:26.979 INFO:tasks.workunit.client.0.smithi088.stdout:5/800: write d4/d1c/d4a/f50 [841941,30653] 0 2024-09-13T21:40:26.979 INFO:tasks.workunit.client.0.smithi088.stdout:5/801: stat d4/d1c/d4a/fa2 0 2024-09-13T21:40:26.979 INFO:tasks.workunit.client.0.smithi088.stdout:5/802: fsync d4/d1c/d24/d26/d4b/d67/f7f 0 2024-09-13T21:40:26.981 INFO:tasks.workunit.client.0.smithi088.stdout:1/687: mkdir d9/dc/d74/df0 0 2024-09-13T21:40:26.982 INFO:tasks.workunit.client.0.smithi088.stdout:8/641: getdents db/df/d61/d97 0 2024-09-13T21:40:26.984 INFO:tasks.workunit.client.0.smithi088.stdout:0/711: dread d7/d2c/d37/f59 [0,4194304] 0 2024-09-13T21:40:26.987 INFO:tasks.workunit.client.0.smithi088.stdout:3/743: mkdir d5/d23/d2a/d63/d48/d49/dd8/de5 0 2024-09-13T21:40:26.989 INFO:tasks.workunit.client.0.smithi088.stdout:8/642: truncate db/d26/d2c/db7/fbb 155494 0 2024-09-13T21:40:26.989 INFO:tasks.workunit.client.0.smithi088.stdout:8/643: creat db/d26/d2c/fdb x:0 0 0 2024-09-13T21:40:26.990 INFO:tasks.workunit.client.0.smithi088.stdout:0/712: getdents d7/d2c/d30 0 2024-09-13T21:40:26.991 INFO:tasks.workunit.client.0.smithi088.stdout:9/565: getdents d1a/d3c/d51 0 2024-09-13T21:40:26.993 INFO:tasks.workunit.client.0.smithi088.stdout:5/803: link d4/d1c/d24/d26/dbf/d89/fd9 d4/d1c/d24/d26/dbf/d89/d92/f104 0 2024-09-13T21:40:26.993 INFO:tasks.workunit.client.0.smithi088.stdout:5/804: write d4/d1c/d24/d95/f103 [894302,77785] 0 2024-09-13T21:40:26.993 INFO:tasks.workunit.client.0.smithi088.stdout:5/805: stat d4/d1c/d24/d26/d40/db6 0 2024-09-13T21:40:26.994 INFO:tasks.workunit.client.0.smithi088.stdout:5/806: read d4/d1c/d24/d26/d56/f91 [667154,45623] 0 2024-09-13T21:40:26.994 INFO:tasks.workunit.client.0.smithi088.stdout:5/807: creat d4/d1b/f105 x:0 0 0 2024-09-13T21:40:26.994 INFO:tasks.workunit.client.0.smithi088.stdout:0/713: mknod d7/d2c/d30/d31/d42/d4b/cfa 0 2024-09-13T21:40:26.996 INFO:tasks.workunit.client.0.smithi088.stdout:5/808: mknod d4/d1c/d24/d26/d4b/d67/c106 0 2024-09-13T21:40:26.997 INFO:tasks.workunit.client.0.smithi088.stdout:5/809: rename d4/d1c to d4/d1c/d24/d26/d40/d90/d107 22 2024-09-13T21:40:27.004 INFO:tasks.workunit.client.0.smithi088.stdout:8/644: dread db/f8f [0,4194304] 0 2024-09-13T21:40:27.004 INFO:tasks.workunit.client.0.smithi088.stdout:8/645: write db/f9b [417002,114243] 0 2024-09-13T21:40:27.004 INFO:tasks.workunit.client.0.smithi088.stdout:8/646: truncate db/df/f69 4605839 0 2024-09-13T21:40:27.022 INFO:tasks.workunit.client.0.smithi088.stdout:5/810: dwrite d4/da7/fee [0,4194304] 0 2024-09-13T21:40:27.038 INFO:tasks.workunit.client.0.smithi088.stdout:4/658: dwrite d2/d5/d2d/d70/fa1 [0,4194304] 0 2024-09-13T21:40:27.038 INFO:tasks.workunit.client.0.smithi088.stdout:4/659: write d2/d13/fa6 [1350301,41978] 0 2024-09-13T21:40:27.038 INFO:tasks.workunit.client.0.smithi088.stdout:4/660: chown d2/d5/d20/d60/de/d1e/d23/d3c/d65/f9c 0 1 2024-09-13T21:40:27.038 INFO:tasks.workunit.client.0.smithi088.stdout:4/661: fdatasync d2/d5/d20/d60/f97 0 2024-09-13T21:40:27.038 INFO:tasks.workunit.client.0.smithi088.stdout:4/662: dread - d2/d13/f77 zero size 2024-09-13T21:40:27.038 INFO:tasks.workunit.client.0.smithi088.stdout:2/706: dwrite d1/d13/f1a [0,4194304] 0 2024-09-13T21:40:27.038 INFO:tasks.workunit.client.0.smithi088.stdout:1/688: dwrite d9/d10/d2a/f8a [0,4194304] 0 2024-09-13T21:40:27.039 INFO:tasks.workunit.client.0.smithi088.stdout:0/714: unlink d7/c14 0 2024-09-13T21:40:27.041 INFO:tasks.workunit.client.0.smithi088.stdout:9/566: dread d1a/d1b/f37 [0,4194304] 0 2024-09-13T21:40:27.042 INFO:tasks.workunit.client.0.smithi088.stdout:6/718: sync 2024-09-13T21:40:27.042 INFO:tasks.workunit.client.0.smithi088.stdout:7/574: sync 2024-09-13T21:40:27.042 INFO:tasks.workunit.client.0.smithi088.stdout:6/719: fsync d0/d2c/fdc 0 2024-09-13T21:40:27.044 INFO:tasks.workunit.client.0.smithi088.stdout:4/663: rmdir d2/d5/d20/d60/de/d1e/d23/d69 39 2024-09-13T21:40:27.045 INFO:tasks.workunit.client.0.smithi088.stdout:4/664: truncate d2/d5/d20/d60/de/d1e/d31/f7d 4811684 0 2024-09-13T21:40:27.045 INFO:tasks.workunit.client.0.smithi088.stdout:4/665: write d2/d81/f82 [899954,38254] 0 2024-09-13T21:40:27.045 INFO:tasks.workunit.client.0.smithi088.stdout:4/666: stat d2/d13/d50/fcc 0 2024-09-13T21:40:27.045 INFO:tasks.workunit.client.0.smithi088.stdout:2/707: getdents d1/d13/d3f/d99/d9c 0 2024-09-13T21:40:27.045 INFO:tasks.workunit.client.0.smithi088.stdout:1/689: dread d9/d10/d2a/d4b/f2f [0,4194304] 0 2024-09-13T21:40:27.050 INFO:tasks.workunit.client.0.smithi088.stdout:0/715: mknod d7/d1d/d27/d43/cfb 0 2024-09-13T21:40:27.050 INFO:tasks.workunit.client.0.smithi088.stdout:7/575: mkdir d6/d5f/d69/d4f/d6f/d70/dbf 0 2024-09-13T21:40:27.052 INFO:tasks.workunit.client.0.smithi088.stdout:6/720: write d0/d2c/d59/fcb [796191,53111] 0 2024-09-13T21:40:27.055 INFO:tasks.workunit.client.0.smithi088.stdout:2/708: mkdir d1/d8/d2e/d91/dee 0 2024-09-13T21:40:27.056 INFO:tasks.workunit.client.0.smithi088.stdout:3/744: dwrite d5/d23/d2a/d6b/d98/da1/daa/d43/fb9 [0,4194304] 0 2024-09-13T21:40:27.056 INFO:tasks.workunit.client.0.smithi088.stdout:2/709: mknod d1/cef 0 2024-09-13T21:40:27.059 INFO:tasks.workunit.client.0.smithi088.stdout:3/745: symlink d5/d5a/le6 0 2024-09-13T21:40:27.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/576: dread d6/d5f/d81/f85 [0,4194304] 0 2024-09-13T21:40:27.062 INFO:tasks.workunit.client.0.smithi088.stdout:2/710: link d1/d13/d3f/d99/d9c/cd7 d1/d8/d24/d78/d7f/d85/cf0 0 2024-09-13T21:40:27.062 INFO:tasks.workunit.client.0.smithi088.stdout:2/711: chown d1/d8/d2e/d3b 474978675 1 2024-09-13T21:40:27.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/577: write d6/da/d1a/d3a/f3f [1625430,14193] 0 2024-09-13T21:40:27.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/578: truncate d6/d5f/d7a/f8e 5177667 0 2024-09-13T21:40:27.062 INFO:tasks.workunit.client.0.smithi088.stdout:5/811: dwrite d4/d1c/d24/d26/dbf/fae [4194304,4194304] 0 2024-09-13T21:40:27.063 INFO:tasks.workunit.client.0.smithi088.stdout:3/746: truncate d5/d23/d2a/d6b/d98/da1/daa/f70 2746874 0 2024-09-13T21:40:27.063 INFO:tasks.workunit.client.0.smithi088.stdout:8/647: dwrite db/df/da7/d88/fd7 [0,4194304] 0 2024-09-13T21:40:27.063 INFO:tasks.workunit.client.0.smithi088.stdout:8/648: chown db 13622464 1 2024-09-13T21:40:27.065 INFO:tasks.workunit.client.0.smithi088.stdout:2/712: rename d1/d13/d2a/d3c/d4a/d6e/d5b/d89/dcc/fdb to d1/d8/ff1 0 2024-09-13T21:40:27.068 INFO:tasks.workunit.client.0.smithi088.stdout:6/721: dread d0/d2c/f9c [0,4194304] 0 2024-09-13T21:40:27.073 INFO:tasks.workunit.client.0.smithi088.stdout:3/747: link d5/d23/d2a/d63/d48/d49/fa7 d5/d23/d2a/d6b/d98/ddc/fe7 0 2024-09-13T21:40:27.074 INFO:tasks.workunit.client.0.smithi088.stdout:8/649: dread db/df/f3d [4194304,4194304] 0 2024-09-13T21:40:27.077 INFO:tasks.workunit.client.0.smithi088.stdout:5/812: write d4/d1c/d76/fa8 [2373747,91242] 0 2024-09-13T21:40:27.077 INFO:tasks.workunit.client.0.smithi088.stdout:5/813: creat d4/d1c/d24/d95/f108 x:0 0 0 2024-09-13T21:40:27.078 INFO:tasks.workunit.client.0.smithi088.stdout:2/713: creat d1/d8/d2e/d91/dee/ff2 x:0 0 0 2024-09-13T21:40:27.078 INFO:tasks.workunit.client.0.smithi088.stdout:6/722: creat d0/d2c/d32/d39/d3f/fe2 x:0 0 0 2024-09-13T21:40:27.078 INFO:tasks.workunit.client.0.smithi088.stdout:6/723: write d0/d28/f80 [9077958,46295] 0 2024-09-13T21:40:27.081 INFO:tasks.workunit.client.0.smithi088.stdout:6/724: read d0/d1e/fd0 [60764,43148] 0 2024-09-13T21:40:27.081 INFO:tasks.workunit.client.0.smithi088.stdout:6/725: creat d0/d1e/fe3 x:0 0 0 2024-09-13T21:40:27.081 INFO:tasks.workunit.client.0.smithi088.stdout:6/726: write d0/d2c/d32/d39/faa [3592756,94614] 0 2024-09-13T21:40:27.081 INFO:tasks.workunit.client.0.smithi088.stdout:6/727: stat d0/d1e/d1f/f91 0 2024-09-13T21:40:27.088 INFO:tasks.workunit.client.0.smithi088.stdout:9/567: dwrite d1a/d3c/d51/d5e/f7c [0,4194304] 0 2024-09-13T21:40:27.089 INFO:tasks.workunit.client.0.smithi088.stdout:6/728: read d0/d1e/d1f/f70 [1163090,52486] 0 2024-09-13T21:40:27.091 INFO:tasks.workunit.client.0.smithi088.stdout:9/568: creat d1a/fab x:0 0 0 2024-09-13T21:40:27.091 INFO:tasks.workunit.client.0.smithi088.stdout:3/748: dread d5/d23/d2a/d3f/d76/db3/fa4 [0,4194304] 0 2024-09-13T21:40:27.092 INFO:tasks.workunit.client.0.smithi088.stdout:6/729: creat d0/d2c/d32/d39/d3f/d71/fe4 x:0 0 0 2024-09-13T21:40:27.093 INFO:tasks.workunit.client.0.smithi088.stdout:3/749: getdents d5/d23/d2a/d63/d48/d49/dd8 0 2024-09-13T21:40:27.094 INFO:tasks.workunit.client.0.smithi088.stdout:5/814: dread d4/d1c/d24/d26/dbf/d89/fdb [0,4194304] 0 2024-09-13T21:40:27.094 INFO:tasks.workunit.client.0.smithi088.stdout:5/815: write d4/d1b/faf [375268,125849] 0 2024-09-13T21:40:27.095 INFO:tasks.workunit.client.0.smithi088.stdout:6/730: getdents d0/d2c/d32 0 2024-09-13T21:40:27.095 INFO:tasks.workunit.client.0.smithi088.stdout:6/731: readlink d0/db/d37/ld6 0 2024-09-13T21:40:27.096 INFO:tasks.workunit.client.0.smithi088.stdout:6/732: truncate d0/d2c/d32/f6e 143226 0 2024-09-13T21:40:27.097 INFO:tasks.workunit.client.0.smithi088.stdout:3/750: dread d5/d23/d2a/d63/d31/f7c [0,4194304] 0 2024-09-13T21:40:27.097 INFO:tasks.workunit.client.0.smithi088.stdout:6/733: truncate d0/d28/f35 3683171 0 2024-09-13T21:40:27.099 INFO:tasks.workunit.client.0.smithi088.stdout:6/734: mknod d0/d1e/d1f/d55/ce5 0 2024-09-13T21:40:27.101 INFO:tasks.workunit.client.0.smithi088.stdout:0/716: dwrite d7/d2c/d30/d31/d42/fad [0,4194304] 0 2024-09-13T21:40:27.101 INFO:tasks.workunit.client.0.smithi088.stdout:6/735: rename d0/db/d37/c74 to d0/d1e/d1f/d55/d8f/ce6 0 2024-09-13T21:40:27.101 INFO:tasks.workunit.client.0.smithi088.stdout:1/690: dwrite d9/d10/d2a/d4b/d39/d43/f93 [0,4194304] 0 2024-09-13T21:40:27.102 INFO:tasks.workunit.client.0.smithi088.stdout:1/691: chown d9/d10/d2a/d4b/d39/l8c 4 1 2024-09-13T21:40:27.103 INFO:tasks.workunit.client.0.smithi088.stdout:0/717: creat d7/d2c/d30/dbe/dce/de1/ffc x:0 0 0 2024-09-13T21:40:27.104 INFO:tasks.workunit.client.0.smithi088.stdout:0/718: readlink d7/d1d/d66/d8b/dc0/lf0 0 2024-09-13T21:40:27.104 INFO:tasks.workunit.client.0.smithi088.stdout:0/719: chown d7/d1d/d26/d45/d7c 0 1 2024-09-13T21:40:27.106 INFO:tasks.workunit.client.0.smithi088.stdout:7/579: dwrite d6/da/fb [0,4194304] 0 2024-09-13T21:40:27.106 INFO:tasks.workunit.client.0.smithi088.stdout:7/580: write d6/da/f10 [1903991,44207] 0 2024-09-13T21:40:27.106 INFO:tasks.workunit.client.0.smithi088.stdout:8/650: dwrite db/d26/d2c/d85/f89 [0,4194304] 0 2024-09-13T21:40:27.107 INFO:tasks.workunit.client.0.smithi088.stdout:6/736: mknod d0/d1e/ce7 0 2024-09-13T21:40:27.107 INFO:tasks.workunit.client.0.smithi088.stdout:1/692: creat d9/dc/d74/ff1 x:0 0 0 2024-09-13T21:40:27.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/714: dwrite d1/d8/f4f [0,4194304] 0 2024-09-13T21:40:27.108 INFO:tasks.workunit.client.0.smithi088.stdout:2/715: write d1/d8/d16/f7c [3730648,102651] 0 2024-09-13T21:40:27.111 INFO:tasks.workunit.client.0.smithi088.stdout:7/581: creat d6/d5f/d69/da8/fc0 x:0 0 0 2024-09-13T21:40:27.112 INFO:tasks.workunit.client.0.smithi088.stdout:8/651: symlink db/d26/d2c/d85/dad/ldc 0 2024-09-13T21:40:27.115 INFO:tasks.workunit.client.0.smithi088.stdout:1/693: rename d9/d10/d2a/d4b/d33/d92/d8e/fa9 to d9/dc/d52/dba/d7d/ff2 0 2024-09-13T21:40:27.115 INFO:tasks.workunit.client.0.smithi088.stdout:1/694: read - d9/d4f/d64/fd3 zero size 2024-09-13T21:40:27.117 INFO:tasks.workunit.client.0.smithi088.stdout:2/716: truncate d1/d8/d24/f8a 1518640 0 2024-09-13T21:40:27.118 INFO:tasks.workunit.client.0.smithi088.stdout:7/582: symlink d6/da/lc1 0 2024-09-13T21:40:27.118 INFO:tasks.workunit.client.0.smithi088.stdout:6/737: dread d0/d2c/d7a/daf/dc7/fd1 [0,4194304] 0 2024-09-13T21:40:27.119 INFO:tasks.workunit.client.0.smithi088.stdout:6/738: truncate d0/db/f85 225903 0 2024-09-13T21:40:27.121 INFO:tasks.workunit.client.0.smithi088.stdout:8/652: mkdir db/df/da7/d88/ddd 0 2024-09-13T21:40:27.123 INFO:tasks.workunit.client.0.smithi088.stdout:2/717: creat d1/d13/d3f/d99/d9c/db1/dcd/ff3 x:0 0 0 2024-09-13T21:40:27.123 INFO:tasks.workunit.client.0.smithi088.stdout:0/720: dread d7/d1d/d27/f70 [0,4194304] 0 2024-09-13T21:40:27.125 INFO:tasks.workunit.client.0.smithi088.stdout:8/653: rmdir db/d26/d2c/d85 39 2024-09-13T21:40:27.127 INFO:tasks.workunit.client.0.smithi088.stdout:8/654: mknod db/d26/d2c/d85/d51/dca/cde 0 2024-09-13T21:40:27.130 INFO:tasks.workunit.client.0.smithi088.stdout:9/569: dwrite d1a/f31 [4194304,4194304] 0 2024-09-13T21:40:27.130 INFO:tasks.workunit.client.0.smithi088.stdout:9/570: fsync d1a/f31 0 2024-09-13T21:40:27.130 INFO:tasks.workunit.client.0.smithi088.stdout:9/571: write d1a/d1b/f53 [4843662,83754] 0 2024-09-13T21:40:27.131 INFO:tasks.workunit.client.0.smithi088.stdout:3/751: dwrite d5/d23/d2a/d3f/d8f/d91/fb0 [0,4194304] 0 2024-09-13T21:40:27.131 INFO:tasks.workunit.client.0.smithi088.stdout:3/752: chown d5/d14/f37 5122131 1 2024-09-13T21:40:27.131 INFO:tasks.workunit.client.0.smithi088.stdout:5/816: dwrite d4/d1c/d24/d26/d4b/d66/f77 [0,4194304] 0 2024-09-13T21:40:27.132 INFO:tasks.workunit.client.0.smithi088.stdout:8/655: rename db/df/da7/l34 to db/d26/d2c/d85/d51/ldf 0 2024-09-13T21:40:27.132 INFO:tasks.workunit.client.0.smithi088.stdout:8/656: chown db/df/da7/d88/da8/db4 1099622062 1 2024-09-13T21:40:27.136 INFO:tasks.workunit.client.0.smithi088.stdout:9/572: symlink d1a/d61/d3d/d41/d48/lac 0 2024-09-13T21:40:27.137 INFO:tasks.workunit.client.0.smithi088.stdout:7/583: write d6/d4e/f8f [3974739,63618] 0 2024-09-13T21:40:27.138 INFO:tasks.workunit.client.0.smithi088.stdout:7/584: write d6/da/d44/fbe [323467,48341] 0 2024-09-13T21:40:27.142 INFO:tasks.workunit.client.0.smithi088.stdout:6/739: read d0/d1e/d1f/f7b [7665701,78263] 0 2024-09-13T21:40:27.143 INFO:tasks.workunit.client.0.smithi088.stdout:8/657: rename db/d26/d2c/d85/d51/dca/dcb to db/df/de0 0 2024-09-13T21:40:27.143 INFO:tasks.workunit.client.0.smithi088.stdout:8/658: chown db/df/la0 23633 1 2024-09-13T21:40:27.145 INFO:tasks.workunit.client.0.smithi088.stdout:5/817: read d4/d1c/d4a/d63/d6a/d6d/fdd [2713851,15687] 0 2024-09-13T21:40:27.145 INFO:tasks.workunit.client.0.smithi088.stdout:5/818: creat d4/d1c/d24/d26/d56/f109 x:0 0 0 2024-09-13T21:40:27.145 INFO:tasks.workunit.client.0.smithi088.stdout:5/819: stat d4/d1b/d68 0 2024-09-13T21:40:27.145 INFO:tasks.workunit.client.0.smithi088.stdout:5/820: creat d4/d1b/f10a x:0 0 0 2024-09-13T21:40:27.148 INFO:tasks.workunit.client.0.smithi088.stdout:9/573: mknod d1a/d61/d3d/d41/d48/d86/d8e/cad 0 2024-09-13T21:40:27.152 INFO:tasks.workunit.client.0.smithi088.stdout:8/659: write db/df/da7/f28 [2761513,55389] 0 2024-09-13T21:40:27.152 INFO:tasks.workunit.client.0.smithi088.stdout:8/660: chown db/df/da7/d88/da8/db4/fbc 776574 1 2024-09-13T21:40:27.157 INFO:tasks.workunit.client.0.smithi088.stdout:6/740: rename d0/le to d0/d1e/d1f/d55/le8 0 2024-09-13T21:40:27.159 INFO:tasks.workunit.client.0.smithi088.stdout:0/721: dwrite d7/d2c/d37/f59 [0,4194304] 0 2024-09-13T21:40:27.162 INFO:tasks.workunit.client.0.smithi088.stdout:8/661: getdents db/d26/d4f 0 2024-09-13T21:40:27.162 INFO:tasks.workunit.client.0.smithi088.stdout:8/662: chown db/df/da7/daa/lcc 2031212620 1 2024-09-13T21:40:27.163 INFO:tasks.workunit.client.0.smithi088.stdout:2/718: dwrite d1/d8/fc [0,4194304] 0 2024-09-13T21:40:27.163 INFO:tasks.workunit.client.0.smithi088.stdout:3/753: dwrite d5/d23/d2a/d6b/f5d [0,4194304] 0 2024-09-13T21:40:27.164 INFO:tasks.workunit.client.0.smithi088.stdout:2/719: mknod d1/d13/d2a/d3c/d4a/d6e/d76/cf4 0 2024-09-13T21:40:27.168 INFO:tasks.workunit.client.0.smithi088.stdout:0/722: write d7/d1d/d26/d45/d7c/f86 [1646353,90115] 0 2024-09-13T21:40:27.170 INFO:tasks.workunit.client.0.smithi088.stdout:0/723: mknod d7/d1d/d26/cfd 0 2024-09-13T21:40:27.170 INFO:tasks.workunit.client.0.smithi088.stdout:0/724: truncate d7/d2c/d78/f7a 4730467 0 2024-09-13T21:40:27.172 INFO:tasks.workunit.client.0.smithi088.stdout:6/741: write d0/d2c/d7a/f9f [1066092,10751] 0 2024-09-13T21:40:27.172 INFO:tasks.workunit.client.0.smithi088.stdout:6/742: read d0/d2c/d59/fcb [4065394,86974] 0 2024-09-13T21:40:27.172 INFO:tasks.workunit.client.0.smithi088.stdout:6/743: creat d0/d1e/d1f/d55/d8f/fe9 x:0 0 0 2024-09-13T21:40:27.173 INFO:tasks.workunit.client.0.smithi088.stdout:7/585: dwrite d6/d4e/f7b [0,4194304] 0 2024-09-13T21:40:27.175 INFO:tasks.workunit.client.0.smithi088.stdout:9/574: dwrite d1a/d61/d3d/d41/f8a [0,4194304] 0 2024-09-13T21:40:27.175 INFO:tasks.workunit.client.0.smithi088.stdout:6/744: mkdir d0/d2c/d7a/dea 0 2024-09-13T21:40:27.177 INFO:tasks.workunit.client.0.smithi088.stdout:0/725: getdents d7/d1d/d66/d8b 0 2024-09-13T21:40:27.178 INFO:tasks.workunit.client.0.smithi088.stdout:3/754: dread d5/f13 [0,4194304] 0 2024-09-13T21:40:27.178 INFO:tasks.workunit.client.0.smithi088.stdout:3/755: write d5/d23/d2a/d6b/d98/da1/daa/f70 [3554309,52608] 0 2024-09-13T21:40:27.178 INFO:tasks.workunit.client.0.smithi088.stdout:3/756: write d5/d23/d2a/d6b/d98/ddc/fac [916762,92128] 0 2024-09-13T21:40:27.178 INFO:tasks.workunit.client.0.smithi088.stdout:2/720: write d1/d13/d2a/d3c/d4a/f7a [322779,108207] 0 2024-09-13T21:40:27.178 INFO:tasks.workunit.client.0.smithi088.stdout:7/586: creat d6/da/db7/fc2 x:0 0 0 2024-09-13T21:40:27.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/575: unlink d1a/c32 0 2024-09-13T21:40:27.182 INFO:tasks.workunit.client.0.smithi088.stdout:9/576: chown d1a/f5d 9181 1 2024-09-13T21:40:27.183 INFO:tasks.workunit.client.0.smithi088.stdout:8/663: dwrite db/d26/d2c/f78 [0,4194304] 0 2024-09-13T21:40:27.184 INFO:tasks.workunit.client.0.smithi088.stdout:6/745: getdents d0/d2c/d32/d39/d3f/d71/d81 0 2024-09-13T21:40:27.186 INFO:tasks.workunit.client.0.smithi088.stdout:0/726: rename d7/d2c/d30/c68 to d7/d1d/d27/cfe 0 2024-09-13T21:40:27.186 INFO:tasks.workunit.client.0.smithi088.stdout:0/727: write d7/d2c/d37/f7d [1799678,46249] 0 2024-09-13T21:40:27.192 INFO:tasks.workunit.client.0.smithi088.stdout:3/757: link d5/d23/d2a/d6b/d98/dcd/ld9 d5/d23/d2a/d6b/d98/dcd/le8 0 2024-09-13T21:40:27.195 INFO:tasks.workunit.client.0.smithi088.stdout:2/721: unlink d1/d13/d2a/d3c/d4a/f7a 0 2024-09-13T21:40:27.195 INFO:tasks.workunit.client.0.smithi088.stdout:2/722: getdents d1/d13/d3f/d99/d9c 0 2024-09-13T21:40:27.196 INFO:tasks.workunit.client.0.smithi088.stdout:7/587: symlink d6/da/d1a/d3a/d5c/lc3 0 2024-09-13T21:40:27.200 INFO:tasks.workunit.client.0.smithi088.stdout:0/728: write d7/d1d/d26/dcd/fde [3916059,128369] 0 2024-09-13T21:40:27.210 INFO:tasks.workunit.client.0.smithi088.stdout:6/746: unlink d0/d28/f78 0 2024-09-13T21:40:27.213 INFO:tasks.workunit.client.0.smithi088.stdout:2/723: link d1/d13/d2a/d3c/d4a/d6e/l80 d1/lf5 0 2024-09-13T21:40:27.213 INFO:tasks.workunit.client.0.smithi088.stdout:2/724: fdatasync d1/f77 0 2024-09-13T21:40:27.215 INFO:tasks.workunit.client.0.smithi088.stdout:0/729: mkdir d7/d1d/d3d/dae/dff 0 2024-09-13T21:40:27.215 INFO:tasks.workunit.client.0.smithi088.stdout:0/730: fsync d7/d1d/d27/f64 0 2024-09-13T21:40:27.217 INFO:tasks.workunit.client.0.smithi088.stdout:0/731: rename d7/d65/d8c/fdd to d7/d2c/d30/d31/d42/de2/f100 0 2024-09-13T21:40:27.217 INFO:tasks.workunit.client.0.smithi088.stdout:0/732: chown d7/d2c/l2d 23 1 2024-09-13T21:40:27.217 INFO:tasks.workunit.client.0.smithi088.stdout:0/733: fsync d7/d2c/d37/f6a 0 2024-09-13T21:40:27.217 INFO:tasks.workunit.client.0.smithi088.stdout:0/734: readlink d7/d1d/d3d/la0 0 2024-09-13T21:40:27.218 INFO:tasks.workunit.client.0.smithi088.stdout:0/735: truncate d7/d1d/d21/f80 8906165 0 2024-09-13T21:40:27.218 INFO:tasks.workunit.client.0.smithi088.stdout:0/736: chown d7/d2c/d30/d31/d42/fec 9292468 1 2024-09-13T21:40:27.223 INFO:tasks.workunit.client.0.smithi088.stdout:9/577: dwrite d1a/d3c/d60/f79 [0,4194304] 0 2024-09-13T21:40:27.226 INFO:tasks.workunit.client.0.smithi088.stdout:2/725: write d1/d8/fe [4063904,11257] 0 2024-09-13T21:40:27.226 INFO:tasks.workunit.client.0.smithi088.stdout:2/726: chown d1/d8/d24/d78/d7f/lb6 1150113832 1 2024-09-13T21:40:27.227 INFO:tasks.workunit.client.0.smithi088.stdout:2/727: mkdir d1/d13/d2a/d3c/d4a/d6e/d5b/d89/dcc/df6 0 2024-09-13T21:40:27.229 INFO:tasks.workunit.client.0.smithi088.stdout:2/728: symlink d1/d8/d24/d78/d7f/d85/lf7 0 2024-09-13T21:40:27.229 INFO:tasks.workunit.client.0.smithi088.stdout:0/737: write d7/d1d/d21/f4c [3929969,36724] 0 2024-09-13T21:40:27.231 INFO:tasks.workunit.client.0.smithi088.stdout:0/738: mkdir d7/d1d/d26/dcd/d101 0 2024-09-13T21:40:27.231 INFO:tasks.workunit.client.0.smithi088.stdout:8/664: dwrite db/d26/f48 [0,4194304] 0 2024-09-13T21:40:27.231 INFO:tasks.workunit.client.0.smithi088.stdout:3/758: dwrite d5/d23/d2a/d6b/d98/ddc/fe7 [0,4194304] 0 2024-09-13T21:40:27.231 INFO:tasks.workunit.client.0.smithi088.stdout:7/588: dwrite d6/d5f/d69/d4f/fae [0,4194304] 0 2024-09-13T21:40:27.232 INFO:tasks.workunit.client.0.smithi088.stdout:6/747: dwrite d0/d2c/d32/f6e [0,4194304] 0 2024-09-13T21:40:27.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:26 smithi088 ceph-mon[27963]: pgmap v253: 65 pgs: 65 active+clean; 1.2 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 125 MiB/s rd, 162 MiB/s wr, 688 op/s 2024-09-13T21:40:27.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:26 smithi088 ceph-mon[27963]: Standby manager daemon smithi116.bqnvtn restarted 2024-09-13T21:40:27.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:26 smithi088 ceph-mon[27963]: Standby manager daemon smithi116.bqnvtn started 2024-09-13T21:40:27.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:26 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/crt"}]: dispatch 2024-09-13T21:40:27.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:26 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:40:27.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:26 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/key"}]: dispatch 2024-09-13T21:40:27.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:26 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:40:27.233 INFO:tasks.workunit.client.0.smithi088.stdout:0/739: mkdir d7/d102 0 2024-09-13T21:40:27.234 INFO:tasks.workunit.client.0.smithi088.stdout:9/578: dread d1a/d61/d3d/f62 [0,4194304] 0 2024-09-13T21:40:27.234 INFO:tasks.workunit.client.0.smithi088.stdout:2/729: dread d1/d8/d24/d78/d7f/d85/f97 [0,4194304] 0 2024-09-13T21:40:27.234 INFO:tasks.workunit.client.0.smithi088.stdout:2/730: fsync d1/d8/d2e/d91/f95 0 2024-09-13T21:40:27.235 INFO:tasks.workunit.client.0.smithi088.stdout:6/748: read d0/d2c/d32/d39/d3f/f79 [2888410,50582] 0 2024-09-13T21:40:27.236 INFO:tasks.workunit.client.0.smithi088.stdout:8/665: symlink db/df/da7/daa/le1 0 2024-09-13T21:40:27.237 INFO:tasks.workunit.client.0.smithi088.stdout:3/759: mknod d5/d23/d2a/d6b/d98/ce9 0 2024-09-13T21:40:27.237 INFO:tasks.workunit.client.0.smithi088.stdout:3/760: creat d5/d23/d2a/d6b/d98/fea x:0 0 0 2024-09-13T21:40:27.239 INFO:tasks.workunit.client.0.smithi088.stdout:7/589: mknod d6/d5f/d69/d45/cc4 0 2024-09-13T21:40:27.242 INFO:tasks.workunit.client.0.smithi088.stdout:0/740: unlink d7/d1d/d21/c9f 0 2024-09-13T21:40:27.243 INFO:tasks.workunit.client.0.smithi088.stdout:9/579: dread d1a/d61/d3d/d41/f8a [0,4194304] 0 2024-09-13T21:40:27.246 INFO:tasks.workunit.client.0.smithi088.stdout:2/731: rmdir d1/d8/d24/db4 0 2024-09-13T21:40:27.250 INFO:tasks.workunit.client.0.smithi088.stdout:7/590: dread d6/da/f31 [4194304,4194304] 0 2024-09-13T21:40:27.250 INFO:tasks.workunit.client.0.smithi088.stdout:3/761: getdents d5/d23/d2a/d6b/d98/dcd 0 2024-09-13T21:40:27.250 INFO:tasks.workunit.client.0.smithi088.stdout:3/762: stat d5/d23/d2a/d6b/d8b/fbf 0 2024-09-13T21:40:27.253 INFO:tasks.workunit.client.0.smithi088.stdout:4/667: sync 2024-09-13T21:40:27.253 INFO:tasks.workunit.client.0.smithi088.stdout:7/591: rmdir d6/d5f/d69/d4f/d6f/d83 39 2024-09-13T21:40:27.256 INFO:tasks.workunit.client.0.smithi088.stdout:9/580: link d1a/c39 d1a/d9e/cae 0 2024-09-13T21:40:27.258 INFO:tasks.workunit.client.0.smithi088.stdout:4/668: mknod d2/d5/d20/d60/de/d1e/d31/d61/d99/cd9 0 2024-09-13T21:40:27.259 INFO:tasks.workunit.client.0.smithi088.stdout:4/669: chown d2/d5/d20/d60/de/d1e/fa0 16017733 1 2024-09-13T21:40:27.259 INFO:tasks.workunit.client.0.smithi088.stdout:4/670: stat d2/d5/l6d 0 2024-09-13T21:40:27.260 INFO:tasks.workunit.client.0.smithi088.stdout:9/581: symlink d1a/d3c/laf 0 2024-09-13T21:40:27.260 INFO:tasks.workunit.client.0.smithi088.stdout:9/582: readlink d1a/d61/d3d/d41/l8f 0 2024-09-13T21:40:27.269 INFO:tasks.workunit.client.0.smithi088.stdout:6/749: dwrite d0/d2c/d32/d39/faa [0,4194304] 0 2024-09-13T21:40:27.270 INFO:tasks.workunit.client.0.smithi088.stdout:1/695: sync 2024-09-13T21:40:27.270 INFO:tasks.workunit.client.0.smithi088.stdout:1/696: chown d9/d10/d2a/d47/d9c/cd1 4 1 2024-09-13T21:40:27.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/697: creat d9/d10/d2a/d4b/d3a/dcd/ff3 x:0 0 0 2024-09-13T21:40:27.272 INFO:tasks.workunit.client.0.smithi088.stdout:1/698: creat d9/d10/d2a/d4b/d3a/ff4 x:0 0 0 2024-09-13T21:40:27.275 INFO:tasks.workunit.client.0.smithi088.stdout:1/699: link d9/d4f/d64/fd3 d9/dc/d52/dba/d7d/ff5 0 2024-09-13T21:40:27.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/700: creat d9/d10/d2a/d4b/d33/dad/dbb/ff6 x:0 0 0 2024-09-13T21:40:27.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/701: truncate d9/d10/d9f/fb4 32179 0 2024-09-13T21:40:27.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/702: readlink d9/d10/d2a/d4b/d3a/l4e 0 2024-09-13T21:40:27.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/703: stat d9/d10/d2a/d4b/d39/l8c 0 2024-09-13T21:40:27.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/704: creat d9/d10/d2a/d4b/d33/ff7 x:0 0 0 2024-09-13T21:40:27.276 INFO:tasks.workunit.client.0.smithi088.stdout:1/705: creat d9/d10/d2a/d4b/d33/dad/ff8 x:0 0 0 2024-09-13T21:40:27.277 INFO:tasks.workunit.client.0.smithi088.stdout:1/706: chown d9/l6b 263112277 1 2024-09-13T21:40:27.277 INFO:tasks.workunit.client.0.smithi088.stdout:1/707: chown d9/d10/d2a/d4b/d39/d43/lde 6 1 2024-09-13T21:40:27.281 INFO:tasks.workunit.client.0.smithi088.stdout:1/708: rename d9/dc/d52/dba/d7d/f80 to d9/d10/d2a/d4b/d3a/ff9 0 2024-09-13T21:40:27.282 INFO:tasks.workunit.client.0.smithi088.stdout:1/709: unlink d9/d10/d2a/d4b/f28 0 2024-09-13T21:40:27.282 INFO:tasks.workunit.client.0.smithi088.stdout:1/710: chown d9/dc/l22 9 1 2024-09-13T21:40:27.283 INFO:tasks.workunit.client.0.smithi088.stdout:1/711: link d9/d10/d2a/d47/d9c/lc7 d9/d4f/d64/lfa 0 2024-09-13T21:40:27.283 INFO:tasks.workunit.client.0.smithi088.stdout:1/712: rmdir d9/d10/d2a/d4b/d39/d43 39 2024-09-13T21:40:27.284 INFO:tasks.workunit.client.0.smithi088.stdout:8/666: dwrite db/d26/d2c/d85/f5c [0,4194304] 0 2024-09-13T21:40:27.284 INFO:tasks.workunit.client.0.smithi088.stdout:0/741: dwrite d7/d2c/f2e [4194304,4194304] 0 2024-09-13T21:40:27.285 INFO:tasks.workunit.client.0.smithi088.stdout:0/742: chown d7/c6b 833614 1 2024-09-13T21:40:27.285 INFO:tasks.workunit.client.0.smithi088.stdout:1/713: mkdir d9/d10/d2a/d4b/d39/d43/dfb 0 2024-09-13T21:40:27.288 INFO:tasks.workunit.client.0.smithi088.stdout:8/667: creat db/fe2 x:0 0 0 2024-09-13T21:40:27.288 INFO:tasks.workunit.client.0.smithi088.stdout:8/668: chown db/df/f65 51 1 2024-09-13T21:40:27.288 INFO:tasks.workunit.client.0.smithi088.stdout:8/669: stat db/d26/d4f/cb6 0 2024-09-13T21:40:27.288 INFO:tasks.workunit.client.0.smithi088.stdout:8/670: write db/d26/d2c/fdb [272448,29942] 0 2024-09-13T21:40:27.288 INFO:tasks.workunit.client.0.smithi088.stdout:1/714: mknod d9/d10/d2a/d4b/d33/dad/cfc 0 2024-09-13T21:40:27.288 INFO:tasks.workunit.client.0.smithi088.stdout:1/715: stat d9/d10/d2a/d47/d9c/db5/de6 0 2024-09-13T21:40:27.288 INFO:tasks.workunit.client.0.smithi088.stdout:1/716: dread - d9/d10/d2a/d4b/d3a/ff4 zero size 2024-09-13T21:40:27.288 INFO:tasks.workunit.client.0.smithi088.stdout:8/671: truncate db/d26/d2c/f5a 772800 0 2024-09-13T21:40:27.289 INFO:tasks.workunit.client.0.smithi088.stdout:8/672: symlink db/d26/d37/le3 0 2024-09-13T21:40:27.289 INFO:tasks.workunit.client.0.smithi088.stdout:8/673: chown db/d26/d37/d7d/fc8 0 1 2024-09-13T21:40:27.292 INFO:tasks.workunit.client.0.smithi088.stdout:8/674: dread db/d26/d2c/db7/fbb [0,4194304] 0 2024-09-13T21:40:27.299 INFO:tasks.workunit.client.0.smithi088.stdout:1/717: dread d9/f60 [0,4194304] 0 2024-09-13T21:40:27.299 INFO:tasks.workunit.client.0.smithi088.stdout:2/732: dwrite d1/f10 [0,4194304] 0 2024-09-13T21:40:27.299 INFO:tasks.workunit.client.0.smithi088.stdout:3/763: dwrite d5/d23/d2a/d3f/db4/fe1 [0,4194304] 0 2024-09-13T21:40:27.300 INFO:tasks.workunit.client.0.smithi088.stdout:1/718: mknod d9/d10/d2a/d4b/d3a/cfd 0 2024-09-13T21:40:27.301 INFO:tasks.workunit.client.0.smithi088.stdout:2/733: creat d1/d8/d2e/d91/ff8 x:0 0 0 2024-09-13T21:40:27.303 INFO:tasks.workunit.client.0.smithi088.stdout:3/764: mknod d5/d23/d2a/d6b/d98/ceb 0 2024-09-13T21:40:27.303 INFO:tasks.workunit.client.0.smithi088.stdout:1/719: truncate d9/d4f/faa 66203 0 2024-09-13T21:40:27.304 INFO:tasks.workunit.client.0.smithi088.stdout:1/720: truncate d9/d10/d2a/d4b/d3a/ff4 734851 0 2024-09-13T21:40:27.304 INFO:tasks.workunit.client.0.smithi088.stdout:2/734: dread d1/d8/d24/d78/d7f/d85/f97 [0,4194304] 0 2024-09-13T21:40:27.304 INFO:tasks.workunit.client.0.smithi088.stdout:2/735: write d1/d8/d24/d78/d7f/fd6 [946432,70228] 0 2024-09-13T21:40:27.304 INFO:tasks.workunit.client.0.smithi088.stdout:1/721: truncate d9/f14 1542622 0 2024-09-13T21:40:27.306 INFO:tasks.workunit.client.0.smithi088.stdout:4/671: dwrite d2/d5/d20/d60/de/d1e/d23/d3c/d65/f9c [0,4194304] 0 2024-09-13T21:40:27.308 INFO:tasks.workunit.client.0.smithi088.stdout:1/722: dread d9/d10/d2a/d4b/d33/d92/dbe/fcb [0,4194304] 0 2024-09-13T21:40:27.308 INFO:tasks.workunit.client.0.smithi088.stdout:9/583: dwrite d1a/d3c/d51/f83 [0,4194304] 0 2024-09-13T21:40:27.310 INFO:tasks.workunit.client.0.smithi088.stdout:0/743: dwrite d7/d2c/d30/d31/d42/d95/f9a [0,4194304] 0 2024-09-13T21:40:27.310 INFO:tasks.workunit.client.0.smithi088.stdout:0/744: chown d7/d2c/d37/fbf 32724 1 2024-09-13T21:40:27.311 INFO:tasks.workunit.client.0.smithi088.stdout:1/723: mkdir d9/d10/d9f/dfe 0 2024-09-13T21:40:27.314 INFO:tasks.workunit.client.0.smithi088.stdout:3/765: dread d5/d23/d2a/d63/d48/d49/f53 [0,4194304] 0 2024-09-13T21:40:27.314 INFO:tasks.workunit.client.0.smithi088.stdout:6/750: dwrite d0/d1e/d1f/f4d [0,4194304] 0 2024-09-13T21:40:27.316 INFO:tasks.workunit.client.0.smithi088.stdout:9/584: creat d1a/d3c/d51/d5e/fb0 x:0 0 0 2024-09-13T21:40:27.319 INFO:tasks.workunit.client.0.smithi088.stdout:0/745: dread d7/d1d/d21/d82/dca/fcb [4194304,4194304] 0 2024-09-13T21:40:27.319 INFO:tasks.workunit.client.0.smithi088.stdout:0/746: readlink d7/d2c/d30/d31/l7e 0 2024-09-13T21:40:27.321 INFO:tasks.workunit.client.0.smithi088.stdout:1/724: dread d9/d10/d2a/fa1 [0,4194304] 0 2024-09-13T21:40:27.327 INFO:tasks.workunit.client.0.smithi088.stdout:0/747: write d7/d1d/d26/d45/fac [4596153,49579] 0 2024-09-13T21:40:27.327 INFO:tasks.workunit.client.0.smithi088.stdout:3/766: rmdir d5/d23/d2a/d63/d48/d49/dd8/de5 0 2024-09-13T21:40:27.327 INFO:tasks.workunit.client.0.smithi088.stdout:3/767: dread - d5/d23/d2a/d6b/d98/fea zero size 2024-09-13T21:40:27.328 INFO:tasks.workunit.client.0.smithi088.stdout:3/768: write d5/d14/fc6 [833218,15971] 0 2024-09-13T21:40:27.329 INFO:tasks.workunit.client.0.smithi088.stdout:6/751: truncate d0/f22 5866152 0 2024-09-13T21:40:27.329 INFO:tasks.workunit.client.0.smithi088.stdout:6/752: chown d0/d1e/d1f/d55/d96/d98/cbf 2508898 1 2024-09-13T21:40:27.331 INFO:tasks.workunit.client.0.smithi088.stdout:2/736: dwrite d1/f10 [0,4194304] 0 2024-09-13T21:40:27.331 INFO:tasks.workunit.client.0.smithi088.stdout:2/737: chown d1/d13/d2a/d3c/d4a/d6e/d5b/dc3 3642 1 2024-09-13T21:40:27.331 INFO:tasks.workunit.client.0.smithi088.stdout:9/585: rename d1a/d3c/c88 to d1a/d1b/d3f/cb1 0 2024-09-13T21:40:27.332 INFO:tasks.workunit.client.0.smithi088.stdout:1/725: truncate d9/d10/d2a/d4b/d61/f6a 2169746 0 2024-09-13T21:40:27.332 INFO:tasks.workunit.client.0.smithi088.stdout:1/726: write d9/d10/d2a/d4b/d39/d43/db2/fee [4589784,42513] 0 2024-09-13T21:40:27.333 INFO:tasks.workunit.client.0.smithi088.stdout:8/675: truncate db/d26/d2c/d85/f5c 3402237 0 2024-09-13T21:40:27.333 INFO:tasks.workunit.client.0.smithi088.stdout:8/676: dread - db/d26/d37/d7d/fac zero size 2024-09-13T21:40:27.340 INFO:tasks.workunit.client.0.smithi088.stdout:3/769: rename d5/d14/f29 to d5/d23/d2a/d6b/d9e/fec 0 2024-09-13T21:40:27.342 INFO:tasks.workunit.client.0.smithi088.stdout:1/727: mkdir d9/d10/dff 0 2024-09-13T21:40:27.343 INFO:tasks.workunit.client.0.smithi088.stdout:8/677: mknod db/df/da7/ce4 0 2024-09-13T21:40:27.345 INFO:tasks.workunit.client.0.smithi088.stdout:1/728: mkdir d9/d10/d2a/d4b/d39/d43/d85/d100 0 2024-09-13T21:40:27.346 INFO:tasks.workunit.client.0.smithi088.stdout:0/748: dread d7/d1d/d26/d45/fac [0,4194304] 0 2024-09-13T21:40:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:26 smithi116 ceph-mon[33391]: pgmap v253: 65 pgs: 65 active+clean; 1.2 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 125 MiB/s rd, 162 MiB/s wr, 688 op/s 2024-09-13T21:40:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:26 smithi116 ceph-mon[33391]: Standby manager daemon smithi116.bqnvtn restarted 2024-09-13T21:40:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:26 smithi116 ceph-mon[33391]: Standby manager daemon smithi116.bqnvtn started 2024-09-13T21:40:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:26 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/crt"}]: dispatch 2024-09-13T21:40:27.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:26 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:40:27.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:26 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/key"}]: dispatch 2024-09-13T21:40:27.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:26 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:40:27.347 INFO:tasks.workunit.client.0.smithi088.stdout:8/678: mknod db/df/da7/daa/ce5 0 2024-09-13T21:40:27.347 INFO:tasks.workunit.client.0.smithi088.stdout:0/749: dread d7/d2c/d30/d31/d42/d4b/f85 [0,4194304] 0 2024-09-13T21:40:27.348 INFO:tasks.workunit.client.0.smithi088.stdout:0/750: chown d7/d2c/d37/ff1 7302777 1 2024-09-13T21:40:27.348 INFO:tasks.workunit.client.0.smithi088.stdout:2/738: read d1/f34 [1609950,92753] 0 2024-09-13T21:40:27.350 INFO:tasks.workunit.client.0.smithi088.stdout:0/751: symlink d7/d1d/d21/d82/l103 0 2024-09-13T21:40:27.352 INFO:tasks.workunit.client.0.smithi088.stdout:2/739: creat d1/d8/d2e/d3b/ff9 x:0 0 0 2024-09-13T21:40:27.352 INFO:tasks.workunit.client.0.smithi088.stdout:6/753: dwrite d0/db/f2e [0,4194304] 0 2024-09-13T21:40:27.352 INFO:tasks.workunit.client.0.smithi088.stdout:6/754: chown d0/db/c7e 6 1 2024-09-13T21:40:27.353 INFO:tasks.workunit.client.0.smithi088.stdout:9/586: dwrite d1a/d3c/d51/f52 [0,4194304] 0 2024-09-13T21:40:27.354 INFO:tasks.workunit.client.0.smithi088.stdout:9/587: chown d1a/l2c 0 1 2024-09-13T21:40:27.355 INFO:tasks.workunit.client.0.smithi088.stdout:0/752: creat d7/d1d/d26/d45/d7c/f104 x:0 0 0 2024-09-13T21:40:27.355 INFO:tasks.workunit.client.0.smithi088.stdout:0/753: chown d7/d2c/d30/d31/d42/de2/c84 1536542 1 2024-09-13T21:40:27.356 INFO:tasks.workunit.client.0.smithi088.stdout:9/588: write d1a/d1b/d3f/f55 [701945,17315] 0 2024-09-13T21:40:27.357 INFO:tasks.workunit.client.0.smithi088.stdout:2/740: unlink d1/d8/la 0 2024-09-13T21:40:27.358 INFO:tasks.workunit.client.0.smithi088.stdout:6/755: symlink d0/d2c/d7f/db1/leb 0 2024-09-13T21:40:27.358 INFO:tasks.workunit.client.0.smithi088.stdout:8/679: write db/f1a [3869344,101688] 0 2024-09-13T21:40:27.358 INFO:tasks.workunit.client.0.smithi088.stdout:6/756: readlink d0/l19 0 2024-09-13T21:40:27.358 INFO:tasks.workunit.client.0.smithi088.stdout:8/680: stat db/d26/d2c/d85/dad 0 2024-09-13T21:40:27.359 INFO:tasks.workunit.client.0.smithi088.stdout:6/757: fdatasync d0/d1e/d1f/fa2 0 2024-09-13T21:40:27.360 INFO:tasks.workunit.client.0.smithi088.stdout:0/754: unlink d7/d1d/d21/d82/f87 0 2024-09-13T21:40:27.361 INFO:tasks.workunit.client.0.smithi088.stdout:9/589: mkdir d1a/d3c/d51/db2 0 2024-09-13T21:40:27.361 INFO:tasks.workunit.client.0.smithi088.stdout:9/590: chown f17 8 1 2024-09-13T21:40:27.362 INFO:tasks.workunit.client.0.smithi088.stdout:2/741: mknod d1/d13/d3f/d99/d9c/db1/dcd/d9e/cfa 0 2024-09-13T21:40:27.363 INFO:tasks.workunit.client.0.smithi088.stdout:0/755: link d7/d2c/d30/cf5 d7/d65/dd4/c105 0 2024-09-13T21:40:27.363 INFO:tasks.workunit.client.0.smithi088.stdout:0/756: stat d7/d1d/d26/d45/d7c/f94 0 2024-09-13T21:40:27.365 INFO:tasks.workunit.client.0.smithi088.stdout:9/591: symlink d1a/d1b/d3f/lb3 0 2024-09-13T21:40:27.365 INFO:tasks.workunit.client.0.smithi088.stdout:0/757: mknod d7/d1d/d26/c106 0 2024-09-13T21:40:27.365 INFO:tasks.workunit.client.0.smithi088.stdout:0/758: chown d7/d1d/d26/d45/l7f 1674874 1 2024-09-13T21:40:27.366 INFO:tasks.workunit.client.0.smithi088.stdout:0/759: mkdir d7/d65/d8c/deb/d107 0 2024-09-13T21:40:27.373 INFO:tasks.workunit.client.0.smithi088.stdout:1/729: dwrite d9/dc/f71 [0,4194304] 0 2024-09-13T21:40:27.376 INFO:tasks.workunit.client.0.smithi088.stdout:5/821: sync 2024-09-13T21:40:27.377 INFO:tasks.workunit.client.0.smithi088.stdout:1/730: rename d9/d10/d2a/d4b/c45 to d9/dc/d52/dba/c101 0 2024-09-13T21:40:27.377 INFO:tasks.workunit.client.0.smithi088.stdout:1/731: truncate d9/d10/d2a/d4b/d39/d43/f94 4901265 0 2024-09-13T21:40:27.381 INFO:tasks.workunit.client.0.smithi088.stdout:3/770: dwrite d5/f21 [0,4194304] 0 2024-09-13T21:40:27.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/592: dread d1a/d1b/f2e [0,4194304] 0 2024-09-13T21:40:27.381 INFO:tasks.workunit.client.0.smithi088.stdout:5/822: rename d4/d1c/d24/d26/dbf/d89/c9d to d4/d1c/d24/d26/d40/d90/c10b 0 2024-09-13T21:40:27.381 INFO:tasks.workunit.client.0.smithi088.stdout:5/823: readlink d4/d1b/l37 0 2024-09-13T21:40:27.386 INFO:tasks.workunit.client.0.smithi088.stdout:9/593: rename d1a/d1b/d3f/lb3 to d1a/d3c/d51/db2/lb4 0 2024-09-13T21:40:27.386 INFO:tasks.workunit.client.0.smithi088.stdout:9/594: chown d1a/d3c/d60/fa2 223376569 1 2024-09-13T21:40:27.387 INFO:tasks.workunit.client.0.smithi088.stdout:5/824: mknod d4/d1c/d24/d26/d4b/d67/c10c 0 2024-09-13T21:40:27.387 INFO:tasks.workunit.client.0.smithi088.stdout:5/825: stat d4/d1c/d24/d26/dbf/d89/da3/fff 0 2024-09-13T21:40:27.389 INFO:tasks.workunit.client.0.smithi088.stdout:3/771: rename d5/cbc to d5/d23/d2a/d3f/d76/d81/ced 0 2024-09-13T21:40:27.390 INFO:tasks.workunit.client.0.smithi088.stdout:5/826: unlink d4/d1c/d24/d26/d4b/c5b 0 2024-09-13T21:40:27.391 INFO:tasks.workunit.client.0.smithi088.stdout:3/772: rmdir d5/d23/d2a/d6b/d98/da1 39 2024-09-13T21:40:27.401 INFO:tasks.workunit.client.0.smithi088.stdout:8/681: dwrite db/d26/f35 [0,4194304] 0 2024-09-13T21:40:27.401 INFO:tasks.workunit.client.0.smithi088.stdout:2/742: dwrite d1/d13/f2c [0,4194304] 0 2024-09-13T21:40:27.401 INFO:tasks.workunit.client.0.smithi088.stdout:8/682: fdatasync db/f6b 0 2024-09-13T21:40:27.401 INFO:tasks.workunit.client.0.smithi088.stdout:8/683: readlink db/d26/d2c/d85/lbe 0 2024-09-13T21:40:27.401 INFO:tasks.workunit.client.0.smithi088.stdout:8/684: write db/d26/d2c/f5a [951153,90484] 0 2024-09-13T21:40:27.401 INFO:tasks.workunit.client.0.smithi088.stdout:8/685: chown db/d26/d2c/d85/dad 113474542 1 2024-09-13T21:40:27.404 INFO:tasks.workunit.client.0.smithi088.stdout:3/773: dread f0 [0,4194304] 0 2024-09-13T21:40:27.404 INFO:tasks.workunit.client.0.smithi088.stdout:1/732: dwrite d9/d10/d2a/d4b/d33/dad/ff8 [0,4194304] 0 2024-09-13T21:40:27.408 INFO:tasks.workunit.client.0.smithi088.stdout:8/686: dread db/d26/f2b [4194304,4194304] 0 2024-09-13T21:40:27.409 INFO:tasks.workunit.client.0.smithi088.stdout:1/733: unlink d9/d10/d2a/d47/d9c/lc2 0 2024-09-13T21:40:27.410 INFO:tasks.workunit.client.0.smithi088.stdout:9/595: dwrite d1a/d3c/d51/d5e/fb0 [0,4194304] 0 2024-09-13T21:40:27.410 INFO:tasks.workunit.client.0.smithi088.stdout:9/596: chown d1a/d1b/f2d 2569 1 2024-09-13T21:40:27.410 INFO:tasks.workunit.client.0.smithi088.stdout:9/597: write f18 [2571180,108190] 0 2024-09-13T21:40:27.410 INFO:tasks.workunit.client.0.smithi088.stdout:9/598: dread - d1a/d61/d3d/d41/d48/d86/d97/f98 zero size 2024-09-13T21:40:27.410 INFO:tasks.workunit.client.0.smithi088.stdout:9/599: readlink d1a/d61/d3d/l7b 0 2024-09-13T21:40:27.411 INFO:tasks.workunit.client.0.smithi088.stdout:5/827: dwrite d4/da7/ff1 [0,4194304] 0 2024-09-13T21:40:27.411 INFO:tasks.workunit.client.0.smithi088.stdout:3/774: symlink d5/d23/d2a/d6b/d98/da1/lee 0 2024-09-13T21:40:27.412 INFO:tasks.workunit.client.0.smithi088.stdout:2/743: symlink d1/d8/d2e/d91/lfb 0 2024-09-13T21:40:27.413 INFO:tasks.workunit.client.0.smithi088.stdout:1/734: mkdir d9/d10/dff/d102 0 2024-09-13T21:40:27.419 INFO:tasks.workunit.client.0.smithi088.stdout:3/775: mknod d5/d23/d2a/d63/d31/cef 0 2024-09-13T21:40:27.421 INFO:tasks.workunit.client.0.smithi088.stdout:2/744: read d1/d8/d24/d78/fe0 [14956,46678] 0 2024-09-13T21:40:27.421 INFO:tasks.workunit.client.0.smithi088.stdout:9/600: dread d1a/d3c/d60/f79 [0,4194304] 0 2024-09-13T21:40:27.421 INFO:tasks.workunit.client.0.smithi088.stdout:1/735: creat d9/d10/d2a/d47/d9c/db5/de6/f103 x:0 0 0 2024-09-13T21:40:27.421 INFO:tasks.workunit.client.0.smithi088.stdout:1/736: read - d9/d10/d2a/d47/d9c/db5/de6/f103 zero size 2024-09-13T21:40:27.422 INFO:tasks.workunit.client.0.smithi088.stdout:5/828: write d4/d1c/d24/d26/d40/fa [1970328,12313] 0 2024-09-13T21:40:27.422 INFO:tasks.workunit.client.0.smithi088.stdout:3/776: rename d5/d14/fc8 to d5/d23/d2a/d3f/d76/ff0 0 2024-09-13T21:40:27.424 INFO:tasks.workunit.client.0.smithi088.stdout:8/687: dwrite db/df/d61/f63 [0,4194304] 0 2024-09-13T21:40:27.424 INFO:tasks.workunit.client.0.smithi088.stdout:9/601: rmdir d1a/d1b/d3f 39 2024-09-13T21:40:27.427 INFO:tasks.workunit.client.0.smithi088.stdout:5/829: creat d4/d1c/d24/d26/dbf/d89/dc9/dd1/f10d x:0 0 0 2024-09-13T21:40:27.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/745: rename d1/d8/d2e/d91/db3/dcf to d1/d13/d3f/d99/d9c/db1/dfc 0 2024-09-13T21:40:27.431 INFO:tasks.workunit.client.0.smithi088.stdout:2/746: stat d1/d13/d2a/d41/d48/f83 0 2024-09-13T21:40:27.435 INFO:tasks.workunit.client.0.smithi088.stdout:8/688: creat db/df/da7/fe6 x:0 0 0 2024-09-13T21:40:27.435 INFO:tasks.workunit.client.0.smithi088.stdout:8/689: chown db/df/da7/d88/da8/db4/fbc 446 1 2024-09-13T21:40:27.436 INFO:tasks.workunit.client.0.smithi088.stdout:8/690: write db/d26/fa5 [1646160,78470] 0 2024-09-13T21:40:27.436 INFO:tasks.workunit.client.0.smithi088.stdout:8/691: truncate db/f8f 5036955 0 2024-09-13T21:40:27.437 INFO:tasks.workunit.client.0.smithi088.stdout:9/602: creat d1a/fb5 x:0 0 0 2024-09-13T21:40:27.437 INFO:tasks.workunit.client.0.smithi088.stdout:9/603: write d1a/d1b/f5c [423598,41668] 0 2024-09-13T21:40:27.442 INFO:tasks.workunit.client.0.smithi088.stdout:2/747: rename d1/d8/d2e/d91/dee/ff2 to d1/d13/d3f/ffd 0 2024-09-13T21:40:27.446 INFO:tasks.workunit.client.0.smithi088.stdout:9/604: truncate d1a/d61/d3d/d41/d48/f4f 45049 0 2024-09-13T21:40:27.455 INFO:tasks.workunit.client.0.smithi088.stdout:9/605: symlink d1a/d61/lb6 0 2024-09-13T21:40:27.457 INFO:tasks.workunit.client.0.smithi088.stdout:9/606: symlink d1a/d61/d3d/d41/d48/d86/lb7 0 2024-09-13T21:40:27.458 INFO:tasks.workunit.client.0.smithi088.stdout:3/777: dwrite d5/d23/fc9 [0,4194304] 0 2024-09-13T21:40:27.458 INFO:tasks.workunit.client.0.smithi088.stdout:3/778: chown d5/d23/d2a/d63/d48/d49/c67 112 1 2024-09-13T21:40:27.459 INFO:tasks.workunit.client.0.smithi088.stdout:9/607: mknod d1a/d61/d3d/d75/cb8 0 2024-09-13T21:40:27.460 INFO:tasks.workunit.client.0.smithi088.stdout:5/830: dwrite d4/d1c/d4a/d63/d6a/f6b [0,4194304] 0 2024-09-13T21:40:27.463 INFO:tasks.workunit.client.0.smithi088.stdout:5/831: mkdir d4/d1c/d24/d26/dbf/dc6/d10e 0 2024-09-13T21:40:27.466 INFO:tasks.workunit.client.0.smithi088.stdout:1/737: dwrite d9/d10/d2a/d4b/d33/dad/dbb/fe8 [0,4194304] 0 2024-09-13T21:40:27.466 INFO:tasks.workunit.client.0.smithi088.stdout:1/738: write d9/d10/d2a/d4b/d39/fb0 [1449061,67955] 0 2024-09-13T21:40:27.466 INFO:tasks.workunit.client.0.smithi088.stdout:2/748: dwrite d1/d8/d24/f8a [0,4194304] 0 2024-09-13T21:40:27.466 INFO:tasks.workunit.client.0.smithi088.stdout:2/749: chown d1/d8/d2e/d3b/cd3 1003 1 2024-09-13T21:40:27.472 INFO:tasks.workunit.client.0.smithi088.stdout:1/739: mkdir d9/d10/d2a/d4b/d3a/d104 0 2024-09-13T21:40:27.472 INFO:tasks.workunit.client.0.smithi088.stdout:1/740: fdatasync d9/fd 0 2024-09-13T21:40:27.472 INFO:tasks.workunit.client.0.smithi088.stdout:3/779: read d5/f22 [160657,2027] 0 2024-09-13T21:40:27.476 INFO:tasks.workunit.client.0.smithi088.stdout:3/780: rename d5/d23/d2a/d63/f87 to d5/d23/d2a/d63/d48/d49/ff1 0 2024-09-13T21:40:27.477 INFO:tasks.workunit.client.0.smithi088.stdout:3/781: symlink d5/d23/d2a/d63/lf2 0 2024-09-13T21:40:27.478 INFO:tasks.workunit.client.0.smithi088.stdout:3/782: symlink d5/d23/d2a/d6b/d98/da1/daa/lf3 0 2024-09-13T21:40:27.482 INFO:tasks.workunit.client.0.smithi088.stdout:9/608: dwrite d1a/d3c/f5b [0,4194304] 0 2024-09-13T21:40:27.483 INFO:tasks.workunit.client.0.smithi088.stdout:5/832: dwrite d4/d1c/d24/d26/d56/f91 [0,4194304] 0 2024-09-13T21:40:27.484 INFO:tasks.workunit.client.0.smithi088.stdout:7/592: sync 2024-09-13T21:40:27.484 INFO:tasks.workunit.client.0.smithi088.stdout:7/593: chown d6/f42 6209173 1 2024-09-13T21:40:27.484 INFO:tasks.workunit.client.0.smithi088.stdout:4/672: sync 2024-09-13T21:40:27.484 INFO:tasks.workunit.client.0.smithi088.stdout:7/594: creat d6/d5f/d7a/fc5 x:0 0 0 2024-09-13T21:40:27.484 INFO:tasks.workunit.client.0.smithi088.stdout:7/595: creat d6/d5f/d69/d4f/fc6 x:0 0 0 2024-09-13T21:40:27.484 INFO:tasks.workunit.client.0.smithi088.stdout:7/596: fsync d6/f22 0 2024-09-13T21:40:27.484 INFO:tasks.workunit.client.0.smithi088.stdout:7/597: creat d6/d5f/d69/d4f/fc7 x:0 0 0 2024-09-13T21:40:27.485 INFO:tasks.workunit.client.0.smithi088.stdout:9/609: mkdir d1a/d1b/db9 0 2024-09-13T21:40:27.486 INFO:tasks.workunit.client.0.smithi088.stdout:3/783: dread d5/d23/d2a/d6b/d9e/fec [0,4194304] 0 2024-09-13T21:40:27.488 INFO:tasks.workunit.client.0.smithi088.stdout:5/833: mknod d4/d1c/d4a/d63/d6a/d6d/c10f 0 2024-09-13T21:40:27.489 INFO:tasks.workunit.client.0.smithi088.stdout:2/750: read d1/d8/d16/f5c [2960158,121389] 0 2024-09-13T21:40:27.492 INFO:tasks.workunit.client.0.smithi088.stdout:4/673: symlink d2/d5/d2d/d70/lda 0 2024-09-13T21:40:27.492 INFO:tasks.workunit.client.0.smithi088.stdout:4/674: readlink d2/d5/d20/d60/de/d1e/d23/d6f/lb0 0 2024-09-13T21:40:27.492 INFO:tasks.workunit.client.0.smithi088.stdout:4/675: stat d2/d5/ff 0 2024-09-13T21:40:27.492 INFO:tasks.workunit.client.0.smithi088.stdout:7/598: dread d6/f42 [0,4194304] 0 2024-09-13T21:40:27.498 INFO:tasks.workunit.client.0.smithi088.stdout:3/784: truncate d5/d14/f82 3457303 0 2024-09-13T21:40:27.499 INFO:tasks.workunit.client.0.smithi088.stdout:5/834: mknod d4/d1c/d24/d26/dbf/d89/d92/df3/c110 0 2024-09-13T21:40:27.499 INFO:tasks.workunit.client.0.smithi088.stdout:5/835: write d4/d1c/d24/d95/da6/fc3 [701785,109688] 0 2024-09-13T21:40:27.499 INFO:tasks.workunit.client.0.smithi088.stdout:5/836: creat d4/d1c/d24/d26/d56/f111 x:0 0 0 2024-09-13T21:40:27.500 INFO:tasks.workunit.client.0.smithi088.stdout:2/751: creat d1/d8/d2e/d44/ffe x:0 0 0 2024-09-13T21:40:27.501 INFO:tasks.workunit.client.0.smithi088.stdout:4/676: link d2/d5/d20/d60/de/d1e/d23/d69/cbb d2/d5/d20/d60/de/d1e/d31/d61/cdb 0 2024-09-13T21:40:27.501 INFO:tasks.workunit.client.0.smithi088.stdout:9/610: dwrite d1a/d1b/f25 [0,4194304] 0 2024-09-13T21:40:27.502 INFO:tasks.workunit.client.0.smithi088.stdout:7/599: getdents d6/d5f/d69/d4f/d6f/d70/d76 0 2024-09-13T21:40:27.503 INFO:tasks.workunit.client.0.smithi088.stdout:3/785: creat d5/d23/d2a/d6b/ff4 x:0 0 0 2024-09-13T21:40:27.503 INFO:tasks.workunit.client.0.smithi088.stdout:9/611: dread d1a/f43 [0,4194304] 0 2024-09-13T21:40:27.504 INFO:tasks.workunit.client.0.smithi088.stdout:4/677: dread d2/d5/d20/d7f/f93 [0,4194304] 0 2024-09-13T21:40:27.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/678: creat d2/d5/d20/d60/de/d1e/d23/d3c/fdc x:0 0 0 2024-09-13T21:40:27.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/679: dread - d2/d13/f77 zero size 2024-09-13T21:40:27.505 INFO:tasks.workunit.client.0.smithi088.stdout:4/680: truncate d2/d5/d20/d60/de/f76 804590 0 2024-09-13T21:40:27.505 INFO:tasks.workunit.client.0.smithi088.stdout:5/837: mknod d4/d1c/d24/d26/da1/c112 0 2024-09-13T21:40:27.509 INFO:tasks.workunit.client.0.smithi088.stdout:6/758: sync 2024-09-13T21:40:27.512 INFO:tasks.workunit.client.0.smithi088.stdout:4/681: symlink d2/d5/d20/d7f/ldd 0 2024-09-13T21:40:27.512 INFO:tasks.workunit.client.0.smithi088.stdout:4/682: chown d2/d13/l1f 2005315 1 2024-09-13T21:40:27.513 INFO:tasks.workunit.client.0.smithi088.stdout:7/600: write d6/da/f19 [8102006,94204] 0 2024-09-13T21:40:27.516 INFO:tasks.workunit.client.0.smithi088.stdout:3/786: write d5/d23/d2a/d63/f97 [4013944,111293] 0 2024-09-13T21:40:27.520 INFO:tasks.workunit.client.0.smithi088.stdout:9/612: mknod d1a/d3c/d51/d5e/cba 0 2024-09-13T21:40:27.521 INFO:tasks.workunit.client.0.smithi088.stdout:6/759: truncate d0/d1e/f4c 204756 0 2024-09-13T21:40:27.522 INFO:tasks.workunit.client.0.smithi088.stdout:4/683: rmdir d2/d13 39 2024-09-13T21:40:27.524 INFO:tasks.workunit.client.0.smithi088.stdout:3/787: creat d5/d14/ff5 x:0 0 0 2024-09-13T21:40:27.525 INFO:tasks.workunit.client.0.smithi088.stdout:2/752: rename d1/d13 to d1/d8/d2e/d3b/dff 0 2024-09-13T21:40:27.526 INFO:tasks.workunit.client.0.smithi088.stdout:6/760: symlink d0/db/lec 0 2024-09-13T21:40:27.526 INFO:tasks.workunit.client.0.smithi088.stdout:6/761: creat d0/d28/fed x:0 0 0 2024-09-13T21:40:27.528 INFO:tasks.workunit.client.0.smithi088.stdout:3/788: rename d5/d23/d2a/d3f/d8f/da3/fab to d5/d23/d2a/d6b/d98/ff6 0 2024-09-13T21:40:27.529 INFO:tasks.workunit.client.0.smithi088.stdout:6/762: creat d0/fee x:0 0 0 2024-09-13T21:40:27.529 INFO:tasks.workunit.client.0.smithi088.stdout:6/763: write d0/d2c/d32/d39/f95 [7936752,1976] 0 2024-09-13T21:40:27.530 INFO:tasks.workunit.client.0.smithi088.stdout:4/684: mkdir d2/d5/d20/d60/de/dde 0 2024-09-13T21:40:27.530 INFO:tasks.workunit.client.0.smithi088.stdout:4/685: write d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79/fd2 [749943,60252] 0 2024-09-13T21:40:27.531 INFO:tasks.workunit.client.0.smithi088.stdout:3/789: creat d5/d23/d2a/d3f/d76/d81/ff7 x:0 0 0 2024-09-13T21:40:27.531 INFO:tasks.workunit.client.0.smithi088.stdout:3/790: write d5/d23/d2a/d6b/d98/da1/daa/f6e [1302511,60590] 0 2024-09-13T21:40:27.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/764: chown d0/d1e/d1f/c72 14053 1 2024-09-13T21:40:27.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/765: fdatasync d0/d28/f35 0 2024-09-13T21:40:27.531 INFO:tasks.workunit.client.0.smithi088.stdout:4/686: getdents d2/d11 0 2024-09-13T21:40:27.533 INFO:tasks.workunit.client.0.smithi088.stdout:3/791: unlink d5/d23/d2a/fbd 0 2024-09-13T21:40:27.534 INFO:tasks.workunit.client.0.smithi088.stdout:4/687: rename d2/d11/l46 to d2/d5/ldf 0 2024-09-13T21:40:27.535 INFO:tasks.workunit.client.0.smithi088.stdout:4/688: symlink d2/d5/le0 0 2024-09-13T21:40:27.535 INFO:tasks.workunit.client.0.smithi088.stdout:4/689: creat d2/d5/d2d/d70/fe1 x:0 0 0 2024-09-13T21:40:27.537 INFO:tasks.workunit.client.0.smithi088.stdout:9/613: read d1a/d1b/f74 [1211326,13350] 0 2024-09-13T21:40:27.537 INFO:tasks.workunit.client.0.smithi088.stdout:4/690: creat d2/d5/d20/d60/de/d1e/d23/fe2 x:0 0 0 2024-09-13T21:40:27.537 INFO:tasks.workunit.client.0.smithi088.stdout:2/753: write d1/fd [2470483,96387] 0 2024-09-13T21:40:27.537 INFO:tasks.workunit.client.0.smithi088.stdout:9/614: mkdir d1a/d3c/d60/dbb 0 2024-09-13T21:40:27.538 INFO:tasks.workunit.client.0.smithi088.stdout:4/691: mkdir d2/d81/de3 0 2024-09-13T21:40:27.540 INFO:tasks.workunit.client.0.smithi088.stdout:2/754: rename d1/d8/d2e/d3b/dff/fb7 to d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/f100 0 2024-09-13T21:40:27.540 INFO:tasks.workunit.client.0.smithi088.stdout:4/692: write d2/d11/f16 [2436986,84237] 0 2024-09-13T21:40:27.541 INFO:tasks.workunit.client.0.smithi088.stdout:4/693: chown d2/d5/d20/d60/de/d1e/d23/d6f/l30 604706 1 2024-09-13T21:40:27.541 INFO:tasks.workunit.client.0.smithi088.stdout:4/694: write d2/d5/d20/d60/fb6 [937851,64878] 0 2024-09-13T21:40:27.541 INFO:tasks.workunit.client.0.smithi088.stdout:5/838: dwrite d4/d1c/d4a/d63/f6f [0,4194304] 0 2024-09-13T21:40:27.541 INFO:tasks.workunit.client.0.smithi088.stdout:2/755: mkdir d1/d8/d2e/d3b/dff/d2a/d41/d82/d101 0 2024-09-13T21:40:27.541 INFO:tasks.workunit.client.0.smithi088.stdout:2/756: readlink d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d76/lce 0 2024-09-13T21:40:27.542 INFO:tasks.workunit.client.0.smithi088.stdout:9/615: mknod d1a/cbc 0 2024-09-13T21:40:27.543 INFO:tasks.workunit.client.0.smithi088.stdout:4/695: symlink d2/d5/d20/d60/de/d1e/d23/dca/le4 0 2024-09-13T21:40:27.544 INFO:tasks.workunit.client.0.smithi088.stdout:4/696: write d2/d5/d20/d60/de/fba [791976,31482] 0 2024-09-13T21:40:27.544 INFO:tasks.workunit.client.0.smithi088.stdout:4/697: chown d2/d5/d20/d7f 2394063 1 2024-09-13T21:40:27.545 INFO:tasks.workunit.client.0.smithi088.stdout:5/839: link d4/d1c/d24/f41 d4/d1c/d4a/d8a/f113 0 2024-09-13T21:40:27.545 INFO:tasks.workunit.client.0.smithi088.stdout:7/601: dwrite d6/da/d1a/f24 [0,4194304] 0 2024-09-13T21:40:27.545 INFO:tasks.workunit.client.0.smithi088.stdout:3/792: dread d5/d23/d2a/d3f/f64 [0,4194304] 0 2024-09-13T21:40:27.548 INFO:tasks.workunit.client.0.smithi088.stdout:9/616: truncate d1a/f31 2655933 0 2024-09-13T21:40:27.548 INFO:tasks.workunit.client.0.smithi088.stdout:9/617: readlink d1a/d61/d3d/l73 0 2024-09-13T21:40:27.549 INFO:tasks.workunit.client.0.smithi088.stdout:6/766: dread d0/d2c/fcd [0,4194304] 0 2024-09-13T21:40:27.549 INFO:tasks.workunit.client.0.smithi088.stdout:4/698: chown d2/d11/dab/cb3 32976236 1 2024-09-13T21:40:27.549 INFO:tasks.workunit.client.0.smithi088.stdout:6/767: fdatasync d0/d2c/d7a/daf/dc7/fd1 0 2024-09-13T21:40:27.550 INFO:tasks.workunit.client.0.smithi088.stdout:4/699: dread d2/d5/d20/d41/f8e [0,4194304] 0 2024-09-13T21:40:27.550 INFO:tasks.workunit.client.0.smithi088.stdout:4/700: write d2/d5/d20/d7f/fcf [47229,45025] 0 2024-09-13T21:40:27.627 INFO:tasks.workunit.client.0.smithi088.stdout:7/602: mkdir d6/da/dc8 0 2024-09-13T21:40:27.627 INFO:tasks.workunit.client.0.smithi088.stdout:7/603: write d6/da/d1a/f30 [299973,48744] 0 2024-09-13T21:40:27.628 INFO:tasks.workunit.client.0.smithi088.stdout:3/793: creat d5/d23/d2a/d3f/d76/db3/ff8 x:0 0 0 2024-09-13T21:40:27.629 INFO:tasks.workunit.client.0.smithi088.stdout:2/757: mknod d1/d8/d2e/c102 0 2024-09-13T21:40:27.631 INFO:tasks.workunit.client.0.smithi088.stdout:9/618: creat d1a/d61/d3d/d41/d48/d86/d8e/fbd x:0 0 0 2024-09-13T21:40:27.633 INFO:tasks.workunit.client.0.smithi088.stdout:6/768: creat d0/d1e/d1f/d55/d96/d98/fef x:0 0 0 2024-09-13T21:40:27.634 INFO:tasks.workunit.client.0.smithi088.stdout:3/794: dread d5/d14/f82 [0,4194304] 0 2024-09-13T21:40:27.635 INFO:tasks.workunit.client.0.smithi088.stdout:4/701: unlink d2/fb9 0 2024-09-13T21:40:27.641 INFO:tasks.workunit.client.0.smithi088.stdout:7/604: unlink d6/da/d1a/fba 0 2024-09-13T21:40:27.643 INFO:tasks.workunit.client.0.smithi088.stdout:2/758: mkdir d1/d8/d24/d78/d7f/d103 0 2024-09-13T21:40:27.646 INFO:tasks.workunit.client.0.smithi088.stdout:9/619: symlink d1a/d61/d3d/d41/d48/d86/d8e/lbe 0 2024-09-13T21:40:27.649 INFO:tasks.workunit.client.0.smithi088.stdout:7/605: creat d6/da/d1a/d3a/d5c/fc9 x:0 0 0 2024-09-13T21:40:27.650 INFO:tasks.workunit.client.0.smithi088.stdout:9/620: mknod d1a/d61/cbf 0 2024-09-13T21:40:27.651 INFO:tasks.workunit.client.0.smithi088.stdout:9/621: mknod d1a/d3c/d51/d5e/d7e/d92/cc0 0 2024-09-13T21:40:27.654 INFO:tasks.workunit.client.0.smithi088.stdout:1/741: sync 2024-09-13T21:40:27.654 INFO:tasks.workunit.client.0.smithi088.stdout:8/692: sync 2024-09-13T21:40:27.655 INFO:tasks.workunit.client.0.smithi088.stdout:0/760: sync 2024-09-13T21:40:27.655 INFO:tasks.workunit.client.0.smithi088.stdout:8/693: chown db/d26/d2c/lc0 20916913 1 2024-09-13T21:40:27.655 INFO:tasks.workunit.client.0.smithi088.stdout:8/694: chown db/d26/f45 1 1 2024-09-13T21:40:27.655 INFO:tasks.workunit.client.0.smithi088.stdout:8/695: fsync db/d26/d4f/f9e 0 2024-09-13T21:40:27.656 INFO:tasks.workunit.client.0.smithi088.stdout:1/742: creat d9/d10/d2a/d4b/d39/d43/dfb/f105 x:0 0 0 2024-09-13T21:40:27.656 INFO:tasks.workunit.client.0.smithi088.stdout:1/743: creat d9/d4f/f106 x:0 0 0 2024-09-13T21:40:27.656 INFO:tasks.workunit.client.0.smithi088.stdout:8/696: truncate db/df/d61/f81 995976 0 2024-09-13T21:40:27.656 INFO:tasks.workunit.client.0.smithi088.stdout:8/697: write db/fe2 [689643,83770] 0 2024-09-13T21:40:27.657 INFO:tasks.workunit.client.0.smithi088.stdout:9/622: write d1a/d1b/f35 [495276,32955] 0 2024-09-13T21:40:27.658 INFO:tasks.workunit.client.0.smithi088.stdout:8/698: symlink db/d26/d37/d7d/le7 0 2024-09-13T21:40:27.659 INFO:tasks.workunit.client.0.smithi088.stdout:9/623: creat d1a/d3c/d85/fc1 x:0 0 0 2024-09-13T21:40:27.662 INFO:tasks.workunit.client.0.smithi088.stdout:6/769: dwrite d0/db/f43 [0,4194304] 0 2024-09-13T21:40:27.663 INFO:tasks.workunit.client.0.smithi088.stdout:4/702: dwrite d2/d13/f86 [0,4194304] 0 2024-09-13T21:40:27.666 INFO:tasks.workunit.client.0.smithi088.stdout:1/744: dread d9/d10/d2a/f8a [0,4194304] 0 2024-09-13T21:40:27.666 INFO:tasks.workunit.client.0.smithi088.stdout:6/770: link d0/db/c69 d0/d2c/d83/cf0 0 2024-09-13T21:40:27.667 INFO:tasks.workunit.client.0.smithi088.stdout:0/761: dread d7/d2c/d30/d31/d42/d95/fc4 [0,4194304] 0 2024-09-13T21:40:27.671 INFO:tasks.workunit.client.0.smithi088.stdout:4/703: link d2/d5/d20/d60/de/d1e/d31/l4c d2/d5/d20/d41/d4b/le5 0 2024-09-13T21:40:27.671 INFO:tasks.workunit.client.0.smithi088.stdout:4/704: stat d2/f48 0 2024-09-13T21:40:27.671 INFO:tasks.workunit.client.0.smithi088.stdout:4/705: fsync d2/d5/d20/d41/d4b/f7a 0 2024-09-13T21:40:27.673 INFO:tasks.workunit.client.0.smithi088.stdout:1/745: rename d9/d10/d2a/d47/dc8/cdc to d9/d10/d2a/d47/d9c/db5/de6/c107 0 2024-09-13T21:40:27.674 INFO:tasks.workunit.client.0.smithi088.stdout:6/771: symlink d0/d1e/d1f/d55/d96/lf1 0 2024-09-13T21:40:27.677 INFO:tasks.workunit.client.0.smithi088.stdout:0/762: unlink d7/d1d/d66/d8b/fa1 0 2024-09-13T21:40:27.677 INFO:tasks.workunit.client.0.smithi088.stdout:0/763: dread - d7/d1d/d26/d45/f8d zero size 2024-09-13T21:40:27.678 INFO:tasks.workunit.client.0.smithi088.stdout:4/706: unlink d2/d5/d2d/l44 0 2024-09-13T21:40:27.679 INFO:tasks.workunit.client.0.smithi088.stdout:7/606: dwrite d6/d4e/f9b [0,4194304] 0 2024-09-13T21:40:27.679 INFO:tasks.workunit.client.0.smithi088.stdout:5/840: sync 2024-09-13T21:40:27.681 INFO:tasks.workunit.client.0.smithi088.stdout:9/624: dwrite d1a/d3c/faa [0,4194304] 0 2024-09-13T21:40:27.681 INFO:tasks.workunit.client.0.smithi088.stdout:1/746: unlink d9/d10/d2a/fa1 0 2024-09-13T21:40:27.684 INFO:tasks.workunit.client.0.smithi088.stdout:6/772: rename d0/d28/f35 to d0/d1e/d1f/d55/ff2 0 2024-09-13T21:40:27.694 INFO:tasks.workunit.client.0.smithi088.stdout:9/625: truncate d1a/f20 3559774 0 2024-09-13T21:40:27.696 INFO:tasks.workunit.client.0.smithi088.stdout:1/747: link d9/dc/d74/fef d9/d10/d2a/d4b/d39/d43/f108 0 2024-09-13T21:40:27.697 INFO:tasks.workunit.client.0.smithi088.stdout:8/699: rmdir db/d26/d37 39 2024-09-13T21:40:27.698 INFO:tasks.workunit.client.0.smithi088.stdout:0/764: getdents d7/d1d/d26/dcd 0 2024-09-13T21:40:27.698 INFO:tasks.workunit.client.0.smithi088.stdout:0/765: fsync d7/d1d/d66/ff8 0 2024-09-13T21:40:27.701 INFO:tasks.workunit.client.0.smithi088.stdout:9/626: creat d1a/d1b/db9/fc2 x:0 0 0 2024-09-13T21:40:27.705 INFO:tasks.workunit.client.0.smithi088.stdout:4/707: dwrite f1 [4194304,4194304] 0 2024-09-13T21:40:27.705 INFO:tasks.workunit.client.0.smithi088.stdout:5/841: dwrite d4/d1c/d24/d26/fe0 [0,4194304] 0 2024-09-13T21:40:27.705 INFO:tasks.workunit.client.0.smithi088.stdout:4/708: write d2/d5/d20/d60/de/d1e/d23/d6c/f34 [1766778,119931] 0 2024-09-13T21:40:27.705 INFO:tasks.workunit.client.0.smithi088.stdout:4/709: write d2/d5/d20/d60/de/d1e/d31/f8b [541956,68136] 0 2024-09-13T21:40:27.707 INFO:tasks.workunit.client.0.smithi088.stdout:6/773: link d0/d1e/d1f/c8a d0/d2c/d7a/daf/cf3 0 2024-09-13T21:40:27.708 INFO:tasks.workunit.client.0.smithi088.stdout:8/700: mkdir db/df/da7/d88/ddd/de8 0 2024-09-13T21:40:27.708 INFO:tasks.workunit.client.0.smithi088.stdout:8/701: fsync db/df/f65 0 2024-09-13T21:40:27.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/766: getdents d7/d1d/d27 0 2024-09-13T21:40:27.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/767: truncate d7/d2c/f48 4775592 0 2024-09-13T21:40:27.709 INFO:tasks.workunit.client.0.smithi088.stdout:0/768: readlink d7/d2c/d30/lc8 0 2024-09-13T21:40:27.711 INFO:tasks.workunit.client.0.smithi088.stdout:7/607: rmdir d6/d5f/d7a/db5 0 2024-09-13T21:40:27.711 INFO:tasks.workunit.client.0.smithi088.stdout:7/608: readlink d6/l35 0 2024-09-13T21:40:27.711 INFO:tasks.workunit.client.0.smithi088.stdout:7/609: dread - d6/d5f/d7a/fc5 zero size 2024-09-13T21:40:27.711 INFO:tasks.workunit.client.0.smithi088.stdout:7/610: truncate d6/da/d44/f65 248867 0 2024-09-13T21:40:27.711 INFO:tasks.workunit.client.0.smithi088.stdout:7/611: stat d6/c16 0 2024-09-13T21:40:27.712 INFO:tasks.workunit.client.0.smithi088.stdout:7/612: write d6/da/d1a/f30 [1861979,68006] 0 2024-09-13T21:40:27.712 INFO:tasks.workunit.client.0.smithi088.stdout:7/613: readlink d6/d5f/d69/d45/l58 0 2024-09-13T21:40:27.712 INFO:tasks.workunit.client.0.smithi088.stdout:9/627: getdents d1a/d3c/d51/d5e/d7e/d92 0 2024-09-13T21:40:27.712 INFO:tasks.workunit.client.0.smithi088.stdout:9/628: chown d1a/d61/d3d/d41/d48/d86/f9a 2933816 1 2024-09-13T21:40:27.717 INFO:tasks.workunit.client.0.smithi088.stdout:4/710: read d2/d5/d20/d60/de/d1e/d23/d3c/d65/f9c [1903096,19749] 0 2024-09-13T21:40:27.718 INFO:tasks.workunit.client.0.smithi088.stdout:1/748: dwrite d9/d10/d2a/d47/d9c/db5/fea [0,4194304] 0 2024-09-13T21:40:27.718 INFO:tasks.workunit.client.0.smithi088.stdout:6/774: unlink d0/d2c/d7a/fb6 0 2024-09-13T21:40:27.718 INFO:tasks.workunit.client.0.smithi088.stdout:6/775: dread - d0/d1e/d1f/d55/d96/d98/fef zero size 2024-09-13T21:40:27.718 INFO:tasks.workunit.client.0.smithi088.stdout:6/776: chown d0/d2c/d32/fdf 41659 1 2024-09-13T21:40:27.718 INFO:tasks.workunit.client.0.smithi088.stdout:6/777: chown d0/d1e/l2f 24 1 2024-09-13T21:40:27.718 INFO:tasks.workunit.client.0.smithi088.stdout:6/778: fsync d0/d2c/f9c 0 2024-09-13T21:40:27.718 INFO:tasks.workunit.client.0.smithi088.stdout:6/779: dread - d0/db/fda zero size 2024-09-13T21:40:27.718 INFO:tasks.workunit.client.0.smithi088.stdout:6/780: chown d0/d1e/d1f/f4d 127 1 2024-09-13T21:40:27.718 INFO:tasks.workunit.client.0.smithi088.stdout:6/781: write d0/d1e/d1f/d55/fc5 [41704,114219] 0 2024-09-13T21:40:27.719 INFO:tasks.workunit.client.0.smithi088.stdout:0/769: link d7/l79 d7/d2c/d78/l108 0 2024-09-13T21:40:27.719 INFO:tasks.workunit.client.0.smithi088.stdout:0/770: stat d7/d1d/d26/d34/f38 0 2024-09-13T21:40:27.720 INFO:tasks.workunit.client.0.smithi088.stdout:9/629: dread d1a/d1b/f25 [4194304,4194304] 0 2024-09-13T21:40:27.720 INFO:tasks.workunit.client.0.smithi088.stdout:9/630: chown d1a/d1b/l71 568683 1 2024-09-13T21:40:27.721 INFO:tasks.workunit.client.0.smithi088.stdout:0/771: write d7/d2c/d30/d31/d42/d4b/f85 [172460,9422] 0 2024-09-13T21:40:27.721 INFO:tasks.workunit.client.0.smithi088.stdout:0/772: creat d7/d2c/d30/d31/d42/f109 x:0 0 0 2024-09-13T21:40:27.721 INFO:tasks.workunit.client.0.smithi088.stdout:7/614: mkdir d6/da/dca 0 2024-09-13T21:40:27.722 INFO:tasks.workunit.client.0.smithi088.stdout:5/842: getdents d4/d1c/d24/d26/d4b/d66 0 2024-09-13T21:40:27.722 INFO:tasks.workunit.client.0.smithi088.stdout:8/702: read db/df/f69 [2356292,26726] 0 2024-09-13T21:40:27.723 INFO:tasks.workunit.client.0.smithi088.stdout:8/703: truncate db/df/d61/d97/faf 183454 0 2024-09-13T21:40:27.726 INFO:tasks.workunit.client.0.smithi088.stdout:9/631: dread d1a/d1b/f74 [0,4194304] 0 2024-09-13T21:40:27.733 INFO:tasks.workunit.client.0.smithi088.stdout:8/704: write db/d26/f48 [3573204,106148] 0 2024-09-13T21:40:27.734 INFO:tasks.workunit.client.0.smithi088.stdout:4/711: rmdir d2/d11 39 2024-09-13T21:40:27.735 INFO:tasks.workunit.client.0.smithi088.stdout:1/749: creat d9/d10/dff/f109 x:0 0 0 2024-09-13T21:40:27.735 INFO:tasks.workunit.client.0.smithi088.stdout:1/750: chown d9/d10/d2a/d4b/d3a/cfd 24420535 1 2024-09-13T21:40:27.739 INFO:tasks.workunit.client.0.smithi088.stdout:7/615: creat d6/d5f/d69/d45/fcb x:0 0 0 2024-09-13T21:40:27.739 INFO:tasks.workunit.client.0.smithi088.stdout:7/616: write d6/f53 [3783794,60797] 0 2024-09-13T21:40:27.739 INFO:tasks.workunit.client.0.smithi088.stdout:7/617: dread - d6/d4e/f6a zero size 2024-09-13T21:40:27.739 INFO:tasks.workunit.client.0.smithi088.stdout:7/618: write d6/d5f/d69/d4f/fc7 [329906,14524] 0 2024-09-13T21:40:27.740 INFO:tasks.workunit.client.0.smithi088.stdout:6/782: dwrite d0/d1e/d1f/d55/ff2 [4194304,4194304] 0 2024-09-13T21:40:27.740 INFO:tasks.workunit.client.0.smithi088.stdout:5/843: creat d4/db8/f114 x:0 0 0 2024-09-13T21:40:27.740 INFO:tasks.workunit.client.0.smithi088.stdout:5/844: stat d4/d1c/d24/d26/fe0 0 2024-09-13T21:40:27.742 INFO:tasks.workunit.client.0.smithi088.stdout:9/632: unlink d1a/d61/d3d/d41/d48/d86/d8e/l9b 0 2024-09-13T21:40:27.744 INFO:tasks.workunit.client.0.smithi088.stdout:8/705: mknod db/df/d61/ce9 0 2024-09-13T21:40:27.745 INFO:tasks.workunit.client.0.smithi088.stdout:1/751: mkdir d9/d10/d2a/d4b/d39/dda/d10a 0 2024-09-13T21:40:27.746 INFO:tasks.workunit.client.0.smithi088.stdout:1/752: write d9/dc/fb9 [510281,88260] 0 2024-09-13T21:40:27.746 INFO:tasks.workunit.client.0.smithi088.stdout:1/753: dread - d9/d10/d2a/d4b/d33/dad/dbb/ff6 zero size 2024-09-13T21:40:27.748 INFO:tasks.workunit.client.0.smithi088.stdout:3/795: sync 2024-09-13T21:40:27.751 INFO:tasks.workunit.client.0.smithi088.stdout:6/783: truncate d0/d2c/d32/d39/d3f/d71/f97 2115721 0 2024-09-13T21:40:27.752 INFO:tasks.workunit.client.0.smithi088.stdout:8/706: dread db/df/da7/f28 [0,4194304] 0 2024-09-13T21:40:27.752 INFO:tasks.workunit.client.0.smithi088.stdout:8/707: creat db/fea x:0 0 0 2024-09-13T21:40:27.753 INFO:tasks.workunit.client.0.smithi088.stdout:5/845: symlink d4/d1c/d24/d26/dbf/d89/d92/df3/l115 0 2024-09-13T21:40:27.755 INFO:tasks.workunit.client.0.smithi088.stdout:0/773: getdents d7/d2c/d30/d31/d42 0 2024-09-13T21:40:27.756 INFO:tasks.workunit.client.0.smithi088.stdout:9/633: write d1a/d3c/d51/d5e/f7a [3283559,114882] 0 2024-09-13T21:40:27.759 INFO:tasks.workunit.client.0.smithi088.stdout:1/754: unlink d9/dc/la5 0 2024-09-13T21:40:27.761 INFO:tasks.workunit.client.0.smithi088.stdout:3/796: mknod d5/d23/d2a/cf9 0 2024-09-13T21:40:27.761 INFO:tasks.workunit.client.0.smithi088.stdout:8/708: dread db/d26/f2b [0,4194304] 0 2024-09-13T21:40:27.761 INFO:tasks.workunit.client.0.smithi088.stdout:8/709: readlink db/df/da7/daa/le1 0 2024-09-13T21:40:27.761 INFO:tasks.workunit.client.0.smithi088.stdout:6/784: creat d0/d2c/d8b/ff4 x:0 0 0 2024-09-13T21:40:27.761 INFO:tasks.workunit.client.0.smithi088.stdout:6/785: write d0/d1e/fa1 [275239,94332] 0 2024-09-13T21:40:27.764 INFO:tasks.workunit.client.0.smithi088.stdout:5/846: rename d4/d1c/d24/d26/dbf/d89/d92/f96 to d4/d1c/d24/d26/dbf/dc6/d10e/f116 0 2024-09-13T21:40:27.766 INFO:tasks.workunit.client.0.smithi088.stdout:1/755: getdents d9/dc/d52/dba/d7d 0 2024-09-13T21:40:27.766 INFO:tasks.workunit.client.0.smithi088.stdout:7/619: dwrite d6/f53 [0,4194304] 0 2024-09-13T21:40:27.767 INFO:tasks.workunit.client.0.smithi088.stdout:3/797: stat d5/d23/d2a/d63/d31/c3a 0 2024-09-13T21:40:27.768 INFO:tasks.workunit.client.0.smithi088.stdout:2/759: sync 2024-09-13T21:40:27.769 INFO:tasks.workunit.client.0.smithi088.stdout:8/710: rmdir db/d26/d2c/d85/d51/dca 39 2024-09-13T21:40:27.769 INFO:tasks.workunit.client.0.smithi088.stdout:8/711: truncate db/f9b 1564322 0 2024-09-13T21:40:27.773 INFO:tasks.workunit.client.0.smithi088.stdout:5/847: mkdir d4/d1c/d24/d26/d117 0 2024-09-13T21:40:27.776 INFO:tasks.workunit.client.0.smithi088.stdout:1/756: dread d9/d10/d2a/d4b/d39/fb0 [0,4194304] 0 2024-09-13T21:40:27.776 INFO:tasks.workunit.client.0.smithi088.stdout:3/798: rename d5/d23/d2a/d63/d48/f99 to d5/d5a/db8/ffa 0 2024-09-13T21:40:27.776 INFO:tasks.workunit.client.0.smithi088.stdout:3/799: chown d5/d23/d2a/c35 428091703 1 2024-09-13T21:40:27.776 INFO:tasks.workunit.client.0.smithi088.stdout:0/774: read d7/d1d/d27/d43/f17 [5312797,33129] 0 2024-09-13T21:40:27.778 INFO:tasks.workunit.client.0.smithi088.stdout:2/760: mkdir d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/d104 0 2024-09-13T21:40:27.779 INFO:tasks.workunit.client.0.smithi088.stdout:8/712: creat db/d26/d2c/d85/feb x:0 0 0 2024-09-13T21:40:27.781 INFO:tasks.workunit.client.0.smithi088.stdout:3/800: symlink d5/d23/d2a/d63/d48/lfb 0 2024-09-13T21:40:27.781 INFO:tasks.workunit.client.0.smithi088.stdout:3/801: read f0 [2149364,31831] 0 2024-09-13T21:40:27.781 INFO:tasks.workunit.client.0.smithi088.stdout:3/802: getdents d5/d23/d2a/d6b/d98/dcd 0 2024-09-13T21:40:27.784 INFO:tasks.workunit.client.0.smithi088.stdout:0/775: symlink d7/d1d/l10a 0 2024-09-13T21:40:27.784 INFO:tasks.workunit.client.0.smithi088.stdout:2/761: truncate d1/d8/f47 1750479 0 2024-09-13T21:40:27.787 INFO:tasks.workunit.client.0.smithi088.stdout:8/713: unlink db/d26/d2c/d85/dad/ldc 0 2024-09-13T21:40:27.788 INFO:tasks.workunit.client.0.smithi088.stdout:0/776: creat d7/d1d/d21/d82/f10b x:0 0 0 2024-09-13T21:40:27.789 INFO:tasks.workunit.client.0.smithi088.stdout:2/762: mkdir d1/d8/d2e/d3b/dff/d3f/d99/d105 0 2024-09-13T21:40:27.790 INFO:tasks.workunit.client.0.smithi088.stdout:0/777: mkdir d7/d1d/d66/d8b/d10c 0 2024-09-13T21:40:27.791 INFO:tasks.workunit.client.0.smithi088.stdout:2/763: symlink d1/d8/d2e/d3b/dff/d2a/l106 0 2024-09-13T21:40:27.791 INFO:tasks.workunit.client.0.smithi088.stdout:6/786: dwrite d0/d1e/f4c [0,4194304] 0 2024-09-13T21:40:27.792 INFO:tasks.workunit.client.0.smithi088.stdout:7/620: dwrite d6/d5f/d69/f9a [4194304,4194304] 0 2024-09-13T21:40:27.793 INFO:tasks.workunit.client.0.smithi088.stdout:3/803: write d5/d23/d2a/d6b/d98/da1/daa/d43/fb9 [1693051,96505] 0 2024-09-13T21:40:27.795 INFO:tasks.workunit.client.0.smithi088.stdout:8/714: dread db/df/d61/f8e [0,4194304] 0 2024-09-13T21:40:27.795 INFO:tasks.workunit.client.0.smithi088.stdout:3/804: write d5/d23/d2a/d6b/d98/da1/daa/f6e [986998,3575] 0 2024-09-13T21:40:27.795 INFO:tasks.workunit.client.0.smithi088.stdout:8/715: creat db/df/d61/fec x:0 0 0 2024-09-13T21:40:27.796 INFO:tasks.workunit.client.0.smithi088.stdout:6/787: rename d0/d1e/d1f/c75 to d0/d1e/d1f/d55/d96/d98/cf5 0 2024-09-13T21:40:27.798 INFO:tasks.workunit.client.0.smithi088.stdout:3/805: mkdir d5/d23/d2a/d6b/d98/dfc 0 2024-09-13T21:40:27.800 INFO:tasks.workunit.client.0.smithi088.stdout:8/716: rename db/d26/f35 to db/df/da7/d88/db3/fed 0 2024-09-13T21:40:27.800 INFO:tasks.workunit.client.0.smithi088.stdout:6/788: mknod d0/d2c/d32/d39/d3f/cf6 0 2024-09-13T21:40:27.801 INFO:tasks.workunit.client.0.smithi088.stdout:0/778: dread d7/f7b [0,4194304] 0 2024-09-13T21:40:27.802 INFO:tasks.workunit.client.0.smithi088.stdout:0/779: chown d7/d1d/d66/d8b/lb1 241077 1 2024-09-13T21:40:27.802 INFO:tasks.workunit.client.0.smithi088.stdout:0/780: write d7/d2c/d30/d31/d42/d4b/f85 [1359322,117715] 0 2024-09-13T21:40:27.802 INFO:tasks.workunit.client.0.smithi088.stdout:0/781: chown d7/d1d/d26/d45/fac 493 1 2024-09-13T21:40:27.809 INFO:tasks.workunit.client.0.smithi088.stdout:6/789: dread d0/d1e/d1f/d55/fc5 [0,4194304] 0 2024-09-13T21:40:27.809 INFO:tasks.workunit.client.0.smithi088.stdout:7/621: write d6/d5f/d69/d4f/f41 [2835447,84744] 0 2024-09-13T21:40:27.809 INFO:tasks.workunit.client.0.smithi088.stdout:7/622: creat d6/d5f/d69/d45/fcc x:0 0 0 2024-09-13T21:40:27.810 INFO:tasks.workunit.client.0.smithi088.stdout:0/782: dread d7/f46 [4194304,4194304] 0 2024-09-13T21:40:27.810 INFO:tasks.workunit.client.0.smithi088.stdout:0/783: chown d7/d2c 47650 1 2024-09-13T21:40:27.810 INFO:tasks.workunit.client.0.smithi088.stdout:3/806: dread d5/d23/d2a/d6b/d9e/fec [0,4194304] 0 2024-09-13T21:40:27.810 INFO:tasks.workunit.client.0.smithi088.stdout:7/623: mknod d6/da/db7/ccd 0 2024-09-13T21:40:27.810 INFO:tasks.workunit.client.0.smithi088.stdout:5/848: dwrite d4/d1c/d24/d26/dbf/d89/dc9/dd1/ff6 [0,4194304] 0 2024-09-13T21:40:27.811 INFO:tasks.workunit.client.0.smithi088.stdout:1/757: dwrite d9/d10/d2a/d47/fe0 [0,4194304] 0 2024-09-13T21:40:27.812 INFO:tasks.workunit.client.0.smithi088.stdout:0/784: link d7/d1d/d21/d82/fd7 d7/d2c/d30/f10d 0 2024-09-13T21:40:27.812 INFO:tasks.workunit.client.0.smithi088.stdout:0/785: fdatasync d7/d2c/d30/d31/fb6 0 2024-09-13T21:40:27.813 INFO:tasks.workunit.client.0.smithi088.stdout:8/717: dread db/df/da7/d88/db3/fed [0,4194304] 0 2024-09-13T21:40:27.814 INFO:tasks.workunit.client.0.smithi088.stdout:2/764: dwrite d1/d8/d24/f39 [0,4194304] 0 2024-09-13T21:40:27.814 INFO:tasks.workunit.client.0.smithi088.stdout:2/765: fsync d1/f4 0 2024-09-13T21:40:27.814 INFO:tasks.workunit.client.0.smithi088.stdout:2/766: write d1/d8/d2e/d3b/dff/d3f/d99/f9d [840682,20466] 0 2024-09-13T21:40:27.822 INFO:tasks.workunit.client.0.smithi088.stdout:0/786: mknod d7/d2c/d30/d31/d42/c10e 0 2024-09-13T21:40:27.823 INFO:tasks.workunit.client.0.smithi088.stdout:7/624: mknod d6/cce 0 2024-09-13T21:40:27.825 INFO:tasks.workunit.client.0.smithi088.stdout:8/718: creat db/d26/d2c/d85/d51/fee x:0 0 0 2024-09-13T21:40:27.827 INFO:tasks.workunit.client.0.smithi088.stdout:3/807: dwrite d5/d14/fc6 [0,4194304] 0 2024-09-13T21:40:27.827 INFO:tasks.workunit.client.0.smithi088.stdout:3/808: chown d5/l45 1 1 2024-09-13T21:40:27.827 INFO:tasks.workunit.client.0.smithi088.stdout:3/809: fdatasync d5/d23/d2a/d63/d31/f7e 0 2024-09-13T21:40:27.831 INFO:tasks.workunit.client.0.smithi088.stdout:2/767: rmdir d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dfc 0 2024-09-13T21:40:27.831 INFO:tasks.workunit.client.0.smithi088.stdout:2/768: chown d1/d8/d2e/d91/db3 183111278 1 2024-09-13T21:40:27.832 INFO:tasks.workunit.client.0.smithi088.stdout:2/769: chown d1/d8/d2e/d3b/dff/d2a/d3c 3227647 1 2024-09-13T21:40:27.832 INFO:tasks.workunit.client.0.smithi088.stdout:2/770: chown d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/l6d 12 1 2024-09-13T21:40:27.832 INFO:tasks.workunit.client.0.smithi088.stdout:2/771: truncate d1/d8/d2e/d3b/dff/d2a/d41/d48/da0/fe1 52261 0 2024-09-13T21:40:27.832 INFO:tasks.workunit.client.0.smithi088.stdout:5/849: creat d4/d1c/d24/d26/dbf/d89/ddc/f118 x:0 0 0 2024-09-13T21:40:27.833 INFO:tasks.workunit.client.0.smithi088.stdout:5/850: chown d4/d1c/d4a/d63/d6a/f6b 7345 1 2024-09-13T21:40:27.833 INFO:tasks.workunit.client.0.smithi088.stdout:7/625: write d6/d5f/f72 [3925482,129578] 0 2024-09-13T21:40:27.833 INFO:tasks.workunit.client.0.smithi088.stdout:7/626: chown d6/d5f/d69/d4f/f48 22 1 2024-09-13T21:40:27.835 INFO:tasks.workunit.client.0.smithi088.stdout:8/719: unlink db/d26/d37/d7d/fc8 0 2024-09-13T21:40:27.840 INFO:tasks.workunit.client.0.smithi088.stdout:5/851: symlink d4/d1c/d24/d26/dbf/d89/dc9/dcb/l119 0 2024-09-13T21:40:27.843 INFO:tasks.workunit.client.0.smithi088.stdout:7/627: write d6/d5f/d69/d4f/d6f/f92 [792791,43348] 0 2024-09-13T21:40:27.843 INFO:tasks.workunit.client.0.smithi088.stdout:5/852: symlink d4/d1c/d24/d26/dbf/d89/l11a 0 2024-09-13T21:40:27.843 INFO:tasks.workunit.client.0.smithi088.stdout:5/853: dread - d4/d1c/d24/d26/d56/f70 zero size 2024-09-13T21:40:27.845 INFO:tasks.workunit.client.0.smithi088.stdout:7/628: mknod d6/da/d44/ccf 0 2024-09-13T21:40:27.845 INFO:tasks.workunit.client.0.smithi088.stdout:7/629: readlink d6/da/lc1 0 2024-09-13T21:40:27.845 INFO:tasks.workunit.client.0.smithi088.stdout:7/630: fdatasync d6/da/f38 0 2024-09-13T21:40:27.846 INFO:tasks.workunit.client.0.smithi088.stdout:5/854: mknod d4/d1c/d24/d26/d40/db6/c11b 0 2024-09-13T21:40:27.846 INFO:tasks.workunit.client.0.smithi088.stdout:8/720: dread db/df/f67 [0,4194304] 0 2024-09-13T21:40:27.846 INFO:tasks.workunit.client.0.smithi088.stdout:8/721: write db/df/d61/fa9 [88539,91229] 0 2024-09-13T21:40:27.847 INFO:tasks.workunit.client.0.smithi088.stdout:7/631: symlink d6/da/db7/ld0 0 2024-09-13T21:40:27.848 INFO:tasks.workunit.client.0.smithi088.stdout:7/632: creat d6/da/d1a/fd1 x:0 0 0 2024-09-13T21:40:27.850 INFO:tasks.workunit.client.0.smithi088.stdout:7/633: mknod d6/d5f/d69/d45/cd2 0 2024-09-13T21:40:27.853 INFO:tasks.workunit.client.0.smithi088.stdout:0/787: dwrite d7/d65/ff7 [0,4194304] 0 2024-09-13T21:40:27.853 INFO:tasks.workunit.client.0.smithi088.stdout:0/788: fsync d7/d1d/d27/f6f 0 2024-09-13T21:40:27.853 INFO:tasks.workunit.client.0.smithi088.stdout:3/810: dwrite d5/f16 [0,4194304] 0 2024-09-13T21:40:27.854 INFO:tasks.workunit.client.0.smithi088.stdout:2/772: write d1/d8/f19 [1382722,23924] 0 2024-09-13T21:40:27.859 INFO:tasks.workunit.client.0.smithi088.stdout:0/789: getdents d7/d1d/d3d/dae 0 2024-09-13T21:40:27.859 INFO:tasks.workunit.client.0.smithi088.stdout:0/790: chown d7/d1d/d27/d43/cfb 519412522 1 2024-09-13T21:40:27.862 INFO:tasks.workunit.client.0.smithi088.stdout:3/811: stat d5/f38 0 2024-09-13T21:40:27.862 INFO:tasks.workunit.client.0.smithi088.stdout:3/812: read d5/d23/d2a/f40 [433208,45077] 0 2024-09-13T21:40:27.868 INFO:tasks.workunit.client.0.smithi088.stdout:2/773: symlink d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dd8/l107 0 2024-09-13T21:40:27.870 INFO:tasks.workunit.client.0.smithi088.stdout:0/791: mkdir d7/d1d/d66/d8b/d10c/d10f 0 2024-09-13T21:40:27.871 INFO:tasks.workunit.client.0.smithi088.stdout:0/792: mknod d7/d2c/d30/dbe/c110 0 2024-09-13T21:40:27.872 INFO:tasks.workunit.client.0.smithi088.stdout:7/634: dread d6/f18 [0,4194304] 0 2024-09-13T21:40:27.872 INFO:tasks.workunit.client.0.smithi088.stdout:0/793: mkdir d7/d1d/d3d/dae/d111 0 2024-09-13T21:40:27.872 INFO:tasks.workunit.client.0.smithi088.stdout:0/794: getdents d7/d2c/d30/dbe/dce 0 2024-09-13T21:40:27.873 INFO:tasks.workunit.client.0.smithi088.stdout:0/795: mknod d7/d1d/d26/d34/c112 0 2024-09-13T21:40:27.875 INFO:tasks.workunit.client.0.smithi088.stdout:0/796: link d7/d65/f22 d7/d2c/d30/d31/d42/d4b/f113 0 2024-09-13T21:40:27.875 INFO:tasks.workunit.client.0.smithi088.stdout:0/797: readlink d7/l79 0 2024-09-13T21:40:27.876 INFO:tasks.workunit.client.0.smithi088.stdout:0/798: mkdir d7/d2c/d30/d31/d42/d95/d114 0 2024-09-13T21:40:27.903 INFO:tasks.workunit.client.0.smithi088.stdout:5/855: dwrite d4/f31 [0,4194304] 0 2024-09-13T21:40:27.903 INFO:tasks.workunit.client.0.smithi088.stdout:5/856: chown d4/d1c/d24/d26/cf9 0 1 2024-09-13T21:40:27.905 INFO:tasks.workunit.client.0.smithi088.stdout:3/813: dwrite d5/f22 [4194304,4194304] 0 2024-09-13T21:40:27.905 INFO:tasks.workunit.client.0.smithi088.stdout:8/722: dwrite db/d26/d2c/fb1 [0,4194304] 0 2024-09-13T21:40:27.905 INFO:tasks.workunit.client.0.smithi088.stdout:2/774: dwrite d1/d8/d16/f5c [0,4194304] 0 2024-09-13T21:40:27.906 INFO:tasks.workunit.client.0.smithi088.stdout:8/723: write db/d26/d2c/fcf [4529618,20461] 0 2024-09-13T21:40:27.906 INFO:tasks.workunit.client.0.smithi088.stdout:8/724: fsync db/d26/d2c/d85/f89 0 2024-09-13T21:40:27.906 INFO:tasks.workunit.client.0.smithi088.stdout:8/725: creat db/d26/fef x:0 0 0 2024-09-13T21:40:27.907 INFO:tasks.workunit.client.0.smithi088.stdout:2/775: read d1/d8/d2e/d44/f92 [416895,41690] 0 2024-09-13T21:40:27.911 INFO:tasks.workunit.client.0.smithi088.stdout:8/726: creat db/d26/d37/d7d/ff0 x:0 0 0 2024-09-13T21:40:27.915 INFO:tasks.workunit.client.0.smithi088.stdout:8/727: write db/df/f80 [2125954,19876] 0 2024-09-13T21:40:27.916 INFO:tasks.workunit.client.0.smithi088.stdout:9/634: sync 2024-09-13T21:40:27.916 INFO:tasks.workunit.client.0.smithi088.stdout:4/712: sync 2024-09-13T21:40:27.919 INFO:tasks.workunit.client.0.smithi088.stdout:1/758: sync 2024-09-13T21:40:27.919 INFO:tasks.workunit.client.0.smithi088.stdout:6/790: sync 2024-09-13T21:40:27.919 INFO:tasks.workunit.client.0.smithi088.stdout:1/759: fdatasync d9/d10/d2a/fc5 0 2024-09-13T21:40:27.919 INFO:tasks.workunit.client.0.smithi088.stdout:1/760: truncate d9/d10/d2a/d4b/d33/dad/dbb/fc9 458007 0 2024-09-13T21:40:27.919 INFO:tasks.workunit.client.0.smithi088.stdout:1/761: write d9/d4f/d64/fd3 [1019365,11233] 0 2024-09-13T21:40:27.919 INFO:tasks.workunit.client.0.smithi088.stdout:1/762: readlink d9/d10/d2a/d4b/d3a/dcd/ld0 0 2024-09-13T21:40:27.929 INFO:tasks.workunit.client.0.smithi088.stdout:6/791: read d0/d2c/d32/d39/faa [2165272,4361] 0 2024-09-13T21:40:27.929 INFO:tasks.workunit.client.0.smithi088.stdout:6/792: dread - d0/d28/da3/fc9 zero size 2024-09-13T21:40:27.931 INFO:tasks.workunit.client.0.smithi088.stdout:2/776: dwrite d1/d8/d2e/d3b/dff/f2c [4194304,4194304] 0 2024-09-13T21:40:27.934 INFO:tasks.workunit.client.0.smithi088.stdout:2/777: mkdir d1/d8/d2e/d3b/dff/d2a/d3c/de9/d108 0 2024-09-13T21:40:27.934 INFO:tasks.workunit.client.0.smithi088.stdout:5/857: dwrite d4/d1c/d24/d26/dbf/d89/dc9/dd1/ff6 [0,4194304] 0 2024-09-13T21:40:27.935 INFO:tasks.workunit.client.0.smithi088.stdout:8/728: dread db/d26/f45 [0,4194304] 0 2024-09-13T21:40:27.935 INFO:tasks.workunit.client.0.smithi088.stdout:8/729: readlink db/d26/d2c/d85/dad/lae 0 2024-09-13T21:40:27.935 INFO:tasks.workunit.client.0.smithi088.stdout:2/778: creat d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/d89/f109 x:0 0 0 2024-09-13T21:40:27.935 INFO:tasks.workunit.client.0.smithi088.stdout:2/779: stat d1/d8/d2e/d3b/dff/d2a/d41/d82/fed 0 2024-09-13T21:40:27.937 INFO:tasks.workunit.client.0.smithi088.stdout:8/730: creat db/df/da7/d88/ddd/ff1 x:0 0 0 2024-09-13T21:40:27.937 INFO:tasks.workunit.client.0.smithi088.stdout:8/731: read - db/df/da7/fe6 zero size 2024-09-13T21:40:27.938 INFO:tasks.workunit.client.0.smithi088.stdout:5/858: link d4/d1c/d24/d26/dbf/dc6/dc7/fd4 d4/d1b/d68/f11c 0 2024-09-13T21:40:27.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/859: dread d4/d1c/d4a/f5d [0,4194304] 0 2024-09-13T21:40:27.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/860: dread - d4/d1b/fe6 zero size 2024-09-13T21:40:27.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/861: stat d4/d1c/d24/d26/d56/fd3 0 2024-09-13T21:40:27.952 INFO:tasks.workunit.client.0.smithi088.stdout:5/862: read d4/da7/fc2 [1087365,128591] 0 2024-09-13T21:40:27.952 INFO:tasks.workunit.client.0.smithi088.stdout:4/713: dwrite d2/d13/f86 [4194304,4194304] 0 2024-09-13T21:40:27.953 INFO:tasks.workunit.client.0.smithi088.stdout:4/714: dread - d2/d5/d2d/d70/fe1 zero size 2024-09-13T21:40:27.953 INFO:tasks.workunit.client.0.smithi088.stdout:4/715: chown d2/d5/d20/d60/de 397345424 1 2024-09-13T21:40:27.953 INFO:tasks.workunit.client.0.smithi088.stdout:5/863: dread d4/d1c/d24/d26/d40/f5a [4194304,4194304] 0 2024-09-13T21:40:27.954 INFO:tasks.workunit.client.0.smithi088.stdout:5/864: rename d4/d1c/d24/d95/f108 to d4/d1c/d24/d26/d4b/d67/f11d 0 2024-09-13T21:40:27.955 INFO:tasks.workunit.client.0.smithi088.stdout:4/716: write d2/f15 [4542804,60989] 0 2024-09-13T21:40:27.955 INFO:tasks.workunit.client.0.smithi088.stdout:5/865: write d4/d1b/faf [212404,1764] 0 2024-09-13T21:40:27.956 INFO:tasks.workunit.client.0.smithi088.stdout:4/717: creat d2/d11/dab/fe6 x:0 0 0 2024-09-13T21:40:27.957 INFO:tasks.workunit.client.0.smithi088.stdout:1/763: dwrite d9/fd [0,4194304] 0 2024-09-13T21:40:27.957 INFO:tasks.workunit.client.0.smithi088.stdout:1/764: write d9/dc/d52/dba/f9b [3728582,41078] 0 2024-09-13T21:40:27.959 INFO:tasks.workunit.client.0.smithi088.stdout:1/765: read d9/d10/d2a/d4b/d33/f91 [8921503,49147] 0 2024-09-13T21:40:27.960 INFO:tasks.workunit.client.0.smithi088.stdout:1/766: creat d9/dc/d52/dba/f10b x:0 0 0 2024-09-13T21:40:27.960 INFO:tasks.workunit.client.0.smithi088.stdout:1/767: chown d9/d10/d2a/d47/d9c/ca7 0 1 2024-09-13T21:40:27.962 INFO:tasks.workunit.client.0.smithi088.stdout:1/768: rename d9/d4f/dd5 to d9/d10/d2a/d4b/d3a/d10c 0 2024-09-13T21:40:27.965 INFO:tasks.workunit.client.0.smithi088.stdout:6/793: dwrite d0/d1e/d1f/d55/d8f/fdd [0,4194304] 0 2024-09-13T21:40:27.969 INFO:tasks.workunit.client.0.smithi088.stdout:6/794: creat d0/d2c/d7f/db1/ff7 x:0 0 0 2024-09-13T21:40:27.971 INFO:tasks.workunit.client.0.smithi088.stdout:6/795: creat d0/d2c/d8b/ddb/ff8 x:0 0 0 2024-09-13T21:40:27.971 INFO:tasks.workunit.client.0.smithi088.stdout:4/718: dread d2/d13/f86 [4194304,4194304] 0 2024-09-13T21:40:27.972 INFO:tasks.workunit.client.0.smithi088.stdout:6/796: mkdir d0/d28/da3/df9 0 2024-09-13T21:40:27.972 INFO:tasks.workunit.client.0.smithi088.stdout:6/797: fdatasync d0/f52 0 2024-09-13T21:40:27.973 INFO:tasks.workunit.client.0.smithi088.stdout:4/719: symlink d2/d5/d2d/le7 0 2024-09-13T21:40:27.975 INFO:tasks.workunit.client.0.smithi088.stdout:4/720: creat d2/d81/de3/fe8 x:0 0 0 2024-09-13T21:40:27.976 INFO:tasks.workunit.client.0.smithi088.stdout:2/780: dwrite d1/d8/d24/d78/d7f/fe6 [0,4194304] 0 2024-09-13T21:40:27.976 INFO:tasks.workunit.client.0.smithi088.stdout:4/721: mkdir d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79/de9 0 2024-09-13T21:40:27.981 INFO:tasks.workunit.client.0.smithi088.stdout:2/781: dread d1/d8/d2e/d3b/dff/f1a [4194304,4194304] 0 2024-09-13T21:40:27.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/722: dread d2/d5/d20/d60/de/f76 [0,4194304] 0 2024-09-13T21:40:27.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/723: write d2/d5/d2d/d70/fc8 [1138750,61287] 0 2024-09-13T21:40:27.983 INFO:tasks.workunit.client.0.smithi088.stdout:4/724: chown d2/d5/d20/d60/de/f58 11154063 1 2024-09-13T21:40:27.983 INFO:tasks.workunit.client.0.smithi088.stdout:4/725: write d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 [1535386,25022] 0 2024-09-13T21:40:27.985 INFO:tasks.workunit.client.0.smithi088.stdout:4/726: mkdir d2/d5/d20/d60/de/d1e/d23/d3c/dea 0 2024-09-13T21:40:27.985 INFO:tasks.workunit.client.0.smithi088.stdout:4/727: readlink d2/d5/l6b 0 2024-09-13T21:40:27.986 INFO:tasks.workunit.client.0.smithi088.stdout:5/866: dwrite d4/d1c/d4a/fe4 [0,4194304] 0 2024-09-13T21:40:27.986 INFO:tasks.workunit.client.0.smithi088.stdout:8/732: dwrite db/f9b [0,4194304] 0 2024-09-13T21:40:27.986 INFO:tasks.workunit.client.0.smithi088.stdout:8/733: stat db/df/da7/fcd 0 2024-09-13T21:40:27.986 INFO:tasks.workunit.client.0.smithi088.stdout:5/867: write d4/d1c/f4e [95944,55850] 0 2024-09-13T21:40:27.986 INFO:tasks.workunit.client.0.smithi088.stdout:4/728: truncate d2/d5/f14 4031623 0 2024-09-13T21:40:27.986 INFO:tasks.workunit.client.0.smithi088.stdout:5/868: read d4/d1c/d24/d26/d40/f49 [128477,29562] 0 2024-09-13T21:40:27.987 INFO:tasks.workunit.client.0.smithi088.stdout:8/734: dread db/df/d61/d97/faf [0,4194304] 0 2024-09-13T21:40:28.000 INFO:tasks.workunit.client.0.smithi088.stdout:5/869: write d4/d1c/d24/d26/f6c [2906530,128964] 0 2024-09-13T21:40:28.001 INFO:tasks.workunit.client.0.smithi088.stdout:5/870: readlink d4/d1b/d68/lda 0 2024-09-13T21:40:28.002 INFO:tasks.workunit.client.0.smithi088.stdout:5/871: stat d4/d1b/d68/f9c 0 2024-09-13T21:40:28.005 INFO:tasks.workunit.client.0.smithi088.stdout:6/798: dwrite d0/d2c/fcd [0,4194304] 0 2024-09-13T21:40:28.012 INFO:tasks.workunit.client.0.smithi088.stdout:1/769: dwrite d9/d10/d2a/d4b/d3a/dcd/ff3 [0,4194304] 0 2024-09-13T21:40:28.012 INFO:tasks.workunit.client.0.smithi088.stdout:8/735: dread db/f9b [0,4194304] 0 2024-09-13T21:40:28.016 INFO:tasks.workunit.client.0.smithi088.stdout:1/770: truncate d9/d10/d2a/d4b/d3a/ff9 831795 0 2024-09-13T21:40:28.018 INFO:tasks.workunit.client.0.smithi088.stdout:2/782: dwrite d1/d8/d2e/d3b/dff/d2a/d41/d48/fea [0,4194304] 0 2024-09-13T21:40:28.018 INFO:tasks.workunit.client.0.smithi088.stdout:5/872: dread d4/d1c/d24/d26/fe0 [0,4194304] 0 2024-09-13T21:40:28.021 INFO:tasks.workunit.client.0.smithi088.stdout:8/736: mkdir db/df/da7/d88/da8/db4/df2 0 2024-09-13T21:40:28.021 INFO:tasks.workunit.client.0.smithi088.stdout:8/737: chown db/df/f3d 851987804 1 2024-09-13T21:40:28.021 INFO:tasks.workunit.client.0.smithi088.stdout:8/738: write db/df/d61/fa9 [1209676,54327] 0 2024-09-13T21:40:28.021 INFO:tasks.workunit.client.0.smithi088.stdout:1/771: mkdir d9/d10/d9f/dfe/d10d 0 2024-09-13T21:40:28.021 INFO:tasks.workunit.client.0.smithi088.stdout:1/772: write d9/d4f/f106 [759706,61169] 0 2024-09-13T21:40:28.021 INFO:tasks.workunit.client.0.smithi088.stdout:1/773: write d9/d10/d2a/d4b/d33/d92/dbe/fcb [4505363,44346] 0 2024-09-13T21:40:28.024 INFO:tasks.workunit.client.0.smithi088.stdout:4/729: dread d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 [0,4194304] 0 2024-09-13T21:40:28.024 INFO:tasks.workunit.client.0.smithi088.stdout:8/739: symlink db/df/d61/lf3 0 2024-09-13T21:40:28.025 INFO:tasks.workunit.client.0.smithi088.stdout:8/740: truncate db/d26/d2c/d85/f83 188684 0 2024-09-13T21:40:28.028 INFO:tasks.workunit.client.0.smithi088.stdout:1/774: rename d9/dc/l26 to d9/d10/d2a/d47/d9c/l10e 0 2024-09-13T21:40:28.028 INFO:tasks.workunit.client.0.smithi088.stdout:5/873: write d4/d1c/d4a/d8a/ff2 [532149,126508] 0 2024-09-13T21:40:28.029 INFO:tasks.workunit.client.0.smithi088.stdout:4/730: truncate d2/d5/d20/d60/de/d1e/f37 198521 0 2024-09-13T21:40:28.031 INFO:tasks.workunit.client.0.smithi088.stdout:4/731: dread d2/d81/f82 [0,4194304] 0 2024-09-13T21:40:28.032 INFO:tasks.workunit.client.0.smithi088.stdout:5/874: truncate d4/d1c/d24/f41 2094853 0 2024-09-13T21:40:28.033 INFO:tasks.workunit.client.0.smithi088.stdout:1/775: getdents d9/d10/d2a/d4b/d3a/dcd 0 2024-09-13T21:40:28.035 INFO:tasks.workunit.client.0.smithi088.stdout:6/799: dwrite d0/d2c/d32/d39/d3f/d71/d81/fa4 [0,4194304] 0 2024-09-13T21:40:28.036 INFO:tasks.workunit.client.0.smithi088.stdout:6/800: creat d0/db/ffa x:0 0 0 2024-09-13T21:40:28.036 INFO:tasks.workunit.client.0.smithi088.stdout:4/732: rename d2/d5/d20/d60/de/d1e/d31/f3b to d2/d13/feb 0 2024-09-13T21:40:28.037 INFO:tasks.workunit.client.0.smithi088.stdout:5/875: mkdir d4/d1c/d24/d26/d117/d11e 0 2024-09-13T21:40:28.037 INFO:tasks.workunit.client.0.smithi088.stdout:5/876: creat d4/d1c/d24/f11f x:0 0 0 2024-09-13T21:40:28.038 INFO:tasks.workunit.client.0.smithi088.stdout:1/776: mkdir d9/d10/d2a/d4b/d39/dda/d10a/d10f 0 2024-09-13T21:40:28.038 INFO:tasks.workunit.client.0.smithi088.stdout:1/777: dread - d9/d10/d2a/d4b/d33/ff7 zero size 2024-09-13T21:40:28.041 INFO:tasks.workunit.client.0.smithi088.stdout:3/814: sync 2024-09-13T21:40:28.041 INFO:tasks.workunit.client.0.smithi088.stdout:9/635: sync 2024-09-13T21:40:28.041 INFO:tasks.workunit.client.0.smithi088.stdout:7/635: sync 2024-09-13T21:40:28.041 INFO:tasks.workunit.client.0.smithi088.stdout:0/799: sync 2024-09-13T21:40:28.041 INFO:tasks.workunit.client.0.smithi088.stdout:3/815: write d5/d23/f57 [337305,74128] 0 2024-09-13T21:40:28.042 INFO:tasks.workunit.client.0.smithi088.stdout:6/801: creat d0/d1e/d66/ffb x:0 0 0 2024-09-13T21:40:28.042 INFO:tasks.workunit.client.0.smithi088.stdout:4/733: truncate d2/d5/f55 4143110 0 2024-09-13T21:40:28.042 INFO:tasks.workunit.client.0.smithi088.stdout:4/734: fsync d2/d5/d20/d60/f2a 0 2024-09-13T21:40:28.042 INFO:tasks.workunit.client.0.smithi088.stdout:4/735: readlink d2/d5/d20/d60/de/d1e/d31/l4c 0 2024-09-13T21:40:28.043 INFO:tasks.workunit.client.0.smithi088.stdout:2/783: dwrite d1/f68 [4194304,4194304] 0 2024-09-13T21:40:28.043 INFO:tasks.workunit.client.0.smithi088.stdout:2/784: readlink d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/d89/dcc/le8 0 2024-09-13T21:40:28.046 INFO:tasks.workunit.client.0.smithi088.stdout:5/877: creat d4/d1c/d24/d26/dfe/f120 x:0 0 0 2024-09-13T21:40:28.046 INFO:tasks.workunit.client.0.smithi088.stdout:5/878: chown d4/d1c/d24/d26/dbf/de8/la4 2304160 1 2024-09-13T21:40:28.049 INFO:tasks.workunit.client.0.smithi088.stdout:9/636: link d1a/f23 d1a/d1b/db9/fc3 0 2024-09-13T21:40:28.051 INFO:tasks.workunit.client.0.smithi088.stdout:0/800: rename d7/d1d/d26/d45/l7f to d7/d2c/d37/l115 0 2024-09-13T21:40:28.053 INFO:tasks.workunit.client.0.smithi088.stdout:7/636: mkdir d6/d5f/d69/da8/dd3 0 2024-09-13T21:40:28.054 INFO:tasks.workunit.client.0.smithi088.stdout:3/816: symlink d5/d23/lfd 0 2024-09-13T21:40:28.057 INFO:tasks.workunit.client.0.smithi088.stdout:0/801: dread d7/d2c/d30/d31/d42/fa8 [0,4194304] 0 2024-09-13T21:40:28.057 INFO:tasks.workunit.client.0.smithi088.stdout:0/802: write d7/d1d/d27/f64 [2899434,67744] 0 2024-09-13T21:40:28.061 INFO:tasks.workunit.client.0.smithi088.stdout:2/785: link d1/d8/d2e/d3b/dff/c51 d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d66/c10a 0 2024-09-13T21:40:28.062 INFO:tasks.workunit.client.0.smithi088.stdout:6/802: dwrite d0/d28/f40 [4194304,4194304] 0 2024-09-13T21:40:28.063 INFO:tasks.workunit.client.0.smithi088.stdout:1/778: dwrite d9/d10/d2a/d4b/d39/d43/f93 [4194304,4194304] 0 2024-09-13T21:40:28.063 INFO:tasks.workunit.client.0.smithi088.stdout:5/879: mknod d4/d1c/d24/d26/dbf/dc6/dc7/c121 0 2024-09-13T21:40:28.065 INFO:tasks.workunit.client.0.smithi088.stdout:9/637: unlink d1a/d1b/l33 0 2024-09-13T21:40:28.066 INFO:tasks.workunit.client.0.smithi088.stdout:7/637: rename d6/da/d44/c55 to d6/d5f/d69/da8/cd4 0 2024-09-13T21:40:28.066 INFO:tasks.workunit.client.0.smithi088.stdout:7/638: stat d6/da/dc8 0 2024-09-13T21:40:28.067 INFO:tasks.workunit.client.0.smithi088.stdout:4/736: rmdir d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79 39 2024-09-13T21:40:28.067 INFO:tasks.workunit.client.0.smithi088.stdout:3/817: dread d5/d23/d2a/d3f/db4/fe1 [0,4194304] 0 2024-09-13T21:40:28.067 INFO:tasks.workunit.client.0.smithi088.stdout:3/818: write d5/d23/d2a/d63/f97 [4350638,127207] 0 2024-09-13T21:40:28.067 INFO:tasks.workunit.client.0.smithi088.stdout:3/819: chown d5/d23/d2a/d63/d48/d49/fa7 6387 1 2024-09-13T21:40:28.067 INFO:tasks.workunit.client.0.smithi088.stdout:3/820: read - d5/d5a/fd7 zero size 2024-09-13T21:40:28.068 INFO:tasks.workunit.client.0.smithi088.stdout:3/821: truncate d5/d23/d2a/d3f/d76/d81/ff7 237243 0 2024-09-13T21:40:28.069 INFO:tasks.workunit.client.0.smithi088.stdout:2/786: rmdir d1/d8/d24/d78 39 2024-09-13T21:40:28.073 INFO:tasks.workunit.client.0.smithi088.stdout:2/787: dread d1/d8/d24/d78/d7f/fd6 [0,4194304] 0 2024-09-13T21:40:28.073 INFO:tasks.workunit.client.0.smithi088.stdout:1/779: symlink d9/d10/d2a/d4b/d33/dad/l110 0 2024-09-13T21:40:28.077 INFO:tasks.workunit.client.0.smithi088.stdout:5/880: creat d4/d1c/f122 x:0 0 0 2024-09-13T21:40:28.078 INFO:tasks.workunit.client.0.smithi088.stdout:2/788: chown d1/d8/c33 632 1 2024-09-13T21:40:28.079 INFO:tasks.workunit.client.0.smithi088.stdout:9/638: dread d1a/d3c/faa [0,4194304] 0 2024-09-13T21:40:28.079 INFO:tasks.workunit.client.0.smithi088.stdout:9/639: stat d1a/d1b/f74 0 2024-09-13T21:40:28.080 INFO:tasks.workunit.client.0.smithi088.stdout:1/780: unlink d9/dc/d52/dba/c101 0 2024-09-13T21:40:28.080 INFO:tasks.workunit.client.0.smithi088.stdout:5/881: mknod d4/d1c/d24/d26/dbf/d89/d92/c123 0 2024-09-13T21:40:28.080 INFO:tasks.workunit.client.0.smithi088.stdout:4/737: read f1 [2523252,6738] 0 2024-09-13T21:40:28.081 INFO:tasks.workunit.client.0.smithi088.stdout:1/781: mknod d9/d10/d2a/d4b/d39/dda/c111 0 2024-09-13T21:40:28.081 INFO:tasks.workunit.client.0.smithi088.stdout:1/782: read d9/dc/fb9 [434984,8331] 0 2024-09-13T21:40:28.081 INFO:tasks.workunit.client.0.smithi088.stdout:1/783: creat d9/d10/d2a/d4b/d39/d43/db2/f112 x:0 0 0 2024-09-13T21:40:28.081 INFO:tasks.workunit.client.0.smithi088.stdout:4/738: dread d2/d5/d20/d60/de/d1e/d31/f7d [4194304,4194304] 0 2024-09-13T21:40:28.086 INFO:tasks.workunit.client.0.smithi088.stdout:4/739: dread d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 [0,4194304] 0 2024-09-13T21:40:28.087 INFO:tasks.workunit.client.0.smithi088.stdout:6/803: dwrite d0/d2c/d8b/ff4 [0,4194304] 0 2024-09-13T21:40:28.087 INFO:tasks.workunit.client.0.smithi088.stdout:3/822: dwrite d5/d23/d2a/d63/fe3 [0,4194304] 0 2024-09-13T21:40:28.089 INFO:tasks.workunit.client.0.smithi088.stdout:3/823: write d5/d23/d2a/f51 [1155237,37272] 0 2024-09-13T21:40:28.089 INFO:tasks.workunit.client.0.smithi088.stdout:3/824: creat d5/d14/ffe x:0 0 0 2024-09-13T21:40:28.089 INFO:tasks.workunit.client.0.smithi088.stdout:3/825: chown d5/d23/d2a/f51 858109 1 2024-09-13T21:40:28.092 INFO:tasks.workunit.client.0.smithi088.stdout:9/640: write d1a/f3b [2843946,89438] 0 2024-09-13T21:40:28.092 INFO:tasks.workunit.client.0.smithi088.stdout:9/641: chown d1a/d61/d3d/d41/d48/la8 59 1 2024-09-13T21:40:28.092 INFO:tasks.workunit.client.0.smithi088.stdout:9/642: write d1a/d1b/f74 [3547284,120402] 0 2024-09-13T21:40:28.092 INFO:tasks.workunit.client.0.smithi088.stdout:2/789: write d1/d8/d2e/d3b/dff/f1a [3487852,63020] 0 2024-09-13T21:40:28.123 INFO:tasks.workunit.client.0.smithi088.stdout:5/882: creat d4/d1c/d24/d26/d4b/d67/db2/f124 x:0 0 0 2024-09-13T21:40:28.125 INFO:tasks.workunit.client.0.smithi088.stdout:1/784: getdents d9/d10/d9f 0 2024-09-13T21:40:28.128 INFO:tasks.workunit.client.0.smithi088.stdout:4/740: unlink d2/d81/cce 0 2024-09-13T21:40:28.135 INFO:tasks.workunit.client.0.smithi088.stdout:6/804: link d0/d2c/fdc d0/d2c/d32/d39/d3f/ffc 0 2024-09-13T21:40:28.140 INFO:tasks.workunit.client.0.smithi088.stdout:3/826: creat d5/d5a/d7f/fff x:0 0 0 2024-09-13T21:40:28.144 INFO:tasks.workunit.client.0.smithi088.stdout:9/643: creat d1a/d9e/fc4 x:0 0 0 2024-09-13T21:40:28.145 INFO:tasks.workunit.client.0.smithi088.stdout:2/790: symlink d1/l10b 0 2024-09-13T21:40:28.150 INFO:tasks.workunit.client.0.smithi088.stdout:4/741: getdents d2/d5/d20/d60/de/d1e 0 2024-09-13T21:40:28.150 INFO:tasks.workunit.client.0.smithi088.stdout:1/785: dwrite d9/d10/d2a/d4b/d33/dad/dbb/fe8 [0,4194304] 0 2024-09-13T21:40:28.150 INFO:tasks.workunit.client.0.smithi088.stdout:1/786: fsync d9/d10/dff/f109 0 2024-09-13T21:40:28.150 INFO:tasks.workunit.client.0.smithi088.stdout:1/787: chown d9/d10/d2a/d4b/d39/d43/dfb 0 1 2024-09-13T21:40:28.155 INFO:tasks.workunit.client.0.smithi088.stdout:5/883: dwrite d4/d1c/d24/d26/d4b/d67/f11d [0,4194304] 0 2024-09-13T21:40:28.156 INFO:tasks.workunit.client.0.smithi088.stdout:5/884: fsync d4/d1c/d24/d26/d40/f46 0 2024-09-13T21:40:28.160 INFO:tasks.workunit.client.0.smithi088.stdout:2/791: mknod d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dd8/c10c 0 2024-09-13T21:40:28.162 INFO:tasks.workunit.client.0.smithi088.stdout:4/742: link d2/d5/d2d/d70/fb5 d2/d5/d20/d60/de/d1e/fec 0 2024-09-13T21:40:28.167 INFO:tasks.workunit.client.0.smithi088.stdout:1/788: rename d9/d10/d2a/d4b/f23 to d9/d10/d2a/d47/d9c/db5/f113 0 2024-09-13T21:40:28.168 INFO:tasks.workunit.client.0.smithi088.stdout:3/827: dwrite d5/d23/d2a/d3f/d76/d81/f9f [0,4194304] 0 2024-09-13T21:40:28.168 INFO:tasks.workunit.client.0.smithi088.stdout:3/828: stat c4 0 2024-09-13T21:40:28.169 INFO:tasks.workunit.client.0.smithi088.stdout:9/644: dwrite d1a/d61/f89 [0,4194304] 0 2024-09-13T21:40:28.171 INFO:tasks.workunit.client.0.smithi088.stdout:6/805: rmdir d0/d1e 39 2024-09-13T21:40:28.171 INFO:tasks.workunit.client.0.smithi088.stdout:6/806: chown d0/d2c/dad/db8/cd4 1154 1 2024-09-13T21:40:28.175 INFO:tasks.workunit.client.0.smithi088.stdout:5/885: unlink d4/d1b/f85 0 2024-09-13T21:40:28.177 INFO:tasks.workunit.client.0.smithi088.stdout:4/743: creat d2/d13/fed x:0 0 0 2024-09-13T21:40:28.177 INFO:tasks.workunit.client.0.smithi088.stdout:2/792: dwrite d1/d8/d24/d78/d7f/fe6 [0,4194304] 0 2024-09-13T21:40:28.178 INFO:tasks.workunit.client.0.smithi088.stdout:4/744: write d2/d5/d20/d41/f8e [244788,96560] 0 2024-09-13T21:40:28.178 INFO:tasks.workunit.client.0.smithi088.stdout:4/745: chown d2/d5/le0 27 1 2024-09-13T21:40:28.178 INFO:tasks.workunit.client.0.smithi088.stdout:4/746: truncate d2/d13/fed 157241 0 2024-09-13T21:40:28.178 INFO:tasks.workunit.client.0.smithi088.stdout:1/789: creat d9/d10/d9f/dfe/d10d/f114 x:0 0 0 2024-09-13T21:40:28.179 INFO:tasks.workunit.client.0.smithi088.stdout:2/793: dread d1/d8/d2e/d3b/dff/d2a/d41/d48/f83 [0,4194304] 0 2024-09-13T21:40:28.179 INFO:tasks.workunit.client.0.smithi088.stdout:2/794: write d1/d8/d2e/f38 [7040981,64087] 0 2024-09-13T21:40:28.179 INFO:tasks.workunit.client.0.smithi088.stdout:2/795: readlink d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/d89/dcc/le8 0 2024-09-13T21:40:28.180 INFO:tasks.workunit.client.0.smithi088.stdout:3/829: creat d5/d23/d2a/d3f/db4/f100 x:0 0 0 2024-09-13T21:40:28.186 INFO:tasks.workunit.client.0.smithi088.stdout:6/807: symlink d0/d1e/d66/lfd 0 2024-09-13T21:40:28.187 INFO:tasks.workunit.client.0.smithi088.stdout:5/886: mknod d4/d1b/c125 0 2024-09-13T21:40:28.190 INFO:tasks.workunit.client.0.smithi088.stdout:8/741: sync 2024-09-13T21:40:28.194 INFO:tasks.workunit.client.0.smithi088.stdout:3/830: link d5/d23/d2a/d3f/cda d5/d23/d2a/d3f/d76/c101 0 2024-09-13T21:40:28.196 INFO:tasks.workunit.client.0.smithi088.stdout:9/645: rename d1a/d3c/f90 to d1a/fc5 0 2024-09-13T21:40:28.196 INFO:tasks.workunit.client.0.smithi088.stdout:9/646: truncate d1a/d1b/db9/fc2 574187 0 2024-09-13T21:40:28.196 INFO:tasks.workunit.client.0.smithi088.stdout:9/647: write d1a/fb5 [137964,7304] 0 2024-09-13T21:40:28.198 INFO:tasks.workunit.client.0.smithi088.stdout:6/808: creat d0/d2c/dad/db3/ffe x:0 0 0 2024-09-13T21:40:28.198 INFO:tasks.workunit.client.0.smithi088.stdout:7/639: sync 2024-09-13T21:40:28.198 INFO:tasks.workunit.client.0.smithi088.stdout:0/803: sync 2024-09-13T21:40:28.198 INFO:tasks.workunit.client.0.smithi088.stdout:0/804: write d7/d2c/d30/d31/d42/de2/fb3 [952293,23286] 0 2024-09-13T21:40:28.200 INFO:tasks.workunit.client.0.smithi088.stdout:1/790: rename d9/d10/d9f/fb4 to d9/d10/d2a/d4b/d39/d43/dfb/f115 0 2024-09-13T21:40:28.200 INFO:tasks.workunit.client.0.smithi088.stdout:6/809: chown d0/d1e/d1f/c57 2 1 2024-09-13T21:40:28.203 INFO:tasks.workunit.client.0.smithi088.stdout:7/640: link d6/d4e/f7b d6/d5f/d69/d4f/d6f/d70/d76/dbd/fd5 0 2024-09-13T21:40:28.205 INFO:tasks.workunit.client.0.smithi088.stdout:5/887: mknod d4/d1c/d76/c126 0 2024-09-13T21:40:28.207 INFO:tasks.workunit.client.0.smithi088.stdout:8/742: rename db/d26/d4f/f66 to db/d26/d4f/dd0/ff4 0 2024-09-13T21:40:28.207 INFO:tasks.workunit.client.0.smithi088.stdout:8/743: chown db/df/da7/d88/db3 1814526 1 2024-09-13T21:40:28.208 INFO:tasks.workunit.client.0.smithi088.stdout:9/648: dread d1a/d3c/d51/d5e/f7a [0,4194304] 0 2024-09-13T21:40:28.208 INFO:tasks.workunit.client.0.smithi088.stdout:1/791: creat d9/d10/d2a/d4b/d39/d43/d85/f116 x:0 0 0 2024-09-13T21:40:28.210 INFO:tasks.workunit.client.0.smithi088.stdout:6/810: mknod d0/d28/cff 0 2024-09-13T21:40:28.210 INFO:tasks.workunit.client.0.smithi088.stdout:6/811: creat d0/d2c/d7a/f100 x:0 0 0 2024-09-13T21:40:28.211 INFO:tasks.workunit.client.0.smithi088.stdout:7/641: mknod d6/d5f/d69/da8/dd3/cd6 0 2024-09-13T21:40:28.212 INFO:tasks.workunit.client.0.smithi088.stdout:5/888: creat d4/d1c/d4a/d63/dd0/f127 x:0 0 0 2024-09-13T21:40:28.215 INFO:tasks.workunit.client.0.smithi088.stdout:4/747: rename d2/d5/d20/d60/de/d1e/d23/d69 to d2/d13/dee 0 2024-09-13T21:40:28.215 INFO:tasks.workunit.client.0.smithi088.stdout:9/649: mkdir d1a/d61/dc6 0 2024-09-13T21:40:28.217 INFO:tasks.workunit.client.0.smithi088.stdout:6/812: creat d0/d1e/d1f/d55/f101 x:0 0 0 2024-09-13T21:40:28.217 INFO:tasks.workunit.client.0.smithi088.stdout:6/813: read - d0/d2c/d32/d39/d3f/fe2 zero size 2024-09-13T21:40:28.218 INFO:tasks.workunit.client.0.smithi088.stdout:7/642: creat d6/da/d1a/d3a/d5c/d60/fd7 x:0 0 0 2024-09-13T21:40:28.218 INFO:tasks.workunit.client.0.smithi088.stdout:7/643: chown d6/d5f/d69/f8a 999 1 2024-09-13T21:40:28.218 INFO:tasks.workunit.client.0.smithi088.stdout:7/644: getdents d6/d5f/d69/d4f/d6f/d83/d97 0 2024-09-13T21:40:28.218 INFO:tasks.workunit.client.0.smithi088.stdout:7/645: write d6/d5f/d69/d4f/f41 [2502079,111980] 0 2024-09-13T21:40:28.219 INFO:tasks.workunit.client.0.smithi088.stdout:9/650: unlink d1a/d1b/f2e 0 2024-09-13T21:40:28.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/814: rmdir d0/d1e/d66 39 2024-09-13T21:40:28.220 INFO:tasks.workunit.client.0.smithi088.stdout:8/744: read db/d26/d2c/f78 [474915,20913] 0 2024-09-13T21:40:28.220 INFO:tasks.workunit.client.0.smithi088.stdout:6/815: creat d0/d2c/d32/d39/d3f/d71/f102 x:0 0 0 2024-09-13T21:40:28.221 INFO:tasks.workunit.client.0.smithi088.stdout:4/748: symlink d2/d5/d20/d60/de/d1e/d31/d61/d99/lef 0 2024-09-13T21:40:28.221 INFO:tasks.workunit.client.0.smithi088.stdout:4/749: stat d2/d13 0 2024-09-13T21:40:28.223 INFO:tasks.workunit.client.0.smithi088.stdout:6/816: creat d0/d1e/d1f/d55/d96/f103 x:0 0 0 2024-09-13T21:40:28.225 INFO:tasks.workunit.client.0.smithi088.stdout:8/745: mknod db/d26/d2c/cf5 0 2024-09-13T21:40:28.226 INFO:tasks.workunit.client.0.smithi088.stdout:7/646: symlink d6/d5f/ld8 0 2024-09-13T21:40:28.226 INFO:tasks.workunit.client.0.smithi088.stdout:7/647: rename d6/da to d6/da/d1a/dd9 22 2024-09-13T21:40:28.227 INFO:tasks.workunit.client.0.smithi088.stdout:0/805: dwrite d7/d1d/d21/f80 [8388608,4194304] 0 2024-09-13T21:40:28.227 INFO:tasks.workunit.client.0.smithi088.stdout:4/750: creat d2/d5/d20/d60/de/d1e/d23/d6c/ff0 x:0 0 0 2024-09-13T21:40:28.227 INFO:tasks.workunit.client.0.smithi088.stdout:4/751: chown d2/d5/d20/d41/d4b 79 1 2024-09-13T21:40:28.227 INFO:tasks.workunit.client.0.smithi088.stdout:4/752: chown d2/d5/d20/d60/de/d1e/d23/f9a 164487 1 2024-09-13T21:40:28.227 INFO:tasks.workunit.client.0.smithi088.stdout:3/831: dwrite d5/d23/d2a/d63/fe3 [0,4194304] 0 2024-09-13T21:40:28.227 INFO:tasks.workunit.client.0.smithi088.stdout:2/796: dwrite d1/d8/f1b [0,4194304] 0 2024-09-13T21:40:28.227 INFO:tasks.workunit.client.0.smithi088.stdout:3/832: fsync d5/d23/d2a/d6b/d98/ddc/f7b 0 2024-09-13T21:40:28.228 INFO:tasks.workunit.client.0.smithi088.stdout:5/889: dread f2 [0,4194304] 0 2024-09-13T21:40:28.229 INFO:tasks.workunit.client.0.smithi088.stdout:8/746: link db/d26/c2f db/d26/d4f/cf6 0 2024-09-13T21:40:28.229 INFO:tasks.workunit.client.0.smithi088.stdout:8/747: fdatasync db/df/fa3 0 2024-09-13T21:40:28.234 INFO:tasks.workunit.client.0.smithi088.stdout:9/651: write d1a/d61/f89 [431974,93996] 0 2024-09-13T21:40:28.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:27 smithi088 ceph-mon[27963]: mgrmap e20: smithi088.scyrwy(active, since 7m), standbys: smithi116.bqnvtn 2024-09-13T21:40:28.239 INFO:tasks.workunit.client.0.smithi088.stdout:8/748: mknod db/d26/d4f/dd0/cf7 0 2024-09-13T21:40:28.239 INFO:tasks.workunit.client.0.smithi088.stdout:8/749: chown db/df/d61/d97/la1 587340 1 2024-09-13T21:40:28.239 INFO:tasks.workunit.client.0.smithi088.stdout:8/750: readlink db/l38 0 2024-09-13T21:40:28.241 INFO:tasks.workunit.client.0.smithi088.stdout:2/797: rename d1/d8/fe to d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/f10d 0 2024-09-13T21:40:28.242 INFO:tasks.workunit.client.0.smithi088.stdout:9/652: mknod d1a/d3c/d60/cc7 0 2024-09-13T21:40:28.242 INFO:tasks.workunit.client.0.smithi088.stdout:9/653: readlink d1a/d3c/d51/l6f 0 2024-09-13T21:40:28.243 INFO:tasks.workunit.client.0.smithi088.stdout:9/654: chown d1a/d1b 810079060 1 2024-09-13T21:40:28.244 INFO:tasks.workunit.client.0.smithi088.stdout:9/655: truncate d1a/d61/d3d/f62 4234866 0 2024-09-13T21:40:28.246 INFO:tasks.workunit.client.0.smithi088.stdout:8/751: rename db/d26/d2c/d85/d51/l75 to db/df/da7/d88/db3/lf8 0 2024-09-13T21:40:28.247 INFO:tasks.workunit.client.0.smithi088.stdout:9/656: mkdir d1a/d1b/db9/dc8 0 2024-09-13T21:40:28.251 INFO:tasks.workunit.client.0.smithi088.stdout:9/657: symlink d1a/d61/lc9 0 2024-09-13T21:40:28.257 INFO:tasks.workunit.client.0.smithi088.stdout:8/752: dread db/d26/d4f/dd0/ff4 [0,4194304] 0 2024-09-13T21:40:28.257 INFO:tasks.workunit.client.0.smithi088.stdout:8/753: readlink db/df/da7/d88/db3/lf8 0 2024-09-13T21:40:28.258 INFO:tasks.workunit.client.0.smithi088.stdout:9/658: rmdir d1a/d3c/d85 39 2024-09-13T21:40:28.262 INFO:tasks.workunit.client.0.smithi088.stdout:9/659: creat d1a/d61/d3d/fca x:0 0 0 2024-09-13T21:40:28.263 INFO:tasks.workunit.client.0.smithi088.stdout:9/660: getdents d1a/d3c/d51/db2 0 2024-09-13T21:40:28.264 INFO:tasks.workunit.client.0.smithi088.stdout:9/661: dread - d1a/d9e/fc4 zero size 2024-09-13T21:40:28.265 INFO:tasks.workunit.client.0.smithi088.stdout:9/662: mknod d1a/d61/d3d/d41/d48/d86/d97/ccb 0 2024-09-13T21:40:28.266 INFO:tasks.workunit.client.0.smithi088.stdout:6/817: dwrite d0/db/f2e [0,4194304] 0 2024-09-13T21:40:28.267 INFO:tasks.workunit.client.0.smithi088.stdout:9/663: link d1a/d3c/d51/d5e/d7e/l99 d1a/d9e/lcc 0 2024-09-13T21:40:28.269 INFO:tasks.workunit.client.0.smithi088.stdout:2/798: write d1/d8/d2e/d3b/dff/d2a/f2b [1144664,92581] 0 2024-09-13T21:40:28.269 INFO:tasks.workunit.client.0.smithi088.stdout:6/818: rename d0/d28/da3 to d0/d2c/d7f/db1/d104 0 2024-09-13T21:40:28.269 INFO:tasks.workunit.client.0.smithi088.stdout:6/819: fdatasync d0/d1e/d66/ffb 0 2024-09-13T21:40:28.271 INFO:tasks.workunit.client.0.smithi088.stdout:9/664: link d1a/d61/d3d/l7b d1a/d61/d3d/d75/lcd 0 2024-09-13T21:40:28.273 INFO:tasks.workunit.client.0.smithi088.stdout:9/665: creat d1a/d3c/d51/fce x:0 0 0 2024-09-13T21:40:28.273 INFO:tasks.workunit.client.0.smithi088.stdout:9/666: creat d1a/d3c/fcf x:0 0 0 2024-09-13T21:40:28.276 INFO:tasks.workunit.client.0.smithi088.stdout:9/667: mknod d1a/d1b/d3f/cd0 0 2024-09-13T21:40:28.276 INFO:tasks.workunit.client.0.smithi088.stdout:9/668: read d1a/d61/d3d/d41/d48/f68 [13855,110382] 0 2024-09-13T21:40:28.276 INFO:tasks.workunit.client.0.smithi088.stdout:2/799: write d1/d8/d2e/d3b/dff/f2c [1756245,5675] 0 2024-09-13T21:40:28.279 INFO:tasks.workunit.client.0.smithi088.stdout:9/669: mknod d1a/d3c/d51/d5e/d7e/d92/cd1 0 2024-09-13T21:40:28.279 INFO:tasks.workunit.client.0.smithi088.stdout:9/670: fsync d1a/d3c/f94 0 2024-09-13T21:40:28.281 INFO:tasks.workunit.client.0.smithi088.stdout:9/671: unlink d1a/d3c/d85/c87 0 2024-09-13T21:40:28.285 INFO:tasks.workunit.client.0.smithi088.stdout:7/648: dwrite d6/d5f/d69/d45/fcb [0,4194304] 0 2024-09-13T21:40:28.288 INFO:tasks.workunit.client.0.smithi088.stdout:7/649: symlink d6/d5f/d69/da8/lda 0 2024-09-13T21:40:28.290 INFO:tasks.workunit.client.0.smithi088.stdout:7/650: rename d6/d5f/d69/d4f/d6f/d70/d76/dbd/fd5 to d6/d5f/d69/d4f/d6f/d70/dbf/fdb 0 2024-09-13T21:40:28.290 INFO:tasks.workunit.client.0.smithi088.stdout:7/651: write d6/d5f/d69/d45/fcc [400210,44984] 0 2024-09-13T21:40:28.291 INFO:tasks.workunit.client.0.smithi088.stdout:7/652: creat d6/da/dca/fdc x:0 0 0 2024-09-13T21:40:28.293 INFO:tasks.workunit.client.0.smithi088.stdout:7/653: creat d6/d5f/d69/d4f/d4c/db9/fdd x:0 0 0 2024-09-13T21:40:28.294 INFO:tasks.workunit.client.0.smithi088.stdout:7/654: creat d6/d5f/fde x:0 0 0 2024-09-13T21:40:28.294 INFO:tasks.workunit.client.0.smithi088.stdout:7/655: stat d6/da/dc8 0 2024-09-13T21:40:28.295 INFO:tasks.workunit.client.0.smithi088.stdout:7/656: read d6/da/d44/f75 [629360,8047] 0 2024-09-13T21:40:28.296 INFO:tasks.workunit.client.0.smithi088.stdout:5/890: dwrite d4/d1b/faf [0,4194304] 0 2024-09-13T21:40:28.297 INFO:tasks.workunit.client.0.smithi088.stdout:0/806: dwrite d7/d1d/d21/d82/dca/fcb [8388608,4194304] 0 2024-09-13T21:40:28.297 INFO:tasks.workunit.client.0.smithi088.stdout:4/753: dwrite d2/d5/d20/d60/de/d1e/d23/f3d [0,4194304] 0 2024-09-13T21:40:28.297 INFO:tasks.workunit.client.0.smithi088.stdout:0/807: write d7/d1d/d66/fab [2870542,111541] 0 2024-09-13T21:40:28.297 INFO:tasks.workunit.client.0.smithi088.stdout:0/808: chown d7/d1d/d3d/dae/dff 58 1 2024-09-13T21:40:28.297 INFO:tasks.workunit.client.0.smithi088.stdout:0/809: write d7/f23 [1479015,88182] 0 2024-09-13T21:40:28.299 INFO:tasks.workunit.client.0.smithi088.stdout:5/891: truncate d4/d1c/d4a/f5d 98392 0 2024-09-13T21:40:28.302 INFO:tasks.workunit.client.0.smithi088.stdout:8/754: dwrite db/d26/d2c/d85/d51/fee [0,4194304] 0 2024-09-13T21:40:28.302 INFO:tasks.workunit.client.0.smithi088.stdout:8/755: read - db/df/d61/d97/fd3 zero size 2024-09-13T21:40:28.303 INFO:tasks.workunit.client.0.smithi088.stdout:8/756: write db/d26/d4f/f68 [2478303,128843] 0 2024-09-13T21:40:28.303 INFO:tasks.workunit.client.0.smithi088.stdout:6/820: dwrite d0/d28/f80 [4194304,4194304] 0 2024-09-13T21:40:28.304 INFO:tasks.workunit.client.0.smithi088.stdout:4/754: mknod d2/d5/d20/d60/de/d1e/d23/d3c/cf1 0 2024-09-13T21:40:28.304 INFO:tasks.workunit.client.0.smithi088.stdout:4/755: creat d2/d5/d20/d60/ff2 x:0 0 0 2024-09-13T21:40:28.305 INFO:tasks.workunit.client.0.smithi088.stdout:6/821: dread d0/d1e/d1f/d55/fc5 [0,4194304] 0 2024-09-13T21:40:28.305 INFO:tasks.workunit.client.0.smithi088.stdout:3/833: dwrite d5/d23/d2a/d6b/d98/da1/daa/d43/fb9 [0,4194304] 0 2024-09-13T21:40:28.306 INFO:tasks.workunit.client.0.smithi088.stdout:0/810: creat d7/d2c/d30/d31/d42/d4b/f116 x:0 0 0 2024-09-13T21:40:28.306 INFO:tasks.workunit.client.0.smithi088.stdout:0/811: dread - d7/d1d/d26/d45/d7c/f104 zero size 2024-09-13T21:40:28.308 INFO:tasks.workunit.client.0.smithi088.stdout:5/892: read d4/d1c/f42 [1622956,120334] 0 2024-09-13T21:40:28.308 INFO:tasks.workunit.client.0.smithi088.stdout:5/893: chown d4/fc 6 1 2024-09-13T21:40:28.308 INFO:tasks.workunit.client.0.smithi088.stdout:5/894: write d4/d1c/d24/d26/d56/f111 [112559,69436] 0 2024-09-13T21:40:28.308 INFO:tasks.workunit.client.0.smithi088.stdout:5/895: chown d4/d1b/c2b 16346 1 2024-09-13T21:40:28.309 INFO:tasks.workunit.client.0.smithi088.stdout:8/757: link db/df/d61/lf3 db/df/da7/daa/lf9 0 2024-09-13T21:40:28.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/657: dwrite d6/d4e/f6a [0,4194304] 0 2024-09-13T21:40:28.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/658: chown d6/d5f/d69/d4f/fb8 3049203 1 2024-09-13T21:40:28.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/659: chown d6/d5f 0 1 2024-09-13T21:40:28.313 INFO:tasks.workunit.client.0.smithi088.stdout:7/660: creat d6/d5f/d69/d45/fdf x:0 0 0 2024-09-13T21:40:28.321 INFO:tasks.workunit.client.0.smithi088.stdout:3/834: dwrite d5/d23/f6c [0,4194304] 0 2024-09-13T21:40:28.325 INFO:tasks.workunit.client.0.smithi088.stdout:4/756: rename d2/d5/d2d/d70/fc8 to d2/d81/ff3 0 2024-09-13T21:40:28.325 INFO:tasks.workunit.client.0.smithi088.stdout:4/757: creat d2/d11/dab/ff4 x:0 0 0 2024-09-13T21:40:28.332 INFO:tasks.workunit.client.0.smithi088.stdout:8/758: link db/df/da7/d88/da8/cc3 db/df/d61/d97/cfa 0 2024-09-13T21:40:28.333 INFO:tasks.workunit.client.0.smithi088.stdout:8/759: chown db/df/da7/daa 24 1 2024-09-13T21:40:28.337 INFO:tasks.workunit.client.0.smithi088.stdout:3/835: dwrite d5/d23/d2a/d6b/d98/fea [0,4194304] 0 2024-09-13T21:40:28.338 INFO:tasks.workunit.client.0.smithi088.stdout:0/812: rename d7/d1d/d66/lc1 to d7/d65/d8c/df3/l117 0 2024-09-13T21:40:28.340 INFO:tasks.workunit.client.0.smithi088.stdout:4/758: mknod d2/d5/d20/d60/cf5 0 2024-09-13T21:40:28.340 INFO:tasks.workunit.client.0.smithi088.stdout:4/759: creat d2/ff6 x:0 0 0 2024-09-13T21:40:28.340 INFO:tasks.workunit.client.0.smithi088.stdout:4/760: stat d2 0 2024-09-13T21:40:28.341 INFO:tasks.workunit.client.0.smithi088.stdout:4/761: write d2/d5/d20/d60/de/d1e/d23/f9a [931359,128057] 0 2024-09-13T21:40:28.341 INFO:tasks.workunit.client.0.smithi088.stdout:3/836: dread d5/f38 [0,4194304] 0 2024-09-13T21:40:28.341 INFO:tasks.workunit.client.0.smithi088.stdout:6/822: symlink d0/l105 0 2024-09-13T21:40:28.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:27 smithi116 ceph-mon[33391]: mgrmap e20: smithi088.scyrwy(active, since 7m), standbys: smithi116.bqnvtn 2024-09-13T21:40:28.349 INFO:tasks.workunit.client.0.smithi088.stdout:4/762: write d2/d5/d20/d60/de/d1e/d23/fc3 [1255827,76693] 0 2024-09-13T21:40:28.354 INFO:tasks.workunit.client.0.smithi088.stdout:1/792: sync 2024-09-13T21:40:28.361 INFO:tasks.workunit.client.0.smithi088.stdout:5/896: rmdir d4 39 2024-09-13T21:40:28.361 INFO:tasks.workunit.client.0.smithi088.stdout:5/897: stat d4/d1c/d76/f88 0 2024-09-13T21:40:28.361 INFO:tasks.workunit.client.0.smithi088.stdout:5/898: write d4/d1c/f45 [4372315,64274] 0 2024-09-13T21:40:28.361 INFO:tasks.workunit.client.0.smithi088.stdout:5/899: write d4/d1c/d4a/d8a/ff2 [2109594,13326] 0 2024-09-13T21:40:28.365 INFO:tasks.workunit.client.0.smithi088.stdout:0/813: rmdir d7/d65/d8c/deb/d107 0 2024-09-13T21:40:28.367 INFO:tasks.workunit.client.0.smithi088.stdout:1/793: dwrite d9/d10/d2a/d4b/d33/dad/dbb/ff6 [0,4194304] 0 2024-09-13T21:40:28.368 INFO:tasks.workunit.client.0.smithi088.stdout:1/794: write d9/d4f/f106 [209183,12389] 0 2024-09-13T21:40:28.368 INFO:tasks.workunit.client.0.smithi088.stdout:1/795: creat d9/dc/d74/f117 x:0 0 0 2024-09-13T21:40:28.368 INFO:tasks.workunit.client.0.smithi088.stdout:1/796: write d9/d10/d2a/d47/fc1 [33747,18533] 0 2024-09-13T21:40:28.368 INFO:tasks.workunit.client.0.smithi088.stdout:1/797: stat d9/d10/d2a/d4b/d33/f91 0 2024-09-13T21:40:28.368 INFO:tasks.workunit.client.0.smithi088.stdout:1/798: chown d9/d10/f29 473 1 2024-09-13T21:40:28.369 INFO:tasks.workunit.client.0.smithi088.stdout:3/837: creat d5/d23/d2a/d63/d31/f102 x:0 0 0 2024-09-13T21:40:28.369 INFO:tasks.workunit.client.0.smithi088.stdout:3/838: fsync d5/d23/d2a/d63/d31/f7c 0 2024-09-13T21:40:28.370 INFO:tasks.workunit.client.0.smithi088.stdout:6/823: creat d0/d2c/dad/f106 x:0 0 0 2024-09-13T21:40:28.372 INFO:tasks.workunit.client.0.smithi088.stdout:5/900: dread d4/d1c/d4a/d63/d6a/f6b [0,4194304] 0 2024-09-13T21:40:28.375 INFO:tasks.workunit.client.0.smithi088.stdout:7/661: rename d6/d5f/l98 to d6/da/dca/le0 0 2024-09-13T21:40:28.382 INFO:tasks.workunit.client.0.smithi088.stdout:6/824: creat d0/d2c/d7a/dea/f107 x:0 0 0 2024-09-13T21:40:28.384 INFO:tasks.workunit.client.0.smithi088.stdout:4/763: link d2/d5/d20/d60/l1d d2/d5/d20/d60/de/d1e/lf7 0 2024-09-13T21:40:28.384 INFO:tasks.workunit.client.0.smithi088.stdout:4/764: chown d2/d5/d2d/d70/fe1 3 1 2024-09-13T21:40:28.386 INFO:tasks.workunit.client.0.smithi088.stdout:5/901: symlink d4/d1c/d24/d26/dbf/d89/ddc/l128 0 2024-09-13T21:40:28.386 INFO:tasks.workunit.client.0.smithi088.stdout:2/800: sync 2024-09-13T21:40:28.386 INFO:tasks.workunit.client.0.smithi088.stdout:9/672: sync 2024-09-13T21:40:28.387 INFO:tasks.workunit.client.0.smithi088.stdout:8/760: rename db/df/da7/daa/fce to db/df/ffb 0 2024-09-13T21:40:28.389 INFO:tasks.workunit.client.0.smithi088.stdout:7/662: link d6/d5f/d69/d45/l95 d6/d5f/da9/le1 0 2024-09-13T21:40:28.390 INFO:tasks.workunit.client.0.smithi088.stdout:7/663: write d6/fa6 [826412,123549] 0 2024-09-13T21:40:28.391 INFO:tasks.workunit.client.0.smithi088.stdout:0/814: getdents d7/d1d/d66/d8b 0 2024-09-13T21:40:28.391 INFO:tasks.workunit.client.0.smithi088.stdout:0/815: chown d7/d1d/d66 23131450 1 2024-09-13T21:40:28.391 INFO:tasks.workunit.client.0.smithi088.stdout:0/816: chown d7/l36 14490145 1 2024-09-13T21:40:28.392 INFO:tasks.workunit.client.0.smithi088.stdout:3/839: dwrite d5/d23/d2a/d3f/dd0/fcc [0,4194304] 0 2024-09-13T21:40:28.393 INFO:tasks.workunit.client.0.smithi088.stdout:1/799: dwrite d9/d10/d2a/d4b/d39/d43/f108 [0,4194304] 0 2024-09-13T21:40:28.393 INFO:tasks.workunit.client.0.smithi088.stdout:1/800: write d9/f81 [4556730,58493] 0 2024-09-13T21:40:28.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/825: unlink d0/d2c/d32/d39/d3f/d71/d81/fd9 0 2024-09-13T21:40:28.394 INFO:tasks.workunit.client.0.smithi088.stdout:6/826: truncate d0/db/d37/fd3 8785584 0 2024-09-13T21:40:28.396 INFO:tasks.workunit.client.0.smithi088.stdout:4/765: mkdir d2/d5/d20/d60/de/d1e/d31/d61/d99/df8 0 2024-09-13T21:40:28.397 INFO:tasks.workunit.client.0.smithi088.stdout:5/902: rmdir d4/d1c/d24/d26 39 2024-09-13T21:40:28.398 INFO:tasks.workunit.client.0.smithi088.stdout:2/801: truncate d1/d8/d2e/d3b/dff/d2a/d41/d48/fea 2942776 0 2024-09-13T21:40:28.399 INFO:tasks.workunit.client.0.smithi088.stdout:2/802: write d1/d8/d2e/fbe [2302575,123277] 0 2024-09-13T21:40:28.399 INFO:tasks.workunit.client.0.smithi088.stdout:2/803: chown d1/d8/d2e/d3b/dff/d2a/f2b 162997 1 2024-09-13T21:40:28.400 INFO:tasks.workunit.client.0.smithi088.stdout:9/673: creat d1a/d3c/d51/d5e/d7e/d92/fd2 x:0 0 0 2024-09-13T21:40:28.401 INFO:tasks.workunit.client.0.smithi088.stdout:7/664: mkdir d6/d5f/d69/d4f/de2 0 2024-09-13T21:40:28.401 INFO:tasks.workunit.client.0.smithi088.stdout:7/665: creat d6/d5f/da9/fe3 x:0 0 0 2024-09-13T21:40:28.404 INFO:tasks.workunit.client.0.smithi088.stdout:3/840: mknod d5/d23/c103 0 2024-09-13T21:40:28.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/766: creat d2/d5/d20/d41/ff9 x:0 0 0 2024-09-13T21:40:28.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/767: creat d2/d11/dab/ffa x:0 0 0 2024-09-13T21:40:28.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/768: chown d2/d13/fa6 20022 1 2024-09-13T21:40:28.411 INFO:tasks.workunit.client.0.smithi088.stdout:4/769: fsync d2/d5/d2d/d70/fa8 0 2024-09-13T21:40:28.414 INFO:tasks.workunit.client.0.smithi088.stdout:5/903: symlink d4/d1c/d24/d26/d4b/d66/l129 0 2024-09-13T21:40:28.416 INFO:tasks.workunit.client.0.smithi088.stdout:9/674: symlink d1a/d61/d3d/d41/d48/ld3 0 2024-09-13T21:40:28.419 INFO:tasks.workunit.client.0.smithi088.stdout:7/666: symlink d6/da/dca/le4 0 2024-09-13T21:40:28.423 INFO:tasks.workunit.client.0.smithi088.stdout:6/827: dwrite d0/d2c/d32/d39/d3f/d71/d81/fa4 [4194304,4194304] 0 2024-09-13T21:40:28.423 INFO:tasks.workunit.client.0.smithi088.stdout:1/801: dwrite d9/fe3 [0,4194304] 0 2024-09-13T21:40:28.424 INFO:tasks.workunit.client.0.smithi088.stdout:0/817: rename d7/d1d/d26 to d7/d1d/d66/d8b/d118 0 2024-09-13T21:40:28.426 INFO:tasks.workunit.client.0.smithi088.stdout:3/841: unlink d5/d23/d2a/d63/d48/d49/l9b 0 2024-09-13T21:40:28.433 INFO:tasks.workunit.client.0.smithi088.stdout:5/904: mknod d4/d1c/d24/d26/d4b/d66/c12a 0 2024-09-13T21:40:28.433 INFO:tasks.workunit.client.0.smithi088.stdout:7/667: stat d6/d5f/l7c 0 2024-09-13T21:40:28.441 INFO:tasks.workunit.client.0.smithi088.stdout:1/802: stat c0 0 2024-09-13T21:40:28.443 INFO:tasks.workunit.client.0.smithi088.stdout:2/804: rename d1/d8/d2e/d3b/dff/d3f/c58 to d1/d8/d24/d78/d7f/d103/c10e 0 2024-09-13T21:40:28.444 INFO:tasks.workunit.client.0.smithi088.stdout:0/818: getdents d7/d1d/d66/d8b/d118/d34 0 2024-09-13T21:40:28.445 INFO:tasks.workunit.client.0.smithi088.stdout:6/828: dwrite d0/db/f82 [0,4194304] 0 2024-09-13T21:40:28.446 INFO:tasks.workunit.client.0.smithi088.stdout:3/842: symlink d5/d5a/db8/l104 0 2024-09-13T21:40:28.448 INFO:tasks.workunit.client.0.smithi088.stdout:5/905: getdents d4/d1c/d24/d26/d4b 0 2024-09-13T21:40:28.453 INFO:tasks.workunit.client.0.smithi088.stdout:4/770: rename d2/d81/ca3 to d2/d5/d20/d60/de/d1e/d31/cfb 0 2024-09-13T21:40:28.456 INFO:tasks.workunit.client.0.smithi088.stdout:4/771: dread d2/d5/d20/d60/de/fba [0,4194304] 0 2024-09-13T21:40:28.457 INFO:tasks.workunit.client.0.smithi088.stdout:4/772: write d2/f15 [5121026,72863] 0 2024-09-13T21:40:28.460 INFO:tasks.workunit.client.0.smithi088.stdout:3/843: unlink d5/d23/d2a/d63/f44 0 2024-09-13T21:40:28.460 INFO:tasks.workunit.client.0.smithi088.stdout:3/844: chown d5/d23/d2a/d3f/d76/db3/lcb 4617 1 2024-09-13T21:40:28.460 INFO:tasks.workunit.client.0.smithi088.stdout:3/845: readlink d5/d23/d2a/d3f/d76/db3/lcb 0 2024-09-13T21:40:28.461 INFO:tasks.workunit.client.0.smithi088.stdout:5/906: getdents d4/d1c 0 2024-09-13T21:40:28.464 INFO:tasks.workunit.client.0.smithi088.stdout:1/803: dwrite d9/d10/d2a/d4b/d39/d43/db2/fcf [0,4194304] 0 2024-09-13T21:40:28.464 INFO:tasks.workunit.client.0.smithi088.stdout:1/804: chown d9/d10/d2a/d4b/ldf 2964925 1 2024-09-13T21:40:28.464 INFO:tasks.workunit.client.0.smithi088.stdout:7/668: dwrite d6/d5f/da9/fe3 [0,4194304] 0 2024-09-13T21:40:28.465 INFO:tasks.workunit.client.0.smithi088.stdout:4/773: unlink d2/d5/d20/d41/lbf 0 2024-09-13T21:40:28.466 INFO:tasks.workunit.client.0.smithi088.stdout:6/829: mkdir d0/d1e/d1f/d108 0 2024-09-13T21:40:28.466 INFO:tasks.workunit.client.0.smithi088.stdout:6/830: dread - d0/d28/fed zero size 2024-09-13T21:40:28.467 INFO:tasks.workunit.client.0.smithi088.stdout:3/846: truncate d5/d23/d2a/d6b/d98/ddc/f7b 213533 0 2024-09-13T21:40:28.468 INFO:tasks.workunit.client.0.smithi088.stdout:5/907: write d4/d1c/d24/d95/fc4 [2347129,120280] 0 2024-09-13T21:40:28.469 INFO:tasks.workunit.client.0.smithi088.stdout:9/675: rename d1a/d3c/d51/d5e/f63 to d1a/d9e/fd4 0 2024-09-13T21:40:28.469 INFO:tasks.workunit.client.0.smithi088.stdout:4/774: dread d2/d5/d20/d60/de/d1e/d23/d3c/d65/fcb [0,4194304] 0 2024-09-13T21:40:28.469 INFO:tasks.workunit.client.0.smithi088.stdout:4/775: getdents d2/d5/d20/d60/de/d1e/d31/d61/d99/df8 0 2024-09-13T21:40:28.469 INFO:tasks.workunit.client.0.smithi088.stdout:4/776: write d2/d5/d20/d7f/fcf [106756,11473] 0 2024-09-13T21:40:28.469 INFO:tasks.workunit.client.0.smithi088.stdout:4/777: write d2/d13/d50/fcc [996937,121199] 0 2024-09-13T21:40:28.469 INFO:tasks.workunit.client.0.smithi088.stdout:4/778: chown d2/d13/dee/cbb 80857377 1 2024-09-13T21:40:28.472 INFO:tasks.workunit.client.0.smithi088.stdout:7/669: write d6/d4e/f7b [1555566,73863] 0 2024-09-13T21:40:28.473 INFO:tasks.workunit.client.0.smithi088.stdout:1/805: creat d9/d10/d2a/d4b/d39/d43/f118 x:0 0 0 2024-09-13T21:40:28.475 INFO:tasks.workunit.client.0.smithi088.stdout:5/908: mkdir d4/d1c/d24/d26/d117/d12b 0 2024-09-13T21:40:28.475 INFO:tasks.workunit.client.0.smithi088.stdout:7/670: dread d6/d5f/d81/f85 [0,4194304] 0 2024-09-13T21:40:28.477 INFO:tasks.workunit.client.0.smithi088.stdout:1/806: creat d9/d10/d2a/d4b/d33/d92/f119 x:0 0 0 2024-09-13T21:40:28.479 INFO:tasks.workunit.client.0.smithi088.stdout:3/847: creat d5/d23/d2a/d3f/d76/db3/da9/f105 x:0 0 0 2024-09-13T21:40:28.480 INFO:tasks.workunit.client.0.smithi088.stdout:2/805: dwrite d1/d8/ff1 [0,4194304] 0 2024-09-13T21:40:28.480 INFO:tasks.workunit.client.0.smithi088.stdout:5/909: unlink d4/l19 0 2024-09-13T21:40:28.482 INFO:tasks.workunit.client.0.smithi088.stdout:7/671: creat d6/d5f/d81/fe5 x:0 0 0 2024-09-13T21:40:28.484 INFO:tasks.workunit.client.0.smithi088.stdout:1/807: unlink d9/dc/d52/c69 0 2024-09-13T21:40:28.487 INFO:tasks.workunit.client.0.smithi088.stdout:3/848: creat d5/d23/d2a/d3f/d76/db3/da5/dc3/f106 x:0 0 0 2024-09-13T21:40:28.487 INFO:tasks.workunit.client.0.smithi088.stdout:3/849: readlink d5/d5a/l72 0 2024-09-13T21:40:28.488 INFO:tasks.workunit.client.0.smithi088.stdout:6/831: write d0/f17 [1255372,35639] 0 2024-09-13T21:40:28.489 INFO:tasks.workunit.client.0.smithi088.stdout:1/808: write d9/dc/d52/dba/d7d/ff5 [732375,34362] 0 2024-09-13T21:40:28.489 INFO:tasks.workunit.client.0.smithi088.stdout:1/809: read - d9/d10/d2a/d47/d9c/fc0 zero size 2024-09-13T21:40:28.490 INFO:tasks.workunit.client.0.smithi088.stdout:4/779: dwrite d2/d5/d20/d60/de/f28 [4194304,4194304] 0 2024-09-13T21:40:28.491 INFO:tasks.workunit.client.0.smithi088.stdout:9/676: dwrite d1a/d61/d3d/d41/d48/d86/fa3 [0,4194304] 0 2024-09-13T21:40:28.491 INFO:tasks.workunit.client.0.smithi088.stdout:9/677: readlink d1a/d1b/l1d 0 2024-09-13T21:40:28.491 INFO:tasks.workunit.client.0.smithi088.stdout:2/806: rename d1/d8/f19 to d1/d8/d24/d78/d7f/d85/f10f 0 2024-09-13T21:40:28.491 INFO:tasks.workunit.client.0.smithi088.stdout:9/678: readlink d1a/d61/d3d/l7b 0 2024-09-13T21:40:28.493 INFO:tasks.workunit.client.0.smithi088.stdout:5/910: mkdir d4/d1c/d24/d26/dbf/d89/d92/d12c 0 2024-09-13T21:40:28.493 INFO:tasks.workunit.client.0.smithi088.stdout:5/911: readlink d4/d1c/d24/l4c 0 2024-09-13T21:40:28.493 INFO:tasks.workunit.client.0.smithi088.stdout:5/912: write d4/d1c/d24/d26/d56/f109 [262027,107198] 0 2024-09-13T21:40:28.494 INFO:tasks.workunit.client.0.smithi088.stdout:3/850: truncate d5/d23/fc9 851768 0 2024-09-13T21:40:28.495 INFO:tasks.workunit.client.0.smithi088.stdout:3/851: chown d5/d23/d2a/d6b/d98/fea 190043157 1 2024-09-13T21:40:28.495 INFO:tasks.workunit.client.0.smithi088.stdout:3/852: fdatasync d5/f16 0 2024-09-13T21:40:28.496 INFO:tasks.workunit.client.0.smithi088.stdout:6/832: creat d0/d2c/d83/f109 x:0 0 0 2024-09-13T21:40:28.496 INFO:tasks.workunit.client.0.smithi088.stdout:6/833: stat d0/d1e/fe3 0 2024-09-13T21:40:28.499 INFO:tasks.workunit.client.0.smithi088.stdout:9/679: mkdir d1a/d1b/dd5 0 2024-09-13T21:40:28.502 INFO:tasks.workunit.client.0.smithi088.stdout:5/913: rename d4/d1c/d24/d26/d40/d90/c10b to d4/da7/c12d 0 2024-09-13T21:40:28.503 INFO:tasks.workunit.client.0.smithi088.stdout:5/914: chown d4/d1c/d24/d26/c65 21 1 2024-09-13T21:40:28.503 INFO:tasks.workunit.client.0.smithi088.stdout:5/915: stat d4/l3a 0 2024-09-13T21:40:28.504 INFO:tasks.workunit.client.0.smithi088.stdout:3/853: mkdir d5/d23/d2a/d63/d48/d107 0 2024-09-13T21:40:28.506 INFO:tasks.workunit.client.0.smithi088.stdout:1/810: dread d9/d10/d2a/d4b/f2f [0,4194304] 0 2024-09-13T21:40:28.507 INFO:tasks.workunit.client.0.smithi088.stdout:7/672: dwrite d6/da/d1a/f30 [0,4194304] 0 2024-09-13T21:40:28.507 INFO:tasks.workunit.client.0.smithi088.stdout:7/673: creat d6/da/d44/fe6 x:0 0 0 2024-09-13T21:40:28.507 INFO:tasks.workunit.client.0.smithi088.stdout:4/780: write d2/d13/fed [51884,75680] 0 2024-09-13T21:40:28.507 INFO:tasks.workunit.client.0.smithi088.stdout:5/916: getdents d4/d1c/d4a/d8a 0 2024-09-13T21:40:28.508 INFO:tasks.workunit.client.0.smithi088.stdout:3/854: mknod d5/d23/d2a/d63/d48/d49/dd8/c108 0 2024-09-13T21:40:28.508 INFO:tasks.workunit.client.0.smithi088.stdout:8/761: sync 2024-09-13T21:40:28.510 INFO:tasks.workunit.client.0.smithi088.stdout:6/834: getdents d0/d2c/d32/d39/d3f 0 2024-09-13T21:40:28.513 INFO:tasks.workunit.client.0.smithi088.stdout:1/811: symlink d9/d10/d2a/d4b/d33/dad/dbb/l11a 0 2024-09-13T21:40:28.513 INFO:tasks.workunit.client.0.smithi088.stdout:1/812: creat d9/d10/d2a/d4b/d39/d43/dfb/f11b x:0 0 0 2024-09-13T21:40:28.521 INFO:tasks.workunit.client.0.smithi088.stdout:7/674: mknod d6/da/d44/ce7 0 2024-09-13T21:40:28.521 INFO:tasks.workunit.client.0.smithi088.stdout:2/807: dwrite d1/f34 [4194304,4194304] 0 2024-09-13T21:40:28.522 INFO:tasks.workunit.client.0.smithi088.stdout:4/781: dwrite d2/d5/d20/d60/de/d1e/d23/fe2 [0,4194304] 0 2024-09-13T21:40:28.522 INFO:tasks.workunit.client.0.smithi088.stdout:5/917: creat d4/d1c/d24/d26/d56/d100/f12e x:0 0 0 2024-09-13T21:40:28.524 INFO:tasks.workunit.client.0.smithi088.stdout:3/855: mknod d5/d23/d2a/c109 0 2024-09-13T21:40:28.527 INFO:tasks.workunit.client.0.smithi088.stdout:8/762: rename db/d26/d2c/d85/d51/f7c to db/d26/d37/dd9/ffc 0 2024-09-13T21:40:28.528 INFO:tasks.workunit.client.0.smithi088.stdout:6/835: mkdir d0/d28/d10a 0 2024-09-13T21:40:28.533 INFO:tasks.workunit.client.0.smithi088.stdout:7/675: creat d6/d5f/fe8 x:0 0 0 2024-09-13T21:40:28.541 INFO:tasks.workunit.client.0.smithi088.stdout:4/782: creat d2/d5/d20/d60/de/d1e/d23/d3c/dea/ffc x:0 0 0 2024-09-13T21:40:28.542 INFO:tasks.workunit.client.0.smithi088.stdout:5/918: write d4/d1c/f48 [759472,48616] 0 2024-09-13T21:40:28.544 INFO:tasks.workunit.client.0.smithi088.stdout:6/836: dwrite d0/d2c/d32/fbe [0,4194304] 0 2024-09-13T21:40:28.544 INFO:tasks.workunit.client.0.smithi088.stdout:3/856: link d5/d23/d2a/d3f/d76/db3/lcb d5/d23/d2a/d3f/l10a 0 2024-09-13T21:40:28.547 INFO:tasks.workunit.client.0.smithi088.stdout:2/808: rename d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/d89/dcc/df6 to d1/d8/d2e/d3b/dff/d2a/d41/d48/da0/d110 0 2024-09-13T21:40:28.549 INFO:tasks.workunit.client.0.smithi088.stdout:8/763: creat db/d26/d37/dd9/ffd x:0 0 0 2024-09-13T21:40:28.550 INFO:tasks.workunit.client.0.smithi088.stdout:1/813: link d9/d10/d2a/d4b/d33/d92/f119 d9/d10/d2a/d4b/d3a/f11c 0 2024-09-13T21:40:28.550 INFO:tasks.workunit.client.0.smithi088.stdout:1/814: creat d9/dc/d52/dba/f11d x:0 0 0 2024-09-13T21:40:28.553 INFO:tasks.workunit.client.0.smithi088.stdout:5/919: link d4/d1b/fe6 d4/f12f 0 2024-09-13T21:40:28.558 INFO:tasks.workunit.client.0.smithi088.stdout:6/837: mknod d0/d1e/d1f/d55/d8f/dc6/c10b 0 2024-09-13T21:40:28.558 INFO:tasks.workunit.client.0.smithi088.stdout:6/838: creat d0/d2c/d8b/f10c x:0 0 0 2024-09-13T21:40:28.560 INFO:tasks.workunit.client.0.smithi088.stdout:7/676: rename d6/d5f/d81/f85 to d6/da/dc8/fe9 0 2024-09-13T21:40:28.560 INFO:tasks.workunit.client.0.smithi088.stdout:7/677: stat d6/d5f/d69/c67 0 2024-09-13T21:40:28.562 INFO:tasks.workunit.client.0.smithi088.stdout:8/764: truncate db/d26/d2c/f8b 4144643 0 2024-09-13T21:40:28.565 INFO:tasks.workunit.client.0.smithi088.stdout:1/815: rmdir d9/dc/d52/dba/dd4 39 2024-09-13T21:40:28.567 INFO:tasks.workunit.client.0.smithi088.stdout:4/783: symlink d2/d5/d20/d60/de/d1e/lfd 0 2024-09-13T21:40:28.569 INFO:tasks.workunit.client.0.smithi088.stdout:5/920: unlink d4/d1c/d24/d26/da1/le9 0 2024-09-13T21:40:28.569 INFO:tasks.workunit.client.0.smithi088.stdout:5/921: creat d4/d1c/d24/d26/d56/d100/f130 x:0 0 0 2024-09-13T21:40:28.574 INFO:tasks.workunit.client.0.smithi088.stdout:6/839: rename d0/db/c1b to d0/d2c/d32/d39/c10d 0 2024-09-13T21:40:28.575 INFO:tasks.workunit.client.0.smithi088.stdout:6/840: chown d0/d1e/d1f/d55/d96/d98/fef 61216 1 2024-09-13T21:40:28.578 INFO:tasks.workunit.client.0.smithi088.stdout:2/809: rmdir d1/d8/d2e/d91 39 2024-09-13T21:40:28.578 INFO:tasks.workunit.client.0.smithi088.stdout:2/810: chown d1/d8/d16/d40/d7e/daa/cdf 181216786 1 2024-09-13T21:40:28.582 INFO:tasks.workunit.client.0.smithi088.stdout:7/678: dwrite d6/da/d1a/f56 [0,4194304] 0 2024-09-13T21:40:28.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/922: creat d4/d1c/d24/d26/dfe/f131 x:0 0 0 2024-09-13T21:40:28.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/923: write d4/d1c/d4a/d63/d6a/f6b [1795279,43937] 0 2024-09-13T21:40:28.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/924: fdatasync d4/d1c/d4a/d63/d6a/f8d 0 2024-09-13T21:40:28.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/925: truncate d4/d1c/d24/f8e 280411 0 2024-09-13T21:40:28.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/926: chown d4/c7b 64634 1 2024-09-13T21:40:28.583 INFO:tasks.workunit.client.0.smithi088.stdout:5/927: write d4/d1c/d24/d26/d40/fa [1584982,64650] 0 2024-09-13T21:40:28.584 INFO:tasks.workunit.client.0.smithi088.stdout:8/765: rename db/df/da7/d88/da8/fab to db/df/da7/ffe 0 2024-09-13T21:40:28.584 INFO:tasks.workunit.client.0.smithi088.stdout:8/766: fsync db/d26/d37/d7d/fac 0 2024-09-13T21:40:28.584 INFO:tasks.workunit.client.0.smithi088.stdout:8/767: chown db/df/da7/l9a 308012 1 2024-09-13T21:40:28.586 INFO:tasks.workunit.client.0.smithi088.stdout:6/841: symlink d0/d2c/dad/db3/l10e 0 2024-09-13T21:40:28.586 INFO:tasks.workunit.client.0.smithi088.stdout:6/842: write d0/d28/fed [780367,13454] 0 2024-09-13T21:40:28.586 INFO:tasks.workunit.client.0.smithi088.stdout:6/843: fdatasync d0/d2c/d8b/f10c 0 2024-09-13T21:40:28.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/811: mknod d1/d8/d2e/d3b/dff/d3f/d99/d9c/c111 0 2024-09-13T21:40:28.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/812: getdents d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/d104 0 2024-09-13T21:40:28.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/813: write d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/d89/f109 [113918,15710] 0 2024-09-13T21:40:28.587 INFO:tasks.workunit.client.0.smithi088.stdout:0/819: sync 2024-09-13T21:40:28.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/814: fdatasync d1/d8/f1b 0 2024-09-13T21:40:28.587 INFO:tasks.workunit.client.0.smithi088.stdout:2/815: write d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/fc7 [167080,35051] 0 2024-09-13T21:40:28.590 INFO:tasks.workunit.client.0.smithi088.stdout:7/679: dread d6/f18 [4194304,4194304] 0 2024-09-13T21:40:28.590 INFO:tasks.workunit.client.0.smithi088.stdout:5/928: write f2 [3456282,91297] 0 2024-09-13T21:40:28.591 INFO:tasks.workunit.client.0.smithi088.stdout:2/816: unlink d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/ccb 0 2024-09-13T21:40:28.591 INFO:tasks.workunit.client.0.smithi088.stdout:7/680: read d6/da/d44/fbe [166834,42403] 0 2024-09-13T21:40:28.592 INFO:tasks.workunit.client.0.smithi088.stdout:1/816: dwrite d9/d10/d2a/d4b/d39/d43/dfb/f11b [0,4194304] 0 2024-09-13T21:40:28.592 INFO:tasks.workunit.client.0.smithi088.stdout:1/817: stat d9/dc 0 2024-09-13T21:40:28.593 INFO:tasks.workunit.client.0.smithi088.stdout:0/820: symlink d7/d1d/d66/d8b/l119 0 2024-09-13T21:40:28.597 INFO:tasks.workunit.client.0.smithi088.stdout:2/817: dread d1/d8/d24/d78/d7f/d85/f10f [0,4194304] 0 2024-09-13T21:40:28.597 INFO:tasks.workunit.client.0.smithi088.stdout:2/818: write d1/d8/d2e/d3b/dff/d2a/d3c/d4a/fa2 [1443580,76351] 0 2024-09-13T21:40:28.600 INFO:tasks.workunit.client.0.smithi088.stdout:0/821: symlink d7/d65/d8c/deb/l11a 0 2024-09-13T21:40:28.600 INFO:tasks.workunit.client.0.smithi088.stdout:0/822: readlink d7/d1d/ld1 0 2024-09-13T21:40:28.600 INFO:tasks.workunit.client.0.smithi088.stdout:4/784: dwrite d2/d5/d20/d60/de/d1e/d31/f91 [0,4194304] 0 2024-09-13T21:40:28.602 INFO:tasks.workunit.client.0.smithi088.stdout:7/681: getdents d6/d5f/d69/d4f/d6f/d70 0 2024-09-13T21:40:28.603 INFO:tasks.workunit.client.0.smithi088.stdout:8/768: read db/d26/d2c/f5d [3018689,27193] 0 2024-09-13T21:40:28.603 INFO:tasks.workunit.client.0.smithi088.stdout:8/769: chown db/df/c98 1 1 2024-09-13T21:40:28.604 INFO:tasks.workunit.client.0.smithi088.stdout:2/819: mkdir d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d76/d112 0 2024-09-13T21:40:28.605 INFO:tasks.workunit.client.0.smithi088.stdout:0/823: symlink d7/d1d/d21/d82/db8/de5/l11b 0 2024-09-13T21:40:28.605 INFO:tasks.workunit.client.0.smithi088.stdout:1/818: dread d9/d10/f3f [0,4194304] 0 2024-09-13T21:40:28.608 INFO:tasks.workunit.client.0.smithi088.stdout:4/785: creat d2/d5/d20/d41/d4b/ffe x:0 0 0 2024-09-13T21:40:28.608 INFO:tasks.workunit.client.0.smithi088.stdout:5/929: dwrite d4/d1b/fe6 [0,4194304] 0 2024-09-13T21:40:28.608 INFO:tasks.workunit.client.0.smithi088.stdout:5/930: chown d4/d1c/d24/d26/d40/c20 1 1 2024-09-13T21:40:28.609 INFO:tasks.workunit.client.0.smithi088.stdout:7/682: truncate d6/da/f10 894359 0 2024-09-13T21:40:28.612 INFO:tasks.workunit.client.0.smithi088.stdout:8/770: rename db/d26/d37/d7d/le7 to db/df/da7/daa/lff 0 2024-09-13T21:40:28.613 INFO:tasks.workunit.client.0.smithi088.stdout:1/819: dread d9/d10/d2a/d4b/d61/f6a [0,4194304] 0 2024-09-13T21:40:28.617 INFO:tasks.workunit.client.0.smithi088.stdout:2/820: creat d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/f113 x:0 0 0 2024-09-13T21:40:28.617 INFO:tasks.workunit.client.0.smithi088.stdout:2/821: truncate d1/d8/d24/d78/fe0 1050777 0 2024-09-13T21:40:28.618 INFO:tasks.workunit.client.0.smithi088.stdout:0/824: link d7/d2c/d30/d31/d42/d4b/cfa d7/d1d/d66/d8b/d118/d45/d7c/c11c 0 2024-09-13T21:40:28.618 INFO:tasks.workunit.client.0.smithi088.stdout:0/825: readlink d7/d1d/d21/d82/l103 0 2024-09-13T21:40:28.619 INFO:tasks.workunit.client.0.smithi088.stdout:6/844: dwrite d0/d2c/d32/d39/d3f/f68 [0,4194304] 0 2024-09-13T21:40:28.622 INFO:tasks.workunit.client.0.smithi088.stdout:8/771: mknod db/d26/d2c/d85/dad/c100 0 2024-09-13T21:40:28.622 INFO:tasks.workunit.client.0.smithi088.stdout:8/772: creat db/d26/d37/dd9/f101 x:0 0 0 2024-09-13T21:40:28.622 INFO:tasks.workunit.client.0.smithi088.stdout:8/773: write db/df/da7/d88/da8/db4/fc6 [600570,38188] 0 2024-09-13T21:40:28.623 INFO:tasks.workunit.client.0.smithi088.stdout:5/931: rename d4/d1c/d24/d26/cf9 to d4/d1c/d24/d26/d56/c132 0 2024-09-13T21:40:28.625 INFO:tasks.workunit.client.0.smithi088.stdout:4/786: dwrite d2/d5/d20/d60/de/f28 [4194304,4194304] 0 2024-09-13T21:40:28.627 INFO:tasks.workunit.client.0.smithi088.stdout:8/774: dread db/df/d61/fa2 [0,4194304] 0 2024-09-13T21:40:28.632 INFO:tasks.workunit.client.0.smithi088.stdout:2/822: link d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/f10d d1/d8/d16/d40/d7e/daa/f114 0 2024-09-13T21:40:28.632 INFO:tasks.workunit.client.0.smithi088.stdout:0/826: getdents d7/d2c/d78 0 2024-09-13T21:40:28.633 INFO:tasks.workunit.client.0.smithi088.stdout:8/775: dread db/d26/d2c/f87 [0,4194304] 0 2024-09-13T21:40:28.634 INFO:tasks.workunit.client.0.smithi088.stdout:4/787: dread d2/f15 [0,4194304] 0 2024-09-13T21:40:28.636 INFO:tasks.workunit.client.0.smithi088.stdout:6/845: link d0/d2c/d7f/db1/d104/fc9 d0/d1e/d1f/d55/d8f/dc6/f10f 0 2024-09-13T21:40:28.637 INFO:tasks.workunit.client.0.smithi088.stdout:6/846: chown d0/d2c/d7a/daf 113595233 1 2024-09-13T21:40:28.638 INFO:tasks.workunit.client.0.smithi088.stdout:1/820: rename d9/fd2 to d9/d10/d2a/d4b/d39/f11e 0 2024-09-13T21:40:28.640 INFO:tasks.workunit.client.0.smithi088.stdout:0/827: mknod d7/d65/d8c/df3/c11d 0 2024-09-13T21:40:28.641 INFO:tasks.workunit.client.0.smithi088.stdout:6/847: mkdir d0/d2c/d7a/d7c/d110 0 2024-09-13T21:40:28.642 INFO:tasks.workunit.client.0.smithi088.stdout:5/932: rename d4/d1c/d24/d26/dbf/d89/d92/d12c to d4/d1c/d4a/d133 0 2024-09-13T21:40:28.643 INFO:tasks.workunit.client.0.smithi088.stdout:5/933: truncate d4/d1c/d4a/d63/d6a/f8d 5021268 0 2024-09-13T21:40:28.643 INFO:tasks.workunit.client.0.smithi088.stdout:6/848: truncate d0/d2c/d32/d39/f95 2267558 0 2024-09-13T21:40:28.644 INFO:tasks.workunit.client.0.smithi088.stdout:4/788: dread d2/d81/fc0 [4194304,4194304] 0 2024-09-13T21:40:28.644 INFO:tasks.workunit.client.0.smithi088.stdout:4/789: creat d2/d5/d20/fff x:0 0 0 2024-09-13T21:40:28.646 INFO:tasks.workunit.client.0.smithi088.stdout:2/823: rename d1/d8/d2e/d3b/dff/d2a/d41/c6c to d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dcd/d9e/c115 0 2024-09-13T21:40:28.649 INFO:tasks.workunit.client.0.smithi088.stdout:5/934: symlink d4/d1c/d4a/d8a/l134 0 2024-09-13T21:40:28.649 INFO:tasks.workunit.client.0.smithi088.stdout:3/857: sync 2024-09-13T21:40:28.649 INFO:tasks.workunit.client.0.smithi088.stdout:9/680: sync 2024-09-13T21:40:28.650 INFO:tasks.workunit.client.0.smithi088.stdout:6/849: mknod d0/d2c/d7a/dea/c111 0 2024-09-13T21:40:28.653 INFO:tasks.workunit.client.0.smithi088.stdout:4/790: creat d2/d13/d50/f100 x:0 0 0 2024-09-13T21:40:28.655 INFO:tasks.workunit.client.0.smithi088.stdout:4/791: write d2/d5/d20/d60/de/d1e/d23/d3c/d65/fcb [168715,97478] 0 2024-09-13T21:40:28.655 INFO:tasks.workunit.client.0.smithi088.stdout:4/792: creat d2/d5/d20/d7f/f101 x:0 0 0 2024-09-13T21:40:28.655 INFO:tasks.workunit.client.0.smithi088.stdout:4/793: creat d2/d5/d2d/d70/f102 x:0 0 0 2024-09-13T21:40:28.655 INFO:tasks.workunit.client.0.smithi088.stdout:8/776: rename db/d26/d2c/d85/c72 to db/df/da7/d88/ddd/de8/c102 0 2024-09-13T21:40:28.657 INFO:tasks.workunit.client.0.smithi088.stdout:0/828: dread d7/d65/d8c/df3/fc7 [0,4194304] 0 2024-09-13T21:40:28.657 INFO:tasks.workunit.client.0.smithi088.stdout:0/829: write d7/d2c/d30/d31/d42/de2/fb3 [1055109,41925] 0 2024-09-13T21:40:28.657 INFO:tasks.workunit.client.0.smithi088.stdout:5/935: symlink d4/d1c/d24/d26/d40/d90/l135 0 2024-09-13T21:40:28.657 INFO:tasks.workunit.client.0.smithi088.stdout:5/936: chown d4/d1c/d24/d26/d56/fd3 5 1 2024-09-13T21:40:28.657 INFO:tasks.workunit.client.0.smithi088.stdout:5/937: truncate d4/d1c/d24/d26/dbf/d89/dc9/dcb/ff7 1028694 0 2024-09-13T21:40:28.657 INFO:tasks.workunit.client.0.smithi088.stdout:9/681: read d1a/f49 [1691406,117823] 0 2024-09-13T21:40:28.658 INFO:tasks.workunit.client.0.smithi088.stdout:9/682: write d1a/d61/d3d/d41/d48/f68 [209886,22263] 0 2024-09-13T21:40:28.658 INFO:tasks.workunit.client.0.smithi088.stdout:3/858: dread d5/d23/d2a/d6b/d8b/fbf [0,4194304] 0 2024-09-13T21:40:28.660 INFO:tasks.workunit.client.0.smithi088.stdout:8/777: creat db/df/da7/d88/da8/db4/f103 x:0 0 0 2024-09-13T21:40:28.661 INFO:tasks.workunit.client.0.smithi088.stdout:8/778: readlink db/df/d61/d97/la1 0 2024-09-13T21:40:28.661 INFO:tasks.workunit.client.0.smithi088.stdout:8/779: readlink db/df/d61/d97/la1 0 2024-09-13T21:40:28.662 INFO:tasks.workunit.client.0.smithi088.stdout:0/830: getdents d7/d65/d8c/deb 0 2024-09-13T21:40:28.662 INFO:tasks.workunit.client.0.smithi088.stdout:0/831: readlink d7/d2c/d30/d31/d42/l96 0 2024-09-13T21:40:28.664 INFO:tasks.workunit.client.0.smithi088.stdout:4/794: symlink d2/d5/d20/d60/de/d1e/l103 0 2024-09-13T21:40:28.665 INFO:tasks.workunit.client.0.smithi088.stdout:6/850: write d0/d1e/d1f/f7b [46854,123750] 0 2024-09-13T21:40:28.665 INFO:tasks.workunit.client.0.smithi088.stdout:6/851: creat d0/db/f112 x:0 0 0 2024-09-13T21:40:28.665 INFO:tasks.workunit.client.0.smithi088.stdout:6/852: dread - d0/db/f112 zero size 2024-09-13T21:40:28.667 INFO:tasks.workunit.client.0.smithi088.stdout:8/780: creat db/df/da7/d88/da8/f104 x:0 0 0 2024-09-13T21:40:28.667 INFO:tasks.workunit.client.0.smithi088.stdout:8/781: write db/df/da7/d88/da8/db4/fc6 [899736,29357] 0 2024-09-13T21:40:28.667 INFO:tasks.workunit.client.0.smithi088.stdout:8/782: chown db/d26/d2c/d85/f89 2 1 2024-09-13T21:40:28.667 INFO:tasks.workunit.client.0.smithi088.stdout:8/783: write db/df/d61/d97/faf [532346,97338] 0 2024-09-13T21:40:28.667 INFO:tasks.workunit.client.0.smithi088.stdout:3/859: dread d5/d23/d2a/d3f/db4/fe1 [0,4194304] 0 2024-09-13T21:40:28.667 INFO:tasks.workunit.client.0.smithi088.stdout:3/860: stat d5/d23/d2a/d6b/d98/dfc 0 2024-09-13T21:40:28.668 INFO:tasks.workunit.client.0.smithi088.stdout:1/821: dwrite d9/d10/d2a/d4b/d39/d43/db2/fcf [0,4194304] 0 2024-09-13T21:40:28.668 INFO:tasks.workunit.client.0.smithi088.stdout:1/822: write d9/d10/d2a/d4b/d3a/ff4 [834575,129786] 0 2024-09-13T21:40:28.668 INFO:tasks.workunit.client.0.smithi088.stdout:2/824: dwrite d1/d8/d2e/d44/ffe [0,4194304] 0 2024-09-13T21:40:28.671 INFO:tasks.workunit.client.0.smithi088.stdout:4/795: truncate d2/d5/f53 3287283 0 2024-09-13T21:40:28.674 INFO:tasks.workunit.client.0.smithi088.stdout:6/853: creat d0/d28/d10a/f113 x:0 0 0 2024-09-13T21:40:28.677 INFO:tasks.workunit.client.0.smithi088.stdout:0/832: write d7/f12 [1838232,85354] 0 2024-09-13T21:40:28.679 INFO:tasks.workunit.client.0.smithi088.stdout:4/796: mkdir d2/d5/d20/d60/de/d1e/d23/d6c/d104 0 2024-09-13T21:40:28.681 INFO:tasks.workunit.client.0.smithi088.stdout:5/938: dwrite d4/d1c/d24/d95/da6/fc3 [0,4194304] 0 2024-09-13T21:40:28.681 INFO:tasks.workunit.client.0.smithi088.stdout:0/833: creat d7/d65/d8c/deb/f11e x:0 0 0 2024-09-13T21:40:28.682 INFO:tasks.workunit.client.0.smithi088.stdout:1/823: dread d9/d10/d2a/d47/d9c/faf [0,4194304] 0 2024-09-13T21:40:28.682 INFO:tasks.workunit.client.0.smithi088.stdout:9/683: dwrite d1a/fc5 [0,4194304] 0 2024-09-13T21:40:28.685 INFO:tasks.workunit.client.0.smithi088.stdout:5/939: symlink d4/d1c/d24/d26/dbf/dc6/l136 0 2024-09-13T21:40:28.685 INFO:tasks.workunit.client.0.smithi088.stdout:5/940: chown d4/d1c/d24/d26/f55 1199 1 2024-09-13T21:40:28.685 INFO:tasks.workunit.client.0.smithi088.stdout:5/941: truncate d4/d1c/d24/d26/dbf/d89/fdb 5359828 0 2024-09-13T21:40:28.687 INFO:tasks.workunit.client.0.smithi088.stdout:0/834: mknod d7/d1d/d66/c11f 0 2024-09-13T21:40:28.687 INFO:tasks.workunit.client.0.smithi088.stdout:1/824: symlink d9/d10/d2a/d4b/d3a/d104/l11f 0 2024-09-13T21:40:28.690 INFO:tasks.workunit.client.0.smithi088.stdout:9/684: link d1a/d3c/d51/d5e/d7e/d92/fd2 d1a/d1b/d3f/fd6 0 2024-09-13T21:40:28.692 INFO:tasks.workunit.client.0.smithi088.stdout:5/942: creat d4/f137 x:0 0 0 2024-09-13T21:40:28.694 INFO:tasks.workunit.client.0.smithi088.stdout:0/835: mknod d7/d1d/c120 0 2024-09-13T21:40:28.694 INFO:tasks.workunit.client.0.smithi088.stdout:0/836: write d7/d1d/d66/d8b/d118/d45/f56 [1332159,37148] 0 2024-09-13T21:40:28.695 INFO:tasks.workunit.client.0.smithi088.stdout:9/685: mknod d1a/d61/dc6/cd7 0 2024-09-13T21:40:28.698 INFO:tasks.workunit.client.0.smithi088.stdout:1/825: rmdir d9/d10/d2a/d47/d9c/db5 39 2024-09-13T21:40:28.698 INFO:tasks.workunit.client.0.smithi088.stdout:1/826: creat d9/d4f/d64/f120 x:0 0 0 2024-09-13T21:40:28.698 INFO:tasks.workunit.client.0.smithi088.stdout:9/686: creat d1a/d1b/fd8 x:0 0 0 2024-09-13T21:40:28.699 INFO:tasks.workunit.client.0.smithi088.stdout:6/854: write d0/d1e/d1f/f4d [2329440,24319] 0 2024-09-13T21:40:28.699 INFO:tasks.workunit.client.0.smithi088.stdout:6/855: read - d0/d2c/d8b/ddb/ff8 zero size 2024-09-13T21:40:28.703 INFO:tasks.workunit.client.0.smithi088.stdout:1/827: unlink d9/d4f/d64/f120 0 2024-09-13T21:40:28.704 INFO:tasks.workunit.client.0.smithi088.stdout:1/828: mknod d9/d10/d9f/c121 0 2024-09-13T21:40:28.714 INFO:tasks.workunit.client.0.smithi088.stdout:6/856: write d0/db/f43 [154493,80196] 0 2024-09-13T21:40:28.717 INFO:tasks.workunit.client.0.smithi088.stdout:1/829: write d9/d10/d2a/d4b/d33/dad/ff8 [689544,81878] 0 2024-09-13T21:40:28.719 INFO:tasks.workunit.client.0.smithi088.stdout:1/830: dread d9/dc/d74/f87 [0,4194304] 0 2024-09-13T21:40:28.719 INFO:tasks.workunit.client.0.smithi088.stdout:1/831: dread - d9/d4f/d64/fe9 zero size 2024-09-13T21:40:28.720 INFO:tasks.workunit.client.0.smithi088.stdout:1/832: symlink d9/l122 0 2024-09-13T21:40:28.720 INFO:tasks.workunit.client.0.smithi088.stdout:1/833: write d9/d10/d2a/d4b/d39/d43/dfb/f115 [479638,30774] 0 2024-09-13T21:40:28.722 INFO:tasks.workunit.client.0.smithi088.stdout:8/784: dwrite db/d26/f36 [0,4194304] 0 2024-09-13T21:40:28.722 INFO:tasks.workunit.client.0.smithi088.stdout:8/785: fsync db/d26/d2c/f87 0 2024-09-13T21:40:28.722 INFO:tasks.workunit.client.0.smithi088.stdout:3/861: dwrite d5/d23/d2a/d6b/d98/da1/daa/f6e [0,4194304] 0 2024-09-13T21:40:28.723 INFO:tasks.workunit.client.0.smithi088.stdout:5/943: dwrite d4/d1c/d24/d26/dbf/d89/d92/f2d [0,4194304] 0 2024-09-13T21:40:28.723 INFO:tasks.workunit.client.0.smithi088.stdout:5/944: truncate d4/d1c/f122 202573 0 2024-09-13T21:40:28.723 INFO:tasks.workunit.client.0.smithi088.stdout:5/945: chown d4/d1b/d68/f9c 455120 1 2024-09-13T21:40:28.723 INFO:tasks.workunit.client.0.smithi088.stdout:5/946: truncate d4/d1c/d24/d95/fc4 3505733 0 2024-09-13T21:40:28.723 INFO:tasks.workunit.client.0.smithi088.stdout:0/837: dwrite d7/d1d/d21/ff9 [0,4194304] 0 2024-09-13T21:40:28.723 INFO:tasks.workunit.client.0.smithi088.stdout:0/838: fsync d7/d1d/d21/d82/fc5 0 2024-09-13T21:40:28.723 INFO:tasks.workunit.client.0.smithi088.stdout:0/839: fsync d7/d2c/d30/d31/d42/f74 0 2024-09-13T21:40:28.724 INFO:tasks.workunit.client.0.smithi088.stdout:2/825: dwrite d1/d8/d2e/d3b/dff/d2a/d41/d82/fed [0,4194304] 0 2024-09-13T21:40:28.724 INFO:tasks.workunit.client.0.smithi088.stdout:8/786: rmdir db/d26/d2c/db7/dba 39 2024-09-13T21:40:28.728 INFO:tasks.workunit.client.0.smithi088.stdout:3/862: symlink d5/d23/d2a/d3f/d76/l10b 0 2024-09-13T21:40:28.728 INFO:tasks.workunit.client.0.smithi088.stdout:4/797: dwrite d2/d5/d20/d60/de/d1e/d23/dca/fd1 [0,4194304] 0 2024-09-13T21:40:28.728 INFO:tasks.workunit.client.0.smithi088.stdout:4/798: truncate d2/d5/d20/d41/ff9 886848 0 2024-09-13T21:40:28.732 INFO:tasks.workunit.client.0.smithi088.stdout:0/840: link d7/d2c/d30/d31/d42/fad d7/d1d/d3d/dae/d111/f121 0 2024-09-13T21:40:28.737 INFO:tasks.workunit.client.0.smithi088.stdout:8/787: write db/df/f1f [7356443,66886] 0 2024-09-13T21:40:28.741 INFO:tasks.workunit.client.0.smithi088.stdout:1/834: dwrite d9/f14 [0,4194304] 0 2024-09-13T21:40:28.742 INFO:tasks.workunit.client.0.smithi088.stdout:5/947: dwrite d4/d1c/d4a/fe4 [0,4194304] 0 2024-09-13T21:40:28.747 INFO:tasks.workunit.client.0.smithi088.stdout:2/826: symlink d1/d8/d2e/d3b/dff/d2a/d41/d48/da0/l116 0 2024-09-13T21:40:28.748 INFO:tasks.workunit.client.0.smithi088.stdout:9/687: getdents d1a/d1b/d3f 0 2024-09-13T21:40:28.749 INFO:tasks.workunit.client.0.smithi088.stdout:3/863: write d5/d23/d2a/d6b/d98/ddc/fac [1538978,38297] 0 2024-09-13T21:40:28.752 INFO:tasks.workunit.client.0.smithi088.stdout:4/799: mkdir d2/d5/d20/d60/de/d1e/d23/d6f/d105 0 2024-09-13T21:40:28.752 INFO:tasks.workunit.client.0.smithi088.stdout:4/800: creat d2/d5/d2d/d70/f106 x:0 0 0 2024-09-13T21:40:28.754 INFO:tasks.workunit.client.0.smithi088.stdout:5/948: read d4/d1c/f45 [1579444,103015] 0 2024-09-13T21:40:28.755 INFO:tasks.workunit.client.0.smithi088.stdout:0/841: rename d7/f91 to d7/d1d/d66/f122 0 2024-09-13T21:40:28.757 INFO:tasks.workunit.client.0.smithi088.stdout:8/788: creat db/df/d61/d97/f105 x:0 0 0 2024-09-13T21:40:28.758 INFO:tasks.workunit.client.0.smithi088.stdout:8/789: write db/d26/d2c/db7/dbd/fc7 [2043811,32931] 0 2024-09-13T21:40:28.760 INFO:tasks.workunit.client.0.smithi088.stdout:3/864: mkdir d5/d5a/d7f/d10c 0 2024-09-13T21:40:28.760 INFO:tasks.workunit.client.0.smithi088.stdout:9/688: write d1a/d61/d3d/d41/f8a [3583117,5719] 0 2024-09-13T21:40:28.763 INFO:tasks.workunit.client.0.smithi088.stdout:5/949: read d4/da7/ff1 [2198552,65578] 0 2024-09-13T21:40:28.764 INFO:tasks.workunit.client.0.smithi088.stdout:4/801: rename d2/d5/d20/d7f/f8f to d2/d5/d20/d60/de/d1e/d23/f107 0 2024-09-13T21:40:28.764 INFO:tasks.workunit.client.0.smithi088.stdout:4/802: creat d2/d5/d20/d41/f108 x:0 0 0 2024-09-13T21:40:28.764 INFO:tasks.workunit.client.0.smithi088.stdout:4/803: fdatasync d2/d5/d20/d41/f108 0 2024-09-13T21:40:28.765 INFO:tasks.workunit.client.0.smithi088.stdout:8/790: symlink db/df/da7/d88/ddd/de8/l106 0 2024-09-13T21:40:28.765 INFO:tasks.workunit.client.0.smithi088.stdout:8/791: creat db/d26/d37/dd9/f107 x:0 0 0 2024-09-13T21:40:28.766 INFO:tasks.workunit.client.0.smithi088.stdout:8/792: creat db/d26/d37/dd9/f108 x:0 0 0 2024-09-13T21:40:28.775 INFO:tasks.workunit.client.0.smithi088.stdout:0/842: dwrite d7/d2c/d30/d31/d42/de2/f100 [4194304,4194304] 0 2024-09-13T21:40:28.776 INFO:tasks.workunit.client.0.smithi088.stdout:2/827: dwrite d1/f34 [4194304,4194304] 0 2024-09-13T21:40:28.799 INFO:tasks.workunit.client.0.smithi088.stdout:2/828: dwrite d1/d8/d2e/d3b/ff9 [0,4194304] 0 2024-09-13T21:40:28.799 INFO:tasks.workunit.client.0.smithi088.stdout:9/689: unlink d1a/d61/c57 0 2024-09-13T21:40:28.801 INFO:tasks.workunit.client.0.smithi088.stdout:5/950: creat d4/d1c/d24/d26/dbf/d89/dc9/f138 x:0 0 0 2024-09-13T21:40:28.817 INFO:tasks.workunit.client.0.smithi088.stdout:9/690: dwrite d1a/d1b/f74 [0,4194304] 0 2024-09-13T21:40:28.817 INFO:tasks.workunit.client.0.smithi088.stdout:9/691: truncate d1a/d61/d3d/d41/d48/d86/d8e/fbd 1000805 0 2024-09-13T21:40:28.817 INFO:tasks.workunit.client.0.smithi088.stdout:7/683: sync 2024-09-13T21:40:28.826 INFO:tasks.workunit.client.0.smithi088.stdout:9/692: dread f17 [0,4194304] 0 2024-09-13T21:40:28.826 INFO:tasks.workunit.client.0.smithi088.stdout:9/693: fsync d1a/d3c/d51/f83 0 2024-09-13T21:40:28.826 INFO:tasks.workunit.client.0.smithi088.stdout:7/684: dread f1 [0,4194304] 0 2024-09-13T21:40:28.836 INFO:tasks.workunit.client.0.smithi088.stdout:0/843: symlink d7/d1d/d3d/dae/d111/l123 0 2024-09-13T21:40:28.908 INFO:tasks.workunit.client.0.smithi088.stdout:5/951: symlink d4/d1c/d24/d26/dbf/dc6/d10e/l139 0 2024-09-13T21:40:28.908 INFO:tasks.workunit.client.0.smithi088.stdout:5/952: write d4/d1c/f122 [848645,128869] 0 2024-09-13T21:40:28.909 INFO:tasks.workunit.client.0.smithi088.stdout:5/953: write d4/d1c/d24/d26/dfe/f120 [85621,80431] 0 2024-09-13T21:40:28.915 INFO:tasks.workunit.client.0.smithi088.stdout:7/685: unlink d6/da/f10 0 2024-09-13T21:40:28.915 INFO:tasks.workunit.client.0.smithi088.stdout:7/686: write d6/da/db7/fc2 [293421,130495] 0 2024-09-13T21:40:28.917 INFO:tasks.workunit.client.0.smithi088.stdout:0/844: creat d7/d2c/d30/d31/d42/de2/f124 x:0 0 0 2024-09-13T21:40:28.923 INFO:tasks.workunit.client.0.smithi088.stdout:5/954: rmdir d4/d1b/d68 39 2024-09-13T21:40:28.926 INFO:tasks.workunit.client.0.smithi088.stdout:7/687: dread d6/da/f38 [0,4194304] 0 2024-09-13T21:40:28.926 INFO:tasks.workunit.client.0.smithi088.stdout:0/845: write d7/d2c/d30/d31/d42/d4b/f113 [1187193,49883] 0 2024-09-13T21:40:28.926 INFO:tasks.workunit.client.0.smithi088.stdout:0/846: fsync d7/d1d/d3d/f57 0 2024-09-13T21:40:28.926 INFO:tasks.workunit.client.0.smithi088.stdout:0/847: read - d7/d2c/d30/d31/d42/fec zero size 2024-09-13T21:40:28.927 INFO:tasks.workunit.client.0.smithi088.stdout:5/955: symlink d4/d1c/d24/d26/d56/d100/l13a 0 2024-09-13T21:40:28.929 INFO:tasks.workunit.client.0.smithi088.stdout:7/688: creat d6/da/fea x:0 0 0 2024-09-13T21:40:28.931 INFO:tasks.workunit.client.0.smithi088.stdout:0/848: mkdir d7/d1d/d66/d8b/d118/d45/d7c/d125 0 2024-09-13T21:40:28.932 INFO:tasks.workunit.client.0.smithi088.stdout:7/689: mkdir d6/d5f/d69/d4f/d6f/d70/d76/dbd/deb 0 2024-09-13T21:40:28.935 INFO:tasks.workunit.client.0.smithi088.stdout:0/849: mkdir d7/d2c/d30/dbe/d126 0 2024-09-13T21:40:28.935 INFO:tasks.workunit.client.0.smithi088.stdout:0/850: write d7/d1d/d27/d43/f17 [133227,102970] 0 2024-09-13T21:40:28.937 INFO:tasks.workunit.client.0.smithi088.stdout:7/690: unlink d6/d5f/d69/d45/cd2 0 2024-09-13T21:40:28.940 INFO:tasks.workunit.client.0.smithi088.stdout:7/691: rmdir d6/d5f/d69/d4f/d4c/db9 39 2024-09-13T21:40:28.940 INFO:tasks.workunit.client.0.smithi088.stdout:7/692: chown d6/da/db7/fc2 19173846 1 2024-09-13T21:40:28.943 INFO:tasks.workunit.client.0.smithi088.stdout:5/956: dwrite d4/d1c/d24/d26/d4b/d66/f71 [0,4194304] 0 2024-09-13T21:40:28.943 INFO:tasks.workunit.client.0.smithi088.stdout:5/957: write d4/d1c/d24/f39 [795381,19528] 0 2024-09-13T21:40:28.950 INFO:tasks.workunit.client.0.smithi088.stdout:5/958: unlink d4/d1c/d76/f88 0 2024-09-13T21:40:28.951 INFO:tasks.workunit.client.0.smithi088.stdout:5/959: creat d4/d1c/d24/d26/dbf/d89/dc9/dd1/f13b x:0 0 0 2024-09-13T21:40:28.954 INFO:tasks.workunit.client.0.smithi088.stdout:2/829: creat d1/d8/d2e/d3b/dff/d2a/d3c/f117 x:0 0 0 2024-09-13T21:40:28.955 INFO:tasks.workunit.client.0.smithi088.stdout:4/804: mknod d2/d13/c109 0 2024-09-13T21:40:28.960 INFO:tasks.workunit.client.0.smithi088.stdout:8/793: mknod db/d26/d37/c109 0 2024-09-13T21:40:28.960 INFO:tasks.workunit.client.0.smithi088.stdout:8/794: stat db/d26/d2c/c60 0 2024-09-13T21:40:28.961 INFO:tasks.workunit.client.0.smithi088.stdout:8/795: symlink db/df/de0/l10a 0 2024-09-13T21:40:28.964 INFO:tasks.workunit.client.0.smithi088.stdout:7/693: rename d6/da/d1a/d3a/d5c/c79 to d6/d5f/d69/d4f/d6f/d70/cec 0 2024-09-13T21:40:28.967 INFO:tasks.workunit.client.0.smithi088.stdout:2/830: dread d1/d8/d2e/f53 [0,4194304] 0 2024-09-13T21:40:28.970 INFO:tasks.workunit.client.0.smithi088.stdout:5/960: dwrite d4/d1c/d24/d95/fc4 [0,4194304] 0 2024-09-13T21:40:28.975 INFO:tasks.workunit.client.0.smithi088.stdout:8/796: dread db/d26/d4f/f62 [0,4194304] 0 2024-09-13T21:40:28.988 INFO:tasks.workunit.client.0.smithi088.stdout:3/865: rmdir d5/d23/d2a/d63/d9c 0 2024-09-13T21:40:28.988 INFO:tasks.workunit.client.0.smithi088.stdout:7/694: dwrite d6/f42 [0,4194304] 0 2024-09-13T21:40:28.990 INFO:tasks.workunit.client.0.smithi088.stdout:3/866: symlink d5/d23/d2a/d3f/d76/db3/da5/l10d 0 2024-09-13T21:40:28.996 INFO:tasks.workunit.client.0.smithi088.stdout:3/867: truncate d5/d23/d2a/d3f/db4/fe1 2001080 0 2024-09-13T21:40:28.999 INFO:tasks.workunit.client.0.smithi088.stdout:7/695: unlink d6/da/d1a/d3a/d5c/d60/fd7 0 2024-09-13T21:40:29.002 INFO:tasks.workunit.client.0.smithi088.stdout:2/831: rename d1/d8/d2e/fbe to d1/d8/d2e/d3b/dff/d2a/d3c/d4a/f118 0 2024-09-13T21:40:29.005 INFO:tasks.workunit.client.0.smithi088.stdout:7/696: rmdir d6/d5f/d69/d4f/d6f/d83/d97 0 2024-09-13T21:40:29.007 INFO:tasks.workunit.client.0.smithi088.stdout:2/832: unlink d1/d8/d24/f39 0 2024-09-13T21:40:29.007 INFO:tasks.workunit.client.0.smithi088.stdout:2/833: chown d1/d8/d24/l73 7626628 1 2024-09-13T21:40:29.007 INFO:tasks.workunit.client.0.smithi088.stdout:2/834: truncate d1/d8/d2e/d3b/dff/d3f/d99/d9c/fbf 301533 0 2024-09-13T21:40:29.008 INFO:tasks.workunit.client.0.smithi088.stdout:7/697: mkdir d6/d5f/d69/d4f/d6f/d70/ded 0 2024-09-13T21:40:29.010 INFO:tasks.workunit.client.0.smithi088.stdout:2/835: unlink d1/d8/d24/d78/d7f/d85/cdd 0 2024-09-13T21:40:29.011 INFO:tasks.workunit.client.0.smithi088.stdout:7/698: symlink d6/d5f/d69/d4f/d6f/d70/dbf/lee 0 2024-09-13T21:40:29.011 INFO:tasks.workunit.client.0.smithi088.stdout:7/699: read d6/d5f/d69/d4f/d6f/f92 [2833699,50152] 0 2024-09-13T21:40:29.012 INFO:tasks.workunit.client.0.smithi088.stdout:7/700: write d6/d5f/d69/d45/fcc [169159,122591] 0 2024-09-13T21:40:29.016 INFO:tasks.workunit.client.0.smithi088.stdout:3/868: dwrite d5/d23/d2a/f59 [4194304,4194304] 0 2024-09-13T21:40:29.021 INFO:tasks.workunit.client.0.smithi088.stdout:4/805: creat d2/d5/d20/d60/de/d1e/d23/d3c/f10a x:0 0 0 2024-09-13T21:40:29.021 INFO:tasks.workunit.client.0.smithi088.stdout:4/806: dread - d2/d5/d20/d41/d4b/f6a zero size 2024-09-13T21:40:29.022 INFO:tasks.workunit.client.0.smithi088.stdout:9/694: rmdir d1a/d3c/d51/d5e 39 2024-09-13T21:40:29.022 INFO:tasks.workunit.client.0.smithi088.stdout:9/695: chown d1a/d61/dc6 270043 1 2024-09-13T21:40:29.023 INFO:tasks.workunit.client.0.smithi088.stdout:9/696: link d1a/d3c/d51/d5e/d7e/d92/cd1 d1a/d61/d3d/d41/d48/d86/d8e/cd9 0 2024-09-13T21:40:29.024 INFO:tasks.workunit.client.0.smithi088.stdout:8/797: rmdir db/d26/d2c/d85 39 2024-09-13T21:40:29.024 INFO:tasks.workunit.client.0.smithi088.stdout:8/798: dread - db/df/da7/d88/ddd/ff1 zero size 2024-09-13T21:40:29.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/697: write d1a/d61/d3d/d41/d48/d86/d8e/fbd [579874,16716] 0 2024-09-13T21:40:29.026 INFO:tasks.workunit.client.0.smithi088.stdout:8/799: mknod db/df/c10b 0 2024-09-13T21:40:29.026 INFO:tasks.workunit.client.0.smithi088.stdout:4/807: dread d2/d5/d20/d7f/fcf [0,4194304] 0 2024-09-13T21:40:29.027 INFO:tasks.workunit.client.0.smithi088.stdout:8/800: write db/df/d61/d97/faf [128179,64210] 0 2024-09-13T21:40:29.027 INFO:tasks.workunit.client.0.smithi088.stdout:8/801: write db/d26/f8d [3780319,1490] 0 2024-09-13T21:40:29.029 INFO:tasks.workunit.client.0.smithi088.stdout:4/808: creat d2/d5/d20/d60/de/d1e/d31/d61/d99/f10b x:0 0 0 2024-09-13T21:40:29.032 INFO:tasks.workunit.client.0.smithi088.stdout:8/802: rename db/df/l64 to db/d26/d2c/db7/l10c 0 2024-09-13T21:40:29.032 INFO:tasks.workunit.client.0.smithi088.stdout:8/803: dread - db/df/d61/fa6 zero size 2024-09-13T21:40:29.032 INFO:tasks.workunit.client.0.smithi088.stdout:1/835: sync 2024-09-13T21:40:29.032 INFO:tasks.workunit.client.0.smithi088.stdout:6/857: sync 2024-09-13T21:40:29.032 INFO:tasks.workunit.client.0.smithi088.stdout:6/858: readlink d0/db/d37/ld6 0 2024-09-13T21:40:29.033 INFO:tasks.workunit.client.0.smithi088.stdout:4/809: dread d2/d5/d20/d60/de/d1e/d23/f9a [0,4194304] 0 2024-09-13T21:40:29.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/859: mknod d0/db/d37/c114 0 2024-09-13T21:40:29.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/860: fsync d0/d28/fa8 0 2024-09-13T21:40:29.033 INFO:tasks.workunit.client.0.smithi088.stdout:6/861: creat d0/d2c/d83/f115 x:0 0 0 2024-09-13T21:40:29.034 INFO:tasks.workunit.client.0.smithi088.stdout:6/862: write d0/d1e/d1f/f51 [1677562,125121] 0 2024-09-13T21:40:29.037 INFO:tasks.workunit.client.0.smithi088.stdout:1/836: creat d9/dc/d74/df0/f123 x:0 0 0 2024-09-13T21:40:29.038 INFO:tasks.workunit.client.0.smithi088.stdout:4/810: truncate d2/d5/d20/d60/de/d1e/d31/f7d 3020503 0 2024-09-13T21:40:29.039 INFO:tasks.workunit.client.0.smithi088.stdout:4/811: read - d2/d5/d20/d41/f108 zero size 2024-09-13T21:40:29.039 INFO:tasks.workunit.client.0.smithi088.stdout:4/812: write d2/d5/d20/d41/ff9 [653440,99417] 0 2024-09-13T21:40:29.039 INFO:tasks.workunit.client.0.smithi088.stdout:3/869: dwrite d5/d23/d2a/d63/f97 [4194304,4194304] 0 2024-09-13T21:40:29.042 INFO:tasks.workunit.client.0.smithi088.stdout:6/863: getdents d0/d1e/d1f/d55/d96/d98 0 2024-09-13T21:40:29.046 INFO:tasks.workunit.client.0.smithi088.stdout:1/837: getdents d9/dc/d52/dba 0 2024-09-13T21:40:29.048 INFO:tasks.workunit.client.0.smithi088.stdout:4/813: mknod d2/d5/d20/d7f/c10c 0 2024-09-13T21:40:29.048 INFO:tasks.workunit.client.0.smithi088.stdout:4/814: chown d2/d11/dab/cb3 415 1 2024-09-13T21:40:29.056 INFO:tasks.workunit.client.0.smithi088.stdout:6/864: symlink d0/d2c/d7a/d7c/l116 0 2024-09-13T21:40:29.058 INFO:tasks.workunit.client.0.smithi088.stdout:1/838: symlink d9/d10/d2a/d4b/d33/dad/l124 0 2024-09-13T21:40:29.058 INFO:tasks.workunit.client.0.smithi088.stdout:1/839: stat d9/dc/ca3 0 2024-09-13T21:40:29.060 INFO:tasks.workunit.client.0.smithi088.stdout:3/870: rename d5/l11 to d5/d23/d2a/d3f/d76/l10e 0 2024-09-13T21:40:29.061 INFO:tasks.workunit.client.0.smithi088.stdout:6/865: getdents d0/d1e/d1f/d55/d8f 0 2024-09-13T21:40:29.062 INFO:tasks.workunit.client.0.smithi088.stdout:1/840: link d9/d10/d2a/d47/d9c/faf d9/d10/d2a/d4b/d33/f125 0 2024-09-13T21:40:29.064 INFO:tasks.workunit.client.0.smithi088.stdout:1/841: read d9/d10/d2a/d4b/d3a/ff4 [113504,115980] 0 2024-09-13T21:40:29.065 INFO:tasks.workunit.client.0.smithi088.stdout:3/871: unlink d5/d23/d2a/d3f/d76/db3/ff8 0 2024-09-13T21:40:29.065 INFO:tasks.workunit.client.0.smithi088.stdout:3/872: write d5/d14/f18 [4841283,37293] 0 2024-09-13T21:40:29.066 INFO:tasks.workunit.client.0.smithi088.stdout:6/866: rename d0/d2c/fdc to d0/d28/f117 0 2024-09-13T21:40:29.067 INFO:tasks.workunit.client.0.smithi088.stdout:1/842: mkdir d9/d10/dff/d126 0 2024-09-13T21:40:29.071 INFO:tasks.workunit.client.0.smithi088.stdout:3/873: creat d5/d23/d2a/d3f/f10f x:0 0 0 2024-09-13T21:40:29.071 INFO:tasks.workunit.client.0.smithi088.stdout:9/698: dwrite d1a/d61/d3d/d41/d48/d86/d97/f98 [0,4194304] 0 2024-09-13T21:40:29.072 INFO:tasks.workunit.client.0.smithi088.stdout:2/836: dwrite d1/d8/d2e/d3b/dff/d2a/d3c/d4a/f118 [0,4194304] 0 2024-09-13T21:40:29.073 INFO:tasks.workunit.client.0.smithi088.stdout:8/804: dwrite db/d26/d2c/db7/dbd/fc7 [0,4194304] 0 2024-09-13T21:40:29.073 INFO:tasks.workunit.client.0.smithi088.stdout:4/815: dwrite d2/d11/dab/ff4 [0,4194304] 0 2024-09-13T21:40:29.074 INFO:tasks.workunit.client.0.smithi088.stdout:3/874: symlink d5/d23/d2a/d63/l110 0 2024-09-13T21:40:29.076 INFO:tasks.workunit.client.0.smithi088.stdout:9/699: rmdir d1a/d3c/d60 39 2024-09-13T21:40:29.076 INFO:tasks.workunit.client.0.smithi088.stdout:9/700: write d1a/d9e/fc4 [688079,78056] 0 2024-09-13T21:40:29.078 INFO:tasks.workunit.client.0.smithi088.stdout:2/837: write d1/d8/fa8 [684323,44844] 0 2024-09-13T21:40:29.084 INFO:tasks.workunit.client.0.smithi088.stdout:3/875: dread d5/d23/d2a/d6b/d9e/fec [0,4194304] 0 2024-09-13T21:40:29.084 INFO:tasks.workunit.client.0.smithi088.stdout:2/838: dread d1/d8/d2e/f53 [0,4194304] 0 2024-09-13T21:40:29.087 INFO:tasks.workunit.client.0.smithi088.stdout:4/816: write d2/d5/d2d/f3e [3509386,96399] 0 2024-09-13T21:40:29.092 INFO:tasks.workunit.client.0.smithi088.stdout:9/701: mknod d1a/d3c/d51/db2/cda 0 2024-09-13T21:40:29.092 INFO:tasks.workunit.client.0.smithi088.stdout:9/702: write d1a/d61/d3d/d41/f77 [764377,81009] 0 2024-09-13T21:40:29.092 INFO:tasks.workunit.client.0.smithi088.stdout:9/703: chown d1a/d3c/d51/d5e/fb0 536566603 1 2024-09-13T21:40:29.093 INFO:tasks.workunit.client.0.smithi088.stdout:3/876: mkdir d5/d5a/dcf/d111 0 2024-09-13T21:40:29.095 INFO:tasks.workunit.client.0.smithi088.stdout:2/839: truncate d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/f10d 7908121 0 2024-09-13T21:40:29.095 INFO:tasks.workunit.client.0.smithi088.stdout:2/840: truncate d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/f113 267534 0 2024-09-13T21:40:29.096 INFO:tasks.workunit.client.0.smithi088.stdout:4/817: symlink d2/d5/d20/d7f/l10d 0 2024-09-13T21:40:29.102 INFO:tasks.workunit.client.0.smithi088.stdout:8/805: dwrite db/d26/d4f/dd0/ff4 [0,4194304] 0 2024-09-13T21:40:29.103 INFO:tasks.workunit.client.0.smithi088.stdout:8/806: dread - db/df/da7/d88/da8/db4/fbc zero size 2024-09-13T21:40:29.103 INFO:tasks.workunit.client.0.smithi088.stdout:8/807: read - db/df/d61/fec zero size 2024-09-13T21:40:29.103 INFO:tasks.workunit.client.0.smithi088.stdout:8/808: creat db/df/d61/d97/f10d x:0 0 0 2024-09-13T21:40:29.103 INFO:tasks.workunit.client.0.smithi088.stdout:1/843: dwrite d9/d10/d2a/d4b/d39/fb0 [0,4194304] 0 2024-09-13T21:40:29.103 INFO:tasks.workunit.client.0.smithi088.stdout:1/844: fsync d9/d10/d2a/f8a 0 2024-09-13T21:40:29.103 INFO:tasks.workunit.client.0.smithi088.stdout:1/845: write d9/d10/d9f/dfe/d10d/f114 [896859,72335] 0 2024-09-13T21:40:29.105 INFO:tasks.workunit.client.0.smithi088.stdout:3/877: dread d5/f22 [4194304,4194304] 0 2024-09-13T21:40:29.106 INFO:tasks.workunit.client.0.smithi088.stdout:8/809: rename db/df/d61/fa9 to db/d26/f10e 0 2024-09-13T21:40:29.107 INFO:tasks.workunit.client.0.smithi088.stdout:4/818: dread d2/d5/d20/d60/de/d1e/d23/fe2 [0,4194304] 0 2024-09-13T21:40:29.107 INFO:tasks.workunit.client.0.smithi088.stdout:4/819: truncate d2/d5/d2d/d70/fe1 512754 0 2024-09-13T21:40:29.107 INFO:tasks.workunit.client.0.smithi088.stdout:4/820: chown d2/d13/cac 0 1 2024-09-13T21:40:29.110 INFO:tasks.workunit.client.0.smithi088.stdout:1/846: truncate d9/f19 6530447 0 2024-09-13T21:40:29.117 INFO:tasks.workunit.client.0.smithi088.stdout:3/878: rename d5/d23/d2a/d63/d48/lfb to d5/d23/d2a/d63/d48/d49/dd8/l112 0 2024-09-13T21:40:29.119 INFO:tasks.workunit.client.0.smithi088.stdout:8/810: stat db/d26/d2c/l31 0 2024-09-13T21:40:29.120 INFO:tasks.workunit.client.0.smithi088.stdout:8/811: write db/d26/d37/dd9/f101 [637526,78932] 0 2024-09-13T21:40:29.120 INFO:tasks.workunit.client.0.smithi088.stdout:4/821: symlink d2/d5/d20/d60/l10e 0 2024-09-13T21:40:29.121 INFO:tasks.workunit.client.0.smithi088.stdout:1/847: creat d9/d10/d2a/d47/d9c/db5/de6/f127 x:0 0 0 2024-09-13T21:40:29.121 INFO:tasks.workunit.client.0.smithi088.stdout:1/848: dread - d9/d10/d2a/d47/d9c/db5/de6/f103 zero size 2024-09-13T21:40:29.122 INFO:tasks.workunit.client.0.smithi088.stdout:0/851: sync 2024-09-13T21:40:29.123 INFO:tasks.workunit.client.0.smithi088.stdout:8/812: unlink db/d26/d2c/d85/feb 0 2024-09-13T21:40:29.126 INFO:tasks.workunit.client.0.smithi088.stdout:0/852: symlink d7/d65/d8c/deb/l127 0 2024-09-13T21:40:29.127 INFO:tasks.workunit.client.0.smithi088.stdout:3/879: write d5/d23/d2a/d63/d31/f4e [1156932,109764] 0 2024-09-13T21:40:29.130 INFO:tasks.workunit.client.0.smithi088.stdout:4/822: rmdir d2/d5/d2d/d70 39 2024-09-13T21:40:29.130 INFO:tasks.workunit.client.0.smithi088.stdout:4/823: creat d2/d5/d20/d41/d4b/d98/f10f x:0 0 0 2024-09-13T21:40:29.134 INFO:tasks.workunit.client.0.smithi088.stdout:1/849: write d9/d10/d2a/d4b/d33/dad/dbb/fe8 [443592,1402] 0 2024-09-13T21:40:29.137 INFO:tasks.workunit.client.0.smithi088.stdout:3/880: mkdir d5/d23/d2a/d3f/d76/db3/da5/d113 0 2024-09-13T21:40:29.142 INFO:tasks.workunit.client.0.smithi088.stdout:3/881: symlink d5/d5a/l114 0 2024-09-13T21:40:29.144 INFO:tasks.workunit.client.0.smithi088.stdout:4/824: dread d2/d5/d20/d41/d4b/f7a [0,4194304] 0 2024-09-13T21:40:29.144 INFO:tasks.workunit.client.0.smithi088.stdout:3/882: truncate d5/d23/d2a/d3f/fa6 3401846 0 2024-09-13T21:40:29.145 INFO:tasks.workunit.client.0.smithi088.stdout:3/883: rename d5/d23/d2a/d63/d48/d49/ff1 to d5/d5a/d7f/d10c/f115 0 2024-09-13T21:40:29.175 INFO:tasks.workunit.client.0.smithi088.stdout:1/850: dwrite d9/dc/d74/f117 [0,4194304] 0 2024-09-13T21:40:29.175 INFO:tasks.workunit.client.0.smithi088.stdout:1/851: dread - d9/d10/d2a/d4b/d3a/f11c zero size 2024-09-13T21:40:29.175 INFO:tasks.workunit.client.0.smithi088.stdout:1/852: write d9/d10/f29 [1635836,56532] 0 2024-09-13T21:40:29.177 INFO:tasks.workunit.client.0.smithi088.stdout:8/813: dwrite db/d26/f5f [4194304,4194304] 0 2024-09-13T21:40:29.177 INFO:tasks.workunit.client.0.smithi088.stdout:8/814: fsync db/d26/d37/f41 0 2024-09-13T21:40:29.177 INFO:tasks.workunit.client.0.smithi088.stdout:0/853: dwrite d7/d1d/d3d/f57 [0,4194304] 0 2024-09-13T21:40:29.177 INFO:tasks.workunit.client.0.smithi088.stdout:0/854: dread - d7/d2c/d37/f6a zero size 2024-09-13T21:40:29.177 INFO:tasks.workunit.client.0.smithi088.stdout:0/855: creat d7/d65/d8c/deb/f128 x:0 0 0 2024-09-13T21:40:29.177 INFO:tasks.workunit.client.0.smithi088.stdout:0/856: chown d7/d2c/d78 402291 1 2024-09-13T21:40:29.177 INFO:tasks.workunit.client.0.smithi088.stdout:4/825: dwrite d2/d5/d20/d7f/fcf [0,4194304] 0 2024-09-13T21:40:29.184 INFO:tasks.workunit.client.0.smithi088.stdout:8/815: write db/df/d61/f81 [505539,62925] 0 2024-09-13T21:40:29.190 INFO:tasks.workunit.client.0.smithi088.stdout:1/853: read d9/d10/d2a/d4b/d39/d43/db2/fce [8265758,100891] 0 2024-09-13T21:40:29.198 INFO:tasks.workunit.client.0.smithi088.stdout:1/854: rename d9/d10/d2a/d4b/d39/l8c to d9/d10/d2a/d47/d9c/l128 0 2024-09-13T21:40:29.199 INFO:tasks.workunit.client.0.smithi088.stdout:1/855: write d9/d10/d2a/d4b/d33/dad/dbb/ff6 [4324671,25378] 0 2024-09-13T21:40:29.201 INFO:tasks.workunit.client.0.smithi088.stdout:1/856: symlink d9/l129 0 2024-09-13T21:40:29.212 INFO:tasks.workunit.client.0.smithi088.stdout:1/857: dread d9/dc/d74/f117 [0,4194304] 0 2024-09-13T21:40:29.213 INFO:tasks.workunit.client.0.smithi088.stdout:1/858: chown d9/d10/d2a/d4b/d3a/l4c 51 1 2024-09-13T21:40:29.213 INFO:tasks.workunit.client.0.smithi088.stdout:4/826: dwrite d2/ff6 [0,4194304] 0 2024-09-13T21:40:29.213 INFO:tasks.workunit.client.0.smithi088.stdout:0/857: dwrite d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:29.213 INFO:tasks.workunit.client.0.smithi088.stdout:8/816: dwrite db/f6b [0,4194304] 0 2024-09-13T21:40:29.217 INFO:tasks.workunit.client.0.smithi088.stdout:1/859: mkdir d9/d10/d2a/d4b/d3a/d10c/d12a 0 2024-09-13T21:40:29.217 INFO:tasks.workunit.client.0.smithi088.stdout:1/860: read - d9/d10/d2a/d4b/d39/f11e zero size 2024-09-13T21:40:29.219 INFO:tasks.workunit.client.0.smithi088.stdout:8/817: truncate db/d26/d2c/fcf 2982099 0 2024-09-13T21:40:29.219 INFO:tasks.workunit.client.0.smithi088.stdout:8/818: write db/df/da7/fcd [210490,18586] 0 2024-09-13T21:40:29.219 INFO:tasks.workunit.client.0.smithi088.stdout:1/861: mkdir d9/d10/d2a/d4b/d39/d43/dfb/d12b 0 2024-09-13T21:40:29.220 INFO:tasks.workunit.client.0.smithi088.stdout:4/827: link d2/d5/d20/d60/de/d1e/d31/l4c d2/d5/d20/d60/de/l110 0 2024-09-13T21:40:29.223 INFO:tasks.workunit.client.0.smithi088.stdout:8/819: mkdir db/d26/d37/dd9/d10f 0 2024-09-13T21:40:29.223 INFO:tasks.workunit.client.0.smithi088.stdout:8/820: dread - db/fd2 zero size 2024-09-13T21:40:29.223 INFO:tasks.workunit.client.0.smithi088.stdout:8/821: write db/d26/d37/d7d/fac [1015778,122275] 0 2024-09-13T21:40:29.223 INFO:tasks.workunit.client.0.smithi088.stdout:8/822: stat db/df/d61/d97/f105 0 2024-09-13T21:40:29.224 INFO:tasks.workunit.client.0.smithi088.stdout:8/823: chown db/df/c98 17 1 2024-09-13T21:40:29.226 INFO:tasks.workunit.client.0.smithi088.stdout:0/858: dread d7/d2c/d30/d31/f6e [0,4194304] 0 2024-09-13T21:40:29.227 INFO:tasks.workunit.client.0.smithi088.stdout:1/862: dread d9/dc/d74/f87 [0,4194304] 0 2024-09-13T21:40:29.227 INFO:tasks.workunit.client.0.smithi088.stdout:8/824: unlink db/df/da7/l30 0 2024-09-13T21:40:29.229 INFO:tasks.workunit.client.0.smithi088.stdout:0/859: creat d7/d1d/d21/d82/db8/de5/f129 x:0 0 0 2024-09-13T21:40:29.231 INFO:tasks.workunit.client.0.smithi088.stdout:9/704: sync 2024-09-13T21:40:29.231 INFO:tasks.workunit.client.0.smithi088.stdout:6/867: sync 2024-09-13T21:40:29.231 INFO:tasks.workunit.client.0.smithi088.stdout:7/701: sync 2024-09-13T21:40:29.231 INFO:tasks.workunit.client.0.smithi088.stdout:5/961: sync 2024-09-13T21:40:29.231 INFO:tasks.workunit.client.0.smithi088.stdout:5/962: creat d4/d1c/d24/d26/dbf/d89/dc9/f13c x:0 0 0 2024-09-13T21:40:29.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:28 smithi088 ceph-mon[27963]: pgmap v254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 146 MiB/s rd, 182 MiB/s wr, 401 op/s 2024-09-13T21:40:29.234 INFO:tasks.workunit.client.0.smithi088.stdout:0/860: symlink d7/d1d/d66/d8b/d118/d34/l12a 0 2024-09-13T21:40:29.234 INFO:tasks.workunit.client.0.smithi088.stdout:0/861: dread - d7/d1d/d66/ff8 zero size 2024-09-13T21:40:29.236 INFO:tasks.workunit.client.0.smithi088.stdout:7/702: mkdir d6/d5f/d69/def 0 2024-09-13T21:40:29.245 INFO:tasks.workunit.client.0.smithi088.stdout:8/825: rmdir db/d26/d2c/db7 39 2024-09-13T21:40:29.245 INFO:tasks.workunit.client.0.smithi088.stdout:8/826: creat db/d26/d37/d7d/f110 x:0 0 0 2024-09-13T21:40:29.245 INFO:tasks.workunit.client.0.smithi088.stdout:7/703: rename d6/d4e/c5e to d6/d5f/d69/d4f/d6f/d70/d76/dbd/deb/cf0 0 2024-09-13T21:40:29.246 INFO:tasks.workunit.client.0.smithi088.stdout:6/868: symlink d0/d1e/d1f/l118 0 2024-09-13T21:40:29.247 INFO:tasks.workunit.client.0.smithi088.stdout:6/869: dread - d0/d2c/d7f/db1/ff7 zero size 2024-09-13T21:40:29.252 INFO:tasks.workunit.client.0.smithi088.stdout:8/827: rename db/d26/d4f/f91 to db/df/da7/d88/da8/db4/df2/f111 0 2024-09-13T21:40:29.252 INFO:tasks.workunit.client.0.smithi088.stdout:8/828: fsync db/df/d61/f6a 0 2024-09-13T21:40:29.254 INFO:tasks.workunit.client.0.smithi088.stdout:9/705: write d1a/d1b/f25 [607704,99609] 0 2024-09-13T21:40:29.255 INFO:tasks.workunit.client.0.smithi088.stdout:8/829: dread db/f8f [0,4194304] 0 2024-09-13T21:40:29.256 INFO:tasks.workunit.client.0.smithi088.stdout:7/704: rename d6/da/l2c to d6/d5f/d69/d45/lf1 0 2024-09-13T21:40:29.260 INFO:tasks.workunit.client.0.smithi088.stdout:9/706: rename d1a/d61/d3d/d41/d48/d86 to d1a/d3c/d51/d5e/ddb 0 2024-09-13T21:40:29.261 INFO:tasks.workunit.client.0.smithi088.stdout:9/707: rmdir d1a/d3c/d51/d5e/ddb/d8e 39 2024-09-13T21:40:29.262 INFO:tasks.workunit.client.0.smithi088.stdout:6/870: write d0/d2c/d32/fbe [3212982,71971] 0 2024-09-13T21:40:29.263 INFO:tasks.workunit.client.0.smithi088.stdout:9/708: mkdir d1a/d3c/d60/ddc 0 2024-09-13T21:40:29.263 INFO:tasks.workunit.client.0.smithi088.stdout:4/828: dwrite d2/ff6 [4194304,4194304] 0 2024-09-13T21:40:29.263 INFO:tasks.workunit.client.0.smithi088.stdout:4/829: dread - d2/d5/d20/fff zero size 2024-09-13T21:40:29.264 INFO:tasks.workunit.client.0.smithi088.stdout:6/871: truncate d0/f52 2143936 0 2024-09-13T21:40:29.264 INFO:tasks.workunit.client.0.smithi088.stdout:9/709: mkdir d1a/d3c/d51/ddd 0 2024-09-13T21:40:29.265 INFO:tasks.workunit.client.0.smithi088.stdout:9/710: fsync d1a/d1b/d3f/fd6 0 2024-09-13T21:40:29.266 INFO:tasks.workunit.client.0.smithi088.stdout:6/872: mknod d0/d2c/dad/db8/dcc/c119 0 2024-09-13T21:40:29.267 INFO:tasks.workunit.client.0.smithi088.stdout:7/705: write d6/f53 [3792296,25576] 0 2024-09-13T21:40:29.267 INFO:tasks.workunit.client.0.smithi088.stdout:7/706: chown d6/d5f/fde 4048 1 2024-09-13T21:40:29.268 INFO:tasks.workunit.client.0.smithi088.stdout:6/873: mkdir d0/d2c/d59/d11a 0 2024-09-13T21:40:29.271 INFO:tasks.workunit.client.0.smithi088.stdout:7/707: creat d6/d5f/d69/d4f/d6f/ff2 x:0 0 0 2024-09-13T21:40:29.271 INFO:tasks.workunit.client.0.smithi088.stdout:5/963: dwrite d4/d1c/d4a/d63/dd0/fe2 [0,4194304] 0 2024-09-13T21:40:29.271 INFO:tasks.workunit.client.0.smithi088.stdout:7/708: creat d6/d5f/da9/ff3 x:0 0 0 2024-09-13T21:40:29.271 INFO:tasks.workunit.client.0.smithi088.stdout:8/830: fdatasync db/df/d61/f81 0 2024-09-13T21:40:29.271 INFO:tasks.workunit.client.0.smithi088.stdout:8/831: chown db/d26/d2c/d85/dad 1 1 2024-09-13T21:40:29.271 INFO:tasks.workunit.client.0.smithi088.stdout:1/863: dwrite d9/d10/d2a/d4b/d33/dad/dbb/fc9 [0,4194304] 0 2024-09-13T21:40:29.275 INFO:tasks.workunit.client.0.smithi088.stdout:5/964: symlink d4/d1c/l13d 0 2024-09-13T21:40:29.275 INFO:tasks.workunit.client.0.smithi088.stdout:5/965: truncate d4/d1c/d24/d95/f103 1933555 0 2024-09-13T21:40:29.276 INFO:tasks.workunit.client.0.smithi088.stdout:0/862: dwrite d7/d1d/d21/f80 [0,4194304] 0 2024-09-13T21:40:29.279 INFO:tasks.workunit.client.0.smithi088.stdout:8/832: rename db/c19 to db/df/da7/daa/c112 0 2024-09-13T21:40:29.282 INFO:tasks.workunit.client.0.smithi088.stdout:1/864: rmdir d9/d10/d2a 39 2024-09-13T21:40:29.285 INFO:tasks.workunit.client.0.smithi088.stdout:7/709: dread d6/d5f/d69/d45/fcb [0,4194304] 0 2024-09-13T21:40:29.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/874: getdents d0/d2c/d8b 0 2024-09-13T21:40:29.285 INFO:tasks.workunit.client.0.smithi088.stdout:6/875: read - d0/d2c/d32/d39/d3f/fe2 zero size 2024-09-13T21:40:29.290 INFO:tasks.workunit.client.0.smithi088.stdout:5/966: unlink d4/d1c/d4a/l4f 0 2024-09-13T21:40:29.292 INFO:tasks.workunit.client.0.smithi088.stdout:0/863: read d7/d65/ff7 [3177547,33372] 0 2024-09-13T21:40:29.292 INFO:tasks.workunit.client.0.smithi088.stdout:0/864: stat d7/d2c/d30/d31/d42/d95/fa3 0 2024-09-13T21:40:29.294 INFO:tasks.workunit.client.0.smithi088.stdout:9/711: dwrite d1a/d1b/f8c [0,4194304] 0 2024-09-13T21:40:29.295 INFO:tasks.workunit.client.0.smithi088.stdout:4/830: dwrite d2/d5/d20/d60/de/f28 [4194304,4194304] 0 2024-09-13T21:40:29.296 INFO:tasks.workunit.client.0.smithi088.stdout:4/831: fdatasync d2/f48 0 2024-09-13T21:40:29.301 INFO:tasks.workunit.client.0.smithi088.stdout:8/833: creat db/d26/d2c/d85/dad/f113 x:0 0 0 2024-09-13T21:40:29.303 INFO:tasks.workunit.client.0.smithi088.stdout:7/710: mkdir d6/d5f/d69/d4f/d6f/d70/ded/df4 0 2024-09-13T21:40:29.303 INFO:tasks.workunit.client.0.smithi088.stdout:0/865: symlink d7/d65/d8c/deb/l12b 0 2024-09-13T21:40:29.308 INFO:tasks.workunit.client.0.smithi088.stdout:9/712: creat d1a/d3c/d51/d5e/ddb/d97/fde x:0 0 0 2024-09-13T21:40:29.309 INFO:tasks.workunit.client.0.smithi088.stdout:4/832: link d2/d5/d20/d60/de/d1e/d31/l4c d2/d5/d20/d60/de/d1e/d31/l111 0 2024-09-13T21:40:29.310 INFO:tasks.workunit.client.0.smithi088.stdout:8/834: dread db/df/f67 [0,4194304] 0 2024-09-13T21:40:29.312 INFO:tasks.workunit.client.0.smithi088.stdout:7/711: creat d6/d5f/d69/d4f/ff5 x:0 0 0 2024-09-13T21:40:29.315 INFO:tasks.workunit.client.0.smithi088.stdout:9/713: rename d1a/d3c/d51/f83 to d1a/d3c/d51/d5e/d7e/fdf 0 2024-09-13T21:40:29.319 INFO:tasks.workunit.client.0.smithi088.stdout:2/841: sync 2024-09-13T21:40:29.319 INFO:tasks.workunit.client.0.smithi088.stdout:2/842: fdatasync d1/d8/d2e/d3b/dff/d2a/d3c/d4a/fa2 0 2024-09-13T21:40:29.321 INFO:tasks.workunit.client.0.smithi088.stdout:2/843: mknod d1/d8/d2e/d91/db3/dd9/c119 0 2024-09-13T21:40:29.321 INFO:tasks.workunit.client.0.smithi088.stdout:6/876: dwrite d0/d2c/dad/f106 [0,4194304] 0 2024-09-13T21:40:29.322 INFO:tasks.workunit.client.0.smithi088.stdout:6/877: dread - d0/d2c/d32/d39/d3f/d71/fe4 zero size 2024-09-13T21:40:29.323 INFO:tasks.workunit.client.0.smithi088.stdout:7/712: dread d6/f22 [0,4194304] 0 2024-09-13T21:40:29.323 INFO:tasks.workunit.client.0.smithi088.stdout:2/844: truncate d1/d8/d2e/d3b/f6f 2323426 0 2024-09-13T21:40:29.323 INFO:tasks.workunit.client.0.smithi088.stdout:2/845: write d1/d8/d16/d40/f67 [982951,67003] 0 2024-09-13T21:40:29.323 INFO:tasks.workunit.client.0.smithi088.stdout:2/846: readlink d1/d8/d16/d40/d7e/lc0 0 2024-09-13T21:40:29.326 INFO:tasks.workunit.client.0.smithi088.stdout:5/967: dwrite d4/d1c/d24/d26/dbf/d89/dc9/dd1/f13b [0,4194304] 0 2024-09-13T21:40:29.330 INFO:tasks.workunit.client.0.smithi088.stdout:6/878: rename d0/d2c/d32/d39/d3f/d71/d81/ca6 to d0/d1e/d1f/d55/d96/c11b 0 2024-09-13T21:40:29.332 INFO:tasks.workunit.client.0.smithi088.stdout:7/713: unlink d6/d4e/f6a 0 2024-09-13T21:40:29.332 INFO:tasks.workunit.client.0.smithi088.stdout:7/714: stat d6/d5f/d69/d4f/d6f/d70/fac 0 2024-09-13T21:40:29.332 INFO:tasks.workunit.client.0.smithi088.stdout:7/715: truncate d6/d5f/d69/d4f/d6f/d70/d76/f82 390813 0 2024-09-13T21:40:29.334 INFO:tasks.workunit.client.0.smithi088.stdout:3/884: sync 2024-09-13T21:40:29.335 INFO:tasks.workunit.client.0.smithi088.stdout:5/968: creat d4/d1c/d24/d26/d4b/d67/db2/d101/f13e x:0 0 0 2024-09-13T21:40:29.335 INFO:tasks.workunit.client.0.smithi088.stdout:5/969: write d4/d1c/d4a/d8a/ff2 [2904473,116119] 0 2024-09-13T21:40:29.336 INFO:tasks.workunit.client.0.smithi088.stdout:2/847: rename d1/d8/d16/d40/d7e/daa/feb to d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/dc3/f11a 0 2024-09-13T21:40:29.336 INFO:tasks.workunit.client.0.smithi088.stdout:2/848: stat d1/d8/d2e/d3b/dff/d2a 0 2024-09-13T21:40:29.336 INFO:tasks.workunit.client.0.smithi088.stdout:9/714: write d1a/d3c/d60/f79 [3456046,36389] 0 2024-09-13T21:40:29.336 INFO:tasks.workunit.client.0.smithi088.stdout:2/849: chown d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/d89/dcc/le8 176 1 2024-09-13T21:40:29.336 INFO:tasks.workunit.client.0.smithi088.stdout:9/715: fdatasync d1a/d9e/fc4 0 2024-09-13T21:40:29.337 INFO:tasks.workunit.client.0.smithi088.stdout:6/879: link d0/d28/d10a/f113 d0/d2c/d59/d11a/f11c 0 2024-09-13T21:40:29.339 INFO:tasks.workunit.client.0.smithi088.stdout:3/885: truncate d5/d5a/d7f/d10c/f115 1064791 0 2024-09-13T21:40:29.340 INFO:tasks.workunit.client.0.smithi088.stdout:5/970: creat d4/d1c/d24/d26/d4b/f13f x:0 0 0 2024-09-13T21:40:29.341 INFO:tasks.workunit.client.0.smithi088.stdout:9/716: creat d1a/d3c/d85/fe0 x:0 0 0 2024-09-13T21:40:29.343 INFO:tasks.workunit.client.0.smithi088.stdout:7/716: link d6/da/db7/ld0 d6/d5f/d69/d4f/d6f/db2/lf6 0 2024-09-13T21:40:29.343 INFO:tasks.workunit.client.0.smithi088.stdout:7/717: fsync d6/d4e/f7b 0 2024-09-13T21:40:29.345 INFO:tasks.workunit.client.0.smithi088.stdout:3/886: creat d5/d23/d2a/d63/d48/f116 x:0 0 0 2024-09-13T21:40:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:28 smithi116 ceph-mon[33391]: pgmap v254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 146 MiB/s rd, 182 MiB/s wr, 401 op/s 2024-09-13T21:40:29.347 INFO:tasks.workunit.client.0.smithi088.stdout:5/971: symlink d4/d1c/d4a/d63/d6a/d6d/l140 0 2024-09-13T21:40:29.348 INFO:tasks.workunit.client.0.smithi088.stdout:9/717: getdents d1a/d61 0 2024-09-13T21:40:29.348 INFO:tasks.workunit.client.0.smithi088.stdout:7/718: symlink d6/d5f/d69/d4f/d6f/lf7 0 2024-09-13T21:40:29.348 INFO:tasks.workunit.client.0.smithi088.stdout:7/719: write d6/fa6 [1884585,44190] 0 2024-09-13T21:40:29.349 INFO:tasks.workunit.client.0.smithi088.stdout:8/835: dwrite db/d26/d2c/d85/f6f [0,4194304] 0 2024-09-13T21:40:29.349 INFO:tasks.workunit.client.0.smithi088.stdout:8/836: write db/d26/d2c/d85/dad/f113 [490878,46455] 0 2024-09-13T21:40:29.349 INFO:tasks.workunit.client.0.smithi088.stdout:8/837: creat db/df/da7/d88/ddd/f114 x:0 0 0 2024-09-13T21:40:29.349 INFO:tasks.workunit.client.0.smithi088.stdout:8/838: fdatasync db/d26/d2c/d85/f5c 0 2024-09-13T21:40:29.350 INFO:tasks.workunit.client.0.smithi088.stdout:5/972: symlink d4/d1c/d4a/d63/dd0/l141 0 2024-09-13T21:40:29.350 INFO:tasks.workunit.client.0.smithi088.stdout:0/866: dwrite d7/fb7 [0,4194304] 0 2024-09-13T21:40:29.350 INFO:tasks.workunit.client.0.smithi088.stdout:0/867: write d7/d2c/d30/d31/fb6 [1546095,84562] 0 2024-09-13T21:40:29.350 INFO:tasks.workunit.client.0.smithi088.stdout:0/868: fsync d7/d1d/d27/f54 0 2024-09-13T21:40:29.350 INFO:tasks.workunit.client.0.smithi088.stdout:0/869: readlink d7/d2c/d30/d31/l71 0 2024-09-13T21:40:29.351 INFO:tasks.workunit.client.0.smithi088.stdout:7/720: mknod d6/d5f/d69/d4f/d6f/d70/d76/dbd/deb/cf8 0 2024-09-13T21:40:29.357 INFO:tasks.workunit.client.0.smithi088.stdout:3/887: dread d5/d23/f57 [0,4194304] 0 2024-09-13T21:40:29.358 INFO:tasks.workunit.client.0.smithi088.stdout:8/839: unlink db/d26/d37/d7d/l8a 0 2024-09-13T21:40:29.361 INFO:tasks.workunit.client.0.smithi088.stdout:9/718: write d1a/d3c/d51/d5e/f84 [449059,108] 0 2024-09-13T21:40:29.363 INFO:tasks.workunit.client.0.smithi088.stdout:5/973: mkdir d4/d1c/d24/d26/dbf/d89/d92/d142 0 2024-09-13T21:40:29.364 INFO:tasks.workunit.client.0.smithi088.stdout:4/833: dwrite d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 [0,4194304] 0 2024-09-13T21:40:29.365 INFO:tasks.workunit.client.0.smithi088.stdout:3/888: symlink d5/d23/d2a/d6b/d98/l117 0 2024-09-13T21:40:29.366 INFO:tasks.workunit.client.0.smithi088.stdout:8/840: mkdir db/df/da7/d88/d115 0 2024-09-13T21:40:29.366 INFO:tasks.workunit.client.0.smithi088.stdout:8/841: write db/df/d61/f81 [822828,7866] 0 2024-09-13T21:40:29.366 INFO:tasks.workunit.client.0.smithi088.stdout:8/842: chown db/df/da7/c57 83 1 2024-09-13T21:40:29.366 INFO:tasks.workunit.client.0.smithi088.stdout:5/974: mknod d4/d1c/d4a/d63/d6a/d6d/c143 0 2024-09-13T21:40:29.367 INFO:tasks.workunit.client.0.smithi088.stdout:0/870: dread d7/d2c/d37/f59 [0,4194304] 0 2024-09-13T21:40:29.367 INFO:tasks.workunit.client.0.smithi088.stdout:0/871: fsync d7/d2c/d30/d31/d42/d4b/f113 0 2024-09-13T21:40:29.368 INFO:tasks.workunit.client.0.smithi088.stdout:4/834: symlink d2/d11/l112 0 2024-09-13T21:40:29.368 INFO:tasks.workunit.client.0.smithi088.stdout:4/835: chown d2/d5/d20/d60/de/d1e/lf7 457065881 1 2024-09-13T21:40:29.368 INFO:tasks.workunit.client.0.smithi088.stdout:4/836: creat d2/d5/d20/d41/d4b/d98/f113 x:0 0 0 2024-09-13T21:40:29.369 INFO:tasks.workunit.client.0.smithi088.stdout:0/872: unlink d7/d1d/d66/d8b/d118/d45/f8d 0 2024-09-13T21:40:29.371 INFO:tasks.workunit.client.0.smithi088.stdout:4/837: mknod d2/d13/dee/c114 0 2024-09-13T21:40:29.371 INFO:tasks.workunit.client.0.smithi088.stdout:4/838: dread - d2/d5/d20/d41/d4b/f6a zero size 2024-09-13T21:40:29.371 INFO:tasks.workunit.client.0.smithi088.stdout:4/839: chown d2/d81/de3 49 1 2024-09-13T21:40:29.372 INFO:tasks.workunit.client.0.smithi088.stdout:8/843: dread db/d26/d4f/f68 [0,4194304] 0 2024-09-13T21:40:29.373 INFO:tasks.workunit.client.0.smithi088.stdout:2/850: dwrite d1/d8/d16/d40/d7e/daa/fda [0,4194304] 0 2024-09-13T21:40:29.374 INFO:tasks.workunit.client.0.smithi088.stdout:4/840: truncate d2/d11/f16 3304175 0 2024-09-13T21:40:29.374 INFO:tasks.workunit.client.0.smithi088.stdout:4/841: readlink d2/d13/l5d 0 2024-09-13T21:40:29.374 INFO:tasks.workunit.client.0.smithi088.stdout:4/842: truncate d2/d5/d2d/d70/fb5 891074 0 2024-09-13T21:40:29.374 INFO:tasks.workunit.client.0.smithi088.stdout:9/719: read d1a/f82 [3885122,110314] 0 2024-09-13T21:40:29.376 INFO:tasks.workunit.client.0.smithi088.stdout:6/880: dwrite d0/d2c/d32/fdf [0,4194304] 0 2024-09-13T21:40:29.376 INFO:tasks.workunit.client.0.smithi088.stdout:6/881: fsync d0/d2c/d32/f84 0 2024-09-13T21:40:29.377 INFO:tasks.workunit.client.0.smithi088.stdout:4/843: symlink d2/d5/d20/d60/de/d1e/d23/d3c/dea/l115 0 2024-09-13T21:40:29.378 INFO:tasks.workunit.client.0.smithi088.stdout:5/975: write d4/d1b/f43 [3411392,54015] 0 2024-09-13T21:40:29.378 INFO:tasks.workunit.client.0.smithi088.stdout:5/976: dread - d4/d1c/d24/d26/d56/f70 zero size 2024-09-13T21:40:29.378 INFO:tasks.workunit.client.0.smithi088.stdout:7/721: dwrite d6/d5f/d69/f8a [0,4194304] 0 2024-09-13T21:40:29.378 INFO:tasks.workunit.client.0.smithi088.stdout:7/722: fdatasync d6/da/d1a/f56 0 2024-09-13T21:40:29.378 INFO:tasks.workunit.client.0.smithi088.stdout:7/723: chown d6/d5f/l7c 2 1 2024-09-13T21:40:29.381 INFO:tasks.workunit.client.0.smithi088.stdout:9/720: rename d1a/d61/lc9 to d1a/d1b/dd5/le1 0 2024-09-13T21:40:29.383 INFO:tasks.workunit.client.0.smithi088.stdout:2/851: mknod d1/d8/d2e/c11b 0 2024-09-13T21:40:29.387 INFO:tasks.workunit.client.0.smithi088.stdout:6/882: symlink d0/d1e/d1f/d108/l11d 0 2024-09-13T21:40:29.387 INFO:tasks.workunit.client.0.smithi088.stdout:6/883: chown d0/d1e/d1f/d55/d8f/cce 7126 1 2024-09-13T21:40:29.387 INFO:tasks.workunit.client.0.smithi088.stdout:6/884: chown d0/d2c/d32/d39/l58 42767879 1 2024-09-13T21:40:29.387 INFO:tasks.workunit.client.0.smithi088.stdout:4/844: mknod d2/d5/d20/d60/de/d1e/d31/c116 0 2024-09-13T21:40:29.392 INFO:tasks.workunit.client.0.smithi088.stdout:3/889: dwrite d5/d23/d2a/d6b/d98/ff6 [0,4194304] 0 2024-09-13T21:40:29.392 INFO:tasks.workunit.client.0.smithi088.stdout:3/890: readlink d5/d23/d2a/d6b/d98/l117 0 2024-09-13T21:40:29.392 INFO:tasks.workunit.client.0.smithi088.stdout:0/873: dwrite d7/d2c/d30/d31/d42/de2/f100 [4194304,4194304] 0 2024-09-13T21:40:29.397 INFO:tasks.workunit.client.0.smithi088.stdout:5/977: link d4/d1c/d24/d26/dbf/dc6/dc7/fd4 d4/d1c/d24/d26/d4b/d66/df0/f144 0 2024-09-13T21:40:29.397 INFO:tasks.workunit.client.0.smithi088.stdout:5/978: dread - d4/d1c/d24/d26/dbf/d89/ddc/f118 zero size 2024-09-13T21:40:29.399 INFO:tasks.workunit.client.0.smithi088.stdout:9/721: mkdir d1a/d61/de2 0 2024-09-13T21:40:29.400 INFO:tasks.workunit.client.0.smithi088.stdout:2/852: creat d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d66/f11c x:0 0 0 2024-09-13T21:40:29.400 INFO:tasks.workunit.client.0.smithi088.stdout:2/853: truncate d1/d8/f1b 5221454 0 2024-09-13T21:40:29.401 INFO:tasks.workunit.client.0.smithi088.stdout:6/885: mkdir d0/d2c/d7f/d11e 0 2024-09-13T21:40:29.402 INFO:tasks.workunit.client.0.smithi088.stdout:4/845: mkdir d2/d5/d20/d41/d4b/d98/d117 0 2024-09-13T21:40:29.404 INFO:tasks.workunit.client.0.smithi088.stdout:3/891: rmdir d5/d23/d2a/d3f/d8f 39 2024-09-13T21:40:29.406 INFO:tasks.workunit.client.0.smithi088.stdout:0/874: mkdir d7/d1d/d3d/dae/dff/d12c 0 2024-09-13T21:40:29.409 INFO:tasks.workunit.client.0.smithi088.stdout:9/722: getdents d1a/d3c/d51/d5e 0 2024-09-13T21:40:29.412 INFO:tasks.workunit.client.0.smithi088.stdout:4/846: creat d2/d5/d20/d60/de/d1e/d31/d61/f118 x:0 0 0 2024-09-13T21:40:29.413 INFO:tasks.workunit.client.0.smithi088.stdout:3/892: rename d5/d23/d2a/d6b/d98/ce9 to d5/d23/d2a/d6b/d98/dcd/c118 0 2024-09-13T21:40:29.415 INFO:tasks.workunit.client.0.smithi088.stdout:9/723: creat d1a/fe3 x:0 0 0 2024-09-13T21:40:29.415 INFO:tasks.workunit.client.0.smithi088.stdout:9/724: fdatasync d1a/d61/d3d/d41/f8a 0 2024-09-13T21:40:29.416 INFO:tasks.workunit.client.0.smithi088.stdout:4/847: mknod d2/d5/d20/d60/de/d1e/d23/d6c/d104/c119 0 2024-09-13T21:40:29.416 INFO:tasks.workunit.client.0.smithi088.stdout:4/848: chown d2/d5/d2d/le7 333253362 1 2024-09-13T21:40:29.418 INFO:tasks.workunit.client.0.smithi088.stdout:0/875: rename d7/d1d/d66/d8b/d118/dcd/fde to d7/d65/d8c/df3/f12d 0 2024-09-13T21:40:29.418 INFO:tasks.workunit.client.0.smithi088.stdout:0/876: write d7/d1d/d66/fa7 [735768,47041] 0 2024-09-13T21:40:29.418 INFO:tasks.workunit.client.0.smithi088.stdout:0/877: write d7/d2c/d30/d31/d42/fec [176690,80399] 0 2024-09-13T21:40:29.419 INFO:tasks.workunit.client.0.smithi088.stdout:2/854: rmdir d1/d8/d2e/d3b/dff/d2a/d41/d82/db0 0 2024-09-13T21:40:29.420 INFO:tasks.workunit.client.0.smithi088.stdout:4/849: dread d2/d13/d50/f84 [0,4194304] 0 2024-09-13T21:40:29.422 INFO:tasks.workunit.client.0.smithi088.stdout:6/886: dwrite d0/db/d37/fd3 [4194304,4194304] 0 2024-09-13T21:40:29.422 INFO:tasks.workunit.client.0.smithi088.stdout:2/855: rename d1/d8/d16/l1e to d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d76/l11d 0 2024-09-13T21:40:29.422 INFO:tasks.workunit.client.0.smithi088.stdout:4/850: creat d2/d5/d20/d60/de/d1e/d23/d6f/d105/f11a x:0 0 0 2024-09-13T21:40:29.424 INFO:tasks.workunit.client.0.smithi088.stdout:5/979: dwrite d4/da7/fb1 [0,4194304] 0 2024-09-13T21:40:29.424 INFO:tasks.workunit.client.0.smithi088.stdout:5/980: chown d4/d1b/f75 1372 1 2024-09-13T21:40:29.425 INFO:tasks.workunit.client.0.smithi088.stdout:0/878: creat d7/d1d/d66/d8b/d10c/f12e x:0 0 0 2024-09-13T21:40:29.425 INFO:tasks.workunit.client.0.smithi088.stdout:0/879: readlink d7/d2c/d30/d31/d42/d95/le0 0 2024-09-13T21:40:29.425 INFO:tasks.workunit.client.0.smithi088.stdout:2/856: dread d1/d8/d24/d78/d7f/d85/f97 [0,4194304] 0 2024-09-13T21:40:29.428 INFO:tasks.workunit.client.0.smithi088.stdout:6/887: rename d0/d1e/d1f/f70 to d0/d1e/d1f/d55/d8f/dc6/f11f 0 2024-09-13T21:40:29.432 INFO:tasks.workunit.client.0.smithi088.stdout:0/880: mkdir d7/d102/d12f 0 2024-09-13T21:40:29.432 INFO:tasks.workunit.client.0.smithi088.stdout:0/881: dread - d7/d2c/d37/fbf zero size 2024-09-13T21:40:29.433 INFO:tasks.workunit.client.0.smithi088.stdout:0/882: truncate d7/d2c/d30/dbe/dce/de1/ffc 61954 0 2024-09-13T21:40:29.434 INFO:tasks.workunit.client.0.smithi088.stdout:4/851: dread d2/d5/d20/d60/f2a [0,4194304] 0 2024-09-13T21:40:29.434 INFO:tasks.workunit.client.0.smithi088.stdout:6/888: creat d0/db/f120 x:0 0 0 2024-09-13T21:40:29.434 INFO:tasks.workunit.client.0.smithi088.stdout:6/889: getdents d0/d1e/d1f/d55/d8f 0 2024-09-13T21:40:29.436 INFO:tasks.workunit.client.0.smithi088.stdout:0/883: getdents d7/d1d/d66/d8b 0 2024-09-13T21:40:29.436 INFO:tasks.workunit.client.0.smithi088.stdout:0/884: chown d7/d2c/d30/d31/d42/d95 983975709 1 2024-09-13T21:40:29.436 INFO:tasks.workunit.client.0.smithi088.stdout:0/885: readlink d7/d65/l3a 0 2024-09-13T21:40:29.436 INFO:tasks.workunit.client.0.smithi088.stdout:0/886: dread - d7/d1d/d27/f54 zero size 2024-09-13T21:40:29.440 INFO:tasks.workunit.client.0.smithi088.stdout:6/890: creat d0/d1e/d1f/d55/d8f/f121 x:0 0 0 2024-09-13T21:40:29.440 INFO:tasks.workunit.client.0.smithi088.stdout:6/891: write d0/d2c/d32/fbe [208146,97098] 0 2024-09-13T21:40:29.440 INFO:tasks.workunit.client.0.smithi088.stdout:6/892: chown d0/db/d37/fd3 13 1 2024-09-13T21:40:29.442 INFO:tasks.workunit.client.0.smithi088.stdout:5/981: rename d4/d1b/d68/c86 to d4/d1c/d24/d95/da6/c145 0 2024-09-13T21:40:29.442 INFO:tasks.workunit.client.0.smithi088.stdout:5/982: fsync d4/d1c/d24/d26/dfe/f131 0 2024-09-13T21:40:29.442 INFO:tasks.workunit.client.0.smithi088.stdout:1/865: sync 2024-09-13T21:40:29.442 INFO:tasks.workunit.client.0.smithi088.stdout:1/866: chown d9/d10/d2a/d4b/d39/d43/f108 124713392 1 2024-09-13T21:40:29.443 INFO:tasks.workunit.client.0.smithi088.stdout:1/867: chown d9/d10/l2e 1 1 2024-09-13T21:40:29.443 INFO:tasks.workunit.client.0.smithi088.stdout:0/887: mkdir d7/d1d/d66/d8b/d118/dcd/d130 0 2024-09-13T21:40:29.444 INFO:tasks.workunit.client.0.smithi088.stdout:4/852: getdents d2/d5/d20/d60/de/d1e/d23/d3c 0 2024-09-13T21:40:29.447 INFO:tasks.workunit.client.0.smithi088.stdout:6/893: mknod d0/d28/c122 0 2024-09-13T21:40:29.448 INFO:tasks.workunit.client.0.smithi088.stdout:4/853: dread d2/d13/fed [0,4194304] 0 2024-09-13T21:40:29.450 INFO:tasks.workunit.client.0.smithi088.stdout:5/983: rename d4/d1c/d24/d26/dbf/d89/ddc/f118 to d4/d1c/d24/d26/d40/f146 0 2024-09-13T21:40:29.450 INFO:tasks.workunit.client.0.smithi088.stdout:5/984: dread - d4/d1c/d24/d26/dbf/d89/dc9/f138 zero size 2024-09-13T21:40:29.452 INFO:tasks.workunit.client.0.smithi088.stdout:0/888: creat d7/d2c/d37/de8/f131 x:0 0 0 2024-09-13T21:40:29.453 INFO:tasks.workunit.client.0.smithi088.stdout:6/894: rename d0/d2c/fd7 to d0/d1e/f123 0 2024-09-13T21:40:29.453 INFO:tasks.workunit.client.0.smithi088.stdout:6/895: read - d0/d2c/d32/d39/d3f/ffc zero size 2024-09-13T21:40:29.453 INFO:tasks.workunit.client.0.smithi088.stdout:6/896: chown d0/d28/d10a 0 1 2024-09-13T21:40:29.457 INFO:tasks.workunit.client.0.smithi088.stdout:3/893: dwrite d5/d23/d2a/d6b/d98/da1/daa/d43/fb9 [0,4194304] 0 2024-09-13T21:40:29.457 INFO:tasks.workunit.client.0.smithi088.stdout:3/894: write d5/f13 [3557725,57514] 0 2024-09-13T21:40:29.457 INFO:tasks.workunit.client.0.smithi088.stdout:9/725: dwrite d1a/d1b/d3f/f64 [0,4194304] 0 2024-09-13T21:40:29.458 INFO:tasks.workunit.client.0.smithi088.stdout:2/857: dwrite d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/dc3/f11a [0,4194304] 0 2024-09-13T21:40:29.459 INFO:tasks.workunit.client.0.smithi088.stdout:3/895: mkdir d5/d23/d119 0 2024-09-13T21:40:29.461 INFO:tasks.workunit.client.0.smithi088.stdout:1/868: write d9/d10/d2a/d4b/d39/d43/f93 [6275864,73968] 0 2024-09-13T21:40:29.463 INFO:tasks.workunit.client.0.smithi088.stdout:9/726: mknod d1a/d3c/d60/ce4 0 2024-09-13T21:40:29.471 INFO:tasks.workunit.client.0.smithi088.stdout:6/897: write d0/d28/f40 [5831098,90569] 0 2024-09-13T21:40:29.473 INFO:tasks.workunit.client.0.smithi088.stdout:5/985: dwrite d4/d1c/d24/d26/dbf/dc6/d10e/f116 [0,4194304] 0 2024-09-13T21:40:29.474 INFO:tasks.workunit.client.0.smithi088.stdout:4/854: dwrite d2/d13/d50/fd3 [0,4194304] 0 2024-09-13T21:40:29.479 INFO:tasks.workunit.client.0.smithi088.stdout:2/858: creat d1/d8/d2e/d3b/dff/d2a/d41/d82/f11e x:0 0 0 2024-09-13T21:40:29.479 INFO:tasks.workunit.client.0.smithi088.stdout:2/859: fdatasync d1/d8/d2e/d44/ffe 0 2024-09-13T21:40:29.481 INFO:tasks.workunit.client.0.smithi088.stdout:9/727: rename d1a/d61/d3d/d75/lcd to d1a/d1b/le5 0 2024-09-13T21:40:29.481 INFO:tasks.workunit.client.0.smithi088.stdout:9/728: readlink d1a/d1b/l1d 0 2024-09-13T21:40:29.481 INFO:tasks.workunit.client.0.smithi088.stdout:9/729: write d1a/d1b/d3f/f55 [1006819,120070] 0 2024-09-13T21:40:29.481 INFO:tasks.workunit.client.0.smithi088.stdout:9/730: fsync d1a/f67 0 2024-09-13T21:40:29.484 INFO:tasks.workunit.client.0.smithi088.stdout:5/986: creat d4/d1c/d4a/f147 x:0 0 0 2024-09-13T21:40:29.484 INFO:tasks.workunit.client.0.smithi088.stdout:6/898: dread d0/d28/fa8 [0,4194304] 0 2024-09-13T21:40:29.485 INFO:tasks.workunit.client.0.smithi088.stdout:0/889: dwrite d7/d65/f76 [0,4194304] 0 2024-09-13T21:40:29.488 INFO:tasks.workunit.client.0.smithi088.stdout:1/869: dwrite d9/d10/d2a/d4b/d33/dad/dbb/fe8 [0,4194304] 0 2024-09-13T21:40:29.488 INFO:tasks.workunit.client.0.smithi088.stdout:1/870: read d9/d10/d2a/d4b/d33/f91 [8560854,8344] 0 2024-09-13T21:40:29.488 INFO:tasks.workunit.client.0.smithi088.stdout:1/871: readlink d9/d10/d2a/d4b/d33/dad/dbb/lc3 0 2024-09-13T21:40:29.488 INFO:tasks.workunit.client.0.smithi088.stdout:4/855: creat d2/d5/d20/d60/de/d1e/f11b x:0 0 0 2024-09-13T21:40:29.488 INFO:tasks.workunit.client.0.smithi088.stdout:4/856: stat d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79/fd2 0 2024-09-13T21:40:29.491 INFO:tasks.workunit.client.0.smithi088.stdout:9/731: read d1a/f31 [435105,95563] 0 2024-09-13T21:40:29.491 INFO:tasks.workunit.client.0.smithi088.stdout:9/732: dread - d1a/d61/d3d/fca zero size 2024-09-13T21:40:29.492 INFO:tasks.workunit.client.0.smithi088.stdout:9/733: fdatasync d1a/f3a 0 2024-09-13T21:40:29.492 INFO:tasks.workunit.client.0.smithi088.stdout:6/899: mkdir d0/d2c/d32/d124 0 2024-09-13T21:40:29.495 INFO:tasks.workunit.client.0.smithi088.stdout:0/890: mknod d7/d102/c132 0 2024-09-13T21:40:29.495 INFO:tasks.workunit.client.0.smithi088.stdout:0/891: write d7/f46 [7205552,73772] 0 2024-09-13T21:40:29.495 INFO:tasks.workunit.client.0.smithi088.stdout:5/987: dread d4/d1c/d4a/d63/d6a/f6b [0,4194304] 0 2024-09-13T21:40:29.495 INFO:tasks.workunit.client.0.smithi088.stdout:0/892: creat d7/d65/d8c/deb/f133 x:0 0 0 2024-09-13T21:40:29.495 INFO:tasks.workunit.client.0.smithi088.stdout:0/893: stat d7/d2c/d30/lc9 0 2024-09-13T21:40:29.496 INFO:tasks.workunit.client.0.smithi088.stdout:1/872: creat d9/d10/d2a/d4b/d33/dad/dbb/de1/f12c x:0 0 0 2024-09-13T21:40:29.498 INFO:tasks.workunit.client.0.smithi088.stdout:4/857: mknod d2/d5/d20/d7f/c11c 0 2024-09-13T21:40:29.498 INFO:tasks.workunit.client.0.smithi088.stdout:2/860: dwrite d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d66/f11c [0,4194304] 0 2024-09-13T21:40:29.500 INFO:tasks.workunit.client.0.smithi088.stdout:6/900: rename d0/d1e/d1f/d55/d96/lc8 to d0/d28/l125 0 2024-09-13T21:40:29.501 INFO:tasks.workunit.client.0.smithi088.stdout:6/901: creat d0/d2c/d7f/db1/f126 x:0 0 0 2024-09-13T21:40:29.501 INFO:tasks.workunit.client.0.smithi088.stdout:6/902: chown d0/d1e/d1f/d55/d8f/lbc 0 1 2024-09-13T21:40:29.502 INFO:tasks.workunit.client.0.smithi088.stdout:7/724: sync 2024-09-13T21:40:29.502 INFO:tasks.workunit.client.0.smithi088.stdout:8/844: sync 2024-09-13T21:40:29.503 INFO:tasks.workunit.client.0.smithi088.stdout:8/845: fsync db/df/f3d 0 2024-09-13T21:40:29.503 INFO:tasks.workunit.client.0.smithi088.stdout:8/846: readlink db/d26/d2c/db7/dba/ld4 0 2024-09-13T21:40:29.503 INFO:tasks.workunit.client.0.smithi088.stdout:8/847: chown db/d26/f5f 228707 1 2024-09-13T21:40:29.504 INFO:tasks.workunit.client.0.smithi088.stdout:5/988: getdents d4/d1c 0 2024-09-13T21:40:29.505 INFO:tasks.workunit.client.0.smithi088.stdout:0/894: mknod d7/d2c/d30/d31/d42/d4b/c134 0 2024-09-13T21:40:29.507 INFO:tasks.workunit.client.0.smithi088.stdout:1/873: creat d9/d10/d2a/d4b/d39/dda/d10a/d10f/f12d x:0 0 0 2024-09-13T21:40:29.507 INFO:tasks.workunit.client.0.smithi088.stdout:1/874: creat d9/d10/d2a/d4b/d39/dda/d10a/d10f/f12e x:0 0 0 2024-09-13T21:40:29.511 INFO:tasks.workunit.client.0.smithi088.stdout:2/861: link d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d66/f11c d1/d8/d16/d40/d7e/daa/f11f 0 2024-09-13T21:40:29.511 INFO:tasks.workunit.client.0.smithi088.stdout:2/862: chown d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dcd/ff3 1 1 2024-09-13T21:40:29.515 INFO:tasks.workunit.client.0.smithi088.stdout:6/903: creat d0/d2c/d7f/db1/d104/f127 x:0 0 0 2024-09-13T21:40:29.515 INFO:tasks.workunit.client.0.smithi088.stdout:6/904: chown d0/d2c/d7f/ce0 9774 1 2024-09-13T21:40:29.515 INFO:tasks.workunit.client.0.smithi088.stdout:9/734: dwrite fb [0,4194304] 0 2024-09-13T21:40:29.517 INFO:tasks.workunit.client.0.smithi088.stdout:8/848: mkdir db/df/d61/d97/d116 0 2024-09-13T21:40:29.517 INFO:tasks.workunit.client.0.smithi088.stdout:1/875: dread d9/d10/d2a/d4b/d39/d43/db2/fee [0,4194304] 0 2024-09-13T21:40:29.517 INFO:tasks.workunit.client.0.smithi088.stdout:1/876: creat d9/d10/dff/f12f x:0 0 0 2024-09-13T21:40:29.518 INFO:tasks.workunit.client.0.smithi088.stdout:5/989: creat d4/d1c/d24/d26/dbf/dc6/d10e/f148 x:0 0 0 2024-09-13T21:40:29.518 INFO:tasks.workunit.client.0.smithi088.stdout:5/990: stat d4/d1c/d4a/fe4 0 2024-09-13T21:40:29.520 INFO:tasks.workunit.client.0.smithi088.stdout:2/863: creat d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/dc3/f120 x:0 0 0 2024-09-13T21:40:29.520 INFO:tasks.workunit.client.0.smithi088.stdout:0/895: dread d7/d1d/f69 [0,4194304] 0 2024-09-13T21:40:29.522 INFO:tasks.workunit.client.0.smithi088.stdout:9/735: link d1a/c8b d1a/d3c/d85/ce6 0 2024-09-13T21:40:29.523 INFO:tasks.workunit.client.0.smithi088.stdout:8/849: mkdir db/df/de0/d117 0 2024-09-13T21:40:29.523 INFO:tasks.workunit.client.0.smithi088.stdout:8/850: fdatasync db/d26/d2c/fcf 0 2024-09-13T21:40:29.523 INFO:tasks.workunit.client.0.smithi088.stdout:8/851: chown db/d26/d2c/fcf 0 1 2024-09-13T21:40:29.525 INFO:tasks.workunit.client.0.smithi088.stdout:0/896: dread d7/d1d/d27/d43/fc6 [0,4194304] 0 2024-09-13T21:40:29.526 INFO:tasks.workunit.client.0.smithi088.stdout:5/991: dread d4/d1c/d4a/d63/f6f [0,4194304] 0 2024-09-13T21:40:29.526 INFO:tasks.workunit.client.0.smithi088.stdout:2/864: truncate d1/d8/d2e/d3b/dff/d2a/d41/d48/da0/fa9 3124803 0 2024-09-13T21:40:29.526 INFO:tasks.workunit.client.0.smithi088.stdout:2/865: chown d1/d8/d2e/d3b/dff/d2a/d41/d82/d101 482899954 1 2024-09-13T21:40:29.526 INFO:tasks.workunit.client.0.smithi088.stdout:2/866: write d1/d8/d24/fc6 [103732,100974] 0 2024-09-13T21:40:29.527 INFO:tasks.workunit.client.0.smithi088.stdout:6/905: getdents d0/d1e/d1f/d55 0 2024-09-13T21:40:29.527 INFO:tasks.workunit.client.0.smithi088.stdout:6/906: chown d0/d28/c2b 10405 1 2024-09-13T21:40:29.527 INFO:tasks.workunit.client.0.smithi088.stdout:6/907: read - d0/fee zero size 2024-09-13T21:40:29.527 INFO:tasks.workunit.client.0.smithi088.stdout:9/736: symlink d1a/d1b/d3f/le7 0 2024-09-13T21:40:29.528 INFO:tasks.workunit.client.0.smithi088.stdout:8/852: rmdir db/d26/d4f/dd0 39 2024-09-13T21:40:29.528 INFO:tasks.workunit.client.0.smithi088.stdout:8/853: readlink db/df/da7/d88/db3/lf8 0 2024-09-13T21:40:29.528 INFO:tasks.workunit.client.0.smithi088.stdout:6/908: write d0/db/f60 [601866,109790] 0 2024-09-13T21:40:29.528 INFO:tasks.workunit.client.0.smithi088.stdout:4/858: dwrite d2/d5/d20/d60/de/f58 [4194304,4194304] 0 2024-09-13T21:40:29.529 INFO:tasks.workunit.client.0.smithi088.stdout:4/859: fdatasync d2/d5/d20/d60/f97 0 2024-09-13T21:40:29.529 INFO:tasks.workunit.client.0.smithi088.stdout:7/725: dwrite d6/f1c [0,4194304] 0 2024-09-13T21:40:29.529 INFO:tasks.workunit.client.0.smithi088.stdout:0/897: mknod d7/d2c/d37/c135 0 2024-09-13T21:40:29.529 INFO:tasks.workunit.client.0.smithi088.stdout:0/898: stat d7/d2c/d37/de8 0 2024-09-13T21:40:29.530 INFO:tasks.workunit.client.0.smithi088.stdout:2/867: getdents d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dcd/d9e 0 2024-09-13T21:40:29.531 INFO:tasks.workunit.client.0.smithi088.stdout:9/737: symlink d1a/d61/d3d/d41/le8 0 2024-09-13T21:40:29.531 INFO:tasks.workunit.client.0.smithi088.stdout:9/738: dread - d1a/d61/d3d/d75/f93 zero size 2024-09-13T21:40:29.533 INFO:tasks.workunit.client.0.smithi088.stdout:8/854: truncate db/df/da7/f28 2424906 0 2024-09-13T21:40:29.533 INFO:tasks.workunit.client.0.smithi088.stdout:8/855: chown db/d26/d37/l8c 1011 1 2024-09-13T21:40:29.533 INFO:tasks.workunit.client.0.smithi088.stdout:6/909: symlink d0/d2c/d83/l128 0 2024-09-13T21:40:29.533 INFO:tasks.workunit.client.0.smithi088.stdout:6/910: creat d0/d2c/d8b/ddb/f129 x:0 0 0 2024-09-13T21:40:29.536 INFO:tasks.workunit.client.0.smithi088.stdout:7/726: dread d6/f42 [0,4194304] 0 2024-09-13T21:40:29.536 INFO:tasks.workunit.client.0.smithi088.stdout:4/860: creat d2/d5/d20/d60/de/d1e/d31/f11d x:0 0 0 2024-09-13T21:40:29.538 INFO:tasks.workunit.client.0.smithi088.stdout:1/877: rename d9/d10/d9f/dfe/d10d to d9/d10/d2a/d4b/d3a/d104/d130 0 2024-09-13T21:40:29.538 INFO:tasks.workunit.client.0.smithi088.stdout:1/878: readlink d9/d4f/d64/l97 0 2024-09-13T21:40:29.542 INFO:tasks.workunit.client.0.smithi088.stdout:0/899: dread d7/d2c/d30/f35 [0,4194304] 0 2024-09-13T21:40:29.543 INFO:tasks.workunit.client.0.smithi088.stdout:2/868: dread d1/d8/d24/d78/d7f/fe6 [0,4194304] 0 2024-09-13T21:40:29.545 INFO:tasks.workunit.client.0.smithi088.stdout:6/911: symlink d0/d1e/d1f/d55/d96/d98/l12a 0 2024-09-13T21:40:29.546 INFO:tasks.workunit.client.0.smithi088.stdout:4/861: creat d2/d5/d20/d60/de/dde/f11e x:0 0 0 2024-09-13T21:40:29.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/992: rename d4/d1c/d24/d26/dbf/d89/d92/f104 to d4/d1c/d24/d26/d117/f149 0 2024-09-13T21:40:29.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/993: chown d4/d1c/d24/d26/da1 1932738 1 2024-09-13T21:40:29.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/994: truncate d4/d1b/f54 1645685 0 2024-09-13T21:40:29.548 INFO:tasks.workunit.client.0.smithi088.stdout:5/995: creat d4/d1c/d4a/f14a x:0 0 0 2024-09-13T21:40:29.549 INFO:tasks.workunit.client.0.smithi088.stdout:1/879: rmdir d9/d10/d2a/d4b/d33 39 2024-09-13T21:40:29.549 INFO:tasks.workunit.client.0.smithi088.stdout:1/880: chown d9/d10/d2a/d4b/d3a 428958 1 2024-09-13T21:40:29.550 INFO:tasks.workunit.client.0.smithi088.stdout:2/869: link d1/d8/d16/d40/f60 d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/f121 0 2024-09-13T21:40:29.551 INFO:tasks.workunit.client.0.smithi088.stdout:6/912: mknod d0/d1e/d1f/d55/d96/dde/c12b 0 2024-09-13T21:40:29.553 INFO:tasks.workunit.client.0.smithi088.stdout:4/862: creat d2/d5/d20/d60/de/d1e/d31/d61/d99/df8/f11f x:0 0 0 2024-09-13T21:40:29.555 INFO:tasks.workunit.client.0.smithi088.stdout:9/739: rename d1a/d61/d3d/d41/le8 to d1a/d9e/le9 0 2024-09-13T21:40:29.555 INFO:tasks.workunit.client.0.smithi088.stdout:9/740: fdatasync d1a/d3c/d51/d5e/d7e/d92/fd2 0 2024-09-13T21:40:29.555 INFO:tasks.workunit.client.0.smithi088.stdout:9/741: write d1a/d3c/d51/d5e/ddb/f9a [181495,25498] 0 2024-09-13T21:40:29.556 INFO:tasks.workunit.client.0.smithi088.stdout:9/742: fdatasync d1a/d61/d3d/f7d 0 2024-09-13T21:40:29.557 INFO:tasks.workunit.client.0.smithi088.stdout:5/996: truncate d4/d1c/d24/d26/f6e 4024513 0 2024-09-13T21:40:29.560 INFO:tasks.workunit.client.0.smithi088.stdout:1/881: getdents d9/d10 0 2024-09-13T21:40:29.561 INFO:tasks.workunit.client.0.smithi088.stdout:0/900: dwrite d7/d1d/d66/d8b/d118/d45/fac [4194304,4194304] 0 2024-09-13T21:40:29.561 INFO:tasks.workunit.client.0.smithi088.stdout:2/870: symlink d1/d8/d16/d40/d7e/daa/l122 0 2024-09-13T21:40:29.561 INFO:tasks.workunit.client.0.smithi088.stdout:0/901: write d7/d2c/d30/f35 [4899867,113692] 0 2024-09-13T21:40:29.561 INFO:tasks.workunit.client.0.smithi088.stdout:0/902: dread - d7/d1d/d21/d82/fd7 zero size 2024-09-13T21:40:29.562 INFO:tasks.workunit.client.0.smithi088.stdout:4/863: truncate d2/d5/d20/d60/de/d1e/d23/f3d 531159 0 2024-09-13T21:40:29.562 INFO:tasks.workunit.client.0.smithi088.stdout:2/871: dread d1/d8/d2e/d91/fae [0,4194304] 0 2024-09-13T21:40:29.562 INFO:tasks.workunit.client.0.smithi088.stdout:2/872: write d1/d8/d24/d78/fe0 [1709069,28431] 0 2024-09-13T21:40:29.562 INFO:tasks.workunit.client.0.smithi088.stdout:8/856: rename db/d26/d37/d7d/fac to db/df/d61/f118 0 2024-09-13T21:40:29.563 INFO:tasks.workunit.client.0.smithi088.stdout:2/873: write d1/d8/d2e/d3b/dff/d2a/d41/d48/f83 [306820,70887] 0 2024-09-13T21:40:29.564 INFO:tasks.workunit.client.0.smithi088.stdout:5/997: creat d4/d1c/d4a/d63/dd0/f14b x:0 0 0 2024-09-13T21:40:29.564 INFO:tasks.workunit.client.0.smithi088.stdout:5/998: write d4/d1c/d24/d26/d56/fd3 [601100,20910] 0 2024-09-13T21:40:29.565 INFO:tasks.workunit.client.0.smithi088.stdout:3/896: sync 2024-09-13T21:40:29.566 INFO:tasks.workunit.client.0.smithi088.stdout:1/882: mkdir d9/d4f/d131 0 2024-09-13T21:40:29.566 INFO:tasks.workunit.client.0.smithi088.stdout:1/883: truncate d9/d10/d2a/d4b/d33/d92/dbe/fcb 4740345 0 2024-09-13T21:40:29.568 INFO:tasks.workunit.client.0.smithi088.stdout:4/864: creat d2/d5/d2d/d70/f120 x:0 0 0 2024-09-13T21:40:29.571 INFO:tasks.workunit.client.0.smithi088.stdout:0/903: dread d7/d2c/d37/ff1 [0,4194304] 0 2024-09-13T21:40:29.571 INFO:tasks.workunit.client.0.smithi088.stdout:7/727: rename d6/da/d1a/d3a/cb1 to d6/d5f/d69/d4f/de2/cf9 0 2024-09-13T21:40:29.571 INFO:tasks.workunit.client.0.smithi088.stdout:6/913: dwrite d0/d2c/d7f/db1/ff7 [0,4194304] 0 2024-09-13T21:40:29.574 INFO:tasks.workunit.client.0.smithi088.stdout:1/884: creat d9/d10/d2a/d4b/d39/dda/d10a/f132 x:0 0 0 2024-09-13T21:40:29.576 INFO:tasks.workunit.client.0.smithi088.stdout:4/865: unlink d2/d13/fa6 0 2024-09-13T21:40:29.576 INFO:tasks.workunit.client.0.smithi088.stdout:4/866: chown d2/d11/dab/cb3 2588576 1 2024-09-13T21:40:29.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/867: read d2/d5/d20/d60/de/d1e/d23/f107 [1180933,20103] 0 2024-09-13T21:40:29.577 INFO:tasks.workunit.client.0.smithi088.stdout:4/868: write d2/d13/fed [11293,80396] 0 2024-09-13T21:40:29.579 INFO:tasks.workunit.client.0.smithi088.stdout:9/743: rename d1a/d3c/d51/d5e/d7e/d92/cc0 to d1a/d61/d3d/d75/cea 0 2024-09-13T21:40:29.579 INFO:tasks.workunit.client.0.smithi088.stdout:9/744: stat d1a/d61/d3d/d41/d48/f68 0 2024-09-13T21:40:29.581 INFO:tasks.workunit.client.0.smithi088.stdout:0/904: rmdir d7/d1d/d66/d8b/d118/d45/d7c/d125 0 2024-09-13T21:40:29.581 INFO:tasks.workunit.client.0.smithi088.stdout:0/905: dread - d7/d65/d8c/deb/f128 zero size 2024-09-13T21:40:29.581 INFO:tasks.workunit.client.0.smithi088.stdout:0/906: fsync d7/d1d/d66/d8b/d118/d45/faa 0 2024-09-13T21:40:29.581 INFO:tasks.workunit.client.0.smithi088.stdout:8/857: dwrite db/d26/d2c/f5a [0,4194304] 0 2024-09-13T21:40:29.586 INFO:tasks.workunit.client.0.smithi088.stdout:6/914: creat d0/d2c/d7a/d7c/d110/f12c x:0 0 0 2024-09-13T21:40:29.590 INFO:tasks.workunit.client.0.smithi088.stdout:5/999: symlink d4/d1c/d24/d26/dbf/d89/l14c 0 2024-09-13T21:40:29.594 INFO:tasks.workunit.client.0.smithi088.stdout:1/885: symlink d9/d10/d9f/l133 0 2024-09-13T21:40:29.594 INFO:tasks.workunit.client.0.smithi088.stdout:1/886: write d9/d10/d2a/d4b/d39/d43/db2/f112 [432935,81877] 0 2024-09-13T21:40:29.596 INFO:tasks.workunit.client.0.smithi088.stdout:7/728: symlink d6/da/d44/da7/lfa 0 2024-09-13T21:40:29.596 INFO:tasks.workunit.client.0.smithi088.stdout:9/745: dwrite d1a/d1b/f8c [0,4194304] 0 2024-09-13T21:40:29.598 INFO:tasks.workunit.client.0.smithi088.stdout:3/897: rename d5/d5a/db8/ffa to d5/d23/d2a/d3f/d76/f11a 0 2024-09-13T21:40:29.598 INFO:tasks.workunit.client.0.smithi088.stdout:3/898: dread - d5/d23/d2a/d63/fd1 zero size 2024-09-13T21:40:29.600 INFO:tasks.workunit.client.0.smithi088.stdout:8/858: truncate db/df/d61/f7b 764206 0 2024-09-13T21:40:29.600 INFO:tasks.workunit.client.0.smithi088.stdout:8/859: readlink db/df/l7a 0 2024-09-13T21:40:29.603 INFO:tasks.workunit.client.0.smithi088.stdout:1/887: link d9/d10/d2a/d4b/d39/d43/dfb/f105 d9/d10/d2a/d4b/d3a/f134 0 2024-09-13T21:40:29.605 INFO:tasks.workunit.client.0.smithi088.stdout:4/869: link d2/d5/d20/d60/de/d1e/c49 d2/d5/d20/d60/de/d1e/d23/d6c/d104/c121 0 2024-09-13T21:40:29.611 INFO:tasks.workunit.client.0.smithi088.stdout:3/899: read d5/d23/d2a/d63/d48/f9a [3700296,33269] 0 2024-09-13T21:40:29.611 INFO:tasks.workunit.client.0.smithi088.stdout:3/900: stat d5/d23/d2a/d3f/db4 0 2024-09-13T21:40:29.611 INFO:tasks.workunit.client.0.smithi088.stdout:6/915: rename d0/d2c/d32/d39/d3f/d71/f102 to d0/d2c/d32/f12d 0 2024-09-13T21:40:29.611 INFO:tasks.workunit.client.0.smithi088.stdout:6/916: stat d0/d1e/d1f/d55/d96/d98/ca7 0 2024-09-13T21:40:29.611 INFO:tasks.workunit.client.0.smithi088.stdout:0/907: getdents d7/d1d/d21/d82/db8 0 2024-09-13T21:40:29.612 INFO:tasks.workunit.client.0.smithi088.stdout:8/860: creat db/df/d61/d97/d116/f119 x:0 0 0 2024-09-13T21:40:29.612 INFO:tasks.workunit.client.0.smithi088.stdout:8/861: chown db/df/da7/d88/ddd/de8/c102 414 1 2024-09-13T21:40:29.612 INFO:tasks.workunit.client.0.smithi088.stdout:8/862: fsync db/d26/d2c/f78 0 2024-09-13T21:40:29.612 INFO:tasks.workunit.client.0.smithi088.stdout:1/888: mknod d9/d10/d2a/d4b/d39/dda/c135 0 2024-09-13T21:40:29.614 INFO:tasks.workunit.client.0.smithi088.stdout:3/901: creat d5/d23/d2a/d6b/f11b x:0 0 0 2024-09-13T21:40:29.616 INFO:tasks.workunit.client.0.smithi088.stdout:1/889: mknod d9/d10/d2a/d4b/d39/d43/db2/c136 0 2024-09-13T21:40:29.618 INFO:tasks.workunit.client.0.smithi088.stdout:7/729: dwrite d6/d5f/d7a/f8c [0,4194304] 0 2024-09-13T21:40:29.618 INFO:tasks.workunit.client.0.smithi088.stdout:7/730: write d6/d5f/d69/d4f/d6f/ff2 [595048,45317] 0 2024-09-13T21:40:29.619 INFO:tasks.workunit.client.0.smithi088.stdout:0/908: getdents d7/d1d/d66/d8b/dc0 0 2024-09-13T21:40:29.622 INFO:tasks.workunit.client.0.smithi088.stdout:3/902: unlink d5/l9 0 2024-09-13T21:40:29.623 INFO:tasks.workunit.client.0.smithi088.stdout:4/870: dread d2/d5/d2d/d70/fa1 [0,4194304] 0 2024-09-13T21:40:29.623 INFO:tasks.workunit.client.0.smithi088.stdout:4/871: stat d2/d81 0 2024-09-13T21:40:29.623 INFO:tasks.workunit.client.0.smithi088.stdout:4/872: write d2/d5/d20/d60/de/d1e/f11b [830031,106535] 0 2024-09-13T21:40:29.627 INFO:tasks.workunit.client.0.smithi088.stdout:3/903: link d5/d23/d2a/d63/d48/d49/f53 d5/d23/d2a/d3f/d76/db3/da5/dc3/f11c 0 2024-09-13T21:40:29.627 INFO:tasks.workunit.client.0.smithi088.stdout:6/917: dread d0/d1e/f24 [0,4194304] 0 2024-09-13T21:40:29.629 INFO:tasks.workunit.client.0.smithi088.stdout:7/731: link d6/da/db7/ccd d6/d5f/cfb 0 2024-09-13T21:40:29.630 INFO:tasks.workunit.client.0.smithi088.stdout:7/732: chown d6/d5f/d69/d4f/cb6 12571 1 2024-09-13T21:40:29.630 INFO:tasks.workunit.client.0.smithi088.stdout:9/746: truncate d1a/d1b/f8c 2166870 0 2024-09-13T21:40:29.631 INFO:tasks.workunit.client.0.smithi088.stdout:3/904: mknod d5/d23/d2a/d3f/d76/c11d 0 2024-09-13T21:40:29.634 INFO:tasks.workunit.client.0.smithi088.stdout:6/918: truncate d0/d28/f80 2074801 0 2024-09-13T21:40:29.636 INFO:tasks.workunit.client.0.smithi088.stdout:9/747: stat d1a/d61/d3d/d75/l8d 0 2024-09-13T21:40:29.636 INFO:tasks.workunit.client.0.smithi088.stdout:9/748: fsync d1a/d61/d3d/fca 0 2024-09-13T21:40:29.637 INFO:tasks.workunit.client.0.smithi088.stdout:3/905: creat d5/d23/d2a/d6b/d98/dcd/f11e x:0 0 0 2024-09-13T21:40:29.638 INFO:tasks.workunit.client.0.smithi088.stdout:6/919: symlink d0/d1e/d1f/d55/d8f/dc6/l12e 0 2024-09-13T21:40:29.639 INFO:tasks.workunit.client.0.smithi088.stdout:8/863: dwrite db/df/fb2 [0,4194304] 0 2024-09-13T21:40:29.639 INFO:tasks.workunit.client.0.smithi088.stdout:8/864: dread - db/df/d61/fec zero size 2024-09-13T21:40:29.640 INFO:tasks.workunit.client.0.smithi088.stdout:8/865: dread - db/d26/d2c/db7/dbd/fd1 zero size 2024-09-13T21:40:29.640 INFO:tasks.workunit.client.0.smithi088.stdout:7/733: mkdir d6/da/dfc 0 2024-09-13T21:40:29.642 INFO:tasks.workunit.client.0.smithi088.stdout:9/749: creat d1a/d61/d3d/d41/feb x:0 0 0 2024-09-13T21:40:29.642 INFO:tasks.workunit.client.0.smithi088.stdout:3/906: mkdir d5/d23/d2a/d6b/d98/d11f 0 2024-09-13T21:40:29.642 INFO:tasks.workunit.client.0.smithi088.stdout:9/750: truncate d1a/d61/d3d/d41/feb 321597 0 2024-09-13T21:40:29.643 INFO:tasks.workunit.client.0.smithi088.stdout:8/866: mkdir db/d11a 0 2024-09-13T21:40:29.644 INFO:tasks.workunit.client.0.smithi088.stdout:6/920: rename d0/d2c/d32/d39/d3f to d0/d2c/d7a/d7c/d110/d12f 0 2024-09-13T21:40:29.644 INFO:tasks.workunit.client.0.smithi088.stdout:6/921: write d0/d2c/d7a/d7c/d110/d12f/d71/fe4 [921158,118036] 0 2024-09-13T21:40:29.645 INFO:tasks.workunit.client.0.smithi088.stdout:6/922: mknod d0/d1e/d66/c130 0 2024-09-13T21:40:29.646 INFO:tasks.workunit.client.0.smithi088.stdout:8/867: symlink db/d26/d2c/d85/d51/l11b 0 2024-09-13T21:40:29.647 INFO:tasks.workunit.client.0.smithi088.stdout:6/923: unlink d0/db/d37/ld6 0 2024-09-13T21:40:29.648 INFO:tasks.workunit.client.0.smithi088.stdout:8/868: symlink db/d11a/l11c 0 2024-09-13T21:40:29.650 INFO:tasks.workunit.client.0.smithi088.stdout:1/890: dwrite d9/d10/d2a/d47/d9c/faf [0,4194304] 0 2024-09-13T21:40:29.655 INFO:tasks.workunit.client.0.smithi088.stdout:9/751: dread d1a/d1b/f37 [0,4194304] 0 2024-09-13T21:40:29.655 INFO:tasks.workunit.client.0.smithi088.stdout:9/752: chown d1a/d61/d3d/d75/l8d 95 1 2024-09-13T21:40:29.655 INFO:tasks.workunit.client.0.smithi088.stdout:9/753: chown d1a/d61/cbf 893661 1 2024-09-13T21:40:29.655 INFO:tasks.workunit.client.0.smithi088.stdout:9/754: dread - d1a/d3c/d51/d5e/ddb/d97/fde zero size 2024-09-13T21:40:29.656 INFO:tasks.workunit.client.0.smithi088.stdout:9/755: mkdir d1a/d61/dec 0 2024-09-13T21:40:29.662 INFO:tasks.workunit.client.0.smithi088.stdout:6/924: write d0/d28/f80 [2519837,91763] 0 2024-09-13T21:40:29.664 INFO:tasks.workunit.client.0.smithi088.stdout:9/756: read d1a/d1b/f22 [574359,60248] 0 2024-09-13T21:40:29.664 INFO:tasks.workunit.client.0.smithi088.stdout:9/757: chown d1a/d3c/d60/ddc 18987957 1 2024-09-13T21:40:29.664 INFO:tasks.workunit.client.0.smithi088.stdout:9/758: readlink d1a/d61/d3d/d41/d48/ld3 0 2024-09-13T21:40:29.665 INFO:tasks.workunit.client.0.smithi088.stdout:9/759: creat d1a/d3c/fed x:0 0 0 2024-09-13T21:40:29.665 INFO:tasks.workunit.client.0.smithi088.stdout:9/760: truncate d1a/fe3 563601 0 2024-09-13T21:40:29.666 INFO:tasks.workunit.client.0.smithi088.stdout:0/909: dwrite d7/f12 [0,4194304] 0 2024-09-13T21:40:29.667 INFO:tasks.workunit.client.0.smithi088.stdout:4/873: dwrite d2/d5/d20/d60/de/d1e/d31/f91 [8388608,4194304] 0 2024-09-13T21:40:29.669 INFO:tasks.workunit.client.0.smithi088.stdout:0/910: creat d7/d1d/d66/d8b/d118/dcd/f136 x:0 0 0 2024-09-13T21:40:29.669 INFO:tasks.workunit.client.0.smithi088.stdout:0/911: stat d7/d1d/d21/d82/db8/de5/f129 0 2024-09-13T21:40:29.670 INFO:tasks.workunit.client.0.smithi088.stdout:0/912: creat d7/d65/d8c/df3/f137 x:0 0 0 2024-09-13T21:40:29.670 INFO:tasks.workunit.client.0.smithi088.stdout:4/874: dread d2/d5/d20/f73 [0,4194304] 0 2024-09-13T21:40:29.671 INFO:tasks.workunit.client.0.smithi088.stdout:0/913: symlink d7/d102/d12f/l138 0 2024-09-13T21:40:29.680 INFO:tasks.workunit.client.0.smithi088.stdout:4/875: write d2/d5/d20/d60/de/d1e/d23/fe2 [1969126,81622] 0 2024-09-13T21:40:29.680 INFO:tasks.workunit.client.0.smithi088.stdout:4/876: chown d2/d5/le0 2059640 1 2024-09-13T21:40:29.680 INFO:tasks.workunit.client.0.smithi088.stdout:4/877: write d2/d5/d20/d41/d4b/d98/fb7 [857869,15052] 0 2024-09-13T21:40:29.682 INFO:tasks.workunit.client.0.smithi088.stdout:0/914: write d7/d1d/d21/d82/dca/fcb [11640227,103747] 0 2024-09-13T21:40:29.683 INFO:tasks.workunit.client.0.smithi088.stdout:3/907: dwrite d5/d23/d2a/d3f/d76/fde [0,4194304] 0 2024-09-13T21:40:29.683 INFO:tasks.workunit.client.0.smithi088.stdout:3/908: write d5/d23/d2a/d3f/d76/d81/f9f [1166548,6254] 0 2024-09-13T21:40:29.683 INFO:tasks.workunit.client.0.smithi088.stdout:0/915: mknod d7/d1d/d21/c139 0 2024-09-13T21:40:29.683 INFO:tasks.workunit.client.0.smithi088.stdout:0/916: fdatasync d7/f46 0 2024-09-13T21:40:29.685 INFO:tasks.workunit.client.0.smithi088.stdout:3/909: rename d5/d23/d2a/d6b/d98/da1/daa/d43/f83 to d5/d23/d2a/d6b/d98/dcd/f120 0 2024-09-13T21:40:29.686 INFO:tasks.workunit.client.0.smithi088.stdout:7/734: dwrite d6/d5f/f72 [0,4194304] 0 2024-09-13T21:40:29.687 INFO:tasks.workunit.client.0.smithi088.stdout:0/917: rename d7/d65/d8c/fb9 to d7/d1d/d21/d82/db8/de5/f13a 0 2024-09-13T21:40:29.687 INFO:tasks.workunit.client.0.smithi088.stdout:3/910: symlink d5/d23/d2a/d63/d48/d49/l121 0 2024-09-13T21:40:29.688 INFO:tasks.workunit.client.0.smithi088.stdout:7/735: truncate d6/da/fa2 54183 0 2024-09-13T21:40:29.689 INFO:tasks.workunit.client.0.smithi088.stdout:0/918: link d7/d1d/d27/d43/cda d7/d1d/d66/d8b/d118/d34/c13b 0 2024-09-13T21:40:29.689 INFO:tasks.workunit.client.0.smithi088.stdout:0/919: readlink d7/d2c/d30/lc8 0 2024-09-13T21:40:29.695 INFO:tasks.workunit.client.0.smithi088.stdout:4/878: dread d2/d5/d2d/f3e [0,4194304] 0 2024-09-13T21:40:29.696 INFO:tasks.workunit.client.0.smithi088.stdout:7/736: write d6/da/d1a/f56 [2697799,90381] 0 2024-09-13T21:40:29.696 INFO:tasks.workunit.client.0.smithi088.stdout:7/737: stat d6/c50 0 2024-09-13T21:40:29.696 INFO:tasks.workunit.client.0.smithi088.stdout:7/738: dread - d6/da/d1a/d3a/d5c/fc9 zero size 2024-09-13T21:40:29.697 INFO:tasks.workunit.client.0.smithi088.stdout:4/879: unlink d2/d5/d2d/d70/fb5 0 2024-09-13T21:40:29.699 INFO:tasks.workunit.client.0.smithi088.stdout:4/880: mknod d2/d5/d20/d60/de/d1e/d31/d61/d99/c122 0 2024-09-13T21:40:29.699 INFO:tasks.workunit.client.0.smithi088.stdout:4/881: chown d2/f48 5972788 1 2024-09-13T21:40:29.699 INFO:tasks.workunit.client.0.smithi088.stdout:4/882: truncate d2/d81/fc0 13522936 0 2024-09-13T21:40:29.699 INFO:tasks.workunit.client.0.smithi088.stdout:4/883: dread - d2/d5/d20/d60/de/d1e/d31/d61/d99/df8/f11f zero size 2024-09-13T21:40:29.700 INFO:tasks.workunit.client.0.smithi088.stdout:8/869: dwrite db/df/d61/f63 [0,4194304] 0 2024-09-13T21:40:29.701 INFO:tasks.workunit.client.0.smithi088.stdout:4/884: mkdir d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79/de9/d123 0 2024-09-13T21:40:29.701 INFO:tasks.workunit.client.0.smithi088.stdout:4/885: readlink d2/d5/d20/d60/de/d1e/d23/d6f/l21 0 2024-09-13T21:40:29.701 INFO:tasks.workunit.client.0.smithi088.stdout:4/886: dread - d2/f48 zero size 2024-09-13T21:40:29.702 INFO:tasks.workunit.client.0.smithi088.stdout:1/891: dwrite d9/d10/d2a/d4b/d39/d43/db2/f112 [0,4194304] 0 2024-09-13T21:40:29.703 INFO:tasks.workunit.client.0.smithi088.stdout:9/761: dwrite d1a/d3c/fed [0,4194304] 0 2024-09-13T21:40:29.704 INFO:tasks.workunit.client.0.smithi088.stdout:3/911: dread d5/d23/d2a/d6b/d98/ddc/fe7 [0,4194304] 0 2024-09-13T21:40:29.704 INFO:tasks.workunit.client.0.smithi088.stdout:9/762: stat d1a/d61/d3d/d75 0 2024-09-13T21:40:29.704 INFO:tasks.workunit.client.0.smithi088.stdout:3/912: fdatasync d5/d23/d2a/d3f/d8f/da3/fe4 0 2024-09-13T21:40:29.704 INFO:tasks.workunit.client.0.smithi088.stdout:8/870: mknod db/d26/d2c/c11d 0 2024-09-13T21:40:29.706 INFO:tasks.workunit.client.0.smithi088.stdout:4/887: creat d2/d13/f124 x:0 0 0 2024-09-13T21:40:29.707 INFO:tasks.workunit.client.0.smithi088.stdout:7/739: dread d6/d5f/d69/d4f/d6f/ff2 [0,4194304] 0 2024-09-13T21:40:29.713 INFO:tasks.workunit.client.0.smithi088.stdout:9/763: write d1a/d3c/d51/d5e/f7c [1680922,28335] 0 2024-09-13T21:40:29.715 INFO:tasks.workunit.client.0.smithi088.stdout:8/871: dread db/df/da7/d88/fd7 [0,4194304] 0 2024-09-13T21:40:29.728 INFO:tasks.workunit.client.0.smithi088.stdout:0/920: rename d7/d1d/d66/d8b to d7/d2c/d30/dbe/d13c 0 2024-09-13T21:40:29.728 INFO:tasks.workunit.client.0.smithi088.stdout:6/925: dwrite d0/d28/f80 [0,4194304] 0 2024-09-13T21:40:29.729 INFO:tasks.workunit.client.0.smithi088.stdout:1/892: getdents d9/dc/d74/df0 0 2024-09-13T21:40:29.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/893: read d9/dc/f1f [1512456,4968] 0 2024-09-13T21:40:29.730 INFO:tasks.workunit.client.0.smithi088.stdout:1/894: read d9/d10/d2a/d4b/d33/dad/ff8 [3549089,46895] 0 2024-09-13T21:40:29.731 INFO:tasks.workunit.client.0.smithi088.stdout:0/921: mknod d7/d2c/d30/d31/d42/d4b/c13d 0 2024-09-13T21:40:29.731 INFO:tasks.workunit.client.0.smithi088.stdout:3/913: getdents d5/d23/d2a/d3f/d76/d81 0 2024-09-13T21:40:29.732 INFO:tasks.workunit.client.0.smithi088.stdout:9/764: mknod d1a/cee 0 2024-09-13T21:40:29.734 INFO:tasks.workunit.client.0.smithi088.stdout:3/914: unlink d5/d23/d2a/d63/d31/f4e 0 2024-09-13T21:40:29.735 INFO:tasks.workunit.client.0.smithi088.stdout:9/765: unlink d1a/d3c/d51/d5e/ddb/d97/fde 0 2024-09-13T21:40:29.737 INFO:tasks.workunit.client.0.smithi088.stdout:3/915: mkdir d5/d5a/d7f/d10c/d122 0 2024-09-13T21:40:29.737 INFO:tasks.workunit.client.0.smithi088.stdout:3/916: fdatasync d5/d14/f1a 0 2024-09-13T21:40:29.738 INFO:tasks.workunit.client.0.smithi088.stdout:7/740: dwrite d6/d5f/fe8 [0,4194304] 0 2024-09-13T21:40:29.738 INFO:tasks.workunit.client.0.smithi088.stdout:7/741: write d6/d5f/da9/ff3 [882928,1580] 0 2024-09-13T21:40:29.738 INFO:tasks.workunit.client.0.smithi088.stdout:4/888: dwrite d2/d13/d50/fd3 [0,4194304] 0 2024-09-13T21:40:29.739 INFO:tasks.workunit.client.0.smithi088.stdout:9/766: mkdir d1a/d61/d3d/d41/def 0 2024-09-13T21:40:29.739 INFO:tasks.workunit.client.0.smithi088.stdout:4/889: readlink d2/d13/l1f 0 2024-09-13T21:40:29.739 INFO:tasks.workunit.client.0.smithi088.stdout:4/890: fdatasync d2/d81/ff3 0 2024-09-13T21:40:29.739 INFO:tasks.workunit.client.0.smithi088.stdout:9/767: dread - d1a/d1b/d3f/fd6 zero size 2024-09-13T21:40:29.739 INFO:tasks.workunit.client.0.smithi088.stdout:8/872: dwrite db/d26/f2b [8388608,4194304] 0 2024-09-13T21:40:29.742 INFO:tasks.workunit.client.0.smithi088.stdout:7/742: truncate d6/d5f/d69/d4f/f48 450292 0 2024-09-13T21:40:29.742 INFO:tasks.workunit.client.0.smithi088.stdout:6/926: dread d0/f17 [4194304,4194304] 0 2024-09-13T21:40:29.742 INFO:tasks.workunit.client.0.smithi088.stdout:6/927: write d0/d1e/d1f/f7b [2819736,76775] 0 2024-09-13T21:40:29.743 INFO:tasks.workunit.client.0.smithi088.stdout:6/928: truncate d0/d1e/d1f/d55/f101 1040046 0 2024-09-13T21:40:29.743 INFO:tasks.workunit.client.0.smithi088.stdout:4/891: link d2/d5/d20/d7f/f101 d2/d5/d20/d60/de/d1e/d23/d3c/dea/f125 0 2024-09-13T21:40:29.744 INFO:tasks.workunit.client.0.smithi088.stdout:1/895: read d9/d10/d2a/d4b/d33/f76 [2976358,120926] 0 2024-09-13T21:40:29.744 INFO:tasks.workunit.client.0.smithi088.stdout:9/768: mknod d1a/d61/d3d/d41/def/cf0 0 2024-09-13T21:40:29.744 INFO:tasks.workunit.client.0.smithi088.stdout:9/769: chown d1a/d61/d3d/d41/c4c 44 1 2024-09-13T21:40:29.744 INFO:tasks.workunit.client.0.smithi088.stdout:9/770: stat d1a/d61/d3d/d41/d48/f4f 0 2024-09-13T21:40:29.745 INFO:tasks.workunit.client.0.smithi088.stdout:8/873: rename db/df/da7/d88/db3/fc9 to db/d11a/f11e 0 2024-09-13T21:40:29.750 INFO:tasks.workunit.client.0.smithi088.stdout:6/929: mkdir d0/d1e/d1f/d55/d131 0 2024-09-13T21:40:29.750 INFO:tasks.workunit.client.0.smithi088.stdout:6/930: read - d0/d2c/d7f/db1/d104/fc9 zero size 2024-09-13T21:40:29.750 INFO:tasks.workunit.client.0.smithi088.stdout:0/922: dwrite d7/d2c/d30/dbe/d13c/dc0/fea [0,4194304] 0 2024-09-13T21:40:29.751 INFO:tasks.workunit.client.0.smithi088.stdout:4/892: chown d2/d5/d20/d60/de/d1e/d23 44330 1 2024-09-13T21:40:29.751 INFO:tasks.workunit.client.0.smithi088.stdout:3/917: dread d5/d23/d2a/d63/d31/f5f [0,4194304] 0 2024-09-13T21:40:29.753 INFO:tasks.workunit.client.0.smithi088.stdout:7/743: rename d6/da/d1a/f2b to d6/d5f/d69/def/ffd 0 2024-09-13T21:40:29.754 INFO:tasks.workunit.client.0.smithi088.stdout:9/771: dread d1a/d1b/f66 [0,4194304] 0 2024-09-13T21:40:29.754 INFO:tasks.workunit.client.0.smithi088.stdout:3/918: fdatasync d5/d23/d2a/d63/d48/f9a 0 2024-09-13T21:40:29.754 INFO:tasks.workunit.client.0.smithi088.stdout:3/919: write d5/d23/d2a/d63/fd1 [949347,78240] 0 2024-09-13T21:40:29.755 INFO:tasks.workunit.client.0.smithi088.stdout:8/874: link db/df/c10b db/df/d61/d97/c11f 0 2024-09-13T21:40:29.755 INFO:tasks.workunit.client.0.smithi088.stdout:8/875: write db/df/da7/d88/da8/f104 [529126,59930] 0 2024-09-13T21:40:29.755 INFO:tasks.workunit.client.0.smithi088.stdout:1/896: dread d9/d10/d2a/d4b/d33/f91 [4194304,4194304] 0 2024-09-13T21:40:29.756 INFO:tasks.workunit.client.0.smithi088.stdout:1/897: creat d9/d10/dff/f137 x:0 0 0 2024-09-13T21:40:29.757 INFO:tasks.workunit.client.0.smithi088.stdout:8/876: dread db/d26/d37/dd9/f101 [0,4194304] 0 2024-09-13T21:40:29.758 INFO:tasks.workunit.client.0.smithi088.stdout:0/923: symlink d7/d2c/d30/dbe/d126/l13e 0 2024-09-13T21:40:29.761 INFO:tasks.workunit.client.0.smithi088.stdout:4/893: mknod d2/d5/d20/d60/de/d1e/d23/dca/c126 0 2024-09-13T21:40:29.761 INFO:tasks.workunit.client.0.smithi088.stdout:0/924: read d7/d65/d8c/df3/fc7 [223795,81246] 0 2024-09-13T21:40:29.762 INFO:tasks.workunit.client.0.smithi088.stdout:9/772: mknod d1a/d9e/cf1 0 2024-09-13T21:40:29.763 INFO:tasks.workunit.client.0.smithi088.stdout:3/920: symlink d5/d23/d2a/d6b/d8b/l123 0 2024-09-13T21:40:29.763 INFO:tasks.workunit.client.0.smithi088.stdout:6/931: getdents d0/d2c/dad/db3 0 2024-09-13T21:40:29.766 INFO:tasks.workunit.client.0.smithi088.stdout:1/898: mknod d9/d10/d2a/d4b/d3a/dcd/c138 0 2024-09-13T21:40:29.767 INFO:tasks.workunit.client.0.smithi088.stdout:2/874: sync 2024-09-13T21:40:29.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/877: mkdir db/df/d120 0 2024-09-13T21:40:29.767 INFO:tasks.workunit.client.0.smithi088.stdout:8/878: write db/d26/d2c/db7/dbd/fc7 [4858533,89988] 0 2024-09-13T21:40:29.768 INFO:tasks.workunit.client.0.smithi088.stdout:4/894: creat d2/d5/d20/d60/de/d1e/d23/d3c/f127 x:0 0 0 2024-09-13T21:40:29.769 INFO:tasks.workunit.client.0.smithi088.stdout:9/773: symlink d1a/d3c/d51/d5e/ddb/d8e/lf2 0 2024-09-13T21:40:29.770 INFO:tasks.workunit.client.0.smithi088.stdout:9/774: fsync f13 0 2024-09-13T21:40:29.770 INFO:tasks.workunit.client.0.smithi088.stdout:9/775: write d1a/d1b/f2d [761858,127637] 0 2024-09-13T21:40:29.770 INFO:tasks.workunit.client.0.smithi088.stdout:9/776: stat d1a/d3c/d51/d5e/ddb/d97/l9c 0 2024-09-13T21:40:29.774 INFO:tasks.workunit.client.0.smithi088.stdout:6/932: rmdir d0/d2c/dad/db8 39 2024-09-13T21:40:29.776 INFO:tasks.workunit.client.0.smithi088.stdout:1/899: link d9/dc/f1f d9/dc/d52/dba/f139 0 2024-09-13T21:40:29.777 INFO:tasks.workunit.client.0.smithi088.stdout:1/900: chown d9/d10/d2a/d4b/d3a/l90 318656 1 2024-09-13T21:40:29.777 INFO:tasks.workunit.client.0.smithi088.stdout:0/925: dwrite d7/d65/d8c/deb/f128 [0,4194304] 0 2024-09-13T21:40:29.777 INFO:tasks.workunit.client.0.smithi088.stdout:7/744: dwrite d6/d5f/fde [0,4194304] 0 2024-09-13T21:40:29.779 INFO:tasks.workunit.client.0.smithi088.stdout:2/875: rename d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d5b/f10d to d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dcd/f123 0 2024-09-13T21:40:29.782 INFO:tasks.workunit.client.0.smithi088.stdout:1/901: write d9/d10/d2a/d4b/d3a/d104/d130/f114 [626411,97590] 0 2024-09-13T21:40:29.782 INFO:tasks.workunit.client.0.smithi088.stdout:8/879: symlink db/d26/d2c/db7/dbd/l121 0 2024-09-13T21:40:29.783 INFO:tasks.workunit.client.0.smithi088.stdout:8/880: creat db/df/da7/d88/f122 x:0 0 0 2024-09-13T21:40:29.783 INFO:tasks.workunit.client.0.smithi088.stdout:8/881: write db/d26/d37/d7d/ff0 [238339,110110] 0 2024-09-13T21:40:29.783 INFO:tasks.workunit.client.0.smithi088.stdout:8/882: read db/df/f69 [2233097,121774] 0 2024-09-13T21:40:29.785 INFO:tasks.workunit.client.0.smithi088.stdout:4/895: link d2/d13/d50/fd3 d2/d5/d20/d7f/f128 0 2024-09-13T21:40:29.791 INFO:tasks.workunit.client.0.smithi088.stdout:8/883: dread db/d26/d37/f46 [0,4194304] 0 2024-09-13T21:40:29.799 INFO:tasks.workunit.client.0.smithi088.stdout:9/777: dwrite d1a/d3c/f5a [4194304,4194304] 0 2024-09-13T21:40:29.799 INFO:tasks.workunit.client.0.smithi088.stdout:9/778: truncate d1a/fe3 1332176 0 2024-09-13T21:40:29.800 INFO:tasks.workunit.client.0.smithi088.stdout:0/926: creat d7/d1d/d66/f13f x:0 0 0 2024-09-13T21:40:29.800 INFO:tasks.workunit.client.0.smithi088.stdout:7/745: rmdir d6/da/d44/da7 39 2024-09-13T21:40:29.801 INFO:tasks.workunit.client.0.smithi088.stdout:2/876: truncate d1/d8/f14 4425759 0 2024-09-13T21:40:29.802 INFO:tasks.workunit.client.0.smithi088.stdout:6/933: dwrite d0/d2c/d83/f115 [0,4194304] 0 2024-09-13T21:40:29.802 INFO:tasks.workunit.client.0.smithi088.stdout:6/934: write d0/d1e/d1f/f7b [1000380,123468] 0 2024-09-13T21:40:29.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/902: dwrite d9/d10/dff/f137 [0,4194304] 0 2024-09-13T21:40:29.802 INFO:tasks.workunit.client.0.smithi088.stdout:1/903: dread - d9/d10/d2a/d4b/d39/dda/d10a/d10f/f12d zero size 2024-09-13T21:40:29.806 INFO:tasks.workunit.client.0.smithi088.stdout:8/884: creat db/df/de0/d117/f123 x:0 0 0 2024-09-13T21:40:29.809 INFO:tasks.workunit.client.0.smithi088.stdout:9/779: link d1a/d3c/d51/d5e/ddb/d8e/lbe d1a/d61/dc6/lf3 0 2024-09-13T21:40:29.810 INFO:tasks.workunit.client.0.smithi088.stdout:3/921: rmdir d5 39 2024-09-13T21:40:29.814 INFO:tasks.workunit.client.0.smithi088.stdout:1/904: dread d9/d10/d2a/d47/fe0 [0,4194304] 0 2024-09-13T21:40:29.814 INFO:tasks.workunit.client.0.smithi088.stdout:1/905: readlink d9/d4f/d64/l97 0 2024-09-13T21:40:29.814 INFO:tasks.workunit.client.0.smithi088.stdout:1/906: fdatasync d9/dc/d74/f117 0 2024-09-13T21:40:29.814 INFO:tasks.workunit.client.0.smithi088.stdout:1/907: chown d9/d10/d2a/l3e 3 1 2024-09-13T21:40:29.819 INFO:tasks.workunit.client.0.smithi088.stdout:8/885: rename db/df/f3d to db/df/da7/d88/ddd/de8/f124 0 2024-09-13T21:40:29.819 INFO:tasks.workunit.client.0.smithi088.stdout:8/886: dread - db/df/d61/d97/f105 zero size 2024-09-13T21:40:29.820 INFO:tasks.workunit.client.0.smithi088.stdout:8/887: getdents db/df/da7/d88/d115 0 2024-09-13T21:40:29.820 INFO:tasks.workunit.client.0.smithi088.stdout:2/877: write d1/d8/f12 [389222,78782] 0 2024-09-13T21:40:29.821 INFO:tasks.workunit.client.0.smithi088.stdout:3/922: creat d5/d5a/f124 x:0 0 0 2024-09-13T21:40:29.821 INFO:tasks.workunit.client.0.smithi088.stdout:6/935: dread d0/d2c/d32/fdf [0,4194304] 0 2024-09-13T21:40:29.826 INFO:tasks.workunit.client.0.smithi088.stdout:1/908: creat d9/d10/d9f/f13a x:0 0 0 2024-09-13T21:40:29.828 INFO:tasks.workunit.client.0.smithi088.stdout:9/780: rename d1a/d1b/f2d to d1a/d3c/d60/ddc/ff4 0 2024-09-13T21:40:29.828 INFO:tasks.workunit.client.0.smithi088.stdout:9/781: truncate f13 131502 0 2024-09-13T21:40:29.830 INFO:tasks.workunit.client.0.smithi088.stdout:2/878: unlink d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dcd/ff3 0 2024-09-13T21:40:29.830 INFO:tasks.workunit.client.0.smithi088.stdout:2/879: stat d1/d8/d2e/d91/db3 0 2024-09-13T21:40:29.830 INFO:tasks.workunit.client.0.smithi088.stdout:2/880: read - d1/d8/d2e/d3b/dff/d3f/ffd zero size 2024-09-13T21:40:29.831 INFO:tasks.workunit.client.0.smithi088.stdout:1/909: dread d9/d10/d2a/d47/d9c/db5/f113 [0,4194304] 0 2024-09-13T21:40:29.831 INFO:tasks.workunit.client.0.smithi088.stdout:9/782: dread d1a/f5d [0,4194304] 0 2024-09-13T21:40:29.831 INFO:tasks.workunit.client.0.smithi088.stdout:1/910: write d9/dc/d52/dba/f9b [3832824,111858] 0 2024-09-13T21:40:29.831 INFO:tasks.workunit.client.0.smithi088.stdout:3/923: dread d5/d23/d2a/d63/d48/f9a [0,4194304] 0 2024-09-13T21:40:29.831 INFO:tasks.workunit.client.0.smithi088.stdout:6/936: rename d0/d2c/dad/db8/dcc to d0/d2c/dad/db3/d132 0 2024-09-13T21:40:29.833 INFO:tasks.workunit.client.0.smithi088.stdout:3/924: link d5/d23/d2a/d63/d48/d49/dd8/l112 d5/d5a/l125 0 2024-09-13T21:40:29.834 INFO:tasks.workunit.client.0.smithi088.stdout:3/925: rmdir d5 39 2024-09-13T21:40:29.835 INFO:tasks.workunit.client.0.smithi088.stdout:1/911: dread d9/dc/fb9 [0,4194304] 0 2024-09-13T21:40:29.835 INFO:tasks.workunit.client.0.smithi088.stdout:1/912: stat d9/d10/d2a/d4b/d3a/lb6 0 2024-09-13T21:40:29.835 INFO:tasks.workunit.client.0.smithi088.stdout:3/926: mkdir d5/d23/d2a/d6b/d98/da1/d126 0 2024-09-13T21:40:29.836 INFO:tasks.workunit.client.0.smithi088.stdout:3/927: symlink d5/d23/d2a/d3f/db4/l127 0 2024-09-13T21:40:29.838 INFO:tasks.workunit.client.0.smithi088.stdout:0/927: dwrite d7/d1d/d66/fab [0,4194304] 0 2024-09-13T21:40:29.838 INFO:tasks.workunit.client.0.smithi088.stdout:0/928: stat d7/d65/f92 0 2024-09-13T21:40:29.838 INFO:tasks.workunit.client.0.smithi088.stdout:7/746: dwrite d6/d5f/d7a/f8c [4194304,4194304] 0 2024-09-13T21:40:29.838 INFO:tasks.workunit.client.0.smithi088.stdout:7/747: fdatasync d6/d5f/d69/d4f/fb8 0 2024-09-13T21:40:29.840 INFO:tasks.workunit.client.0.smithi088.stdout:3/928: symlink d5/d23/d2a/d3f/dd0/l128 0 2024-09-13T21:40:29.842 INFO:tasks.workunit.client.0.smithi088.stdout:0/929: link d7/d2c/c98 d7/d1d/d21/d82/db8/c140 0 2024-09-13T21:40:29.842 INFO:tasks.workunit.client.0.smithi088.stdout:0/930: getdents d7/d2c/d30/dbe/d13c/dc0 0 2024-09-13T21:40:29.842 INFO:tasks.workunit.client.0.smithi088.stdout:2/881: write d1/d8/d24/d78/d7f/fe6 [2951999,107810] 0 2024-09-13T21:40:29.845 INFO:tasks.workunit.client.0.smithi088.stdout:9/783: dwrite d1a/fc5 [4194304,4194304] 0 2024-09-13T21:40:29.845 INFO:tasks.workunit.client.0.smithi088.stdout:9/784: truncate d1a/d61/d3d/d41/d48/f96 608214 0 2024-09-13T21:40:29.846 INFO:tasks.workunit.client.0.smithi088.stdout:3/929: read d5/d23/d2a/d63/d48/d49/fa7 [1700220,97592] 0 2024-09-13T21:40:29.846 INFO:tasks.workunit.client.0.smithi088.stdout:3/930: readlink d5/d23/d2a/d6b/d9e/ldd 0 2024-09-13T21:40:29.847 INFO:tasks.workunit.client.0.smithi088.stdout:4/896: write d2/d5/d20/d60/de/d1e/fec [639517,49163] 0 2024-09-13T21:40:29.850 INFO:tasks.workunit.client.0.smithi088.stdout:0/931: dread d7/d2c/d30/d31/d42/d95/fa3 [0,4194304] 0 2024-09-13T21:40:29.850 INFO:tasks.workunit.client.0.smithi088.stdout:0/932: truncate d7/d65/d8c/deb/f11e 130990 0 2024-09-13T21:40:29.862 INFO:tasks.workunit.client.0.smithi088.stdout:3/931: getdents d5/d23/d2a 0 2024-09-13T21:40:29.862 INFO:tasks.workunit.client.0.smithi088.stdout:3/932: chown d5/d23/d2a/d6b/d98/da1/daa/d43/f84 708613 1 2024-09-13T21:40:29.862 INFO:tasks.workunit.client.0.smithi088.stdout:4/897: creat d2/d5/d20/d41/f129 x:0 0 0 2024-09-13T21:40:29.863 INFO:tasks.workunit.client.0.smithi088.stdout:9/785: dwrite d1a/f67 [0,4194304] 0 2024-09-13T21:40:29.863 INFO:tasks.workunit.client.0.smithi088.stdout:9/786: creat d1a/d9e/ff5 x:0 0 0 2024-09-13T21:40:29.863 INFO:tasks.workunit.client.0.smithi088.stdout:7/748: write d6/da/d44/f65 [506087,20936] 0 2024-09-13T21:40:29.863 INFO:tasks.workunit.client.0.smithi088.stdout:9/787: dread d1a/d61/d3d/d41/d48/f96 [0,4194304] 0 2024-09-13T21:40:29.864 INFO:tasks.workunit.client.0.smithi088.stdout:2/882: getdents d1/d8/d2e/d3b/dff/d2a/d41/d82 0 2024-09-13T21:40:29.865 INFO:tasks.workunit.client.0.smithi088.stdout:3/933: getdents d5/d23/d2a/d3f 0 2024-09-13T21:40:29.866 INFO:tasks.workunit.client.0.smithi088.stdout:4/898: mknod d2/d5/d20/d60/de/d1e/d23/d6c/c12a 0 2024-09-13T21:40:29.869 INFO:tasks.workunit.client.0.smithi088.stdout:0/933: rmdir d7/d65/d8c 39 2024-09-13T21:40:29.869 INFO:tasks.workunit.client.0.smithi088.stdout:7/749: getdents d6/d5f/d69/d4f/d6f/d70 0 2024-09-13T21:40:29.871 INFO:tasks.workunit.client.0.smithi088.stdout:9/788: mknod d1a/d9e/cf6 0 2024-09-13T21:40:29.871 INFO:tasks.workunit.client.0.smithi088.stdout:9/789: readlink d1a/d61/d3d/d41/d48/l9d 0 2024-09-13T21:40:29.871 INFO:tasks.workunit.client.0.smithi088.stdout:9/790: write f15 [3004152,109802] 0 2024-09-13T21:40:29.871 INFO:tasks.workunit.client.0.smithi088.stdout:2/883: mknod d1/d8/d2e/d3b/dff/d2a/d3c/d4a/d6e/d66/c124 0 2024-09-13T21:40:29.872 INFO:tasks.workunit.client.0.smithi088.stdout:3/934: truncate d5/d23/d2a/d3f/db4/fe1 165054 0 2024-09-13T21:40:29.872 INFO:tasks.workunit.client.0.smithi088.stdout:3/935: chown d5/d23/d2a/d3f/d8f/da3/lb5 1763 1 2024-09-13T21:40:29.872 INFO:tasks.workunit.client.0.smithi088.stdout:3/936: write f1 [4909638,89333] 0 2024-09-13T21:40:29.874 INFO:tasks.workunit.client.0.smithi088.stdout:4/899: symlink d2/d13/d50/l12b 0 2024-09-13T21:40:29.874 INFO:tasks.workunit.client.0.smithi088.stdout:7/750: stat d6/da/d44/l68 0 2024-09-13T21:40:29.877 INFO:tasks.workunit.client.0.smithi088.stdout:4/900: getdents d2/d5/d20/d41/d4b 0 2024-09-13T21:40:29.879 INFO:tasks.workunit.client.0.smithi088.stdout:7/751: rename d6/d5f/d69/d4f/fc7 to d6/da/dc8/ffe 0 2024-09-13T21:40:29.879 INFO:tasks.workunit.client.0.smithi088.stdout:7/752: creat d6/d5f/d69/d4f/fff x:0 0 0 2024-09-13T21:40:29.880 INFO:tasks.workunit.client.0.smithi088.stdout:9/791: dread d1a/f20 [0,4194304] 0 2024-09-13T21:40:29.881 INFO:tasks.workunit.client.0.smithi088.stdout:9/792: creat d1a/d3c/ff7 x:0 0 0 2024-09-13T21:40:29.881 INFO:tasks.workunit.client.0.smithi088.stdout:9/793: dread - d1a/d3c/fcf zero size 2024-09-13T21:40:29.884 INFO:tasks.workunit.client.0.smithi088.stdout:2/884: read d1/d8/d16/d40/f60 [964294,76333] 0 2024-09-13T21:40:29.885 INFO:tasks.workunit.client.0.smithi088.stdout:9/794: truncate d1a/d61/d3d/d41/f8a 3504331 0 2024-09-13T21:40:29.886 INFO:tasks.workunit.client.0.smithi088.stdout:9/795: fdatasync d1a/d1b/f5c 0 2024-09-13T21:40:29.889 INFO:tasks.workunit.client.0.smithi088.stdout:9/796: creat d1a/d1b/d3f/ff8 x:0 0 0 2024-09-13T21:40:29.892 INFO:tasks.workunit.client.0.smithi088.stdout:9/797: mkdir d1a/d3c/d60/ddc/df9 0 2024-09-13T21:40:29.893 INFO:tasks.workunit.client.0.smithi088.stdout:0/934: dwrite d7/d2c/d37/ff1 [0,4194304] 0 2024-09-13T21:40:29.901 INFO:tasks.workunit.client.0.smithi088.stdout:9/798: dread d1a/d1b/d3f/f55 [0,4194304] 0 2024-09-13T21:40:29.901 INFO:tasks.workunit.client.0.smithi088.stdout:9/799: mknod d1a/d61/dc6/cfa 0 2024-09-13T21:40:29.901 INFO:tasks.workunit.client.0.smithi088.stdout:9/800: creat d1a/d1b/db9/ffb x:0 0 0 2024-09-13T21:40:29.902 INFO:tasks.workunit.client.0.smithi088.stdout:9/801: symlink d1a/d1b/d3f/lfc 0 2024-09-13T21:40:29.916 INFO:tasks.workunit.client.0.smithi088.stdout:3/937: dwrite d5/d23/d2a/d6b/d98/ddc/fdb [0,4194304] 0 2024-09-13T21:40:29.919 INFO:tasks.workunit.client.0.smithi088.stdout:4/901: dwrite d2/d5/d20/d41/d4b/f54 [0,4194304] 0 2024-09-13T21:40:29.919 INFO:tasks.workunit.client.0.smithi088.stdout:4/902: creat d2/d5/d2d/d70/f12c x:0 0 0 2024-09-13T21:40:29.919 INFO:tasks.workunit.client.0.smithi088.stdout:4/903: stat d2/d5/d20/d60/de/d1e/d23/d6f/l36 0 2024-09-13T21:40:29.919 INFO:tasks.workunit.client.0.smithi088.stdout:2/885: dwrite d1/d8/d2e/d3b/dff/d2a/d41/d82/fed [0,4194304] 0 2024-09-13T21:40:29.919 INFO:tasks.workunit.client.0.smithi088.stdout:7/753: dwrite d6/da/d1a/f80 [0,4194304] 0 2024-09-13T21:40:29.920 INFO:tasks.workunit.client.0.smithi088.stdout:3/938: symlink d5/d23/d2a/d3f/d76/db3/l129 0 2024-09-13T21:40:29.922 INFO:tasks.workunit.client.0.smithi088.stdout:9/802: rmdir d1a/d61/d3d/d41 39 2024-09-13T21:40:29.926 INFO:tasks.workunit.client.0.smithi088.stdout:7/754: dread d6/f42 [0,4194304] 0 2024-09-13T21:40:29.927 INFO:tasks.workunit.client.0.smithi088.stdout:2/886: unlink d1/cef 0 2024-09-13T21:40:29.933 INFO:tasks.workunit.client.0.smithi088.stdout:3/939: creat d5/d23/d2a/d6b/d98/da1/daa/d43/f12a x:0 0 0 2024-09-13T21:40:29.933 INFO:tasks.workunit.client.0.smithi088.stdout:3/940: chown d5/d14/fc6 3 1 2024-09-13T21:40:29.935 INFO:tasks.workunit.client.0.smithi088.stdout:9/803: rename d1a/d3c/d51/fce to d1a/d3c/d60/ddc/df9/ffd 0 2024-09-13T21:40:29.936 INFO:tasks.workunit.client.0.smithi088.stdout:7/755: symlink d6/d5f/d69/d4f/d6f/d70/dbf/l100 0 2024-09-13T21:40:29.942 INFO:tasks.workunit.client.0.smithi088.stdout:7/756: dread d6/da/db7/fc2 [0,4194304] 0 2024-09-13T21:40:29.943 INFO:tasks.workunit.client.0.smithi088.stdout:7/757: write d6/f8d [48887,11556] 0 2024-09-13T21:40:29.946 INFO:tasks.workunit.client.0.smithi088.stdout:6/937: sync 2024-09-13T21:40:29.946 INFO:tasks.workunit.client.0.smithi088.stdout:1/913: sync 2024-09-13T21:40:29.946 INFO:tasks.workunit.client.0.smithi088.stdout:8/888: sync 2024-09-13T21:40:29.946 INFO:tasks.workunit.client.0.smithi088.stdout:6/938: write d0/f52 [1157239,79342] 0 2024-09-13T21:40:29.947 INFO:tasks.workunit.client.0.smithi088.stdout:4/904: dwrite d2/d5/d20/d60/de/f28 [0,4194304] 0 2024-09-13T21:40:29.947 INFO:tasks.workunit.client.0.smithi088.stdout:8/889: unlink db/df/d61/d97/f105 0 2024-09-13T21:40:29.948 INFO:tasks.workunit.client.0.smithi088.stdout:1/914: symlink d9/d10/dff/d126/l13b 0 2024-09-13T21:40:29.949 INFO:tasks.workunit.client.0.smithi088.stdout:6/939: symlink d0/d2c/d32/d124/l133 0 2024-09-13T21:40:29.949 INFO:tasks.workunit.client.0.smithi088.stdout:6/940: write d0/d2c/d7a/d7c/d110/d12f/fe2 [43884,100311] 0 2024-09-13T21:40:29.949 INFO:tasks.workunit.client.0.smithi088.stdout:6/941: fdatasync d0/db/ffa 0 2024-09-13T21:40:29.950 INFO:tasks.workunit.client.0.smithi088.stdout:1/915: rename d9/d10/d9f/dfe to d9/d4f/d13c 0 2024-09-13T21:40:29.950 INFO:tasks.workunit.client.0.smithi088.stdout:2/887: dwrite d1/d8/fa8 [0,4194304] 0 2024-09-13T21:40:29.957 INFO:tasks.workunit.client.0.smithi088.stdout:2/888: rename d1/d8/d2e/d3b/dff/d2a to d1/d8/d2e/d91/d125 0 2024-09-13T21:40:29.959 INFO:tasks.workunit.client.0.smithi088.stdout:7/758: write d6/d5f/d69/d45/fcb [924648,45139] 0 2024-09-13T21:40:29.962 INFO:tasks.workunit.client.0.smithi088.stdout:7/759: rename d6/d5f/d69/da8/fc0 to d6/da/d1a/d3a/d5c/d60/f101 0 2024-09-13T21:40:29.962 INFO:tasks.workunit.client.0.smithi088.stdout:7/760: chown d6/d5f/d69/d4f/d6f/d70/cec 5012 1 2024-09-13T21:40:29.962 INFO:tasks.workunit.client.0.smithi088.stdout:3/941: dwrite d5/d23/d2a/d3f/db4/f100 [0,4194304] 0 2024-09-13T21:40:29.962 INFO:tasks.workunit.client.0.smithi088.stdout:4/905: write d2/d5/d20/f88 [3923200,123565] 0 2024-09-13T21:40:29.963 INFO:tasks.workunit.client.0.smithi088.stdout:7/761: mknod d6/d5f/d69/d4f/d6f/c102 0 2024-09-13T21:40:29.965 INFO:tasks.workunit.client.0.smithi088.stdout:7/762: write d6/d5f/da9/ff3 [265656,115747] 0 2024-09-13T21:40:29.966 INFO:tasks.workunit.client.0.smithi088.stdout:4/906: mknod d2/d81/de3/c12d 0 2024-09-13T21:40:29.968 INFO:tasks.workunit.client.0.smithi088.stdout:4/907: creat d2/d5/d20/d41/d4b/f12e x:0 0 0 2024-09-13T21:40:29.971 INFO:tasks.workunit.client.0.smithi088.stdout:2/889: write d1/d8/d16/f37 [522230,10608] 0 2024-09-13T21:40:29.971 INFO:tasks.workunit.client.0.smithi088.stdout:2/890: write d1/d8/d2e/d3b/fec [939126,70410] 0 2024-09-13T21:40:29.971 INFO:tasks.workunit.client.0.smithi088.stdout:2/891: write d1/d8/d16/f7c [3156748,61546] 0 2024-09-13T21:40:29.972 INFO:tasks.workunit.client.0.smithi088.stdout:4/908: unlink d2/d5/d20/d60/de/d1e/d31/f91 0 2024-09-13T21:40:29.972 INFO:tasks.workunit.client.0.smithi088.stdout:2/892: rmdir d1/d8/d24/d78 39 2024-09-13T21:40:29.973 INFO:tasks.workunit.client.0.smithi088.stdout:4/909: mknod d2/d5/d20/d60/de/d1e/d31/d61/d99/c12f 0 2024-09-13T21:40:29.976 INFO:tasks.workunit.client.0.smithi088.stdout:4/910: getdents d2/d5/d20/d60/de/d1e/d23 0 2024-09-13T21:40:29.976 INFO:tasks.workunit.client.0.smithi088.stdout:4/911: creat d2/d5/d20/d7f/f130 x:0 0 0 2024-09-13T21:40:29.980 INFO:tasks.workunit.client.0.smithi088.stdout:4/912: dread d2/d5/d20/d60/de/d1e/d23/d3c/d65/fcb [0,4194304] 0 2024-09-13T21:40:29.980 INFO:tasks.workunit.client.0.smithi088.stdout:4/913: fsync d2/d13/d50/fcc 0 2024-09-13T21:40:29.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/914: mkdir d2/d13/d131 0 2024-09-13T21:40:29.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/915: readlink d2/d5/d20/d60/de/d1e/d31/d61/d99/lef 0 2024-09-13T21:40:29.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/916: readlink d2/d5/l6d 0 2024-09-13T21:40:29.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/917: readlink d2/d13/l1f 0 2024-09-13T21:40:29.982 INFO:tasks.workunit.client.0.smithi088.stdout:4/918: chown d2/fae 1 1 2024-09-13T21:40:29.982 INFO:tasks.workunit.client.0.smithi088.stdout:8/890: dwrite db/df/da7/fe6 [0,4194304] 0 2024-09-13T21:40:29.983 INFO:tasks.workunit.client.0.smithi088.stdout:1/916: dwrite d9/dc/d74/f87 [0,4194304] 0 2024-09-13T21:40:29.984 INFO:tasks.workunit.client.0.smithi088.stdout:4/919: mknod d2/d5/d20/c132 0 2024-09-13T21:40:29.984 INFO:tasks.workunit.client.0.smithi088.stdout:4/920: readlink d2/d5/d20/d41/d4b/la2 0 2024-09-13T21:40:29.985 INFO:tasks.workunit.client.0.smithi088.stdout:2/893: dread d1/d8/fad [0,4194304] 0 2024-09-13T21:40:29.990 INFO:tasks.workunit.client.0.smithi088.stdout:4/921: mkdir d2/d5/d20/d60/de/d1e/d23/d3c/d65/d133 0 2024-09-13T21:40:29.990 INFO:tasks.workunit.client.0.smithi088.stdout:4/922: dread - d2/d5/d20/d60/de/d1e/d31/d61/d99/f10b zero size 2024-09-13T21:40:29.990 INFO:tasks.workunit.client.0.smithi088.stdout:4/923: dread - d2/d5/d20/d60/de/d1e/d23/d3c/f10a zero size 2024-09-13T21:40:29.990 INFO:tasks.workunit.client.0.smithi088.stdout:4/924: write d2/d13/fed [767464,126596] 0 2024-09-13T21:40:29.990 INFO:tasks.workunit.client.0.smithi088.stdout:4/925: dread - d2/d5/d20/d60/de/fc4 zero size 2024-09-13T21:40:29.991 INFO:tasks.workunit.client.0.smithi088.stdout:4/926: stat d2/d5/ldf 0 2024-09-13T21:40:29.991 INFO:tasks.workunit.client.0.smithi088.stdout:4/927: truncate d2/d5/d20/d41/d4b/f6a 190670 0 2024-09-13T21:40:29.991 INFO:tasks.workunit.client.0.smithi088.stdout:4/928: dread - d2/d5/d20/d60/de/d1e/d23/d3c/fdc zero size 2024-09-13T21:40:29.999 INFO:tasks.workunit.client.0.smithi088.stdout:7/763: dwrite d6/da/d1a/f30 [4194304,4194304] 0 2024-09-13T21:40:30.001 INFO:tasks.workunit.client.0.smithi088.stdout:7/764: mknod d6/da/dc8/c103 0 2024-09-13T21:40:30.001 INFO:tasks.workunit.client.0.smithi088.stdout:7/765: write d6/d5f/d69/d45/fcc [954443,43772] 0 2024-09-13T21:40:30.003 INFO:tasks.workunit.client.0.smithi088.stdout:6/942: dwrite d0/d2c/d32/f12d [0,4194304] 0 2024-09-13T21:40:30.003 INFO:tasks.workunit.client.0.smithi088.stdout:1/917: dread d9/d10/d2a/d4b/d39/d43/f93 [0,4194304] 0 2024-09-13T21:40:30.003 INFO:tasks.workunit.client.0.smithi088.stdout:1/918: stat d9/d10/d2a/d4b/d33/dad/l124 0 2024-09-13T21:40:30.003 INFO:tasks.workunit.client.0.smithi088.stdout:1/919: dread - d9/d10/d2a/d4b/d3a/f134 zero size 2024-09-13T21:40:30.005 INFO:tasks.workunit.client.0.smithi088.stdout:7/766: mkdir d6/da/dfc/d104 0 2024-09-13T21:40:30.005 INFO:tasks.workunit.client.0.smithi088.stdout:7/767: truncate d6/da/d1a/d3a/d5c/d60/f9e 361342 0 2024-09-13T21:40:30.006 INFO:tasks.workunit.client.0.smithi088.stdout:3/942: dwrite d5/d5a/d7f/d10c/f115 [0,4194304] 0 2024-09-13T21:40:30.008 INFO:tasks.workunit.client.0.smithi088.stdout:1/920: mkdir d9/d10/d2a/d4b/d33/dad/dbb/de1/d13d 0 2024-09-13T21:40:30.010 INFO:tasks.workunit.client.0.smithi088.stdout:7/768: mkdir d6/da/dfc/d105 0 2024-09-13T21:40:30.012 INFO:tasks.workunit.client.0.smithi088.stdout:3/943: truncate d5/d23/d2a/d3f/fa0 434862 0 2024-09-13T21:40:30.012 INFO:tasks.workunit.client.0.smithi088.stdout:3/944: write d5/d23/d2a/f40 [1322566,106095] 0 2024-09-13T21:40:30.014 INFO:tasks.workunit.client.0.smithi088.stdout:8/891: dwrite db/df/d61/f7b [0,4194304] 0 2024-09-13T21:40:30.014 INFO:tasks.workunit.client.0.smithi088.stdout:8/892: chown db/df/da7/d88/f122 0 1 2024-09-13T21:40:30.015 INFO:tasks.workunit.client.0.smithi088.stdout:7/769: mkdir d6/d5f/d69/d4f/d6f/d70/ded/d106 0 2024-09-13T21:40:30.015 INFO:tasks.workunit.client.0.smithi088.stdout:8/893: write db/d26/d2c/d85/d51/f71 [8353074,88568] 0 2024-09-13T21:40:30.016 INFO:tasks.workunit.client.0.smithi088.stdout:2/894: dwrite d1/fd4 [0,4194304] 0 2024-09-13T21:40:30.018 INFO:tasks.workunit.client.0.smithi088.stdout:3/945: rename d5/d23/d2a/d63/d48/f9a to d5/d23/d2a/d6b/f12b 0 2024-09-13T21:40:30.018 INFO:tasks.workunit.client.0.smithi088.stdout:3/946: fsync d5/d23/d2a/d3f/d76/fde 0 2024-09-13T21:40:30.020 INFO:tasks.workunit.client.0.smithi088.stdout:4/929: rmdir d2/d5/d20/d41 39 2024-09-13T21:40:30.020 INFO:tasks.workunit.client.0.smithi088.stdout:4/930: creat d2/d5/d20/d60/de/d1e/d31/d61/d99/df8/f134 x:0 0 0 2024-09-13T21:40:30.020 INFO:tasks.workunit.client.0.smithi088.stdout:4/931: chown d2/d13/fd7 320026856 1 2024-09-13T21:40:30.020 INFO:tasks.workunit.client.0.smithi088.stdout:4/932: dread - d2/d5/d2d/d70/fa8 zero size 2024-09-13T21:40:30.028 INFO:tasks.workunit.client.0.smithi088.stdout:1/921: dwrite d9/d10/f7e [0,4194304] 0 2024-09-13T21:40:30.029 INFO:tasks.workunit.client.0.smithi088.stdout:2/895: creat d1/d8/d24/d78/d7f/d103/f126 x:0 0 0 2024-09-13T21:40:30.030 INFO:tasks.workunit.client.0.smithi088.stdout:6/943: dwrite d0/d1e/fe3 [0,4194304] 0 2024-09-13T21:40:30.032 INFO:tasks.workunit.client.0.smithi088.stdout:8/894: rename db/d26/d37/d7d/cda to db/d26/d2c/d85/c125 0 2024-09-13T21:40:30.032 INFO:tasks.workunit.client.0.smithi088.stdout:8/895: chown db/df/da7/d88/ddd/f114 0 1 2024-09-13T21:40:30.032 INFO:tasks.workunit.client.0.smithi088.stdout:8/896: readlink db/d26/d2c/lc0 0 2024-09-13T21:40:30.032 INFO:tasks.workunit.client.0.smithi088.stdout:8/897: dread - db/df/d61/fec zero size 2024-09-13T21:40:30.033 INFO:tasks.workunit.client.0.smithi088.stdout:1/922: dread d9/dc/f1f [0,4194304] 0 2024-09-13T21:40:30.033 INFO:tasks.workunit.client.0.smithi088.stdout:4/933: truncate d2/d5/d20/d60/de/d1e/d23/d3c/d65/f75 2019522 0 2024-09-13T21:40:30.033 INFO:tasks.workunit.client.0.smithi088.stdout:4/934: creat d2/d81/de3/f135 x:0 0 0 2024-09-13T21:40:30.033 INFO:tasks.workunit.client.0.smithi088.stdout:4/935: readlink d2/d13/dee/lad 0 2024-09-13T21:40:30.034 INFO:tasks.workunit.client.0.smithi088.stdout:7/770: rmdir d6/d5f/d81 39 2024-09-13T21:40:30.034 INFO:tasks.workunit.client.0.smithi088.stdout:7/771: fsync d6/d5f/d69/d4f/d6f/d70/d76/f82 0 2024-09-13T21:40:30.041 INFO:tasks.workunit.client.0.smithi088.stdout:3/947: rename d5/d23/d2a/d63/d31/c3e to d5/d23/d2a/d3f/c12c 0 2024-09-13T21:40:30.043 INFO:tasks.workunit.client.0.smithi088.stdout:8/898: symlink db/df/l126 0 2024-09-13T21:40:30.045 INFO:tasks.workunit.client.0.smithi088.stdout:1/923: mknod d9/d10/d2a/d4b/d39/d43/d85/d100/c13e 0 2024-09-13T21:40:30.045 INFO:tasks.workunit.client.0.smithi088.stdout:1/924: write d9/dc/d52/dba/f139 [2220904,113923] 0 2024-09-13T21:40:30.047 INFO:tasks.workunit.client.0.smithi088.stdout:7/772: truncate f1 4797645 0 2024-09-13T21:40:30.047 INFO:tasks.workunit.client.0.smithi088.stdout:7/773: chown d6/da/d44/f6d 2325009 1 2024-09-13T21:40:30.047 INFO:tasks.workunit.client.0.smithi088.stdout:7/774: chown d6/d5f/cb3 694 1 2024-09-13T21:40:30.051 INFO:tasks.workunit.client.0.smithi088.stdout:7/775: mknod d6/da/d44/c107 0 2024-09-13T21:40:30.051 INFO:tasks.workunit.client.0.smithi088.stdout:7/776: write d6/d4e/f8f [3403207,26142] 0 2024-09-13T21:40:30.052 INFO:tasks.workunit.client.0.smithi088.stdout:3/948: rename d5/d23/d2a/d6b to d5/d5a/d7f/d10c/d12d 0 2024-09-13T21:40:30.052 INFO:tasks.workunit.client.0.smithi088.stdout:3/949: write d5/d23/d2a/fb2 [935363,24363] 0 2024-09-13T21:40:30.052 INFO:tasks.workunit.client.0.smithi088.stdout:3/950: chown d5/d5a/d7f/le2 18 1 2024-09-13T21:40:30.053 INFO:tasks.workunit.client.0.smithi088.stdout:8/899: getdents db/d26/d2c/d85/d51 0 2024-09-13T21:40:30.053 INFO:tasks.workunit.client.0.smithi088.stdout:8/900: fdatasync db/f9b 0 2024-09-13T21:40:30.053 INFO:tasks.workunit.client.0.smithi088.stdout:8/901: write db/df/da7/d88/ddd/de8/f124 [8020036,59499] 0 2024-09-13T21:40:30.053 INFO:tasks.workunit.client.0.smithi088.stdout:8/902: creat db/df/de0/d117/f127 x:0 0 0 2024-09-13T21:40:30.055 INFO:tasks.workunit.client.0.smithi088.stdout:7/777: unlink d6/d5f/d69/f9a 0 2024-09-13T21:40:30.056 INFO:tasks.workunit.client.0.smithi088.stdout:7/778: chown d6/d5f/d69/d4f/cb6 217 1 2024-09-13T21:40:30.057 INFO:tasks.workunit.client.0.smithi088.stdout:6/944: dwrite d0/d1e/d1f/d55/f101 [0,4194304] 0 2024-09-13T21:40:30.057 INFO:tasks.workunit.client.0.smithi088.stdout:4/936: dwrite d2/d5/d20/d60/de/d1e/d31/f7d [0,4194304] 0 2024-09-13T21:40:30.057 INFO:tasks.workunit.client.0.smithi088.stdout:3/951: getdents d5/d5a/dcf 0 2024-09-13T21:40:30.057 INFO:tasks.workunit.client.0.smithi088.stdout:3/952: write d5/d5a/d7f/d10c/d12d/d98/da1/daa/d43/f84 [1930756,123212] 0 2024-09-13T21:40:30.057 INFO:tasks.workunit.client.0.smithi088.stdout:3/953: read - d5/d23/d2a/d63/d31/f102 zero size 2024-09-13T21:40:30.061 INFO:tasks.workunit.client.0.smithi088.stdout:2/896: dwrite d1/d8/d24/f72 [0,4194304] 0 2024-09-13T21:40:30.061 INFO:tasks.workunit.client.0.smithi088.stdout:8/903: unlink db/d26/c6c 0 2024-09-13T21:40:30.061 INFO:tasks.workunit.client.0.smithi088.stdout:7/779: readlink d6/da/ld 0 2024-09-13T21:40:30.062 INFO:tasks.workunit.client.0.smithi088.stdout:6/945: dread d0/d2c/d32/fdf [0,4194304] 0 2024-09-13T21:40:30.062 INFO:tasks.workunit.client.0.smithi088.stdout:6/946: readlink d0/d2c/d7a/d7c/d110/d12f/l4a 0 2024-09-13T21:40:30.062 INFO:tasks.workunit.client.0.smithi088.stdout:6/947: stat d0/d2c/d7a/f100 0 2024-09-13T21:40:30.065 INFO:tasks.workunit.client.0.smithi088.stdout:0/935: sync 2024-09-13T21:40:30.066 INFO:tasks.workunit.client.0.smithi088.stdout:0/936: write d7/d65/d8c/deb/f11e [1085171,2085] 0 2024-09-13T21:40:30.066 INFO:tasks.workunit.client.0.smithi088.stdout:0/937: write d7/d1d/d66/f13f [1007927,60796] 0 2024-09-13T21:40:30.068 INFO:tasks.workunit.client.0.smithi088.stdout:4/937: read d2/f15 [3547490,32645] 0 2024-09-13T21:40:30.069 INFO:tasks.workunit.client.0.smithi088.stdout:2/897: mkdir d1/d8/d2e/d3b/dff/d127 0 2024-09-13T21:40:30.071 INFO:tasks.workunit.client.0.smithi088.stdout:6/948: creat d0/d2c/d7f/db1/d104/df9/f134 x:0 0 0 2024-09-13T21:40:30.071 INFO:tasks.workunit.client.0.smithi088.stdout:3/954: dread d5/d5a/d7f/d10c/d12d/d98/da1/daa/d43/fb9 [0,4194304] 0 2024-09-13T21:40:30.073 INFO:tasks.workunit.client.0.smithi088.stdout:4/938: link d2/d5/d20/d60/de/d1e/d23/f3d d2/d5/d20/d60/de/d1e/d23/f136 0 2024-09-13T21:40:30.073 INFO:tasks.workunit.client.0.smithi088.stdout:4/939: dread - d2/d5/d20/d41/f129 zero size 2024-09-13T21:40:30.074 INFO:tasks.workunit.client.0.smithi088.stdout:2/898: mknod d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/dc3/c128 0 2024-09-13T21:40:30.076 INFO:tasks.workunit.client.0.smithi088.stdout:8/904: dwrite db/df/ffb [0,4194304] 0 2024-09-13T21:40:30.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/780: getdents d6/d4e 0 2024-09-13T21:40:30.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/781: dread - d6/da/d44/fa0 zero size 2024-09-13T21:40:30.077 INFO:tasks.workunit.client.0.smithi088.stdout:1/925: dread d9/dc/f1f [0,4194304] 0 2024-09-13T21:40:30.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/782: chown d6/d5f/da9/le1 67254 1 2024-09-13T21:40:30.082 INFO:tasks.workunit.client.0.smithi088.stdout:8/905: creat db/d26/d2c/d85/d51/dca/f128 x:0 0 0 2024-09-13T21:40:30.085 INFO:tasks.workunit.client.0.smithi088.stdout:1/926: creat d9/d10/d2a/f13f x:0 0 0 2024-09-13T21:40:30.086 INFO:tasks.workunit.client.0.smithi088.stdout:7/783: creat d6/d5f/d69/d4f/d6f/d70/ded/d106/f108 x:0 0 0 2024-09-13T21:40:30.088 INFO:tasks.workunit.client.0.smithi088.stdout:6/949: rename d0/d2c/d8b to d0/d2c/d7a/daf/dc7/d135 0 2024-09-13T21:40:30.088 INFO:tasks.workunit.client.0.smithi088.stdout:6/950: chown d0/d2c/d7a/d7c/d110/d12f 0 1 2024-09-13T21:40:30.088 INFO:tasks.workunit.client.0.smithi088.stdout:6/951: readlink d0/d1e/d1f/d55/le8 0 2024-09-13T21:40:30.089 INFO:tasks.workunit.client.0.smithi088.stdout:4/940: dwrite d2/d5/f55 [0,4194304] 0 2024-09-13T21:40:30.089 INFO:tasks.workunit.client.0.smithi088.stdout:8/906: mknod db/df/de0/c129 0 2024-09-13T21:40:30.092 INFO:tasks.workunit.client.0.smithi088.stdout:7/784: mkdir d6/d5f/d69/d4f/d6f/d70/d76/d109 0 2024-09-13T21:40:30.092 INFO:tasks.workunit.client.0.smithi088.stdout:9/804: sync 2024-09-13T21:40:30.093 INFO:tasks.workunit.client.0.smithi088.stdout:3/955: rename d5/d5a/d7f/d10c/d12d/d8b/l8c to d5/d23/d2a/d3f/d76/db3/da9/l12e 0 2024-09-13T21:40:30.094 INFO:tasks.workunit.client.0.smithi088.stdout:6/952: mkdir d0/d1e/d1f/d55/d96/dde/d136 0 2024-09-13T21:40:30.098 INFO:tasks.workunit.client.0.smithi088.stdout:8/907: unlink db/d26/d2c/db7/ld8 0 2024-09-13T21:40:30.099 INFO:tasks.workunit.client.0.smithi088.stdout:4/941: dread d2/d5/d20/d7f/f128 [0,4194304] 0 2024-09-13T21:40:30.099 INFO:tasks.workunit.client.0.smithi088.stdout:2/899: write d1/d8/f14 [4383355,95530] 0 2024-09-13T21:40:30.100 INFO:tasks.workunit.client.0.smithi088.stdout:7/785: read d6/d5f/d69/d4f/fae [3509600,37512] 0 2024-09-13T21:40:30.100 INFO:tasks.workunit.client.0.smithi088.stdout:7/786: creat d6/d5f/d69/d4f/f10a x:0 0 0 2024-09-13T21:40:30.107 INFO:tasks.workunit.client.0.smithi088.stdout:8/908: dread db/df/d61/f63 [0,4194304] 0 2024-09-13T21:40:30.107 INFO:tasks.workunit.client.0.smithi088.stdout:9/805: dwrite d1a/d3c/f5b [0,4194304] 0 2024-09-13T21:40:30.110 INFO:tasks.workunit.client.0.smithi088.stdout:1/927: rmdir d9 39 2024-09-13T21:40:30.110 INFO:tasks.workunit.client.0.smithi088.stdout:1/928: write d9/d10/dff/f12f [235016,62240] 0 2024-09-13T21:40:30.111 INFO:tasks.workunit.client.0.smithi088.stdout:3/956: unlink d5/d23/d2a/d63/f46 0 2024-09-13T21:40:30.112 INFO:tasks.workunit.client.0.smithi088.stdout:4/942: mkdir d2/d13/d137 0 2024-09-13T21:40:30.113 INFO:tasks.workunit.client.0.smithi088.stdout:2/900: symlink d1/d8/d2e/d91/d125/d41/d48/l129 0 2024-09-13T21:40:30.115 INFO:tasks.workunit.client.0.smithi088.stdout:7/787: rename d6/da/d44/l68 to d6/d5f/d69/d4f/d6f/d70/d76/l10b 0 2024-09-13T21:40:30.115 INFO:tasks.workunit.client.0.smithi088.stdout:7/788: write d6/da/d44/faf [947506,16652] 0 2024-09-13T21:40:30.115 INFO:tasks.workunit.client.0.smithi088.stdout:7/789: chown d6/f22 8 1 2024-09-13T21:40:30.117 INFO:tasks.workunit.client.0.smithi088.stdout:9/806: link d1a/d3c/d51/d5e/d72/l76 d1a/d1b/db9/lfe 0 2024-09-13T21:40:30.117 INFO:tasks.workunit.client.0.smithi088.stdout:7/790: write d6/da/d1a/d3a/f3f [1058255,92029] 0 2024-09-13T21:40:30.118 INFO:tasks.workunit.client.0.smithi088.stdout:1/929: creat d9/d10/d2a/d4b/d3a/d104/d130/f140 x:0 0 0 2024-09-13T21:40:30.119 INFO:tasks.workunit.client.0.smithi088.stdout:6/953: symlink d0/d1e/d1f/l137 0 2024-09-13T21:40:30.119 INFO:tasks.workunit.client.0.smithi088.stdout:6/954: fsync d0/d1e/f73 0 2024-09-13T21:40:30.119 INFO:tasks.workunit.client.0.smithi088.stdout:8/909: dread db/df/da7/fe6 [0,4194304] 0 2024-09-13T21:40:30.120 INFO:tasks.workunit.client.0.smithi088.stdout:4/943: mkdir d2/d5/d20/d60/de/d1e/d23/d138 0 2024-09-13T21:40:30.120 INFO:tasks.workunit.client.0.smithi088.stdout:4/944: truncate d2/d5/d20/d41/d4b/d98/f113 415434 0 2024-09-13T21:40:30.120 INFO:tasks.workunit.client.0.smithi088.stdout:2/901: getdents d1/d8/d2e/d91 0 2024-09-13T21:40:30.124 INFO:tasks.workunit.client.0.smithi088.stdout:8/910: creat db/d26/d4f/f12a x:0 0 0 2024-09-13T21:40:30.124 INFO:tasks.workunit.client.0.smithi088.stdout:6/955: creat d0/d2c/d7f/f138 x:0 0 0 2024-09-13T21:40:30.124 INFO:tasks.workunit.client.0.smithi088.stdout:9/807: mknod d1a/d61/d3d/cff 0 2024-09-13T21:40:30.125 INFO:tasks.workunit.client.0.smithi088.stdout:8/911: write db/d26/d2c/f5d [4583399,61061] 0 2024-09-13T21:40:30.125 INFO:tasks.workunit.client.0.smithi088.stdout:8/912: dread - db/d26/d37/f74 zero size 2024-09-13T21:40:30.126 INFO:tasks.workunit.client.0.smithi088.stdout:3/957: read d5/d5a/d7f/d10c/d12d/f89 [716564,61304] 0 2024-09-13T21:40:30.126 INFO:tasks.workunit.client.0.smithi088.stdout:9/808: link d1a/d3c/d51/db2/cda d1a/d61/de2/c100 0 2024-09-13T21:40:30.128 INFO:tasks.workunit.client.0.smithi088.stdout:6/956: link d0/d1e/d1f/d55/d8f/lbc d0/d2c/d7a/d7c/d110/d12f/d71/d81/l139 0 2024-09-13T21:40:30.128 INFO:tasks.workunit.client.0.smithi088.stdout:6/957: chown d0/d2c/d59/d11a/f11c 7 1 2024-09-13T21:40:30.128 INFO:tasks.workunit.client.0.smithi088.stdout:6/958: fsync d0/d2c/dad/db3/d132/fe1 0 2024-09-13T21:40:30.128 INFO:tasks.workunit.client.0.smithi088.stdout:6/959: getdents d0/d1e/d1f/d55/d96/dde/d136 0 2024-09-13T21:40:30.129 INFO:tasks.workunit.client.0.smithi088.stdout:8/913: mkdir db/df/da7/d88/da8/db4/df2/d12b 0 2024-09-13T21:40:30.129 INFO:tasks.workunit.client.0.smithi088.stdout:3/958: stat d5/d23/d2a/d3f/d76/l10e 0 2024-09-13T21:40:30.130 INFO:tasks.workunit.client.0.smithi088.stdout:1/930: dread d9/d10/d2a/d4b/d39/d43/dfb/f11b [0,4194304] 0 2024-09-13T21:40:30.130 INFO:tasks.workunit.client.0.smithi088.stdout:4/945: dread d2/d5/d20/d60/de/d1e/d23/d3c/f89 [0,4194304] 0 2024-09-13T21:40:30.131 INFO:tasks.workunit.client.0.smithi088.stdout:3/959: mknod d5/d5a/d7f/d10c/d12d/d98/da1/d126/c12f 0 2024-09-13T21:40:30.131 INFO:tasks.workunit.client.0.smithi088.stdout:4/946: fdatasync d2/d5/f14 0 2024-09-13T21:40:30.133 INFO:tasks.workunit.client.0.smithi088.stdout:1/931: unlink d9/d10/d2a/d4b/d39/dda/c135 0 2024-09-13T21:40:30.134 INFO:tasks.workunit.client.0.smithi088.stdout:3/960: truncate d5/d23/d2a/d3f/f69 532053 0 2024-09-13T21:40:30.135 INFO:tasks.workunit.client.0.smithi088.stdout:8/914: dread db/fe2 [0,4194304] 0 2024-09-13T21:40:30.136 INFO:tasks.workunit.client.0.smithi088.stdout:3/961: link d5/d5a/d7f/d10c/d12d/d98/ddc/cc5 d5/d23/d2a/d3f/d76/db3/da5/dc3/c130 0 2024-09-13T21:40:30.136 INFO:tasks.workunit.client.0.smithi088.stdout:3/962: chown d5/d5a/l114 4963199 1 2024-09-13T21:40:30.137 INFO:tasks.workunit.client.0.smithi088.stdout:3/963: chown d5/d23/d2a/d63/d31/f5f 1 1 2024-09-13T21:40:30.138 INFO:tasks.workunit.client.0.smithi088.stdout:3/964: mkdir d5/d5a/d7f/d10c/d12d/d98/d11f/d131 0 2024-09-13T21:40:30.138 INFO:tasks.workunit.client.0.smithi088.stdout:7/791: dwrite d6/d5f/d69/d45/fdf [0,4194304] 0 2024-09-13T21:40:30.138 INFO:tasks.workunit.client.0.smithi088.stdout:7/792: fdatasync d6/d5f/d69/d4f/fff 0 2024-09-13T21:40:30.138 INFO:tasks.workunit.client.0.smithi088.stdout:7/793: creat d6/d5f/d7a/f10c x:0 0 0 2024-09-13T21:40:30.147 INFO:tasks.workunit.client.0.smithi088.stdout:9/809: dread d1a/d1b/f53 [0,4194304] 0 2024-09-13T21:40:30.147 INFO:tasks.workunit.client.0.smithi088.stdout:9/810: chown d1a/d3c/d60/f79 1 1 2024-09-13T21:40:30.147 INFO:tasks.workunit.client.0.smithi088.stdout:7/794: creat d6/d5f/d69/d4f/d6f/d70/dbf/f10d x:0 0 0 2024-09-13T21:40:30.147 INFO:tasks.workunit.client.0.smithi088.stdout:7/795: creat d6/da/dc8/f10e x:0 0 0 2024-09-13T21:40:30.147 INFO:tasks.workunit.client.0.smithi088.stdout:7/796: fdatasync d6/d5f/f72 0 2024-09-13T21:40:30.147 INFO:tasks.workunit.client.0.smithi088.stdout:8/915: getdents db/d26/d2c/db7 0 2024-09-13T21:40:30.147 INFO:tasks.workunit.client.0.smithi088.stdout:8/916: symlink db/d26/d2c/d85/d51/dca/l12c 0 2024-09-13T21:40:30.152 INFO:tasks.workunit.client.0.smithi088.stdout:4/947: read d2/d5/d20/d60/de/f28 [7048369,35413] 0 2024-09-13T21:40:30.153 INFO:tasks.workunit.client.0.smithi088.stdout:7/797: dread d6/da/d1a/f89 [0,4194304] 0 2024-09-13T21:40:30.153 INFO:tasks.workunit.client.0.smithi088.stdout:7/798: truncate d6/da/d44/fbe 561760 0 2024-09-13T21:40:30.154 INFO:tasks.workunit.client.0.smithi088.stdout:4/948: mkdir d2/d11/dab/d139 0 2024-09-13T21:40:30.155 INFO:tasks.workunit.client.0.smithi088.stdout:3/965: dread d5/d23/d2a/d3f/d8f/d91/fb0 [0,4194304] 0 2024-09-13T21:40:30.157 INFO:tasks.workunit.client.0.smithi088.stdout:1/932: write d9/d10/d2a/d4b/d33/dad/dbb/fc9 [4154822,32171] 0 2024-09-13T21:40:30.157 INFO:tasks.workunit.client.0.smithi088.stdout:2/902: dwrite d1/d8/d2e/d3b/fec [0,4194304] 0 2024-09-13T21:40:30.157 INFO:tasks.workunit.client.0.smithi088.stdout:8/917: write db/df/da7/d88/db3/fed [147128,27717] 0 2024-09-13T21:40:30.157 INFO:tasks.workunit.client.0.smithi088.stdout:8/918: chown db/df/da7/d88/da8/db4 3503 1 2024-09-13T21:40:30.162 INFO:tasks.workunit.client.0.smithi088.stdout:1/933: rename d9/d10/d2a/d4b/d33 to d9/d10/d2a/d4b/d39/d43/dfb/d12b/d141 0 2024-09-13T21:40:30.162 INFO:tasks.workunit.client.0.smithi088.stdout:1/934: write d9/d10/d2a/d47/d9c/fc0 [313392,35528] 0 2024-09-13T21:40:30.165 INFO:tasks.workunit.client.0.smithi088.stdout:2/903: link d1/d8/d16/d40/d7e/daa/ld0 d1/l12a 0 2024-09-13T21:40:30.166 INFO:tasks.workunit.client.0.smithi088.stdout:4/949: rename d2/d5/d20/d60/de/d1e/fa9 to d2/d5/d20/d60/de/d1e/f13a 0 2024-09-13T21:40:30.167 INFO:tasks.workunit.client.0.smithi088.stdout:6/960: dwrite d0/d2c/d7a/d7c/d110/d12f/d71/fe4 [0,4194304] 0 2024-09-13T21:40:30.167 INFO:tasks.workunit.client.0.smithi088.stdout:1/935: mknod d9/d4f/d64/c142 0 2024-09-13T21:40:30.168 INFO:tasks.workunit.client.0.smithi088.stdout:9/811: dwrite d1a/d1b/f35 [0,4194304] 0 2024-09-13T21:40:30.168 INFO:tasks.workunit.client.0.smithi088.stdout:9/812: write d1a/d1b/f66 [4622312,59630] 0 2024-09-13T21:40:30.169 INFO:tasks.workunit.client.0.smithi088.stdout:4/950: dread d2/d5/d20/d60/de/d1e/d23/f9a [0,4194304] 0 2024-09-13T21:40:30.169 INFO:tasks.workunit.client.0.smithi088.stdout:4/951: dread - d2/d5/d20/d60/de/d1e/d23/d6c/ff0 zero size 2024-09-13T21:40:30.169 INFO:tasks.workunit.client.0.smithi088.stdout:4/952: dread - d2/d13/dee/f7e zero size 2024-09-13T21:40:30.170 INFO:tasks.workunit.client.0.smithi088.stdout:2/904: rename d1/d8/d2e/d3b/dff/d3f/d99/d105 to d1/d8/d2e/d91/d125/d41/d82/d101/d12b 0 2024-09-13T21:40:30.171 INFO:tasks.workunit.client.0.smithi088.stdout:6/961: mkdir d0/d2c/d7a/d7c/d110/d12f/d71/d13a 0 2024-09-13T21:40:30.171 INFO:tasks.workunit.client.0.smithi088.stdout:6/962: truncate d0/d1e/d1f/d55/d96/f103 859636 0 2024-09-13T21:40:30.173 INFO:tasks.workunit.client.0.smithi088.stdout:7/799: dwrite d6/f22 [4194304,4194304] 0 2024-09-13T21:40:30.173 INFO:tasks.workunit.client.0.smithi088.stdout:7/800: write d6/d5f/da9/fb4 [140735,91457] 0 2024-09-13T21:40:30.173 INFO:tasks.workunit.client.0.smithi088.stdout:8/919: dread db/df/f96 [0,4194304] 0 2024-09-13T21:40:30.173 INFO:tasks.workunit.client.0.smithi088.stdout:8/920: chown db/df/de0/l10a 471810871 1 2024-09-13T21:40:30.175 INFO:tasks.workunit.client.0.smithi088.stdout:2/905: mkdir d1/d8/d2e/d91/db3/d12c 0 2024-09-13T21:40:30.175 INFO:tasks.workunit.client.0.smithi088.stdout:2/906: creat d1/d8/d2e/d3b/f12d x:0 0 0 2024-09-13T21:40:30.175 INFO:tasks.workunit.client.0.smithi088.stdout:2/907: stat d1/d8/d2e/d3b/f6f 0 2024-09-13T21:40:30.177 INFO:tasks.workunit.client.0.smithi088.stdout:7/801: chown d6/da/fb 5936 1 2024-09-13T21:40:30.177 INFO:tasks.workunit.client.0.smithi088.stdout:7/802: readlink d6/d5f/d69/d45/l58 0 2024-09-13T21:40:30.179 INFO:tasks.workunit.client.0.smithi088.stdout:8/921: rename db/d26/d2c/d85/d51/l11b to db/d26/d2c/d85/d51/l12d 0 2024-09-13T21:40:30.179 INFO:tasks.workunit.client.0.smithi088.stdout:8/922: readlink db/d26/d2c/d85/l4d 0 2024-09-13T21:40:30.179 INFO:tasks.workunit.client.0.smithi088.stdout:8/923: creat db/df/de0/d117/f12e x:0 0 0 2024-09-13T21:40:30.187 INFO:tasks.workunit.client.0.smithi088.stdout:2/908: dread d1/d8/d2e/d91/d125/d3c/d4a/d6e/d66/f11c [0,4194304] 0 2024-09-13T21:40:30.187 INFO:tasks.workunit.client.0.smithi088.stdout:7/803: mknod d6/d5f/d69/d4f/d6f/d70/d76/dbd/c10f 0 2024-09-13T21:40:30.190 INFO:tasks.workunit.client.0.smithi088.stdout:8/924: link db/d26/d2c/d85/dad/f113 db/df/da7/daa/f12f 0 2024-09-13T21:40:30.190 INFO:tasks.workunit.client.0.smithi088.stdout:8/925: write db/df/d61/d97/fd3 [909996,41100] 0 2024-09-13T21:40:30.191 INFO:tasks.workunit.client.0.smithi088.stdout:7/804: unlink d6/d5f/d69/d4f/d6f/c99 0 2024-09-13T21:40:30.192 INFO:tasks.workunit.client.0.smithi088.stdout:2/909: dread d1/d8/d16/d40/f67 [0,4194304] 0 2024-09-13T21:40:30.192 INFO:tasks.workunit.client.0.smithi088.stdout:7/805: mknod d6/d5f/d69/da8/dd3/c110 0 2024-09-13T21:40:30.192 INFO:tasks.workunit.client.0.smithi088.stdout:7/806: truncate d6/da/fa2 1053480 0 2024-09-13T21:40:30.192 INFO:tasks.workunit.client.0.smithi088.stdout:7/807: read - d6/da/fea zero size 2024-09-13T21:40:30.198 INFO:tasks.workunit.client.0.smithi088.stdout:7/808: rename d6/da/d1a/d3a/d5c/d60 to d6/d4e/d111 0 2024-09-13T21:40:30.198 INFO:tasks.workunit.client.0.smithi088.stdout:7/809: chown d6/d5f/d69/d4f/fb8 225 1 2024-09-13T21:40:30.201 INFO:tasks.workunit.client.0.smithi088.stdout:7/810: rename d6/d5f/d69/d4f/l40 to d6/da/db7/l112 0 2024-09-13T21:40:30.233 INFO:tasks.workunit.client.0.smithi088.stdout:1/936: dwrite d9/f81 [0,4194304] 0 2024-09-13T21:40:30.233 INFO:tasks.workunit.client.0.smithi088.stdout:9/813: dwrite d1a/d3c/fcf [0,4194304] 0 2024-09-13T21:40:30.233 INFO:tasks.workunit.client.0.smithi088.stdout:8/926: dwrite db/fe2 [0,4194304] 0 2024-09-13T21:40:30.233 INFO:tasks.workunit.client.0.smithi088.stdout:1/937: stat d9/d10/d2a/d4b/d3a/l9e 0 2024-09-13T21:40:30.233 INFO:tasks.workunit.client.0.smithi088.stdout:8/927: chown db/d26/d2c/lc0 2975 1 2024-09-13T21:40:30.233 INFO:tasks.workunit.client.0.smithi088.stdout:1/938: chown d9/d10/d2a/d4b/d3a/f134 18537057 1 2024-09-13T21:40:30.233 INFO:tasks.workunit.client.0.smithi088.stdout:8/928: chown db/df/da7/cb8 1376 1 2024-09-13T21:40:30.234 INFO:tasks.workunit.client.0.smithi088.stdout:8/929: fdatasync f8 0 2024-09-13T21:40:30.234 INFO:tasks.workunit.client.0.smithi088.stdout:1/939: truncate d9/dc/d74/df0/f123 788927 0 2024-09-13T21:40:30.234 INFO:tasks.workunit.client.0.smithi088.stdout:1/940: write d9/d4f/d64/fd3 [992079,18787] 0 2024-09-13T21:40:30.234 INFO:tasks.workunit.client.0.smithi088.stdout:4/953: dwrite d2/d5/d20/d7f/f93 [0,4194304] 0 2024-09-13T21:40:30.235 INFO:tasks.workunit.client.0.smithi088.stdout:7/811: dwrite d6/da/d44/fbe [0,4194304] 0 2024-09-13T21:40:30.235 INFO:tasks.workunit.client.0.smithi088.stdout:7/812: truncate d6/d5f/d81/fe5 950081 0 2024-09-13T21:40:30.235 INFO:tasks.workunit.client.0.smithi088.stdout:7/813: chown d6/da/d44/f65 345989 1 2024-09-13T21:40:30.235 INFO:tasks.workunit.client.0.smithi088.stdout:2/910: dwrite d1/d8/d2e/d3b/f5e [0,4194304] 0 2024-09-13T21:40:30.237 INFO:tasks.workunit.client.0.smithi088.stdout:1/941: dread d9/dc/f42 [0,4194304] 0 2024-09-13T21:40:30.237 INFO:tasks.workunit.client.0.smithi088.stdout:1/942: fdatasync d9/d10/d2a/d4b/d3a/d104/d130/f140 0 2024-09-13T21:40:30.237 INFO:tasks.workunit.client.0.smithi088.stdout:8/930: creat db/df/f130 x:0 0 0 2024-09-13T21:40:30.239 INFO:tasks.workunit.client.0.smithi088.stdout:4/954: symlink d2/d5/d20/d41/d4b/l13b 0 2024-09-13T21:40:30.243 INFO:tasks.workunit.client.0.smithi088.stdout:9/814: dread d1a/f49 [0,4194304] 0 2024-09-13T21:40:30.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/911: rename d1/d8/d24/d78/d7f/d85/f97 to d1/d8/d2e/d91/d125/d41/d48/da0/d110/f12e 0 2024-09-13T21:40:30.256 INFO:tasks.workunit.client.0.smithi088.stdout:2/912: fdatasync d1/f68 0 2024-09-13T21:40:30.256 INFO:tasks.workunit.client.0.smithi088.stdout:7/814: dwrite d6/da/d1a/d3a/f3f [0,4194304] 0 2024-09-13T21:40:30.256 INFO:tasks.workunit.client.0.smithi088.stdout:7/815: chown d6/da/ld 79109 1 2024-09-13T21:40:30.257 INFO:tasks.workunit.client.0.smithi088.stdout:1/943: rmdir d9/d10/d2a/d4b/d3a/d104 39 2024-09-13T21:40:30.259 INFO:tasks.workunit.client.0.smithi088.stdout:9/815: symlink d1a/d3c/d60/dbb/l101 0 2024-09-13T21:40:30.259 INFO:tasks.workunit.client.0.smithi088.stdout:9/816: dread - d1a/d3c/d60/fa2 zero size 2024-09-13T21:40:30.260 INFO:tasks.workunit.client.0.smithi088.stdout:2/913: symlink d1/d8/d24/d78/d7f/d85/l12f 0 2024-09-13T21:40:30.265 INFO:tasks.workunit.client.0.smithi088.stdout:7/816: mknod d6/d5f/d69/da8/c113 0 2024-09-13T21:40:30.265 INFO:tasks.workunit.client.0.smithi088.stdout:1/944: mkdir d9/d10/dff/d143 0 2024-09-13T21:40:30.265 INFO:tasks.workunit.client.0.smithi088.stdout:2/914: creat d1/d8/d2e/d91/d125/d3c/d4a/d6e/d76/d112/f130 x:0 0 0 2024-09-13T21:40:30.265 INFO:tasks.workunit.client.0.smithi088.stdout:7/817: link d6/d5f/d69/d4f/d6f/d83/f7f d6/d5f/d69/d4f/d6f/db2/f114 0 2024-09-13T21:40:30.266 INFO:tasks.workunit.client.0.smithi088.stdout:1/945: creat d9/d10/d2a/d4b/f144 x:0 0 0 2024-09-13T21:40:30.267 INFO:tasks.workunit.client.0.smithi088.stdout:2/915: mkdir d1/d8/d2e/d91/d125/d41/d131 0 2024-09-13T21:40:30.268 INFO:tasks.workunit.client.0.smithi088.stdout:1/946: symlink d9/d4f/d64/l145 0 2024-09-13T21:40:30.270 INFO:tasks.workunit.client.0.smithi088.stdout:8/931: dwrite db/d26/d2c/d85/f83 [0,4194304] 0 2024-09-13T21:40:30.270 INFO:tasks.workunit.client.0.smithi088.stdout:8/932: dread - db/d26/d2c/db7/dbd/fc4 zero size 2024-09-13T21:40:30.271 INFO:tasks.workunit.client.0.smithi088.stdout:1/947: mkdir d9/d10/d2a/d4b/d146 0 2024-09-13T21:40:30.274 INFO:tasks.workunit.client.0.smithi088.stdout:4/955: dwrite d2/d5/d20/d60/de/d1e/f13a [0,4194304] 0 2024-09-13T21:40:30.274 INFO:tasks.workunit.client.0.smithi088.stdout:8/933: mkdir db/d26/d2c/d85/d51/dca/d131 0 2024-09-13T21:40:30.277 INFO:tasks.workunit.client.0.smithi088.stdout:4/956: unlink d2/d5/l2c 0 2024-09-13T21:40:30.278 INFO:tasks.workunit.client.0.smithi088.stdout:8/934: link db/df/d61/ca4 db/df/da7/d88/db3/c132 0 2024-09-13T21:40:30.283 INFO:tasks.workunit.client.0.smithi088.stdout:0/938: sync 2024-09-13T21:40:30.286 INFO:tasks.workunit.client.0.smithi088.stdout:0/939: unlink d7/f2b 0 2024-09-13T21:40:30.286 INFO:tasks.workunit.client.0.smithi088.stdout:0/940: write d7/f19 [820951,1876] 0 2024-09-13T21:40:30.290 INFO:tasks.workunit.client.0.smithi088.stdout:4/957: dread d2/d5/d20/d60/de/d1e/d23/dca/fd1 [0,4194304] 0 2024-09-13T21:40:30.293 INFO:tasks.workunit.client.0.smithi088.stdout:9/817: dwrite d1a/f80 [0,4194304] 0 2024-09-13T21:40:30.294 INFO:tasks.workunit.client.0.smithi088.stdout:9/818: symlink d1a/d61/dec/l102 0 2024-09-13T21:40:30.294 INFO:tasks.workunit.client.0.smithi088.stdout:9/819: write d1a/d3c/d85/fe0 [811302,68013] 0 2024-09-13T21:40:30.294 INFO:tasks.workunit.client.0.smithi088.stdout:9/820: creat d1a/d3c/d85/f103 x:0 0 0 2024-09-13T21:40:30.295 INFO:tasks.workunit.client.0.smithi088.stdout:9/821: truncate d1a/fb5 886158 0 2024-09-13T21:40:30.297 INFO:tasks.workunit.client.0.smithi088.stdout:9/822: unlink d1a/d9e/cf6 0 2024-09-13T21:40:30.297 INFO:tasks.workunit.client.0.smithi088.stdout:9/823: read d1a/d3c/d51/d5e/f7c [3908329,128506] 0 2024-09-13T21:40:30.297 INFO:tasks.workunit.client.0.smithi088.stdout:9/824: truncate f15 4291918 0 2024-09-13T21:40:30.298 INFO:tasks.workunit.client.0.smithi088.stdout:0/941: dread d7/fb7 [0,4194304] 0 2024-09-13T21:40:30.298 INFO:tasks.workunit.client.0.smithi088.stdout:9/825: mknod d1a/d3c/d51/c104 0 2024-09-13T21:40:30.301 INFO:tasks.workunit.client.0.smithi088.stdout:3/966: sync 2024-09-13T21:40:30.311 INFO:tasks.workunit.client.0.smithi088.stdout:7/818: dwrite d6/da/d44/fa0 [0,4194304] 0 2024-09-13T21:40:30.312 INFO:tasks.workunit.client.0.smithi088.stdout:0/942: read d7/f12 [2464314,98384] 0 2024-09-13T21:40:30.313 INFO:tasks.workunit.client.0.smithi088.stdout:0/943: creat d7/d2c/d30/d31/d42/de2/f141 x:0 0 0 2024-09-13T21:40:30.313 INFO:tasks.workunit.client.0.smithi088.stdout:0/944: dread - d7/d2c/d30/dbe/d13c/d118/d45/d7c/f104 zero size 2024-09-13T21:40:30.313 INFO:tasks.workunit.client.0.smithi088.stdout:0/945: readlink d7/d1d/d3d/la0 0 2024-09-13T21:40:30.317 INFO:tasks.workunit.client.0.smithi088.stdout:2/916: dwrite d1/d8/d2e/d91/d125/d41/d48/da0/fe1 [0,4194304] 0 2024-09-13T21:40:30.324 INFO:tasks.workunit.client.0.smithi088.stdout:8/935: dwrite db/fe2 [4194304,4194304] 0 2024-09-13T21:40:30.324 INFO:tasks.workunit.client.0.smithi088.stdout:1/948: dwrite d9/dc/f71 [0,4194304] 0 2024-09-13T21:40:30.325 INFO:tasks.workunit.client.0.smithi088.stdout:7/819: dread d6/da/d1a/f56 [0,4194304] 0 2024-09-13T21:40:30.325 INFO:tasks.workunit.client.0.smithi088.stdout:4/958: dwrite d2/d5/d20/d41/d4b/f7a [0,4194304] 0 2024-09-13T21:40:30.329 INFO:tasks.workunit.client.0.smithi088.stdout:1/949: creat d9/d10/d2a/d4b/d39/d43/dfb/d12b/d141/d92/f147 x:0 0 0 2024-09-13T21:40:30.329 INFO:tasks.workunit.client.0.smithi088.stdout:1/950: truncate d9/fd 4429711 0 2024-09-13T21:40:30.329 INFO:tasks.workunit.client.0.smithi088.stdout:3/967: dwrite d5/d23/d2a/d63/d48/d49/fa7 [0,4194304] 0 2024-09-13T21:40:30.332 INFO:tasks.workunit.client.0.smithi088.stdout:4/959: symlink d2/d81/de3/l13c 0 2024-09-13T21:40:30.334 INFO:tasks.workunit.client.0.smithi088.stdout:4/960: symlink d2/d5/d20/l13d 0 2024-09-13T21:40:30.334 INFO:tasks.workunit.client.0.smithi088.stdout:4/961: truncate d2/d11/dab/fe6 769337 0 2024-09-13T21:40:30.337 INFO:tasks.workunit.client.0.smithi088.stdout:8/936: dread db/d26/d2c/fcf [0,4194304] 0 2024-09-13T21:40:30.337 INFO:tasks.workunit.client.0.smithi088.stdout:4/962: rename d2/d5/f14 to d2/d5/d20/d60/de/d1e/d31/f13e 0 2024-09-13T21:40:30.338 INFO:tasks.workunit.client.0.smithi088.stdout:0/946: dwrite d7/d65/d8c/df3/f137 [0,4194304] 0 2024-09-13T21:40:30.338 INFO:tasks.workunit.client.0.smithi088.stdout:7/820: dread d6/f22 [0,4194304] 0 2024-09-13T21:40:30.338 INFO:tasks.workunit.client.0.smithi088.stdout:8/937: mknod db/d26/d2c/db7/c133 0 2024-09-13T21:40:30.340 INFO:tasks.workunit.client.0.smithi088.stdout:4/963: truncate d2/d5/f55 2238095 0 2024-09-13T21:40:30.340 INFO:tasks.workunit.client.0.smithi088.stdout:4/964: chown d2/d5/d20/d60/de/d1e/d31/d61/d99/f10b 1995514990 1 2024-09-13T21:40:30.340 INFO:tasks.workunit.client.0.smithi088.stdout:4/965: chown d2/d5/d20/d60/de/d1e/d31/d61/d99/f10b 329608 1 2024-09-13T21:40:30.341 INFO:tasks.workunit.client.0.smithi088.stdout:4/966: creat d2/d5/d20/d60/de/d1e/d31/d61/d99/df8/f13f x:0 0 0 2024-09-13T21:40:30.344 INFO:tasks.workunit.client.0.smithi088.stdout:2/917: dwrite d1/d8/d16/d40/d7e/daa/f11f [0,4194304] 0 2024-09-13T21:40:30.344 INFO:tasks.workunit.client.0.smithi088.stdout:3/968: dread d5/d23/d2a/d3f/f64 [0,4194304] 0 2024-09-13T21:40:30.344 INFO:tasks.workunit.client.0.smithi088.stdout:2/918: fsync d1/d8/d2e/d3b/dff/d3f/f43 0 2024-09-13T21:40:30.344 INFO:tasks.workunit.client.0.smithi088.stdout:7/821: creat d6/d5f/d69/d4f/d6f/d70/d76/dbd/deb/f115 x:0 0 0 2024-09-13T21:40:30.345 INFO:tasks.workunit.client.0.smithi088.stdout:4/967: mknod d2/d5/d20/d60/de/d1e/c140 0 2024-09-13T21:40:30.346 INFO:tasks.workunit.client.0.smithi088.stdout:4/968: mknod d2/d5/d2d/d70/c141 0 2024-09-13T21:40:30.348 INFO:tasks.workunit.client.0.smithi088.stdout:4/969: mkdir d2/d5/d20/d60/de/d1e/d23/dca/d142 0 2024-09-13T21:40:30.350 INFO:tasks.workunit.client.0.smithi088.stdout:6/963: sync 2024-09-13T21:40:30.352 INFO:tasks.workunit.client.0.smithi088.stdout:4/970: rename d2/d5/d20/d60/de/d1e/d23/fc3 to d2/d5/d2d/f143 0 2024-09-13T21:40:30.354 INFO:tasks.workunit.client.0.smithi088.stdout:4/971: truncate d2/d5/d20/d60/de/d1e/d23/f136 852413 0 2024-09-13T21:40:30.354 INFO:tasks.workunit.client.0.smithi088.stdout:0/947: write d7/d1d/d21/ff9 [161841,52557] 0 2024-09-13T21:40:30.354 INFO:tasks.workunit.client.0.smithi088.stdout:1/951: dwrite d9/d10/d2a/d4b/d39/d43/dfb/d12b/d141/f76 [0,4194304] 0 2024-09-13T21:40:30.355 INFO:tasks.workunit.client.0.smithi088.stdout:0/948: write d7/d2c/d30/d31/d42/de2/fb3 [466303,9955] 0 2024-09-13T21:40:30.361 INFO:tasks.workunit.client.0.smithi088.stdout:6/964: dread d0/d28/f80 [0,4194304] 0 2024-09-13T21:40:30.363 INFO:tasks.workunit.client.0.smithi088.stdout:4/972: getdents d2/d5/d20/d60/de/d1e/d31/d61/d99/df8 0 2024-09-13T21:40:30.363 INFO:tasks.workunit.client.0.smithi088.stdout:1/952: write d9/d10/d2a/d4b/d39/d43/dfb/d12b/d141/f125 [3180715,11041] 0 2024-09-13T21:40:30.363 INFO:tasks.workunit.client.0.smithi088.stdout:1/953: fsync d9/d10/d2a/d4b/d3a/dcd/ff3 0 2024-09-13T21:40:30.365 INFO:tasks.workunit.client.0.smithi088.stdout:4/973: mkdir d2/d5/d20/d41/d4b/d98/dcd/d144 0 2024-09-13T21:40:30.368 INFO:tasks.workunit.client.0.smithi088.stdout:4/974: getdents d2/d5/d20/d60/de/d1e 0 2024-09-13T21:40:30.370 INFO:tasks.workunit.client.0.smithi088.stdout:4/975: creat d2/d5/d20/d60/de/d1e/d23/d3c/d65/d79/de9/f145 x:0 0 0 2024-09-13T21:40:30.371 INFO:tasks.workunit.client.0.smithi088.stdout:4/976: symlink d2/d13/l146 0 2024-09-13T21:40:30.371 INFO:tasks.workunit.client.0.smithi088.stdout:4/977: fsync d2/d5/d20/d60/de/d1e/d31/d61/d99/df8/f134 0 2024-09-13T21:40:30.373 INFO:tasks.workunit.client.0.smithi088.stdout:4/978: creat d2/d13/d131/f147 x:0 0 0 2024-09-13T21:40:30.373 INFO:tasks.workunit.client.0.smithi088.stdout:4/979: dread - d2/d5/d2d/d70/f102 zero size 2024-09-13T21:40:30.373 INFO:tasks.workunit.client.0.smithi088.stdout:4/980: readlink d2/d5/d20/l2e 0 2024-09-13T21:40:30.373 INFO:tasks.workunit.client.0.smithi088.stdout:4/981: write d2/d13/f124 [560723,111839] 0 2024-09-13T21:40:30.373 INFO:tasks.workunit.client.0.smithi088.stdout:4/982: chown d2/d5/d20/d41/d4b/d98/fb2 87054 1 2024-09-13T21:40:30.373 INFO:tasks.workunit.client.0.smithi088.stdout:4/983: chown d2/d11/dab/fe6 831514521 1 2024-09-13T21:40:30.373 INFO:tasks.workunit.client.0.smithi088.stdout:4/984: write d2/d5/d20/d7f/f101 [730584,84622] 0 2024-09-13T21:40:30.382 INFO:tasks.workunit.client.0.smithi088.stdout:3/969: dwrite d5/d23/d2a/f51 [0,4194304] 0 2024-09-13T21:40:30.383 INFO:tasks.workunit.client.0.smithi088.stdout:3/970: symlink d5/d23/d2a/d63/d48/l132 0 2024-09-13T21:40:30.386 INFO:tasks.workunit.client.0.smithi088.stdout:4/985: write d2/d5/f55 [1346028,42899] 0 2024-09-13T21:40:30.388 INFO:tasks.workunit.client.0.smithi088.stdout:2/919: dwrite d1/d8/f14 [0,4194304] 0 2024-09-13T21:40:30.390 INFO:tasks.workunit.client.0.smithi088.stdout:0/949: dwrite d7/d1d/d27/d43/fc6 [0,4194304] 0 2024-09-13T21:40:30.390 INFO:tasks.workunit.client.0.smithi088.stdout:0/950: readlink d7/d2c/d37/l97 0 2024-09-13T21:40:30.390 INFO:tasks.workunit.client.0.smithi088.stdout:0/951: write d7/d2c/d30/d31/d42/f109 [134547,69581] 0 2024-09-13T21:40:30.392 INFO:tasks.workunit.client.0.smithi088.stdout:0/952: creat d7/d2c/d30/dbe/d13c/d118/dcd/d101/f142 x:0 0 0 2024-09-13T21:40:30.393 INFO:tasks.workunit.client.0.smithi088.stdout:0/953: write d7/f12 [3590702,55109] 0 2024-09-13T21:40:30.395 INFO:tasks.workunit.client.0.smithi088.stdout:1/954: dwrite d9/d10/d2a/f8a [0,4194304] 0 2024-09-13T21:40:30.395 INFO:tasks.workunit.client.0.smithi088.stdout:1/955: write d9/dc/d74/f87 [4735766,94530] 0 2024-09-13T21:40:30.395 INFO:tasks.workunit.client.0.smithi088.stdout:1/956: chown d9/dc/d52/ld7 57 1 2024-09-13T21:40:30.395 INFO:tasks.workunit.client.0.smithi088.stdout:1/957: chown d9/dc/d74/df0/f123 743 1 2024-09-13T21:40:30.398 INFO:tasks.workunit.client.0.smithi088.stdout:6/965: dwrite d0/d1e/d1f/d55/d8f/f121 [0,4194304] 0 2024-09-13T21:40:30.398 INFO:tasks.workunit.client.0.smithi088.stdout:6/966: readlink d0/d1e/d1f/l86 0 2024-09-13T21:40:30.401 INFO:tasks.workunit.client.0.smithi088.stdout:6/967: rmdir d0/d2c/d32/d39 39 2024-09-13T21:40:30.413 INFO:tasks.workunit.client.0.smithi088.stdout:6/968: write d0/d2c/d32/f6e [3939331,24463] 0 2024-09-13T21:40:30.413 INFO:tasks.workunit.client.0.smithi088.stdout:6/969: fdatasync d0/db/f120 0 2024-09-13T21:40:30.418 INFO:tasks.workunit.client.0.smithi088.stdout:4/986: dwrite d2/fae [0,4194304] 0 2024-09-13T21:40:30.420 INFO:tasks.workunit.client.0.smithi088.stdout:4/987: mknod d2/d5/d20/d60/de/d1e/d23/dca/c148 0 2024-09-13T21:40:30.422 INFO:tasks.workunit.client.0.smithi088.stdout:4/988: rmdir d2/d5/d20/d41/d4b/d98/dcd/d144 0 2024-09-13T21:40:30.429 INFO:tasks.workunit.client.0.smithi088.stdout:6/970: dread d0/d1e/d1f/d55/ff2 [4194304,4194304] 0 2024-09-13T21:40:30.429 INFO:tasks.workunit.client.0.smithi088.stdout:6/971: read - d0/d2c/d7a/d7c/d110/f12c zero size 2024-09-13T21:40:30.429 INFO:tasks.workunit.client.0.smithi088.stdout:6/972: chown d0/d2c/d83/l128 10768 1 2024-09-13T21:40:30.429 INFO:tasks.workunit.client.0.smithi088.stdout:1/958: dwrite d9/d10/d2a/d47/fe0 [0,4194304] 0 2024-09-13T21:40:30.429 INFO:tasks.workunit.client.0.smithi088.stdout:2/920: dwrite d1/d8/d2e/d3b/dff/d3f/d99/f9d [0,4194304] 0 2024-09-13T21:40:30.430 INFO:tasks.workunit.client.0.smithi088.stdout:0/954: dwrite d7/d2c/d78/f7a [0,4194304] 0 2024-09-13T21:40:30.430 INFO:tasks.workunit.client.0.smithi088.stdout:0/955: chown d7/d2c/d30/dbe/d13c/d118/d45/faa 162111826 1 2024-09-13T21:40:30.430 INFO:tasks.workunit.client.0.smithi088.stdout:6/973: mkdir d0/d1e/d1f/d55/d96/dde/d136/d13b 0 2024-09-13T21:40:30.432 INFO:tasks.workunit.client.0.smithi088.stdout:1/959: symlink d9/d10/d2a/d4b/d39/d43/l148 0 2024-09-13T21:40:30.432 INFO:tasks.workunit.client.0.smithi088.stdout:1/960: getdents d9/d10/d2a/d4b/d39/d43/dfb/d12b/d141/dad/dbb/de1/d13d 0 2024-09-13T21:40:30.436 INFO:tasks.workunit.client.0.smithi088.stdout:0/956: truncate d7/d2c/fbd 3938567 0 2024-09-13T21:40:30.438 INFO:tasks.workunit.client.0.smithi088.stdout:1/961: unlink d9/l5f 0 2024-09-13T21:40:30.442 INFO:tasks.workunit.client.0.smithi088.stdout:6/974: dread d0/d1e/f73 [0,4194304] 0 2024-09-13T21:40:30.443 INFO:tasks.workunit.client.0.smithi088.stdout:6/975: link d0/d2c/d7a/d7c/d110/d12f/f68 d0/d2c/d7f/f13c 0 2024-09-13T21:40:30.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/826: sync 2024-09-13T21:40:30.445 INFO:tasks.workunit.client.0.smithi088.stdout:0/957: read d7/d2c/d78/f7a [2644039,123350] 0 2024-09-13T21:40:30.446 INFO:tasks.workunit.client.0.smithi088.stdout:0/958: chown d7/d2c/d30/dbe/d13c/d118/dcd/f136 0 1 2024-09-13T21:40:30.446 INFO:tasks.workunit.client.0.smithi088.stdout:0/959: chown d7/d1d/d3d/dae/d111 50395132 1 2024-09-13T21:40:30.447 INFO:tasks.workunit.client.0.smithi088.stdout:2/921: dwrite d1/d8/d2e/d91/d125/d3c/d4a/f118 [4194304,4194304] 0 2024-09-13T21:40:30.447 INFO:tasks.workunit.client.0.smithi088.stdout:1/962: dread d9/d10/f29 [0,4194304] 0 2024-09-13T21:40:30.447 INFO:tasks.workunit.client.0.smithi088.stdout:2/922: write d1/d8/d2e/d91/d125/d3c/d4a/d6e/d76/d112/f130 [622405,90531] 0 2024-09-13T21:40:30.448 INFO:tasks.workunit.client.0.smithi088.stdout:0/960: rmdir d7/d1d/d21/d82/db8/de5 39 2024-09-13T21:40:30.451 INFO:tasks.workunit.client.0.smithi088.stdout:1/963: unlink d9/d10/d2a/d4b/d61/l6e 0 2024-09-13T21:40:30.453 INFO:tasks.workunit.client.0.smithi088.stdout:0/961: getdents d7/d2c/d30/dbe/d13c/d118/d34 0 2024-09-13T21:40:30.454 INFO:tasks.workunit.client.0.smithi088.stdout:9/827: dread d1a/d61/d3d/d41/f77 [0,4194304] 0 2024-09-13T21:40:30.458 INFO:tasks.workunit.client.0.smithi088.stdout:0/962: mknod d7/d1d/d21/d82/dca/c143 0 2024-09-13T21:40:30.465 INFO:tasks.workunit.client.0.smithi088.stdout:9/828: dread d1a/d3c/d51/d5e/f84 [0,4194304] 0 2024-09-13T21:40:30.465 INFO:tasks.workunit.client.0.smithi088.stdout:9/829: fsync d1a/f5d 0 2024-09-13T21:40:30.469 INFO:tasks.workunit.client.0.smithi088.stdout:9/830: rmdir d1a/d9e 39 2024-09-13T21:40:30.469 INFO:tasks.workunit.client.0.smithi088.stdout:0/963: write d7/d2c/f2e [6496140,26323] 0 2024-09-13T21:40:30.469 INFO:tasks.workunit.client.0.smithi088.stdout:9/831: creat d1a/d61/d3d/d41/d48/f105 x:0 0 0 2024-09-13T21:40:30.469 INFO:tasks.workunit.client.0.smithi088.stdout:0/964: getdents d7/d2c/d30/dbe/dce/de1 0 2024-09-13T21:40:30.477 INFO:tasks.workunit.client.0.smithi088.stdout:6/976: dwrite d0/db/f85 [0,4194304] 0 2024-09-13T21:40:30.477 INFO:tasks.workunit.client.0.smithi088.stdout:1/964: dwrite d9/dc/d52/dba/f9b [0,4194304] 0 2024-09-13T21:40:30.477 INFO:tasks.workunit.client.0.smithi088.stdout:1/965: chown d9/lf 16 1 2024-09-13T21:40:30.477 INFO:tasks.workunit.client.0.smithi088.stdout:9/832: dread d1a/d3c/d51/d5e/ddb/d97/f98 [0,4194304] 0 2024-09-13T21:40:30.479 INFO:tasks.workunit.client.0.smithi088.stdout:6/977: mkdir d0/d2c/d7a/d7c/d110/d12f/d71/d13a/d13d 0 2024-09-13T21:40:30.480 INFO:tasks.workunit.client.0.smithi088.stdout:9/833: symlink d1a/d61/de2/l106 0 2024-09-13T21:40:30.481 INFO:tasks.workunit.client.0.smithi088.stdout:9/834: write d1a/d3c/d51/d5e/d7e/d92/fd2 [881727,37102] 0 2024-09-13T21:40:30.481 INFO:tasks.workunit.client.0.smithi088.stdout:2/923: dwrite d1/d8/d16/d40/d7e/daa/f11f [0,4194304] 0 2024-09-13T21:40:30.481 INFO:tasks.workunit.client.0.smithi088.stdout:2/924: dread - d1/d8/d2e/d91/d125/d41/d82/f11e zero size 2024-09-13T21:40:30.489 INFO:tasks.workunit.client.0.smithi088.stdout:9/835: read d1a/d1b/f25 [4971610,46848] 0 2024-09-13T21:40:30.489 INFO:tasks.workunit.client.0.smithi088.stdout:9/836: write d1a/d61/d3d/f7d [54073,126716] 0 2024-09-13T21:40:30.491 INFO:tasks.workunit.client.0.smithi088.stdout:9/837: mknod d1a/d3c/d51/d5e/d7e/c107 0 2024-09-13T21:40:30.492 INFO:tasks.workunit.client.0.smithi088.stdout:1/966: dread d9/d10/d2a/d4b/d39/d43/f4d [0,4194304] 0 2024-09-13T21:40:30.492 INFO:tasks.workunit.client.0.smithi088.stdout:1/967: read - d9/d10/d2a/d4b/d3a/d104/d130/f140 zero size 2024-09-13T21:40:30.493 INFO:tasks.workunit.client.0.smithi088.stdout:0/965: dwrite d7/d2c/d30/d31/d42/d4b/f116 [0,4194304] 0 2024-09-13T21:40:30.495 INFO:tasks.workunit.client.0.smithi088.stdout:9/838: rename d1a/d1b/f25 to d1a/d3c/d60/ddc/f108 0 2024-09-13T21:40:30.495 INFO:tasks.workunit.client.0.smithi088.stdout:9/839: write d1a/d3c/d51/d5e/f7c [1302310,14207] 0 2024-09-13T21:40:30.495 INFO:tasks.workunit.client.0.smithi088.stdout:2/925: dwrite d1/d8/d2e/d91/f95 [0,4194304] 0 2024-09-13T21:40:30.497 INFO:tasks.workunit.client.0.smithi088.stdout:6/978: write d0/db/f85 [4751119,81110] 0 2024-09-13T21:40:30.498 INFO:tasks.workunit.client.0.smithi088.stdout:6/979: dread - d0/d1e/fbd zero size 2024-09-13T21:40:30.506 INFO:tasks.workunit.client.0.smithi088.stdout:2/926: link d1/d8/d16/f98 d1/d8/d2e/d91/d125/d41/f132 0 2024-09-13T21:40:30.506 INFO:tasks.workunit.client.0.smithi088.stdout:2/927: stat d1/d8/d24/l73 0 2024-09-13T21:40:30.507 INFO:tasks.workunit.client.0.smithi088.stdout:6/980: link d0/d2c/d7a/cd5 d0/d1e/d1f/d55/c13e 0 2024-09-13T21:40:30.509 INFO:tasks.workunit.client.0.smithi088.stdout:6/981: mkdir d0/d2c/d7a/daf/dc7/d135/ddb/d13f 0 2024-09-13T21:40:30.510 INFO:tasks.workunit.client.0.smithi088.stdout:9/840: dread d1a/d3c/d51/d5e/fb0 [0,4194304] 0 2024-09-13T21:40:30.511 INFO:tasks.workunit.client.0.smithi088.stdout:6/982: creat d0/d2c/d7a/d7c/f140 x:0 0 0 2024-09-13T21:40:30.511 INFO:tasks.workunit.client.0.smithi088.stdout:6/983: fsync d0/d1e/fa1 0 2024-09-13T21:40:30.511 INFO:tasks.workunit.client.0.smithi088.stdout:9/841: getdents d1a/d61/dc6 0 2024-09-13T21:40:30.512 INFO:tasks.workunit.client.0.smithi088.stdout:6/984: creat d0/d2c/d7a/daf/dc7/d135/ddb/d13f/f141 x:0 0 0 2024-09-13T21:40:30.512 INFO:tasks.workunit.client.0.smithi088.stdout:6/985: fdatasync d0/db/f12 0 2024-09-13T21:40:30.513 INFO:tasks.workunit.client.0.smithi088.stdout:1/968: dwrite d9/d10/d2a/d4b/d39/d43/dfb/f115 [0,4194304] 0 2024-09-13T21:40:30.513 INFO:tasks.workunit.client.0.smithi088.stdout:9/842: dread d1a/fb5 [0,4194304] 0 2024-09-13T21:40:30.514 INFO:tasks.workunit.client.0.smithi088.stdout:1/969: mkdir d9/d10/dff/d143/d149 0 2024-09-13T21:40:30.515 INFO:tasks.workunit.client.0.smithi088.stdout:9/843: symlink d1a/d3c/d51/d5e/l109 0 2024-09-13T21:40:30.515 INFO:tasks.workunit.client.0.smithi088.stdout:9/844: write d1a/d3c/d60/f79 [2500978,46390] 0 2024-09-13T21:40:30.517 INFO:tasks.workunit.client.0.smithi088.stdout:1/970: creat d9/d10/d2a/d4b/d3a/dcd/f14a x:0 0 0 2024-09-13T21:40:30.519 INFO:tasks.workunit.client.0.smithi088.stdout:9/845: rmdir d1a/d3c/d51/d5e/ddb/d97 39 2024-09-13T21:40:30.519 INFO:tasks.workunit.client.0.smithi088.stdout:9/846: creat d1a/d61/d3d/d75/f10a x:0 0 0 2024-09-13T21:40:30.521 INFO:tasks.workunit.client.0.smithi088.stdout:1/971: dread d9/dc/d52/dba/d7d/ff5 [0,4194304] 0 2024-09-13T21:40:30.521 INFO:tasks.workunit.client.0.smithi088.stdout:9/847: symlink d1a/d61/de2/l10b 0 2024-09-13T21:40:30.521 INFO:tasks.workunit.client.0.smithi088.stdout:9/848: stat d1a/d3c/d51/d5e/d7e/la9 0 2024-09-13T21:40:30.521 INFO:tasks.workunit.client.0.smithi088.stdout:9/849: fsync d1a/d61/d3d/d41/f77 0 2024-09-13T21:40:30.521 INFO:tasks.workunit.client.0.smithi088.stdout:9/850: getdents d1a/d3c/d51/ddd 0 2024-09-13T21:40:30.521 INFO:tasks.workunit.client.0.smithi088.stdout:9/851: dread - d1a/d3c/d60/ddc/df9/ffd zero size 2024-09-13T21:40:30.521 INFO:tasks.workunit.client.0.smithi088.stdout:9/852: write d1a/f82 [3312141,110681] 0 2024-09-13T21:40:30.522 INFO:tasks.workunit.client.0.smithi088.stdout:0/966: dwrite d7/d1d/d21/f4c [0,4194304] 0 2024-09-13T21:40:30.522 INFO:tasks.workunit.client.0.smithi088.stdout:0/967: read - d7/d2c/d30/dbe/d13c/d118/d34/fd2 zero size 2024-09-13T21:40:30.522 INFO:tasks.workunit.client.0.smithi088.stdout:1/972: rename d9/dc/d52/dba/f9b to d9/d10/d2a/d4b/d39/d43/dfb/d12b/d141/dad/f14b 0 2024-09-13T21:40:30.526 INFO:tasks.workunit.client.0.smithi088.stdout:0/968: creat d7/d102/f144 x:0 0 0 2024-09-13T21:40:30.526 INFO:tasks.workunit.client.0.smithi088.stdout:0/969: fsync d7/d1d/d21/d82/fc5 0 2024-09-13T21:40:30.526 INFO:tasks.workunit.client.0.smithi088.stdout:0/970: chown d7/d2c/d30/dbe/d13c/d118/dcd/d101/f142 20 1 2024-09-13T21:40:30.527 INFO:tasks.workunit.client.0.smithi088.stdout:1/973: symlink d9/d10/d2a/d47/d9c/l14c 0 2024-09-13T21:40:30.528 INFO:tasks.workunit.client.0.smithi088.stdout:1/974: truncate d9/d10/d2a/d4b/d39/d43/dfb/d12b/d141/dad/dbb/ff6 2897713 0 2024-09-13T21:40:30.530 INFO:tasks.workunit.client.0.smithi088.stdout:1/975: rmdir d9/d10/d2a/d4b/d61 39 2024-09-13T21:40:30.531 INFO:tasks.workunit.client.0.smithi088.stdout:1/976: write d9/d10/d2a/d4b/d3a/f134 [777039,32742] 0 2024-09-13T21:40:30.531 INFO:tasks.workunit.client.0.smithi088.stdout:6/986: dwrite d0/d2c/d7a/d7c/d110/d12f/f79 [0,4194304] 0 2024-09-13T21:40:30.534 INFO:tasks.workunit.client.0.smithi088.stdout:9/853: dread d1a/d3c/f5b [0,4194304] 0 2024-09-13T21:40:30.536 INFO:tasks.workunit.client.0.smithi088.stdout:9/854: mknod d1a/d1b/d3f/c10c 0 2024-09-13T21:40:30.536 INFO:tasks.workunit.client.0.smithi088.stdout:9/855: write d1a/d3c/d60/ddc/f108 [1413185,110330] 0 2024-09-13T21:40:30.540 INFO:tasks.workunit.client.0.smithi088.stdout:9/856: rmdir d1a/d3c 39 2024-09-13T21:40:30.541 INFO:tasks.workunit.client.0.smithi088.stdout:1/977: dread d9/d10/d2a/d4b/d39/d43/dfb/f115 [0,4194304] 0 2024-09-13T21:40:30.542 INFO:tasks.workunit.client.0.smithi088.stdout:9/857: symlink d1a/d3c/d85/l10d 0 2024-09-13T21:40:30.543 INFO:tasks.workunit.client.0.smithi088.stdout:1/978: mknod d9/d10/dff/d126/c14d 0 2024-09-13T21:40:30.544 INFO:tasks.workunit.client.0.smithi088.stdout:9/858: symlink d1a/d3c/d51/d5e/ddb/d8e/l10e 0 2024-09-13T21:40:30.545 INFO:tasks.workunit.client.0.smithi088.stdout:9/859: dread d1a/d61/d3d/d41/d48/f96 [0,4194304] 0 2024-09-13T21:40:30.552 INFO:tasks.workunit.client.0.smithi088.stdout:3/971: sync 2024-09-13T21:40:30.552 INFO:tasks.workunit.client.0.smithi088.stdout:7/822: sync 2024-09-13T21:40:30.552 INFO:tasks.workunit.client.0.smithi088.stdout:8/938: sync 2024-09-13T21:40:30.553 INFO:tasks.workunit.client.0.smithi088.stdout:4/989: sync 2024-09-13T21:40:30.553 INFO:tasks.workunit.client.0.smithi088.stdout:8/939: readlink db/d26/d2c/d85/lbe 0 2024-09-13T21:40:30.553 INFO:tasks.workunit.client.0.smithi088.stdout:8/940: chown db/df/da7/d88/da8/f104 458720 1 2024-09-13T21:40:30.553 INFO:tasks.workunit.client.0.smithi088.stdout:7/823: fdatasync d6/da/f38 0 2024-09-13T21:40:30.555 INFO:tasks.workunit.client.0.smithi088.stdout:7/824: mknod d6/d5f/d69/d4f/d6f/d70/d76/c116 0 2024-09-13T21:40:30.557 INFO:tasks.workunit.client.0.smithi088.stdout:4/990: rmdir d2/d5/d20/d60/de/d1e/d31 39 2024-09-13T21:40:30.557 INFO:tasks.workunit.client.0.smithi088.stdout:4/991: creat d2/d5/d20/d60/de/d1e/d23/d6f/d105/f149 x:0 0 0 2024-09-13T21:40:30.557 INFO:tasks.workunit.client.0.smithi088.stdout:6/987: dwrite d0/d2c/d32/fbe [0,4194304] 0 2024-09-13T21:40:30.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/860: dread d1a/d3c/f5a [0,4194304] 0 2024-09-13T21:40:30.557 INFO:tasks.workunit.client.0.smithi088.stdout:6/988: chown d0/d2c/d7a/d7c/d110/d12f/f68 637 1 2024-09-13T21:40:30.557 INFO:tasks.workunit.client.0.smithi088.stdout:0/971: dwrite d7/d2c/d30/d31/d42/f74 [0,4194304] 0 2024-09-13T21:40:30.561 INFO:tasks.workunit.client.0.smithi088.stdout:9/861: mkdir d1a/d61/d3d/d41/def/d10f 0 2024-09-13T21:40:30.561 INFO:tasks.workunit.client.0.smithi088.stdout:9/862: read d1a/d3c/d51/d5e/f84 [2612162,37264] 0 2024-09-13T21:40:30.563 INFO:tasks.workunit.client.0.smithi088.stdout:0/972: creat d7/d2c/d30/d31/f145 x:0 0 0 2024-09-13T21:40:30.563 INFO:tasks.workunit.client.0.smithi088.stdout:9/863: mknod d1a/d1b/db9/c110 0 2024-09-13T21:40:30.565 INFO:tasks.workunit.client.0.smithi088.stdout:0/973: truncate d7/d2c/d30/dbe/d13c/d118/d34/f38 1444310 0 2024-09-13T21:40:30.573 INFO:tasks.workunit.client.0.smithi088.stdout:8/941: dread db/d26/d2c/d85/f89 [4194304,4194304] 0 2024-09-13T21:40:30.573 INFO:tasks.workunit.client.0.smithi088.stdout:8/942: chown db/d26/d2c/fb1 17095358 1 2024-09-13T21:40:30.576 INFO:tasks.workunit.client.0.smithi088.stdout:8/943: symlink db/df/de0/d117/l134 0 2024-09-13T21:40:30.576 INFO:tasks.workunit.client.0.smithi088.stdout:8/944: fdatasync db/d26/f10e 0 2024-09-13T21:40:30.581 INFO:tasks.workunit.client.0.smithi088.stdout:1/979: dwrite d9/d10/d2a/d4b/d3a/f134 [0,4194304] 0 2024-09-13T21:40:30.581 INFO:tasks.workunit.client.0.smithi088.stdout:1/980: chown d9 2822177 1 2024-09-13T21:40:30.581 INFO:tasks.workunit.client.0.smithi088.stdout:1/981: write d9/d10/d2a/d4b/d39/d43/dfb/d12b/d141/fcc [380355,116061] 0 2024-09-13T21:40:30.583 INFO:tasks.workunit.client.0.smithi088.stdout:1/982: creat d9/d10/d9f/f14e x:0 0 0 2024-09-13T21:40:30.584 INFO:tasks.workunit.client.0.smithi088.stdout:1/983: truncate d9/f19 337688 0 2024-09-13T21:40:30.584 INFO:tasks.workunit.client.0.smithi088.stdout:1/984: dread - d9/d10/d9f/f13a zero size 2024-09-13T21:40:30.585 INFO:tasks.workunit.client.0.smithi088.stdout:1/985: symlink d9/dc/d74/l14f 0 2024-09-13T21:40:30.590 INFO:tasks.workunit.client.0.smithi088.stdout:6/989: dwrite d0/db/f2e [4194304,4194304] 0 2024-09-13T21:40:30.591 INFO:tasks.workunit.client.0.smithi088.stdout:4/992: dwrite d2/d5/d20/d60/ff2 [0,4194304] 0 2024-09-13T21:40:30.593 INFO:tasks.workunit.client.0.smithi088.stdout:8/945: dread db/d26/d2c/f5a [0,4194304] 0 2024-09-13T21:40:30.593 INFO:tasks.workunit.client.0.smithi088.stdout:8/946: creat db/df/de0/d117/f135 x:0 0 0 2024-09-13T21:40:30.593 INFO:tasks.workunit.client.0.smithi088.stdout:8/947: stat db/d26/d37 0 2024-09-13T21:40:30.595 INFO:tasks.workunit.client.0.smithi088.stdout:0/974: dwrite d7/d2c/fbd [0,4194304] 0 2024-09-13T21:40:30.595 INFO:tasks.workunit.client.0.smithi088.stdout:0/975: chown d7/d2c/l4d 479502610 1 2024-09-13T21:40:30.595 INFO:tasks.workunit.client.0.smithi088.stdout:0/976: chown d7/d2c/d30/dbe/dce/de1/ce7 2017 1 2024-09-13T21:40:30.600 INFO:tasks.workunit.client.0.smithi088.stdout:8/948: creat db/df/de0/f136 x:0 0 0 2024-09-13T21:40:30.602 INFO:tasks.workunit.client.0.smithi088.stdout:1/986: fsync d9/d10/d9f/f14e 0 2024-09-13T21:40:30.606 INFO:tasks.workunit.client.0.smithi088.stdout:0/977: mknod d7/d1d/d21/d82/db8/c146 0 2024-09-13T21:40:30.607 INFO:tasks.workunit.client.0.smithi088.stdout:6/990: rename d0/d2c/d7a/d7c/d110 to d0/d1e/d1f/d108/d142 0 2024-09-13T21:40:30.607 INFO:tasks.workunit.client.0.smithi088.stdout:6/991: read d0/db/f43 [1415846,128119] 0 2024-09-13T21:40:30.607 INFO:tasks.workunit.client.0.smithi088.stdout:6/992: write d0/d2c/d7f/db1/f126 [1016980,45734] 0 2024-09-13T21:40:30.608 INFO:tasks.workunit.client.0.smithi088.stdout:6/993: creat d0/d2c/d7a/dea/f143 x:0 0 0 2024-09-13T21:40:30.608 INFO:tasks.workunit.client.0.smithi088.stdout:1/987: symlink d9/dc/d52/dba/l150 0 2024-09-13T21:40:30.608 INFO:tasks.workunit.client.0.smithi088.stdout:1/988: write d9/d10/d2a/d4b/d39/d43/dfb/d12b/d141/dad/dbb/fc9 [4038587,29718] 0 2024-09-13T21:40:30.609 INFO:tasks.workunit.client.0.smithi088.stdout:1/989: chown d9/d10/d2a/d47/d9c/db5/f113 4033953 1 2024-09-13T21:40:30.609 INFO:tasks.workunit.client.0.smithi088.stdout:1/990: truncate d9/d10/d2a/d4b/d39/f11e 460829 0 2024-09-13T21:40:30.609 INFO:tasks.workunit.client.0.smithi088.stdout:4/993: dwrite d2/d13/f86 [0,4194304] 0 2024-09-13T21:40:30.609 INFO:tasks.workunit.client.0.smithi088.stdout:8/949: dread db/d26/d37/f46 [0,4194304] 0 2024-09-13T21:40:30.610 INFO:tasks.workunit.client.0.smithi088.stdout:6/994: mkdir d0/d1e/d1f/d108/d142/d144 0 2024-09-13T21:40:30.610 INFO:tasks.workunit.client.0.smithi088.stdout:6/995: chown d0/d2c/d7a/daf/dc7/d135/f10c 98784070 1 2024-09-13T21:40:30.611 INFO:tasks.workunit.client.0.smithi088.stdout:1/991: unlink c0 0 2024-09-13T21:40:30.612 INFO:tasks.workunit.client.0.smithi088.stdout:4/994: rmdir d2 39 2024-09-13T21:40:30.612 INFO:tasks.workunit.client.0.smithi088.stdout:8/950: rmdir db/d26/d2c 39 2024-09-13T21:40:30.615 INFO:tasks.workunit.client.0.smithi088.stdout:6/996: link d0/db/d37/c114 d0/d1e/d1f/d108/c145 0 2024-09-13T21:40:30.616 INFO:tasks.workunit.client.0.smithi088.stdout:8/951: mkdir db/df/da7/d88/ddd/d137 0 2024-09-13T21:40:30.616 INFO:tasks.workunit.client.0.smithi088.stdout:8/952: truncate db/df/da7/d88/da8/db4/df2/f111 342774 0 2024-09-13T21:40:30.619 INFO:tasks.workunit.client.0.smithi088.stdout:0/978: write d7/d2c/d30/d31/f6e [543576,49474] 0 2024-09-13T21:40:30.619 INFO:tasks.workunit.client.0.smithi088.stdout:0/979: creat d7/d2c/d30/dbe/d13c/d118/dcd/d101/f147 x:0 0 0 2024-09-13T21:40:30.619 INFO:tasks.workunit.client.0.smithi088.stdout:8/953: getdents db/d26/d2c 0 2024-09-13T21:40:30.631 INFO:tasks.workunit.client.0.smithi088.stdout:4/995: write d2/d5/d20/d60/de/f28 [11822212,45578] 0 2024-09-13T21:40:30.631 INFO:tasks.workunit.client.0.smithi088.stdout:4/996: chown d2/d5/d20/d60/de/d1e/d23/d3c/cd8 941333920 1 2024-09-13T21:40:30.631 INFO:tasks.workunit.client.0.smithi088.stdout:4/997: chown d2/d5/d2d 1732759 1 2024-09-13T21:40:30.631 INFO:tasks.workunit.client.0.smithi088.stdout:4/998: readlink d2/d5/d20/d60/de/d1e/lfd 0 2024-09-13T21:40:30.633 INFO:tasks.workunit.client.0.smithi088.stdout:4/999: rename d2/d5/d20/d41/d4b/f6a to d2/d5/d20/d60/de/d1e/d23/dca/f14a 0 2024-09-13T21:40:30.634 INFO:tasks.workunit.client.0.smithi088.stdout:0/980: write d7/d1d/d27/d43/fc6 [1659611,80849] 0 2024-09-13T21:40:30.636 INFO:tasks.workunit.client.0.smithi088.stdout:0/981: unlink d7/d2c/d30/dbe/dce/de1/ce3 0 2024-09-13T21:40:30.637 INFO:tasks.workunit.client.0.smithi088.stdout:0/982: fdatasync d7/d2c/d30/dbe/d13c/d118/d45/fac 0 2024-09-13T21:40:30.637 INFO:tasks.workunit.client.0.smithi088.stdout:0/983: rmdir d7/d2c/d30/dbe/d13c 39 2024-09-13T21:40:30.638 INFO:tasks.workunit.client.0.smithi088.stdout:0/984: unlink d7/d2c/d30/dbe/d13c/d118/d45/fac 0 2024-09-13T21:40:30.639 INFO:tasks.workunit.client.0.smithi088.stdout:0/985: rename d7/d65/f92 to d7/d1d/d3d/dae/dff/f148 0 2024-09-13T21:40:30.647 INFO:tasks.workunit.client.0.smithi088.stdout:8/954: dwrite db/df/da7/d88/db3/fed [0,4194304] 0 2024-09-13T21:40:30.648 INFO:tasks.workunit.client.0.smithi088.stdout:6/997: dwrite d0/d2c/d83/f109 [0,4194304] 0 2024-09-13T21:40:30.649 INFO:tasks.workunit.client.0.smithi088.stdout:8/955: write db/d26/f2b [8677374,58555] 0 2024-09-13T21:40:30.650 INFO:tasks.workunit.client.0.smithi088.stdout:1/992: dwrite d9/f60 [0,4194304] 0 2024-09-13T21:40:30.651 INFO:tasks.workunit.client.0.smithi088.stdout:8/956: symlink db/d26/d2c/db7/l138 0 2024-09-13T21:40:30.651 INFO:tasks.workunit.client.0.smithi088.stdout:8/957: fdatasync db/d26/d2c/db7/dbd/fc7 0 2024-09-13T21:40:30.651 INFO:tasks.workunit.client.0.smithi088.stdout:8/958: creat db/d26/d4f/f139 x:0 0 0 2024-09-13T21:40:30.651 INFO:tasks.workunit.client.0.smithi088.stdout:8/959: write db/df/fa3 [683385,9393] 0 2024-09-13T21:40:30.651 INFO:tasks.workunit.client.0.smithi088.stdout:6/998: rmdir d0/d28 39 2024-09-13T21:40:30.654 INFO:tasks.workunit.client.0.smithi088.stdout:2/928: sync 2024-09-13T21:40:30.662 INFO:tasks.workunit.client.0.smithi088.stdout:1/993: dread d9/fe3 [0,4194304] 0 2024-09-13T21:40:30.663 INFO:tasks.workunit.client.0.smithi088.stdout:8/960: unlink db/df/da7/d88/db3/cb5 0 2024-09-13T21:40:30.663 INFO:tasks.workunit.client.0.smithi088.stdout:8/961: chown db/df/da7/d88/db3/lf8 1085758171 1 2024-09-13T21:40:30.664 INFO:tasks.workunit.client.0.smithi088.stdout:6/999: truncate d0/d1e/d1f/d55/d8f/dc6/f11f 578074 0 2024-09-13T21:40:30.668 INFO:tasks.workunit.client.0.smithi088.stdout:8/962: mkdir db/df/de0/d117/d13a 0 2024-09-13T21:40:30.670 INFO:tasks.workunit.client.0.smithi088.stdout:2/929: dwrite d1/d8/d2e/d91/d125/d41/d48/f83 [0,4194304] 0 2024-09-13T21:40:30.672 INFO:tasks.workunit.client.0.smithi088.stdout:1/994: truncate d9/d10/d2a/d4b/d3a/f134 2472301 0 2024-09-13T21:40:30.674 INFO:tasks.workunit.client.0.smithi088.stdout:8/963: creat db/d26/d37/f13b x:0 0 0 2024-09-13T21:40:30.676 INFO:tasks.workunit.client.0.smithi088.stdout:1/995: dread d9/dc/f42 [0,4194304] 0 2024-09-13T21:40:30.677 INFO:tasks.workunit.client.0.smithi088.stdout:2/930: creat d1/d8/d2e/d91/d125/d41/d82/f133 x:0 0 0 2024-09-13T21:40:30.684 INFO:tasks.workunit.client.0.smithi088.stdout:1/996: rmdir d9/d10/d2a/d4b/d39/d43/d85 39 2024-09-13T21:40:30.685 INFO:tasks.workunit.client.0.smithi088.stdout:7/825: sync 2024-09-13T21:40:30.685 INFO:tasks.workunit.client.0.smithi088.stdout:9/864: sync 2024-09-13T21:40:30.685 INFO:tasks.workunit.client.0.smithi088.stdout:3/972: sync 2024-09-13T21:40:30.687 INFO:tasks.workunit.client.0.smithi088.stdout:1/997: mkdir d9/d10/dff/d126/d151 0 2024-09-13T21:40:30.687 INFO:tasks.workunit.client.0.smithi088.stdout:1/998: chown d9/d4f/d64/c142 61346151 1 2024-09-13T21:40:30.687 INFO:tasks.workunit.client.0.smithi088.stdout:1/999: creat d9/d10/d2a/d4b/d3a/dcd/f152 x:0 0 0 2024-09-13T21:40:30.688 INFO:tasks.workunit.client.0.smithi088.stdout:8/964: write db/d26/f45 [1903681,38422] 0 2024-09-13T21:40:30.688 INFO:tasks.workunit.client.0.smithi088.stdout:8/965: truncate db/df/de0/d117/f127 273283 0 2024-09-13T21:40:30.688 INFO:tasks.workunit.client.0.smithi088.stdout:7/826: readlink d6/da/lad 0 2024-09-13T21:40:30.688 INFO:tasks.workunit.client.0.smithi088.stdout:7/827: fsync d6/da/d44/f75 0 2024-09-13T21:40:30.688 INFO:tasks.workunit.client.0.smithi088.stdout:7/828: chown d6/da/d44 82027 1 2024-09-13T21:40:30.690 INFO:tasks.workunit.client.0.smithi088.stdout:3/973: write d5/d23/fc9 [252702,120975] 0 2024-09-13T21:40:30.691 INFO:tasks.workunit.client.0.smithi088.stdout:7/829: dread d6/d5f/da9/fb4 [0,4194304] 0 2024-09-13T21:40:30.692 INFO:tasks.workunit.client.0.smithi088.stdout:8/966: rename db/d26/d37/dd9/f108 to db/d26/d37/dd9/f13c 0 2024-09-13T21:40:30.696 INFO:tasks.workunit.client.0.smithi088.stdout:3/974: symlink d5/d23/d2a/d3f/d8f/l133 0 2024-09-13T21:40:30.698 INFO:tasks.workunit.client.0.smithi088.stdout:7/830: creat d6/d5f/d69/d4f/d6f/d83/f117 x:0 0 0 2024-09-13T21:40:30.698 INFO:tasks.workunit.client.0.smithi088.stdout:7/831: read d6/d5f/da9/ff3 [72047,108653] 0 2024-09-13T21:40:30.698 INFO:tasks.workunit.client.0.smithi088.stdout:7/832: truncate d6/d5f/d69/d4f/f10a 160646 0 2024-09-13T21:40:30.699 INFO:tasks.workunit.client.0.smithi088.stdout:0/986: dwrite d7/d2c/d30/dbe/d13c/d118/d34/f38 [0,4194304] 0 2024-09-13T21:40:30.699 INFO:tasks.workunit.client.0.smithi088.stdout:8/967: symlink db/d26/d2c/l13d 0 2024-09-13T21:40:30.700 INFO:tasks.workunit.client.0.smithi088.stdout:8/968: creat db/df/d61/f13e x:0 0 0 2024-09-13T21:40:30.700 INFO:tasks.workunit.client.0.smithi088.stdout:3/975: truncate d5/d14/f1a 3467754 0 2024-09-13T21:40:30.700 INFO:tasks.workunit.client.0.smithi088.stdout:3/976: getdents d5/d23/d2a/d3f/d76/db3/da5/d113 0 2024-09-13T21:40:30.705 INFO:tasks.workunit.client.0.smithi088.stdout:8/969: rename db/df/da7/d88/f122 to db/d26/f13f 0 2024-09-13T21:40:30.705 INFO:tasks.workunit.client.0.smithi088.stdout:3/977: rmdir d5/d5a/d7f/d10c/d12d/d98/da1 39 2024-09-13T21:40:30.706 INFO:tasks.workunit.client.0.smithi088.stdout:3/978: truncate d5/d23/d2a/d3f/db4/f100 4273964 0 2024-09-13T21:40:30.706 INFO:tasks.workunit.client.0.smithi088.stdout:0/987: getdents d7/d65/d8c 0 2024-09-13T21:40:30.707 INFO:tasks.workunit.client.0.smithi088.stdout:8/970: symlink db/d26/d2c/d85/d51/l140 0 2024-09-13T21:40:30.707 INFO:tasks.workunit.client.0.smithi088.stdout:2/931: dwrite d1/d8/d2e/d3b/f8b [0,4194304] 0 2024-09-13T21:40:30.708 INFO:tasks.workunit.client.0.smithi088.stdout:9/865: dwrite f17 [0,4194304] 0 2024-09-13T21:40:30.708 INFO:tasks.workunit.client.0.smithi088.stdout:3/979: rmdir d5/d23/d2a/d63/d48/d49 39 2024-09-13T21:40:30.710 INFO:tasks.workunit.client.0.smithi088.stdout:8/971: symlink db/df/da7/d88/d115/l141 0 2024-09-13T21:40:30.710 INFO:tasks.workunit.client.0.smithi088.stdout:8/972: getdents db/df/de0/d117/d13a 0 2024-09-13T21:40:30.713 INFO:tasks.workunit.client.0.smithi088.stdout:7/833: dread d6/d5f/d69/d4f/d6f/f92 [4194304,4194304] 0 2024-09-13T21:40:30.713 INFO:tasks.workunit.client.0.smithi088.stdout:7/834: read d6/d5f/d69/d4f/f41 [2434124,91470] 0 2024-09-13T21:40:30.716 INFO:tasks.workunit.client.0.smithi088.stdout:9/866: unlink d1a/d61/d3d/d41/d48/la8 0 2024-09-13T21:40:30.718 INFO:tasks.workunit.client.0.smithi088.stdout:0/988: unlink d7/d1d/d66/c11f 0 2024-09-13T21:40:30.718 INFO:tasks.workunit.client.0.smithi088.stdout:0/989: read d7/d1d/d27/d43/f17 [6965894,76209] 0 2024-09-13T21:40:30.720 INFO:tasks.workunit.client.0.smithi088.stdout:3/980: symlink d5/d23/d2a/l134 0 2024-09-13T21:40:30.720 INFO:tasks.workunit.client.0.smithi088.stdout:3/981: dread - d5/d5a/d7f/d10c/d12d/d98/da1/daa/d43/f12a zero size 2024-09-13T21:40:30.720 INFO:tasks.workunit.client.0.smithi088.stdout:8/973: symlink db/d26/d4f/l142 0 2024-09-13T21:40:30.724 INFO:tasks.workunit.client.0.smithi088.stdout:7/835: rename d6/da/d44/f75 to d6/d5f/d69/d4f/d6f/d70/ded/df4/f118 0 2024-09-13T21:40:30.724 INFO:tasks.workunit.client.0.smithi088.stdout:7/836: stat d6/da/dc8/ffe 0 2024-09-13T21:40:30.724 INFO:tasks.workunit.client.0.smithi088.stdout:7/837: fdatasync d6/d5f/d7a/f10c 0 2024-09-13T21:40:30.724 INFO:tasks.workunit.client.0.smithi088.stdout:2/932: dwrite d1/d8/d2e/d3b/fec [4194304,4194304] 0 2024-09-13T21:40:30.725 INFO:tasks.workunit.client.0.smithi088.stdout:9/867: link d1a/d61/d3d/f62 d1a/d3c/d51/d5e/d7e/f111 0 2024-09-13T21:40:30.726 INFO:tasks.workunit.client.0.smithi088.stdout:0/990: chown d7/d2c/d37/l97 39 1 2024-09-13T21:40:30.728 INFO:tasks.workunit.client.0.smithi088.stdout:8/974: fsync db/df/d61/f13e 0 2024-09-13T21:40:30.728 INFO:tasks.workunit.client.0.smithi088.stdout:8/975: read db/d26/d37/d7d/ff0 [295100,37289] 0 2024-09-13T21:40:30.730 INFO:tasks.workunit.client.0.smithi088.stdout:7/838: creat d6/d5f/d81/f119 x:0 0 0 2024-09-13T21:40:30.733 INFO:tasks.workunit.client.0.smithi088.stdout:2/933: symlink d1/d8/d2e/d91/dee/l134 0 2024-09-13T21:40:30.734 INFO:tasks.workunit.client.0.smithi088.stdout:9/868: rename d1a/d1b/f53 to d1a/d3c/d60/ddc/f112 0 2024-09-13T21:40:30.736 INFO:tasks.workunit.client.0.smithi088.stdout:2/934: mknod d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/d89/dcc/c135 0 2024-09-13T21:40:30.736 INFO:tasks.workunit.client.0.smithi088.stdout:2/935: write d1/d8/d24/d78/d7f/d85/f10f [1708366,9873] 0 2024-09-13T21:40:30.736 INFO:tasks.workunit.client.0.smithi088.stdout:9/869: read d1a/d3c/d60/ddc/ff4 [23527,112968] 0 2024-09-13T21:40:30.745 INFO:tasks.workunit.client.0.smithi088.stdout:7/839: dread d6/d5f/d69/d45/fcb [0,4194304] 0 2024-09-13T21:40:30.745 INFO:tasks.workunit.client.0.smithi088.stdout:7/840: chown d6/d5f/l7c 13973882 1 2024-09-13T21:40:30.748 INFO:tasks.workunit.client.0.smithi088.stdout:9/870: read d1a/d3c/d51/d5e/ddb/fa3 [2431938,32280] 0 2024-09-13T21:40:30.749 INFO:tasks.workunit.client.0.smithi088.stdout:3/982: dwrite d5/d23/d2a/f40 [0,4194304] 0 2024-09-13T21:40:30.749 INFO:tasks.workunit.client.0.smithi088.stdout:9/871: mkdir d1a/d3c/d51/d5e/d113 0 2024-09-13T21:40:30.750 INFO:tasks.workunit.client.0.smithi088.stdout:3/983: truncate d5/f21 5149058 0 2024-09-13T21:40:30.751 INFO:tasks.workunit.client.0.smithi088.stdout:9/872: creat d1a/d3c/d51/ddd/f114 x:0 0 0 2024-09-13T21:40:30.752 INFO:tasks.workunit.client.0.smithi088.stdout:3/984: mkdir d5/d5a/dcf/d135 0 2024-09-13T21:40:30.752 INFO:tasks.workunit.client.0.smithi088.stdout:3/985: fsync d5/d5a/d7f/d10c/d12d/d98/dcd/f120 0 2024-09-13T21:40:30.753 INFO:tasks.workunit.client.0.smithi088.stdout:9/873: rmdir d1a/d61/dc6 39 2024-09-13T21:40:30.761 INFO:tasks.workunit.client.0.smithi088.stdout:0/991: dwrite d7/d2c/d30/d31/d42/d95/fa3 [4194304,4194304] 0 2024-09-13T21:40:30.763 INFO:tasks.workunit.client.0.smithi088.stdout:0/992: unlink d7/d1d/d21/d82/fd7 0 2024-09-13T21:40:30.765 INFO:tasks.workunit.client.0.smithi088.stdout:8/976: dwrite db/d26/d2c/d85/f83 [0,4194304] 0 2024-09-13T21:40:30.768 INFO:tasks.workunit.client.0.smithi088.stdout:8/977: rename db/df/de0/d117/f12e to db/d26/d2c/d85/dad/f143 0 2024-09-13T21:40:30.770 INFO:tasks.workunit.client.0.smithi088.stdout:2/936: dwrite d1/f15 [0,4194304] 0 2024-09-13T21:40:30.771 INFO:tasks.workunit.client.0.smithi088.stdout:2/937: dread - d1/d8/d2e/d91/d125/d41/d82/f11e zero size 2024-09-13T21:40:30.771 INFO:tasks.workunit.client.0.smithi088.stdout:8/978: mkdir db/d26/d2c/db7/d144 0 2024-09-13T21:40:30.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/938: creat d1/d8/d2e/d91/dee/f136 x:0 0 0 2024-09-13T21:40:30.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/939: fdatasync d1/d8/d24/d78/d7f/d103/f126 0 2024-09-13T21:40:30.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/940: fdatasync d1/d8/d24/f4c 0 2024-09-13T21:40:30.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/941: write d1/d8/d2e/d91/d125/d3c/d4a/fa2 [2378510,59648] 0 2024-09-13T21:40:30.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/942: write d1/d8/d2e/d91/d125/d41/d82/f133 [480937,84514] 0 2024-09-13T21:40:30.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/943: write d1/f77 [579072,15247] 0 2024-09-13T21:40:30.772 INFO:tasks.workunit.client.0.smithi088.stdout:2/944: write d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dcd/f123 [869941,39571] 0 2024-09-13T21:40:30.772 INFO:tasks.workunit.client.0.smithi088.stdout:8/979: creat db/df/da7/d88/da8/db4/df2/d12b/f145 x:0 0 0 2024-09-13T21:40:30.775 INFO:tasks.workunit.client.0.smithi088.stdout:2/945: rename d1/d8/f1b to d1/d8/d2e/d91/d125/f137 0 2024-09-13T21:40:30.775 INFO:tasks.workunit.client.0.smithi088.stdout:2/946: readlink d1/d8/d2e/d91/d125/d41/d48/l129 0 2024-09-13T21:40:30.776 INFO:tasks.workunit.client.0.smithi088.stdout:8/980: creat db/d11a/f146 x:0 0 0 2024-09-13T21:40:30.776 INFO:tasks.workunit.client.0.smithi088.stdout:8/981: truncate db/df/d61/f63 4407728 0 2024-09-13T21:40:30.779 INFO:tasks.workunit.client.0.smithi088.stdout:3/986: dwrite d5/d5a/fd7 [0,4194304] 0 2024-09-13T21:40:30.779 INFO:tasks.workunit.client.0.smithi088.stdout:3/987: write d5/d23/f57 [3169250,90366] 0 2024-09-13T21:40:30.779 INFO:tasks.workunit.client.0.smithi088.stdout:9/874: dwrite d1a/d3c/d85/fe0 [0,4194304] 0 2024-09-13T21:40:30.783 INFO:tasks.workunit.client.0.smithi088.stdout:2/947: creat d1/d8/d2e/d91/d125/d41/d48/da0/d110/f138 x:0 0 0 2024-09-13T21:40:30.783 INFO:tasks.workunit.client.0.smithi088.stdout:0/993: dwrite d7/d65/dd4/fdb [0,4194304] 0 2024-09-13T21:40:30.784 INFO:tasks.workunit.client.0.smithi088.stdout:8/982: rmdir db/d26/d2c/db7 39 2024-09-13T21:40:30.786 INFO:tasks.workunit.client.0.smithi088.stdout:9/875: rmdir d1a/d3c/d51/d5e/d7e 39 2024-09-13T21:40:30.787 INFO:tasks.workunit.client.0.smithi088.stdout:0/994: getdents d7/d1d/d21/d82/dca 0 2024-09-13T21:40:30.789 INFO:tasks.workunit.client.0.smithi088.stdout:8/983: rename db/df/f1f to db/df/f147 0 2024-09-13T21:40:30.790 INFO:tasks.workunit.client.0.smithi088.stdout:9/876: mknod d1a/d9e/c115 0 2024-09-13T21:40:30.790 INFO:tasks.workunit.client.0.smithi088.stdout:3/988: write d5/d5a/d7f/d10c/f115 [3190124,129856] 0 2024-09-13T21:40:30.791 INFO:tasks.workunit.client.0.smithi088.stdout:8/984: creat db/d26/d4f/dd0/f148 x:0 0 0 2024-09-13T21:40:30.792 INFO:tasks.workunit.client.0.smithi088.stdout:9/877: mkdir d1a/d61/d3d/d41/def/d116 0 2024-09-13T21:40:30.794 INFO:tasks.workunit.client.0.smithi088.stdout:3/989: creat d5/d23/d2a/d63/d48/f136 x:0 0 0 2024-09-13T21:40:30.794 INFO:tasks.workunit.client.0.smithi088.stdout:3/990: write d5/d23/d2a/d3f/d76/db3/fa4 [354089,119322] 0 2024-09-13T21:40:30.795 INFO:tasks.workunit.client.0.smithi088.stdout:8/985: mkdir db/d26/d2c/d85/dad/d149 0 2024-09-13T21:40:30.796 INFO:tasks.workunit.client.0.smithi088.stdout:3/991: link d5/d5a/l72 d5/d5a/d7f/d10c/d12d/d98/l137 0 2024-09-13T21:40:30.806 INFO:tasks.workunit.client.0.smithi088.stdout:8/986: read db/d26/d2c/fb1 [3656217,122195] 0 2024-09-13T21:40:30.808 INFO:tasks.workunit.client.0.smithi088.stdout:8/987: mknod db/d26/d37/c14a 0 2024-09-13T21:40:30.823 INFO:tasks.workunit.client.0.smithi088.stdout:2/948: dwrite d1/d8/d2e/d91/fae [0,4194304] 0 2024-09-13T21:40:30.823 INFO:tasks.workunit.client.0.smithi088.stdout:2/949: stat d1/d8/d2e/d3b/dff/d3f/d99 0 2024-09-13T21:40:30.825 INFO:tasks.workunit.client.0.smithi088.stdout:0/995: dwrite d7/d2c/d30/dbe/d13c/dc0/fea [0,4194304] 0 2024-09-13T21:40:30.825 INFO:tasks.workunit.client.0.smithi088.stdout:9/878: dwrite d1a/d3c/d51/ddd/f114 [0,4194304] 0 2024-09-13T21:40:30.826 INFO:tasks.workunit.client.0.smithi088.stdout:2/950: symlink d1/d8/d2e/d91/db3/dd9/l139 0 2024-09-13T21:40:30.831 INFO:tasks.workunit.client.0.smithi088.stdout:3/992: dread d5/d5a/d7f/d10c/d12d/d98/ddc/f7b [0,4194304] 0 2024-09-13T21:40:30.839 INFO:tasks.workunit.client.0.smithi088.stdout:0/996: write d7/d2c/fbd [3932356,87498] 0 2024-09-13T21:40:30.839 INFO:tasks.workunit.client.0.smithi088.stdout:0/997: fdatasync d7/d2c/d30/dbe/dce/ff2 0 2024-09-13T21:40:30.839 INFO:tasks.workunit.client.0.smithi088.stdout:0/998: stat d7/d65/fd3 0 2024-09-13T21:40:30.839 INFO:tasks.workunit.client.0.smithi088.stdout:0/999: chown d7/d2c/d30/d31 61635 1 2024-09-13T21:40:30.847 INFO:tasks.workunit.client.0.smithi088.stdout:9/879: dwrite d1a/f3b [0,4194304] 0 2024-09-13T21:40:30.848 INFO:tasks.workunit.client.0.smithi088.stdout:3/993: dwrite d5/d14/ff5 [0,4194304] 0 2024-09-13T21:40:30.849 INFO:tasks.workunit.client.0.smithi088.stdout:9/880: truncate d1a/d1b/f37 1660414 0 2024-09-13T21:40:30.852 INFO:tasks.workunit.client.0.smithi088.stdout:3/994: link d5/d23/d2a/d63/d31/f102 d5/f138 0 2024-09-13T21:40:30.854 INFO:tasks.workunit.client.0.smithi088.stdout:3/995: mkdir d5/d23/d2a/d3f/d8f/da3/d139 0 2024-09-13T21:40:30.855 INFO:tasks.workunit.client.0.smithi088.stdout:3/996: mknod d5/d23/d2a/d63/d31/c13a 0 2024-09-13T21:40:30.855 INFO:tasks.workunit.client.0.smithi088.stdout:3/997: write d5/d23/d2a/d63/d31/f7e [941393,81060] 0 2024-09-13T21:40:30.857 INFO:tasks.workunit.client.0.smithi088.stdout:3/998: link d5/d5a/d7f/d10c/d12d/f89 d5/d23/d2a/d3f/d76/db3/da9/f13b 0 2024-09-13T21:40:30.858 INFO:tasks.workunit.client.0.smithi088.stdout:3/999: mkdir d5/d23/d2a/d3f/dd0/d13c 0 2024-09-13T21:40:30.863 INFO:tasks.workunit.client.0.smithi088.stdout:9/881: dwrite d1a/d1b/d3f/f55 [0,4194304] 0 2024-09-13T21:40:30.867 INFO:tasks.workunit.client.0.smithi088.stdout:9/882: creat d1a/d1b/db9/dc8/f117 x:0 0 0 2024-09-13T21:40:30.868 INFO:tasks.workunit.client.0.smithi088.stdout:9/883: stat d1a/d1b/f37 0 2024-09-13T21:40:30.868 INFO:tasks.workunit.client.0.smithi088.stdout:9/884: readlink d1a/d3c/d51/d5e/d7e/la9 0 2024-09-13T21:40:30.868 INFO:tasks.workunit.client.0.smithi088.stdout:9/885: chown d1a/d61/d3d/d41/f77 13935085 1 2024-09-13T21:40:30.868 INFO:tasks.workunit.client.0.smithi088.stdout:9/886: truncate d1a/d9e/fd4 4937510 0 2024-09-13T21:40:30.869 INFO:tasks.workunit.client.0.smithi088.stdout:9/887: creat d1a/d9e/f118 x:0 0 0 2024-09-13T21:40:30.869 INFO:tasks.workunit.client.0.smithi088.stdout:9/888: read d1a/d61/d3d/d41/d48/f68 [490091,104861] 0 2024-09-13T21:40:30.884 INFO:tasks.workunit.client.0.smithi088.stdout:7/841: sync 2024-09-13T21:40:30.884 INFO:tasks.workunit.client.0.smithi088.stdout:7/842: write d6/d5f/da9/ff3 [684134,79060] 0 2024-09-13T21:40:30.885 INFO:tasks.workunit.client.0.smithi088.stdout:7/843: creat d6/d5f/d69/d4f/d6f/d70/d76/dbd/deb/f11a x:0 0 0 2024-09-13T21:40:30.886 INFO:tasks.workunit.client.0.smithi088.stdout:7/844: rename d6/d5f/d69/c67 to d6/d5f/d69/d4f/d6f/d70/ded/d106/c11b 0 2024-09-13T21:40:30.887 INFO:tasks.workunit.client.0.smithi088.stdout:7/845: symlink d6/d5f/d69/d4f/d6f/d70/ded/df4/l11c 0 2024-09-13T21:40:30.889 INFO:tasks.workunit.client.0.smithi088.stdout:7/846: rename d6/da/f19 to d6/f11d 0 2024-09-13T21:40:30.890 INFO:tasks.workunit.client.0.smithi088.stdout:7/847: creat d6/da/dfc/f11e x:0 0 0 2024-09-13T21:40:30.903 INFO:tasks.workunit.client.0.smithi088.stdout:7/848: dwrite d6/d5f/d69/d4f/f10a [0,4194304] 0 2024-09-13T21:40:30.903 INFO:tasks.workunit.client.0.smithi088.stdout:7/849: write d6/d4e/f7b [1213101,118991] 0 2024-09-13T21:40:30.903 INFO:tasks.workunit.client.0.smithi088.stdout:7/850: fdatasync d6/da/d1a/d3a/f3f 0 2024-09-13T21:40:30.903 INFO:tasks.workunit.client.0.smithi088.stdout:7/851: chown f1 747501 1 2024-09-13T21:40:30.905 INFO:tasks.workunit.client.0.smithi088.stdout:7/852: symlink d6/d5f/d69/d4f/d6f/d70/dbf/l11f 0 2024-09-13T21:40:30.906 INFO:tasks.workunit.client.0.smithi088.stdout:7/853: creat d6/d5f/d69/f120 x:0 0 0 2024-09-13T21:40:30.907 INFO:tasks.workunit.client.0.smithi088.stdout:7/854: creat d6/da/d44/da7/f121 x:0 0 0 2024-09-13T21:40:30.907 INFO:tasks.workunit.client.0.smithi088.stdout:7/855: getdents d6/da/dfc/d104 0 2024-09-13T21:40:30.915 INFO:tasks.workunit.client.0.smithi088.stdout:7/856: write d6/da/d1a/f24 [2016809,82614] 0 2024-09-13T21:40:31.001 INFO:tasks.workunit.client.0.smithi088.stdout:8/988: sync 2024-09-13T21:40:31.001 INFO:tasks.workunit.client.0.smithi088.stdout:8/989: chown db/d26/d2c/d85 0 1 2024-09-13T21:40:31.002 INFO:tasks.workunit.client.0.smithi088.stdout:8/990: mkdir db/df/da7/d88/da8/db4/df2/d14b 0 2024-09-13T21:40:31.002 INFO:tasks.workunit.client.0.smithi088.stdout:8/991: creat db/df/d61/d97/d116/f14c x:0 0 0 2024-09-13T21:40:31.002 INFO:tasks.workunit.client.0.smithi088.stdout:8/992: read db/df/da7/f28 [1258001,72720] 0 2024-09-13T21:40:31.005 INFO:tasks.workunit.client.0.smithi088.stdout:8/993: dread db/df/d61/f118 [0,4194304] 0 2024-09-13T21:40:31.006 INFO:tasks.workunit.client.0.smithi088.stdout:8/994: rename db/df/d61/c9c to db/df/da7/d88/c14d 0 2024-09-13T21:40:31.006 INFO:tasks.workunit.client.0.smithi088.stdout:8/995: chown db 2 1 2024-09-13T21:40:31.007 INFO:tasks.workunit.client.0.smithi088.stdout:8/996: truncate db/d26/d37/f46 617774 0 2024-09-13T21:40:31.008 INFO:tasks.workunit.client.0.smithi088.stdout:8/997: mkdir db/df/d120/d14e 0 2024-09-13T21:40:31.008 INFO:tasks.workunit.client.0.smithi088.stdout:8/998: write db/d11a/f146 [509990,80303] 0 2024-09-13T21:40:31.009 INFO:tasks.workunit.client.0.smithi088.stdout:8/999: mkdir db/d11a/d14f 0 2024-09-13T21:40:31.039 INFO:tasks.workunit.client.0.smithi088.stdout:2/951: sync 2024-09-13T21:40:31.039 INFO:tasks.workunit.client.0.smithi088.stdout:2/952: truncate d1/d8/d16/f7c 4568799 0 2024-09-13T21:40:31.040 INFO:tasks.workunit.client.0.smithi088.stdout:2/953: mkdir d1/d8/d24/d78/d7f/d103/d13a 0 2024-09-13T21:40:31.047 INFO:tasks.workunit.client.0.smithi088.stdout:2/954: dread d1/d8/d24/d78/d7f/fac [0,4194304] 0 2024-09-13T21:40:31.048 INFO:tasks.workunit.client.0.smithi088.stdout:2/955: symlink d1/d8/d2e/d44/l13b 0 2024-09-13T21:40:31.049 INFO:tasks.workunit.client.0.smithi088.stdout:2/956: mknod d1/c13c 0 2024-09-13T21:40:31.049 INFO:tasks.workunit.client.0.smithi088.stdout:2/957: chown d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/dc3/c128 4 1 2024-09-13T21:40:31.049 INFO:tasks.workunit.client.0.smithi088.stdout:2/958: mkdir d1/d8/d2e/d91/d125/d13d 0 2024-09-13T21:40:31.051 INFO:tasks.workunit.client.0.smithi088.stdout:2/959: dread d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/f100 [0,4194304] 0 2024-09-13T21:40:31.051 INFO:tasks.workunit.client.0.smithi088.stdout:2/960: write d1/d8/d16/d40/d7e/daa/f114 [3771738,43510] 0 2024-09-13T21:40:31.053 INFO:tasks.workunit.client.0.smithi088.stdout:2/961: link d1/d8/d2e/d91/d125/d3c/d4a/d6e/d66/f11c d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/f13e 0 2024-09-13T21:40:31.053 INFO:tasks.workunit.client.0.smithi088.stdout:2/962: chown d1/d8/d16/f37 322 1 2024-09-13T21:40:31.059 INFO:tasks.workunit.client.0.smithi088.stdout:2/963: write d1/d8/d2e/d91/d125/d41/d48/da0/fe1 [37969,6991] 0 2024-09-13T21:40:31.061 INFO:tasks.workunit.client.0.smithi088.stdout:2/964: link d1/d8/d24/f4c d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/d89/f13f 0 2024-09-13T21:40:31.064 INFO:tasks.workunit.client.0.smithi088.stdout:2/965: dread d1/d8/f57 [0,4194304] 0 2024-09-13T21:40:31.065 INFO:tasks.workunit.client.0.smithi088.stdout:2/966: truncate d1/d8/ff1 1471800 0 2024-09-13T21:40:31.075 INFO:tasks.workunit.client.0.smithi088.stdout:2/967: write d1/f68 [2111807,75324] 0 2024-09-13T21:40:31.076 INFO:tasks.workunit.client.0.smithi088.stdout:2/968: mkdir d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/dc3/d140 0 2024-09-13T21:40:31.077 INFO:tasks.workunit.client.0.smithi088.stdout:9/889: sync 2024-09-13T21:40:31.077 INFO:tasks.workunit.client.0.smithi088.stdout:7/857: sync 2024-09-13T21:40:31.077 INFO:tasks.workunit.client.0.smithi088.stdout:9/890: write f13 [525593,52150] 0 2024-09-13T21:40:31.082 INFO:tasks.workunit.client.0.smithi088.stdout:7/858: write d6/f22 [7415411,49844] 0 2024-09-13T21:40:31.083 INFO:tasks.workunit.client.0.smithi088.stdout:7/859: mknod d6/d5f/d69/d4f/c122 0 2024-09-13T21:40:31.086 INFO:tasks.workunit.client.0.smithi088.stdout:9/891: dread d1a/d3c/fcf [0,4194304] 0 2024-09-13T21:40:31.087 INFO:tasks.workunit.client.0.smithi088.stdout:9/892: symlink d1a/d3c/d60/dbb/l119 0 2024-09-13T21:40:31.089 INFO:tasks.workunit.client.0.smithi088.stdout:9/893: unlink d1a/d1b/dd5/le1 0 2024-09-13T21:40:31.098 INFO:tasks.workunit.client.0.smithi088.stdout:2/969: dwrite d1/d8/d2e/d91/f95 [0,4194304] 0 2024-09-13T21:40:31.099 INFO:tasks.workunit.client.0.smithi088.stdout:7/860: dwrite d6/d5f/d69/d45/fcc [0,4194304] 0 2024-09-13T21:40:31.101 INFO:tasks.workunit.client.0.smithi088.stdout:9/894: write d1a/f3b [3910296,58939] 0 2024-09-13T21:40:31.101 INFO:tasks.workunit.client.0.smithi088.stdout:2/970: rename d1/d8/d24/d78/d7f/c8e to d1/d8/d24/d78/d7f/d103/d13a/c141 0 2024-09-13T21:40:31.103 INFO:tasks.workunit.client.0.smithi088.stdout:7/861: rmdir d6/d5f/d69/d4f/d6f/d70 39 2024-09-13T21:40:31.106 INFO:tasks.workunit.client.0.smithi088.stdout:9/895: truncate d1a/d3c/f94 1214372 0 2024-09-13T21:40:31.106 INFO:tasks.workunit.client.0.smithi088.stdout:9/896: dread - d1a/fab zero size 2024-09-13T21:40:31.106 INFO:tasks.workunit.client.0.smithi088.stdout:9/897: chown d1a/d3c/d51/d5e/ddb/d8e/lf2 1574623768 1 2024-09-13T21:40:31.106 INFO:tasks.workunit.client.0.smithi088.stdout:9/898: truncate d1a/d61/d3d/d41/f77 1387312 0 2024-09-13T21:40:31.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/971: symlink d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/l142 0 2024-09-13T21:40:31.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/972: read d1/d8/f12 [4655086,16131] 0 2024-09-13T21:40:31.107 INFO:tasks.workunit.client.0.smithi088.stdout:2/973: chown d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dd8/l107 24 1 2024-09-13T21:40:31.108 INFO:tasks.workunit.client.0.smithi088.stdout:7/862: link f1 d6/d5f/d69/d4f/d6f/d70/d76/d109/f123 0 2024-09-13T21:40:31.110 INFO:tasks.workunit.client.0.smithi088.stdout:9/899: mknod d1a/d61/dc6/c11a 0 2024-09-13T21:40:31.111 INFO:tasks.workunit.client.0.smithi088.stdout:7/863: write d6/da/fea [105569,3114] 0 2024-09-13T21:40:31.111 INFO:tasks.workunit.client.0.smithi088.stdout:2/974: unlink d1/l2 0 2024-09-13T21:40:31.113 INFO:tasks.workunit.client.0.smithi088.stdout:9/900: unlink d1a/d61/d3d/cff 0 2024-09-13T21:40:31.115 INFO:tasks.workunit.client.0.smithi088.stdout:2/975: symlink d1/d8/d16/d40/d7e/daa/l143 0 2024-09-13T21:40:31.116 INFO:tasks.workunit.client.0.smithi088.stdout:2/976: readlink d1/d8/d2e/l27 0 2024-09-13T21:40:31.116 INFO:tasks.workunit.client.0.smithi088.stdout:2/977: read - d1/d8/d2e/d3b/dff/d3f/ffd zero size 2024-09-13T21:40:31.119 INFO:tasks.workunit.client.0.smithi088.stdout:2/978: link d1/d8/d2e/d91/d125/d41/l42 d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/l144 0 2024-09-13T21:40:31.122 INFO:tasks.workunit.client.0.smithi088.stdout:7/864: dread d6/d5f/f7d [0,4194304] 0 2024-09-13T21:40:31.122 INFO:tasks.workunit.client.0.smithi088.stdout:7/865: read - d6/d4e/d111/f101 zero size 2024-09-13T21:40:31.131 INFO:tasks.workunit.client.0.smithi088.stdout:9/901: dwrite d1a/d3c/d51/d5e/d7e/f111 [4194304,4194304] 0 2024-09-13T21:40:31.131 INFO:tasks.workunit.client.0.smithi088.stdout:2/979: dread d1/d8/d24/f8a [0,4194304] 0 2024-09-13T21:40:31.131 INFO:tasks.workunit.client.0.smithi088.stdout:2/980: chown d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/d89/f13f 3934 1 2024-09-13T21:40:31.156 INFO:tasks.workunit.client.0.smithi088.stdout:9/902: dwrite d1a/d1b/d3f/f64 [0,4194304] 0 2024-09-13T21:40:31.157 INFO:tasks.workunit.client.0.smithi088.stdout:9/903: write d1a/d3c/fed [4477400,4733] 0 2024-09-13T21:40:31.157 INFO:tasks.workunit.client.0.smithi088.stdout:2/981: dwrite d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/dc3/f120 [0,4194304] 0 2024-09-13T21:40:31.161 INFO:tasks.workunit.client.0.smithi088.stdout:2/982: rename d1/d8/d16/d40/d7e to d1/d8/d2e/d91/d125/d13d/d145 0 2024-09-13T21:40:31.182 INFO:tasks.workunit.client.0.smithi088.stdout:2/983: dwrite d1/d8/f7d [0,4194304] 0 2024-09-13T21:40:31.195 INFO:tasks.workunit.client.0.smithi088.stdout:2/984: dwrite d1/d8/d2e/d91/d125/d3c/d4a/d6e/f113 [0,4194304] 0 2024-09-13T21:40:31.212 INFO:tasks.workunit.client.0.smithi088.stdout:2/985: dwrite d1/d8/d24/f8a [0,4194304] 0 2024-09-13T21:40:31.213 INFO:tasks.workunit.client.0.smithi088.stdout:2/986: mkdir d1/d8/d2e/d91/d146 0 2024-09-13T21:40:31.214 INFO:tasks.workunit.client.0.smithi088.stdout:2/987: stat d1/d8/d2e/d91/d125/d3c/d4a/d6e/c7b 0 2024-09-13T21:40:31.214 INFO:tasks.workunit.client.0.smithi088.stdout:2/988: fdatasync d1/d8/ff1 0 2024-09-13T21:40:31.215 INFO:tasks.workunit.client.0.smithi088.stdout:2/989: creat d1/d8/d2e/d91/db3/d12c/f147 x:0 0 0 2024-09-13T21:40:31.216 INFO:tasks.workunit.client.0.smithi088.stdout:2/990: creat d1/d8/d2e/d91/d125/d3c/d4a/d6e/d5b/dc3/d140/f148 x:0 0 0 2024-09-13T21:40:31.216 INFO:tasks.workunit.client.0.smithi088.stdout:2/991: fdatasync d1/d8/d2e/d91/d125/d41/d48/da0/d110/f12e 0 2024-09-13T21:40:31.217 INFO:tasks.workunit.client.0.smithi088.stdout:7/866: sync 2024-09-13T21:40:31.217 INFO:tasks.workunit.client.0.smithi088.stdout:9/904: sync 2024-09-13T21:40:31.217 INFO:tasks.workunit.client.0.smithi088.stdout:7/867: fdatasync d6/d5f/d69/d4f/fc6 0 2024-09-13T21:40:31.217 INFO:tasks.workunit.client.0.smithi088.stdout:9/905: write d1a/d3c/d85/f103 [929146,46381] 0 2024-09-13T21:40:31.218 INFO:tasks.workunit.client.0.smithi088.stdout:2/992: creat d1/d8/d2e/d3b/dff/d3f/d99/d9c/db1/dcd/f149 x:0 0 0 2024-09-13T21:40:31.219 INFO:tasks.workunit.client.0.smithi088.stdout:2/993: rmdir d1/d8/d24/d78/d7f/d103 39 2024-09-13T21:40:31.220 INFO:tasks.workunit.client.0.smithi088.stdout:2/994: truncate d1/d8/d2e/d3b/f8b 2621656 0 2024-09-13T21:40:31.221 INFO:tasks.workunit.client.0.smithi088.stdout:2/995: mknod d1/d8/d2e/d91/d125/d3c/d4a/d6e/c14a 0 2024-09-13T21:40:31.221 INFO:tasks.workunit.client.0.smithi088.stdout:2/996: chown d1/d8/d2e/d91/d125/d41/d48/da0/d110/f138 289456441 1 2024-09-13T21:40:31.221 INFO:tasks.workunit.client.0.smithi088.stdout:2/997: chown d1/d8/d24/d78/d7f/d85 3029359 1 2024-09-13T21:40:31.222 INFO:tasks.workunit.client.0.smithi088.stdout:9/906: dread d1a/d3c/d85/f103 [0,4194304] 0 2024-09-13T21:40:31.222 INFO:tasks.workunit.client.0.smithi088.stdout:9/907: write d1a/fab [677233,25531] 0 2024-09-13T21:40:31.223 INFO:tasks.workunit.client.0.smithi088.stdout:9/908: getdents d1a/d3c/d51/d5e/ddb/d8e 0 2024-09-13T21:40:31.225 INFO:tasks.workunit.client.0.smithi088.stdout:7/868: dread d6/d5f/d69/d4f/fae [0,4194304] 0 2024-09-13T21:40:31.225 INFO:tasks.workunit.client.0.smithi088.stdout:9/909: creat d1a/d3c/d51/d5e/ddb/d97/f11b x:0 0 0 2024-09-13T21:40:31.234 INFO:tasks.workunit.client.0.smithi088.stdout:2/998: dread d1/d8/d2e/f53 [0,4194304] 0 2024-09-13T21:40:31.236 INFO:tasks.workunit.client.0.smithi088.stdout:2/999: creat d1/d8/d2e/d91/d146/f14b x:0 0 0 2024-09-13T21:40:31.236 INFO:tasks.workunit.client.0.smithi088.stdout:9/910: write d1a/d3c/d51/d5e/fb0 [470953,76794] 0 2024-09-13T21:40:31.238 INFO:tasks.workunit.client.0.smithi088.stdout:9/911: link d1a/d9e/ca4 d1a/d3c/d60/ddc/c11c 0 2024-09-13T21:40:31.238 INFO:tasks.workunit.client.0.smithi088.stdout:9/912: chown d1a/d1b/db9/ffb 225 1 2024-09-13T21:40:31.245 INFO:tasks.workunit.client.0.smithi088.stdout:7/869: dwrite d6/d5f/d69/f6e [0,4194304] 0 2024-09-13T21:40:31.245 INFO:tasks.workunit.client.0.smithi088.stdout:7/870: write d6/da/d44/fbe [4866390,51756] 0 2024-09-13T21:40:31.245 INFO:tasks.workunit.client.0.smithi088.stdout:7/871: read d6/f22 [6722929,120503] 0 2024-09-13T21:40:31.245 INFO:tasks.workunit.client.0.smithi088.stdout:7/872: truncate d6/d5f/d7a/f8e 5520774 0 2024-09-13T21:40:31.245 INFO:tasks.workunit.client.0.smithi088.stdout:7/873: readlink d6/l11 0 2024-09-13T21:40:31.249 INFO:tasks.workunit.client.0.smithi088.stdout:7/874: creat d6/d5f/d69/d4f/d6f/d70/ded/df4/f124 x:0 0 0 2024-09-13T21:40:31.252 INFO:tasks.workunit.client.0.smithi088.stdout:7/875: write d6/da/d1a/f89 [2315344,44459] 0 2024-09-13T21:40:31.253 INFO:tasks.workunit.client.0.smithi088.stdout:7/876: creat d6/d5f/d69/da8/dd3/f125 x:0 0 0 2024-09-13T21:40:31.260 INFO:tasks.workunit.client.0.smithi088.stdout:7/877: dread d6/d5f/d69/def/ffd [0,4194304] 0 2024-09-13T21:40:31.268 INFO:tasks.workunit.client.0.smithi088.stdout:7/878: dread d6/d5f/d69/d4f/d6f/db2/f114 [0,4194304] 0 2024-09-13T21:40:31.283 INFO:tasks.workunit.client.0.smithi088.stdout:7/879: dwrite d6/da/d1a/d3a/d5c/fc9 [0,4194304] 0 2024-09-13T21:40:31.283 INFO:tasks.workunit.client.0.smithi088.stdout:7/880: write d6/d5f/d81/fe5 [1026885,105755] 0 2024-09-13T21:40:31.317 INFO:tasks.workunit.client.0.smithi088.stdout:7/881: dwrite d6/d5f/d69/d4f/d6f/d70/dbf/fdb [0,4194304] 0 2024-09-13T21:40:31.339 INFO:tasks.workunit.client.0.smithi088.stdout:9/913: sync 2024-09-13T21:40:31.339 INFO:tasks.workunit.client.0.smithi088.stdout:9/914: truncate d1a/d61/d3d/d75/f10a 864562 0 2024-09-13T21:40:31.355 INFO:tasks.workunit.client.0.smithi088.stdout:9/915: dwrite fb [0,4194304] 0 2024-09-13T21:40:31.357 INFO:tasks.workunit.client.0.smithi088.stdout:9/916: mknod d1a/d3c/d60/ddc/df9/c11d 0 2024-09-13T21:40:31.358 INFO:tasks.workunit.client.0.smithi088.stdout:9/917: unlink d1a/d1b/f22 0 2024-09-13T21:40:31.359 INFO:tasks.workunit.client.0.smithi088.stdout:9/918: dread d1a/f5d [0,4194304] 0 2024-09-13T21:40:31.359 INFO:tasks.workunit.client.0.smithi088.stdout:9/919: readlink d1a/d9e/lcc 0 2024-09-13T21:40:31.359 INFO:tasks.workunit.client.0.smithi088.stdout:9/920: write d1a/fe3 [1766198,100952] 0 2024-09-13T21:40:31.372 INFO:tasks.workunit.client.0.smithi088.stdout:9/921: dwrite d1a/d3c/d85/fe0 [4194304,4194304] 0 2024-09-13T21:40:31.374 INFO:tasks.workunit.client.0.smithi088.stdout:9/922: creat d1a/d1b/dd5/f11e x:0 0 0 2024-09-13T21:40:31.374 INFO:tasks.workunit.client.0.smithi088.stdout:9/923: dread - d1a/d1b/db9/dc8/f117 zero size 2024-09-13T21:40:31.383 INFO:tasks.workunit.client.0.smithi088.stdout:7/882: sync 2024-09-13T21:40:31.383 INFO:tasks.workunit.client.0.smithi088.stdout:7/883: truncate d6/d5f/da9/fb4 119668 0 2024-09-13T21:40:31.400 INFO:tasks.workunit.client.0.smithi088.stdout:7/884: dwrite d6/f11d [4194304,4194304] 0 2024-09-13T21:40:31.400 INFO:tasks.workunit.client.0.smithi088.stdout:7/885: readlink d6/d5f/d69/da8/lda 0 2024-09-13T21:40:31.409 INFO:tasks.workunit.client.0.smithi088.stdout:7/886: dread d6/da/d1a/f56 [0,4194304] 0 2024-09-13T21:40:31.410 INFO:tasks.workunit.client.0.smithi088.stdout:7/887: rename d6/f1c to d6/d5f/d69/d45/f126 0 2024-09-13T21:40:31.423 INFO:tasks.workunit.client.0.smithi088.stdout:7/888: dwrite d6/d5f/fe8 [0,4194304] 0 2024-09-13T21:40:31.424 INFO:tasks.workunit.client.0.smithi088.stdout:7/889: write d6/da/d1a/f80 [5128949,55196] 0 2024-09-13T21:40:31.427 INFO:tasks.workunit.client.0.smithi088.stdout:7/890: dread d6/d5f/d69/def/ffd [0,4194304] 0 2024-09-13T21:40:31.428 INFO:tasks.workunit.client.0.smithi088.stdout:7/891: creat d6/d5f/d69/d4f/d6f/d70/d76/dbd/f127 x:0 0 0 2024-09-13T21:40:31.429 INFO:tasks.workunit.client.0.smithi088.stdout:9/924: sync 2024-09-13T21:40:31.430 INFO:tasks.workunit.client.0.smithi088.stdout:9/925: chown d1a/d3c/l50 84576717 1 2024-09-13T21:40:31.431 INFO:tasks.workunit.client.0.smithi088.stdout:9/926: mknod d1a/d3c/d51/d5e/ddb/c11f 0 2024-09-13T21:40:31.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/927: dwrite d1a/d3c/d85/f103 [0,4194304] 0 2024-09-13T21:40:31.444 INFO:tasks.workunit.client.0.smithi088.stdout:9/928: chown d1a/d61/d3d/d41/f8a 3345 1 2024-09-13T21:40:31.458 INFO:tasks.workunit.client.0.smithi088.stdout:9/929: dwrite d1a/fab [0,4194304] 0 2024-09-13T21:40:31.458 INFO:tasks.workunit.client.0.smithi088.stdout:9/930: read - d1a/d1b/dd5/f11e zero size 2024-09-13T21:40:31.460 INFO:tasks.workunit.client.0.smithi088.stdout:9/931: creat d1a/d61/d3d/d41/f120 x:0 0 0 2024-09-13T21:40:31.463 INFO:tasks.workunit.client.0.smithi088.stdout:9/932: dread d1a/d3c/d51/d5e/ddb/fa3 [0,4194304] 0 2024-09-13T21:40:31.465 INFO:tasks.workunit.client.0.smithi088.stdout:9/933: link d1a/d3c/d51/d5e/fb0 d1a/d3c/d51/d5e/ddb/d8e/f121 0 2024-09-13T21:40:31.466 INFO:tasks.workunit.client.0.smithi088.stdout:9/934: getdents d1a/d3c/d60/ddc 0 2024-09-13T21:40:31.466 INFO:tasks.workunit.client.0.smithi088.stdout:9/935: chown d1a/d3c/d60/fa2 100275 1 2024-09-13T21:40:31.466 INFO:tasks.workunit.client.0.smithi088.stdout:9/936: write d1a/d3c/d60/f79 [3416302,3946] 0 2024-09-13T21:40:31.474 INFO:tasks.workunit.client.0.smithi088.stdout:9/937: write d1a/d1b/d3f/f55 [2184875,90399] 0 2024-09-13T21:40:31.475 INFO:tasks.workunit.client.0.smithi088.stdout:9/938: symlink d1a/d3c/d85/l122 0 2024-09-13T21:40:31.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:31 smithi088 ceph-mon[27963]: pgmap v255: 65 pgs: 65 active+clean; 2.0 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 220 MiB/s rd, 286 MiB/s wr, 434 op/s 2024-09-13T21:40:31.492 INFO:tasks.workunit.client.0.smithi088.stdout:9/939: dwrite f18 [0,4194304] 0 2024-09-13T21:40:31.493 INFO:tasks.workunit.client.0.smithi088.stdout:9/940: write d1a/d61/d3d/d41/f120 [568144,84012] 0 2024-09-13T21:40:31.493 INFO:tasks.workunit.client.0.smithi088.stdout:9/941: stat d1a/d61/d3d/d41/c4c 0 2024-09-13T21:40:31.493 INFO:tasks.workunit.client.0.smithi088.stdout:9/942: mkdir d1a/d3c/d51/d5e/ddb/d97/d123 0 2024-09-13T21:40:31.501 INFO:tasks.workunit.client.0.smithi088.stdout:7/892: sync 2024-09-13T21:40:31.501 INFO:tasks.workunit.client.0.smithi088.stdout:7/893: symlink d6/da/d1a/l128 0 2024-09-13T21:40:31.521 INFO:tasks.workunit.client.0.smithi088.stdout:7/894: dwrite d6/d5f/d69/d4f/d6f/f92 [4194304,4194304] 0 2024-09-13T21:40:31.535 INFO:tasks.workunit.client.0.smithi088.stdout:7/895: dwrite d6/d5f/d69/def/ffd [0,4194304] 0 2024-09-13T21:40:31.535 INFO:tasks.workunit.client.0.smithi088.stdout:7/896: creat d6/da/db7/f129 x:0 0 0 2024-09-13T21:40:31.537 INFO:tasks.workunit.client.0.smithi088.stdout:7/897: getdents d6/d4e/d111 0 2024-09-13T21:40:31.537 INFO:tasks.workunit.client.0.smithi088.stdout:7/898: write d6/d5f/d69/d45/fcb [2513509,93986] 0 2024-09-13T21:40:31.541 INFO:tasks.workunit.client.0.smithi088.stdout:7/899: dread d6/d5f/d69/d4f/fae [0,4194304] 0 2024-09-13T21:40:31.543 INFO:tasks.workunit.client.0.smithi088.stdout:7/900: mkdir d6/d12a 0 2024-09-13T21:40:31.543 INFO:tasks.workunit.client.0.smithi088.stdout:7/901: chown d6/d5f/d69/d4f/fb8 14666747 1 2024-09-13T21:40:31.543 INFO:tasks.workunit.client.0.smithi088.stdout:7/902: symlink d6/d5f/d69/d4f/d6f/d70/d76/d109/l12b 0 2024-09-13T21:40:31.545 INFO:tasks.workunit.client.0.smithi088.stdout:9/943: sync 2024-09-13T21:40:31.545 INFO:tasks.workunit.client.0.smithi088.stdout:9/944: chown d1a/d61/de2/l106 22146232 1 2024-09-13T21:40:31.549 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:31 smithi116 ceph-mon[33391]: pgmap v255: 65 pgs: 65 active+clean; 2.0 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 220 MiB/s rd, 286 MiB/s wr, 434 op/s 2024-09-13T21:40:31.555 INFO:tasks.workunit.client.0.smithi088.stdout:9/945: dread d1a/d3c/d85/f103 [0,4194304] 0 2024-09-13T21:40:31.555 INFO:tasks.workunit.client.0.smithi088.stdout:9/946: truncate d1a/fb5 979202 0 2024-09-13T21:40:31.556 INFO:tasks.workunit.client.0.smithi088.stdout:9/947: mkdir d1a/d3c/d51/d5e/d7e/d92/d124 0 2024-09-13T21:40:31.557 INFO:tasks.workunit.client.0.smithi088.stdout:9/948: rmdir d1a/d3c/d60/ddc/df9 39 2024-09-13T21:40:31.574 INFO:tasks.workunit.client.0.smithi088.stdout:9/949: dwrite d1a/d1b/f74 [0,4194304] 0 2024-09-13T21:40:31.583 INFO:tasks.workunit.client.0.smithi088.stdout:9/950: dread d1a/d3c/fed [0,4194304] 0 2024-09-13T21:40:31.585 INFO:tasks.workunit.client.0.smithi088.stdout:9/951: creat d1a/d61/dc6/f125 x:0 0 0 2024-09-13T21:40:31.585 INFO:tasks.workunit.client.0.smithi088.stdout:9/952: fdatasync d1a/d61/d3d/f62 0 2024-09-13T21:40:31.585 INFO:tasks.workunit.client.0.smithi088.stdout:9/953: read d1a/d61/d3d/d41/f77 [1377005,68189] 0 2024-09-13T21:40:31.600 INFO:tasks.workunit.client.0.smithi088.stdout:9/954: dwrite d1a/d3c/d51/d5e/ddb/d8e/fbd [0,4194304] 0 2024-09-13T21:40:31.602 INFO:tasks.workunit.client.0.smithi088.stdout:9/955: mkdir d1a/d3c/d51/d5e/d7e/d126 0 2024-09-13T21:40:31.602 INFO:tasks.workunit.client.0.smithi088.stdout:9/956: stat d1a/d61/d3d/d41/d48/c6c 0 2024-09-13T21:40:31.602 INFO:tasks.workunit.client.0.smithi088.stdout:9/957: chown d1a/cee 577132469 1 2024-09-13T21:40:31.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/958: symlink d1a/d3c/d51/d5e/d113/l127 0 2024-09-13T21:40:31.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/959: chown d1a/d3c/d51/d5e/d7e/f111 811 1 2024-09-13T21:40:31.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/960: readlink d1a/d1b/d3f/le7 0 2024-09-13T21:40:31.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/961: fsync d1a/d3c/d51/d5e/d7e/fdf 0 2024-09-13T21:40:31.603 INFO:tasks.workunit.client.0.smithi088.stdout:9/962: getdents d1a/d3c/d51/d5e/d7e/d126 0 2024-09-13T21:40:31.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/903: sync 2024-09-13T21:40:31.644 INFO:tasks.workunit.client.0.smithi088.stdout:7/904: symlink d6/d5f/d69/d4f/d6f/d70/l12c 0 2024-09-13T21:40:31.645 INFO:tasks.workunit.client.0.smithi088.stdout:7/905: rmdir d6/da 39 2024-09-13T21:40:31.645 INFO:tasks.workunit.client.0.smithi088.stdout:7/906: mknod d6/da/dfc/d104/c12d 0 2024-09-13T21:40:31.723 INFO:tasks.workunit.client.0.smithi088.stdout:9/963: sync 2024-09-13T21:40:31.724 INFO:tasks.workunit.client.0.smithi088.stdout:9/964: mkdir d1a/d3c/d60/ddc/df9/d128 0 2024-09-13T21:40:31.725 INFO:tasks.workunit.client.0.smithi088.stdout:9/965: unlink d1a/d3c/d51/d5e/la7 0 2024-09-13T21:40:31.727 INFO:tasks.workunit.client.0.smithi088.stdout:9/966: rename d1a/fc5 to d1a/d3c/d51/d5e/d113/f129 0 2024-09-13T21:40:31.727 INFO:tasks.workunit.client.0.smithi088.stdout:9/967: chown d1a/d9e/le9 5 1 2024-09-13T21:40:31.727 INFO:tasks.workunit.client.0.smithi088.stdout:9/968: creat d1a/d61/dc6/f12a x:0 0 0 2024-09-13T21:40:31.729 INFO:tasks.workunit.client.0.smithi088.stdout:9/969: rename d1a/d3c/d51/d5e/ddb/d97/d123 to d1a/d3c/d60/ddc/d12b 0 2024-09-13T21:40:31.729 INFO:tasks.workunit.client.0.smithi088.stdout:9/970: creat d1a/d61/dc6/f12c x:0 0 0 2024-09-13T21:40:31.744 INFO:tasks.workunit.client.0.smithi088.stdout:9/971: dwrite d1a/d3c/d51/d5e/f7c [0,4194304] 0 2024-09-13T21:40:31.746 INFO:tasks.workunit.client.0.smithi088.stdout:9/972: creat d1a/d3c/d60/dbb/f12d x:0 0 0 2024-09-13T21:40:31.747 INFO:tasks.workunit.client.0.smithi088.stdout:9/973: rename d1a/fab to d1a/d61/de2/f12e 0 2024-09-13T21:40:31.748 INFO:tasks.workunit.client.0.smithi088.stdout:9/974: mkdir d1a/d61/d3d/d41/def/d10f/d12f 0 2024-09-13T21:40:31.751 INFO:tasks.workunit.client.0.smithi088.stdout:9/975: creat d1a/d61/d3d/d41/def/d10f/f130 x:0 0 0 2024-09-13T21:40:31.753 INFO:tasks.workunit.client.0.smithi088.stdout:9/976: unlink d1a/d61/d3d/f7d 0 2024-09-13T21:40:31.757 INFO:tasks.workunit.client.0.smithi088.stdout:7/907: sync 2024-09-13T21:40:31.757 INFO:tasks.workunit.client.0.smithi088.stdout:7/908: fdatasync d6/da/d1a/f33 0 2024-09-13T21:40:31.758 INFO:tasks.workunit.client.0.smithi088.stdout:7/909: mknod d6/d5f/d69/d4f/d6f/da4/c12e 0 2024-09-13T21:40:31.758 INFO:tasks.workunit.client.0.smithi088.stdout:7/910: fsync d6/f11d 0 2024-09-13T21:40:31.759 INFO:tasks.workunit.client.0.smithi088.stdout:9/977: dread f10 [0,4194304] 0 2024-09-13T21:40:31.766 INFO:tasks.workunit.client.0.smithi088.stdout:7/911: write d6/d5f/d69/d4f/d6f/f92 [7575966,113180] 0 2024-09-13T21:40:31.767 INFO:tasks.workunit.client.0.smithi088.stdout:7/912: symlink d6/da/d1a/d3a/d5c/l12f 0 2024-09-13T21:40:31.768 INFO:tasks.workunit.client.0.smithi088.stdout:7/913: getdents d6/d5f/d69/def 0 2024-09-13T21:40:31.769 INFO:tasks.workunit.client.0.smithi088.stdout:7/914: creat d6/d5f/f130 x:0 0 0 2024-09-13T21:40:31.769 INFO:tasks.workunit.client.0.smithi088.stdout:7/915: creat d6/da/dfc/f131 x:0 0 0 2024-09-13T21:40:31.771 INFO:tasks.workunit.client.0.smithi088.stdout:7/916: stat d6/d5f/d69/d4f/d6f/d70/d76/l10b 0 2024-09-13T21:40:31.771 INFO:tasks.workunit.client.0.smithi088.stdout:7/917: fsync d6/d5f/fde 0 2024-09-13T21:40:31.772 INFO:tasks.workunit.client.0.smithi088.stdout:7/918: mknod d6/d5f/d69/d4f/d6f/d70/ded/df4/c132 0 2024-09-13T21:40:31.785 INFO:tasks.workunit.client.0.smithi088.stdout:7/919: dwrite d6/d4e/d111/f9e [0,4194304] 0 2024-09-13T21:40:31.788 INFO:tasks.workunit.client.0.smithi088.stdout:7/920: getdents d6 0 2024-09-13T21:40:31.790 INFO:tasks.workunit.client.0.smithi088.stdout:7/921: symlink d6/d4e/l133 0 2024-09-13T21:40:31.808 INFO:tasks.workunit.client.0.smithi088.stdout:7/922: dwrite d6/da/dfc/f11e [0,4194304] 0 2024-09-13T21:40:31.808 INFO:tasks.workunit.client.0.smithi088.stdout:7/923: chown d6/da/dfc 42 1 2024-09-13T21:40:31.808 INFO:tasks.workunit.client.0.smithi088.stdout:7/924: fdatasync d6/da/d1a/f89 0 2024-09-13T21:40:31.810 INFO:tasks.workunit.client.0.smithi088.stdout:7/925: mkdir d6/d134 0 2024-09-13T21:40:31.810 INFO:tasks.workunit.client.0.smithi088.stdout:7/926: chown d6/d5f/d69/da8/dd3/f125 2654484 1 2024-09-13T21:40:31.811 INFO:tasks.workunit.client.0.smithi088.stdout:7/927: mknod d6/d5f/d69/d4f/d6f/d70/ded/df4/c135 0 2024-09-13T21:40:31.834 INFO:tasks.workunit.client.0.smithi088.stdout:7/928: dwrite d6/d5f/da9/ff3 [0,4194304] 0 2024-09-13T21:40:31.840 INFO:tasks.workunit.client.0.smithi088.stdout:9/978: sync 2024-09-13T21:40:31.843 INFO:tasks.workunit.client.0.smithi088.stdout:7/929: dread d6/d5f/d69/f6e [0,4194304] 0 2024-09-13T21:40:31.845 INFO:tasks.workunit.client.0.smithi088.stdout:7/930: creat d6/da/d1a/d3a/d5c/f136 x:0 0 0 2024-09-13T21:40:31.845 INFO:tasks.workunit.client.0.smithi088.stdout:7/931: write d6/da/d44/da7/f121 [406227,111874] 0 2024-09-13T21:40:31.845 INFO:tasks.workunit.client.0.smithi088.stdout:7/932: write d6/d5f/d7a/fc5 [532157,105468] 0 2024-09-13T21:40:31.846 INFO:tasks.workunit.client.0.smithi088.stdout:7/933: dread - d6/da/dca/fdc zero size 2024-09-13T21:40:31.908 INFO:tasks.workunit.client.0.smithi088.stdout:9/979: sync 2024-09-13T21:40:31.909 INFO:tasks.workunit.client.0.smithi088.stdout:9/980: fsync d1a/d3c/d51/d5e/f7c 0 2024-09-13T21:40:31.925 INFO:tasks.workunit.client.0.smithi088.stdout:9/981: dwrite d1a/d9e/fd4 [4194304,4194304] 0 2024-09-13T21:40:31.934 INFO:tasks.workunit.client.0.smithi088.stdout:9/982: dread d1a/d61/de2/f12e [0,4194304] 0 2024-09-13T21:40:31.941 INFO:tasks.workunit.client.0.smithi088.stdout:9/983: write d1a/d3c/d51/d5e/d113/f129 [3464051,48398] 0 2024-09-13T21:40:31.942 INFO:tasks.workunit.client.0.smithi088.stdout:9/984: creat d1a/d1b/f131 x:0 0 0 2024-09-13T21:40:31.942 INFO:tasks.workunit.client.0.smithi088.stdout:9/985: rmdir d1a/d3c/d51/d5e/d113 39 2024-09-13T21:40:31.952 INFO:tasks.workunit.client.0.smithi088.stdout:9/986: dread d1a/d61/f89 [0,4194304] 0 2024-09-13T21:40:31.952 INFO:tasks.workunit.client.0.smithi088.stdout:9/987: mknod d1a/d3c/d51/c132 0 2024-09-13T21:40:31.953 INFO:tasks.workunit.client.0.smithi088.stdout:9/988: mkdir d1a/d1b/db9/dc8/d133 0 2024-09-13T21:40:31.954 INFO:tasks.workunit.client.0.smithi088.stdout:9/989: creat d1a/f134 x:0 0 0 2024-09-13T21:40:31.955 INFO:tasks.workunit.client.0.smithi088.stdout:9/990: mkdir d1a/d61/d135 0 2024-09-13T21:40:31.955 INFO:tasks.workunit.client.0.smithi088.stdout:9/991: chown d1a/d61/c59 4173 1 2024-09-13T21:40:31.962 INFO:tasks.workunit.client.0.smithi088.stdout:9/992: write d1a/f80 [2506135,722] 0 2024-09-13T21:40:31.963 INFO:tasks.workunit.client.0.smithi088.stdout:9/993: link f10 d1a/d1b/d3f/f136 0 2024-09-13T21:40:32.021 INFO:tasks.workunit.client.0.smithi088.stdout:9/994: creat d1a/d61/d3d/d41/def/d10f/d12f/f137 x:0 0 0 2024-09-13T21:40:32.024 INFO:tasks.workunit.client.0.smithi088.stdout:9/995: link d1a/d1b/d3f/f64 d1a/d3c/d51/d5e/ddb/d8e/f138 0 2024-09-13T21:40:32.026 INFO:tasks.workunit.client.0.smithi088.stdout:9/996: link d1a/d61/dc6/f125 d1a/d3c/d60/ddc/df9/f139 0 2024-09-13T21:40:32.026 INFO:tasks.workunit.client.0.smithi088.stdout:9/997: stat d1a/d3c/d51/d5e/d7e/d92/d124 0 2024-09-13T21:40:32.026 INFO:tasks.workunit.client.0.smithi088.stdout:9/998: creat d1a/d1b/f13a x:0 0 0 2024-09-13T21:40:32.028 INFO:tasks.workunit.client.0.smithi088.stdout:9/999: truncate f10 3266951 0 2024-09-13T21:40:32.029 INFO:tasks.workunit.client.0.smithi088.stdout:7/934: sync 2024-09-13T21:40:32.037 INFO:tasks.workunit.client.0.smithi088.stdout:7/935: write d6/d5f/d69/d45/fdf [4006255,39436] 0 2024-09-13T21:40:32.037 INFO:tasks.workunit.client.0.smithi088.stdout:7/936: creat d6/d5f/d69/d4f/d6f/f137 x:0 0 0 2024-09-13T21:40:32.037 INFO:tasks.workunit.client.0.smithi088.stdout:7/937: write d6/d5f/d69/d4f/d6f/d70/dbf/f10d [799190,77183] 0 2024-09-13T21:40:32.037 INFO:tasks.workunit.client.0.smithi088.stdout:7/938: fsync d6/d5f/da9/ff3 0 2024-09-13T21:40:32.037 INFO:tasks.workunit.client.0.smithi088.stdout:7/939: dread - d6/da/d44/fe6 zero size 2024-09-13T21:40:32.038 INFO:tasks.workunit.client.0.smithi088.stdout:7/940: creat d6/da/f138 x:0 0 0 2024-09-13T21:40:32.040 INFO:tasks.workunit.client.0.smithi088.stdout:7/941: truncate d6/d5f/d69/d4f/f48 391851 0 2024-09-13T21:40:32.047 INFO:tasks.workunit.client.0.smithi088.stdout:7/942: write d6/d5f/d69/f8a [3598567,96512] 0 2024-09-13T21:40:32.049 INFO:tasks.workunit.client.0.smithi088.stdout:7/943: chown d6/da/f46 260279004 1 2024-09-13T21:40:32.051 INFO:tasks.workunit.client.0.smithi088.stdout:7/944: rename d6/d5f/d69/d4f/d6f/c90 to d6/d5f/d69/d4f/de2/c139 0 2024-09-13T21:40:32.052 INFO:tasks.workunit.client.0.smithi088.stdout:7/945: truncate d6/d4e/f7b 2214782 0 2024-09-13T21:40:32.052 INFO:tasks.workunit.client.0.smithi088.stdout:7/946: creat d6/d5f/d69/f13a x:0 0 0 2024-09-13T21:40:32.053 INFO:tasks.workunit.client.0.smithi088.stdout:7/947: rmdir d6/da/d1a 39 2024-09-13T21:40:32.055 INFO:tasks.workunit.client.0.smithi088.stdout:7/948: rename d6/da/d1a/d3a/d5c/fc9 to d6/da/dfc/d104/f13b 0 2024-09-13T21:40:32.062 INFO:tasks.workunit.client.0.smithi088.stdout:7/949: rename d6/da/d1a/d3a/d5c to d6/d4e/d111/d13c 0 2024-09-13T21:40:32.063 INFO:tasks.workunit.client.0.smithi088.stdout:7/950: mkdir d6/d13d 0 2024-09-13T21:40:32.063 INFO:tasks.workunit.client.0.smithi088.stdout:7/951: readlink d6/da/l96 0 2024-09-13T21:40:32.064 INFO:tasks.workunit.client.0.smithi088.stdout:7/952: mkdir d6/da/db7/d13e 0 2024-09-13T21:40:32.070 INFO:tasks.workunit.client.0.smithi088.stdout:7/953: write d6/d5f/d69/def/ffd [1104455,66882] 0 2024-09-13T21:40:32.073 INFO:tasks.workunit.client.0.smithi088.stdout:7/954: mknod d6/da/c13f 0 2024-09-13T21:40:32.073 INFO:tasks.workunit.client.0.smithi088.stdout:7/955: fsync d6/da/d44/fa0 0 2024-09-13T21:40:32.073 INFO:tasks.workunit.client.0.smithi088.stdout:7/956: creat d6/d5f/d69/d4f/d6f/d83/f140 x:0 0 0 2024-09-13T21:40:32.074 INFO:tasks.workunit.client.0.smithi088.stdout:7/957: mkdir d6/da/dfc/d104/d141 0 2024-09-13T21:40:32.074 INFO:tasks.workunit.client.0.smithi088.stdout:7/958: write d6/d5f/d69/d4f/d6f/d83/f7f [4855216,128945] 0 2024-09-13T21:40:32.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/959: readlink d6/d5f/d69/d4f/d6f/d70/dbf/lee 0 2024-09-13T21:40:32.075 INFO:tasks.workunit.client.0.smithi088.stdout:7/960: readlink d6/d4e/l133 0 2024-09-13T21:40:32.078 INFO:tasks.workunit.client.0.smithi088.stdout:7/961: rmdir d6/d5f/d69/d4f/d6f 39 2024-09-13T21:40:32.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/962: creat d6/d5f/d69/d4f/d4c/f142 x:0 0 0 2024-09-13T21:40:32.080 INFO:tasks.workunit.client.0.smithi088.stdout:7/963: fdatasync d6/d4e/d111/f9e 0 2024-09-13T21:40:32.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/964: symlink d6/da/dfc/d104/l143 0 2024-09-13T21:40:32.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/965: rmdir d6/da/dfc/d104 39 2024-09-13T21:40:32.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/966: dread - d6/d5f/d69/d4f/d6f/f137 zero size 2024-09-13T21:40:32.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/967: fdatasync d6/d5f/d69/d4f/fae 0 2024-09-13T21:40:32.081 INFO:tasks.workunit.client.0.smithi088.stdout:7/968: fdatasync d6/d5f/fde 0 2024-09-13T21:40:32.083 INFO:tasks.workunit.client.0.smithi088.stdout:7/969: fsync d6/d5f/d69/def/ffd 0 2024-09-13T21:40:32.083 INFO:tasks.workunit.client.0.smithi088.stdout:7/970: symlink d6/d12a/l144 0 2024-09-13T21:40:32.084 INFO:tasks.workunit.client.0.smithi088.stdout:7/971: fsync d6/fa6 0 2024-09-13T21:40:32.084 INFO:tasks.workunit.client.0.smithi088.stdout:7/972: creat d6/d5f/d69/d4f/d4c/f145 x:0 0 0 2024-09-13T21:40:32.086 INFO:tasks.workunit.client.0.smithi088.stdout:7/973: mkdir d6/d5f/d69/d4f/d6f/d83/d146 0 2024-09-13T21:40:32.086 INFO:tasks.workunit.client.0.smithi088.stdout:7/974: creat d6/d5f/f147 x:0 0 0 2024-09-13T21:40:32.092 INFO:tasks.workunit.client.0.smithi088.stdout:7/975: dread d6/f53 [0,4194304] 0 2024-09-13T21:40:32.092 INFO:tasks.workunit.client.0.smithi088.stdout:7/976: fsync d6/da/d44/fa0 0 2024-09-13T21:40:32.108 INFO:tasks.workunit.client.0.smithi088.stdout:7/977: dwrite d6/d5f/d69/d4f/d6f/f137 [0,4194304] 0 2024-09-13T21:40:32.129 INFO:tasks.workunit.client.0.smithi088.stdout:7/978: dwrite d6/d5f/d69/d4f/d4c/db9/fdd [0,4194304] 0 2024-09-13T21:40:32.131 INFO:tasks.workunit.client.0.smithi088.stdout:7/979: rename d6/c6b to d6/d5f/d7a/c148 0 2024-09-13T21:40:32.131 INFO:tasks.workunit.client.0.smithi088.stdout:7/980: creat d6/da/d44/da7/f149 x:0 0 0 2024-09-13T21:40:32.133 INFO:tasks.workunit.client.0.smithi088.stdout:7/981: mknod d6/d5f/d69/d4f/d6f/d83/d146/c14a 0 2024-09-13T21:40:32.149 INFO:tasks.workunit.client.0.smithi088.stdout:7/982: dwrite d6/d5f/f7d [0,4194304] 0 2024-09-13T21:40:32.150 INFO:tasks.workunit.client.0.smithi088.stdout:7/983: mknod d6/d5f/d69/d4f/d6f/d83/d146/c14b 0 2024-09-13T21:40:32.152 INFO:tasks.workunit.client.0.smithi088.stdout:7/984: unlink d6/c57 0 2024-09-13T21:40:32.152 INFO:tasks.workunit.client.0.smithi088.stdout:7/985: getdents d6/d4e/d111/d13c 0 2024-09-13T21:40:32.168 INFO:tasks.workunit.client.0.smithi088.stdout:7/986: dwrite d6/d5f/d69/d4f/fc6 [0,4194304] 0 2024-09-13T21:40:32.170 INFO:tasks.workunit.client.0.smithi088.stdout:7/987: mkdir d6/da/dfc/d14c 0 2024-09-13T21:40:32.170 INFO:tasks.workunit.client.0.smithi088.stdout:7/988: readlink d6/d5f/d69/d4f/d6f/db2/lf6 0 2024-09-13T21:40:32.178 INFO:tasks.workunit.client.0.smithi088.stdout:7/989: dread d6/d5f/d69/d4f/d6f/f137 [0,4194304] 0 2024-09-13T21:40:32.178 INFO:tasks.workunit.client.0.smithi088.stdout:7/990: stat d6/d5f/d69/def 0 2024-09-13T21:40:32.191 INFO:tasks.workunit.client.0.smithi088.stdout:7/991: dwrite d6/d5f/d69/d4f/d6f/d70/d76/dbd/deb/f115 [0,4194304] 0 2024-09-13T21:40:32.192 INFO:tasks.workunit.client.0.smithi088.stdout:7/992: symlink d6/l14d 0 2024-09-13T21:40:32.193 INFO:tasks.workunit.client.0.smithi088.stdout:7/993: rename d6/d5f/d69/da8/cd4 to d6/d5f/d69/d4f/d6f/d70/ded/df4/c14e 0 2024-09-13T21:40:32.194 INFO:tasks.workunit.client.0.smithi088.stdout:7/994: mkdir d6/d5f/d69/d4f/d6f/d83/d146/d14f 0 2024-09-13T21:40:32.195 INFO:tasks.workunit.client.0.smithi088.stdout:7/995: mkdir d6/d5f/da9/d150 0 2024-09-13T21:40:32.197 INFO:tasks.workunit.client.0.smithi088.stdout:7/996: link d6/d5f/d69/d4f/d4c/f142 d6/d134/f151 0 2024-09-13T21:40:32.197 INFO:tasks.workunit.client.0.smithi088.stdout:7/997: creat d6/da/dc8/f152 x:0 0 0 2024-09-13T21:40:32.198 INFO:tasks.workunit.client.0.smithi088.stdout:7/998: symlink d6/d5f/d69/def/l153 0 2024-09-13T21:40:32.198 INFO:tasks.workunit.client.0.smithi088.stdout:7/999: creat d6/da/d44/f154 x:0 0 0 2024-09-13T21:40:32.201 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf -- ./tmp.oEIdpO56Qr 2024-09-13T21:40:33.258 INFO:tasks.workunit.client.1.smithi116.stdout:4/23: sync 2024-09-13T21:40:33.258 INFO:tasks.workunit.client.1.smithi116.stdout:4/24: chown d0/l4 218812421 1 2024-09-13T21:40:33.259 INFO:tasks.workunit.client.1.smithi116.stdout:4/25: unlink d0/f1 0 2024-09-13T21:40:33.259 INFO:tasks.workunit.client.1.smithi116.stdout:4/26: fdatasync - no filename 2024-09-13T21:40:33.260 INFO:tasks.workunit.client.1.smithi116.stdout:4/27: mknod d0/c5 0 2024-09-13T21:40:33.260 INFO:tasks.workunit.client.1.smithi116.stdout:4/28: read - no filename 2024-09-13T21:40:33.260 INFO:tasks.workunit.client.1.smithi116.stdout:4/29: fsync - no filename 2024-09-13T21:40:33.261 INFO:tasks.workunit.client.1.smithi116.stdout:4/30: symlink d0/l6 0 2024-09-13T21:40:33.261 INFO:tasks.workunit.client.1.smithi116.stdout:4/31: chown d0/c5 39343430 1 2024-09-13T21:40:33.261 INFO:tasks.workunit.client.1.smithi116.stdout:4/32: dread - no filename 2024-09-13T21:40:33.262 INFO:tasks.workunit.client.1.smithi116.stdout:4/33: unlink d0/l4 0 2024-09-13T21:40:33.263 INFO:tasks.workunit.client.1.smithi116.stdout:4/34: symlink d0/l7 0 2024-09-13T21:40:33.263 INFO:tasks.workunit.client.1.smithi116.stdout:4/35: creat d0/f8 x:0 0 0 2024-09-13T21:40:33.263 INFO:tasks.workunit.client.1.smithi116.stdout:4/36: read - d0/f8 zero size 2024-09-13T21:40:33.269 INFO:tasks.workunit.client.1.smithi116.stdout:4/37: getdents d0 0 2024-09-13T21:40:33.289 INFO:tasks.workunit.client.1.smithi116.stdout:4/38: dwrite d0/f8 [0,4194304] 0 2024-09-13T21:40:33.291 INFO:tasks.workunit.client.1.smithi116.stdout:4/39: symlink d0/l9 0 2024-09-13T21:40:33.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.293+0000 7f48576cb700 1 -- 172.21.15.88:0/279000999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 msgr2=0x7f4850072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.293+0000 7f48576cb700 1 --2- 172.21.15.88:0/279000999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 0x7f4850072210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f484c009910 tx=0x7f484c009c20 comp rx=0 tx=0).stop 2024-09-13T21:40:33.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.293+0000 7f48576cb700 1 -- 172.21.15.88:0/279000999 shutdown_connections 2024-09-13T21:40:33.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.293+0000 7f48576cb700 1 --2- 172.21.15.88:0/279000999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4850072750 0x7f4850107d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.293+0000 7f48576cb700 1 --2- 172.21.15.88:0/279000999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 0x7f4850072210 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.293+0000 7f48576cb700 1 -- 172.21.15.88:0/279000999 >> 172.21.15.88:0/279000999 conn(0x7f485006d110 msgr2=0x7f485006f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.294+0000 7f48576cb700 1 -- 172.21.15.88:0/279000999 shutdown_connections 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.294+0000 7f48576cb700 1 -- 172.21.15.88:0/279000999 wait complete. 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.294+0000 7f48576cb700 1 Processor -- start 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.294+0000 7f48576cb700 1 -- start start 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f48576cb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 0x7f485019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f48576cb700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4850072750 0x7f485019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f48576cb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485019ef90 con 0x7f4850071e00 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f48576cb700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485019f0d0 con 0x7f4850072750 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f4855467700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 0x7f485019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:33.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f4855467700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 0x7f485019e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36974/0 (socket says 172.21.15.88:36974) 2024-09-13T21:40:33.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f4855467700 1 -- 172.21.15.88:0/3621065776 learned_addr learned my addr 172.21.15.88:0/3621065776 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:33.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f4854c66700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4850072750 0x7f485019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:33.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f4855467700 1 -- 172.21.15.88:0/3621065776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4850072750 msgr2=0x7f485019e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f4855467700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4850072750 0x7f485019e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f4855467700 1 -- 172.21.15.88:0/3621065776 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0095f0 con 0x7f4850071e00 2024-09-13T21:40:33.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f4855467700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 0x7f485019e430 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f484c000c00 tx=0x7f484c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:33.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f48427fc700 1 -- 172.21.15.88:0/3621065776 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f484c01d070 con 0x7f4850071e00 2024-09-13T21:40:33.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f48427fc700 1 -- 172.21.15.88:0/3621065776 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f484c022470 con 0x7f4850071e00 2024-09-13T21:40:33.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48501a3b20 con 0x7f4850071e00 2024-09-13T21:40:33.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.295+0000 7f48427fc700 1 -- 172.21.15.88:0/3621065776 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f484c00f670 con 0x7f4850071e00 2024-09-13T21:40:33.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.296+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48501a4010 con 0x7f4850071e00 2024-09-13T21:40:33.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.297+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4850198440 con 0x7f4850071e00 2024-09-13T21:40:33.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.297+0000 7f48427fc700 1 -- 172.21.15.88:0/3621065776 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 91159+0+0 (secure 0 0 0) 0x7f484c0225e0 con 0x7f4850071e00 2024-09-13T21:40:33.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.297+0000 7f48427fc700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f483c06d4c0 0x7f483c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:33.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.298+0000 7f48427fc700 1 -- 172.21.15.88:0/3621065776 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f484c08e230 con 0x7f4850071e00 2024-09-13T21:40:33.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.298+0000 7f4854c66700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f483c06d4c0 0x7f483c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.298+0000 7f4854c66700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f483c06d4c0 0x7f483c06f970 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4844006fd0 tx=0x7f4844009190 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.304+0000 7f48427fc700 1 -- 172.21.15.88:0/3621065776 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f484c05c4a0 con 0x7f4850071e00 2024-09-13T21:40:33.307 INFO:tasks.workunit.client.1.smithi116.stdout:4/40: write d0/f8 [2924440,25613] 0 2024-09-13T21:40:33.315 INFO:tasks.workunit.client.1.smithi116.stdout:4/41: truncate d0/f8 219698 0 2024-09-13T21:40:33.338 INFO:tasks.workunit.client.1.smithi116.stdout:4/42: dwrite d0/f8 [0,4194304] 0 2024-09-13T21:40:33.339 INFO:tasks.workunit.client.1.smithi116.stdout:4/43: creat d0/fa x:0 0 0 2024-09-13T21:40:33.339 INFO:tasks.workunit.client.1.smithi116.stdout:4/44: fdatasync d0/fa 0 2024-09-13T21:40:33.359 INFO:tasks.workunit.client.1.smithi116.stdout:4/45: dwrite d0/f8 [4194304,4194304] 0 2024-09-13T21:40:33.360 INFO:tasks.workunit.client.1.smithi116.stdout:4/46: creat d0/fb x:0 0 0 2024-09-13T21:40:33.363 INFO:tasks.workunit.client.1.smithi116.stdout:4/47: mknod d0/cc 0 2024-09-13T21:40:33.364 INFO:tasks.workunit.client.1.smithi116.stdout:4/48: mkdir d0/dd 0 2024-09-13T21:40:33.366 INFO:tasks.workunit.client.1.smithi116.stdout:4/49: link d0/cc d0/ce 0 2024-09-13T21:40:33.366 INFO:tasks.workunit.client.1.smithi116.stdout:4/50: chown d0/c5 1406 1 2024-09-13T21:40:33.366 INFO:tasks.workunit.client.1.smithi116.stdout:4/51: creat d0/ff x:0 0 0 2024-09-13T21:40:33.377 INFO:tasks.workunit.client.1.smithi116.stdout:4/52: rmdir d0 39 2024-09-13T21:40:33.379 INFO:tasks.workunit.client.1.smithi116.stdout:4/53: creat d0/f10 x:0 0 0 2024-09-13T21:40:33.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:33 smithi088 ceph-mon[27963]: pgmap v256: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 220 MiB/s rd, 281 MiB/s wr, 392 op/s 2024-09-13T21:40:33.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.562+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4850061190 con 0x7f483c06d4c0 2024-09-13T21:40:33.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.563+0000 7f48427fc700 1 -- 172.21.15.88:0/3621065776 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f4850061190 con 0x7f483c06d4c0 2024-09-13T21:40:33.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.565+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f483c06d4c0 msgr2=0x7f483c06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.565+0000 7f48576cb700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f483c06d4c0 0x7f483c06f970 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4844006fd0 tx=0x7f4844009190 comp rx=0 tx=0).stop 2024-09-13T21:40:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.565+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 msgr2=0x7f485019e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.565+0000 7f48576cb700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 0x7f485019e430 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f484c000c00 tx=0x7f484c00bd70 comp rx=0 tx=0).stop 2024-09-13T21:40:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.566+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 shutdown_connections 2024-09-13T21:40:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.566+0000 7f48576cb700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f483c06d4c0 0x7f483c06f970 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.566+0000 7f48576cb700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4850071e00 0x7f485019e430 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.566+0000 7f48576cb700 1 --2- 172.21.15.88:0/3621065776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4850072750 0x7f485019e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.566+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 >> 172.21.15.88:0/3621065776 conn(0x7f485006d110 msgr2=0x7f4850070440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.566+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 shutdown_connections 2024-09-13T21:40:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.566+0000 7f48576cb700 1 -- 172.21.15.88:0/3621065776 wait complete. 2024-09-13T21:40:33.575 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:33 smithi116 ceph-mon[33391]: pgmap v256: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 220 MiB/s rd, 281 MiB/s wr, 392 op/s 2024-09-13T21:40:33.578 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:40:33.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.681+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/521676215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 msgr2=0x7fdcac101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.681+0000 7fdcb1fe6700 1 --2- 172.21.15.88:0/521676215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 0x7fdcac101890 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009910 tx=0x7fdca0009c20 comp rx=0 tx=0).stop 2024-09-13T21:40:33.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.681+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/521676215 shutdown_connections 2024-09-13T21:40:33.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.681+0000 7fdcb1fe6700 1 --2- 172.21.15.88:0/521676215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 0x7fdcac101890 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.681+0000 7fdcb1fe6700 1 --2- 172.21.15.88:0/521676215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcac100240 0x7fdcac100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.681+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/521676215 >> 172.21.15.88:0/521676215 conn(0x7fdcac0fb7f0 msgr2=0x7fdcac0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:33.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.681+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/521676215 shutdown_connections 2024-09-13T21:40:33.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.681+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/521676215 wait complete. 2024-09-13T21:40:33.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcb1fe6700 1 Processor -- start 2024-09-13T21:40:33.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcb1fe6700 1 -- start start 2024-09-13T21:40:33.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcb1fe6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcac100240 0x7fdcac195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:33.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcb1fe6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 0x7fdcac195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:33.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcb1fe6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac196580 con 0x7fdcac101440 2024-09-13T21:40:33.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcb1fe6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac1966c0 con 0x7fdcac100240 2024-09-13T21:40:33.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcaaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 0x7fdcac195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:33.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcab7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcac100240 0x7fdcac195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:33.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcaaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 0x7fdcac195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36986/0 (socket says 172.21.15.88:36986) 2024-09-13T21:40:33.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcaaffd700 1 -- 172.21.15.88:0/2683805792 learned_addr learned my addr 172.21.15.88:0/2683805792 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcaaffd700 1 -- 172.21.15.88:0/2683805792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcac100240 msgr2=0x7fdcac195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.682+0000 7fdcaaffd700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcac100240 0x7fdcac195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.683+0000 7fdcaaffd700 1 -- 172.21.15.88:0/2683805792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca00095f0 con 0x7fdcac101440 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.683+0000 7fdcaaffd700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 0x7fdcac195ff0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdca000bd70 tx=0x7fdca000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.683+0000 7fdca8ff9700 1 -- 172.21.15.88:0/2683805792 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca001d070 con 0x7fdcac101440 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.683+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac19b120 con 0x7fdcac101440 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.683+0000 7fdca8ff9700 1 -- 172.21.15.88:0/2683805792 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdca0005940 con 0x7fdcac101440 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.683+0000 7fdca8ff9700 1 -- 172.21.15.88:0/2683805792 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca0021430 con 0x7fdcac101440 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.683+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac19b5e0 con 0x7fdcac101440 2024-09-13T21:40:33.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.684+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac108d90 con 0x7fdcac101440 2024-09-13T21:40:33.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.684+0000 7fdca8ff9700 1 -- 172.21.15.88:0/2683805792 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 91159+0+0 (secure 0 0 0) 0x7fdca000f860 con 0x7fdcac101440 2024-09-13T21:40:33.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.685+0000 7fdca8ff9700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fdc9406d4c0 0x7fdc9406f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:33.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.685+0000 7fdca8ff9700 1 -- 172.21.15.88:0/2683805792 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fdca008de50 con 0x7fdcac101440 2024-09-13T21:40:33.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.685+0000 7fdcab7fe700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fdc9406d4c0 0x7fdc9406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:33.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.685+0000 7fdcab7fe700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fdc9406d4c0 0x7fdc9406f970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdcac1012a0 tx=0x7fdc9c00a3b0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:33.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.689+0000 7fdca8ff9700 1 -- 172.21.15.88:0/2683805792 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdca005c010 con 0x7fdcac101440 2024-09-13T21:40:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.918+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcac105d90 con 0x7fdc9406d4c0 2024-09-13T21:40:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.919+0000 7fdca8ff9700 1 -- 172.21.15.88:0/2683805792 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fdcac105d90 con 0x7fdc9406d4c0 2024-09-13T21:40:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fdc9406d4c0 msgr2=0x7fdc9406f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fdc9406d4c0 0x7fdc9406f970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdcac1012a0 tx=0x7fdc9c00a3b0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 msgr2=0x7fdcac195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 0x7fdcac195ff0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdca000bd70 tx=0x7fdca000bda0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 shutdown_connections 2024-09-13T21:40:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7fdc9406d4c0 0x7fdc9406f970 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcac100240 0x7fdcac195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 --2- 172.21.15.88:0/2683805792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcac101440 0x7fdcac195ff0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 >> 172.21.15.88:0/2683805792 conn(0x7fdcac0fb7f0 msgr2=0x7fdcac104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.922+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 shutdown_connections 2024-09-13T21:40:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:33.923+0000 7fdcb1fe6700 1 -- 172.21.15.88:0/2683805792 wait complete. 2024-09-13T21:40:34.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.037+0000 7f7c6468c700 1 -- 172.21.15.88:0/2565021832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c1003d0 msgr2=0x7f7c5c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.037+0000 7f7c6468c700 1 --2- 172.21.15.88:0/2565021832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c1003d0 0x7f7c5c100840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009910 tx=0x7f7c4c009c20 comp rx=0 tx=0).stop 2024-09-13T21:40:34.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.037+0000 7f7c6468c700 1 -- 172.21.15.88:0/2565021832 shutdown_connections 2024-09-13T21:40:34.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.037+0000 7f7c6468c700 1 --2- 172.21.15.88:0/2565021832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c1003d0 0x7f7c5c100840 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.037+0000 7f7c6468c700 1 --2- 172.21.15.88:0/2565021832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c5c0ff130 0x7f7c5c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.037+0000 7f7c6468c700 1 -- 172.21.15.88:0/2565021832 >> 172.21.15.88:0/2565021832 conn(0x7f7c5c0fa780 msgr2=0x7f7c5c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:34.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.037+0000 7f7c6468c700 1 -- 172.21.15.88:0/2565021832 shutdown_connections 2024-09-13T21:40:34.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.037+0000 7f7c6468c700 1 -- 172.21.15.88:0/2565021832 wait complete. 2024-09-13T21:40:34.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c6468c700 1 Processor -- start 2024-09-13T21:40:34.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c6468c700 1 -- start start 2024-09-13T21:40:34.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c6468c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c0ff130 0x7f7c5c194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:34.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c6468c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c5c1003d0 0x7f7c5c194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:34.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c6468c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c1954c0 con 0x7f7c5c0ff130 2024-09-13T21:40:34.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c6468c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c195600 con 0x7f7c5c1003d0 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c62428700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c0ff130 0x7f7c5c194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c62428700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c0ff130 0x7f7c5c194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37002/0 (socket says 172.21.15.88:37002) 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c62428700 1 -- 172.21.15.88:0/3160182299 learned_addr learned my addr 172.21.15.88:0/3160182299 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c61c27700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c5c1003d0 0x7f7c5c194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c62428700 1 -- 172.21.15.88:0/3160182299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c5c1003d0 msgr2=0x7f7c5c194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c62428700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c5c1003d0 0x7f7c5c194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.038+0000 7f7c62428700 1 -- 172.21.15.88:0/3160182299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0095f0 con 0x7f7c5c0ff130 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.039+0000 7f7c62428700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c0ff130 0x7f7c5c194960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800d900 tx=0x7f7c5800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.039+0000 7f7c537fe700 1 -- 172.21.15.88:0/3160182299 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c580041f0 con 0x7f7c5c0ff130 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.039+0000 7f7c537fe700 1 -- 172.21.15.88:0/3160182299 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7c58004ce0 con 0x7f7c5c0ff130 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.039+0000 7f7c537fe700 1 -- 172.21.15.88:0/3160182299 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c5800b750 con 0x7f7c5c0ff130 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.039+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c0686e0 con 0x7f7c5c0ff130 2024-09-13T21:40:34.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.039+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c068be0 con 0x7f7c5c0ff130 2024-09-13T21:40:34.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.040+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c107c10 con 0x7f7c5c0ff130 2024-09-13T21:40:34.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.040+0000 7f7c537fe700 1 -- 172.21.15.88:0/3160182299 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 91159+0+0 (secure 0 0 0) 0x7f7c58004e50 con 0x7f7c5c0ff130 2024-09-13T21:40:34.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.041+0000 7f7c537fe700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c4806d4c0 0x7f7c4806f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:34.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.041+0000 7f7c537fe700 1 -- 172.21.15.88:0/3160182299 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7c5808ca00 con 0x7f7c5c0ff130 2024-09-13T21:40:34.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.041+0000 7f7c61c27700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c4806d4c0 0x7f7c4806f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:34.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.041+0000 7f7c61c27700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c4806d4c0 0x7f7c4806f970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00b5c0 tx=0x7f7c4c005ee0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:34.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.046+0000 7f7c537fe700 1 -- 172.21.15.88:0/3160182299 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7c5805abc0 con 0x7f7c5c0ff130 2024-09-13T21:40:34.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.253+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c5c104d20 con 0x7f7c4806d4c0 2024-09-13T21:40:34.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.264+0000 7f7c537fe700 1 -- 172.21.15.88:0/3160182299 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3504 (secure 0 0 0) 0x7f7c5c104d20 con 0x7f7c4806d4c0 2024-09-13T21:40:34.266 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:40:34.266 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (6m) 2m ago 7m 24.7M - 0.25.0 c8568f914cd2 c82eca12b874 2024-09-13T21:40:34.266 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (8m) 2m ago 8m 7419k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:40:34.266 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (7m) 2m ago 7m 7331k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:40:34.266 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (8m) 2m ago 8m 6665k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:40:34.266 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (7m) 2m ago 7m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:40:34.266 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (6m) 2m ago 7m 88.1M - 9.4.7 954c08fa6188 aa2cd07a9c2d 2024-09-13T21:40:34.266 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (2m) 2m ago 2m 17.0M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:40:34.266 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (2m) 2m ago 2m 11.2M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (2m) 2m ago 2m 13.1M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (2m) 2m ago 2m 18.3M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:9283,8765,8443 running (9m) 2m ago 9m 489M - 18.2.0 dc2bc1663786 9fc04dc2c4a7 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 starting - - - - 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (9m) 2m ago 9m 45.0M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (6m) 2m ago 6m 34.7M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (8m) 2m ago 8m 15.7M - 1.5.0 0da6a335fe13 71ce2b0df304 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (7m) 2m ago 6m 16.1M - 1.5.0 0da6a335fe13 6d3c62590d98 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (6m) 2m ago 6m 49.6M 3946M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (5m) 2m ago 5m 50.6M 3946M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (5m) 2m ago 5m 47.0M 3946M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (4m) 2m ago 4m 46.5M 4970M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (4m) 2m ago 4m 46.5M 4970M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:40:34.267 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (3m) 2m ago 3m 44.4M 4970M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:40:34.268 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (6m) 2m ago 7m 64.3M - 2.43.0 a07b618ecd1d 85cb356d6671 2024-09-13T21:40:34.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c4806d4c0 msgr2=0x7f7c4806f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c4806d4c0 0x7f7c4806f970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00b5c0 tx=0x7f7c4c005ee0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c0ff130 msgr2=0x7f7c5c194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c0ff130 0x7f7c5c194960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800d900 tx=0x7f7c5800dc10 comp rx=0 tx=0).stop 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 shutdown_connections 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f7c4806d4c0 0x7f7c4806f970 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5c0ff130 0x7f7c5c194960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 --2- 172.21.15.88:0/3160182299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c5c1003d0 0x7f7c5c194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 >> 172.21.15.88:0/3160182299 conn(0x7f7c5c0fa780 msgr2=0x7f7c5c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 shutdown_connections 2024-09-13T21:40:34.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.267+0000 7f7c6468c700 1 -- 172.21.15.88:0/3160182299 wait complete. 2024-09-13T21:40:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.402+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/2200254146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 msgr2=0x7f4db4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.402+0000 7f4dbc6cb700 1 --2- 172.21.15.88:0/2200254146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 0x7f4db4103110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00b0a0 tx=0x7f4dac00b3b0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.402+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/2200254146 shutdown_connections 2024-09-13T21:40:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.402+0000 7f4dbc6cb700 1 --2- 172.21.15.88:0/2200254146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4db4103650 0x7f4db4105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.402+0000 7f4dbc6cb700 1 --2- 172.21.15.88:0/2200254146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 0x7f4db4103110 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.402+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/2200254146 >> 172.21.15.88:0/2200254146 conn(0x7f4db40fa6d0 msgr2=0x7f4db40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.402+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/2200254146 shutdown_connections 2024-09-13T21:40:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.402+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/2200254146 wait complete. 2024-09-13T21:40:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.403+0000 7f4dbc6cb700 1 Processor -- start 2024-09-13T21:40:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.403+0000 7f4dbc6cb700 1 -- start start 2024-09-13T21:40:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.403+0000 7f4dbc6cb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 0x7f4db4195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.403+0000 7f4dbc6cb700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4db4103650 0x7f4db4195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.403+0000 7f4dbc6cb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db41965c0 con 0x7f4db4100d30 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.403+0000 7f4dbc6cb700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4196700 con 0x7f4db4103650 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.403+0000 7f4dba467700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 0x7f4db4195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.403+0000 7f4dba467700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 0x7f4db4195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37016/0 (socket says 172.21.15.88:37016) 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.403+0000 7f4dba467700 1 -- 172.21.15.88:0/359129453 learned_addr learned my addr 172.21.15.88:0/359129453 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4db9c66700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4db4103650 0x7f4db4195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4dba467700 1 -- 172.21.15.88:0/359129453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4db4103650 msgr2=0x7f4db4195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4dba467700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4db4103650 0x7f4db4195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4dba467700 1 -- 172.21.15.88:0/359129453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac009d00 con 0x7f4db4100d30 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4dba467700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 0x7f4db4195a60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00d010 tx=0x7f4dac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4db37fe700 1 -- 172.21.15.88:0/359129453 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dac00e040 con 0x7f4db4100d30 2024-09-13T21:40:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4db37fe700 1 -- 172.21.15.88:0/359129453 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4dac003c10 con 0x7f4db4100d30 2024-09-13T21:40:34.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4db37fe700 1 -- 172.21.15.88:0/359129453 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dac0043b0 con 0x7f4db4100d30 2024-09-13T21:40:34.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db40feb20 con 0x7f4db4100d30 2024-09-13T21:40:34.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.404+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db40ff020 con 0x7f4db4100d30 2024-09-13T21:40:34.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.405+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db418fc60 con 0x7f4db4100d30 2024-09-13T21:40:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.406+0000 7f4db37fe700 1 -- 172.21.15.88:0/359129453 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 91159+0+0 (secure 0 0 0) 0x7f4dac01bbd0 con 0x7f4db4100d30 2024-09-13T21:40:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.406+0000 7f4db37fe700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4d9c06d4c0 0x7f4d9c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.406+0000 7f4db37fe700 1 -- 172.21.15.88:0/359129453 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4dac091ba0 con 0x7f4db4100d30 2024-09-13T21:40:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.406+0000 7f4db9c66700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4d9c06d4c0 0x7f4d9c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.407+0000 7f4db9c66700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4d9c06d4c0 0x7f4d9c06f970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009c60 tx=0x7f4da8009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.411+0000 7f4db37fe700 1 -- 172.21.15.88:0/359129453 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4dac05fcc0 con 0x7f4db4100d30 2024-09-13T21:40:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.713+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4db41004d0 con 0x7f4db4100d30 2024-09-13T21:40:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.714+0000 7f4db37fe700 1 -- 172.21.15.88:0/359129453 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7f4dac017070 con 0x7f4db4100d30 2024-09-13T21:40:34.715 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:40:34.715 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:40:34.716 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:40:34.717 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-09-13T21:40:34.717 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:40:34.717 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:40:34.717 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:40:34.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.715+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4d9c06d4c0 msgr2=0x7f4d9c06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4d9c06d4c0 0x7f4d9c06f970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009c60 tx=0x7f4da8009260 comp rx=0 tx=0).stop 2024-09-13T21:40:34.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 msgr2=0x7f4db4195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 0x7f4db4195a60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00d010 tx=0x7f4dac009750 comp rx=0 tx=0).stop 2024-09-13T21:40:34.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 shutdown_connections 2024-09-13T21:40:34.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f4d9c06d4c0 0x7f4d9c06f970 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db4100d30 0x7f4db4195a60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 --2- 172.21.15.88:0/359129453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4db4103650 0x7f4db4195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 >> 172.21.15.88:0/359129453 conn(0x7f4db40fa6d0 msgr2=0x7f4db40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:34.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 shutdown_connections 2024-09-13T21:40:34.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.716+0000 7f4dbc6cb700 1 -- 172.21.15.88:0/359129453 wait complete. 2024-09-13T21:40:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.823+0000 7f1826255700 1 -- 172.21.15.88:0/2908714464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 msgr2=0x7f1820100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.823+0000 7f1826255700 1 --2- 172.21.15.88:0/2908714464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 0x7f1820100860 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1814009910 tx=0x7f1814009c20 comp rx=0 tx=0).stop 2024-09-13T21:40:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.823+0000 7f1826255700 1 -- 172.21.15.88:0/2908714464 shutdown_connections 2024-09-13T21:40:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.823+0000 7f1826255700 1 --2- 172.21.15.88:0/2908714464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 0x7f1820100860 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.823+0000 7f1826255700 1 --2- 172.21.15.88:0/2908714464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18200ff150 0x7f18200ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.823+0000 7f1826255700 1 -- 172.21.15.88:0/2908714464 >> 172.21.15.88:0/2908714464 conn(0x7f18200fa7a0 msgr2=0x7f18200fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.823+0000 7f1826255700 1 -- 172.21.15.88:0/2908714464 shutdown_connections 2024-09-13T21:40:34.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.823+0000 7f1826255700 1 -- 172.21.15.88:0/2908714464 wait complete. 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.823+0000 7f1826255700 1 Processor -- start 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f1826255700 1 -- start start 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f1826255700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18200ff150 0x7f1820103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f1826255700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 0x7f18201017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f1826255700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1820101d10 con 0x7f18201003f0 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f1826255700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1820101e50 con 0x7f18200ff150 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f181effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 0x7f18201017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f181effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 0x7f18201017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37036/0 (socket says 172.21.15.88:37036) 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f181effd700 1 -- 172.21.15.88:0/590621552 learned_addr learned my addr 172.21.15.88:0/590621552 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f181f7fe700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18200ff150 0x7f1820103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f181effd700 1 -- 172.21.15.88:0/590621552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18200ff150 msgr2=0x7f1820103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f181effd700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18200ff150 0x7f1820103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f181effd700 1 -- 172.21.15.88:0/590621552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140095f0 con 0x7f18201003f0 2024-09-13T21:40:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.824+0000 7f181effd700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 0x7f18201017d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f181400bd70 tx=0x7f181400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.825+0000 7f181cff9700 1 -- 172.21.15.88:0/590621552 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f181401d070 con 0x7f18201003f0 2024-09-13T21:40:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.825+0000 7f181cff9700 1 -- 172.21.15.88:0/590621552 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1814005940 con 0x7f18201003f0 2024-09-13T21:40:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.825+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18201020d0 con 0x7f18201003f0 2024-09-13T21:40:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.825+0000 7f181cff9700 1 -- 172.21.15.88:0/590621552 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1814021430 con 0x7f18201003f0 2024-09-13T21:40:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.825+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18201025c0 con 0x7f18201003f0 2024-09-13T21:40:34.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.826+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1820068ab0 con 0x7f18201003f0 2024-09-13T21:40:34.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.826+0000 7f181cff9700 1 -- 172.21.15.88:0/590621552 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 20) v1 ==== 91159+0+0 (secure 0 0 0) 0x7f181400f860 con 0x7f18201003f0 2024-09-13T21:40:34.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.827+0000 7f181cff9700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f180806d4c0 0x7f180806f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:34.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.827+0000 7f181cff9700 1 -- 172.21.15.88:0/590621552 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f181408df60 con 0x7f18201003f0 2024-09-13T21:40:34.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.827+0000 7f181f7fe700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f180806d4c0 0x7f180806f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:34.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.827+0000 7f181f7fe700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f180806d4c0 0x7f180806f970 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f181000f440 tx=0x7f18100079e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:34.831+0000 7f181cff9700 1 -- 172.21.15.88:0/590621552 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f18140c0720 con 0x7f18201003f0 2024-09-13T21:40:35.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.055+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 --> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18200694e0 con 0x7f180806d4c0 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.056+0000 7f181cff9700 1 -- 172.21.15.88:0/590621552 <== mgr.14211 v2:172.21.15.88:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f18200694e0 con 0x7f180806d4c0 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "", 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:40:35.058 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:40:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f180806d4c0 msgr2=0x7f180806f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f180806d4c0 0x7f180806f970 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f181000f440 tx=0x7f18100079e0 comp rx=0 tx=0).stop 2024-09-13T21:40:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 msgr2=0x7f18201017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 0x7f18201017d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f181400bd70 tx=0x7f181400bda0 comp rx=0 tx=0).stop 2024-09-13T21:40:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 shutdown_connections 2024-09-13T21:40:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:6800/2,v1:172.21.15.88:6801/2] conn(0x7f180806d4c0 0x7f180806f970 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18200ff150 0x7f1820103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 --2- 172.21.15.88:0/590621552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18201003f0 0x7f18201017d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 >> 172.21.15.88:0/590621552 conn(0x7f18200fa7a0 msgr2=0x7f1820068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:35.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 shutdown_connections 2024-09-13T21:40:35.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:40:35.059+0000 7f1826255700 1 -- 172.21.15.88:0/590621552 wait complete. 2024-09-13T21:40:35.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:35 smithi088 ceph-mon[27963]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:35.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:35 smithi088 ceph-mon[27963]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:35.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:35 smithi088 ceph-mon[27963]: pgmap v257: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 216 MiB/s rd, 284 MiB/s wr, 396 op/s 2024-09-13T21:40:35.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:35 smithi088 ceph-mon[27963]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:35.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:35 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/359129453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:40:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:35 smithi116 ceph-mon[33391]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:35 smithi116 ceph-mon[33391]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:35 smithi116 ceph-mon[33391]: pgmap v257: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 216 MiB/s rd, 284 MiB/s wr, 396 op/s 2024-09-13T21:40:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:35 smithi116 ceph-mon[33391]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:35 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/359129453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:40:35.623 INFO:tasks.workunit.client.1.smithi116.stdout:1/17: sync 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:2/31: sync 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:3/107: sync 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:6/20: sync 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:5/144: sync 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:9/18: sync 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:6/21: stat f3 0 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:5/145: stat d7/da/f19 0 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:3/108: fdatasync d3/db/d10/f13 0 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:8/41: sync 2024-09-13T21:40:35.645 INFO:tasks.workunit.client.1.smithi116.stdout:9/19: write d2/f4 [776200,30590] 0 2024-09-13T21:40:35.646 INFO:tasks.workunit.client.1.smithi116.stdout:5/146: rename d7/c18 to d7/c2e 0 2024-09-13T21:40:35.646 INFO:tasks.workunit.client.1.smithi116.stdout:6/22: mknod c7 0 2024-09-13T21:40:35.647 INFO:tasks.workunit.client.1.smithi116.stdout:2/32: mkdir d0/d5/d8 0 2024-09-13T21:40:35.647 INFO:tasks.workunit.client.1.smithi116.stdout:2/33: truncate - no filename 2024-09-13T21:40:35.649 INFO:tasks.workunit.client.1.smithi116.stdout:5/147: creat d7/f2f x:0 0 0 2024-09-13T21:40:35.650 INFO:tasks.workunit.client.1.smithi116.stdout:2/34: mknod d0/d5/c9 0 2024-09-13T21:40:35.651 INFO:tasks.workunit.client.1.smithi116.stdout:5/148: creat d7/da/d21/f30 x:0 0 0 2024-09-13T21:40:35.652 INFO:tasks.workunit.client.1.smithi116.stdout:2/35: mkdir d0/da 0 2024-09-13T21:40:35.653 INFO:tasks.workunit.client.1.smithi116.stdout:2/36: creat d0/d5/d8/fb x:0 0 0 2024-09-13T21:40:35.657 INFO:tasks.workunit.client.1.smithi116.stdout:7/61: sync 2024-09-13T21:40:35.657 INFO:tasks.workunit.client.1.smithi116.stdout:0/39: sync 2024-09-13T21:40:35.657 INFO:tasks.workunit.client.1.smithi116.stdout:4/54: sync 2024-09-13T21:40:35.658 INFO:tasks.workunit.client.1.smithi116.stdout:4/55: symlink d0/l11 0 2024-09-13T21:40:35.659 INFO:tasks.workunit.client.1.smithi116.stdout:9/20: write d2/f3 [369051,54077] 0 2024-09-13T21:40:35.660 INFO:tasks.workunit.client.1.smithi116.stdout:7/62: symlink d5/d9/l13 0 2024-09-13T21:40:35.662 INFO:tasks.workunit.client.1.smithi116.stdout:0/40: creat d2/dc/fe x:0 0 0 2024-09-13T21:40:35.662 INFO:tasks.workunit.client.1.smithi116.stdout:5/149: getdents d7/da/d21 0 2024-09-13T21:40:35.665 INFO:tasks.workunit.client.1.smithi116.stdout:4/56: unlink d0/ff 0 2024-09-13T21:40:35.669 INFO:tasks.workunit.client.1.smithi116.stdout:7/63: link d5/d9/f10 d5/d9/f14 0 2024-09-13T21:40:35.670 INFO:tasks.workunit.client.1.smithi116.stdout:0/41: mkdir d2/dc/df 0 2024-09-13T21:40:35.671 INFO:tasks.workunit.client.1.smithi116.stdout:9/21: getdents d2 0 2024-09-13T21:40:35.672 INFO:tasks.workunit.client.1.smithi116.stdout:9/22: chown c1 683 1 2024-09-13T21:40:35.673 INFO:tasks.workunit.client.1.smithi116.stdout:0/42: symlink d2/dc/l10 0 2024-09-13T21:40:35.679 INFO:tasks.workunit.client.1.smithi116.stdout:9/23: fdatasync d2/f3 0 2024-09-13T21:40:35.681 INFO:tasks.workunit.client.1.smithi116.stdout:9/24: dread f0 [0,4194304] 0 2024-09-13T21:40:35.681 INFO:tasks.workunit.client.1.smithi116.stdout:9/25: write d2/f3 [1195454,53624] 0 2024-09-13T21:40:35.682 INFO:tasks.workunit.client.1.smithi116.stdout:8/42: dwrite d2/f8 [4194304,4194304] 0 2024-09-13T21:40:35.682 INFO:tasks.workunit.client.1.smithi116.stdout:8/43: creat d2/fd x:0 0 0 2024-09-13T21:40:35.682 INFO:tasks.workunit.client.1.smithi116.stdout:8/44: truncate d2/fd 165961 0 2024-09-13T21:40:35.682 INFO:tasks.workunit.client.1.smithi116.stdout:9/26: mknod d2/c6 0 2024-09-13T21:40:35.682 INFO:tasks.workunit.client.1.smithi116.stdout:9/27: chown d2 1679 1 2024-09-13T21:40:35.685 INFO:tasks.workunit.client.1.smithi116.stdout:6/23: dwrite f4 [4194304,4194304] 0 2024-09-13T21:40:35.686 INFO:tasks.workunit.client.1.smithi116.stdout:8/45: mknod d2/ce 0 2024-09-13T21:40:35.687 INFO:tasks.workunit.client.1.smithi116.stdout:2/37: dwrite d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.688 INFO:tasks.workunit.client.1.smithi116.stdout:9/28: creat d2/f7 x:0 0 0 2024-09-13T21:40:35.690 INFO:tasks.workunit.client.1.smithi116.stdout:8/46: link d2/lc d2/lf 0 2024-09-13T21:40:35.690 INFO:tasks.workunit.client.1.smithi116.stdout:0/43: dread d2/d5/f8 [0,4194304] 0 2024-09-13T21:40:35.691 INFO:tasks.workunit.client.1.smithi116.stdout:9/29: mkdir d2/d8 0 2024-09-13T21:40:35.691 INFO:tasks.workunit.client.1.smithi116.stdout:9/30: chown d2/f3 32637 1 2024-09-13T21:40:35.692 INFO:tasks.workunit.client.1.smithi116.stdout:8/47: truncate d2/fa 473255 0 2024-09-13T21:40:35.692 INFO:tasks.workunit.client.1.smithi116.stdout:9/31: mknod d2/d8/c9 0 2024-09-13T21:40:35.693 INFO:tasks.workunit.client.1.smithi116.stdout:8/48: mkdir d2/d10 0 2024-09-13T21:40:35.696 INFO:tasks.workunit.client.1.smithi116.stdout:8/49: unlink d2/lc 0 2024-09-13T21:40:35.696 INFO:tasks.workunit.client.1.smithi116.stdout:8/50: readlink d2/lf 0 2024-09-13T21:40:35.697 INFO:tasks.workunit.client.1.smithi116.stdout:8/51: creat d2/d10/f11 x:0 0 0 2024-09-13T21:40:35.698 INFO:tasks.workunit.client.1.smithi116.stdout:7/64: dwrite d5/d9/db/f12 [0,4194304] 0 2024-09-13T21:40:35.698 INFO:tasks.workunit.client.1.smithi116.stdout:8/52: symlink d2/l12 0 2024-09-13T21:40:35.700 INFO:tasks.workunit.client.1.smithi116.stdout:7/65: link d5/d9/l13 d5/l15 0 2024-09-13T21:40:35.703 INFO:tasks.workunit.client.1.smithi116.stdout:7/66: creat d5/f16 x:0 0 0 2024-09-13T21:40:35.703 INFO:tasks.workunit.client.1.smithi116.stdout:7/67: write d5/d9/f10 [5427037,126737] 0 2024-09-13T21:40:35.703 INFO:tasks.workunit.client.1.smithi116.stdout:7/68: readlink d5/d9/db/l11 0 2024-09-13T21:40:35.705 INFO:tasks.workunit.client.1.smithi116.stdout:0/44: dread d2/fb [0,4194304] 0 2024-09-13T21:40:35.705 INFO:tasks.workunit.client.1.smithi116.stdout:2/38: dread d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.705 INFO:tasks.workunit.client.1.smithi116.stdout:0/45: chown d2/dc/fe 101 1 2024-09-13T21:40:35.705 INFO:tasks.workunit.client.1.smithi116.stdout:2/39: chown d0/c3 897 1 2024-09-13T21:40:35.705 INFO:tasks.workunit.client.1.smithi116.stdout:0/46: truncate d2/fb 4458588 0 2024-09-13T21:40:35.705 INFO:tasks.workunit.client.1.smithi116.stdout:6/24: truncate f4 5160109 0 2024-09-13T21:40:35.705 INFO:tasks.workunit.client.1.smithi116.stdout:5/150: dwrite f1 [0,4194304] 0 2024-09-13T21:40:35.705 INFO:tasks.workunit.client.1.smithi116.stdout:0/47: mknod d2/d5/c11 0 2024-09-13T21:40:35.706 INFO:tasks.workunit.client.1.smithi116.stdout:9/32: getdents d2/d8 0 2024-09-13T21:40:35.706 INFO:tasks.workunit.client.1.smithi116.stdout:9/33: fdatasync d2/f3 0 2024-09-13T21:40:35.707 INFO:tasks.workunit.client.1.smithi116.stdout:6/25: mkdir d8 0 2024-09-13T21:40:35.708 INFO:tasks.workunit.client.1.smithi116.stdout:0/48: rename d2/dc/df to d2/dc/d12 0 2024-09-13T21:40:35.709 INFO:tasks.workunit.client.1.smithi116.stdout:0/49: creat d2/d5/f13 x:0 0 0 2024-09-13T21:40:35.709 INFO:tasks.workunit.client.1.smithi116.stdout:0/50: read - d2/dc/fe zero size 2024-09-13T21:40:35.709 INFO:tasks.workunit.client.1.smithi116.stdout:0/51: fsync d2/d5/fd 0 2024-09-13T21:40:35.712 INFO:tasks.workunit.client.1.smithi116.stdout:9/34: rename d2/c6 to d2/ca 0 2024-09-13T21:40:35.713 INFO:tasks.workunit.client.1.smithi116.stdout:9/35: chown d2 63 1 2024-09-13T21:40:35.717 INFO:tasks.workunit.client.1.smithi116.stdout:9/36: write d2/f3 [729256,104908] 0 2024-09-13T21:40:35.725 INFO:tasks.workunit.client.1.smithi116.stdout:9/37: symlink d2/d8/lb 0 2024-09-13T21:40:35.725 INFO:tasks.workunit.client.1.smithi116.stdout:9/38: fdatasync d2/f7 0 2024-09-13T21:40:35.727 INFO:tasks.workunit.client.1.smithi116.stdout:0/52: rmdir d2/dc 39 2024-09-13T21:40:35.730 INFO:tasks.workunit.client.1.smithi116.stdout:7/69: dwrite f2 [0,4194304] 0 2024-09-13T21:40:35.730 INFO:tasks.workunit.client.1.smithi116.stdout:7/70: write d5/d9/db/ff [866660,102621] 0 2024-09-13T21:40:35.730 INFO:tasks.workunit.client.1.smithi116.stdout:7/71: readlink d5/ld 0 2024-09-13T21:40:35.731 INFO:tasks.workunit.client.1.smithi116.stdout:7/72: stat l3 0 2024-09-13T21:40:35.743 INFO:tasks.workunit.client.1.smithi116.stdout:7/73: write d5/d9/db/f12 [1655095,44796] 0 2024-09-13T21:40:35.745 INFO:tasks.workunit.client.1.smithi116.stdout:7/74: creat d5/d9/f17 x:0 0 0 2024-09-13T21:40:35.745 INFO:tasks.workunit.client.1.smithi116.stdout:7/75: creat d5/f18 x:0 0 0 2024-09-13T21:40:35.745 INFO:tasks.workunit.client.1.smithi116.stdout:7/76: write d5/d9/db/ff [1051606,41281] 0 2024-09-13T21:40:35.746 INFO:tasks.workunit.client.1.smithi116.stdout:7/77: mknod d5/d9/db/c19 0 2024-09-13T21:40:35.746 INFO:tasks.workunit.client.1.smithi116.stdout:7/78: chown d5 224 1 2024-09-13T21:40:35.748 INFO:tasks.workunit.client.1.smithi116.stdout:5/151: dwrite d7/da/f1b [0,4194304] 0 2024-09-13T21:40:35.748 INFO:tasks.workunit.client.1.smithi116.stdout:2/40: dwrite d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.753 INFO:tasks.workunit.client.1.smithi116.stdout:9/39: dread d2/f3 [0,4194304] 0 2024-09-13T21:40:35.753 INFO:tasks.workunit.client.1.smithi116.stdout:9/40: write d2/f4 [1123084,80771] 0 2024-09-13T21:40:35.753 INFO:tasks.workunit.client.1.smithi116.stdout:9/41: creat d2/fc x:0 0 0 2024-09-13T21:40:35.753 INFO:tasks.workunit.client.1.smithi116.stdout:6/26: dwrite f4 [0,4194304] 0 2024-09-13T21:40:35.753 INFO:tasks.workunit.client.1.smithi116.stdout:6/27: truncate f3 614993 0 2024-09-13T21:40:35.753 INFO:tasks.workunit.client.1.smithi116.stdout:6/28: chown c7 10 1 2024-09-13T21:40:35.753 INFO:tasks.workunit.client.1.smithi116.stdout:6/29: chown f3 171313824 1 2024-09-13T21:40:35.754 INFO:tasks.workunit.client.1.smithi116.stdout:9/42: stat d2/ca 0 2024-09-13T21:40:35.757 INFO:tasks.workunit.client.1.smithi116.stdout:6/30: rename c7 to d8/c9 0 2024-09-13T21:40:35.757 INFO:tasks.workunit.client.1.smithi116.stdout:6/31: write f5 [227943,89955] 0 2024-09-13T21:40:35.757 INFO:tasks.workunit.client.1.smithi116.stdout:6/32: chown f3 5709 1 2024-09-13T21:40:35.758 INFO:tasks.workunit.client.1.smithi116.stdout:6/33: creat d8/fa x:0 0 0 2024-09-13T21:40:35.759 INFO:tasks.workunit.client.1.smithi116.stdout:0/53: dwrite d2/f7 [0,4194304] 0 2024-09-13T21:40:35.759 INFO:tasks.workunit.client.1.smithi116.stdout:0/54: truncate d2/dc/fe 575430 0 2024-09-13T21:40:35.762 INFO:tasks.workunit.client.1.smithi116.stdout:2/41: dread d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.769 INFO:tasks.workunit.client.1.smithi116.stdout:9/43: dread d2/f4 [0,4194304] 0 2024-09-13T21:40:35.769 INFO:tasks.workunit.client.1.smithi116.stdout:2/42: dread d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.769 INFO:tasks.workunit.client.1.smithi116.stdout:5/152: dwrite d7/da/f19 [0,4194304] 0 2024-09-13T21:40:35.778 INFO:tasks.workunit.client.1.smithi116.stdout:2/43: dread d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.780 INFO:tasks.workunit.client.1.smithi116.stdout:2/44: truncate d0/d5/d8/fb 2267806 0 2024-09-13T21:40:35.781 INFO:tasks.workunit.client.1.smithi116.stdout:2/45: symlink d0/da/lc 0 2024-09-13T21:40:35.782 INFO:tasks.workunit.client.1.smithi116.stdout:2/46: mkdir d0/da/dd 0 2024-09-13T21:40:35.791 INFO:tasks.workunit.client.1.smithi116.stdout:2/47: write d0/d5/d8/fb [2407931,80023] 0 2024-09-13T21:40:35.797 INFO:tasks.workunit.client.1.smithi116.stdout:7/79: dwrite d5/d9/f10 [0,4194304] 0 2024-09-13T21:40:35.797 INFO:tasks.workunit.client.1.smithi116.stdout:7/80: stat d5/f16 0 2024-09-13T21:40:35.798 INFO:tasks.workunit.client.1.smithi116.stdout:7/81: mknod d5/d9/c1a 0 2024-09-13T21:40:35.799 INFO:tasks.workunit.client.1.smithi116.stdout:7/82: symlink d5/d9/l1b 0 2024-09-13T21:40:35.799 INFO:tasks.workunit.client.1.smithi116.stdout:6/34: dwrite f4 [0,4194304] 0 2024-09-13T21:40:35.799 INFO:tasks.workunit.client.1.smithi116.stdout:0/55: dwrite d2/dc/fe [0,4194304] 0 2024-09-13T21:40:35.800 INFO:tasks.workunit.client.1.smithi116.stdout:7/83: mkdir d5/d9/d1c 0 2024-09-13T21:40:35.800 INFO:tasks.workunit.client.1.smithi116.stdout:7/84: fdatasync d5/d9/db/fe 0 2024-09-13T21:40:35.801 INFO:tasks.workunit.client.1.smithi116.stdout:9/44: dwrite d2/f7 [0,4194304] 0 2024-09-13T21:40:35.801 INFO:tasks.workunit.client.1.smithi116.stdout:9/45: fdatasync d2/f7 0 2024-09-13T21:40:35.801 INFO:tasks.workunit.client.1.smithi116.stdout:9/46: dread - d2/fc zero size 2024-09-13T21:40:35.801 INFO:tasks.workunit.client.1.smithi116.stdout:5/153: dwrite d7/da/d21/f30 [0,4194304] 0 2024-09-13T21:40:35.801 INFO:tasks.workunit.client.1.smithi116.stdout:6/35: rename c2 to d8/cb 0 2024-09-13T21:40:35.803 INFO:tasks.workunit.client.1.smithi116.stdout:7/85: mknod d5/d9/c1d 0 2024-09-13T21:40:35.807 INFO:tasks.workunit.client.1.smithi116.stdout:5/154: mknod d7/da/c31 0 2024-09-13T21:40:35.807 INFO:tasks.workunit.client.1.smithi116.stdout:5/155: read d7/da/f1c [3213018,113793] 0 2024-09-13T21:40:35.807 INFO:tasks.workunit.client.1.smithi116.stdout:5/156: chown d7/da/d21 0 1 2024-09-13T21:40:35.808 INFO:tasks.workunit.client.1.smithi116.stdout:5/157: chown d7/da/d21/f30 2 1 2024-09-13T21:40:35.808 INFO:tasks.workunit.client.1.smithi116.stdout:5/158: chown d7/da/d21/f30 921 1 2024-09-13T21:40:35.808 INFO:tasks.workunit.client.1.smithi116.stdout:2/48: dread d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.810 INFO:tasks.workunit.client.1.smithi116.stdout:5/159: truncate d7/fc 1858845 0 2024-09-13T21:40:35.811 INFO:tasks.workunit.client.1.smithi116.stdout:0/56: dread d2/f7 [0,4194304] 0 2024-09-13T21:40:35.812 INFO:tasks.workunit.client.1.smithi116.stdout:0/57: rename d2/dc to d2/dc/d12/d14 22 2024-09-13T21:40:35.812 INFO:tasks.workunit.client.1.smithi116.stdout:2/49: creat d0/fe x:0 0 0 2024-09-13T21:40:35.812 INFO:tasks.workunit.client.1.smithi116.stdout:9/47: write d2/f7 [2773327,109285] 0 2024-09-13T21:40:35.813 INFO:tasks.workunit.client.1.smithi116.stdout:6/36: link d8/cb d8/cc 0 2024-09-13T21:40:35.815 INFO:tasks.workunit.client.1.smithi116.stdout:0/58: mknod d2/c15 0 2024-09-13T21:40:35.815 INFO:tasks.workunit.client.1.smithi116.stdout:0/59: write d2/d5/f8 [4025744,101121] 0 2024-09-13T21:40:35.815 INFO:tasks.workunit.client.1.smithi116.stdout:2/50: write d0/d5/d8/fb [317062,9670] 0 2024-09-13T21:40:35.815 INFO:tasks.workunit.client.1.smithi116.stdout:2/51: stat d0/da 0 2024-09-13T21:40:35.816 INFO:tasks.workunit.client.1.smithi116.stdout:9/48: creat d2/d8/fd x:0 0 0 2024-09-13T21:40:35.819 INFO:tasks.workunit.client.1.smithi116.stdout:0/60: rename d2/d5/f8 to d2/d5/f16 0 2024-09-13T21:40:35.820 INFO:tasks.workunit.client.1.smithi116.stdout:5/160: rmdir d7 39 2024-09-13T21:40:35.822 INFO:tasks.workunit.client.1.smithi116.stdout:7/86: truncate d5/d9/f14 637183 0 2024-09-13T21:40:35.823 INFO:tasks.workunit.client.1.smithi116.stdout:0/61: creat d2/dc/d12/f17 x:0 0 0 2024-09-13T21:40:35.824 INFO:tasks.workunit.client.1.smithi116.stdout:0/62: write d2/d5/f9 [79062,100515] 0 2024-09-13T21:40:35.825 INFO:tasks.workunit.client.1.smithi116.stdout:6/37: getdents d8 0 2024-09-13T21:40:35.829 INFO:tasks.workunit.client.1.smithi116.stdout:9/49: rmdir d2 39 2024-09-13T21:40:35.830 INFO:tasks.workunit.client.1.smithi116.stdout:7/87: mknod d5/c1e 0 2024-09-13T21:40:35.830 INFO:tasks.workunit.client.1.smithi116.stdout:7/88: dread - d5/d9/f17 zero size 2024-09-13T21:40:35.830 INFO:tasks.workunit.client.1.smithi116.stdout:0/63: getdents d2/dc 0 2024-09-13T21:40:35.832 INFO:tasks.workunit.client.1.smithi116.stdout:6/38: link d8/fa d8/fd 0 2024-09-13T21:40:35.832 INFO:tasks.workunit.client.1.smithi116.stdout:6/39: write f3 [532854,114866] 0 2024-09-13T21:40:35.833 INFO:tasks.workunit.client.1.smithi116.stdout:9/50: symlink d2/d8/le 0 2024-09-13T21:40:35.833 INFO:tasks.workunit.client.1.smithi116.stdout:9/51: fdatasync d2/f5 0 2024-09-13T21:40:35.834 INFO:tasks.workunit.client.1.smithi116.stdout:2/52: dwrite d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.836 INFO:tasks.workunit.client.1.smithi116.stdout:7/89: rename d5/d9/c1d to d5/d9/db/c1f 0 2024-09-13T21:40:35.837 INFO:tasks.workunit.client.1.smithi116.stdout:0/64: creat d2/f18 x:0 0 0 2024-09-13T21:40:35.838 INFO:tasks.workunit.client.1.smithi116.stdout:6/40: creat d8/fe x:0 0 0 2024-09-13T21:40:35.839 INFO:tasks.workunit.client.1.smithi116.stdout:9/52: getdents d2 0 2024-09-13T21:40:35.839 INFO:tasks.workunit.client.1.smithi116.stdout:9/53: write d2/d8/fd [276754,39245] 0 2024-09-13T21:40:35.840 INFO:tasks.workunit.client.1.smithi116.stdout:9/54: chown d2/d8/lb 48388 1 2024-09-13T21:40:35.840 INFO:tasks.workunit.client.1.smithi116.stdout:2/53: mknod d0/d5/cf 0 2024-09-13T21:40:35.843 INFO:tasks.workunit.client.1.smithi116.stdout:0/65: rename d2/c15 to d2/dc/d12/c19 0 2024-09-13T21:40:35.844 INFO:tasks.workunit.client.1.smithi116.stdout:5/161: write d7/fc [1150315,4789] 0 2024-09-13T21:40:35.845 INFO:tasks.workunit.client.1.smithi116.stdout:6/41: creat d8/ff x:0 0 0 2024-09-13T21:40:35.845 INFO:tasks.workunit.client.1.smithi116.stdout:6/42: write f4 [5986934,80690] 0 2024-09-13T21:40:35.845 INFO:tasks.workunit.client.1.smithi116.stdout:6/43: write d8/ff [184255,106934] 0 2024-09-13T21:40:35.845 INFO:tasks.workunit.client.1.smithi116.stdout:6/44: chown d8/fe 3 1 2024-09-13T21:40:35.845 INFO:tasks.workunit.client.1.smithi116.stdout:6/45: write f5 [231519,113738] 0 2024-09-13T21:40:35.845 INFO:tasks.workunit.client.1.smithi116.stdout:6/46: write f4 [6126103,72235] 0 2024-09-13T21:40:35.845 INFO:tasks.workunit.client.1.smithi116.stdout:6/47: write d8/fe [438280,63425] 0 2024-09-13T21:40:35.846 INFO:tasks.workunit.client.1.smithi116.stdout:7/90: rmdir d5/d9/db 39 2024-09-13T21:40:35.849 INFO:tasks.workunit.client.1.smithi116.stdout:9/55: dread d2/f7 [0,4194304] 0 2024-09-13T21:40:35.849 INFO:tasks.workunit.client.1.smithi116.stdout:9/56: stat d2/d8/fd 0 2024-09-13T21:40:35.850 INFO:tasks.workunit.client.1.smithi116.stdout:7/91: symlink d5/d9/db/l20 0 2024-09-13T21:40:35.851 INFO:tasks.workunit.client.1.smithi116.stdout:0/66: getdents d2/d5 0 2024-09-13T21:40:35.851 INFO:tasks.workunit.client.1.smithi116.stdout:0/67: write d2/d5/f16 [858476,8141] 0 2024-09-13T21:40:35.853 INFO:tasks.workunit.client.1.smithi116.stdout:6/48: mkdir d8/d10 0 2024-09-13T21:40:35.856 INFO:tasks.workunit.client.1.smithi116.stdout:5/162: write d7/f16 [638868,14607] 0 2024-09-13T21:40:35.858 INFO:tasks.workunit.client.1.smithi116.stdout:6/49: getdents d8 0 2024-09-13T21:40:35.859 INFO:tasks.workunit.client.1.smithi116.stdout:6/50: mknod d8/d10/c11 0 2024-09-13T21:40:35.861 INFO:tasks.workunit.client.1.smithi116.stdout:0/68: write d2/dc/fe [1953717,125036] 0 2024-09-13T21:40:35.862 INFO:tasks.workunit.client.1.smithi116.stdout:0/69: mknod d2/d5/c1a 0 2024-09-13T21:40:35.862 INFO:tasks.workunit.client.1.smithi116.stdout:0/70: chown d2/ca 96046 1 2024-09-13T21:40:35.862 INFO:tasks.workunit.client.1.smithi116.stdout:0/71: write d2/d5/f13 [308604,78597] 0 2024-09-13T21:40:35.863 INFO:tasks.workunit.client.1.smithi116.stdout:0/72: stat d2/dc/fe 0 2024-09-13T21:40:35.863 INFO:tasks.workunit.client.1.smithi116.stdout:0/73: read d2/d5/f9 [152680,33199] 0 2024-09-13T21:40:35.863 INFO:tasks.workunit.client.1.smithi116.stdout:0/74: symlink d2/dc/l1b 0 2024-09-13T21:40:35.863 INFO:tasks.workunit.client.1.smithi116.stdout:0/75: stat d2/dc 0 2024-09-13T21:40:35.863 INFO:tasks.workunit.client.1.smithi116.stdout:0/76: chown d2/d5/c1a 6948 1 2024-09-13T21:40:35.864 INFO:tasks.workunit.client.1.smithi116.stdout:0/77: rmdir d2/d5 39 2024-09-13T21:40:35.865 INFO:tasks.workunit.client.1.smithi116.stdout:0/78: mknod d2/dc/d12/c1c 0 2024-09-13T21:40:35.865 INFO:tasks.workunit.client.1.smithi116.stdout:0/79: creat d2/f1d x:0 0 0 2024-09-13T21:40:35.865 INFO:tasks.workunit.client.1.smithi116.stdout:0/80: read d2/dc/fe [1212722,97318] 0 2024-09-13T21:40:35.866 INFO:tasks.workunit.client.1.smithi116.stdout:7/92: write f2 [3100756,80880] 0 2024-09-13T21:40:35.866 INFO:tasks.workunit.client.1.smithi116.stdout:7/93: truncate d5/f18 410409 0 2024-09-13T21:40:35.867 INFO:tasks.workunit.client.1.smithi116.stdout:2/54: dwrite d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.867 INFO:tasks.workunit.client.1.smithi116.stdout:2/55: fdatasync d0/d5/d8/fb 0 2024-09-13T21:40:35.869 INFO:tasks.workunit.client.1.smithi116.stdout:2/56: creat d0/d5/f10 x:0 0 0 2024-09-13T21:40:35.871 INFO:tasks.workunit.client.1.smithi116.stdout:6/51: read f4 [1974784,54764] 0 2024-09-13T21:40:35.871 INFO:tasks.workunit.client.1.smithi116.stdout:6/52: dread - d8/fd zero size 2024-09-13T21:40:35.872 INFO:tasks.workunit.client.1.smithi116.stdout:6/53: rename d8 to d8/d12 22 2024-09-13T21:40:35.873 INFO:tasks.workunit.client.1.smithi116.stdout:6/54: mknod d8/d10/c13 0 2024-09-13T21:40:35.880 INFO:tasks.workunit.client.1.smithi116.stdout:9/57: dwrite d2/f7 [0,4194304] 0 2024-09-13T21:40:35.881 INFO:tasks.workunit.client.1.smithi116.stdout:2/57: write d0/d5/d8/fb [2913854,128391] 0 2024-09-13T21:40:35.882 INFO:tasks.workunit.client.1.smithi116.stdout:9/58: mknod d2/cf 0 2024-09-13T21:40:35.885 INFO:tasks.workunit.client.1.smithi116.stdout:9/59: mkdir d2/d10 0 2024-09-13T21:40:35.885 INFO:tasks.workunit.client.1.smithi116.stdout:2/58: rmdir d0/d5/d8 39 2024-09-13T21:40:35.885 INFO:tasks.workunit.client.1.smithi116.stdout:2/59: dread - d0/d5/f10 zero size 2024-09-13T21:40:35.887 INFO:tasks.workunit.client.1.smithi116.stdout:9/60: rename d2/f5 to d2/d8/f11 0 2024-09-13T21:40:35.887 INFO:tasks.workunit.client.1.smithi116.stdout:9/61: write f0 [762332,22879] 0 2024-09-13T21:40:35.893 INFO:tasks.workunit.client.1.smithi116.stdout:5/163: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:35.893 INFO:tasks.workunit.client.1.smithi116.stdout:5/164: fsync d7/da/f1b 0 2024-09-13T21:40:35.893 INFO:tasks.workunit.client.1.smithi116.stdout:5/165: truncate d7/d1d/f29 945703 0 2024-09-13T21:40:35.895 INFO:tasks.workunit.client.1.smithi116.stdout:5/166: write d7/d1d/f29 [418671,74465] 0 2024-09-13T21:40:35.900 INFO:tasks.workunit.client.1.smithi116.stdout:0/81: dwrite d2/dc/fe [0,4194304] 0 2024-09-13T21:40:35.903 INFO:tasks.workunit.client.1.smithi116.stdout:0/82: symlink d2/l1e 0 2024-09-13T21:40:35.903 INFO:tasks.workunit.client.1.smithi116.stdout:0/83: stat d2/dc/fe 0 2024-09-13T21:40:35.904 INFO:tasks.workunit.client.1.smithi116.stdout:0/84: creat d2/d5/f1f x:0 0 0 2024-09-13T21:40:35.906 INFO:tasks.workunit.client.1.smithi116.stdout:0/85: rename d2/c3 to d2/c20 0 2024-09-13T21:40:35.907 INFO:tasks.workunit.client.1.smithi116.stdout:0/86: mknod d2/c21 0 2024-09-13T21:40:35.909 INFO:tasks.workunit.client.1.smithi116.stdout:6/55: dwrite f5 [0,4194304] 0 2024-09-13T21:40:35.909 INFO:tasks.workunit.client.1.smithi116.stdout:6/56: readlink - no filename 2024-09-13T21:40:35.909 INFO:tasks.workunit.client.1.smithi116.stdout:6/57: stat d8 0 2024-09-13T21:40:35.910 INFO:tasks.workunit.client.1.smithi116.stdout:0/87: link d2/d5/fd d2/dc/f22 0 2024-09-13T21:40:35.913 INFO:tasks.workunit.client.1.smithi116.stdout:9/62: truncate d2/f7 3989786 0 2024-09-13T21:40:35.914 INFO:tasks.workunit.client.1.smithi116.stdout:7/94: dwrite d5/d9/db/f12 [0,4194304] 0 2024-09-13T21:40:35.914 INFO:tasks.workunit.client.1.smithi116.stdout:7/95: chown d5/d9/db 219364 1 2024-09-13T21:40:35.915 INFO:tasks.workunit.client.1.smithi116.stdout:0/88: unlink d2/f18 0 2024-09-13T21:40:35.916 INFO:tasks.workunit.client.1.smithi116.stdout:9/63: creat d2/d10/f12 x:0 0 0 2024-09-13T21:40:35.916 INFO:tasks.workunit.client.1.smithi116.stdout:9/64: chown d2/cf 4369 1 2024-09-13T21:40:35.916 INFO:tasks.workunit.client.1.smithi116.stdout:9/65: dread - d2/d10/f12 zero size 2024-09-13T21:40:35.916 INFO:tasks.workunit.client.1.smithi116.stdout:9/66: stat d2/f4 0 2024-09-13T21:40:35.917 INFO:tasks.workunit.client.1.smithi116.stdout:7/96: mkdir d5/d9/db/d21 0 2024-09-13T21:40:35.918 INFO:tasks.workunit.client.1.smithi116.stdout:7/97: write d5/d9/f14 [1466444,8299] 0 2024-09-13T21:40:35.919 INFO:tasks.workunit.client.1.smithi116.stdout:6/58: dread f3 [0,4194304] 0 2024-09-13T21:40:35.919 INFO:tasks.workunit.client.1.smithi116.stdout:2/60: dwrite d0/d5/d8/fb [0,4194304] 0 2024-09-13T21:40:35.919 INFO:tasks.workunit.client.1.smithi116.stdout:0/89: creat d2/dc/d12/f23 x:0 0 0 2024-09-13T21:40:35.919 INFO:tasks.workunit.client.1.smithi116.stdout:2/61: truncate d0/d5/f10 47726 0 2024-09-13T21:40:35.919 INFO:tasks.workunit.client.1.smithi116.stdout:2/62: dread d0/d5/f10 [0,4194304] 0 2024-09-13T21:40:35.924 INFO:tasks.workunit.client.1.smithi116.stdout:9/67: creat d2/f13 x:0 0 0 2024-09-13T21:40:35.924 INFO:tasks.workunit.client.1.smithi116.stdout:9/68: write d2/f4 [2055134,89069] 0 2024-09-13T21:40:35.924 INFO:tasks.workunit.client.1.smithi116.stdout:9/69: dread - d2/f13 zero size 2024-09-13T21:40:35.928 INFO:tasks.workunit.client.1.smithi116.stdout:0/90: fsync d2/d5/fd 0 2024-09-13T21:40:35.928 INFO:tasks.workunit.client.1.smithi116.stdout:0/91: chown d2/dc/l10 468 1 2024-09-13T21:40:35.928 INFO:tasks.workunit.client.1.smithi116.stdout:0/92: write d2/d5/f9 [1174931,80773] 0 2024-09-13T21:40:35.931 INFO:tasks.workunit.client.1.smithi116.stdout:0/93: write d2/f7 [2988945,103177] 0 2024-09-13T21:40:35.934 INFO:tasks.workunit.client.1.smithi116.stdout:6/59: rename f4 to d8/d10/f14 0 2024-09-13T21:40:35.934 INFO:tasks.workunit.client.1.smithi116.stdout:6/60: write d8/ff [222683,8482] 0 2024-09-13T21:40:35.934 INFO:tasks.workunit.client.1.smithi116.stdout:6/61: chown d8/d10 12476290 1 2024-09-13T21:40:35.935 INFO:tasks.workunit.client.1.smithi116.stdout:9/70: dread d2/f4 [0,4194304] 0 2024-09-13T21:40:35.935 INFO:tasks.workunit.client.1.smithi116.stdout:9/71: read - d2/d10/f12 zero size 2024-09-13T21:40:35.935 INFO:tasks.workunit.client.1.smithi116.stdout:2/63: write d0/d5/d8/fb [1522834,55555] 0 2024-09-13T21:40:35.936 INFO:tasks.workunit.client.1.smithi116.stdout:9/72: mkdir d2/d10/d14 0 2024-09-13T21:40:35.936 INFO:tasks.workunit.client.1.smithi116.stdout:9/73: rename d2 to d2/d10/d14/d15 22 2024-09-13T21:40:35.937 INFO:tasks.workunit.client.1.smithi116.stdout:2/64: creat d0/da/f11 x:0 0 0 2024-09-13T21:40:35.939 INFO:tasks.workunit.client.1.smithi116.stdout:9/74: symlink d2/d8/l16 0 2024-09-13T21:40:35.940 INFO:tasks.workunit.client.1.smithi116.stdout:7/98: truncate d5/d9/db/ff 277890 0 2024-09-13T21:40:35.941 INFO:tasks.workunit.client.1.smithi116.stdout:2/65: creat d0/d7/f12 x:0 0 0 2024-09-13T21:40:35.943 INFO:tasks.workunit.client.1.smithi116.stdout:7/99: mkdir d5/d9/d1c/d22 0 2024-09-13T21:40:35.944 INFO:tasks.workunit.client.1.smithi116.stdout:2/66: symlink d0/d7/l13 0 2024-09-13T21:40:35.966 INFO:tasks.workunit.client.1.smithi116.stdout:7/100: dwrite f2 [8388608,4194304] 0 2024-09-13T21:40:35.966 INFO:tasks.workunit.client.1.smithi116.stdout:2/67: dwrite d0/d5/f10 [0,4194304] 0 2024-09-13T21:40:35.966 INFO:tasks.workunit.client.1.smithi116.stdout:2/68: rename d0/da to d0/da/d14 22 2024-09-13T21:40:35.967 INFO:tasks.workunit.client.1.smithi116.stdout:7/101: mknod d5/d9/d1c/d22/c23 0 2024-09-13T21:40:35.967 INFO:tasks.workunit.client.1.smithi116.stdout:7/102: dread d5/f18 [0,4194304] 0 2024-09-13T21:40:35.968 INFO:tasks.workunit.client.1.smithi116.stdout:2/69: mknod d0/da/dd/c15 0 2024-09-13T21:40:35.969 INFO:tasks.workunit.client.1.smithi116.stdout:7/103: unlink d5/d9/c1a 0 2024-09-13T21:40:35.969 INFO:tasks.workunit.client.1.smithi116.stdout:7/104: stat d5/d9/db/f12 0 2024-09-13T21:40:35.969 INFO:tasks.workunit.client.1.smithi116.stdout:7/105: read - d5/f8 zero size 2024-09-13T21:40:35.969 INFO:tasks.workunit.client.1.smithi116.stdout:7/106: chown d5/d9/db/l7 5575581 1 2024-09-13T21:40:35.970 INFO:tasks.workunit.client.1.smithi116.stdout:7/107: write d5/f8 [845233,81903] 0 2024-09-13T21:40:35.970 INFO:tasks.workunit.client.1.smithi116.stdout:2/70: creat d0/d5/d8/f16 x:0 0 0 2024-09-13T21:40:35.970 INFO:tasks.workunit.client.1.smithi116.stdout:2/71: dread - d0/d7/f12 zero size 2024-09-13T21:40:35.971 INFO:tasks.workunit.client.1.smithi116.stdout:2/72: fdatasync d0/d7/f12 0 2024-09-13T21:40:35.971 INFO:tasks.workunit.client.1.smithi116.stdout:7/108: getdents d5/d9/d1c 0 2024-09-13T21:40:35.971 INFO:tasks.workunit.client.1.smithi116.stdout:2/73: mknod d0/d7/c17 0 2024-09-13T21:40:35.973 INFO:tasks.workunit.client.1.smithi116.stdout:2/74: unlink d0/d5/d8/fb 0 2024-09-13T21:40:35.973 INFO:tasks.workunit.client.1.smithi116.stdout:2/75: dread - d0/d7/f12 zero size 2024-09-13T21:40:35.973 INFO:tasks.workunit.client.1.smithi116.stdout:2/76: write d0/fe [491698,62070] 0 2024-09-13T21:40:35.973 INFO:tasks.workunit.client.1.smithi116.stdout:2/77: chown d0/d5/cf 9 1 2024-09-13T21:40:35.974 INFO:tasks.workunit.client.1.smithi116.stdout:2/78: fdatasync d0/fe 0 2024-09-13T21:40:35.975 INFO:tasks.workunit.client.1.smithi116.stdout:7/109: getdents d5/d9 0 2024-09-13T21:40:35.976 INFO:tasks.workunit.client.1.smithi116.stdout:2/79: symlink d0/d5/d8/l18 0 2024-09-13T21:40:35.976 INFO:tasks.workunit.client.1.smithi116.stdout:2/80: fsync d0/d5/d8/f16 0 2024-09-13T21:40:35.976 INFO:tasks.workunit.client.1.smithi116.stdout:2/81: stat d0/da/f11 0 2024-09-13T21:40:35.978 INFO:tasks.workunit.client.1.smithi116.stdout:7/110: dread d5/d9/f14 [0,4194304] 0 2024-09-13T21:40:35.978 INFO:tasks.workunit.client.1.smithi116.stdout:7/111: readlink d5/d9/db/l20 0 2024-09-13T21:40:35.978 INFO:tasks.workunit.client.1.smithi116.stdout:7/112: write d5/f16 [199473,5298] 0 2024-09-13T21:40:35.979 INFO:tasks.workunit.client.1.smithi116.stdout:7/113: mkdir d5/d9/d1c/d22/d24 0 2024-09-13T21:40:35.979 INFO:tasks.workunit.client.1.smithi116.stdout:7/114: truncate d5/f16 389115 0 2024-09-13T21:40:35.980 INFO:tasks.workunit.client.1.smithi116.stdout:7/115: chown l3 734991887 1 2024-09-13T21:40:35.980 INFO:tasks.workunit.client.1.smithi116.stdout:7/116: symlink d5/d9/d1c/d22/l25 0 2024-09-13T21:40:35.981 INFO:tasks.workunit.client.1.smithi116.stdout:7/117: mknod d5/c26 0 2024-09-13T21:40:35.982 INFO:tasks.workunit.client.1.smithi116.stdout:7/118: fdatasync d5/d9/f17 0 2024-09-13T21:40:35.984 INFO:tasks.workunit.client.1.smithi116.stdout:7/119: mkdir d5/d9/d27 0 2024-09-13T21:40:35.984 INFO:tasks.workunit.client.1.smithi116.stdout:2/82: write d0/d5/f10 [3989584,93283] 0 2024-09-13T21:40:35.984 INFO:tasks.workunit.client.1.smithi116.stdout:2/83: chown d0/da 350835086 1 2024-09-13T21:40:35.984 INFO:tasks.workunit.client.1.smithi116.stdout:2/84: dread - d0/da/f11 zero size 2024-09-13T21:40:35.985 INFO:tasks.workunit.client.1.smithi116.stdout:2/85: mknod d0/d5/d8/c19 0 2024-09-13T21:40:35.986 INFO:tasks.workunit.client.1.smithi116.stdout:2/86: mknod d0/d5/c1a 0 2024-09-13T21:40:35.988 INFO:tasks.workunit.client.1.smithi116.stdout:2/87: symlink d0/d5/d8/l1b 0 2024-09-13T21:40:35.988 INFO:tasks.workunit.client.1.smithi116.stdout:2/88: truncate d0/d7/f12 610390 0 2024-09-13T21:40:35.996 INFO:tasks.workunit.client.1.smithi116.stdout:7/120: dwrite d5/d9/db/fe [0,4194304] 0 2024-09-13T21:40:36.001 INFO:tasks.workunit.client.1.smithi116.stdout:7/121: link d5/d9/l1b d5/l28 0 2024-09-13T21:40:36.001 INFO:tasks.workunit.client.1.smithi116.stdout:7/122: dread d5/f16 [0,4194304] 0 2024-09-13T21:40:36.001 INFO:tasks.workunit.client.1.smithi116.stdout:7/123: mknod d5/d9/c29 0 2024-09-13T21:40:36.001 INFO:tasks.workunit.client.1.smithi116.stdout:7/124: dread - d5/d9/f17 zero size 2024-09-13T21:40:36.002 INFO:tasks.workunit.client.1.smithi116.stdout:7/125: symlink d5/d9/db/d21/l2a 0 2024-09-13T21:40:36.002 INFO:tasks.workunit.client.1.smithi116.stdout:7/126: read - d5/d9/f17 zero size 2024-09-13T21:40:36.002 INFO:tasks.workunit.client.1.smithi116.stdout:7/127: creat d5/d9/d27/f2b x:0 0 0 2024-09-13T21:40:36.003 INFO:tasks.workunit.client.1.smithi116.stdout:7/128: truncate d5/d9/f14 1436094 0 2024-09-13T21:40:36.005 INFO:tasks.workunit.client.1.smithi116.stdout:7/129: mknod d5/c2c 0 2024-09-13T21:40:36.005 INFO:tasks.workunit.client.1.smithi116.stdout:7/130: stat d5/d9/d27 0 2024-09-13T21:40:36.005 INFO:tasks.workunit.client.1.smithi116.stdout:7/131: chown d5/d9/f14 900 1 2024-09-13T21:40:36.005 INFO:tasks.workunit.client.1.smithi116.stdout:7/132: chown c4 18 1 2024-09-13T21:40:36.006 INFO:tasks.workunit.client.1.smithi116.stdout:7/133: mknod d5/d9/db/d21/c2d 0 2024-09-13T21:40:36.028 INFO:tasks.workunit.client.1.smithi116.stdout:7/134: dwrite f2 [0,4194304] 0 2024-09-13T21:40:36.043 INFO:tasks.workunit.client.1.smithi116.stdout:7/135: dwrite d5/d9/db/ff [0,4194304] 0 2024-09-13T21:40:36.045 INFO:tasks.workunit.client.1.smithi116.stdout:7/136: mkdir d5/d9/d1c/d2e 0 2024-09-13T21:40:36.183 INFO:tasks.workunit.client.1.smithi116.stdout:4/57: sync 2024-09-13T21:40:36.183 INFO:tasks.workunit.client.1.smithi116.stdout:3/109: sync 2024-09-13T21:40:36.183 INFO:tasks.workunit.client.1.smithi116.stdout:1/18: sync 2024-09-13T21:40:36.184 INFO:tasks.workunit.client.1.smithi116.stdout:3/110: creat d3/db/d26/f28 x:0 0 0 2024-09-13T21:40:36.185 INFO:tasks.workunit.client.1.smithi116.stdout:1/19: symlink d4/l7 0 2024-09-13T21:40:36.186 INFO:tasks.workunit.client.1.smithi116.stdout:3/111: truncate d3/f9 344265 0 2024-09-13T21:40:36.187 INFO:tasks.workunit.client.1.smithi116.stdout:3/112: mkdir d3/db/d10/d29 0 2024-09-13T21:40:36.189 INFO:tasks.workunit.client.1.smithi116.stdout:3/113: creat d3/db/d20/d25/f2a x:0 0 0 2024-09-13T21:40:36.191 INFO:tasks.workunit.client.1.smithi116.stdout:1/20: write f1 [990626,83008] 0 2024-09-13T21:40:36.192 INFO:tasks.workunit.client.1.smithi116.stdout:1/21: creat d4/f8 x:0 0 0 2024-09-13T21:40:36.193 INFO:tasks.workunit.client.1.smithi116.stdout:1/22: read f1 [739056,6951] 0 2024-09-13T21:40:36.198 INFO:tasks.workunit.client.1.smithi116.stdout:4/58: dwrite d0/fb [0,4194304] 0 2024-09-13T21:40:36.210 INFO:tasks.workunit.client.1.smithi116.stdout:4/59: write d0/fb [1997724,40681] 0 2024-09-13T21:40:36.210 INFO:tasks.workunit.client.1.smithi116.stdout:4/60: mknod d0/dd/c12 0 2024-09-13T21:40:36.210 INFO:tasks.workunit.client.1.smithi116.stdout:4/61: dread - d0/fa zero size 2024-09-13T21:40:36.211 INFO:tasks.workunit.client.1.smithi116.stdout:4/62: chown d0/c5 63 1 2024-09-13T21:40:36.211 INFO:tasks.workunit.client.1.smithi116.stdout:4/63: write d0/f10 [690214,83439] 0 2024-09-13T21:40:36.211 INFO:tasks.workunit.client.1.smithi116.stdout:4/64: mkdir d0/dd/d13 0 2024-09-13T21:40:36.212 INFO:tasks.workunit.client.1.smithi116.stdout:3/114: dwrite d3/db/d20/f23 [0,4194304] 0 2024-09-13T21:40:36.212 INFO:tasks.workunit.client.1.smithi116.stdout:3/115: truncate d3/db/d10/d1c/f21 990574 0 2024-09-13T21:40:36.212 INFO:tasks.workunit.client.1.smithi116.stdout:1/23: dwrite d4/f8 [0,4194304] 0 2024-09-13T21:40:36.229 INFO:tasks.workunit.client.1.smithi116.stdout:3/116: write d3/db/f17 [407202,26162] 0 2024-09-13T21:40:36.246 INFO:tasks.workunit.client.1.smithi116.stdout:1/24: dwrite d4/f8 [0,4194304] 0 2024-09-13T21:40:36.247 INFO:tasks.workunit.client.1.smithi116.stdout:4/65: dwrite d0/f10 [0,4194304] 0 2024-09-13T21:40:36.247 INFO:tasks.workunit.client.1.smithi116.stdout:3/117: dwrite d3/db/d10/d1c/f21 [0,4194304] 0 2024-09-13T21:40:36.247 INFO:tasks.workunit.client.1.smithi116.stdout:1/25: mknod d4/c9 0 2024-09-13T21:40:36.257 INFO:tasks.workunit.client.1.smithi116.stdout:3/118: write d3/f9 [76410,16638] 0 2024-09-13T21:40:36.258 INFO:tasks.workunit.client.1.smithi116.stdout:4/66: truncate d0/fb 3160779 0 2024-09-13T21:40:36.258 INFO:tasks.workunit.client.1.smithi116.stdout:4/67: readlink d0/l11 0 2024-09-13T21:40:36.258 INFO:tasks.workunit.client.1.smithi116.stdout:4/68: truncate d0/fa 558689 0 2024-09-13T21:40:36.268 INFO:tasks.workunit.client.1.smithi116.stdout:3/119: read d3/f8 [4187733,127212] 0 2024-09-13T21:40:36.269 INFO:tasks.workunit.client.1.smithi116.stdout:3/120: rename d3/db/l12 to d3/l2b 0 2024-09-13T21:40:36.270 INFO:tasks.workunit.client.1.smithi116.stdout:3/121: getdents d3/db/d20/d25 0 2024-09-13T21:40:36.272 INFO:tasks.workunit.client.1.smithi116.stdout:3/122: rename d3/db/c14 to d3/db/d20/d25/c2c 0 2024-09-13T21:40:36.274 INFO:tasks.workunit.client.1.smithi116.stdout:3/123: rename d3/fc to d3/db/d10/d1d/f2d 0 2024-09-13T21:40:36.274 INFO:tasks.workunit.client.1.smithi116.stdout:1/26: dwrite f3 [0,4194304] 0 2024-09-13T21:40:36.275 INFO:tasks.workunit.client.1.smithi116.stdout:3/124: rename d3/ce to d3/c2e 0 2024-09-13T21:40:36.275 INFO:tasks.workunit.client.1.smithi116.stdout:3/125: truncate d3/db/d10/d1c/f1f 1491078 0 2024-09-13T21:40:36.276 INFO:tasks.workunit.client.1.smithi116.stdout:4/69: dwrite d0/fa [0,4194304] 0 2024-09-13T21:40:36.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/126: mkdir d3/db/d10/d1d/d2f 0 2024-09-13T21:40:36.280 INFO:tasks.workunit.client.1.smithi116.stdout:3/127: creat d3/db/f30 x:0 0 0 2024-09-13T21:40:36.281 INFO:tasks.workunit.client.1.smithi116.stdout:3/128: creat d3/db/f31 x:0 0 0 2024-09-13T21:40:36.283 INFO:tasks.workunit.client.1.smithi116.stdout:3/129: rename d3/db/c24 to d3/db/d26/c32 0 2024-09-13T21:40:36.285 INFO:tasks.workunit.client.1.smithi116.stdout:1/27: write f3 [2168133,9168] 0 2024-09-13T21:40:36.285 INFO:tasks.workunit.client.1.smithi116.stdout:3/130: symlink d3/db/d20/d25/l33 0 2024-09-13T21:40:36.286 INFO:tasks.workunit.client.1.smithi116.stdout:4/70: dread d0/f10 [0,4194304] 0 2024-09-13T21:40:36.287 INFO:tasks.workunit.client.1.smithi116.stdout:1/28: link f1 d4/fa 0 2024-09-13T21:40:36.288 INFO:tasks.workunit.client.1.smithi116.stdout:3/131: mkdir d3/db/d10/d1c/d34 0 2024-09-13T21:40:36.289 INFO:tasks.workunit.client.1.smithi116.stdout:3/132: symlink d3/db/d10/d29/l35 0 2024-09-13T21:40:36.290 INFO:tasks.workunit.client.1.smithi116.stdout:3/133: stat d3/db/d10/d29/l35 0 2024-09-13T21:40:36.292 INFO:tasks.workunit.client.1.smithi116.stdout:3/134: stat d3/l2b 0 2024-09-13T21:40:36.292 INFO:tasks.workunit.client.1.smithi116.stdout:3/135: truncate d3/db/d10/d1d/f1e 4747440 0 2024-09-13T21:40:36.293 INFO:tasks.workunit.client.1.smithi116.stdout:3/136: fdatasync d3/db/d20/f23 0 2024-09-13T21:40:36.293 INFO:tasks.workunit.client.1.smithi116.stdout:3/137: chown d3/db/d10/f13 416887 1 2024-09-13T21:40:36.293 INFO:tasks.workunit.client.1.smithi116.stdout:3/138: chown d3/db/d20/d25 17291436 1 2024-09-13T21:40:36.293 INFO:tasks.workunit.client.1.smithi116.stdout:1/29: truncate d4/f8 2308480 0 2024-09-13T21:40:36.294 INFO:tasks.workunit.client.1.smithi116.stdout:4/71: dread d0/fa [0,4194304] 0 2024-09-13T21:40:36.294 INFO:tasks.workunit.client.1.smithi116.stdout:4/72: fsync d0/fb 0 2024-09-13T21:40:36.294 INFO:tasks.workunit.client.1.smithi116.stdout:4/73: chown d0/dd/c12 303717235 1 2024-09-13T21:40:36.295 INFO:tasks.workunit.client.1.smithi116.stdout:4/74: truncate d0/fa 4097043 0 2024-09-13T21:40:36.296 INFO:tasks.workunit.client.1.smithi116.stdout:4/75: symlink d0/dd/d13/l14 0 2024-09-13T21:40:36.297 INFO:tasks.workunit.client.1.smithi116.stdout:4/76: mknod d0/dd/d13/c15 0 2024-09-13T21:40:36.297 INFO:tasks.workunit.client.1.smithi116.stdout:4/77: fsync d0/f8 0 2024-09-13T21:40:36.298 INFO:tasks.workunit.client.1.smithi116.stdout:4/78: mknod d0/dd/c16 0 2024-09-13T21:40:36.299 INFO:tasks.workunit.client.1.smithi116.stdout:4/79: truncate d0/f10 3197485 0 2024-09-13T21:40:36.300 INFO:tasks.workunit.client.1.smithi116.stdout:4/80: truncate d0/fb 2391037 0 2024-09-13T21:40:36.300 INFO:tasks.workunit.client.1.smithi116.stdout:4/81: chown d0/c5 0 1 2024-09-13T21:40:36.300 INFO:tasks.workunit.client.1.smithi116.stdout:1/30: dread f3 [0,4194304] 0 2024-09-13T21:40:36.301 INFO:tasks.workunit.client.1.smithi116.stdout:3/139: dread d3/db/d10/f13 [0,4194304] 0 2024-09-13T21:40:36.301 INFO:tasks.workunit.client.1.smithi116.stdout:3/140: fdatasync d3/db/d10/f15 0 2024-09-13T21:40:36.302 INFO:tasks.workunit.client.1.smithi116.stdout:1/31: symlink d4/lb 0 2024-09-13T21:40:36.303 INFO:tasks.workunit.client.1.smithi116.stdout:3/141: unlink d3/c2e 0 2024-09-13T21:40:36.303 INFO:tasks.workunit.client.1.smithi116.stdout:3/142: write d3/db/f31 [259507,51212] 0 2024-09-13T21:40:36.304 INFO:tasks.workunit.client.1.smithi116.stdout:3/143: mknod d3/db/d10/d29/c36 0 2024-09-13T21:40:36.305 INFO:tasks.workunit.client.1.smithi116.stdout:4/82: write d0/fa [2043651,103213] 0 2024-09-13T21:40:36.305 INFO:tasks.workunit.client.1.smithi116.stdout:3/144: read d3/f9 [122764,89468] 0 2024-09-13T21:40:36.307 INFO:tasks.workunit.client.1.smithi116.stdout:8/53: sync 2024-09-13T21:40:36.307 INFO:tasks.workunit.client.1.smithi116.stdout:5/167: sync 2024-09-13T21:40:36.310 INFO:tasks.workunit.client.1.smithi116.stdout:4/83: mknod d0/dd/d13/c17 0 2024-09-13T21:40:36.310 INFO:tasks.workunit.client.1.smithi116.stdout:3/145: mknod d3/db/d10/d1d/d2f/c37 0 2024-09-13T21:40:36.310 INFO:tasks.workunit.client.1.smithi116.stdout:3/146: chown d3/db/d10/d1c/d34 199183 1 2024-09-13T21:40:36.311 INFO:tasks.workunit.client.1.smithi116.stdout:3/147: chown d3/db/d10/d1c/f21 2847 1 2024-09-13T21:40:36.311 INFO:tasks.workunit.client.1.smithi116.stdout:3/148: chown d3/db/d26/f28 249895421 1 2024-09-13T21:40:36.311 INFO:tasks.workunit.client.1.smithi116.stdout:5/168: truncate d7/d1d/f20 3563246 0 2024-09-13T21:40:36.312 INFO:tasks.workunit.client.1.smithi116.stdout:4/84: symlink d0/dd/l18 0 2024-09-13T21:40:36.314 INFO:tasks.workunit.client.1.smithi116.stdout:8/54: rename d2/fa to d2/f13 0 2024-09-13T21:40:36.315 INFO:tasks.workunit.client.1.smithi116.stdout:1/32: truncate d4/f8 942531 0 2024-09-13T21:40:36.318 INFO:tasks.workunit.client.1.smithi116.stdout:4/85: dread d0/f10 [0,4194304] 0 2024-09-13T21:40:36.321 INFO:tasks.workunit.client.1.smithi116.stdout:3/149: dread d3/db/f31 [0,4194304] 0 2024-09-13T21:40:36.322 INFO:tasks.workunit.client.1.smithi116.stdout:5/169: write d7/fc [3516404,17064] 0 2024-09-13T21:40:36.328 INFO:tasks.workunit.client.1.smithi116.stdout:3/150: write d3/db/d10/d1d/f1e [5422421,100215] 0 2024-09-13T21:40:36.330 INFO:tasks.workunit.client.1.smithi116.stdout:3/151: truncate d3/f8 1371489 0 2024-09-13T21:40:36.331 INFO:tasks.workunit.client.1.smithi116.stdout:3/152: creat d3/db/d10/d1d/d2f/f38 x:0 0 0 2024-09-13T21:40:36.339 INFO:tasks.workunit.client.1.smithi116.stdout:5/170: truncate d7/fc 3480836 0 2024-09-13T21:40:36.340 INFO:tasks.workunit.client.1.smithi116.stdout:5/171: link c5 d7/da/d21/c32 0 2024-09-13T21:40:36.341 INFO:tasks.workunit.client.1.smithi116.stdout:5/172: mknod d7/da/d21/c33 0 2024-09-13T21:40:36.342 INFO:tasks.workunit.client.1.smithi116.stdout:3/153: read d3/db/d10/d1d/f1e [1225702,72737] 0 2024-09-13T21:40:36.342 INFO:tasks.workunit.client.1.smithi116.stdout:5/173: rename d7/c14 to d7/d1d/c34 0 2024-09-13T21:40:36.344 INFO:tasks.workunit.client.1.smithi116.stdout:1/33: dwrite f3 [0,4194304] 0 2024-09-13T21:40:36.345 INFO:tasks.workunit.client.1.smithi116.stdout:4/86: dwrite d0/f8 [0,4194304] 0 2024-09-13T21:40:36.346 INFO:tasks.workunit.client.1.smithi116.stdout:5/174: mknod d7/da/d21/c35 0 2024-09-13T21:40:36.346 INFO:tasks.workunit.client.1.smithi116.stdout:5/175: chown d7/c1a 29 1 2024-09-13T21:40:36.346 INFO:tasks.workunit.client.1.smithi116.stdout:5/176: chown d7/da/d21/l2a 3610 1 2024-09-13T21:40:36.347 INFO:tasks.workunit.client.1.smithi116.stdout:3/154: rmdir d3/db/d10/d1c 39 2024-09-13T21:40:36.350 INFO:tasks.workunit.client.1.smithi116.stdout:1/34: mknod d4/cc 0 2024-09-13T21:40:36.351 INFO:tasks.workunit.client.1.smithi116.stdout:4/87: truncate d0/f10 3030914 0 2024-09-13T21:40:36.353 INFO:tasks.workunit.client.1.smithi116.stdout:3/155: truncate d3/db/d10/d1c/f21 1657343 0 2024-09-13T21:40:36.355 INFO:tasks.workunit.client.1.smithi116.stdout:1/35: rename d4/lb to d4/ld 0 2024-09-13T21:40:36.355 INFO:tasks.workunit.client.1.smithi116.stdout:1/36: stat f1 0 2024-09-13T21:40:36.360 INFO:tasks.workunit.client.1.smithi116.stdout:5/177: write d7/da/f1b [1693683,91602] 0 2024-09-13T21:40:36.362 INFO:tasks.workunit.client.1.smithi116.stdout:5/178: creat d7/da/f36 x:0 0 0 2024-09-13T21:40:36.365 INFO:tasks.workunit.client.1.smithi116.stdout:6/62: sync 2024-09-13T21:40:36.365 INFO:tasks.workunit.client.1.smithi116.stdout:9/75: sync 2024-09-13T21:40:36.365 INFO:tasks.workunit.client.1.smithi116.stdout:9/76: chown d2/f4 400600938 1 2024-09-13T21:40:36.367 INFO:tasks.workunit.client.1.smithi116.stdout:0/94: sync 2024-09-13T21:40:36.367 INFO:tasks.workunit.client.1.smithi116.stdout:2/89: sync 2024-09-13T21:40:36.367 INFO:tasks.workunit.client.1.smithi116.stdout:7/137: sync 2024-09-13T21:40:36.367 INFO:tasks.workunit.client.1.smithi116.stdout:6/63: write d8/fe [21249,38974] 0 2024-09-13T21:40:36.367 INFO:tasks.workunit.client.1.smithi116.stdout:4/88: write d0/f8 [5829980,31562] 0 2024-09-13T21:40:36.368 INFO:tasks.workunit.client.1.smithi116.stdout:2/90: symlink d0/da/dd/l1c 0 2024-09-13T21:40:36.368 INFO:tasks.workunit.client.1.smithi116.stdout:2/91: creat d0/da/f1d x:0 0 0 2024-09-13T21:40:36.369 INFO:tasks.workunit.client.1.smithi116.stdout:7/138: write d5/f18 [397390,15280] 0 2024-09-13T21:40:36.369 INFO:tasks.workunit.client.1.smithi116.stdout:2/92: write d0/d7/f12 [513044,74720] 0 2024-09-13T21:40:36.370 INFO:tasks.workunit.client.1.smithi116.stdout:2/93: creat d0/d7/f1e x:0 0 0 2024-09-13T21:40:36.370 INFO:tasks.workunit.client.1.smithi116.stdout:4/89: mknod d0/dd/c19 0 2024-09-13T21:40:36.370 INFO:tasks.workunit.client.1.smithi116.stdout:4/90: chown d0/dd/c12 23787752 1 2024-09-13T21:40:36.372 INFO:tasks.workunit.client.1.smithi116.stdout:6/64: mkdir d8/d15 0 2024-09-13T21:40:36.373 INFO:tasks.workunit.client.1.smithi116.stdout:7/139: symlink d5/d9/d1c/d22/l2f 0 2024-09-13T21:40:36.373 INFO:tasks.workunit.client.1.smithi116.stdout:5/179: dread d7/da/f27 [0,4194304] 0 2024-09-13T21:40:36.374 INFO:tasks.workunit.client.1.smithi116.stdout:5/180: write d7/fc [3494531,111659] 0 2024-09-13T21:40:36.374 INFO:tasks.workunit.client.1.smithi116.stdout:5/181: chown d7/d1d/f20 703475660 1 2024-09-13T21:40:36.374 INFO:tasks.workunit.client.1.smithi116.stdout:5/182: chown d7/d1d/f29 404474467 1 2024-09-13T21:40:36.374 INFO:tasks.workunit.client.1.smithi116.stdout:5/183: chown d7/l2b 31 1 2024-09-13T21:40:36.374 INFO:tasks.workunit.client.1.smithi116.stdout:2/94: mkdir d0/da/d1f 0 2024-09-13T21:40:36.374 INFO:tasks.workunit.client.1.smithi116.stdout:2/95: write d0/da/f1d [384733,108082] 0 2024-09-13T21:40:36.374 INFO:tasks.workunit.client.1.smithi116.stdout:2/96: write d0/d5/f10 [2709450,78226] 0 2024-09-13T21:40:36.379 INFO:tasks.workunit.client.1.smithi116.stdout:5/184: dread d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:36.379 INFO:tasks.workunit.client.1.smithi116.stdout:5/185: creat d7/da/f37 x:0 0 0 2024-09-13T21:40:36.386 INFO:tasks.workunit.client.1.smithi116.stdout:3/156: dwrite d3/db/d20/d25/f2a [0,4194304] 0 2024-09-13T21:40:36.386 INFO:tasks.workunit.client.1.smithi116.stdout:3/157: chown d3/f9 2301422 1 2024-09-13T21:40:36.386 INFO:tasks.workunit.client.1.smithi116.stdout:0/95: write d2/dc/fe [2018022,5578] 0 2024-09-13T21:40:36.386 INFO:tasks.workunit.client.1.smithi116.stdout:0/96: stat d2/d5/f13 0 2024-09-13T21:40:36.386 INFO:tasks.workunit.client.1.smithi116.stdout:9/77: write d2/f7 [3130586,89671] 0 2024-09-13T21:40:36.387 INFO:tasks.workunit.client.1.smithi116.stdout:3/158: mknod d3/db/d10/d1c/c39 0 2024-09-13T21:40:36.387 INFO:tasks.workunit.client.1.smithi116.stdout:0/97: mknod d2/c24 0 2024-09-13T21:40:36.389 INFO:tasks.workunit.client.1.smithi116.stdout:9/78: rename d2/cf to d2/d10/c17 0 2024-09-13T21:40:36.394 INFO:tasks.workunit.client.1.smithi116.stdout:0/98: rename d2/dc/l10 to d2/d5/l25 0 2024-09-13T21:40:36.394 INFO:tasks.workunit.client.1.smithi116.stdout:9/79: write f0 [761200,71630] 0 2024-09-13T21:40:36.394 INFO:tasks.workunit.client.1.smithi116.stdout:0/99: creat d2/d5/f26 x:0 0 0 2024-09-13T21:40:36.394 INFO:tasks.workunit.client.1.smithi116.stdout:9/80: creat d2/d10/f18 x:0 0 0 2024-09-13T21:40:36.394 INFO:tasks.workunit.client.1.smithi116.stdout:0/100: chown d2/dc/d12/f23 3309232 1 2024-09-13T21:40:36.394 INFO:tasks.workunit.client.1.smithi116.stdout:9/81: readlink d2/d8/lb 0 2024-09-13T21:40:36.394 INFO:tasks.workunit.client.1.smithi116.stdout:9/82: read - d2/f13 zero size 2024-09-13T21:40:36.395 INFO:tasks.workunit.client.1.smithi116.stdout:3/159: dread d3/db/d10/d1c/f1f [0,4194304] 0 2024-09-13T21:40:36.397 INFO:tasks.workunit.client.1.smithi116.stdout:3/160: rename d3/db/d10/c16 to d3/db/c3a 0 2024-09-13T21:40:36.399 INFO:tasks.workunit.client.1.smithi116.stdout:3/161: creat d3/db/d10/d29/f3b x:0 0 0 2024-09-13T21:40:36.400 INFO:tasks.workunit.client.1.smithi116.stdout:3/162: mkdir d3/db/d10/d1c/d34/d3c 0 2024-09-13T21:40:36.400 INFO:tasks.workunit.client.1.smithi116.stdout:3/163: write d3/db/d10/d1d/f1e [3785373,106513] 0 2024-09-13T21:40:36.400 INFO:tasks.workunit.client.1.smithi116.stdout:1/37: dwrite f3 [0,4194304] 0 2024-09-13T21:40:36.402 INFO:tasks.workunit.client.1.smithi116.stdout:3/164: mkdir d3/db/d3d 0 2024-09-13T21:40:36.407 INFO:tasks.workunit.client.1.smithi116.stdout:6/65: truncate d8/fe 1985 0 2024-09-13T21:40:36.409 INFO:tasks.workunit.client.1.smithi116.stdout:6/66: getdents d8/d10 0 2024-09-13T21:40:36.411 INFO:tasks.workunit.client.1.smithi116.stdout:7/140: dwrite d5/d9/db/ff [0,4194304] 0 2024-09-13T21:40:36.411 INFO:tasks.workunit.client.1.smithi116.stdout:6/67: creat d8/f16 x:0 0 0 2024-09-13T21:40:36.417 INFO:tasks.workunit.client.1.smithi116.stdout:7/141: unlink l3 0 2024-09-13T21:40:36.417 INFO:tasks.workunit.client.1.smithi116.stdout:7/142: write d5/f16 [1431232,13548] 0 2024-09-13T21:40:36.417 INFO:tasks.workunit.client.1.smithi116.stdout:7/143: symlink d5/d9/l30 0 2024-09-13T21:40:36.417 INFO:tasks.workunit.client.1.smithi116.stdout:1/38: dread d4/fa [0,4194304] 0 2024-09-13T21:40:36.418 INFO:tasks.workunit.client.1.smithi116.stdout:7/144: mkdir d5/d9/d27/d31 0 2024-09-13T21:40:36.418 INFO:tasks.workunit.client.1.smithi116.stdout:1/39: mknod d4/ce 0 2024-09-13T21:40:36.419 INFO:tasks.workunit.client.1.smithi116.stdout:7/145: symlink d5/d9/db/l32 0 2024-09-13T21:40:36.420 INFO:tasks.workunit.client.1.smithi116.stdout:7/146: readlink d5/d9/db/l11 0 2024-09-13T21:40:36.420 INFO:tasks.workunit.client.1.smithi116.stdout:4/91: dwrite d0/fb [0,4194304] 0 2024-09-13T21:40:36.421 INFO:tasks.workunit.client.1.smithi116.stdout:7/147: creat d5/d9/f33 x:0 0 0 2024-09-13T21:40:36.424 INFO:tasks.workunit.client.1.smithi116.stdout:7/148: symlink d5/d9/d27/d31/l34 0 2024-09-13T21:40:36.424 INFO:tasks.workunit.client.1.smithi116.stdout:7/149: creat d5/f35 x:0 0 0 2024-09-13T21:40:36.424 INFO:tasks.workunit.client.1.smithi116.stdout:7/150: read d5/f18 [120775,46939] 0 2024-09-13T21:40:36.427 INFO:tasks.workunit.client.1.smithi116.stdout:1/40: dread d4/f8 [0,4194304] 0 2024-09-13T21:40:36.427 INFO:tasks.workunit.client.1.smithi116.stdout:1/41: creat d4/ff x:0 0 0 2024-09-13T21:40:36.427 INFO:tasks.workunit.client.1.smithi116.stdout:1/42: creat d4/f10 x:0 0 0 2024-09-13T21:40:36.429 INFO:tasks.workunit.client.1.smithi116.stdout:2/97: dwrite d0/d7/f12 [0,4194304] 0 2024-09-13T21:40:36.430 INFO:tasks.workunit.client.1.smithi116.stdout:4/92: dread d0/f10 [0,4194304] 0 2024-09-13T21:40:36.430 INFO:tasks.workunit.client.1.smithi116.stdout:9/83: dwrite d2/d10/f12 [0,4194304] 0 2024-09-13T21:40:36.430 INFO:tasks.workunit.client.1.smithi116.stdout:4/93: write d0/f8 [7217391,108991] 0 2024-09-13T21:40:36.431 INFO:tasks.workunit.client.1.smithi116.stdout:1/43: mknod d4/c11 0 2024-09-13T21:40:36.431 INFO:tasks.workunit.client.1.smithi116.stdout:1/44: creat d4/f12 x:0 0 0 2024-09-13T21:40:36.431 INFO:tasks.workunit.client.1.smithi116.stdout:1/45: fdatasync f2 0 2024-09-13T21:40:36.431 INFO:tasks.workunit.client.1.smithi116.stdout:0/101: dwrite d2/dc/d12/f23 [0,4194304] 0 2024-09-13T21:40:36.431 INFO:tasks.workunit.client.1.smithi116.stdout:3/165: dwrite d3/db/ff [0,4194304] 0 2024-09-13T21:40:36.434 INFO:tasks.workunit.client.1.smithi116.stdout:2/98: rename d0/da/f11 to d0/d5/d8/f20 0 2024-09-13T21:40:36.437 INFO:tasks.workunit.client.1.smithi116.stdout:0/102: dread d2/d5/f9 [0,4194304] 0 2024-09-13T21:40:36.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/84: mknod d2/d10/d14/c19 0 2024-09-13T21:40:36.438 INFO:tasks.workunit.client.1.smithi116.stdout:5/186: truncate d7/da/f1b 1183189 0 2024-09-13T21:40:36.438 INFO:tasks.workunit.client.1.smithi116.stdout:6/68: dwrite d8/fd [0,4194304] 0 2024-09-13T21:40:36.441 INFO:tasks.workunit.client.1.smithi116.stdout:4/94: link d0/l9 d0/dd/l1a 0 2024-09-13T21:40:36.443 INFO:tasks.workunit.client.1.smithi116.stdout:1/46: symlink d4/l13 0 2024-09-13T21:40:36.455 INFO:tasks.workunit.client.1.smithi116.stdout:0/103: unlink d2/d5/l25 0 2024-09-13T21:40:36.455 INFO:tasks.workunit.client.1.smithi116.stdout:0/104: read - d2/d5/fd zero size 2024-09-13T21:40:36.455 INFO:tasks.workunit.client.1.smithi116.stdout:0/105: dread - d2/d5/f26 zero size 2024-09-13T21:40:36.455 INFO:tasks.workunit.client.1.smithi116.stdout:0/106: dread - d2/dc/f22 zero size 2024-09-13T21:40:36.455 INFO:tasks.workunit.client.1.smithi116.stdout:0/107: creat d2/d5/f27 x:0 0 0 2024-09-13T21:40:36.458 INFO:tasks.workunit.client.1.smithi116.stdout:9/85: link d2/f4 d2/d8/f1a 0 2024-09-13T21:40:36.461 INFO:tasks.workunit.client.1.smithi116.stdout:5/187: rename d7/d1d/l26 to d7/d1d/l38 0 2024-09-13T21:40:36.462 INFO:tasks.workunit.client.1.smithi116.stdout:5/188: dread d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:36.466 INFO:tasks.workunit.client.1.smithi116.stdout:6/69: truncate d8/d10/f14 4598951 0 2024-09-13T21:40:36.469 INFO:tasks.workunit.client.1.smithi116.stdout:7/151: fsync d5/f35 0 2024-09-13T21:40:36.469 INFO:tasks.workunit.client.1.smithi116.stdout:7/152: fsync d5/f16 0 2024-09-13T21:40:36.469 INFO:tasks.workunit.client.1.smithi116.stdout:7/153: readlink d5/l28 0 2024-09-13T21:40:36.469 INFO:tasks.workunit.client.1.smithi116.stdout:7/154: chown d5/f16 16522 1 2024-09-13T21:40:36.469 INFO:tasks.workunit.client.1.smithi116.stdout:7/155: stat c4 0 2024-09-13T21:40:36.478 INFO:tasks.workunit.client.1.smithi116.stdout:4/95: creat d0/dd/f1b x:0 0 0 2024-09-13T21:40:36.480 INFO:tasks.workunit.client.1.smithi116.stdout:1/47: mkdir d4/d14 0 2024-09-13T21:40:36.481 INFO:tasks.workunit.client.1.smithi116.stdout:3/166: rename d3/db/d10/d29/f3b to d3/db/f3e 0 2024-09-13T21:40:36.481 INFO:tasks.workunit.client.1.smithi116.stdout:3/167: read d3/db/f31 [276734,56727] 0 2024-09-13T21:40:36.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:36 smithi088 ceph-mon[27963]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:36.485 INFO:tasks.workunit.client.1.smithi116.stdout:1/48: write f1 [316502,111369] 0 2024-09-13T21:40:36.485 INFO:tasks.workunit.client.1.smithi116.stdout:1/49: read f1 [1260513,26825] 0 2024-09-13T21:40:36.485 INFO:tasks.workunit.client.1.smithi116.stdout:0/108: mkdir d2/dc/d12/d28 0 2024-09-13T21:40:36.485 INFO:tasks.workunit.client.1.smithi116.stdout:0/109: write d2/dc/f22 [900128,98639] 0 2024-09-13T21:40:36.486 INFO:tasks.workunit.client.1.smithi116.stdout:9/86: symlink d2/l1b 0 2024-09-13T21:40:36.490 INFO:tasks.workunit.client.1.smithi116.stdout:5/189: creat d7/da/d21/f39 x:0 0 0 2024-09-13T21:40:36.493 INFO:tasks.workunit.client.1.smithi116.stdout:7/156: chown d5/d9/db/d21/c2d 9552532 1 2024-09-13T21:40:36.493 INFO:tasks.workunit.client.1.smithi116.stdout:9/87: dread d2/f7 [0,4194304] 0 2024-09-13T21:40:36.494 INFO:tasks.workunit.client.1.smithi116.stdout:1/50: mknod d4/d14/c15 0 2024-09-13T21:40:36.497 INFO:tasks.workunit.client.1.smithi116.stdout:0/110: creat d2/dc/f29 x:0 0 0 2024-09-13T21:40:36.499 INFO:tasks.workunit.client.1.smithi116.stdout:5/190: creat d7/f3a x:0 0 0 2024-09-13T21:40:36.500 INFO:tasks.workunit.client.1.smithi116.stdout:6/70: mkdir d8/d17 0 2024-09-13T21:40:36.504 INFO:tasks.workunit.client.1.smithi116.stdout:9/88: rename d2/d8/c9 to d2/c1c 0 2024-09-13T21:40:36.504 INFO:tasks.workunit.client.1.smithi116.stdout:9/89: chown d2/d8/fd 2766 1 2024-09-13T21:40:36.504 INFO:tasks.workunit.client.1.smithi116.stdout:9/90: fdatasync d2/fc 0 2024-09-13T21:40:36.504 INFO:tasks.workunit.client.1.smithi116.stdout:9/91: stat d2/d8/f11 0 2024-09-13T21:40:36.506 INFO:tasks.workunit.client.1.smithi116.stdout:3/168: getdents d3/db/d10/d1d 0 2024-09-13T21:40:36.506 INFO:tasks.workunit.client.1.smithi116.stdout:3/169: creat d3/db/f3f x:0 0 0 2024-09-13T21:40:36.506 INFO:tasks.workunit.client.1.smithi116.stdout:3/170: fsync d3/db/ff 0 2024-09-13T21:40:36.507 INFO:tasks.workunit.client.1.smithi116.stdout:4/96: dwrite d0/f8 [4194304,4194304] 0 2024-09-13T21:40:36.508 INFO:tasks.workunit.client.1.smithi116.stdout:1/51: mknod d4/c16 0 2024-09-13T21:40:36.508 INFO:tasks.workunit.client.1.smithi116.stdout:1/52: chown d4/c11 7611439 1 2024-09-13T21:40:36.508 INFO:tasks.workunit.client.1.smithi116.stdout:1/53: dread - d4/ff zero size 2024-09-13T21:40:36.511 INFO:tasks.workunit.client.1.smithi116.stdout:6/71: creat d8/d10/f18 x:0 0 0 2024-09-13T21:40:36.511 INFO:tasks.workunit.client.1.smithi116.stdout:6/72: getdents d8/d17 0 2024-09-13T21:40:36.512 INFO:tasks.workunit.client.1.smithi116.stdout:9/92: dread d2/f7 [0,4194304] 0 2024-09-13T21:40:36.514 INFO:tasks.workunit.client.1.smithi116.stdout:2/99: truncate d0/d7/f12 2816440 0 2024-09-13T21:40:36.517 INFO:tasks.workunit.client.1.smithi116.stdout:1/54: link f1 d4/f17 0 2024-09-13T21:40:36.518 INFO:tasks.workunit.client.1.smithi116.stdout:1/55: chown d4/c5 11463 1 2024-09-13T21:40:36.518 INFO:tasks.workunit.client.1.smithi116.stdout:1/56: chown d4/fa 409983 1 2024-09-13T21:40:36.521 INFO:tasks.workunit.client.1.smithi116.stdout:4/97: write d0/fb [22163,53288] 0 2024-09-13T21:40:36.524 INFO:tasks.workunit.client.1.smithi116.stdout:7/157: symlink d5/d9/db/l36 0 2024-09-13T21:40:36.524 INFO:tasks.workunit.client.1.smithi116.stdout:7/158: readlink d5/d9/db/d21/l2a 0 2024-09-13T21:40:36.528 INFO:tasks.workunit.client.1.smithi116.stdout:4/98: getdents d0 0 2024-09-13T21:40:36.529 INFO:tasks.workunit.client.1.smithi116.stdout:7/159: dread d5/f16 [0,4194304] 0 2024-09-13T21:40:36.529 INFO:tasks.workunit.client.1.smithi116.stdout:7/160: dread - d5/f35 zero size 2024-09-13T21:40:36.529 INFO:tasks.workunit.client.1.smithi116.stdout:5/191: dwrite d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:36.530 INFO:tasks.workunit.client.1.smithi116.stdout:4/99: symlink d0/dd/d13/l1c 0 2024-09-13T21:40:36.530 INFO:tasks.workunit.client.1.smithi116.stdout:4/100: fsync d0/f10 0 2024-09-13T21:40:36.530 INFO:tasks.workunit.client.1.smithi116.stdout:4/101: chown d0/f8 3 1 2024-09-13T21:40:36.532 INFO:tasks.workunit.client.1.smithi116.stdout:7/161: mkdir d5/d9/d1c/d37 0 2024-09-13T21:40:36.535 INFO:tasks.workunit.client.1.smithi116.stdout:5/192: link d7/da/d21/f30 d7/da/d21/f3b 0 2024-09-13T21:40:36.536 INFO:tasks.workunit.client.1.smithi116.stdout:7/162: mkdir d5/d9/d27/d31/d38 0 2024-09-13T21:40:36.537 INFO:tasks.workunit.client.1.smithi116.stdout:7/163: creat d5/f39 x:0 0 0 2024-09-13T21:40:36.537 INFO:tasks.workunit.client.1.smithi116.stdout:7/164: truncate d5/f35 498464 0 2024-09-13T21:40:36.538 INFO:tasks.workunit.client.1.smithi116.stdout:4/102: dread d0/fa [0,4194304] 0 2024-09-13T21:40:36.538 INFO:tasks.workunit.client.1.smithi116.stdout:4/103: chown d0/dd/c16 879001807 1 2024-09-13T21:40:36.538 INFO:tasks.workunit.client.1.smithi116.stdout:4/104: write d0/fb [1234638,78905] 0 2024-09-13T21:40:36.539 INFO:tasks.workunit.client.1.smithi116.stdout:5/193: link d7/da/d21/c22 d7/da/d21/c3c 0 2024-09-13T21:40:36.541 INFO:tasks.workunit.client.1.smithi116.stdout:7/165: mkdir d5/d9/d1c/d22/d24/d3a 0 2024-09-13T21:40:36.543 INFO:tasks.workunit.client.1.smithi116.stdout:7/166: chown d5/f39 45838499 1 2024-09-13T21:40:36.544 INFO:tasks.workunit.client.1.smithi116.stdout:7/167: write d5/d9/f33 [223949,31774] 0 2024-09-13T21:40:36.544 INFO:tasks.workunit.client.1.smithi116.stdout:1/57: dwrite d4/ff [0,4194304] 0 2024-09-13T21:40:36.544 INFO:tasks.workunit.client.1.smithi116.stdout:4/105: mknod d0/dd/d13/c1d 0 2024-09-13T21:40:36.545 INFO:tasks.workunit.client.1.smithi116.stdout:6/73: dwrite d8/fd [0,4194304] 0 2024-09-13T21:40:36.545 INFO:tasks.workunit.client.1.smithi116.stdout:8/55: sync 2024-09-13T21:40:36.545 INFO:tasks.workunit.client.1.smithi116.stdout:7/168: dread d5/f18 [0,4194304] 0 2024-09-13T21:40:36.546 INFO:tasks.workunit.client.1.smithi116.stdout:1/58: getdents d4/d14 0 2024-09-13T21:40:36.547 INFO:tasks.workunit.client.1.smithi116.stdout:1/59: creat d4/f18 x:0 0 0 2024-09-13T21:40:36.552 INFO:tasks.workunit.client.1.smithi116.stdout:5/194: dread d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:36.552 INFO:tasks.workunit.client.1.smithi116.stdout:5/195: read - d7/f2f zero size 2024-09-13T21:40:36.555 INFO:tasks.workunit.client.1.smithi116.stdout:6/74: dread d8/fd [0,4194304] 0 2024-09-13T21:40:36.555 INFO:tasks.workunit.client.1.smithi116.stdout:6/75: write f3 [1239117,9154] 0 2024-09-13T21:40:36.556 INFO:tasks.workunit.client.1.smithi116.stdout:6/76: stat d8/d10 0 2024-09-13T21:40:36.556 INFO:tasks.workunit.client.1.smithi116.stdout:5/196: dread d7/da/f1b [0,4194304] 0 2024-09-13T21:40:36.556 INFO:tasks.workunit.client.1.smithi116.stdout:5/197: dread - d7/f2f zero size 2024-09-13T21:40:36.558 INFO:tasks.workunit.client.1.smithi116.stdout:8/56: symlink d2/d10/l14 0 2024-09-13T21:40:36.561 INFO:tasks.workunit.client.1.smithi116.stdout:7/169: rename d5/d9/db/fe to d5/d9/d1c/f3b 0 2024-09-13T21:40:36.561 INFO:tasks.workunit.client.1.smithi116.stdout:7/170: write d5/f8 [1670132,95607] 0 2024-09-13T21:40:36.563 INFO:tasks.workunit.client.1.smithi116.stdout:8/57: chown d2/f8 2 1 2024-09-13T21:40:36.563 INFO:tasks.workunit.client.1.smithi116.stdout:8/58: read - d2/d10/f11 zero size 2024-09-13T21:40:36.563 INFO:tasks.workunit.client.1.smithi116.stdout:6/77: creat d8/d17/f19 x:0 0 0 2024-09-13T21:40:36.564 INFO:tasks.workunit.client.1.smithi116.stdout:1/60: rename d4/f12 to d4/d14/f19 0 2024-09-13T21:40:36.564 INFO:tasks.workunit.client.1.smithi116.stdout:1/61: write d4/f8 [1226753,104442] 0 2024-09-13T21:40:36.564 INFO:tasks.workunit.client.1.smithi116.stdout:8/59: chown d2/c4 52 1 2024-09-13T21:40:36.568 INFO:tasks.workunit.client.1.smithi116.stdout:8/60: unlink d2/d10/l14 0 2024-09-13T21:40:36.569 INFO:tasks.workunit.client.1.smithi116.stdout:8/61: truncate d2/d10/f11 656505 0 2024-09-13T21:40:36.571 INFO:tasks.workunit.client.1.smithi116.stdout:6/78: link d8/d10/f14 d8/f1a 0 2024-09-13T21:40:36.571 INFO:tasks.workunit.client.1.smithi116.stdout:6/79: fdatasync d8/fd 0 2024-09-13T21:40:36.572 INFO:tasks.workunit.client.1.smithi116.stdout:8/62: rmdir d2 39 2024-09-13T21:40:36.572 INFO:tasks.workunit.client.1.smithi116.stdout:6/80: dread d8/fe [0,4194304] 0 2024-09-13T21:40:36.572 INFO:tasks.workunit.client.1.smithi116.stdout:6/81: dread - d8/d10/f18 zero size 2024-09-13T21:40:36.573 INFO:tasks.workunit.client.1.smithi116.stdout:4/106: truncate d0/f8 7461790 0 2024-09-13T21:40:36.575 INFO:tasks.workunit.client.1.smithi116.stdout:6/82: rename d8/fd to d8/d15/f1b 0 2024-09-13T21:40:36.575 INFO:tasks.workunit.client.1.smithi116.stdout:6/83: chown d8/d15 2 1 2024-09-13T21:40:36.575 INFO:tasks.workunit.client.1.smithi116.stdout:6/84: write d8/d10/f18 [759556,6566] 0 2024-09-13T21:40:36.575 INFO:tasks.workunit.client.1.smithi116.stdout:6/85: creat d8/d10/f1c x:0 0 0 2024-09-13T21:40:36.576 INFO:tasks.workunit.client.1.smithi116.stdout:8/63: mknod d2/c15 0 2024-09-13T21:40:36.577 INFO:tasks.workunit.client.1.smithi116.stdout:4/107: getdents d0/dd 0 2024-09-13T21:40:36.577 INFO:tasks.workunit.client.1.smithi116.stdout:4/108: chown d0 45859431 1 2024-09-13T21:40:36.579 INFO:tasks.workunit.client.1.smithi116.stdout:6/86: rename d8/d10/f1c to d8/f1d 0 2024-09-13T21:40:36.580 INFO:tasks.workunit.client.1.smithi116.stdout:4/109: truncate d0/fa 2936510 0 2024-09-13T21:40:36.582 INFO:tasks.workunit.client.1.smithi116.stdout:6/87: mkdir d8/d1e 0 2024-09-13T21:40:36.583 INFO:tasks.workunit.client.1.smithi116.stdout:6/88: creat d8/d15/f1f x:0 0 0 2024-09-13T21:40:36.585 INFO:tasks.workunit.client.1.smithi116.stdout:5/198: dwrite f1 [4194304,4194304] 0 2024-09-13T21:40:36.585 INFO:tasks.workunit.client.1.smithi116.stdout:5/199: write d7/f12 [4042343,46757] 0 2024-09-13T21:40:36.585 INFO:tasks.workunit.client.1.smithi116.stdout:6/89: fsync d8/d10/f14 0 2024-09-13T21:40:36.585 INFO:tasks.workunit.client.1.smithi116.stdout:1/62: fsync d4/f8 0 2024-09-13T21:40:36.585 INFO:tasks.workunit.client.1.smithi116.stdout:1/63: readlink d4/l13 0 2024-09-13T21:40:36.586 INFO:tasks.workunit.client.1.smithi116.stdout:1/64: chown d4/f8 2038719 1 2024-09-13T21:40:36.586 INFO:tasks.workunit.client.1.smithi116.stdout:1/65: fsync d4/ff 0 2024-09-13T21:40:36.586 INFO:tasks.workunit.client.1.smithi116.stdout:7/171: dwrite d5/f35 [0,4194304] 0 2024-09-13T21:40:36.587 INFO:tasks.workunit.client.1.smithi116.stdout:5/200: link d7/da/f19 d7/f3d 0 2024-09-13T21:40:36.587 INFO:tasks.workunit.client.1.smithi116.stdout:5/201: creat d7/da/f3e x:0 0 0 2024-09-13T21:40:36.588 INFO:tasks.workunit.client.1.smithi116.stdout:5/202: creat d7/f3f x:0 0 0 2024-09-13T21:40:36.588 INFO:tasks.workunit.client.1.smithi116.stdout:5/203: chown d7/da/d21 43089313 1 2024-09-13T21:40:36.591 INFO:tasks.workunit.client.1.smithi116.stdout:1/66: unlink d4/l13 0 2024-09-13T21:40:36.591 INFO:tasks.workunit.client.1.smithi116.stdout:1/67: chown d4/c9 5959 1 2024-09-13T21:40:36.591 INFO:tasks.workunit.client.1.smithi116.stdout:1/68: stat d4/d14 0 2024-09-13T21:40:36.591 INFO:tasks.workunit.client.1.smithi116.stdout:8/64: dread d2/f8 [0,4194304] 0 2024-09-13T21:40:36.591 INFO:tasks.workunit.client.1.smithi116.stdout:6/90: write d8/ff [115905,81166] 0 2024-09-13T21:40:36.591 INFO:tasks.workunit.client.1.smithi116.stdout:4/110: read d0/f10 [2446959,57601] 0 2024-09-13T21:40:36.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:36 smithi116 ceph-mon[33391]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:36.598 INFO:tasks.workunit.client.1.smithi116.stdout:1/69: mknod d4/c1a 0 2024-09-13T21:40:36.598 INFO:tasks.workunit.client.1.smithi116.stdout:1/70: fdatasync f1 0 2024-09-13T21:40:36.601 INFO:tasks.workunit.client.1.smithi116.stdout:6/91: symlink d8/d15/l20 0 2024-09-13T21:40:36.602 INFO:tasks.workunit.client.1.smithi116.stdout:4/111: link d0/f10 d0/dd/d13/f1e 0 2024-09-13T21:40:36.604 INFO:tasks.workunit.client.1.smithi116.stdout:7/172: link d5/f8 d5/d9/db/f3c 0 2024-09-13T21:40:36.606 INFO:tasks.workunit.client.1.smithi116.stdout:8/65: getdents d2/d10 0 2024-09-13T21:40:36.606 INFO:tasks.workunit.client.1.smithi116.stdout:8/66: chown d2/c4 0 1 2024-09-13T21:40:36.607 INFO:tasks.workunit.client.1.smithi116.stdout:6/92: creat d8/f21 x:0 0 0 2024-09-13T21:40:36.607 INFO:tasks.workunit.client.1.smithi116.stdout:5/204: dwrite d7/d1d/f29 [4194304,4194304] 0 2024-09-13T21:40:36.607 INFO:tasks.workunit.client.1.smithi116.stdout:5/205: readlink d7/d1d/l38 0 2024-09-13T21:40:36.608 INFO:tasks.workunit.client.1.smithi116.stdout:4/112: rmdir d0 39 2024-09-13T21:40:36.608 INFO:tasks.workunit.client.1.smithi116.stdout:4/113: fdatasync d0/f10 0 2024-09-13T21:40:36.608 INFO:tasks.workunit.client.1.smithi116.stdout:4/114: write d0/f10 [2401283,65259] 0 2024-09-13T21:40:36.608 INFO:tasks.workunit.client.1.smithi116.stdout:4/115: dread - d0/dd/f1b zero size 2024-09-13T21:40:36.608 INFO:tasks.workunit.client.1.smithi116.stdout:4/116: stat d0/dd/f1b 0 2024-09-13T21:40:36.611 INFO:tasks.workunit.client.1.smithi116.stdout:6/93: link f5 d8/d15/f22 0 2024-09-13T21:40:36.611 INFO:tasks.workunit.client.1.smithi116.stdout:6/94: write d8/d10/f18 [924524,129017] 0 2024-09-13T21:40:36.611 INFO:tasks.workunit.client.1.smithi116.stdout:5/206: mkdir d7/d40 0 2024-09-13T21:40:36.613 INFO:tasks.workunit.client.1.smithi116.stdout:4/117: rename d0/dd/c16 to d0/dd/d13/c1f 0 2024-09-13T21:40:36.618 INFO:tasks.workunit.client.1.smithi116.stdout:1/71: dwrite f3 [0,4194304] 0 2024-09-13T21:40:36.618 INFO:tasks.workunit.client.1.smithi116.stdout:6/95: fdatasync d8/d10/f18 0 2024-09-13T21:40:36.621 INFO:tasks.workunit.client.1.smithi116.stdout:4/118: dread d0/dd/d13/f1e [0,4194304] 0 2024-09-13T21:40:36.625 INFO:tasks.workunit.client.1.smithi116.stdout:5/207: rmdir d7 39 2024-09-13T21:40:36.625 INFO:tasks.workunit.client.1.smithi116.stdout:7/173: dread d5/d9/db/ff [0,4194304] 0 2024-09-13T21:40:36.626 INFO:tasks.workunit.client.1.smithi116.stdout:4/119: getdents d0/dd 0 2024-09-13T21:40:36.627 INFO:tasks.workunit.client.1.smithi116.stdout:8/67: write d2/f13 [1172023,5794] 0 2024-09-13T21:40:36.627 INFO:tasks.workunit.client.1.smithi116.stdout:7/174: write d5/f16 [1278673,14670] 0 2024-09-13T21:40:36.628 INFO:tasks.workunit.client.1.smithi116.stdout:6/96: truncate d8/d10/f18 408959 0 2024-09-13T21:40:36.628 INFO:tasks.workunit.client.1.smithi116.stdout:6/97: creat d8/d17/f23 x:0 0 0 2024-09-13T21:40:36.628 INFO:tasks.workunit.client.1.smithi116.stdout:6/98: readlink d8/d15/l20 0 2024-09-13T21:40:36.631 INFO:tasks.workunit.client.1.smithi116.stdout:7/175: link f2 d5/d9/f3d 0 2024-09-13T21:40:36.633 INFO:tasks.workunit.client.1.smithi116.stdout:6/99: mkdir d8/d10/d24 0 2024-09-13T21:40:36.635 INFO:tasks.workunit.client.1.smithi116.stdout:7/176: rename d5/f39 to d5/d9/db/d21/f3e 0 2024-09-13T21:40:36.636 INFO:tasks.workunit.client.1.smithi116.stdout:6/100: symlink d8/d17/l25 0 2024-09-13T21:40:36.638 INFO:tasks.workunit.client.1.smithi116.stdout:8/68: write d2/f8 [4496254,24847] 0 2024-09-13T21:40:36.639 INFO:tasks.workunit.client.1.smithi116.stdout:7/177: mknod d5/d9/db/c3f 0 2024-09-13T21:40:36.639 INFO:tasks.workunit.client.1.smithi116.stdout:8/69: mknod d2/d10/c16 0 2024-09-13T21:40:36.640 INFO:tasks.workunit.client.1.smithi116.stdout:7/178: chown d5/d9/db/l32 30 1 2024-09-13T21:40:36.640 INFO:tasks.workunit.client.1.smithi116.stdout:8/70: mknod d2/d10/c17 0 2024-09-13T21:40:36.641 INFO:tasks.workunit.client.1.smithi116.stdout:7/179: mknod d5/d9/d27/d31/d38/c40 0 2024-09-13T21:40:36.646 INFO:tasks.workunit.client.1.smithi116.stdout:4/120: dwrite d0/dd/f1b [0,4194304] 0 2024-09-13T21:40:36.646 INFO:tasks.workunit.client.1.smithi116.stdout:4/121: chown d0/dd/d13/l14 22 1 2024-09-13T21:40:36.647 INFO:tasks.workunit.client.1.smithi116.stdout:6/101: write d8/d15/f22 [2236377,98272] 0 2024-09-13T21:40:36.648 INFO:tasks.workunit.client.1.smithi116.stdout:7/180: dread d5/f8 [0,4194304] 0 2024-09-13T21:40:36.649 INFO:tasks.workunit.client.1.smithi116.stdout:4/122: symlink d0/dd/d13/l20 0 2024-09-13T21:40:36.649 INFO:tasks.workunit.client.1.smithi116.stdout:4/123: stat d0/dd/d13 0 2024-09-13T21:40:36.650 INFO:tasks.workunit.client.1.smithi116.stdout:6/102: mknod d8/d15/c26 0 2024-09-13T21:40:36.651 INFO:tasks.workunit.client.1.smithi116.stdout:6/103: fsync d8/d15/f1f 0 2024-09-13T21:40:36.651 INFO:tasks.workunit.client.1.smithi116.stdout:6/104: chown d8/f16 19525 1 2024-09-13T21:40:36.653 INFO:tasks.workunit.client.1.smithi116.stdout:4/124: unlink d0/dd/d13/c1f 0 2024-09-13T21:40:36.653 INFO:tasks.workunit.client.1.smithi116.stdout:4/125: fsync d0/dd/d13/f1e 0 2024-09-13T21:40:36.654 INFO:tasks.workunit.client.1.smithi116.stdout:6/105: symlink d8/d15/l27 0 2024-09-13T21:40:36.655 INFO:tasks.workunit.client.1.smithi116.stdout:6/106: creat d8/d1e/f28 x:0 0 0 2024-09-13T21:40:36.657 INFO:tasks.workunit.client.1.smithi116.stdout:6/107: creat d8/d10/d24/f29 x:0 0 0 2024-09-13T21:40:36.657 INFO:tasks.workunit.client.1.smithi116.stdout:6/108: stat d8/d15/c26 0 2024-09-13T21:40:36.658 INFO:tasks.workunit.client.1.smithi116.stdout:6/109: mknod d8/d17/c2a 0 2024-09-13T21:40:36.658 INFO:tasks.workunit.client.1.smithi116.stdout:6/110: write d8/d10/d24/f29 [20655,18520] 0 2024-09-13T21:40:36.658 INFO:tasks.workunit.client.1.smithi116.stdout:6/111: write d8/d1e/f28 [28811,86340] 0 2024-09-13T21:40:36.667 INFO:tasks.workunit.client.1.smithi116.stdout:8/71: dwrite d2/fd [0,4194304] 0 2024-09-13T21:40:36.667 INFO:tasks.workunit.client.1.smithi116.stdout:7/181: dwrite d5/d9/d1c/f3b [0,4194304] 0 2024-09-13T21:40:36.667 INFO:tasks.workunit.client.1.smithi116.stdout:7/182: truncate d5/d9/d1c/f3b 4625483 0 2024-09-13T21:40:36.669 INFO:tasks.workunit.client.1.smithi116.stdout:8/72: creat d2/d10/f18 x:0 0 0 2024-09-13T21:40:36.671 INFO:tasks.workunit.client.1.smithi116.stdout:7/183: creat d5/d9/d27/d31/d38/f41 x:0 0 0 2024-09-13T21:40:36.671 INFO:tasks.workunit.client.1.smithi116.stdout:7/184: dread - d5/d9/db/d21/f3e zero size 2024-09-13T21:40:36.671 INFO:tasks.workunit.client.1.smithi116.stdout:4/126: getdents d0/dd/d13 0 2024-09-13T21:40:36.674 INFO:tasks.workunit.client.1.smithi116.stdout:7/185: write d5/d9/f14 [403934,25357] 0 2024-09-13T21:40:36.700 INFO:tasks.workunit.client.1.smithi116.stdout:6/112: dwrite d8/d1e/f28 [0,4194304] 0 2024-09-13T21:40:36.701 INFO:tasks.workunit.client.1.smithi116.stdout:6/113: write d8/d10/f18 [28818,102566] 0 2024-09-13T21:40:36.706 INFO:tasks.workunit.client.1.smithi116.stdout:6/114: link d8/f16 d8/d10/f2b 0 2024-09-13T21:40:36.719 INFO:tasks.workunit.client.1.smithi116.stdout:6/115: dwrite d8/d1e/f28 [0,4194304] 0 2024-09-13T21:40:36.720 INFO:tasks.workunit.client.1.smithi116.stdout:6/116: creat d8/f2c x:0 0 0 2024-09-13T21:40:36.720 INFO:tasks.workunit.client.1.smithi116.stdout:6/117: stat d8/d10/c13 0 2024-09-13T21:40:36.720 INFO:tasks.workunit.client.1.smithi116.stdout:6/118: symlink d8/d17/l2d 0 2024-09-13T21:40:36.796 INFO:tasks.workunit.client.1.smithi116.stdout:8/73: dwrite d2/f13 [0,4194304] 0 2024-09-13T21:40:36.798 INFO:tasks.workunit.client.1.smithi116.stdout:8/74: mkdir d2/d10/d19 0 2024-09-13T21:40:36.798 INFO:tasks.workunit.client.1.smithi116.stdout:8/75: link d2/d10/c16 d2/d10/d19/c1a 0 2024-09-13T21:40:36.801 INFO:tasks.workunit.client.1.smithi116.stdout:4/127: dwrite d0/f8 [0,4194304] 0 2024-09-13T21:40:36.801 INFO:tasks.workunit.client.1.smithi116.stdout:4/128: truncate d0/fb 3540103 0 2024-09-13T21:40:36.802 INFO:tasks.workunit.client.1.smithi116.stdout:4/129: getdents d0/dd/d13 0 2024-09-13T21:40:36.805 INFO:tasks.workunit.client.1.smithi116.stdout:8/76: getdents d2/d10/d19 0 2024-09-13T21:40:36.807 INFO:tasks.workunit.client.1.smithi116.stdout:8/77: symlink d2/d10/d19/l1b 0 2024-09-13T21:40:36.807 INFO:tasks.workunit.client.1.smithi116.stdout:8/78: fdatasync d2/d10/f18 0 2024-09-13T21:40:36.815 INFO:tasks.workunit.client.1.smithi116.stdout:4/130: dwrite d0/fa [0,4194304] 0 2024-09-13T21:40:36.821 INFO:tasks.workunit.client.1.smithi116.stdout:4/131: dread d0/fb [0,4194304] 0 2024-09-13T21:40:36.821 INFO:tasks.workunit.client.1.smithi116.stdout:4/132: chown d0/f8 1 1 2024-09-13T21:40:36.821 INFO:tasks.workunit.client.1.smithi116.stdout:4/133: write d0/dd/d13/f1e [2667185,41728] 0 2024-09-13T21:40:36.821 INFO:tasks.workunit.client.1.smithi116.stdout:4/134: read d0/fb [941733,23628] 0 2024-09-13T21:40:36.822 INFO:tasks.workunit.client.1.smithi116.stdout:4/135: creat d0/dd/d13/f21 x:0 0 0 2024-09-13T21:40:36.822 INFO:tasks.workunit.client.1.smithi116.stdout:4/136: truncate d0/fb 3623841 0 2024-09-13T21:40:36.822 INFO:tasks.workunit.client.1.smithi116.stdout:4/137: rmdir d0 39 2024-09-13T21:40:36.840 INFO:tasks.workunit.client.1.smithi116.stdout:4/138: dwrite d0/f10 [0,4194304] 0 2024-09-13T21:40:36.840 INFO:tasks.workunit.client.1.smithi116.stdout:4/139: getdents d0/dd 0 2024-09-13T21:40:36.841 INFO:tasks.workunit.client.1.smithi116.stdout:4/140: rename d0/l9 to d0/dd/l22 0 2024-09-13T21:40:36.842 INFO:tasks.workunit.client.1.smithi116.stdout:4/141: link d0/l6 d0/l23 0 2024-09-13T21:40:36.846 INFO:tasks.workunit.client.1.smithi116.stdout:4/142: getdents d0 0 2024-09-13T21:40:36.847 INFO:tasks.workunit.client.1.smithi116.stdout:4/143: creat d0/f24 x:0 0 0 2024-09-13T21:40:36.869 INFO:tasks.workunit.client.1.smithi116.stdout:4/144: dwrite d0/f10 [0,4194304] 0 2024-09-13T21:40:36.870 INFO:tasks.workunit.client.1.smithi116.stdout:4/145: symlink d0/l25 0 2024-09-13T21:40:36.888 INFO:tasks.workunit.client.1.smithi116.stdout:4/146: dwrite d0/dd/f1b [0,4194304] 0 2024-09-13T21:40:36.889 INFO:tasks.workunit.client.1.smithi116.stdout:4/147: chown d0/dd/d13/c15 31143606 1 2024-09-13T21:40:36.889 INFO:tasks.workunit.client.1.smithi116.stdout:4/148: dread - d0/f24 zero size 2024-09-13T21:40:36.889 INFO:tasks.workunit.client.1.smithi116.stdout:4/149: symlink d0/dd/l26 0 2024-09-13T21:40:36.896 INFO:tasks.workunit.client.1.smithi116.stdout:4/150: truncate d0/fb 2604846 0 2024-09-13T21:40:36.897 INFO:tasks.workunit.client.1.smithi116.stdout:4/151: creat d0/dd/f27 x:0 0 0 2024-09-13T21:40:36.905 INFO:tasks.workunit.client.1.smithi116.stdout:4/152: dread d0/f8 [4194304,4194304] 0 2024-09-13T21:40:36.905 INFO:tasks.workunit.client.1.smithi116.stdout:4/153: fsync d0/dd/d13/f1e 0 2024-09-13T21:40:36.906 INFO:tasks.workunit.client.1.smithi116.stdout:4/154: readlink d0/l25 0 2024-09-13T21:40:36.908 INFO:tasks.workunit.client.1.smithi116.stdout:4/155: creat d0/f28 x:0 0 0 2024-09-13T21:40:36.910 INFO:tasks.workunit.client.1.smithi116.stdout:4/156: unlink d0/fa 0 2024-09-13T21:40:36.912 INFO:tasks.workunit.client.1.smithi116.stdout:4/157: rename d0/l6 to d0/dd/l29 0 2024-09-13T21:40:36.913 INFO:tasks.workunit.client.1.smithi116.stdout:4/158: rename d0/dd/l22 to d0/dd/d13/l2a 0 2024-09-13T21:40:36.918 INFO:tasks.workunit.client.1.smithi116.stdout:4/159: rmdir d0/dd 39 2024-09-13T21:40:36.919 INFO:tasks.workunit.client.1.smithi116.stdout:4/160: creat d0/f2b x:0 0 0 2024-09-13T21:40:36.919 INFO:tasks.workunit.client.1.smithi116.stdout:4/161: write d0/fb [2134637,110020] 0 2024-09-13T21:40:36.921 INFO:tasks.workunit.client.1.smithi116.stdout:4/162: rename d0/dd/l26 to d0/l2c 0 2024-09-13T21:40:36.922 INFO:tasks.workunit.client.1.smithi116.stdout:4/163: unlink d0/cc 0 2024-09-13T21:40:36.924 INFO:tasks.workunit.client.1.smithi116.stdout:4/164: rename d0/c5 to d0/c2d 0 2024-09-13T21:40:36.925 INFO:tasks.workunit.client.1.smithi116.stdout:4/165: creat d0/dd/f2e x:0 0 0 2024-09-13T21:40:36.926 INFO:tasks.workunit.client.1.smithi116.stdout:4/166: symlink d0/dd/d13/l2f 0 2024-09-13T21:40:36.927 INFO:tasks.workunit.client.1.smithi116.stdout:4/167: creat d0/f30 x:0 0 0 2024-09-13T21:40:36.927 INFO:tasks.workunit.client.1.smithi116.stdout:4/168: truncate d0/f8 5775750 0 2024-09-13T21:40:36.928 INFO:tasks.workunit.client.1.smithi116.stdout:4/169: creat d0/f31 x:0 0 0 2024-09-13T21:40:36.934 INFO:tasks.workunit.client.1.smithi116.stdout:4/170: rmdir d0/dd 39 2024-09-13T21:40:36.956 INFO:tasks.workunit.client.1.smithi116.stdout:4/171: dwrite d0/dd/f1b [0,4194304] 0 2024-09-13T21:40:36.958 INFO:tasks.workunit.client.1.smithi116.stdout:4/172: mkdir d0/d32 0 2024-09-13T21:40:36.958 INFO:tasks.workunit.client.1.smithi116.stdout:4/173: fsync d0/dd/d13/f1e 0 2024-09-13T21:40:36.958 INFO:tasks.workunit.client.1.smithi116.stdout:4/174: dread - d0/dd/f2e zero size 2024-09-13T21:40:36.958 INFO:tasks.workunit.client.1.smithi116.stdout:4/175: stat d0/dd/d13/f1e 0 2024-09-13T21:40:36.959 INFO:tasks.workunit.client.1.smithi116.stdout:4/176: dread - d0/f30 zero size 2024-09-13T21:40:36.959 INFO:tasks.workunit.client.1.smithi116.stdout:4/177: chown d0/dd/f2e 96 1 2024-09-13T21:40:36.959 INFO:tasks.workunit.client.1.smithi116.stdout:4/178: stat d0/dd/f2e 0 2024-09-13T21:40:36.959 INFO:tasks.workunit.client.1.smithi116.stdout:4/179: read - d0/dd/f2e zero size 2024-09-13T21:40:36.960 INFO:tasks.workunit.client.1.smithi116.stdout:4/180: getdents d0/dd 0 2024-09-13T21:40:36.984 INFO:tasks.workunit.client.1.smithi116.stdout:4/181: dwrite d0/dd/d13/f21 [0,4194304] 0 2024-09-13T21:40:36.984 INFO:tasks.workunit.client.1.smithi116.stdout:4/182: truncate d0/f30 239999 0 2024-09-13T21:40:36.985 INFO:tasks.workunit.client.1.smithi116.stdout:4/183: write d0/f2b [677056,47663] 0 2024-09-13T21:40:36.994 INFO:tasks.workunit.client.1.smithi116.stdout:4/184: write - open d0/f30 failed 14 2024-09-13T21:40:37.014 INFO:tasks.workunit.client.1.smithi116.stdout:4/185: dwrite d0/f31 [0,4194304] 0 2024-09-13T21:40:37.014 INFO:tasks.workunit.client.1.smithi116.stdout:4/186: dread - d0/dd/f2e zero size 2024-09-13T21:40:37.029 INFO:tasks.workunit.client.1.smithi116.stdout:4/187: dwrite d0/f28 [0,4194304] 0 2024-09-13T21:40:37.045 INFO:tasks.workunit.client.1.smithi116.stdout:4/188: dwrite d0/f8 [4194304,4194304] 0 2024-09-13T21:40:37.045 INFO:tasks.workunit.client.1.smithi116.stdout:4/189: fdatasync d0/f30 0 2024-09-13T21:40:37.049 INFO:tasks.workunit.client.1.smithi116.stdout:4/190: dread d0/f30 [0,4194304] 0 2024-09-13T21:40:37.051 INFO:tasks.workunit.client.1.smithi116.stdout:4/191: mknod d0/c33 0 2024-09-13T21:40:37.051 INFO:tasks.workunit.client.1.smithi116.stdout:4/192: chown d0/ce 301488370 1 2024-09-13T21:40:37.069 INFO:tasks.workunit.client.1.smithi116.stdout:4/193: dwrite d0/dd/d13/f1e [0,4194304] 0 2024-09-13T21:40:37.070 INFO:tasks.workunit.client.1.smithi116.stdout:4/194: fdatasync d0/f24 0 2024-09-13T21:40:37.070 INFO:tasks.workunit.client.1.smithi116.stdout:4/195: write d0/f10 [4808898,38571] 0 2024-09-13T21:40:37.071 INFO:tasks.workunit.client.1.smithi116.stdout:4/196: unlink d0/dd/d13/c15 0 2024-09-13T21:40:37.084 INFO:tasks.workunit.client.1.smithi116.stdout:3/171: sync 2024-09-13T21:40:37.084 INFO:tasks.workunit.client.1.smithi116.stdout:0/111: sync 2024-09-13T21:40:37.085 INFO:tasks.workunit.client.1.smithi116.stdout:0/112: truncate d2/f1d 109121 0 2024-09-13T21:40:37.085 INFO:tasks.workunit.client.1.smithi116.stdout:3/172: mkdir d3/db/d3d/d40 0 2024-09-13T21:40:37.087 INFO:tasks.workunit.client.1.smithi116.stdout:4/197: dwrite d0/f8 [0,4194304] 0 2024-09-13T21:40:37.095 INFO:tasks.workunit.client.1.smithi116.stdout:0/113: write d2/dc/d12/f23 [107695,34822] 0 2024-09-13T21:40:37.095 INFO:tasks.workunit.client.1.smithi116.stdout:0/114: write d2/d5/f13 [1196870,41784] 0 2024-09-13T21:40:37.096 INFO:tasks.workunit.client.1.smithi116.stdout:3/173: dread d3/db/d20/d25/f2a [0,4194304] 0 2024-09-13T21:40:37.096 INFO:tasks.workunit.client.1.smithi116.stdout:3/174: truncate d3/db/f3f 688206 0 2024-09-13T21:40:37.097 INFO:tasks.workunit.client.1.smithi116.stdout:0/115: creat d2/dc/d12/d28/f2a x:0 0 0 2024-09-13T21:40:37.098 INFO:tasks.workunit.client.1.smithi116.stdout:0/116: creat d2/dc/d12/d28/f2b x:0 0 0 2024-09-13T21:40:37.098 INFO:tasks.workunit.client.1.smithi116.stdout:0/117: truncate d2/dc/d12/d28/f2b 109770 0 2024-09-13T21:40:37.098 INFO:tasks.workunit.client.1.smithi116.stdout:0/118: chown d2/f7 2 1 2024-09-13T21:40:37.098 INFO:tasks.workunit.client.1.smithi116.stdout:0/119: creat d2/dc/f2c x:0 0 0 2024-09-13T21:40:37.099 INFO:tasks.workunit.client.1.smithi116.stdout:4/198: read d0/dd/d13/f1e [2818400,85901] 0 2024-09-13T21:40:37.108 INFO:tasks.workunit.client.1.smithi116.stdout:3/175: dread d3/db/ff [0,4194304] 0 2024-09-13T21:40:37.110 INFO:tasks.workunit.client.1.smithi116.stdout:3/176: mknod d3/db/d10/d1d/c41 0 2024-09-13T21:40:37.110 INFO:tasks.workunit.client.1.smithi116.stdout:3/177: stat d3/db/d10/d29/c36 0 2024-09-13T21:40:37.111 INFO:tasks.workunit.client.1.smithi116.stdout:3/178: fdatasync d3/db/d10/f18 0 2024-09-13T21:40:37.111 INFO:tasks.workunit.client.1.smithi116.stdout:3/179: chown d3/db/d10/d1d/f2d 40653 1 2024-09-13T21:40:37.111 INFO:tasks.workunit.client.1.smithi116.stdout:3/180: write d3/db/f3f [1193467,121790] 0 2024-09-13T21:40:37.116 INFO:tasks.workunit.client.1.smithi116.stdout:3/181: dread d3/db/d10/f15 [0,4194304] 0 2024-09-13T21:40:37.120 INFO:tasks.workunit.client.1.smithi116.stdout:0/120: dwrite d2/f1d [0,4194304] 0 2024-09-13T21:40:37.120 INFO:tasks.workunit.client.1.smithi116.stdout:4/199: dwrite d0/f24 [0,4194304] 0 2024-09-13T21:40:37.121 INFO:tasks.workunit.client.1.smithi116.stdout:3/182: truncate d3/db/f3f 73904 0 2024-09-13T21:40:37.122 INFO:tasks.workunit.client.1.smithi116.stdout:0/121: truncate d2/d5/fd 650827 0 2024-09-13T21:40:37.125 INFO:tasks.workunit.client.1.smithi116.stdout:4/200: creat d0/d32/f34 x:0 0 0 2024-09-13T21:40:37.125 INFO:tasks.workunit.client.1.smithi116.stdout:4/201: dread - d0/d32/f34 zero size 2024-09-13T21:40:37.126 INFO:tasks.workunit.client.1.smithi116.stdout:3/183: creat d3/db/d3d/d40/f42 x:0 0 0 2024-09-13T21:40:37.128 INFO:tasks.workunit.client.1.smithi116.stdout:4/202: mknod d0/c35 0 2024-09-13T21:40:37.129 INFO:tasks.workunit.client.1.smithi116.stdout:4/203: readlink d0/l25 0 2024-09-13T21:40:37.129 INFO:tasks.workunit.client.1.smithi116.stdout:0/122: dread d2/d5/fd [0,4194304] 0 2024-09-13T21:40:37.129 INFO:tasks.workunit.client.1.smithi116.stdout:0/123: chown d2/dc/d12/f17 0 1 2024-09-13T21:40:37.130 INFO:tasks.workunit.client.1.smithi116.stdout:0/124: creat d2/dc/f2d x:0 0 0 2024-09-13T21:40:37.130 INFO:tasks.workunit.client.1.smithi116.stdout:0/125: chown d2/d5/f16 674811 1 2024-09-13T21:40:37.130 INFO:tasks.workunit.client.1.smithi116.stdout:0/126: creat d2/dc/f2e x:0 0 0 2024-09-13T21:40:37.130 INFO:tasks.workunit.client.1.smithi116.stdout:0/127: stat d2/d5 0 2024-09-13T21:40:37.131 INFO:tasks.workunit.client.1.smithi116.stdout:0/128: symlink d2/dc/d12/l2f 0 2024-09-13T21:40:37.132 INFO:tasks.workunit.client.1.smithi116.stdout:0/129: symlink d2/dc/d12/d28/l30 0 2024-09-13T21:40:37.133 INFO:tasks.workunit.client.1.smithi116.stdout:0/130: rename d2/dc/d12/f17 to d2/dc/f31 0 2024-09-13T21:40:37.137 INFO:tasks.workunit.client.1.smithi116.stdout:4/204: read d0/f8 [6850673,35681] 0 2024-09-13T21:40:37.140 INFO:tasks.workunit.client.1.smithi116.stdout:0/131: dread d2/d5/f6 [0,4194304] 0 2024-09-13T21:40:37.140 INFO:tasks.workunit.client.1.smithi116.stdout:0/132: write d2/dc/d12/f23 [1388773,49701] 0 2024-09-13T21:40:37.158 INFO:tasks.workunit.client.1.smithi116.stdout:4/205: dwrite d0/dd/f2e [0,4194304] 0 2024-09-13T21:40:37.158 INFO:tasks.workunit.client.1.smithi116.stdout:4/206: write d0/f10 [2645965,39232] 0 2024-09-13T21:40:37.158 INFO:tasks.workunit.client.1.smithi116.stdout:0/133: dwrite d2/dc/f2e [0,4194304] 0 2024-09-13T21:40:37.159 INFO:tasks.workunit.client.1.smithi116.stdout:0/134: write d2/d5/f26 [893825,68449] 0 2024-09-13T21:40:37.159 INFO:tasks.workunit.client.1.smithi116.stdout:0/135: creat d2/dc/d12/d28/f32 x:0 0 0 2024-09-13T21:40:37.159 INFO:tasks.workunit.client.1.smithi116.stdout:0/136: readlink d2/dc/l1b 0 2024-09-13T21:40:37.159 INFO:tasks.workunit.client.1.smithi116.stdout:0/137: write d2/dc/d12/f23 [3520847,20330] 0 2024-09-13T21:40:37.159 INFO:tasks.workunit.client.1.smithi116.stdout:0/138: dread - d2/dc/f2d zero size 2024-09-13T21:40:37.159 INFO:tasks.workunit.client.1.smithi116.stdout:0/139: write d2/d5/f9 [1066485,107000] 0 2024-09-13T21:40:37.162 INFO:tasks.workunit.client.1.smithi116.stdout:4/207: dread d0/f30 [0,4194304] 0 2024-09-13T21:40:37.165 INFO:tasks.workunit.client.1.smithi116.stdout:4/208: mknod d0/c36 0 2024-09-13T21:40:37.175 INFO:tasks.workunit.client.1.smithi116.stdout:0/140: dwrite d2/dc/f2d [0,4194304] 0 2024-09-13T21:40:37.177 INFO:tasks.workunit.client.1.smithi116.stdout:4/209: write d0/f28 [2202415,111793] 0 2024-09-13T21:40:37.180 INFO:tasks.workunit.client.1.smithi116.stdout:4/210: rename d0/dd/d13/c17 to d0/d32/c37 0 2024-09-13T21:40:37.194 INFO:tasks.workunit.client.1.smithi116.stdout:0/141: dwrite d2/dc/f31 [0,4194304] 0 2024-09-13T21:40:37.194 INFO:tasks.workunit.client.1.smithi116.stdout:0/142: creat d2/dc/f33 x:0 0 0 2024-09-13T21:40:37.194 INFO:tasks.workunit.client.1.smithi116.stdout:0/143: fsync d2/d5/f13 0 2024-09-13T21:40:37.196 INFO:tasks.workunit.client.1.smithi116.stdout:0/144: link d2/dc/f2c d2/d5/f34 0 2024-09-13T21:40:37.199 INFO:tasks.workunit.client.1.smithi116.stdout:4/211: dwrite d0/dd/f1b [0,4194304] 0 2024-09-13T21:40:37.216 INFO:tasks.workunit.client.1.smithi116.stdout:4/212: dwrite d0/f8 [4194304,4194304] 0 2024-09-13T21:40:37.219 INFO:tasks.workunit.client.1.smithi116.stdout:4/213: truncate d0/f8 8268257 0 2024-09-13T21:40:37.219 INFO:tasks.workunit.client.1.smithi116.stdout:4/214: readlink d0/l11 0 2024-09-13T21:40:37.219 INFO:tasks.workunit.client.1.smithi116.stdout:4/215: write d0/dd/d13/f1e [1228371,99408] 0 2024-09-13T21:40:37.227 INFO:tasks.workunit.client.1.smithi116.stdout:4/216: dread d0/f28 [0,4194304] 0 2024-09-13T21:40:37.231 INFO:tasks.workunit.client.1.smithi116.stdout:4/217: dwrite - open d0/f31 failed 14 2024-09-13T21:40:37.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:37 smithi088 ceph-mon[27963]: pgmap v258: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 221 MiB/s rd, 276 MiB/s wr, 387 op/s 2024-09-13T21:40:37.236 INFO:tasks.workunit.client.1.smithi116.stdout:4/218: write d0/f30 [1182190,50496] 0 2024-09-13T21:40:37.237 INFO:tasks.workunit.client.1.smithi116.stdout:9/93: sync 2024-09-13T21:40:37.237 INFO:tasks.workunit.client.1.smithi116.stdout:9/94: readlink d2/d8/l16 0 2024-09-13T21:40:37.237 INFO:tasks.workunit.client.1.smithi116.stdout:9/95: chown d2/d10/d14/c19 219 1 2024-09-13T21:40:37.237 INFO:tasks.workunit.client.1.smithi116.stdout:9/96: truncate d2/d8/f11 4677988 0 2024-09-13T21:40:37.237 INFO:tasks.workunit.client.1.smithi116.stdout:9/97: truncate d2/f4 2565038 0 2024-09-13T21:40:37.238 INFO:tasks.workunit.client.1.smithi116.stdout:9/98: rmdir d2/d8 39 2024-09-13T21:40:37.238 INFO:tasks.workunit.client.1.smithi116.stdout:4/219: fsync d0/dd/d13/f1e 0 2024-09-13T21:40:37.239 INFO:tasks.workunit.client.1.smithi116.stdout:4/220: write d0/f28 [4082053,55912] 0 2024-09-13T21:40:37.241 INFO:tasks.workunit.client.1.smithi116.stdout:4/221: rmdir d0/d32 39 2024-09-13T21:40:37.241 INFO:tasks.workunit.client.1.smithi116.stdout:4/222: getdents d0/dd 0 2024-09-13T21:40:37.241 INFO:tasks.workunit.client.1.smithi116.stdout:4/223: stat d0/l11 0 2024-09-13T21:40:37.256 INFO:tasks.workunit.client.1.smithi116.stdout:9/99: dwrite f0 [0,4194304] 0 2024-09-13T21:40:37.256 INFO:tasks.workunit.client.1.smithi116.stdout:9/100: readlink d2/d8/l16 0 2024-09-13T21:40:37.256 INFO:tasks.workunit.client.1.smithi116.stdout:9/101: creat d2/f1d x:0 0 0 2024-09-13T21:40:37.262 INFO:tasks.workunit.client.1.smithi116.stdout:4/224: dwrite d0/f28 [0,4194304] 0 2024-09-13T21:40:37.272 INFO:tasks.workunit.client.1.smithi116.stdout:9/102: dwrite d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:37.276 INFO:tasks.workunit.client.1.smithi116.stdout:9/103: truncate f0 769460 0 2024-09-13T21:40:37.277 INFO:tasks.workunit.client.1.smithi116.stdout:9/104: write d2/fc [298576,22812] 0 2024-09-13T21:40:37.277 INFO:tasks.workunit.client.1.smithi116.stdout:9/105: creat d2/f1e x:0 0 0 2024-09-13T21:40:37.278 INFO:tasks.workunit.client.1.smithi116.stdout:4/225: dread d0/f30 [0,4194304] 0 2024-09-13T21:40:37.279 INFO:tasks.workunit.client.1.smithi116.stdout:4/226: symlink d0/dd/l38 0 2024-09-13T21:40:37.280 INFO:tasks.workunit.client.1.smithi116.stdout:4/227: getdents d0/dd/d13 0 2024-09-13T21:40:37.282 INFO:tasks.workunit.client.1.smithi116.stdout:4/228: creat d0/f39 x:0 0 0 2024-09-13T21:40:37.287 INFO:tasks.workunit.client.1.smithi116.stdout:9/106: dread d2/d8/f11 [0,4194304] 0 2024-09-13T21:40:37.287 INFO:tasks.workunit.client.1.smithi116.stdout:9/107: write d2/fc [1006476,22294] 0 2024-09-13T21:40:37.308 INFO:tasks.workunit.client.1.smithi116.stdout:4/229: dwrite d0/dd/f2e [0,4194304] 0 2024-09-13T21:40:37.308 INFO:tasks.workunit.client.1.smithi116.stdout:4/230: chown d0/l23 6286 1 2024-09-13T21:40:37.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/108: dwrite d2/f4 [0,4194304] 0 2024-09-13T21:40:37.309 INFO:tasks.workunit.client.1.smithi116.stdout:4/231: creat d0/f3a x:0 0 0 2024-09-13T21:40:37.310 INFO:tasks.workunit.client.1.smithi116.stdout:9/109: symlink d2/d10/l1f 0 2024-09-13T21:40:37.310 INFO:tasks.workunit.client.1.smithi116.stdout:9/110: creat d2/d10/f20 x:0 0 0 2024-09-13T21:40:37.311 INFO:tasks.workunit.client.1.smithi116.stdout:4/232: rename d0/dd/f27 to d0/dd/f3b 0 2024-09-13T21:40:37.311 INFO:tasks.workunit.client.1.smithi116.stdout:4/233: chown d0/dd/d13/f1e 1011440 1 2024-09-13T21:40:37.311 INFO:tasks.workunit.client.1.smithi116.stdout:4/234: truncate d0/f39 322078 0 2024-09-13T21:40:37.312 INFO:tasks.workunit.client.1.smithi116.stdout:9/111: creat d2/d10/d14/f21 x:0 0 0 2024-09-13T21:40:37.312 INFO:tasks.workunit.client.1.smithi116.stdout:9/112: fsync d2/d10/f12 0 2024-09-13T21:40:37.313 INFO:tasks.workunit.client.1.smithi116.stdout:4/235: creat d0/dd/d13/f3c x:0 0 0 2024-09-13T21:40:37.313 INFO:tasks.workunit.client.1.smithi116.stdout:9/113: mknod d2/d8/c22 0 2024-09-13T21:40:37.314 INFO:tasks.workunit.client.1.smithi116.stdout:4/236: link d0/d32/c37 d0/dd/c3d 0 2024-09-13T21:40:37.314 INFO:tasks.workunit.client.1.smithi116.stdout:4/237: write d0/dd/f3b [679537,73981] 0 2024-09-13T21:40:37.317 INFO:tasks.workunit.client.1.smithi116.stdout:4/238: creat d0/d32/f3e x:0 0 0 2024-09-13T21:40:37.317 INFO:tasks.workunit.client.1.smithi116.stdout:4/239: write d0/d32/f34 [566691,123767] 0 2024-09-13T21:40:37.317 INFO:tasks.workunit.client.1.smithi116.stdout:4/240: stat d0/dd/d13/l2f 0 2024-09-13T21:40:37.317 INFO:tasks.workunit.client.1.smithi116.stdout:4/241: chown d0/dd/f2e 1134 1 2024-09-13T21:40:37.318 INFO:tasks.workunit.client.1.smithi116.stdout:4/242: truncate d0/f24 2667752 0 2024-09-13T21:40:37.318 INFO:tasks.workunit.client.1.smithi116.stdout:9/114: dread d2/d8/f11 [0,4194304] 0 2024-09-13T21:40:37.319 INFO:tasks.workunit.client.1.smithi116.stdout:4/243: creat d0/dd/f3f x:0 0 0 2024-09-13T21:40:37.323 INFO:tasks.workunit.client.1.smithi116.stdout:9/115: dread d2/f7 [0,4194304] 0 2024-09-13T21:40:37.332 INFO:tasks.workunit.client.1.smithi116.stdout:9/116: dread d2/f4 [0,4194304] 0 2024-09-13T21:40:37.333 INFO:tasks.workunit.client.1.smithi116.stdout:9/117: rename d2/d8/c22 to d2/d8/c23 0 2024-09-13T21:40:37.334 INFO:tasks.workunit.client.1.smithi116.stdout:9/118: symlink d2/d8/l24 0 2024-09-13T21:40:37.334 INFO:tasks.workunit.client.1.smithi116.stdout:9/119: stat d2/d8/f11 0 2024-09-13T21:40:37.358 INFO:tasks.workunit.client.1.smithi116.stdout:8/79: sync 2024-09-13T21:40:37.358 INFO:tasks.workunit.client.1.smithi116.stdout:8/80: stat d2/c4 0 2024-09-13T21:40:37.358 INFO:tasks.workunit.client.1.smithi116.stdout:8/81: chown d2/d10/c16 2778 1 2024-09-13T21:40:37.358 INFO:tasks.workunit.client.1.smithi116.stdout:8/82: write d2/f8 [4958792,102614] 0 2024-09-13T21:40:37.358 INFO:tasks.workunit.client.1.smithi116.stdout:7/186: sync 2024-09-13T21:40:37.358 INFO:tasks.workunit.client.1.smithi116.stdout:1/72: sync 2024-09-13T21:40:37.358 INFO:tasks.workunit.client.1.smithi116.stdout:1/73: chown d4/fa 18 1 2024-09-13T21:40:37.358 INFO:tasks.workunit.client.1.smithi116.stdout:5/208: sync 2024-09-13T21:40:37.358 INFO:tasks.workunit.client.1.smithi116.stdout:2/100: sync 2024-09-13T21:40:37.359 INFO:tasks.workunit.client.1.smithi116.stdout:6/119: sync 2024-09-13T21:40:37.359 INFO:tasks.workunit.client.1.smithi116.stdout:2/101: dread - d0/d7/f1e zero size 2024-09-13T21:40:37.359 INFO:tasks.workunit.client.1.smithi116.stdout:6/120: readlink d8/d15/l27 0 2024-09-13T21:40:37.359 INFO:tasks.workunit.client.1.smithi116.stdout:7/187: mkdir d5/d9/d27/d31/d38/d42 0 2024-09-13T21:40:37.359 INFO:tasks.workunit.client.1.smithi116.stdout:7/188: chown d5/d9/d1c/d22/d24/d3a 2479520 1 2024-09-13T21:40:37.361 INFO:tasks.workunit.client.1.smithi116.stdout:5/209: rename f1 to d7/d40/f41 0 2024-09-13T21:40:37.362 INFO:tasks.workunit.client.1.smithi116.stdout:2/102: link d0/d7/l13 d0/da/l21 0 2024-09-13T21:40:37.363 INFO:tasks.workunit.client.1.smithi116.stdout:6/121: mkdir d8/d15/d2e 0 2024-09-13T21:40:37.363 INFO:tasks.workunit.client.1.smithi116.stdout:6/122: chown d8/f16 191389840 1 2024-09-13T21:40:37.364 INFO:tasks.workunit.client.1.smithi116.stdout:8/83: getdents d2/d10 0 2024-09-13T21:40:37.365 INFO:tasks.workunit.client.1.smithi116.stdout:5/210: mknod d7/da/d21/c42 0 2024-09-13T21:40:37.365 INFO:tasks.workunit.client.1.smithi116.stdout:5/211: readlink d7/d1d/l1e 0 2024-09-13T21:40:37.366 INFO:tasks.workunit.client.1.smithi116.stdout:2/103: rename d0/d5/c9 to d0/da/c22 0 2024-09-13T21:40:37.367 INFO:tasks.workunit.client.1.smithi116.stdout:5/212: mknod d7/da/d21/c43 0 2024-09-13T21:40:37.369 INFO:tasks.workunit.client.1.smithi116.stdout:2/104: link d0/l4 d0/d5/l23 0 2024-09-13T21:40:37.371 INFO:tasks.workunit.client.1.smithi116.stdout:5/213: mknod d7/da/d21/c44 0 2024-09-13T21:40:37.371 INFO:tasks.workunit.client.1.smithi116.stdout:5/214: chown d7/da/d21/c43 17 1 2024-09-13T21:40:37.373 INFO:tasks.workunit.client.1.smithi116.stdout:5/215: truncate d7/f16 6252722 0 2024-09-13T21:40:37.374 INFO:tasks.workunit.client.1.smithi116.stdout:5/216: creat d7/d1d/f45 x:0 0 0 2024-09-13T21:40:37.375 INFO:tasks.workunit.client.1.smithi116.stdout:1/74: write d4/fa [2578786,26848] 0 2024-09-13T21:40:37.375 INFO:tasks.workunit.client.1.smithi116.stdout:5/217: mkdir d7/d1d/d46 0 2024-09-13T21:40:37.384 INFO:tasks.workunit.client.1.smithi116.stdout:7/189: read d5/d9/f3d [10716881,100721] 0 2024-09-13T21:40:37.385 INFO:tasks.workunit.client.1.smithi116.stdout:2/105: dwrite d0/d5/d8/f20 [0,4194304] 0 2024-09-13T21:40:37.385 INFO:tasks.workunit.client.1.smithi116.stdout:2/106: creat d0/d7/f24 x:0 0 0 2024-09-13T21:40:37.385 INFO:tasks.workunit.client.1.smithi116.stdout:2/107: write d0/d5/f10 [1027100,21772] 0 2024-09-13T21:40:37.385 INFO:tasks.workunit.client.1.smithi116.stdout:7/190: dread d5/d9/f33 [0,4194304] 0 2024-09-13T21:40:37.389 INFO:tasks.workunit.client.1.smithi116.stdout:6/123: dwrite d8/f1a [0,4194304] 0 2024-09-13T21:40:37.389 INFO:tasks.workunit.client.1.smithi116.stdout:7/191: symlink d5/d9/d1c/d22/d24/d3a/l43 0 2024-09-13T21:40:37.392 INFO:tasks.workunit.client.1.smithi116.stdout:6/124: getdents d8/d15 0 2024-09-13T21:40:37.392 INFO:tasks.workunit.client.1.smithi116.stdout:6/125: fsync d8/d17/f19 0 2024-09-13T21:40:37.393 INFO:tasks.workunit.client.1.smithi116.stdout:6/126: truncate d8/d1e/f28 3413323 0 2024-09-13T21:40:37.396 INFO:tasks.workunit.client.1.smithi116.stdout:6/127: getdents d8 0 2024-09-13T21:40:37.398 INFO:tasks.workunit.client.1.smithi116.stdout:6/128: mkdir d8/d15/d2e/d2f 0 2024-09-13T21:40:37.398 INFO:tasks.workunit.client.1.smithi116.stdout:5/218: dwrite d7/da/f27 [0,4194304] 0 2024-09-13T21:40:37.401 INFO:tasks.workunit.client.1.smithi116.stdout:5/219: link d7/da/l15 d7/l47 0 2024-09-13T21:40:37.406 INFO:tasks.workunit.client.1.smithi116.stdout:1/75: truncate d4/f17 2272247 0 2024-09-13T21:40:37.406 INFO:tasks.workunit.client.1.smithi116.stdout:1/76: creat d4/f1b x:0 0 0 2024-09-13T21:40:37.414 INFO:tasks.workunit.client.1.smithi116.stdout:6/129: getdents d8/d15/d2e 0 2024-09-13T21:40:37.414 INFO:tasks.workunit.client.1.smithi116.stdout:6/130: truncate f3 2011459 0 2024-09-13T21:40:37.415 INFO:tasks.workunit.client.1.smithi116.stdout:6/131: mknod d8/d17/c30 0 2024-09-13T21:40:37.415 INFO:tasks.workunit.client.1.smithi116.stdout:6/132: chown d8/fe 0 1 2024-09-13T21:40:37.416 INFO:tasks.workunit.client.1.smithi116.stdout:5/220: truncate d7/da/f27 455954 0 2024-09-13T21:40:37.418 INFO:tasks.workunit.client.1.smithi116.stdout:5/221: getdents d7/d40 0 2024-09-13T21:40:37.418 INFO:tasks.workunit.client.1.smithi116.stdout:7/192: dwrite d5/d9/db/f3c [0,4194304] 0 2024-09-13T21:40:37.420 INFO:tasks.workunit.client.1.smithi116.stdout:5/222: creat d7/da/f48 x:0 0 0 2024-09-13T21:40:37.420 INFO:tasks.workunit.client.1.smithi116.stdout:5/223: write d7/f12 [1005307,100291] 0 2024-09-13T21:40:37.420 INFO:tasks.workunit.client.1.smithi116.stdout:5/224: write d7/da/d21/f39 [584413,122619] 0 2024-09-13T21:40:37.423 INFO:tasks.workunit.client.1.smithi116.stdout:2/108: dwrite d0/d5/f10 [0,4194304] 0 2024-09-13T21:40:37.423 INFO:tasks.workunit.client.1.smithi116.stdout:7/193: mknod d5/d9/c44 0 2024-09-13T21:40:37.423 INFO:tasks.workunit.client.1.smithi116.stdout:7/194: chown d5/d9/d1c/d22/l2f 1562 1 2024-09-13T21:40:37.424 INFO:tasks.workunit.client.1.smithi116.stdout:2/109: write d0/fe [62116,84387] 0 2024-09-13T21:40:37.427 INFO:tasks.workunit.client.1.smithi116.stdout:2/110: rmdir d0/da 39 2024-09-13T21:40:37.429 INFO:tasks.workunit.client.1.smithi116.stdout:2/111: rename d0/da/dd/l1c to d0/d7/l25 0 2024-09-13T21:40:37.429 INFO:tasks.workunit.client.1.smithi116.stdout:2/112: truncate d0/d5/d8/f16 957218 0 2024-09-13T21:40:37.430 INFO:tasks.workunit.client.1.smithi116.stdout:2/113: mknod d0/d5/c26 0 2024-09-13T21:40:37.430 INFO:tasks.workunit.client.1.smithi116.stdout:2/114: truncate d0/d5/d8/f16 1871401 0 2024-09-13T21:40:37.431 INFO:tasks.workunit.client.1.smithi116.stdout:1/77: dwrite d4/d14/f19 [0,4194304] 0 2024-09-13T21:40:37.431 INFO:tasks.workunit.client.1.smithi116.stdout:1/78: write f1 [1549164,33761] 0 2024-09-13T21:40:37.431 INFO:tasks.workunit.client.1.smithi116.stdout:1/79: fsync d4/f10 0 2024-09-13T21:40:37.431 INFO:tasks.workunit.client.1.smithi116.stdout:1/80: truncate d4/fa 3249074 0 2024-09-13T21:40:37.431 INFO:tasks.workunit.client.1.smithi116.stdout:1/81: creat d4/f1c x:0 0 0 2024-09-13T21:40:37.431 INFO:tasks.workunit.client.1.smithi116.stdout:2/115: creat d0/da/d1f/f27 x:0 0 0 2024-09-13T21:40:37.440 INFO:tasks.workunit.client.1.smithi116.stdout:1/82: creat d4/d14/f1d x:0 0 0 2024-09-13T21:40:37.440 INFO:tasks.workunit.client.1.smithi116.stdout:7/195: write d5/d9/db/f12 [3803125,65438] 0 2024-09-13T21:40:37.440 INFO:tasks.workunit.client.1.smithi116.stdout:2/116: mknod d0/da/c28 0 2024-09-13T21:40:37.442 INFO:tasks.workunit.client.1.smithi116.stdout:7/196: stat d5/l15 0 2024-09-13T21:40:37.442 INFO:tasks.workunit.client.1.smithi116.stdout:6/133: dwrite d8/d15/f22 [4194304,4194304] 0 2024-09-13T21:40:37.442 INFO:tasks.workunit.client.1.smithi116.stdout:6/134: dread - d8/f1d zero size 2024-09-13T21:40:37.442 INFO:tasks.workunit.client.1.smithi116.stdout:6/135: chown d8/c9 7100 1 2024-09-13T21:40:37.443 INFO:tasks.workunit.client.1.smithi116.stdout:2/117: symlink d0/d7/l29 0 2024-09-13T21:40:37.446 INFO:tasks.workunit.client.1.smithi116.stdout:2/118: mkdir d0/d5/d2a 0 2024-09-13T21:40:37.448 INFO:tasks.workunit.client.1.smithi116.stdout:7/197: dread d5/f16 [0,4194304] 0 2024-09-13T21:40:37.449 INFO:tasks.workunit.client.1.smithi116.stdout:2/119: mkdir d0/d7/d2b 0 2024-09-13T21:40:37.454 INFO:tasks.workunit.client.1.smithi116.stdout:2/120: rename d0/da/dd to d0/d7/d2b/d2c 0 2024-09-13T21:40:37.456 INFO:tasks.workunit.client.1.smithi116.stdout:2/121: mkdir d0/d7/d2d 0 2024-09-13T21:40:37.456 INFO:tasks.workunit.client.1.smithi116.stdout:2/122: chown d0/d5/d8/c19 23 1 2024-09-13T21:40:37.462 INFO:tasks.workunit.client.1.smithi116.stdout:7/198: write d5/f35 [1467892,124800] 0 2024-09-13T21:40:37.462 INFO:tasks.workunit.client.1.smithi116.stdout:7/199: chown d5/d9/db/f12 5702 1 2024-09-13T21:40:37.462 INFO:tasks.workunit.client.1.smithi116.stdout:7/200: read d5/f35 [1202215,43189] 0 2024-09-13T21:40:37.463 INFO:tasks.workunit.client.1.smithi116.stdout:7/201: creat d5/d9/db/f45 x:0 0 0 2024-09-13T21:40:37.464 INFO:tasks.workunit.client.1.smithi116.stdout:7/202: creat d5/d9/d1c/d22/d24/d3a/f46 x:0 0 0 2024-09-13T21:40:37.466 INFO:tasks.workunit.client.1.smithi116.stdout:7/203: rmdir d5/d9/d27/d31/d38 39 2024-09-13T21:40:37.466 INFO:tasks.workunit.client.1.smithi116.stdout:7/204: readlink d5/d9/l1b 0 2024-09-13T21:40:37.467 INFO:tasks.workunit.client.1.smithi116.stdout:7/205: symlink d5/d9/d27/l47 0 2024-09-13T21:40:37.467 INFO:tasks.workunit.client.1.smithi116.stdout:1/83: dwrite d4/f1b [0,4194304] 0 2024-09-13T21:40:37.468 INFO:tasks.workunit.client.1.smithi116.stdout:7/206: mkdir d5/d9/d27/d31/d38/d48 0 2024-09-13T21:40:37.470 INFO:tasks.workunit.client.1.smithi116.stdout:7/207: creat d5/d9/db/d21/f49 x:0 0 0 2024-09-13T21:40:37.472 INFO:tasks.workunit.client.1.smithi116.stdout:7/208: symlink d5/d9/d27/d31/d38/d48/l4a 0 2024-09-13T21:40:37.472 INFO:tasks.workunit.client.1.smithi116.stdout:7/209: creat d5/f4b x:0 0 0 2024-09-13T21:40:37.472 INFO:tasks.workunit.client.1.smithi116.stdout:7/210: fsync f2 0 2024-09-13T21:40:37.472 INFO:tasks.workunit.client.1.smithi116.stdout:7/211: write d5/d9/f33 [132633,100368] 0 2024-09-13T21:40:37.476 INFO:tasks.workunit.client.1.smithi116.stdout:6/136: dwrite d8/d10/f18 [0,4194304] 0 2024-09-13T21:40:37.484 INFO:tasks.workunit.client.1.smithi116.stdout:6/137: getdents d8/d17 0 2024-09-13T21:40:37.484 INFO:tasks.workunit.client.1.smithi116.stdout:6/138: stat d8/d15/f1f 0 2024-09-13T21:40:37.484 INFO:tasks.workunit.client.1.smithi116.stdout:6/139: truncate d8/d15/f1b 4197275 0 2024-09-13T21:40:37.484 INFO:tasks.workunit.client.1.smithi116.stdout:6/140: chown d8/fe 2861134 1 2024-09-13T21:40:37.484 INFO:tasks.workunit.client.1.smithi116.stdout:6/141: creat d8/d1e/f31 x:0 0 0 2024-09-13T21:40:37.486 INFO:tasks.workunit.client.1.smithi116.stdout:6/142: creat d8/d15/f32 x:0 0 0 2024-09-13T21:40:37.486 INFO:tasks.workunit.client.1.smithi116.stdout:6/143: write d8/ff [764648,75227] 0 2024-09-13T21:40:37.488 INFO:tasks.workunit.client.1.smithi116.stdout:6/144: mkdir d8/d10/d33 0 2024-09-13T21:40:37.489 INFO:tasks.workunit.client.1.smithi116.stdout:6/145: creat d8/d15/d2e/f34 x:0 0 0 2024-09-13T21:40:37.490 INFO:tasks.workunit.client.1.smithi116.stdout:6/146: rename d8/d15/d2e/f34 to d8/d15/d2e/d2f/f35 0 2024-09-13T21:40:37.492 INFO:tasks.workunit.client.1.smithi116.stdout:6/147: link d8/cc d8/c36 0 2024-09-13T21:40:37.492 INFO:tasks.workunit.client.1.smithi116.stdout:6/148: write d8/f2c [1027855,79441] 0 2024-09-13T21:40:37.492 INFO:tasks.workunit.client.1.smithi116.stdout:6/149: chown d8/d10/c11 436814315 1 2024-09-13T21:40:37.500 INFO:tasks.workunit.client.1.smithi116.stdout:7/212: dwrite d5/d9/f14 [0,4194304] 0 2024-09-13T21:40:37.504 INFO:tasks.workunit.client.1.smithi116.stdout:6/150: write d8/d10/f18 [1965424,67822] 0 2024-09-13T21:40:37.506 INFO:tasks.workunit.client.1.smithi116.stdout:6/151: getdents d8/d10/d24 0 2024-09-13T21:40:37.506 INFO:tasks.workunit.client.1.smithi116.stdout:6/152: write d8/d1e/f28 [3805620,2843] 0 2024-09-13T21:40:37.506 INFO:tasks.workunit.client.1.smithi116.stdout:6/153: dread - d8/f1d zero size 2024-09-13T21:40:37.506 INFO:tasks.workunit.client.1.smithi116.stdout:6/154: write d8/d1e/f31 [555915,54942] 0 2024-09-13T21:40:37.507 INFO:tasks.workunit.client.1.smithi116.stdout:6/155: creat d8/d10/d24/f37 x:0 0 0 2024-09-13T21:40:37.508 INFO:tasks.workunit.client.1.smithi116.stdout:6/156: read - d8/d15/f1f zero size 2024-09-13T21:40:37.508 INFO:tasks.workunit.client.1.smithi116.stdout:6/157: mkdir d8/d15/d2e/d2f/d38 0 2024-09-13T21:40:37.509 INFO:tasks.workunit.client.1.smithi116.stdout:6/158: write d8/fa [4390319,54479] 0 2024-09-13T21:40:37.510 INFO:tasks.workunit.client.1.smithi116.stdout:6/159: mknod d8/d10/c39 0 2024-09-13T21:40:37.510 INFO:tasks.workunit.client.1.smithi116.stdout:6/160: write d8/d10/d24/f29 [447344,70640] 0 2024-09-13T21:40:37.510 INFO:tasks.workunit.client.1.smithi116.stdout:6/161: mknod d8/d10/d24/c3a 0 2024-09-13T21:40:37.511 INFO:tasks.workunit.client.1.smithi116.stdout:6/162: creat d8/d10/d33/f3b x:0 0 0 2024-09-13T21:40:37.512 INFO:tasks.workunit.client.1.smithi116.stdout:6/163: creat d8/f3c x:0 0 0 2024-09-13T21:40:37.512 INFO:tasks.workunit.client.1.smithi116.stdout:6/164: creat d8/d10/d24/f3d x:0 0 0 2024-09-13T21:40:37.513 INFO:tasks.workunit.client.1.smithi116.stdout:6/165: mkdir d8/d15/d2e/d2f/d38/d3e 0 2024-09-13T21:40:37.513 INFO:tasks.workunit.client.1.smithi116.stdout:6/166: chown d8/d10 7802 1 2024-09-13T21:40:37.513 INFO:tasks.workunit.client.1.smithi116.stdout:6/167: stat d8/fe 0 2024-09-13T21:40:37.514 INFO:tasks.workunit.client.1.smithi116.stdout:6/168: unlink d8/d17/l2d 0 2024-09-13T21:40:37.517 INFO:tasks.workunit.client.1.smithi116.stdout:7/213: dwrite d5/f8 [4194304,4194304] 0 2024-09-13T21:40:37.574 INFO:tasks.workunit.client.1.smithi116.stdout:2/123: dwrite d0/d7/f12 [0,4194304] 0 2024-09-13T21:40:37.590 INFO:tasks.workunit.client.1.smithi116.stdout:2/124: write d0/d5/d8/f20 [1863164,108552] 0 2024-09-13T21:40:37.590 INFO:tasks.workunit.client.1.smithi116.stdout:2/125: write d0/da/d1f/f27 [225740,61688] 0 2024-09-13T21:40:37.590 INFO:tasks.workunit.client.1.smithi116.stdout:2/126: write d0/fe [116761,40502] 0 2024-09-13T21:40:37.594 INFO:tasks.workunit.client.1.smithi116.stdout:6/169: rmdir d8/d15 39 2024-09-13T21:40:37.596 INFO:tasks.workunit.client.1.smithi116.stdout:3/184: sync 2024-09-13T21:40:37.596 INFO:tasks.workunit.client.1.smithi116.stdout:3/185: creat d3/db/f43 x:0 0 0 2024-09-13T21:40:37.596 INFO:tasks.workunit.client.1.smithi116.stdout:3/186: chown d3/db/d10/d1d/d2f/c37 85 1 2024-09-13T21:40:37.596 INFO:tasks.workunit.client.1.smithi116.stdout:3/187: chown d3/db/ff 41838915 1 2024-09-13T21:40:37.596 INFO:tasks.workunit.client.1.smithi116.stdout:3/188: rename d3/db/d26 to d3/db/d26/d44 22 2024-09-13T21:40:37.596 INFO:tasks.workunit.client.1.smithi116.stdout:3/189: read d3/db/f17 [1573410,10026] 0 2024-09-13T21:40:37.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:37 smithi116 ceph-mon[33391]: pgmap v258: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 221 MiB/s rd, 276 MiB/s wr, 387 op/s 2024-09-13T21:40:37.597 INFO:tasks.workunit.client.1.smithi116.stdout:6/170: creat d8/d15/d2e/f3f x:0 0 0 2024-09-13T21:40:37.597 INFO:tasks.workunit.client.1.smithi116.stdout:6/171: readlink d8/d15/l27 0 2024-09-13T21:40:37.597 INFO:tasks.workunit.client.1.smithi116.stdout:6/172: chown d8/d15 2234872 1 2024-09-13T21:40:37.598 INFO:tasks.workunit.client.1.smithi116.stdout:3/190: dread d3/db/d10/d1d/f2d [0,4194304] 0 2024-09-13T21:40:37.598 INFO:tasks.workunit.client.1.smithi116.stdout:7/214: dwrite d5/d9/f33 [0,4194304] 0 2024-09-13T21:40:37.598 INFO:tasks.workunit.client.1.smithi116.stdout:7/215: write d5/d9/f17 [725776,10710] 0 2024-09-13T21:40:37.599 INFO:tasks.workunit.client.1.smithi116.stdout:2/127: dread d0/da/d1f/f27 [0,4194304] 0 2024-09-13T21:40:37.599 INFO:tasks.workunit.client.1.smithi116.stdout:3/191: read d3/f11 [492066,95135] 0 2024-09-13T21:40:37.599 INFO:tasks.workunit.client.1.smithi116.stdout:3/192: readlink d3/l1a 0 2024-09-13T21:40:37.602 INFO:tasks.workunit.client.1.smithi116.stdout:2/128: stat d0/d7/l13 0 2024-09-13T21:40:37.605 INFO:tasks.workunit.client.1.smithi116.stdout:3/193: mknod d3/db/d20/c45 0 2024-09-13T21:40:37.605 INFO:tasks.workunit.client.1.smithi116.stdout:3/194: readlink d3/db/ld 0 2024-09-13T21:40:37.607 INFO:tasks.workunit.client.1.smithi116.stdout:6/173: dread d8/f1a [0,4194304] 0 2024-09-13T21:40:37.610 INFO:tasks.workunit.client.1.smithi116.stdout:3/195: symlink d3/db/d3d/d40/l46 0 2024-09-13T21:40:37.611 INFO:tasks.workunit.client.1.smithi116.stdout:2/129: truncate d0/d7/f12 3561088 0 2024-09-13T21:40:37.613 INFO:tasks.workunit.client.1.smithi116.stdout:3/196: mkdir d3/db/d10/d1c/d34/d47 0 2024-09-13T21:40:37.613 INFO:tasks.workunit.client.1.smithi116.stdout:3/197: chown d3/l1a 7 1 2024-09-13T21:40:37.617 INFO:tasks.workunit.client.1.smithi116.stdout:2/130: dread d0/d5/d8/f20 [0,4194304] 0 2024-09-13T21:40:37.618 INFO:tasks.workunit.client.1.smithi116.stdout:2/131: symlink d0/da/l2e 0 2024-09-13T21:40:37.621 INFO:tasks.workunit.client.1.smithi116.stdout:2/132: rename d0/d7/l29 to d0/l2f 0 2024-09-13T21:40:37.621 INFO:tasks.workunit.client.1.smithi116.stdout:2/133: getdents d0/d7/d2d 0 2024-09-13T21:40:37.622 INFO:tasks.workunit.client.1.smithi116.stdout:3/198: read d3/db/d10/f18 [1426557,2671] 0 2024-09-13T21:40:37.622 INFO:tasks.workunit.client.1.smithi116.stdout:3/199: creat d3/db/d3d/d40/f48 x:0 0 0 2024-09-13T21:40:37.625 INFO:tasks.workunit.client.1.smithi116.stdout:3/200: symlink d3/db/d10/d29/l49 0 2024-09-13T21:40:37.625 INFO:tasks.workunit.client.1.smithi116.stdout:3/201: write d3/db/d26/f28 [93218,118299] 0 2024-09-13T21:40:37.625 INFO:tasks.workunit.client.1.smithi116.stdout:3/202: chown d3 100834 1 2024-09-13T21:40:37.626 INFO:tasks.workunit.client.1.smithi116.stdout:3/203: mkdir d3/db/d20/d4a 0 2024-09-13T21:40:37.627 INFO:tasks.workunit.client.1.smithi116.stdout:6/174: dwrite d8/d10/d33/f3b [0,4194304] 0 2024-09-13T21:40:37.627 INFO:tasks.workunit.client.1.smithi116.stdout:3/204: mknod d3/db/d10/d29/c4b 0 2024-09-13T21:40:37.631 INFO:tasks.workunit.client.1.smithi116.stdout:6/175: creat d8/d15/f40 x:0 0 0 2024-09-13T21:40:37.632 INFO:tasks.workunit.client.1.smithi116.stdout:3/205: rmdir d3/db/d10/d1c/d34 39 2024-09-13T21:40:37.632 INFO:tasks.workunit.client.1.smithi116.stdout:3/206: creat d3/db/d3d/d40/f4c x:0 0 0 2024-09-13T21:40:37.632 INFO:tasks.workunit.client.1.smithi116.stdout:3/207: chown d3/db/d10/d1c/d34/d47 1 1 2024-09-13T21:40:37.633 INFO:tasks.workunit.client.1.smithi116.stdout:6/176: rmdir d8/d15/d2e/d2f/d38 39 2024-09-13T21:40:37.636 INFO:tasks.workunit.client.1.smithi116.stdout:3/208: symlink d3/db/l4d 0 2024-09-13T21:40:37.637 INFO:tasks.workunit.client.1.smithi116.stdout:6/177: symlink d8/d1e/l41 0 2024-09-13T21:40:37.641 INFO:tasks.workunit.client.1.smithi116.stdout:2/134: dwrite d0/d7/f1e [0,4194304] 0 2024-09-13T21:40:37.641 INFO:tasks.workunit.client.1.smithi116.stdout:2/135: write d0/d7/f24 [982504,67985] 0 2024-09-13T21:40:37.645 INFO:tasks.workunit.client.1.smithi116.stdout:6/178: dread d8/d10/d33/f3b [0,4194304] 0 2024-09-13T21:40:37.645 INFO:tasks.workunit.client.1.smithi116.stdout:6/179: write d8/d17/f23 [503780,121457] 0 2024-09-13T21:40:37.646 INFO:tasks.workunit.client.1.smithi116.stdout:6/180: chown d8/d15/d2e/d2f/d38/d3e 0 1 2024-09-13T21:40:37.648 INFO:tasks.workunit.client.1.smithi116.stdout:2/136: rename d0/d5/c26 to d0/d7/d2d/c30 0 2024-09-13T21:40:37.649 INFO:tasks.workunit.client.1.smithi116.stdout:6/181: unlink d8/f1a 0 2024-09-13T21:40:37.649 INFO:tasks.workunit.client.1.smithi116.stdout:6/182: truncate d8/fe 451987 0 2024-09-13T21:40:37.651 INFO:tasks.workunit.client.1.smithi116.stdout:2/137: symlink d0/d5/d2a/l31 0 2024-09-13T21:40:37.653 INFO:tasks.workunit.client.1.smithi116.stdout:6/183: symlink d8/d17/l42 0 2024-09-13T21:40:37.655 INFO:tasks.workunit.client.1.smithi116.stdout:6/184: rmdir d8/d15/d2e/d2f/d38/d3e 0 2024-09-13T21:40:37.655 INFO:tasks.workunit.client.1.smithi116.stdout:3/209: dwrite d3/db/f17 [0,4194304] 0 2024-09-13T21:40:37.657 INFO:tasks.workunit.client.1.smithi116.stdout:6/185: creat d8/d15/d2e/d2f/f43 x:0 0 0 2024-09-13T21:40:37.657 INFO:tasks.workunit.client.1.smithi116.stdout:3/210: mknod d3/db/d20/c4e 0 2024-09-13T21:40:37.660 INFO:tasks.workunit.client.1.smithi116.stdout:6/186: rename d8/d15/d2e/d2f/f43 to d8/d10/f44 0 2024-09-13T21:40:37.661 INFO:tasks.workunit.client.1.smithi116.stdout:3/211: mknod d3/db/d3d/d40/c4f 0 2024-09-13T21:40:37.663 INFO:tasks.workunit.client.1.smithi116.stdout:6/187: creat d8/d15/d2e/d2f/d38/f45 x:0 0 0 2024-09-13T21:40:37.672 INFO:tasks.workunit.client.1.smithi116.stdout:6/188: dread d8/d1e/f28 [0,4194304] 0 2024-09-13T21:40:37.672 INFO:tasks.workunit.client.1.smithi116.stdout:6/189: write d8/d15/f1f [848306,97045] 0 2024-09-13T21:40:37.672 INFO:tasks.workunit.client.1.smithi116.stdout:6/190: creat d8/d10/d33/f46 x:0 0 0 2024-09-13T21:40:37.676 INFO:tasks.workunit.client.1.smithi116.stdout:6/191: dread d8/f2c [0,4194304] 0 2024-09-13T21:40:37.677 INFO:tasks.workunit.client.1.smithi116.stdout:6/192: creat d8/f47 x:0 0 0 2024-09-13T21:40:37.677 INFO:tasks.workunit.client.1.smithi116.stdout:3/212: dwrite d3/db/d10/d1d/f1e [0,4194304] 0 2024-09-13T21:40:37.677 INFO:tasks.workunit.client.1.smithi116.stdout:6/193: write d8/f16 [754083,127502] 0 2024-09-13T21:40:37.678 INFO:tasks.workunit.client.1.smithi116.stdout:3/213: mkdir d3/db/d20/d50 0 2024-09-13T21:40:37.678 INFO:tasks.workunit.client.1.smithi116.stdout:3/214: chown d3/la 29263 1 2024-09-13T21:40:37.678 INFO:tasks.workunit.client.1.smithi116.stdout:3/215: write d3/db/f3e [101315,75416] 0 2024-09-13T21:40:37.679 INFO:tasks.workunit.client.1.smithi116.stdout:3/216: chown d3/db/c3a 57858104 1 2024-09-13T21:40:37.680 INFO:tasks.workunit.client.1.smithi116.stdout:6/194: rename c6 to d8/d15/d2e/c48 0 2024-09-13T21:40:37.682 INFO:tasks.workunit.client.1.smithi116.stdout:3/217: creat d3/db/d10/d1c/d34/d47/f51 x:0 0 0 2024-09-13T21:40:37.683 INFO:tasks.workunit.client.1.smithi116.stdout:3/218: mknod d3/db/d20/d4a/c52 0 2024-09-13T21:40:37.686 INFO:tasks.workunit.client.1.smithi116.stdout:3/219: mknod d3/db/d20/c53 0 2024-09-13T21:40:37.688 INFO:tasks.workunit.client.1.smithi116.stdout:0/145: sync 2024-09-13T21:40:37.688 INFO:tasks.workunit.client.1.smithi116.stdout:0/146: truncate d2/dc/f29 898737 0 2024-09-13T21:40:37.690 INFO:tasks.workunit.client.1.smithi116.stdout:0/147: rmdir d2/dc/d12 39 2024-09-13T21:40:37.692 INFO:tasks.workunit.client.1.smithi116.stdout:0/148: symlink d2/dc/l35 0 2024-09-13T21:40:37.693 INFO:tasks.workunit.client.1.smithi116.stdout:0/149: creat d2/dc/d12/f36 x:0 0 0 2024-09-13T21:40:37.693 INFO:tasks.workunit.client.1.smithi116.stdout:0/150: dread - d2/d5/f1f zero size 2024-09-13T21:40:37.697 INFO:tasks.workunit.client.1.smithi116.stdout:0/151: mknod d2/dc/d12/d28/c37 0 2024-09-13T21:40:37.699 INFO:tasks.workunit.client.1.smithi116.stdout:0/152: dread d2/dc/f22 [0,4194304] 0 2024-09-13T21:40:37.704 INFO:tasks.workunit.client.1.smithi116.stdout:0/153: rename d2/dc/d12/d28/f2a to d2/f38 0 2024-09-13T21:40:37.704 INFO:tasks.workunit.client.1.smithi116.stdout:0/154: write d2/dc/d12/f36 [586312,89107] 0 2024-09-13T21:40:37.705 INFO:tasks.workunit.client.1.smithi116.stdout:6/195: dwrite d8/d15/d2e/f3f [0,4194304] 0 2024-09-13T21:40:37.711 INFO:tasks.workunit.client.1.smithi116.stdout:3/220: getdents d3/db/d20/d4a 0 2024-09-13T21:40:37.711 INFO:tasks.workunit.client.1.smithi116.stdout:3/221: chown d3/db/d10/f18 1 1 2024-09-13T21:40:37.712 INFO:tasks.workunit.client.1.smithi116.stdout:3/222: symlink d3/l54 0 2024-09-13T21:40:37.712 INFO:tasks.workunit.client.1.smithi116.stdout:3/223: read - d3/db/d3d/d40/f4c zero size 2024-09-13T21:40:37.713 INFO:tasks.workunit.client.1.smithi116.stdout:3/224: mkdir d3/db/d10/d1c/d34/d55 0 2024-09-13T21:40:37.716 INFO:tasks.workunit.client.1.smithi116.stdout:3/225: unlink d3/db/d10/d1d/c27 0 2024-09-13T21:40:37.716 INFO:tasks.workunit.client.1.smithi116.stdout:3/226: chown d3/db/d10/d1d/d2f 4966211 1 2024-09-13T21:40:37.717 INFO:tasks.workunit.client.1.smithi116.stdout:3/227: creat d3/db/d10/d1c/d34/f56 x:0 0 0 2024-09-13T21:40:37.720 INFO:tasks.workunit.client.1.smithi116.stdout:3/228: rename d3/db/d10/d1c/d34/d3c to d3/db/d10/d1c/d34/d55/d57 0 2024-09-13T21:40:37.723 INFO:tasks.workunit.client.1.smithi116.stdout:3/229: truncate d3/db/d10/f13 3219690 0 2024-09-13T21:40:37.723 INFO:tasks.workunit.client.1.smithi116.stdout:3/230: write d3/db/d10/f15 [4599227,54797] 0 2024-09-13T21:40:37.725 INFO:tasks.workunit.client.1.smithi116.stdout:3/231: rename d3/db/d10/f18 to d3/db/d10/d1c/d34/d55/d57/f58 0 2024-09-13T21:40:37.726 INFO:tasks.workunit.client.1.smithi116.stdout:3/232: stat d3/f9 0 2024-09-13T21:40:37.726 INFO:tasks.workunit.client.1.smithi116.stdout:3/233: readlink d3/db/d10/d29/l35 0 2024-09-13T21:40:37.727 INFO:tasks.workunit.client.1.smithi116.stdout:3/234: link d3/c7 d3/db/d20/d4a/c59 0 2024-09-13T21:40:37.728 INFO:tasks.workunit.client.1.smithi116.stdout:3/235: mknod d3/db/d10/d1c/d34/d55/d57/c5a 0 2024-09-13T21:40:37.728 INFO:tasks.workunit.client.1.smithi116.stdout:0/155: rmdir d2/dc 39 2024-09-13T21:40:37.730 INFO:tasks.workunit.client.1.smithi116.stdout:3/236: write d3/db/d10/d1d/f1e [4766823,118696] 0 2024-09-13T21:40:37.730 INFO:tasks.workunit.client.1.smithi116.stdout:3/237: dread - d3/db/d3d/d40/f4c zero size 2024-09-13T21:40:37.733 INFO:tasks.workunit.client.1.smithi116.stdout:0/156: dread d2/dc/d12/f23 [0,4194304] 0 2024-09-13T21:40:37.739 INFO:tasks.workunit.client.1.smithi116.stdout:3/238: read d3/db/f17 [2394123,126580] 0 2024-09-13T21:40:37.739 INFO:tasks.workunit.client.1.smithi116.stdout:3/239: write d3/db/f3e [610520,98335] 0 2024-09-13T21:40:37.740 INFO:tasks.workunit.client.1.smithi116.stdout:3/240: rename d3/db/d10/d29/c4b to d3/db/d3d/c5b 0 2024-09-13T21:40:37.741 INFO:tasks.workunit.client.1.smithi116.stdout:3/241: chown d3/db/d20/d4a 103031 1 2024-09-13T21:40:37.742 INFO:tasks.workunit.client.1.smithi116.stdout:3/242: mkdir d3/db/d20/d4a/d5c 0 2024-09-13T21:40:37.743 INFO:tasks.workunit.client.1.smithi116.stdout:3/243: creat d3/db/d10/d1c/f5d x:0 0 0 2024-09-13T21:40:37.744 INFO:tasks.workunit.client.1.smithi116.stdout:3/244: rmdir d3/db/d10 39 2024-09-13T21:40:37.745 INFO:tasks.workunit.client.1.smithi116.stdout:3/245: rename d3/db/d10/d1c/f21 to d3/db/f5e 0 2024-09-13T21:40:37.746 INFO:tasks.workunit.client.1.smithi116.stdout:3/246: mkdir d3/db/d10/d1d/d5f 0 2024-09-13T21:40:37.749 INFO:tasks.workunit.client.1.smithi116.stdout:3/247: dread d3/db/f5e [0,4194304] 0 2024-09-13T21:40:37.785 INFO:tasks.workunit.client.1.smithi116.stdout:0/157: dwrite d2/f38 [0,4194304] 0 2024-09-13T21:40:37.785 INFO:tasks.workunit.client.1.smithi116.stdout:0/158: stat d2/dc/d12/l2f 0 2024-09-13T21:40:37.794 INFO:tasks.workunit.client.1.smithi116.stdout:0/159: dread d2/dc/f2d [0,4194304] 0 2024-09-13T21:40:37.794 INFO:tasks.workunit.client.1.smithi116.stdout:0/160: write d2/dc/f33 [58752,82528] 0 2024-09-13T21:40:37.794 INFO:tasks.workunit.client.1.smithi116.stdout:0/161: readlink d2/dc/l35 0 2024-09-13T21:40:37.798 INFO:tasks.workunit.client.1.smithi116.stdout:3/248: dwrite d3/db/d20/f23 [0,4194304] 0 2024-09-13T21:40:37.798 INFO:tasks.workunit.client.1.smithi116.stdout:3/249: rmdir d3/db/d10/d1c/d34/d55/d57 39 2024-09-13T21:40:37.799 INFO:tasks.workunit.client.1.smithi116.stdout:3/250: creat d3/db/d10/d1d/f60 x:0 0 0 2024-09-13T21:40:37.801 INFO:tasks.workunit.client.1.smithi116.stdout:3/251: rename d3/db/d20/d25 to d3/db/d10/d1d/d2f/d61 0 2024-09-13T21:40:37.803 INFO:tasks.workunit.client.1.smithi116.stdout:3/252: mkdir d3/db/d10/d62 0 2024-09-13T21:40:37.804 INFO:tasks.workunit.client.1.smithi116.stdout:3/253: chown d3/db/d10/d1c/d34/d55/d57/c5a 1804535 1 2024-09-13T21:40:37.805 INFO:tasks.workunit.client.1.smithi116.stdout:3/254: unlink d3/db/d20/d4a/c52 0 2024-09-13T21:40:37.806 INFO:tasks.workunit.client.1.smithi116.stdout:3/255: dread d3/db/f3f [0,4194304] 0 2024-09-13T21:40:37.806 INFO:tasks.workunit.client.1.smithi116.stdout:3/256: dread - d3/db/d3d/d40/f42 zero size 2024-09-13T21:40:37.808 INFO:tasks.workunit.client.1.smithi116.stdout:3/257: dread d3/db/f5e [0,4194304] 0 2024-09-13T21:40:37.809 INFO:tasks.workunit.client.1.smithi116.stdout:3/258: mkdir d3/db/d10/d1c/d63 0 2024-09-13T21:40:37.810 INFO:tasks.workunit.client.1.smithi116.stdout:3/259: creat d3/db/d10/d1c/d63/f64 x:0 0 0 2024-09-13T21:40:37.810 INFO:tasks.workunit.client.1.smithi116.stdout:3/260: chown d3/l54 67029425 1 2024-09-13T21:40:37.811 INFO:tasks.workunit.client.1.smithi116.stdout:0/162: dwrite d2/dc/f2e [4194304,4194304] 0 2024-09-13T21:40:37.813 INFO:tasks.workunit.client.1.smithi116.stdout:3/261: creat d3/db/d20/f65 x:0 0 0 2024-09-13T21:40:37.815 INFO:tasks.workunit.client.1.smithi116.stdout:0/163: truncate d2/d5/f6 710480 0 2024-09-13T21:40:37.815 INFO:tasks.workunit.client.1.smithi116.stdout:0/164: creat d2/d5/f39 x:0 0 0 2024-09-13T21:40:37.816 INFO:tasks.workunit.client.1.smithi116.stdout:3/262: mknod d3/db/d20/d4a/c66 0 2024-09-13T21:40:37.816 INFO:tasks.workunit.client.1.smithi116.stdout:3/263: write d3/db/d10/d1c/d63/f64 [481260,19188] 0 2024-09-13T21:40:37.816 INFO:tasks.workunit.client.1.smithi116.stdout:3/264: chown d3/db/d10/d29/c36 0 1 2024-09-13T21:40:37.816 INFO:tasks.workunit.client.1.smithi116.stdout:3/265: creat d3/db/d10/d29/f67 x:0 0 0 2024-09-13T21:40:37.819 INFO:tasks.workunit.client.1.smithi116.stdout:0/165: dread d2/fb [0,4194304] 0 2024-09-13T21:40:37.820 INFO:tasks.workunit.client.1.smithi116.stdout:0/166: truncate d2/f38 624117 0 2024-09-13T21:40:37.821 INFO:tasks.workunit.client.1.smithi116.stdout:0/167: unlink d2/dc/d12/d28/f2b 0 2024-09-13T21:40:37.826 INFO:tasks.workunit.client.1.smithi116.stdout:0/168: write d2/fb [3117108,4535] 0 2024-09-13T21:40:37.841 INFO:tasks.workunit.client.1.smithi116.stdout:0/169: dwrite d2/d5/f1f [0,4194304] 0 2024-09-13T21:40:37.860 INFO:tasks.workunit.client.1.smithi116.stdout:0/170: dwrite d2/d5/f9 [0,4194304] 0 2024-09-13T21:40:37.860 INFO:tasks.workunit.client.1.smithi116.stdout:4/244: sync 2024-09-13T21:40:37.863 INFO:tasks.workunit.client.1.smithi116.stdout:0/171: dread d2/dc/d12/f36 [0,4194304] 0 2024-09-13T21:40:37.865 INFO:tasks.workunit.client.1.smithi116.stdout:0/172: dread d2/d5/f26 [0,4194304] 0 2024-09-13T21:40:37.866 INFO:tasks.workunit.client.1.smithi116.stdout:0/173: mknod d2/c3a 0 2024-09-13T21:40:37.869 INFO:tasks.workunit.client.1.smithi116.stdout:0/174: link d2/ca d2/dc/c3b 0 2024-09-13T21:40:37.869 INFO:tasks.workunit.client.1.smithi116.stdout:0/175: readlink d2/dc/d12/l2f 0 2024-09-13T21:40:37.869 INFO:tasks.workunit.client.1.smithi116.stdout:0/176: stat d2/dc/d12/c1c 0 2024-09-13T21:40:37.869 INFO:tasks.workunit.client.1.smithi116.stdout:0/177: chown d2/d5/f9 214 1 2024-09-13T21:40:37.870 INFO:tasks.workunit.client.1.smithi116.stdout:0/178: mknod d2/dc/d12/d28/c3c 0 2024-09-13T21:40:37.870 INFO:tasks.workunit.client.1.smithi116.stdout:0/179: chown d2/dc/l35 47112539 1 2024-09-13T21:40:37.873 INFO:tasks.workunit.client.1.smithi116.stdout:0/180: rename d2/f7 to d2/dc/f3d 0 2024-09-13T21:40:37.892 INFO:tasks.workunit.client.1.smithi116.stdout:0/181: dwrite d2/d5/fd [0,4194304] 0 2024-09-13T21:40:37.909 INFO:tasks.workunit.client.1.smithi116.stdout:0/182: dwrite d2/dc/fe [0,4194304] 0 2024-09-13T21:40:37.911 INFO:tasks.workunit.client.1.smithi116.stdout:0/183: unlink d2/c21 0 2024-09-13T21:40:37.911 INFO:tasks.workunit.client.1.smithi116.stdout:0/184: chown d2/dc/fe 10 1 2024-09-13T21:40:37.911 INFO:tasks.workunit.client.1.smithi116.stdout:0/185: stat d2/dc/c3b 0 2024-09-13T21:40:37.911 INFO:tasks.workunit.client.1.smithi116.stdout:0/186: truncate d2/d5/f34 958709 0 2024-09-13T21:40:37.911 INFO:tasks.workunit.client.1.smithi116.stdout:0/187: truncate d2/d5/f26 1314857 0 2024-09-13T21:40:37.912 INFO:tasks.workunit.client.1.smithi116.stdout:0/188: mkdir d2/d5/d3e 0 2024-09-13T21:40:37.912 INFO:tasks.workunit.client.1.smithi116.stdout:0/189: creat d2/f3f x:0 0 0 2024-09-13T21:40:37.913 INFO:tasks.workunit.client.1.smithi116.stdout:0/190: unlink d2/dc/l1b 0 2024-09-13T21:40:37.916 INFO:tasks.workunit.client.1.smithi116.stdout:0/191: read d2/d5/f6 [445792,69405] 0 2024-09-13T21:40:37.917 INFO:tasks.workunit.client.1.smithi116.stdout:0/192: dread d2/d5/f34 [0,4194304] 0 2024-09-13T21:40:37.917 INFO:tasks.workunit.client.1.smithi116.stdout:0/193: chown d2/f38 520712444 1 2024-09-13T21:40:37.948 INFO:tasks.workunit.client.1.smithi116.stdout:8/84: sync 2024-09-13T21:40:37.948 INFO:tasks.workunit.client.1.smithi116.stdout:9/120: sync 2024-09-13T21:40:37.949 INFO:tasks.workunit.client.1.smithi116.stdout:8/85: symlink d2/d10/l1c 0 2024-09-13T21:40:37.949 INFO:tasks.workunit.client.1.smithi116.stdout:8/86: fsync d2/d10/f11 0 2024-09-13T21:40:37.950 INFO:tasks.workunit.client.1.smithi116.stdout:8/87: dread d2/d10/f11 [0,4194304] 0 2024-09-13T21:40:37.950 INFO:tasks.workunit.client.1.smithi116.stdout:8/88: chown d2/d10/d19/c1a 3426 1 2024-09-13T21:40:37.951 INFO:tasks.workunit.client.1.smithi116.stdout:8/89: truncate d2/f13 2724982 0 2024-09-13T21:40:37.952 INFO:tasks.workunit.client.1.smithi116.stdout:8/90: creat d2/d10/d19/f1d x:0 0 0 2024-09-13T21:40:37.953 INFO:tasks.workunit.client.1.smithi116.stdout:8/91: symlink d2/d10/l1e 0 2024-09-13T21:40:37.961 INFO:tasks.workunit.client.1.smithi116.stdout:9/121: dread d2/d10/f12 [0,4194304] 0 2024-09-13T21:40:37.967 INFO:tasks.workunit.client.1.smithi116.stdout:8/92: dwrite d2/fd [4194304,4194304] 0 2024-09-13T21:40:37.972 INFO:tasks.workunit.client.1.smithi116.stdout:8/93: dread d2/f13 [0,4194304] 0 2024-09-13T21:40:37.972 INFO:tasks.workunit.client.1.smithi116.stdout:8/94: dread - d2/d10/d19/f1d zero size 2024-09-13T21:40:37.973 INFO:tasks.workunit.client.1.smithi116.stdout:8/95: mkdir d2/d10/d1f 0 2024-09-13T21:40:37.988 INFO:tasks.workunit.client.1.smithi116.stdout:8/96: dwrite d2/f13 [0,4194304] 0 2024-09-13T21:40:38.002 INFO:tasks.workunit.client.1.smithi116.stdout:8/97: dwrite d2/d10/d19/f1d [0,4194304] 0 2024-09-13T21:40:38.003 INFO:tasks.workunit.client.1.smithi116.stdout:8/98: read d2/f8 [8284189,68687] 0 2024-09-13T21:40:38.003 INFO:tasks.workunit.client.1.smithi116.stdout:8/99: truncate d2/d10/d19/f1d 4706074 0 2024-09-13T21:40:38.006 INFO:tasks.workunit.client.1.smithi116.stdout:8/100: rename d2/c9 to d2/d10/d1f/c20 0 2024-09-13T21:40:38.006 INFO:tasks.workunit.client.1.smithi116.stdout:8/101: write d2/d10/f18 [115755,126747] 0 2024-09-13T21:40:38.012 INFO:tasks.workunit.client.1.smithi116.stdout:8/102: write d2/d10/d19/f1d [877255,87700] 0 2024-09-13T21:40:38.019 INFO:tasks.workunit.client.1.smithi116.stdout:8/103: dread d2/f13 [0,4194304] 0 2024-09-13T21:40:38.021 INFO:tasks.workunit.client.1.smithi116.stdout:8/104: mkdir d2/d10/d19/d21 0 2024-09-13T21:40:38.025 INFO:tasks.workunit.client.1.smithi116.stdout:8/105: rename d2/d10/d1f to d2/d10/d19/d21/d22 0 2024-09-13T21:40:38.027 INFO:tasks.workunit.client.1.smithi116.stdout:8/106: mkdir d2/d10/d19/d23 0 2024-09-13T21:40:38.034 INFO:tasks.workunit.client.1.smithi116.stdout:8/107: dread d2/d10/d19/f1d [0,4194304] 0 2024-09-13T21:40:38.039 INFO:tasks.workunit.client.1.smithi116.stdout:8/108: dread d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:38.058 INFO:tasks.workunit.client.1.smithi116.stdout:8/109: dwrite d2/fd [0,4194304] 0 2024-09-13T21:40:38.083 INFO:tasks.workunit.client.1.smithi116.stdout:1/84: sync 2024-09-13T21:40:38.083 INFO:tasks.workunit.client.1.smithi116.stdout:5/225: sync 2024-09-13T21:40:38.083 INFO:tasks.workunit.client.1.smithi116.stdout:1/85: readlink d4/l7 0 2024-09-13T21:40:38.084 INFO:tasks.workunit.client.1.smithi116.stdout:5/226: truncate d7/da/d21/f3b 251002 0 2024-09-13T21:40:38.085 INFO:tasks.workunit.client.1.smithi116.stdout:5/227: link d7/d1d/l38 d7/d40/l49 0 2024-09-13T21:40:38.085 INFO:tasks.workunit.client.1.smithi116.stdout:5/228: readlink d7/d1d/l1e 0 2024-09-13T21:40:38.110 INFO:tasks.workunit.client.1.smithi116.stdout:1/86: dwrite d4/f18 [0,4194304] 0 2024-09-13T21:40:38.110 INFO:tasks.workunit.client.1.smithi116.stdout:5/229: dwrite d7/da/f48 [0,4194304] 0 2024-09-13T21:40:38.110 INFO:tasks.workunit.client.1.smithi116.stdout:1/87: chown d4/ce 5205 1 2024-09-13T21:40:38.110 INFO:tasks.workunit.client.1.smithi116.stdout:5/230: write d7/f3d [4614637,67690] 0 2024-09-13T21:40:38.112 INFO:tasks.workunit.client.1.smithi116.stdout:1/88: unlink d4/cc 0 2024-09-13T21:40:38.113 INFO:tasks.workunit.client.1.smithi116.stdout:1/89: rmdir d4/d14 39 2024-09-13T21:40:38.114 INFO:tasks.workunit.client.1.smithi116.stdout:1/90: read d4/f17 [671394,108661] 0 2024-09-13T21:40:38.114 INFO:tasks.workunit.client.1.smithi116.stdout:1/91: write f1 [1113323,70661] 0 2024-09-13T21:40:38.114 INFO:tasks.workunit.client.1.smithi116.stdout:1/92: mknod d4/d14/c1e 0 2024-09-13T21:40:38.115 INFO:tasks.workunit.client.1.smithi116.stdout:1/93: chown d4/d14/c1e 38 1 2024-09-13T21:40:38.115 INFO:tasks.workunit.client.1.smithi116.stdout:1/94: rmdir d4/d14 39 2024-09-13T21:40:38.118 INFO:tasks.workunit.client.1.smithi116.stdout:1/95: fsync d4/f17 0 2024-09-13T21:40:38.118 INFO:tasks.workunit.client.1.smithi116.stdout:1/96: truncate d4/d14/f1d 1932 0 2024-09-13T21:40:38.119 INFO:tasks.workunit.client.1.smithi116.stdout:5/231: dread d7/d1d/f29 [4194304,4194304] 0 2024-09-13T21:40:38.119 INFO:tasks.workunit.client.1.smithi116.stdout:1/97: unlink d4/f18 0 2024-09-13T21:40:38.121 INFO:tasks.workunit.client.1.smithi116.stdout:5/232: unlink d7/da/d21/c22 0 2024-09-13T21:40:38.121 INFO:tasks.workunit.client.1.smithi116.stdout:5/233: read - d7/da/f36 zero size 2024-09-13T21:40:38.122 INFO:tasks.workunit.client.1.smithi116.stdout:5/234: unlink d7/da/d21/f39 0 2024-09-13T21:40:38.124 INFO:tasks.workunit.client.1.smithi116.stdout:5/235: unlink d7/d40/f41 0 2024-09-13T21:40:38.124 INFO:tasks.workunit.client.1.smithi116.stdout:5/236: fdatasync d7/f16 0 2024-09-13T21:40:38.124 INFO:tasks.workunit.client.1.smithi116.stdout:5/237: fsync d7/da/f48 0 2024-09-13T21:40:38.125 INFO:tasks.workunit.client.1.smithi116.stdout:5/238: link d7/d1d/l38 d7/da/d21/l4a 0 2024-09-13T21:40:38.126 INFO:tasks.workunit.client.1.smithi116.stdout:5/239: symlink d7/d1d/l4b 0 2024-09-13T21:40:38.127 INFO:tasks.workunit.client.1.smithi116.stdout:5/240: rename d7/d1d/c34 to d7/c4c 0 2024-09-13T21:40:38.135 INFO:tasks.workunit.client.1.smithi116.stdout:1/98: dwrite f1 [0,4194304] 0 2024-09-13T21:40:38.157 INFO:tasks.workunit.client.1.smithi116.stdout:5/241: dwrite d7/f3d [4194304,4194304] 0 2024-09-13T21:40:38.158 INFO:tasks.workunit.client.1.smithi116.stdout:1/99: dwrite f1 [0,4194304] 0 2024-09-13T21:40:38.158 INFO:tasks.workunit.client.1.smithi116.stdout:1/100: write d4/f10 [541540,19875] 0 2024-09-13T21:40:38.161 INFO:tasks.workunit.client.1.smithi116.stdout:1/101: rmdir d4 39 2024-09-13T21:40:38.169 INFO:tasks.workunit.client.1.smithi116.stdout:5/242: read d7/da/f19 [6075740,114698] 0 2024-09-13T21:40:38.170 INFO:tasks.workunit.client.1.smithi116.stdout:1/102: write f1 [59862,49853] 0 2024-09-13T21:40:38.171 INFO:tasks.workunit.client.1.smithi116.stdout:5/243: truncate d7/da/f3e 43860 0 2024-09-13T21:40:38.172 INFO:tasks.workunit.client.1.smithi116.stdout:1/103: truncate d4/d14/f19 2918564 0 2024-09-13T21:40:38.174 INFO:tasks.workunit.client.1.smithi116.stdout:1/104: write d4/f8 [1116886,34404] 0 2024-09-13T21:40:38.174 INFO:tasks.workunit.client.1.smithi116.stdout:1/105: fdatasync d4/d14/f1d 0 2024-09-13T21:40:38.175 INFO:tasks.workunit.client.1.smithi116.stdout:5/244: unlink d7/da/c17 0 2024-09-13T21:40:38.178 INFO:tasks.workunit.client.1.smithi116.stdout:1/106: rmdir d4 39 2024-09-13T21:40:38.178 INFO:tasks.workunit.client.1.smithi116.stdout:1/107: fsync d4/f1b 0 2024-09-13T21:40:38.179 INFO:tasks.workunit.client.1.smithi116.stdout:5/245: symlink d7/d1d/d46/l4d 0 2024-09-13T21:40:38.181 INFO:tasks.workunit.client.1.smithi116.stdout:5/246: creat d7/da/d21/f4e x:0 0 0 2024-09-13T21:40:38.181 INFO:tasks.workunit.client.1.smithi116.stdout:5/247: chown d7/da/f1c 214601989 1 2024-09-13T21:40:38.182 INFO:tasks.workunit.client.1.smithi116.stdout:5/248: symlink d7/d1d/d46/l4f 0 2024-09-13T21:40:38.183 INFO:tasks.workunit.client.1.smithi116.stdout:5/249: creat d7/d40/f50 x:0 0 0 2024-09-13T21:40:38.184 INFO:tasks.workunit.client.1.smithi116.stdout:5/250: rename d7/da/f1b to d7/d1d/d46/f51 0 2024-09-13T21:40:38.184 INFO:tasks.workunit.client.1.smithi116.stdout:5/251: chown d7/da/d21/l4a 4401533 1 2024-09-13T21:40:38.185 INFO:tasks.workunit.client.1.smithi116.stdout:5/252: rename d7/da/f36 to d7/da/f52 0 2024-09-13T21:40:38.186 INFO:tasks.workunit.client.1.smithi116.stdout:5/253: chown d7/da/d21/l28 18236508 1 2024-09-13T21:40:38.186 INFO:tasks.workunit.client.1.smithi116.stdout:5/254: chown d7/d1d/l1e 22606 1 2024-09-13T21:40:38.191 INFO:tasks.workunit.client.1.smithi116.stdout:5/255: dread d7/fc [0,4194304] 0 2024-09-13T21:40:38.192 INFO:tasks.workunit.client.1.smithi116.stdout:5/256: unlink d7/f3a 0 2024-09-13T21:40:38.232 INFO:tasks.workunit.client.1.smithi116.stdout:1/108: dread d4/f17 [0,4194304] 0 2024-09-13T21:40:38.233 INFO:tasks.workunit.client.1.smithi116.stdout:1/109: chown d4/c11 594 1 2024-09-13T21:40:38.233 INFO:tasks.workunit.client.1.smithi116.stdout:1/110: rename d4 to d4/d1f 22 2024-09-13T21:40:38.234 INFO:tasks.workunit.client.1.smithi116.stdout:1/111: creat d4/f20 x:0 0 0 2024-09-13T21:40:38.237 INFO:tasks.workunit.client.1.smithi116.stdout:1/112: mknod d4/c21 0 2024-09-13T21:40:38.238 INFO:tasks.workunit.client.1.smithi116.stdout:1/113: symlink d4/d14/l22 0 2024-09-13T21:40:38.247 INFO:tasks.workunit.client.1.smithi116.stdout:1/114: dread d4/ff [0,4194304] 0 2024-09-13T21:40:38.247 INFO:tasks.workunit.client.1.smithi116.stdout:1/115: chown d4/ld 18 1 2024-09-13T21:40:38.248 INFO:tasks.workunit.client.1.smithi116.stdout:1/116: mkdir d4/d23 0 2024-09-13T21:40:38.248 INFO:tasks.workunit.client.1.smithi116.stdout:1/117: write d4/f8 [1879154,89572] 0 2024-09-13T21:40:38.249 INFO:tasks.workunit.client.1.smithi116.stdout:1/118: rename f2 to d4/d14/f24 0 2024-09-13T21:40:38.250 INFO:tasks.workunit.client.1.smithi116.stdout:1/119: rename d4/c16 to d4/d23/c25 0 2024-09-13T21:40:38.322 INFO:tasks.workunit.client.1.smithi116.stdout:1/120: dwrite d4/f1b [0,4194304] 0 2024-09-13T21:40:38.322 INFO:tasks.workunit.client.1.smithi116.stdout:1/121: stat d4/d14/f1d 0 2024-09-13T21:40:38.323 INFO:tasks.workunit.client.1.smithi116.stdout:1/122: symlink d4/d14/l26 0 2024-09-13T21:40:38.331 INFO:tasks.workunit.client.1.smithi116.stdout:1/123: write d4/d14/f19 [2460003,84786] 0 2024-09-13T21:40:38.331 INFO:tasks.workunit.client.1.smithi116.stdout:1/124: dread d4/d14/f1d [0,4194304] 0 2024-09-13T21:40:38.332 INFO:tasks.workunit.client.1.smithi116.stdout:1/125: chown d4/d14/f1d 2 1 2024-09-13T21:40:38.451 INFO:tasks.workunit.client.1.smithi116.stdout:7/216: sync 2024-09-13T21:40:38.455 INFO:tasks.workunit.client.1.smithi116.stdout:7/217: read d5/d9/db/ff [391248,84767] 0 2024-09-13T21:40:38.457 INFO:tasks.workunit.client.1.smithi116.stdout:7/218: mknod d5/d9/d1c/d22/d24/c4c 0 2024-09-13T21:40:38.457 INFO:tasks.workunit.client.1.smithi116.stdout:7/219: dread - d5/d9/db/f45 zero size 2024-09-13T21:40:38.457 INFO:tasks.workunit.client.1.smithi116.stdout:7/220: chown d5/d9/db/ff 112670155 1 2024-09-13T21:40:38.458 INFO:tasks.workunit.client.1.smithi116.stdout:7/221: mknod d5/d9/d27/d31/d38/d48/c4d 0 2024-09-13T21:40:38.459 INFO:tasks.workunit.client.1.smithi116.stdout:7/222: mkdir d5/d9/d27/d31/d38/d48/d4e 0 2024-09-13T21:40:38.460 INFO:tasks.workunit.client.1.smithi116.stdout:7/223: creat d5/d9/db/f4f x:0 0 0 2024-09-13T21:40:38.479 INFO:tasks.workunit.client.1.smithi116.stdout:7/224: dwrite d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:38.492 INFO:tasks.workunit.client.1.smithi116.stdout:7/225: dread d5/d9/f3d [4194304,4194304] 0 2024-09-13T21:40:38.514 INFO:tasks.workunit.client.1.smithi116.stdout:7/226: dwrite d5/d9/db/f45 [0,4194304] 0 2024-09-13T21:40:38.516 INFO:tasks.workunit.client.1.smithi116.stdout:7/227: mknod d5/d9/d27/d31/c50 0 2024-09-13T21:40:38.517 INFO:tasks.workunit.client.1.smithi116.stdout:7/228: getdents d5/d9/d27/d31/d38/d48 0 2024-09-13T21:40:38.517 INFO:tasks.workunit.client.1.smithi116.stdout:7/229: creat d5/d9/f51 x:0 0 0 2024-09-13T21:40:38.529 INFO:tasks.workunit.client.1.smithi116.stdout:7/230: write d5/d9/f10 [4454,79277] 0 2024-09-13T21:40:38.587 INFO:tasks.workunit.client.1.smithi116.stdout:2/138: sync 2024-09-13T21:40:38.587 INFO:tasks.workunit.client.1.smithi116.stdout:6/196: sync 2024-09-13T21:40:38.588 INFO:tasks.workunit.client.1.smithi116.stdout:6/197: readlink d8/d17/l25 0 2024-09-13T21:40:38.588 INFO:tasks.workunit.client.1.smithi116.stdout:2/139: mkdir d0/d7/d32 0 2024-09-13T21:40:38.604 INFO:tasks.workunit.client.1.smithi116.stdout:2/140: dwrite d0/fe [0,4194304] 0 2024-09-13T21:40:38.628 INFO:tasks.workunit.client.1.smithi116.stdout:2/141: dwrite d0/da/f1d [0,4194304] 0 2024-09-13T21:40:38.628 INFO:tasks.workunit.client.1.smithi116.stdout:2/142: chown d0/d5/d2a 23 1 2024-09-13T21:40:38.628 INFO:tasks.workunit.client.1.smithi116.stdout:2/143: fsync d0/d5/d8/f20 0 2024-09-13T21:40:38.629 INFO:tasks.workunit.client.1.smithi116.stdout:2/144: fdatasync d0/d5/d8/f20 0 2024-09-13T21:40:38.629 INFO:tasks.workunit.client.1.smithi116.stdout:2/145: rename d0 to d0/d7/d2b/d2c/d33 22 2024-09-13T21:40:38.654 INFO:tasks.workunit.client.1.smithi116.stdout:2/146: dwrite d0/d7/f1e [0,4194304] 0 2024-09-13T21:40:38.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/147: link d0/d7/f12 d0/d7/d2d/f34 0 2024-09-13T21:40:38.656 INFO:tasks.workunit.client.1.smithi116.stdout:2/148: write d0/da/d1f/f27 [672652,116062] 0 2024-09-13T21:40:38.674 INFO:tasks.workunit.client.1.smithi116.stdout:2/149: dwrite d0/fe [0,4194304] 0 2024-09-13T21:40:38.675 INFO:tasks.workunit.client.1.smithi116.stdout:2/150: truncate d0/d7/f1e 5067459 0 2024-09-13T21:40:38.675 INFO:tasks.workunit.client.1.smithi116.stdout:2/151: mknod d0/d5/d8/c35 0 2024-09-13T21:40:38.681 INFO:tasks.workunit.client.1.smithi116.stdout:2/152: dread d0/d7/d2d/f34 [0,4194304] 0 2024-09-13T21:40:38.688 INFO:tasks.workunit.client.1.smithi116.stdout:3/266: sync 2024-09-13T21:40:38.688 INFO:tasks.workunit.client.1.smithi116.stdout:3/267: creat d3/db/f68 x:0 0 0 2024-09-13T21:40:38.689 INFO:tasks.workunit.client.1.smithi116.stdout:3/268: creat d3/db/d10/d62/f69 x:0 0 0 2024-09-13T21:40:38.698 INFO:tasks.workunit.client.1.smithi116.stdout:3/269: write d3/db/d10/d1d/d2f/d61/f2a [1856638,81940] 0 2024-09-13T21:40:38.700 INFO:tasks.workunit.client.1.smithi116.stdout:3/270: rename d3/db/d10/d1d/d2f/d61/l33 to d3/db/d10/d1d/d5f/l6a 0 2024-09-13T21:40:38.702 INFO:tasks.workunit.client.1.smithi116.stdout:3/271: link d3/db/d10/d1c/d34/d55/d57/c5a d3/db/d26/c6b 0 2024-09-13T21:40:38.702 INFO:tasks.workunit.client.1.smithi116.stdout:3/272: creat d3/db/d10/d1c/d34/d47/f6c x:0 0 0 2024-09-13T21:40:38.708 INFO:tasks.workunit.client.1.smithi116.stdout:2/153: dwrite d0/d7/f1e [0,4194304] 0 2024-09-13T21:40:38.884 INFO:tasks.workunit.client.1.smithi116.stdout:0/194: sync 2024-09-13T21:40:38.884 INFO:tasks.workunit.client.1.smithi116.stdout:4/245: sync 2024-09-13T21:40:38.885 INFO:tasks.workunit.client.1.smithi116.stdout:4/246: read d0/f2b [576460,91738] 0 2024-09-13T21:40:38.888 INFO:tasks.workunit.client.1.smithi116.stdout:4/247: dread d0/f2b [0,4194304] 0 2024-09-13T21:40:38.888 INFO:tasks.workunit.client.1.smithi116.stdout:4/248: fsync d0/dd/f1b 0 2024-09-13T21:40:38.890 INFO:tasks.workunit.client.1.smithi116.stdout:4/249: mknod d0/dd/c40 0 2024-09-13T21:40:38.890 INFO:tasks.workunit.client.1.smithi116.stdout:4/250: read - d0/f3a zero size 2024-09-13T21:40:38.890 INFO:tasks.workunit.client.1.smithi116.stdout:4/251: write d0/dd/d13/f21 [4505324,93072] 0 2024-09-13T21:40:38.892 INFO:tasks.workunit.client.1.smithi116.stdout:4/252: rename d0/f28 to d0/dd/d13/f41 0 2024-09-13T21:40:38.916 INFO:tasks.workunit.client.1.smithi116.stdout:0/195: dwrite d2/dc/f3d [4194304,4194304] 0 2024-09-13T21:40:38.916 INFO:tasks.workunit.client.1.smithi116.stdout:0/196: write d2/d5/f34 [1391027,31575] 0 2024-09-13T21:40:38.917 INFO:tasks.workunit.client.1.smithi116.stdout:4/253: dwrite d0/f3a [0,4194304] 0 2024-09-13T21:40:38.921 INFO:tasks.workunit.client.1.smithi116.stdout:0/197: dread d2/dc/d12/f23 [0,4194304] 0 2024-09-13T21:40:38.921 INFO:tasks.workunit.client.1.smithi116.stdout:0/198: chown d2/l1e 177 1 2024-09-13T21:40:38.923 INFO:tasks.workunit.client.1.smithi116.stdout:4/254: mknod d0/d32/c42 0 2024-09-13T21:40:38.924 INFO:tasks.workunit.client.1.smithi116.stdout:0/199: mknod d2/c40 0 2024-09-13T21:40:38.925 INFO:tasks.workunit.client.1.smithi116.stdout:4/255: unlink d0/f2b 0 2024-09-13T21:40:38.927 INFO:tasks.workunit.client.1.smithi116.stdout:0/200: unlink d2/c20 0 2024-09-13T21:40:38.927 INFO:tasks.workunit.client.1.smithi116.stdout:0/201: fsync d2/d5/f27 0 2024-09-13T21:40:38.929 INFO:tasks.workunit.client.1.smithi116.stdout:4/256: truncate d0/dd/f2e 2018721 0 2024-09-13T21:40:38.929 INFO:tasks.workunit.client.1.smithi116.stdout:0/202: creat d2/dc/d12/f41 x:0 0 0 2024-09-13T21:40:38.930 INFO:tasks.workunit.client.1.smithi116.stdout:0/203: write d2/dc/fe [5151037,100927] 0 2024-09-13T21:40:38.930 INFO:tasks.workunit.client.1.smithi116.stdout:0/204: chown d2/dc/l35 24086 1 2024-09-13T21:40:38.930 INFO:tasks.workunit.client.1.smithi116.stdout:4/257: creat d0/f43 x:0 0 0 2024-09-13T21:40:38.931 INFO:tasks.workunit.client.1.smithi116.stdout:0/205: truncate d2/fb 2294706 0 2024-09-13T21:40:38.931 INFO:tasks.workunit.client.1.smithi116.stdout:0/206: write d2/d5/f16 [3161417,16603] 0 2024-09-13T21:40:38.931 INFO:tasks.workunit.client.1.smithi116.stdout:4/258: symlink d0/d32/l44 0 2024-09-13T21:40:38.931 INFO:tasks.workunit.client.1.smithi116.stdout:0/207: mkdir d2/d5/d3e/d42 0 2024-09-13T21:40:38.934 INFO:tasks.workunit.client.1.smithi116.stdout:4/259: mknod d0/c45 0 2024-09-13T21:40:38.934 INFO:tasks.workunit.client.1.smithi116.stdout:4/260: creat d0/dd/d13/f46 x:0 0 0 2024-09-13T21:40:38.939 INFO:tasks.workunit.client.1.smithi116.stdout:9/122: sync 2024-09-13T21:40:38.939 INFO:tasks.workunit.client.1.smithi116.stdout:9/123: chown d2/l1b 0 1 2024-09-13T21:40:38.939 INFO:tasks.workunit.client.1.smithi116.stdout:9/124: chown d2/d10/d14/c19 72 1 2024-09-13T21:40:38.940 INFO:tasks.workunit.client.1.smithi116.stdout:7/231: sync 2024-09-13T21:40:38.940 INFO:tasks.workunit.client.1.smithi116.stdout:5/257: sync 2024-09-13T21:40:38.940 INFO:tasks.workunit.client.1.smithi116.stdout:1/126: sync 2024-09-13T21:40:38.940 INFO:tasks.workunit.client.1.smithi116.stdout:1/127: fdatasync d4/d14/f24 0 2024-09-13T21:40:38.940 INFO:tasks.workunit.client.1.smithi116.stdout:4/261: rename d0/dd/l18 to d0/dd/d13/l47 0 2024-09-13T21:40:38.940 INFO:tasks.workunit.client.1.smithi116.stdout:6/198: sync 2024-09-13T21:40:38.940 INFO:tasks.workunit.client.1.smithi116.stdout:8/110: sync 2024-09-13T21:40:38.940 INFO:tasks.workunit.client.1.smithi116.stdout:2/154: sync 2024-09-13T21:40:38.941 INFO:tasks.workunit.client.1.smithi116.stdout:3/273: sync 2024-09-13T21:40:38.943 INFO:tasks.workunit.client.1.smithi116.stdout:7/232: unlink d5/d9/db/f4f 0 2024-09-13T21:40:38.943 INFO:tasks.workunit.client.1.smithi116.stdout:7/233: fdatasync d5/d9/db/d21/f3e 0 2024-09-13T21:40:38.944 INFO:tasks.workunit.client.1.smithi116.stdout:1/128: creat d4/d23/f27 x:0 0 0 2024-09-13T21:40:38.944 INFO:tasks.workunit.client.1.smithi116.stdout:5/258: dread d7/fc [0,4194304] 0 2024-09-13T21:40:38.944 INFO:tasks.workunit.client.1.smithi116.stdout:1/129: truncate d4/d14/f24 475409 0 2024-09-13T21:40:38.944 INFO:tasks.workunit.client.1.smithi116.stdout:1/130: fdatasync d4/d14/f19 0 2024-09-13T21:40:38.944 INFO:tasks.workunit.client.1.smithi116.stdout:1/131: write d4/f1c [698582,52834] 0 2024-09-13T21:40:38.944 INFO:tasks.workunit.client.1.smithi116.stdout:1/132: write d4/f1c [1360580,34352] 0 2024-09-13T21:40:38.945 INFO:tasks.workunit.client.1.smithi116.stdout:4/262: mkdir d0/dd/d48 0 2024-09-13T21:40:38.946 INFO:tasks.workunit.client.1.smithi116.stdout:4/263: creat d0/d32/f49 x:0 0 0 2024-09-13T21:40:38.946 INFO:tasks.workunit.client.1.smithi116.stdout:2/155: mknod d0/d7/c36 0 2024-09-13T21:40:38.947 INFO:tasks.workunit.client.1.smithi116.stdout:8/111: symlink d2/d10/d19/d21/d22/l24 0 2024-09-13T21:40:38.948 INFO:tasks.workunit.client.1.smithi116.stdout:3/274: symlink d3/l6d 0 2024-09-13T21:40:38.948 INFO:tasks.workunit.client.1.smithi116.stdout:3/275: stat d3/db/d10/d1c/d63/f64 0 2024-09-13T21:40:38.949 INFO:tasks.workunit.client.1.smithi116.stdout:7/234: mkdir d5/d9/d1c/d2e/d52 0 2024-09-13T21:40:38.950 INFO:tasks.workunit.client.1.smithi116.stdout:5/259: write d7/f12 [3025740,107679] 0 2024-09-13T21:40:38.952 INFO:tasks.workunit.client.1.smithi116.stdout:1/133: mknod d4/d14/c28 0 2024-09-13T21:40:38.953 INFO:tasks.workunit.client.1.smithi116.stdout:4/264: symlink d0/dd/d48/l4a 0 2024-09-13T21:40:38.955 INFO:tasks.workunit.client.1.smithi116.stdout:2/156: link d0/c2 d0/d5/c37 0 2024-09-13T21:40:38.955 INFO:tasks.workunit.client.1.smithi116.stdout:6/199: dread d8/d1e/f28 [0,4194304] 0 2024-09-13T21:40:38.956 INFO:tasks.workunit.client.1.smithi116.stdout:1/134: dread d4/fa [0,4194304] 0 2024-09-13T21:40:38.957 INFO:tasks.workunit.client.1.smithi116.stdout:8/112: creat d2/d10/d19/d23/f25 x:0 0 0 2024-09-13T21:40:38.957 INFO:tasks.workunit.client.1.smithi116.stdout:8/113: chown d2/d10/d19/d23 0 1 2024-09-13T21:40:38.958 INFO:tasks.workunit.client.1.smithi116.stdout:8/114: dread d2/d10/f11 [0,4194304] 0 2024-09-13T21:40:38.958 INFO:tasks.workunit.client.1.smithi116.stdout:5/260: mkdir d7/d40/d53 0 2024-09-13T21:40:38.958 INFO:tasks.workunit.client.1.smithi116.stdout:5/261: truncate d7/da/f3e 564242 0 2024-09-13T21:40:38.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/157: symlink d0/d5/l38 0 2024-09-13T21:40:38.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/158: creat d0/d5/d8/f39 x:0 0 0 2024-09-13T21:40:38.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/159: chown d0/da/d1f/f27 128894071 1 2024-09-13T21:40:38.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/160: stat d0/da/d1f/f27 0 2024-09-13T21:40:38.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/161: readlink d0/d5/l23 0 2024-09-13T21:40:38.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/162: chown d0/d7/f24 3 1 2024-09-13T21:40:38.962 INFO:tasks.workunit.client.1.smithi116.stdout:8/115: readlink d2/l12 0 2024-09-13T21:40:38.962 INFO:tasks.workunit.client.1.smithi116.stdout:5/262: readlink d7/l2c 0 2024-09-13T21:40:38.962 INFO:tasks.workunit.client.1.smithi116.stdout:9/125: dwrite d2/f4 [0,4194304] 0 2024-09-13T21:40:38.963 INFO:tasks.workunit.client.1.smithi116.stdout:6/200: getdents d8/d10/d24 0 2024-09-13T21:40:38.963 INFO:tasks.workunit.client.1.smithi116.stdout:6/201: dread - d8/d10/d24/f37 zero size 2024-09-13T21:40:38.964 INFO:tasks.workunit.client.1.smithi116.stdout:8/116: truncate d2/f8 8198095 0 2024-09-13T21:40:38.964 INFO:tasks.workunit.client.1.smithi116.stdout:4/265: dread d0/dd/f2e [0,4194304] 0 2024-09-13T21:40:38.964 INFO:tasks.workunit.client.1.smithi116.stdout:5/263: symlink d7/d1d/d46/l54 0 2024-09-13T21:40:38.966 INFO:tasks.workunit.client.1.smithi116.stdout:9/126: mknod d2/d10/d14/c25 0 2024-09-13T21:40:38.966 INFO:tasks.workunit.client.1.smithi116.stdout:9/127: chown d2/f7 7204 1 2024-09-13T21:40:38.966 INFO:tasks.workunit.client.1.smithi116.stdout:9/128: fsync d2/f1d 0 2024-09-13T21:40:38.966 INFO:tasks.workunit.client.1.smithi116.stdout:8/117: rmdir d2 39 2024-09-13T21:40:38.967 INFO:tasks.workunit.client.1.smithi116.stdout:9/129: truncate d2/d8/f11 2230179 0 2024-09-13T21:40:38.970 INFO:tasks.workunit.client.1.smithi116.stdout:4/266: rename d0/dd/d13/l47 to d0/l4b 0 2024-09-13T21:40:38.972 INFO:tasks.workunit.client.1.smithi116.stdout:9/130: mknod d2/d10/d14/c26 0 2024-09-13T21:40:38.974 INFO:tasks.workunit.client.1.smithi116.stdout:1/135: dread d4/f1b [0,4194304] 0 2024-09-13T21:40:38.974 INFO:tasks.workunit.client.1.smithi116.stdout:2/163: read d0/da/d1f/f27 [10605,75545] 0 2024-09-13T21:40:38.975 INFO:tasks.workunit.client.1.smithi116.stdout:4/267: link d0/f10 d0/dd/d13/f4c 0 2024-09-13T21:40:38.976 INFO:tasks.workunit.client.1.smithi116.stdout:4/268: dread - d0/d32/f49 zero size 2024-09-13T21:40:38.976 INFO:tasks.workunit.client.1.smithi116.stdout:4/269: chown d0/dd/c19 34750 1 2024-09-13T21:40:38.976 INFO:tasks.workunit.client.1.smithi116.stdout:4/270: chown d0/d32/f3e 255 1 2024-09-13T21:40:38.976 INFO:tasks.workunit.client.1.smithi116.stdout:4/271: fdatasync d0/f8 0 2024-09-13T21:40:38.976 INFO:tasks.workunit.client.1.smithi116.stdout:4/272: creat d0/dd/d13/f4d x:0 0 0 2024-09-13T21:40:38.977 INFO:tasks.workunit.client.1.smithi116.stdout:9/131: unlink d2/ca 0 2024-09-13T21:40:38.977 INFO:tasks.workunit.client.1.smithi116.stdout:9/132: chown d2/f13 62300 1 2024-09-13T21:40:38.979 INFO:tasks.workunit.client.1.smithi116.stdout:8/118: rename d2/l5 to d2/d10/d19/d21/d22/l26 0 2024-09-13T21:40:38.981 INFO:tasks.workunit.client.1.smithi116.stdout:4/273: stat d0/l7 0 2024-09-13T21:40:38.984 INFO:tasks.workunit.client.1.smithi116.stdout:8/119: readlink d2/lf 0 2024-09-13T21:40:38.986 INFO:tasks.workunit.client.1.smithi116.stdout:4/274: mkdir d0/dd/d13/d4e 0 2024-09-13T21:40:38.986 INFO:tasks.workunit.client.1.smithi116.stdout:4/275: fsync d0/f30 0 2024-09-13T21:40:38.986 INFO:tasks.workunit.client.1.smithi116.stdout:4/276: fdatasync d0/dd/f3b 0 2024-09-13T21:40:38.986 INFO:tasks.workunit.client.1.smithi116.stdout:4/277: creat d0/dd/d13/f4f x:0 0 0 2024-09-13T21:40:38.989 INFO:tasks.workunit.client.1.smithi116.stdout:8/120: mkdir d2/d27 0 2024-09-13T21:40:38.996 INFO:tasks.workunit.client.1.smithi116.stdout:4/278: dread d0/dd/f1b [0,4194304] 0 2024-09-13T21:40:39.009 INFO:tasks.workunit.client.1.smithi116.stdout:4/279: dread d0/f10 [0,4194304] 0 2024-09-13T21:40:39.013 INFO:tasks.workunit.client.1.smithi116.stdout:7/235: dwrite d5/d9/f3d [0,4194304] 0 2024-09-13T21:40:39.013 INFO:tasks.workunit.client.1.smithi116.stdout:7/236: dread - d5/d9/d27/d31/d38/f41 zero size 2024-09-13T21:40:39.013 INFO:tasks.workunit.client.1.smithi116.stdout:7/237: truncate d5/d9/db/d21/f3e 752292 0 2024-09-13T21:40:39.013 INFO:tasks.workunit.client.1.smithi116.stdout:7/238: chown d5/l28 351629 1 2024-09-13T21:40:39.014 INFO:tasks.workunit.client.1.smithi116.stdout:7/239: rename d5/d9/d27/d31/d38/f41 to d5/d9/db/d21/f53 0 2024-09-13T21:40:39.024 INFO:tasks.workunit.client.1.smithi116.stdout:2/164: dwrite d0/d5/d8/f20 [0,4194304] 0 2024-09-13T21:40:39.024 INFO:tasks.workunit.client.1.smithi116.stdout:5/264: dwrite d7/da/d21/f30 [0,4194304] 0 2024-09-13T21:40:39.026 INFO:tasks.workunit.client.1.smithi116.stdout:2/165: rename d0/d7/d32 to d0/d3a 0 2024-09-13T21:40:39.027 INFO:tasks.workunit.client.1.smithi116.stdout:5/265: link d7/da/d21/f4e d7/d40/f55 0 2024-09-13T21:40:39.028 INFO:tasks.workunit.client.1.smithi116.stdout:2/166: creat d0/d5/d2a/f3b x:0 0 0 2024-09-13T21:40:39.028 INFO:tasks.workunit.client.1.smithi116.stdout:2/167: fsync d0/d5/d8/f16 0 2024-09-13T21:40:39.032 INFO:tasks.workunit.client.1.smithi116.stdout:5/266: dread d7/d1d/f29 [4194304,4194304] 0 2024-09-13T21:40:39.034 INFO:tasks.workunit.client.1.smithi116.stdout:5/267: mknod d7/da/d21/c56 0 2024-09-13T21:40:39.037 INFO:tasks.workunit.client.1.smithi116.stdout:1/136: dwrite d4/f8 [0,4194304] 0 2024-09-13T21:40:39.038 INFO:tasks.workunit.client.1.smithi116.stdout:1/137: creat d4/d14/f29 x:0 0 0 2024-09-13T21:40:39.038 INFO:tasks.workunit.client.1.smithi116.stdout:1/138: chown d4/c1a 19720523 1 2024-09-13T21:40:39.043 INFO:tasks.workunit.client.1.smithi116.stdout:8/121: dwrite d2/fd [0,4194304] 0 2024-09-13T21:40:39.047 INFO:tasks.workunit.client.1.smithi116.stdout:8/122: write d2/f13 [2079964,100683] 0 2024-09-13T21:40:39.048 INFO:tasks.workunit.client.1.smithi116.stdout:8/123: unlink d2/d10/d19/d21/d22/c20 0 2024-09-13T21:40:39.049 INFO:tasks.workunit.client.1.smithi116.stdout:8/124: write d2/f13 [2332723,97099] 0 2024-09-13T21:40:39.049 INFO:tasks.workunit.client.1.smithi116.stdout:8/125: symlink d2/d10/d19/d21/l28 0 2024-09-13T21:40:39.050 INFO:tasks.workunit.client.1.smithi116.stdout:8/126: chown d2/c4 24 1 2024-09-13T21:40:39.050 INFO:tasks.workunit.client.1.smithi116.stdout:8/127: fdatasync d2/d10/d19/d23/f25 0 2024-09-13T21:40:39.050 INFO:tasks.workunit.client.1.smithi116.stdout:8/128: fdatasync d2/d10/d19/f1d 0 2024-09-13T21:40:39.050 INFO:tasks.workunit.client.1.smithi116.stdout:8/129: mknod d2/d10/d19/d21/c29 0 2024-09-13T21:40:39.051 INFO:tasks.workunit.client.1.smithi116.stdout:8/130: symlink d2/d10/d19/d23/l2a 0 2024-09-13T21:40:39.052 INFO:tasks.workunit.client.1.smithi116.stdout:8/131: mknod d2/d10/d19/d21/c2b 0 2024-09-13T21:40:39.055 INFO:tasks.workunit.client.1.smithi116.stdout:6/202: dwrite d8/ff [0,4194304] 0 2024-09-13T21:40:39.055 INFO:tasks.workunit.client.1.smithi116.stdout:4/280: dwrite d0/f43 [0,4194304] 0 2024-09-13T21:40:39.055 INFO:tasks.workunit.client.1.smithi116.stdout:4/281: truncate d0/dd/f2e 2096276 0 2024-09-13T21:40:39.055 INFO:tasks.workunit.client.1.smithi116.stdout:4/282: fsync d0/f31 0 2024-09-13T21:40:39.057 INFO:tasks.workunit.client.1.smithi116.stdout:9/133: fsync d2/d8/f11 0 2024-09-13T21:40:39.060 INFO:tasks.workunit.client.1.smithi116.stdout:4/283: mknod d0/dd/c50 0 2024-09-13T21:40:39.061 INFO:tasks.workunit.client.1.smithi116.stdout:9/134: mknod d2/d10/d14/c27 0 2024-09-13T21:40:39.061 INFO:tasks.workunit.client.1.smithi116.stdout:9/135: chown d2/d8 1355 1 2024-09-13T21:40:39.062 INFO:tasks.workunit.client.1.smithi116.stdout:6/203: dread d8/d10/f2b [0,4194304] 0 2024-09-13T21:40:39.063 INFO:tasks.workunit.client.1.smithi116.stdout:9/136: mknod d2/d8/c28 0 2024-09-13T21:40:39.064 INFO:tasks.workunit.client.1.smithi116.stdout:6/204: symlink d8/d10/l49 0 2024-09-13T21:40:39.064 INFO:tasks.workunit.client.1.smithi116.stdout:6/205: dread - d8/d10/d24/f37 zero size 2024-09-13T21:40:39.065 INFO:tasks.workunit.client.1.smithi116.stdout:9/137: mknod d2/d8/c29 0 2024-09-13T21:40:39.065 INFO:tasks.workunit.client.1.smithi116.stdout:6/206: rmdir d8/d10/d24 39 2024-09-13T21:40:39.067 INFO:tasks.workunit.client.1.smithi116.stdout:9/138: rename d2/f7 to d2/d10/f2a 0 2024-09-13T21:40:39.068 INFO:tasks.workunit.client.1.smithi116.stdout:9/139: creat d2/f2b x:0 0 0 2024-09-13T21:40:39.069 INFO:tasks.workunit.client.1.smithi116.stdout:2/168: dwrite d0/d5/f10 [0,4194304] 0 2024-09-13T21:40:39.069 INFO:tasks.workunit.client.1.smithi116.stdout:2/169: creat d0/d5/d8/f3c x:0 0 0 2024-09-13T21:40:39.070 INFO:tasks.workunit.client.1.smithi116.stdout:6/207: rename d8/d10/f14 to d8/d10/d33/f4a 0 2024-09-13T21:40:39.070 INFO:tasks.workunit.client.1.smithi116.stdout:7/240: dwrite d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:39.070 INFO:tasks.workunit.client.1.smithi116.stdout:7/241: readlink d5/d9/d27/l47 0 2024-09-13T21:40:39.078 INFO:tasks.workunit.client.1.smithi116.stdout:7/242: link d5/l28 d5/d9/d1c/d22/l54 0 2024-09-13T21:40:39.078 INFO:tasks.workunit.client.1.smithi116.stdout:7/243: fsync d5/d9/f33 0 2024-09-13T21:40:39.079 INFO:tasks.workunit.client.1.smithi116.stdout:6/208: getdents d8/d17 0 2024-09-13T21:40:39.081 INFO:tasks.workunit.client.1.smithi116.stdout:6/209: symlink d8/d15/d2e/d2f/l4b 0 2024-09-13T21:40:39.081 INFO:tasks.workunit.client.1.smithi116.stdout:2/170: write d0/d7/f1e [3368462,31734] 0 2024-09-13T21:40:39.082 INFO:tasks.workunit.client.1.smithi116.stdout:2/171: stat d0/d7/d2b/d2c/c15 0 2024-09-13T21:40:39.083 INFO:tasks.workunit.client.1.smithi116.stdout:7/244: rename d5/d9/d27/d31/d38/d48/c4d to d5/d9/db/c55 0 2024-09-13T21:40:39.083 INFO:tasks.workunit.client.1.smithi116.stdout:7/245: truncate d5/d9/f51 5184 0 2024-09-13T21:40:39.085 INFO:tasks.workunit.client.1.smithi116.stdout:6/210: unlink d8/f21 0 2024-09-13T21:40:39.085 INFO:tasks.workunit.client.1.smithi116.stdout:6/211: write d8/d10/d24/f37 [397315,65033] 0 2024-09-13T21:40:39.085 INFO:tasks.workunit.client.1.smithi116.stdout:2/172: dread d0/d7/f12 [0,4194304] 0 2024-09-13T21:40:39.086 INFO:tasks.workunit.client.1.smithi116.stdout:7/246: mkdir d5/d9/d27/d31/d38/d56 0 2024-09-13T21:40:39.086 INFO:tasks.workunit.client.1.smithi116.stdout:6/212: symlink d8/d10/l4c 0 2024-09-13T21:40:39.087 INFO:tasks.workunit.client.1.smithi116.stdout:7/247: mknod d5/d9/d1c/c57 0 2024-09-13T21:40:39.088 INFO:tasks.workunit.client.1.smithi116.stdout:7/248: chown d5/d9/db/f12 225 1 2024-09-13T21:40:39.088 INFO:tasks.workunit.client.1.smithi116.stdout:7/249: getdents d5/d9/d27/d31/d38/d56 0 2024-09-13T21:40:39.088 INFO:tasks.workunit.client.1.smithi116.stdout:7/250: fdatasync d5/f18 0 2024-09-13T21:40:39.088 INFO:tasks.workunit.client.1.smithi116.stdout:7/251: fdatasync d5/d9/db/d21/f49 0 2024-09-13T21:40:39.091 INFO:tasks.workunit.client.1.smithi116.stdout:6/213: link d8/f3c d8/d10/f4d 0 2024-09-13T21:40:39.091 INFO:tasks.workunit.client.1.smithi116.stdout:1/139: dwrite f3 [0,4194304] 0 2024-09-13T21:40:39.093 INFO:tasks.workunit.client.1.smithi116.stdout:7/252: dread d5/f18 [0,4194304] 0 2024-09-13T21:40:39.093 INFO:tasks.workunit.client.1.smithi116.stdout:7/253: getdents d5/d9/d27/d31/d38/d48/d4e 0 2024-09-13T21:40:39.093 INFO:tasks.workunit.client.1.smithi116.stdout:1/140: getdents d4 0 2024-09-13T21:40:39.093 INFO:tasks.workunit.client.1.smithi116.stdout:1/141: readlink d4/l7 0 2024-09-13T21:40:39.093 INFO:tasks.workunit.client.1.smithi116.stdout:1/142: write d4/f1c [2233817,107779] 0 2024-09-13T21:40:39.093 INFO:tasks.workunit.client.1.smithi116.stdout:1/143: dread - d4/d14/f29 zero size 2024-09-13T21:40:39.094 INFO:tasks.workunit.client.1.smithi116.stdout:6/214: dread d8/d1e/f31 [0,4194304] 0 2024-09-13T21:40:39.094 INFO:tasks.workunit.client.1.smithi116.stdout:7/254: stat d5/d9/db/l11 0 2024-09-13T21:40:39.095 INFO:tasks.workunit.client.1.smithi116.stdout:4/284: dwrite d0/f39 [0,4194304] 0 2024-09-13T21:40:39.098 INFO:tasks.workunit.client.1.smithi116.stdout:7/255: creat d5/d9/d1c/d22/d24/f58 x:0 0 0 2024-09-13T21:40:39.098 INFO:tasks.workunit.client.1.smithi116.stdout:7/256: chown d5/d9/db/ff 10 1 2024-09-13T21:40:39.098 INFO:tasks.workunit.client.1.smithi116.stdout:7/257: chown d5/d9/c29 1681 1 2024-09-13T21:40:39.098 INFO:tasks.workunit.client.1.smithi116.stdout:8/132: dwrite d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:39.101 INFO:tasks.workunit.client.1.smithi116.stdout:1/144: rmdir d4/d23 39 2024-09-13T21:40:39.106 INFO:tasks.workunit.client.1.smithi116.stdout:8/133: creat d2/d10/f2c x:0 0 0 2024-09-13T21:40:39.106 INFO:tasks.workunit.client.1.smithi116.stdout:8/134: chown d2/d10/d19/d21/c29 0 1 2024-09-13T21:40:39.108 INFO:tasks.workunit.client.1.smithi116.stdout:5/268: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:39.110 INFO:tasks.workunit.client.1.smithi116.stdout:4/285: read d0/dd/f2e [310957,71167] 0 2024-09-13T21:40:39.110 INFO:tasks.workunit.client.1.smithi116.stdout:4/286: truncate d0/dd/d13/f4f 533371 0 2024-09-13T21:40:39.110 INFO:tasks.workunit.client.1.smithi116.stdout:4/287: creat d0/dd/d13/f51 x:0 0 0 2024-09-13T21:40:39.111 INFO:tasks.workunit.client.1.smithi116.stdout:5/269: stat d7/c4c 0 2024-09-13T21:40:39.113 INFO:tasks.workunit.client.1.smithi116.stdout:2/173: dwrite d0/d7/d2d/f34 [0,4194304] 0 2024-09-13T21:40:39.114 INFO:tasks.workunit.client.1.smithi116.stdout:2/174: truncate d0/d5/d8/f3c 524856 0 2024-09-13T21:40:39.114 INFO:tasks.workunit.client.1.smithi116.stdout:2/175: creat d0/d5/d2a/f3d x:0 0 0 2024-09-13T21:40:39.114 INFO:tasks.workunit.client.1.smithi116.stdout:4/288: getdents d0/dd/d48 0 2024-09-13T21:40:39.114 INFO:tasks.workunit.client.1.smithi116.stdout:4/289: stat d0/dd/d48 0 2024-09-13T21:40:39.114 INFO:tasks.workunit.client.1.smithi116.stdout:4/290: stat d0/dd/c50 0 2024-09-13T21:40:39.116 INFO:tasks.workunit.client.1.smithi116.stdout:7/258: dread d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:39.120 INFO:tasks.workunit.client.1.smithi116.stdout:9/140: getdents d2/d8 0 2024-09-13T21:40:39.129 INFO:tasks.workunit.client.1.smithi116.stdout:7/259: write d5/d9/db/f3c [7294068,123196] 0 2024-09-13T21:40:39.129 INFO:tasks.workunit.client.1.smithi116.stdout:7/260: write f2 [11332553,41133] 0 2024-09-13T21:40:39.133 INFO:tasks.workunit.client.1.smithi116.stdout:9/141: write d2/f4 [3218165,100641] 0 2024-09-13T21:40:39.134 INFO:tasks.workunit.client.1.smithi116.stdout:2/176: creat d0/d7/d2b/f3e x:0 0 0 2024-09-13T21:40:39.134 INFO:tasks.workunit.client.1.smithi116.stdout:6/215: dwrite d8/d17/f19 [0,4194304] 0 2024-09-13T21:40:39.137 INFO:tasks.workunit.client.1.smithi116.stdout:7/261: link f2 d5/f59 0 2024-09-13T21:40:39.137 INFO:tasks.workunit.client.1.smithi116.stdout:7/262: truncate d5/d9/d1c/f3b 5065546 0 2024-09-13T21:40:39.137 INFO:tasks.workunit.client.1.smithi116.stdout:7/263: dread - d5/f4b zero size 2024-09-13T21:40:39.137 INFO:tasks.workunit.client.1.smithi116.stdout:7/264: truncate d5/f18 719092 0 2024-09-13T21:40:39.141 INFO:tasks.workunit.client.1.smithi116.stdout:7/265: mknod d5/d9/d1c/d2e/c5a 0 2024-09-13T21:40:39.146 INFO:tasks.workunit.client.1.smithi116.stdout:5/270: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:39.146 INFO:tasks.workunit.client.1.smithi116.stdout:5/271: write d7/d1d/d46/f51 [2204122,117751] 0 2024-09-13T21:40:39.146 INFO:tasks.workunit.client.1.smithi116.stdout:5/272: write d7/da/f3e [684253,10505] 0 2024-09-13T21:40:39.148 INFO:tasks.workunit.client.1.smithi116.stdout:1/145: dwrite d4/d14/f1d [0,4194304] 0 2024-09-13T21:40:39.167 INFO:tasks.workunit.client.1.smithi116.stdout:8/135: dwrite d2/fd [0,4194304] 0 2024-09-13T21:40:39.171 INFO:tasks.workunit.client.1.smithi116.stdout:4/291: rmdir d0/dd 39 2024-09-13T21:40:39.171 INFO:tasks.workunit.client.1.smithi116.stdout:4/292: creat d0/d32/f52 x:0 0 0 2024-09-13T21:40:39.171 INFO:tasks.workunit.client.1.smithi116.stdout:8/136: dread d2/d10/d19/f1d [0,4194304] 0 2024-09-13T21:40:39.173 INFO:tasks.workunit.client.1.smithi116.stdout:8/137: creat d2/d10/d19/d21/f2d x:0 0 0 2024-09-13T21:40:39.173 INFO:tasks.workunit.client.1.smithi116.stdout:8/138: read d2/f8 [2007850,89056] 0 2024-09-13T21:40:39.175 INFO:tasks.workunit.client.1.smithi116.stdout:8/139: symlink d2/d10/d19/d21/l2e 0 2024-09-13T21:40:39.176 INFO:tasks.workunit.client.1.smithi116.stdout:8/140: creat d2/f2f x:0 0 0 2024-09-13T21:40:39.176 INFO:tasks.workunit.client.1.smithi116.stdout:1/146: dread d4/f17 [0,4194304] 0 2024-09-13T21:40:39.177 INFO:tasks.workunit.client.1.smithi116.stdout:1/147: mkdir d4/d14/d2a 0 2024-09-13T21:40:39.178 INFO:tasks.workunit.client.1.smithi116.stdout:1/148: creat d4/d23/f2b x:0 0 0 2024-09-13T21:40:39.178 INFO:tasks.workunit.client.1.smithi116.stdout:1/149: write d4/d14/f19 [945983,130018] 0 2024-09-13T21:40:39.178 INFO:tasks.workunit.client.1.smithi116.stdout:1/150: chown d4/ld 223262485 1 2024-09-13T21:40:39.189 INFO:tasks.workunit.client.1.smithi116.stdout:8/141: write d2/fd [5389725,15372] 0 2024-09-13T21:40:39.189 INFO:tasks.workunit.client.1.smithi116.stdout:8/142: write d2/d10/f2c [498696,127670] 0 2024-09-13T21:40:39.195 INFO:tasks.workunit.client.1.smithi116.stdout:7/266: dwrite d5/d9/f14 [0,4194304] 0 2024-09-13T21:40:39.195 INFO:tasks.workunit.client.1.smithi116.stdout:9/142: dwrite d2/fc [0,4194304] 0 2024-09-13T21:40:39.196 INFO:tasks.workunit.client.1.smithi116.stdout:4/293: dwrite d0/f3a [0,4194304] 0 2024-09-13T21:40:39.196 INFO:tasks.workunit.client.1.smithi116.stdout:2/177: dwrite d0/d5/d8/f3c [0,4194304] 0 2024-09-13T21:40:39.196 INFO:tasks.workunit.client.1.smithi116.stdout:2/178: creat d0/d7/d2b/f3f x:0 0 0 2024-09-13T21:40:39.196 INFO:tasks.workunit.client.1.smithi116.stdout:5/273: dwrite d7/d1d/f45 [0,4194304] 0 2024-09-13T21:40:39.197 INFO:tasks.workunit.client.1.smithi116.stdout:7/267: mknod d5/d9/db/d21/c5b 0 2024-09-13T21:40:39.199 INFO:tasks.workunit.client.1.smithi116.stdout:8/143: read d2/fd [241467,84266] 0 2024-09-13T21:40:39.199 INFO:tasks.workunit.client.1.smithi116.stdout:8/144: fdatasync d2/f8 0 2024-09-13T21:40:39.200 INFO:tasks.workunit.client.1.smithi116.stdout:9/143: rename d2/d8/l24 to d2/d8/l2c 0 2024-09-13T21:40:39.202 INFO:tasks.workunit.client.1.smithi116.stdout:4/294: truncate d0/dd/f3b 946289 0 2024-09-13T21:40:39.202 INFO:tasks.workunit.client.1.smithi116.stdout:4/295: dread - d0/d32/f49 zero size 2024-09-13T21:40:39.202 INFO:tasks.workunit.client.1.smithi116.stdout:4/296: read d0/dd/f3b [695091,25922] 0 2024-09-13T21:40:39.203 INFO:tasks.workunit.client.1.smithi116.stdout:1/151: dwrite d4/f1c [0,4194304] 0 2024-09-13T21:40:39.214 INFO:tasks.workunit.client.1.smithi116.stdout:2/179: mknod d0/d5/d2a/c40 0 2024-09-13T21:40:39.217 INFO:tasks.workunit.client.1.smithi116.stdout:7/268: mknod d5/d9/d1c/c5c 0 2024-09-13T21:40:39.217 INFO:tasks.workunit.client.1.smithi116.stdout:7/269: stat d5/d9/db/f12 0 2024-09-13T21:40:39.219 INFO:tasks.workunit.client.1.smithi116.stdout:9/144: rename d2/d10/f18 to d2/f2d 0 2024-09-13T21:40:39.220 INFO:tasks.workunit.client.1.smithi116.stdout:4/297: truncate d0/f43 3080395 0 2024-09-13T21:40:39.220 INFO:tasks.workunit.client.1.smithi116.stdout:4/298: creat d0/d32/f53 x:0 0 0 2024-09-13T21:40:39.220 INFO:tasks.workunit.client.1.smithi116.stdout:4/299: chown d0/dd/c40 606516 1 2024-09-13T21:40:39.221 INFO:tasks.workunit.client.1.smithi116.stdout:4/300: fsync d0/dd/f3f 0 2024-09-13T21:40:39.221 INFO:tasks.workunit.client.1.smithi116.stdout:5/274: mknod d7/c57 0 2024-09-13T21:40:39.222 INFO:tasks.workunit.client.1.smithi116.stdout:4/301: symlink d0/dd/l54 0 2024-09-13T21:40:39.222 INFO:tasks.workunit.client.1.smithi116.stdout:7/270: write d5/d9/d27/f2b [3990356,30063] 0 2024-09-13T21:40:39.223 INFO:tasks.workunit.client.1.smithi116.stdout:5/275: symlink d7/d40/d53/l58 0 2024-09-13T21:40:39.224 INFO:tasks.workunit.client.1.smithi116.stdout:5/276: stat d7/da/d21/c3c 0 2024-09-13T21:40:39.225 INFO:tasks.workunit.client.1.smithi116.stdout:7/271: link d5/c2c d5/d9/db/c5d 0 2024-09-13T21:40:39.225 INFO:tasks.workunit.client.1.smithi116.stdout:2/180: write d0/d5/d8/f20 [8540,24996] 0 2024-09-13T21:40:39.226 INFO:tasks.workunit.client.1.smithi116.stdout:5/277: creat d7/d40/d53/f59 x:0 0 0 2024-09-13T21:40:39.226 INFO:tasks.workunit.client.1.smithi116.stdout:5/278: chown d7/d1d/l1e 435659 1 2024-09-13T21:40:39.227 INFO:tasks.workunit.client.1.smithi116.stdout:8/145: dwrite d2/d10/f11 [0,4194304] 0 2024-09-13T21:40:39.228 INFO:tasks.workunit.client.1.smithi116.stdout:1/152: dwrite d4/d14/f1d [0,4194304] 0 2024-09-13T21:40:39.229 INFO:tasks.workunit.client.1.smithi116.stdout:8/146: truncate d2/f13 3030651 0 2024-09-13T21:40:39.229 INFO:tasks.workunit.client.1.smithi116.stdout:8/147: readlink d2/lf 0 2024-09-13T21:40:39.229 INFO:tasks.workunit.client.1.smithi116.stdout:8/148: write d2/fd [6753287,100024] 0 2024-09-13T21:40:39.229 INFO:tasks.workunit.client.1.smithi116.stdout:8/149: chown d2/d10/c16 26198722 1 2024-09-13T21:40:39.231 INFO:tasks.workunit.client.1.smithi116.stdout:8/150: symlink d2/d10/d19/l30 0 2024-09-13T21:40:39.231 INFO:tasks.workunit.client.1.smithi116.stdout:8/151: creat d2/d10/f31 x:0 0 0 2024-09-13T21:40:39.234 INFO:tasks.workunit.client.1.smithi116.stdout:8/152: symlink d2/d10/l32 0 2024-09-13T21:40:39.237 INFO:tasks.workunit.client.1.smithi116.stdout:9/145: rename d2/d8/l2c to d2/d10/d14/l2e 0 2024-09-13T21:40:39.237 INFO:tasks.workunit.client.1.smithi116.stdout:2/181: write d0/d5/d8/f3c [4016790,50326] 0 2024-09-13T21:40:39.237 INFO:tasks.workunit.client.1.smithi116.stdout:2/182: dread - d0/d7/d2b/f3f zero size 2024-09-13T21:40:39.237 INFO:tasks.workunit.client.1.smithi116.stdout:2/183: write d0/d5/d8/f3c [3767546,74085] 0 2024-09-13T21:40:39.239 INFO:tasks.workunit.client.1.smithi116.stdout:8/153: rename d2/c4 to d2/d10/d19/d21/d22/c33 0 2024-09-13T21:40:39.239 INFO:tasks.workunit.client.1.smithi116.stdout:8/154: write d2/d10/d19/d21/f2d [982447,63622] 0 2024-09-13T21:40:39.243 INFO:tasks.workunit.client.1.smithi116.stdout:9/146: read d2/d10/f12 [1246118,34349] 0 2024-09-13T21:40:39.243 INFO:tasks.workunit.client.1.smithi116.stdout:9/147: creat d2/f2f x:0 0 0 2024-09-13T21:40:39.246 INFO:tasks.workunit.client.1.smithi116.stdout:9/148: mknod d2/d10/c30 0 2024-09-13T21:40:39.246 INFO:tasks.workunit.client.1.smithi116.stdout:9/149: truncate d2/f2f 870519 0 2024-09-13T21:40:39.246 INFO:tasks.workunit.client.1.smithi116.stdout:9/150: chown d2/d10/d14/c19 0 1 2024-09-13T21:40:39.248 INFO:tasks.workunit.client.1.smithi116.stdout:4/302: truncate d0/f43 3180661 0 2024-09-13T21:40:39.248 INFO:tasks.workunit.client.1.smithi116.stdout:4/303: chown d0/l4b 493 1 2024-09-13T21:40:39.249 INFO:tasks.workunit.client.1.smithi116.stdout:4/304: mknod d0/dd/c55 0 2024-09-13T21:40:39.252 INFO:tasks.workunit.client.1.smithi116.stdout:4/305: mkdir d0/d56 0 2024-09-13T21:40:39.254 INFO:tasks.workunit.client.1.smithi116.stdout:2/184: dread d0/fe [0,4194304] 0 2024-09-13T21:40:39.254 INFO:tasks.workunit.client.1.smithi116.stdout:2/185: chown d0/d7/d2d 2730 1 2024-09-13T21:40:39.255 INFO:tasks.workunit.client.1.smithi116.stdout:2/186: symlink d0/d5/d2a/l41 0 2024-09-13T21:40:39.255 INFO:tasks.workunit.client.1.smithi116.stdout:2/187: chown d0/da/c28 718572 1 2024-09-13T21:40:39.256 INFO:tasks.workunit.client.1.smithi116.stdout:2/188: creat d0/d7/d2b/d2c/f42 x:0 0 0 2024-09-13T21:40:39.256 INFO:tasks.workunit.client.1.smithi116.stdout:2/189: fdatasync d0/d5/f10 0 2024-09-13T21:40:39.257 INFO:tasks.workunit.client.1.smithi116.stdout:2/190: unlink d0/d5/d2a/l41 0 2024-09-13T21:40:39.257 INFO:tasks.workunit.client.1.smithi116.stdout:2/191: creat d0/d7/f43 x:0 0 0 2024-09-13T21:40:39.259 INFO:tasks.workunit.client.1.smithi116.stdout:2/192: mknod d0/d7/d2d/c44 0 2024-09-13T21:40:39.259 INFO:tasks.workunit.client.1.smithi116.stdout:1/153: dwrite f3 [0,4194304] 0 2024-09-13T21:40:39.259 INFO:tasks.workunit.client.1.smithi116.stdout:2/193: write d0/d7/d2b/f3f [331915,7310] 0 2024-09-13T21:40:39.262 INFO:tasks.workunit.client.1.smithi116.stdout:1/154: mkdir d4/d14/d2a/d2c 0 2024-09-13T21:40:39.262 INFO:tasks.workunit.client.1.smithi116.stdout:1/155: dread - d4/f20 zero size 2024-09-13T21:40:39.266 INFO:tasks.workunit.client.1.smithi116.stdout:5/279: dwrite d7/da/f27 [0,4194304] 0 2024-09-13T21:40:39.267 INFO:tasks.workunit.client.1.smithi116.stdout:8/155: dread d2/fd [0,4194304] 0 2024-09-13T21:40:39.267 INFO:tasks.workunit.client.1.smithi116.stdout:7/272: dwrite d5/d9/db/f12 [0,4194304] 0 2024-09-13T21:40:39.267 INFO:tasks.workunit.client.1.smithi116.stdout:7/273: chown d5/d9/d1c/c57 2 1 2024-09-13T21:40:39.267 INFO:tasks.workunit.client.1.smithi116.stdout:7/274: fsync d5/d9/d1c/d22/d24/d3a/f46 0 2024-09-13T21:40:39.267 INFO:tasks.workunit.client.1.smithi116.stdout:7/275: creat d5/f5e x:0 0 0 2024-09-13T21:40:39.274 INFO:tasks.workunit.client.1.smithi116.stdout:8/156: mknod d2/d10/c34 0 2024-09-13T21:40:39.275 INFO:tasks.workunit.client.1.smithi116.stdout:8/157: read - d2/d10/d19/d23/f25 zero size 2024-09-13T21:40:39.276 INFO:tasks.workunit.client.1.smithi116.stdout:7/276: truncate d5/d9/db/ff 241041 0 2024-09-13T21:40:39.277 INFO:tasks.workunit.client.1.smithi116.stdout:5/280: rename d7/c1a to d7/d1d/d46/c5a 0 2024-09-13T21:40:39.277 INFO:tasks.workunit.client.1.smithi116.stdout:5/281: readlink d7/da/d21/l4a 0 2024-09-13T21:40:39.277 INFO:tasks.workunit.client.1.smithi116.stdout:5/282: creat d7/d40/f5b x:0 0 0 2024-09-13T21:40:39.277 INFO:tasks.workunit.client.1.smithi116.stdout:5/283: write d7/da/f37 [882370,104585] 0 2024-09-13T21:40:39.278 INFO:tasks.workunit.client.1.smithi116.stdout:7/277: mkdir d5/d9/d1c/d22/d24/d5f 0 2024-09-13T21:40:39.280 INFO:tasks.workunit.client.1.smithi116.stdout:8/158: symlink d2/d10/d19/l35 0 2024-09-13T21:40:39.281 INFO:tasks.workunit.client.1.smithi116.stdout:8/159: truncate d2/f13 371883 0 2024-09-13T21:40:39.281 INFO:tasks.workunit.client.1.smithi116.stdout:8/160: chown d2 4058 1 2024-09-13T21:40:39.282 INFO:tasks.workunit.client.1.smithi116.stdout:4/306: dwrite d0/f3a [0,4194304] 0 2024-09-13T21:40:39.282 INFO:tasks.workunit.client.1.smithi116.stdout:4/307: chown d0/dd/f3b 324273784 1 2024-09-13T21:40:39.285 INFO:tasks.workunit.client.1.smithi116.stdout:7/278: dread d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:39.290 INFO:tasks.workunit.client.1.smithi116.stdout:8/161: dread d2/fd [4194304,4194304] 0 2024-09-13T21:40:39.292 INFO:tasks.workunit.client.1.smithi116.stdout:8/162: unlink d2/d10/d19/d21/c29 0 2024-09-13T21:40:39.292 INFO:tasks.workunit.client.1.smithi116.stdout:8/163: chown d2/l12 1135314644 1 2024-09-13T21:40:39.322 INFO:tasks.workunit.client.1.smithi116.stdout:1/156: dwrite d4/d14/f29 [0,4194304] 0 2024-09-13T21:40:39.323 INFO:tasks.workunit.client.1.smithi116.stdout:2/194: dwrite d0/d5/d2a/f3b [0,4194304] 0 2024-09-13T21:40:39.323 INFO:tasks.workunit.client.1.smithi116.stdout:2/195: readlink d0/d5/d2a/l31 0 2024-09-13T21:40:39.323 INFO:tasks.workunit.client.1.smithi116.stdout:4/308: dwrite d0/f24 [0,4194304] 0 2024-09-13T21:40:39.323 INFO:tasks.workunit.client.1.smithi116.stdout:4/309: readlink d0/dd/d13/l1c 0 2024-09-13T21:40:39.323 INFO:tasks.workunit.client.1.smithi116.stdout:4/310: dread - d0/d32/f49 zero size 2024-09-13T21:40:39.324 INFO:tasks.workunit.client.1.smithi116.stdout:7/279: dwrite d5/d9/db/f12 [0,4194304] 0 2024-09-13T21:40:39.324 INFO:tasks.workunit.client.1.smithi116.stdout:8/164: dwrite d2/fd [4194304,4194304] 0 2024-09-13T21:40:39.325 INFO:tasks.workunit.client.1.smithi116.stdout:2/196: read d0/d7/f24 [556756,23416] 0 2024-09-13T21:40:39.325 INFO:tasks.workunit.client.1.smithi116.stdout:2/197: fsync d0/d7/f12 0 2024-09-13T21:40:39.325 INFO:tasks.workunit.client.1.smithi116.stdout:5/284: dwrite d7/da/f19 [8388608,4194304] 0 2024-09-13T21:40:39.328 INFO:tasks.workunit.client.1.smithi116.stdout:4/311: mkdir d0/d56/d57 0 2024-09-13T21:40:39.329 INFO:tasks.workunit.client.1.smithi116.stdout:7/280: rmdir d5/d9/d27/d31/d38/d48 39 2024-09-13T21:40:39.332 INFO:tasks.workunit.client.1.smithi116.stdout:2/198: mknod d0/d5/d2a/c45 0 2024-09-13T21:40:39.333 INFO:tasks.workunit.client.1.smithi116.stdout:2/199: write d0/d7/d2b/f3f [242619,127265] 0 2024-09-13T21:40:39.333 INFO:tasks.workunit.client.1.smithi116.stdout:2/200: chown d0/d5 11811883 1 2024-09-13T21:40:39.333 INFO:tasks.workunit.client.1.smithi116.stdout:5/285: mkdir d7/d1d/d46/d5c 0 2024-09-13T21:40:39.334 INFO:tasks.workunit.client.1.smithi116.stdout:4/312: mknod d0/d32/c58 0 2024-09-13T21:40:39.335 INFO:tasks.workunit.client.1.smithi116.stdout:0/208: sync 2024-09-13T21:40:39.335 INFO:tasks.workunit.client.1.smithi116.stdout:3/276: sync 2024-09-13T21:40:39.335 INFO:tasks.workunit.client.1.smithi116.stdout:6/216: sync 2024-09-13T21:40:39.338 INFO:tasks.workunit.client.1.smithi116.stdout:6/217: dread d8/d17/f23 [0,4194304] 0 2024-09-13T21:40:39.338 INFO:tasks.workunit.client.1.smithi116.stdout:0/209: dread d2/d5/f34 [0,4194304] 0 2024-09-13T21:40:39.340 INFO:tasks.workunit.client.1.smithi116.stdout:2/201: creat d0/da/f46 x:0 0 0 2024-09-13T21:40:39.343 INFO:tasks.workunit.client.1.smithi116.stdout:0/210: rmdir d2/d5/d3e/d42 0 2024-09-13T21:40:39.343 INFO:tasks.workunit.client.1.smithi116.stdout:0/211: read - d2/dc/d12/d28/f32 zero size 2024-09-13T21:40:39.344 INFO:tasks.workunit.client.1.smithi116.stdout:4/313: dread d0/f8 [4194304,4194304] 0 2024-09-13T21:40:39.344 INFO:tasks.workunit.client.1.smithi116.stdout:5/286: getdents d7/da/d21 0 2024-09-13T21:40:39.345 INFO:tasks.workunit.client.1.smithi116.stdout:4/314: write d0/dd/d13/f4d [924464,40829] 0 2024-09-13T21:40:39.346 INFO:tasks.workunit.client.1.smithi116.stdout:2/202: mkdir d0/d7/d2d/d47 0 2024-09-13T21:40:39.348 INFO:tasks.workunit.client.1.smithi116.stdout:8/165: rmdir d2/d10 39 2024-09-13T21:40:39.349 INFO:tasks.workunit.client.1.smithi116.stdout:3/277: getdents d3/db/d3d/d40 0 2024-09-13T21:40:39.350 INFO:tasks.workunit.client.1.smithi116.stdout:5/287: fsync d7/f2f 0 2024-09-13T21:40:39.350 INFO:tasks.workunit.client.1.smithi116.stdout:2/203: dread d0/fe [0,4194304] 0 2024-09-13T21:40:39.351 INFO:tasks.workunit.client.1.smithi116.stdout:4/315: symlink d0/dd/d13/d4e/l59 0 2024-09-13T21:40:39.353 INFO:tasks.workunit.client.1.smithi116.stdout:8/166: unlink d2/d10/d19/d21/d22/l24 0 2024-09-13T21:40:39.353 INFO:tasks.workunit.client.1.smithi116.stdout:8/167: chown d2/d10/d19/l30 111012535 1 2024-09-13T21:40:39.354 INFO:tasks.workunit.client.1.smithi116.stdout:5/288: creat d7/f5d x:0 0 0 2024-09-13T21:40:39.355 INFO:tasks.workunit.client.1.smithi116.stdout:2/204: mkdir d0/da/d1f/d48 0 2024-09-13T21:40:39.356 INFO:tasks.workunit.client.1.smithi116.stdout:4/316: mkdir d0/dd/d13/d5a 0 2024-09-13T21:40:39.358 INFO:tasks.workunit.client.1.smithi116.stdout:5/289: rename d7/da/d21 to d7/da/d5e 0 2024-09-13T21:40:39.359 INFO:tasks.workunit.client.1.smithi116.stdout:4/317: mknod d0/d32/c5b 0 2024-09-13T21:40:39.363 INFO:tasks.workunit.client.1.smithi116.stdout:7/281: dwrite d5/d9/db/ff [0,4194304] 0 2024-09-13T21:40:39.363 INFO:tasks.workunit.client.1.smithi116.stdout:8/168: dread d2/f13 [0,4194304] 0 2024-09-13T21:40:39.364 INFO:tasks.workunit.client.1.smithi116.stdout:7/282: write d5/f18 [1042620,89616] 0 2024-09-13T21:40:39.364 INFO:tasks.workunit.client.1.smithi116.stdout:7/283: chown d5/c1e 192989 1 2024-09-13T21:40:39.364 INFO:tasks.workunit.client.1.smithi116.stdout:6/218: dwrite d8/d15/f1f [0,4194304] 0 2024-09-13T21:40:39.364 INFO:tasks.workunit.client.1.smithi116.stdout:5/290: rmdir d7/d1d 39 2024-09-13T21:40:39.364 INFO:tasks.workunit.client.1.smithi116.stdout:5/291: chown d7/da/f48 18989 1 2024-09-13T21:40:39.365 INFO:tasks.workunit.client.1.smithi116.stdout:3/278: write d3/db/d10/f15 [4122115,64866] 0 2024-09-13T21:40:39.367 INFO:tasks.workunit.client.1.smithi116.stdout:8/169: rename d2/d10/d19/l1b to d2/d10/d19/d21/d22/l36 0 2024-09-13T21:40:39.367 INFO:tasks.workunit.client.1.smithi116.stdout:8/170: readlink d2/d10/d19/d21/d22/l36 0 2024-09-13T21:40:39.372 INFO:tasks.workunit.client.1.smithi116.stdout:6/219: mknod d8/d17/c4e 0 2024-09-13T21:40:39.373 INFO:tasks.workunit.client.1.smithi116.stdout:3/279: symlink d3/db/d20/d4a/l6e 0 2024-09-13T21:40:39.375 INFO:tasks.workunit.client.1.smithi116.stdout:5/292: rename d7/d1d/l4b to d7/da/d5e/l5f 0 2024-09-13T21:40:39.377 INFO:tasks.workunit.client.1.smithi116.stdout:8/171: unlink d2/fd 0 2024-09-13T21:40:39.377 INFO:tasks.workunit.client.1.smithi116.stdout:8/172: write d2/d10/d19/f1d [2465629,48263] 0 2024-09-13T21:40:39.379 INFO:tasks.workunit.client.1.smithi116.stdout:7/284: link d5/d9/db/l32 d5/d9/db/l60 0 2024-09-13T21:40:39.380 INFO:tasks.workunit.client.1.smithi116.stdout:6/220: symlink d8/d10/d24/l4f 0 2024-09-13T21:40:39.380 INFO:tasks.workunit.client.1.smithi116.stdout:6/221: creat d8/d10/d33/f50 x:0 0 0 2024-09-13T21:40:39.380 INFO:tasks.workunit.client.1.smithi116.stdout:6/222: readlink d8/d10/d24/l4f 0 2024-09-13T21:40:39.382 INFO:tasks.workunit.client.1.smithi116.stdout:3/280: rename d3/db/d20/d4a/d5c to d3/db/d10/d1d/d5f/d6f 0 2024-09-13T21:40:39.382 INFO:tasks.workunit.client.1.smithi116.stdout:3/281: readlink d3/l1a 0 2024-09-13T21:40:39.382 INFO:tasks.workunit.client.1.smithi116.stdout:5/293: chown d7/ce 439484127 1 2024-09-13T21:40:39.383 INFO:tasks.workunit.client.1.smithi116.stdout:6/223: rmdir d8/d10/d24 39 2024-09-13T21:40:39.383 INFO:tasks.workunit.client.1.smithi116.stdout:6/224: truncate d8/d15/f40 456474 0 2024-09-13T21:40:39.383 INFO:tasks.workunit.client.1.smithi116.stdout:6/225: write d8/d10/d24/f3d [53889,115982] 0 2024-09-13T21:40:39.384 INFO:tasks.workunit.client.1.smithi116.stdout:2/205: dwrite d0/d5/d8/f3c [4194304,4194304] 0 2024-09-13T21:40:39.384 INFO:tasks.workunit.client.1.smithi116.stdout:2/206: chown d0/da/f46 721917211 1 2024-09-13T21:40:39.384 INFO:tasks.workunit.client.1.smithi116.stdout:2/207: chown d0/d5/cf 759 1 2024-09-13T21:40:39.385 INFO:tasks.workunit.client.1.smithi116.stdout:4/318: dwrite d0/d32/f52 [0,4194304] 0 2024-09-13T21:40:39.385 INFO:tasks.workunit.client.1.smithi116.stdout:8/173: rename d2/d10/d19/d23 to d2/d10/d37 0 2024-09-13T21:40:39.387 INFO:tasks.workunit.client.1.smithi116.stdout:5/294: symlink d7/da/d5e/l60 0 2024-09-13T21:40:39.388 INFO:tasks.workunit.client.1.smithi116.stdout:6/226: symlink d8/d15/d2e/l51 0 2024-09-13T21:40:39.388 INFO:tasks.workunit.client.1.smithi116.stdout:6/227: creat d8/d10/d33/f52 x:0 0 0 2024-09-13T21:40:39.390 INFO:tasks.workunit.client.1.smithi116.stdout:2/208: mkdir d0/d7/d49 0 2024-09-13T21:40:39.390 INFO:tasks.workunit.client.1.smithi116.stdout:2/209: creat d0/da/f4a x:0 0 0 2024-09-13T21:40:39.396 INFO:tasks.workunit.client.1.smithi116.stdout:7/285: rename d5/d9/db/l11 to d5/d9/d27/l61 0 2024-09-13T21:40:39.398 INFO:tasks.workunit.client.1.smithi116.stdout:3/282: rmdir d3/db/d26 39 2024-09-13T21:40:39.398 INFO:tasks.workunit.client.1.smithi116.stdout:3/283: dread - d3/db/f43 zero size 2024-09-13T21:40:39.399 INFO:tasks.workunit.client.1.smithi116.stdout:3/284: dread d3/db/f31 [0,4194304] 0 2024-09-13T21:40:39.407 INFO:tasks.workunit.client.1.smithi116.stdout:7/286: write d5/d9/db/ff [4026754,100795] 0 2024-09-13T21:40:39.407 INFO:tasks.workunit.client.1.smithi116.stdout:6/228: rename d8/f1d to d8/d1e/f53 0 2024-09-13T21:40:39.408 INFO:tasks.workunit.client.1.smithi116.stdout:8/174: symlink d2/l38 0 2024-09-13T21:40:39.408 INFO:tasks.workunit.client.1.smithi116.stdout:8/175: dread - d2/f2f zero size 2024-09-13T21:40:39.409 INFO:tasks.workunit.client.1.smithi116.stdout:3/285: symlink d3/db/d3d/l70 0 2024-09-13T21:40:39.409 INFO:tasks.workunit.client.1.smithi116.stdout:3/286: dread - d3/db/d10/d1c/d34/d47/f51 zero size 2024-09-13T21:40:39.411 INFO:tasks.workunit.client.1.smithi116.stdout:8/176: symlink d2/d10/d19/d21/d22/l39 0 2024-09-13T21:40:39.412 INFO:tasks.workunit.client.1.smithi116.stdout:4/319: truncate d0/d32/f52 1009564 0 2024-09-13T21:40:39.412 INFO:tasks.workunit.client.1.smithi116.stdout:4/320: stat d0/f39 0 2024-09-13T21:40:39.414 INFO:tasks.workunit.client.1.smithi116.stdout:3/287: rename d3/db/d20/d4a to d3/db/d10/d1d/d5f/d6f/d71 0 2024-09-13T21:40:39.415 INFO:tasks.workunit.client.1.smithi116.stdout:3/288: chown d3/db/d10/d1d 434933813 1 2024-09-13T21:40:39.415 INFO:tasks.workunit.client.1.smithi116.stdout:3/289: symlink d3/db/d10/d1c/l72 0 2024-09-13T21:40:39.418 INFO:tasks.workunit.client.1.smithi116.stdout:3/290: dread d3/db/d26/f28 [0,4194304] 0 2024-09-13T21:40:39.418 INFO:tasks.workunit.client.1.smithi116.stdout:3/291: dread - d3/db/d10/d1c/d34/f56 zero size 2024-09-13T21:40:39.419 INFO:tasks.workunit.client.1.smithi116.stdout:7/287: dread d5/d9/db/f45 [0,4194304] 0 2024-09-13T21:40:39.420 INFO:tasks.workunit.client.1.smithi116.stdout:3/292: dread d3/f11 [0,4194304] 0 2024-09-13T21:40:39.421 INFO:tasks.workunit.client.1.smithi116.stdout:3/293: creat d3/f73 x:0 0 0 2024-09-13T21:40:39.423 INFO:tasks.workunit.client.1.smithi116.stdout:3/294: symlink d3/db/d20/d50/l74 0 2024-09-13T21:40:39.423 INFO:tasks.workunit.client.1.smithi116.stdout:3/295: creat d3/db/d10/d1d/f75 x:0 0 0 2024-09-13T21:40:39.423 INFO:tasks.workunit.client.1.smithi116.stdout:8/177: read d2/d10/f18 [289335,33612] 0 2024-09-13T21:40:39.425 INFO:tasks.workunit.client.1.smithi116.stdout:2/210: dwrite d0/d5/d2a/f3d [0,4194304] 0 2024-09-13T21:40:39.425 INFO:tasks.workunit.client.1.smithi116.stdout:2/211: creat d0/d5/f4b x:0 0 0 2024-09-13T21:40:39.432 INFO:tasks.workunit.client.1.smithi116.stdout:7/288: dread d5/f8 [0,4194304] 0 2024-09-13T21:40:39.433 INFO:tasks.workunit.client.1.smithi116.stdout:3/296: mknod d3/db/d10/d1c/d34/d55/c76 0 2024-09-13T21:40:39.434 INFO:tasks.workunit.client.1.smithi116.stdout:5/295: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:39.435 INFO:tasks.workunit.client.1.smithi116.stdout:3/297: dread d3/db/d10/d1c/d63/f64 [0,4194304] 0 2024-09-13T21:40:39.438 INFO:tasks.workunit.client.1.smithi116.stdout:3/298: dread d3/db/d10/d1d/f2d [0,4194304] 0 2024-09-13T21:40:39.439 INFO:tasks.workunit.client.1.smithi116.stdout:3/299: stat d3/la 0 2024-09-13T21:40:39.440 INFO:tasks.workunit.client.1.smithi116.stdout:5/296: unlink d7/d1d/d46/f51 0 2024-09-13T21:40:39.440 INFO:tasks.workunit.client.1.smithi116.stdout:5/297: dread - d7/d40/d53/f59 zero size 2024-09-13T21:40:39.442 INFO:tasks.workunit.client.1.smithi116.stdout:8/178: mkdir d2/d10/d19/d3a 0 2024-09-13T21:40:39.443 INFO:tasks.workunit.client.1.smithi116.stdout:3/300: symlink d3/db/d10/d62/l77 0 2024-09-13T21:40:39.443 INFO:tasks.workunit.client.1.smithi116.stdout:3/301: write d3/db/d10/d62/f69 [249660,38836] 0 2024-09-13T21:40:39.443 INFO:tasks.workunit.client.1.smithi116.stdout:3/302: stat d3/db/f30 0 2024-09-13T21:40:39.443 INFO:tasks.workunit.client.1.smithi116.stdout:8/179: dread d2/f13 [0,4194304] 0 2024-09-13T21:40:39.445 INFO:tasks.workunit.client.1.smithi116.stdout:5/298: link d7/da/f37 d7/d40/d53/f61 0 2024-09-13T21:40:39.446 INFO:tasks.workunit.client.1.smithi116.stdout:8/180: creat d2/d10/d19/d3a/f3b x:0 0 0 2024-09-13T21:40:39.446 INFO:tasks.workunit.client.1.smithi116.stdout:8/181: chown d2/d10/d37/l2a 85618448 1 2024-09-13T21:40:39.446 INFO:tasks.workunit.client.1.smithi116.stdout:2/212: dwrite d0/da/d1f/f27 [0,4194304] 0 2024-09-13T21:40:39.447 INFO:tasks.workunit.client.1.smithi116.stdout:5/299: truncate d7/da/f48 1939171 0 2024-09-13T21:40:39.447 INFO:tasks.workunit.client.1.smithi116.stdout:5/300: truncate d7/f5d 725797 0 2024-09-13T21:40:39.451 INFO:tasks.workunit.client.1.smithi116.stdout:2/213: link d0/d5/l38 d0/d7/d2b/l4c 0 2024-09-13T21:40:39.452 INFO:tasks.workunit.client.1.smithi116.stdout:5/301: symlink d7/d40/d53/l62 0 2024-09-13T21:40:39.454 INFO:tasks.workunit.client.1.smithi116.stdout:8/182: rename d2/d10/l1e to d2/l3c 0 2024-09-13T21:40:39.454 INFO:tasks.workunit.client.1.smithi116.stdout:8/183: readlink d2/l3c 0 2024-09-13T21:40:39.455 INFO:tasks.workunit.client.1.smithi116.stdout:5/302: rmdir d7/d1d 39 2024-09-13T21:40:39.471 INFO:tasks.workunit.client.1.smithi116.stdout:7/289: dwrite d5/d9/f3d [4194304,4194304] 0 2024-09-13T21:40:39.471 INFO:tasks.workunit.client.1.smithi116.stdout:3/303: dwrite d3/db/d3d/d40/f48 [0,4194304] 0 2024-09-13T21:40:39.471 INFO:tasks.workunit.client.1.smithi116.stdout:3/304: readlink d3/db/d10/d1d/d5f/d6f/d71/l6e 0 2024-09-13T21:40:39.474 INFO:tasks.workunit.client.1.smithi116.stdout:3/305: creat d3/db/d26/f78 x:0 0 0 2024-09-13T21:40:39.474 INFO:tasks.workunit.client.1.smithi116.stdout:3/306: creat d3/db/f79 x:0 0 0 2024-09-13T21:40:39.474 INFO:tasks.workunit.client.1.smithi116.stdout:3/307: chown d3/db/d10/d1c/d34/d47/f51 513973989 1 2024-09-13T21:40:39.475 INFO:tasks.workunit.client.1.smithi116.stdout:3/308: creat d3/db/d10/d1c/d34/d55/d57/f7a x:0 0 0 2024-09-13T21:40:39.476 INFO:tasks.workunit.client.1.smithi116.stdout:3/309: stat d3/db/d10/d1c/d34/f56 0 2024-09-13T21:40:39.476 INFO:tasks.workunit.client.1.smithi116.stdout:3/310: dread - d3/db/f68 zero size 2024-09-13T21:40:39.476 INFO:tasks.workunit.client.1.smithi116.stdout:3/311: symlink d3/db/d10/d1d/d5f/d6f/l7b 0 2024-09-13T21:40:39.476 INFO:tasks.workunit.client.1.smithi116.stdout:3/312: getdents d3/db/d3d/d40 0 2024-09-13T21:40:39.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:39 smithi088 ceph-mon[27963]: pgmap v259: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 173 MiB/s rd, 218 MiB/s wr, 287 op/s 2024-09-13T21:40:39.487 INFO:tasks.workunit.client.1.smithi116.stdout:8/184: dwrite d2/f2f [0,4194304] 0 2024-09-13T21:40:39.489 INFO:tasks.workunit.client.1.smithi116.stdout:8/185: symlink d2/d10/l3d 0 2024-09-13T21:40:39.505 INFO:tasks.workunit.client.1.smithi116.stdout:5/303: dwrite d7/f16 [4194304,4194304] 0 2024-09-13T21:40:39.505 INFO:tasks.workunit.client.1.smithi116.stdout:2/214: dwrite d0/d7/f12 [4194304,4194304] 0 2024-09-13T21:40:39.505 INFO:tasks.workunit.client.1.smithi116.stdout:2/215: fsync d0/da/f46 0 2024-09-13T21:40:39.506 INFO:tasks.workunit.client.1.smithi116.stdout:2/216: chown d0/d7/d2d/f34 38558686 1 2024-09-13T21:40:39.506 INFO:tasks.workunit.client.1.smithi116.stdout:3/313: dwrite d3/db/d10/f13 [0,4194304] 0 2024-09-13T21:40:39.507 INFO:tasks.workunit.client.1.smithi116.stdout:8/186: dwrite d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:39.507 INFO:tasks.workunit.client.1.smithi116.stdout:8/187: stat d2/d10/d37 0 2024-09-13T21:40:39.512 INFO:tasks.workunit.client.1.smithi116.stdout:2/217: rename d0/da/l21 to d0/d7/d2b/l4d 0 2024-09-13T21:40:39.514 INFO:tasks.workunit.client.1.smithi116.stdout:3/314: mkdir d3/db/d10/d1c/d34/d47/d7c 0 2024-09-13T21:40:39.518 INFO:tasks.workunit.client.1.smithi116.stdout:8/188: mkdir d2/d10/d3e 0 2024-09-13T21:40:39.519 INFO:tasks.workunit.client.1.smithi116.stdout:5/304: creat d7/d1d/d46/d5c/f63 x:0 0 0 2024-09-13T21:40:39.521 INFO:tasks.workunit.client.1.smithi116.stdout:2/218: symlink d0/d3a/l4e 0 2024-09-13T21:40:39.523 INFO:tasks.workunit.client.1.smithi116.stdout:2/219: getdents d0/d7/d2d 0 2024-09-13T21:40:39.523 INFO:tasks.workunit.client.1.smithi116.stdout:2/220: read d0/d7/d2b/f3f [207397,53570] 0 2024-09-13T21:40:39.525 INFO:tasks.workunit.client.1.smithi116.stdout:5/305: rmdir d7/d40 39 2024-09-13T21:40:39.527 INFO:tasks.workunit.client.1.smithi116.stdout:2/221: truncate d0/d5/d2a/f3d 2383083 0 2024-09-13T21:40:39.531 INFO:tasks.workunit.client.1.smithi116.stdout:3/315: dwrite d3/db/d3d/d40/f48 [0,4194304] 0 2024-09-13T21:40:39.537 INFO:tasks.workunit.client.1.smithi116.stdout:3/316: getdents d3/db 0 2024-09-13T21:40:39.548 INFO:tasks.workunit.client.1.smithi116.stdout:5/306: dwrite d7/da/f27 [0,4194304] 0 2024-09-13T21:40:39.550 INFO:tasks.workunit.client.1.smithi116.stdout:2/222: dwrite d0/d5/d8/f16 [0,4194304] 0 2024-09-13T21:40:39.554 INFO:tasks.workunit.client.1.smithi116.stdout:2/223: symlink d0/d5/d2a/l4f 0 2024-09-13T21:40:39.564 INFO:tasks.workunit.client.1.smithi116.stdout:3/317: dwrite d3/db/d10/d1c/d34/d47/f51 [0,4194304] 0 2024-09-13T21:40:39.568 INFO:tasks.workunit.client.1.smithi116.stdout:3/318: creat d3/db/d10/d1d/d5f/d6f/d71/f7d x:0 0 0 2024-09-13T21:40:39.570 INFO:tasks.workunit.client.1.smithi116.stdout:3/319: rename d3/db/d10/d29/f67 to d3/db/d10/f7e 0 2024-09-13T21:40:39.570 INFO:tasks.workunit.client.1.smithi116.stdout:3/320: truncate d3/db/d10/d1c/d34/f56 509364 0 2024-09-13T21:40:39.570 INFO:tasks.workunit.client.1.smithi116.stdout:2/224: write d0/d7/d2d/f34 [6800346,80716] 0 2024-09-13T21:40:39.570 INFO:tasks.workunit.client.1.smithi116.stdout:2/225: chown d0/d5/f4b 0 1 2024-09-13T21:40:39.571 INFO:tasks.workunit.client.1.smithi116.stdout:3/321: mkdir d3/db/d10/d1d/d5f/d7f 0 2024-09-13T21:40:39.572 INFO:tasks.workunit.client.1.smithi116.stdout:2/226: link d0/d5/c1a d0/d5/d8/c50 0 2024-09-13T21:40:39.573 INFO:tasks.workunit.client.1.smithi116.stdout:2/227: readlink d0/d7/l13 0 2024-09-13T21:40:39.573 INFO:tasks.workunit.client.1.smithi116.stdout:5/307: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:39.574 INFO:tasks.workunit.client.1.smithi116.stdout:3/322: rmdir d3/db/d10/d1c/d34/d47/d7c 0 2024-09-13T21:40:39.575 INFO:tasks.workunit.client.1.smithi116.stdout:2/228: truncate d0/fe 3388646 0 2024-09-13T21:40:39.577 INFO:tasks.workunit.client.1.smithi116.stdout:3/323: rename d3/f8 to d3/db/d10/d1d/d5f/d6f/f80 0 2024-09-13T21:40:39.578 INFO:tasks.workunit.client.1.smithi116.stdout:2/229: mknod d0/d7/d2b/c51 0 2024-09-13T21:40:39.579 INFO:tasks.workunit.client.1.smithi116.stdout:2/230: fdatasync d0/d7/d2b/f3e 0 2024-09-13T21:40:39.579 INFO:tasks.workunit.client.1.smithi116.stdout:2/231: creat d0/d7/d2b/d2c/f52 x:0 0 0 2024-09-13T21:40:39.579 INFO:tasks.workunit.client.1.smithi116.stdout:2/232: write d0/d7/d2b/d2c/f52 [302080,126276] 0 2024-09-13T21:40:39.579 INFO:tasks.workunit.client.1.smithi116.stdout:3/324: mknod d3/db/d10/d1d/d2f/c81 0 2024-09-13T21:40:39.579 INFO:tasks.workunit.client.1.smithi116.stdout:3/325: creat d3/f82 x:0 0 0 2024-09-13T21:40:39.582 INFO:tasks.workunit.client.1.smithi116.stdout:2/233: symlink d0/l53 0 2024-09-13T21:40:39.582 INFO:tasks.workunit.client.1.smithi116.stdout:2/234: chown d0/d7/f24 19936 1 2024-09-13T21:40:39.582 INFO:tasks.workunit.client.1.smithi116.stdout:2/235: creat d0/f54 x:0 0 0 2024-09-13T21:40:39.585 INFO:tasks.workunit.client.1.smithi116.stdout:2/236: link d0/da/l2e d0/d3a/l55 0 2024-09-13T21:40:39.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:39 smithi116 ceph-mon[33391]: pgmap v259: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 173 MiB/s rd, 218 MiB/s wr, 287 op/s 2024-09-13T21:40:39.602 INFO:tasks.workunit.client.1.smithi116.stdout:2/237: dread d0/d5/f10 [0,4194304] 0 2024-09-13T21:40:39.602 INFO:tasks.workunit.client.1.smithi116.stdout:2/238: write d0/d7/d2b/d2c/f52 [367285,9617] 0 2024-09-13T21:40:39.602 INFO:tasks.workunit.client.1.smithi116.stdout:5/308: dwrite d7/da/f37 [0,4194304] 0 2024-09-13T21:40:39.605 INFO:tasks.workunit.client.1.smithi116.stdout:2/239: rename d0/d5/d8/f20 to d0/d7/d2d/f56 0 2024-09-13T21:40:39.605 INFO:tasks.workunit.client.1.smithi116.stdout:2/240: creat d0/d5/d2a/f57 x:0 0 0 2024-09-13T21:40:39.605 INFO:tasks.workunit.client.1.smithi116.stdout:2/241: write d0/d7/d2b/d2c/f52 [1207241,27413] 0 2024-09-13T21:40:39.607 INFO:tasks.workunit.client.1.smithi116.stdout:5/309: mkdir d7/d1d/d64 0 2024-09-13T21:40:39.608 INFO:tasks.workunit.client.1.smithi116.stdout:5/310: mkdir d7/da/d5e/d65 0 2024-09-13T21:40:39.608 INFO:tasks.workunit.client.1.smithi116.stdout:5/311: write d7/da/f52 [844011,115258] 0 2024-09-13T21:40:39.611 INFO:tasks.workunit.client.1.smithi116.stdout:3/326: dwrite d3/db/d3d/d40/f4c [0,4194304] 0 2024-09-13T21:40:39.611 INFO:tasks.workunit.client.1.smithi116.stdout:3/327: fsync d3/f11 0 2024-09-13T21:40:39.611 INFO:tasks.workunit.client.1.smithi116.stdout:3/328: dread - d3/f82 zero size 2024-09-13T21:40:39.611 INFO:tasks.workunit.client.1.smithi116.stdout:3/329: fsync d3/db/d10/d1d/f1e 0 2024-09-13T21:40:39.634 INFO:tasks.workunit.client.1.smithi116.stdout:5/312: dwrite d7/da/f37 [0,4194304] 0 2024-09-13T21:40:39.635 INFO:tasks.workunit.client.1.smithi116.stdout:5/313: stat d7/da/d5e/c42 0 2024-09-13T21:40:39.635 INFO:tasks.workunit.client.1.smithi116.stdout:3/330: dwrite d3/db/d10/d1d/d2f/f38 [0,4194304] 0 2024-09-13T21:40:39.635 INFO:tasks.workunit.client.1.smithi116.stdout:3/331: chown d3/db/d10/d1d/d5f/d6f/d71 12 1 2024-09-13T21:40:39.635 INFO:tasks.workunit.client.1.smithi116.stdout:3/332: creat d3/db/d10/d29/f83 x:0 0 0 2024-09-13T21:40:39.636 INFO:tasks.workunit.client.1.smithi116.stdout:5/314: mknod d7/da/d5e/d65/c66 0 2024-09-13T21:40:39.640 INFO:tasks.workunit.client.1.smithi116.stdout:3/333: rename d3/db/d10/f13 to d3/db/d20/d50/f84 0 2024-09-13T21:40:39.640 INFO:tasks.workunit.client.1.smithi116.stdout:3/334: dread - d3/db/d10/f7e zero size 2024-09-13T21:40:39.640 INFO:tasks.workunit.client.1.smithi116.stdout:3/335: write d3/db/f3f [133020,7002] 0 2024-09-13T21:40:39.641 INFO:tasks.workunit.client.1.smithi116.stdout:3/336: write d3/db/d20/f23 [1466889,79508] 0 2024-09-13T21:40:39.641 INFO:tasks.workunit.client.1.smithi116.stdout:3/337: write d3/db/f3e [1037904,125833] 0 2024-09-13T21:40:39.641 INFO:tasks.workunit.client.1.smithi116.stdout:3/338: fdatasync d3/f11 0 2024-09-13T21:40:39.641 INFO:tasks.workunit.client.1.smithi116.stdout:5/315: write d7/f25 [128477,15188] 0 2024-09-13T21:40:39.642 INFO:tasks.workunit.client.1.smithi116.stdout:3/339: mknod d3/db/d26/c85 0 2024-09-13T21:40:39.644 INFO:tasks.workunit.client.1.smithi116.stdout:5/316: unlink d7/da/d5e/c32 0 2024-09-13T21:40:39.644 INFO:tasks.workunit.client.1.smithi116.stdout:5/317: truncate d7/da/f37 4577111 0 2024-09-13T21:40:39.647 INFO:tasks.workunit.client.1.smithi116.stdout:3/340: mkdir d3/db/d20/d86 0 2024-09-13T21:40:39.649 INFO:tasks.workunit.client.1.smithi116.stdout:3/341: mknod d3/c87 0 2024-09-13T21:40:39.653 INFO:tasks.workunit.client.1.smithi116.stdout:3/342: mknod d3/db/d10/d1d/d5f/d7f/c88 0 2024-09-13T21:40:39.653 INFO:tasks.workunit.client.1.smithi116.stdout:3/343: chown d3/f11 3611 1 2024-09-13T21:40:39.653 INFO:tasks.workunit.client.1.smithi116.stdout:3/344: dread - d3/db/f43 zero size 2024-09-13T21:40:39.653 INFO:tasks.workunit.client.1.smithi116.stdout:3/345: fsync d3/db/d10/d1c/d34/d55/d57/f7a 0 2024-09-13T21:40:39.671 INFO:tasks.workunit.client.1.smithi116.stdout:3/346: dwrite d3/db/d10/d1c/f5d [0,4194304] 0 2024-09-13T21:40:39.679 INFO:tasks.workunit.client.1.smithi116.stdout:3/347: dread d3/db/d10/f15 [0,4194304] 0 2024-09-13T21:40:39.679 INFO:tasks.workunit.client.1.smithi116.stdout:3/348: chown d3/l6d 1207914 1 2024-09-13T21:40:39.696 INFO:tasks.workunit.client.1.smithi116.stdout:3/349: dwrite d3/db/d10/d1c/d34/d47/f51 [0,4194304] 0 2024-09-13T21:40:39.696 INFO:tasks.workunit.client.1.smithi116.stdout:3/350: readlink d3/l2b 0 2024-09-13T21:40:39.697 INFO:tasks.workunit.client.1.smithi116.stdout:3/351: chown d3/db/d10/d1c/d34/f56 59429 1 2024-09-13T21:40:39.710 INFO:tasks.workunit.client.1.smithi116.stdout:3/352: dwrite d3/db/d20/f23 [4194304,4194304] 0 2024-09-13T21:40:39.711 INFO:tasks.workunit.client.1.smithi116.stdout:3/353: rename d3/db/d10/d1d/d2f/c37 to d3/db/d26/c89 0 2024-09-13T21:40:39.729 INFO:tasks.workunit.client.1.smithi116.stdout:3/354: dwrite d3/db/d10/d1c/d34/f56 [0,4194304] 0 2024-09-13T21:40:39.744 INFO:tasks.workunit.client.1.smithi116.stdout:3/355: dwrite d3/db/d10/d1d/f75 [0,4194304] 0 2024-09-13T21:40:39.745 INFO:tasks.workunit.client.1.smithi116.stdout:3/356: mknod d3/db/d26/c8a 0 2024-09-13T21:40:39.747 INFO:tasks.workunit.client.1.smithi116.stdout:3/357: dread d3/f9 [0,4194304] 0 2024-09-13T21:40:39.748 INFO:tasks.workunit.client.1.smithi116.stdout:3/358: creat d3/db/d20/d50/f8b x:0 0 0 2024-09-13T21:40:39.748 INFO:tasks.workunit.client.1.smithi116.stdout:3/359: truncate d3/db/d10/d1c/d63/f64 704232 0 2024-09-13T21:40:39.748 INFO:tasks.workunit.client.1.smithi116.stdout:3/360: fdatasync d3/db/d20/d50/f84 0 2024-09-13T21:40:39.748 INFO:tasks.workunit.client.1.smithi116.stdout:3/361: rmdir d3/db/d10/d1d/d5f 39 2024-09-13T21:40:39.749 INFO:tasks.workunit.client.1.smithi116.stdout:3/362: unlink d3/db/d10/c19 0 2024-09-13T21:40:39.749 INFO:tasks.workunit.client.1.smithi116.stdout:3/363: read - d3/db/f79 zero size 2024-09-13T21:40:39.749 INFO:tasks.workunit.client.1.smithi116.stdout:3/364: fsync d3/db/d10/d29/f83 0 2024-09-13T21:40:39.750 INFO:tasks.workunit.client.1.smithi116.stdout:3/365: link d3/l54 d3/db/d10/d1c/l8c 0 2024-09-13T21:40:39.751 INFO:tasks.workunit.client.1.smithi116.stdout:3/366: symlink d3/db/d10/d1c/d34/d55/l8d 0 2024-09-13T21:40:39.901 INFO:tasks.workunit.client.1.smithi116.stdout:9/151: sync 2024-09-13T21:40:39.901 INFO:tasks.workunit.client.1.smithi116.stdout:9/152: creat d2/d10/d14/f31 x:0 0 0 2024-09-13T21:40:40.084 INFO:tasks.workunit.client.1.smithi116.stdout:1/157: sync 2024-09-13T21:40:40.085 INFO:tasks.workunit.client.1.smithi116.stdout:1/158: symlink d4/d14/d2a/l2d 0 2024-09-13T21:40:40.085 INFO:tasks.workunit.client.1.smithi116.stdout:1/159: write d4/d14/f19 [2360474,97790] 0 2024-09-13T21:40:40.085 INFO:tasks.workunit.client.1.smithi116.stdout:1/160: symlink d4/d23/l2e 0 2024-09-13T21:40:40.085 INFO:tasks.workunit.client.1.smithi116.stdout:1/161: chown f1 642899654 1 2024-09-13T21:40:40.086 INFO:tasks.workunit.client.1.smithi116.stdout:1/162: mkdir d4/d14/d2a/d2c/d2f 0 2024-09-13T21:40:40.095 INFO:tasks.workunit.client.1.smithi116.stdout:1/163: dread d4/f8 [0,4194304] 0 2024-09-13T21:40:40.096 INFO:tasks.workunit.client.1.smithi116.stdout:1/164: mknod d4/d14/c30 0 2024-09-13T21:40:40.248 INFO:tasks.workunit.client.1.smithi116.stdout:0/212: sync 2024-09-13T21:40:40.249 INFO:tasks.workunit.client.1.smithi116.stdout:6/229: sync 2024-09-13T21:40:40.249 INFO:tasks.workunit.client.1.smithi116.stdout:6/230: write d8/d1e/f53 [691604,14618] 0 2024-09-13T21:40:40.249 INFO:tasks.workunit.client.1.smithi116.stdout:0/213: write d2/d5/f13 [1755034,54937] 0 2024-09-13T21:40:40.249 INFO:tasks.workunit.client.1.smithi116.stdout:6/231: creat d8/d10/d33/f54 x:0 0 0 2024-09-13T21:40:40.250 INFO:tasks.workunit.client.1.smithi116.stdout:0/214: read d2/f38 [121079,81784] 0 2024-09-13T21:40:40.251 INFO:tasks.workunit.client.1.smithi116.stdout:0/215: symlink d2/dc/l43 0 2024-09-13T21:40:40.257 INFO:tasks.workunit.client.1.smithi116.stdout:6/232: write d8/d17/f19 [725975,26800] 0 2024-09-13T21:40:40.257 INFO:tasks.workunit.client.1.smithi116.stdout:6/233: chown d8/d1e 19 1 2024-09-13T21:40:40.280 INFO:tasks.workunit.client.1.smithi116.stdout:6/234: dwrite d8/fa [0,4194304] 0 2024-09-13T21:40:40.280 INFO:tasks.workunit.client.1.smithi116.stdout:6/235: creat d8/d10/f55 x:0 0 0 2024-09-13T21:40:40.285 INFO:tasks.workunit.client.1.smithi116.stdout:6/236: truncate d8/d15/f1b 1165584 0 2024-09-13T21:40:40.302 INFO:tasks.workunit.client.1.smithi116.stdout:6/237: dwrite d8/fe [0,4194304] 0 2024-09-13T21:40:40.302 INFO:tasks.workunit.client.1.smithi116.stdout:6/238: readlink d8/d10/l4c 0 2024-09-13T21:40:40.303 INFO:tasks.workunit.client.1.smithi116.stdout:6/239: dread - d8/d10/d33/f54 zero size 2024-09-13T21:40:40.304 INFO:tasks.workunit.client.1.smithi116.stdout:6/240: symlink d8/d15/l56 0 2024-09-13T21:40:40.305 INFO:tasks.workunit.client.1.smithi116.stdout:6/241: mkdir d8/d15/d2e/d2f/d57 0 2024-09-13T21:40:40.329 INFO:tasks.workunit.client.1.smithi116.stdout:6/242: dwrite d8/d15/d2e/f3f [0,4194304] 0 2024-09-13T21:40:40.331 INFO:tasks.workunit.client.1.smithi116.stdout:6/243: link d8/d15/l27 d8/l58 0 2024-09-13T21:40:40.332 INFO:tasks.workunit.client.1.smithi116.stdout:6/244: symlink d8/d15/d2e/d2f/d57/l59 0 2024-09-13T21:40:40.334 INFO:tasks.workunit.client.1.smithi116.stdout:6/245: unlink d8/d10/d24/f3d 0 2024-09-13T21:40:40.334 INFO:tasks.workunit.client.1.smithi116.stdout:6/246: creat d8/d15/d2e/f5a x:0 0 0 2024-09-13T21:40:40.334 INFO:tasks.workunit.client.1.smithi116.stdout:6/247: write d8/d17/f19 [672612,130222] 0 2024-09-13T21:40:40.336 INFO:tasks.workunit.client.1.smithi116.stdout:6/248: mknod d8/d10/c5b 0 2024-09-13T21:40:40.336 INFO:tasks.workunit.client.1.smithi116.stdout:6/249: creat d8/d10/d33/f5c x:0 0 0 2024-09-13T21:40:40.356 INFO:tasks.workunit.client.1.smithi116.stdout:6/250: dwrite d8/ff [4194304,4194304] 0 2024-09-13T21:40:40.358 INFO:tasks.workunit.client.1.smithi116.stdout:6/251: mknod d8/d15/d2e/d2f/d38/c5d 0 2024-09-13T21:40:40.365 INFO:tasks.workunit.client.1.smithi116.stdout:6/252: read d8/d15/f1f [3072862,43550] 0 2024-09-13T21:40:40.365 INFO:tasks.workunit.client.1.smithi116.stdout:6/253: readlink d8/d1e/l41 0 2024-09-13T21:40:40.366 INFO:tasks.workunit.client.1.smithi116.stdout:6/254: symlink d8/d17/l5e 0 2024-09-13T21:40:40.366 INFO:tasks.workunit.client.1.smithi116.stdout:6/255: chown d8/d10/f18 1 1 2024-09-13T21:40:40.367 INFO:tasks.workunit.client.1.smithi116.stdout:6/256: symlink d8/l5f 0 2024-09-13T21:40:40.368 INFO:tasks.workunit.client.1.smithi116.stdout:6/257: truncate d8/f16 387768 0 2024-09-13T21:40:40.369 INFO:tasks.workunit.client.1.smithi116.stdout:6/258: dread d8/d17/f23 [0,4194304] 0 2024-09-13T21:40:40.371 INFO:tasks.workunit.client.1.smithi116.stdout:6/259: link d8/d17/l5e d8/l60 0 2024-09-13T21:40:40.373 INFO:tasks.workunit.client.1.smithi116.stdout:6/260: symlink d8/d1e/l61 0 2024-09-13T21:40:40.373 INFO:tasks.workunit.client.1.smithi116.stdout:6/261: dread - d8/d10/d33/f5c zero size 2024-09-13T21:40:40.373 INFO:tasks.workunit.client.1.smithi116.stdout:6/262: read f3 [1543651,93887] 0 2024-09-13T21:40:40.376 INFO:tasks.workunit.client.1.smithi116.stdout:6/263: dread d8/d1e/f28 [0,4194304] 0 2024-09-13T21:40:40.377 INFO:tasks.workunit.client.1.smithi116.stdout:6/264: truncate d8/d15/f40 559525 0 2024-09-13T21:40:40.378 INFO:tasks.workunit.client.1.smithi116.stdout:1/165: sync 2024-09-13T21:40:40.378 INFO:tasks.workunit.client.1.smithi116.stdout:5/318: sync 2024-09-13T21:40:40.378 INFO:tasks.workunit.client.1.smithi116.stdout:2/242: sync 2024-09-13T21:40:40.378 INFO:tasks.workunit.client.1.smithi116.stdout:9/153: sync 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:8/189: sync 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:2/243: dread - d0/d5/d2a/f57 zero size 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:0/216: sync 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:0/217: chown d2 131612723 1 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:7/290: sync 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:3/367: sync 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:3/368: truncate d3/db/d3d/d40/f48 4915446 0 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:0/218: creat d2/d5/f44 x:0 0 0 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:3/369: stat d3/db/d20/d50/f8b 0 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:0/219: write d2/dc/f3d [752087,121335] 0 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:0/220: write d2/dc/f2d [5132704,33350] 0 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:6/265: dread d8/d15/f40 [0,4194304] 0 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:0/221: write d2/dc/d12/f41 [258154,25791] 0 2024-09-13T21:40:40.379 INFO:tasks.workunit.client.1.smithi116.stdout:4/321: sync 2024-09-13T21:40:40.380 INFO:tasks.workunit.client.1.smithi116.stdout:5/319: chown d7/d1d/f45 0 1 2024-09-13T21:40:40.380 INFO:tasks.workunit.client.1.smithi116.stdout:5/320: fdatasync d7/da/d5e/f30 0 2024-09-13T21:40:40.380 INFO:tasks.workunit.client.1.smithi116.stdout:5/321: chown d7/ce 24 1 2024-09-13T21:40:40.380 INFO:tasks.workunit.client.1.smithi116.stdout:9/154: link d2/d8/f1a d2/d10/f32 0 2024-09-13T21:40:40.380 INFO:tasks.workunit.client.1.smithi116.stdout:8/190: creat d2/d10/f3f x:0 0 0 2024-09-13T21:40:40.381 INFO:tasks.workunit.client.1.smithi116.stdout:1/166: symlink d4/d14/d2a/d2c/d2f/l31 0 2024-09-13T21:40:40.381 INFO:tasks.workunit.client.1.smithi116.stdout:2/244: dread d0/d7/f24 [0,4194304] 0 2024-09-13T21:40:40.381 INFO:tasks.workunit.client.1.smithi116.stdout:3/370: dread d3/db/d10/d1d/f2d [0,4194304] 0 2024-09-13T21:40:40.381 INFO:tasks.workunit.client.1.smithi116.stdout:7/291: creat d5/d9/d1c/d37/f62 x:0 0 0 2024-09-13T21:40:40.382 INFO:tasks.workunit.client.1.smithi116.stdout:6/266: symlink d8/d15/d2e/l62 0 2024-09-13T21:40:40.383 INFO:tasks.workunit.client.1.smithi116.stdout:6/267: creat d8/d1e/f63 x:0 0 0 2024-09-13T21:40:40.383 INFO:tasks.workunit.client.1.smithi116.stdout:6/268: creat d8/d15/f64 x:0 0 0 2024-09-13T21:40:40.383 INFO:tasks.workunit.client.1.smithi116.stdout:6/269: stat d8/d10/c39 0 2024-09-13T21:40:40.383 INFO:tasks.workunit.client.1.smithi116.stdout:0/222: symlink d2/dc/d12/d28/l45 0 2024-09-13T21:40:40.383 INFO:tasks.workunit.client.1.smithi116.stdout:5/322: mknod d7/da/d5e/d65/c67 0 2024-09-13T21:40:40.385 INFO:tasks.workunit.client.1.smithi116.stdout:9/155: unlink f0 0 2024-09-13T21:40:40.385 INFO:tasks.workunit.client.1.smithi116.stdout:9/156: read d2/d10/f32 [3856991,32962] 0 2024-09-13T21:40:40.385 INFO:tasks.workunit.client.1.smithi116.stdout:1/167: mknod d4/d14/c32 0 2024-09-13T21:40:40.386 INFO:tasks.workunit.client.1.smithi116.stdout:4/322: write d0/dd/d13/f41 [4071314,103158] 0 2024-09-13T21:40:40.386 INFO:tasks.workunit.client.1.smithi116.stdout:2/245: rename d0/da/d1f/d48 to d0/d5/d8/d58 0 2024-09-13T21:40:40.387 INFO:tasks.workunit.client.1.smithi116.stdout:2/246: write d0/d7/d2b/f3e [974489,9426] 0 2024-09-13T21:40:40.387 INFO:tasks.workunit.client.1.smithi116.stdout:3/371: mknod d3/db/d10/d29/c8e 0 2024-09-13T21:40:40.390 INFO:tasks.workunit.client.1.smithi116.stdout:8/191: dread d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:40.390 INFO:tasks.workunit.client.1.smithi116.stdout:8/192: write d2/d10/f18 [585915,4016] 0 2024-09-13T21:40:40.390 INFO:tasks.workunit.client.1.smithi116.stdout:8/193: write d2/d10/f2c [1657903,15949] 0 2024-09-13T21:40:40.392 INFO:tasks.workunit.client.1.smithi116.stdout:0/223: mknod d2/dc/d12/c46 0 2024-09-13T21:40:40.393 INFO:tasks.workunit.client.1.smithi116.stdout:5/323: link d7/da/d5e/c43 d7/da/c68 0 2024-09-13T21:40:40.396 INFO:tasks.workunit.client.1.smithi116.stdout:2/247: rmdir d0/d7/d2d/d47 0 2024-09-13T21:40:40.396 INFO:tasks.workunit.client.1.smithi116.stdout:2/248: creat d0/d7/f59 x:0 0 0 2024-09-13T21:40:40.396 INFO:tasks.workunit.client.1.smithi116.stdout:2/249: write d0/d7/f59 [906506,40933] 0 2024-09-13T21:40:40.398 INFO:tasks.workunit.client.1.smithi116.stdout:0/224: unlink d2/d5/f26 0 2024-09-13T21:40:40.401 INFO:tasks.workunit.client.1.smithi116.stdout:0/225: dread d2/dc/d12/f41 [0,4194304] 0 2024-09-13T21:40:40.401 INFO:tasks.workunit.client.1.smithi116.stdout:0/226: fdatasync d2/dc/d12/d28/f32 0 2024-09-13T21:40:40.401 INFO:tasks.workunit.client.1.smithi116.stdout:2/250: mknod d0/d7/d2d/c5a 0 2024-09-13T21:40:40.403 INFO:tasks.workunit.client.1.smithi116.stdout:7/292: rmdir d5/d9/d27/d31/d38/d48/d4e 0 2024-09-13T21:40:40.408 INFO:tasks.workunit.client.1.smithi116.stdout:2/251: mknod d0/d5/c5b 0 2024-09-13T21:40:40.408 INFO:tasks.workunit.client.1.smithi116.stdout:2/252: truncate d0/d5/d2a/f3d 3354528 0 2024-09-13T21:40:40.408 INFO:tasks.workunit.client.1.smithi116.stdout:2/253: chown d0/d7/d2b/d2c/f52 28 1 2024-09-13T21:40:40.408 INFO:tasks.workunit.client.1.smithi116.stdout:7/293: rmdir d5/d9/d1c/d22 39 2024-09-13T21:40:40.408 INFO:tasks.workunit.client.1.smithi116.stdout:6/270: dread d8/d15/d2e/f3f [0,4194304] 0 2024-09-13T21:40:40.424 INFO:tasks.workunit.client.1.smithi116.stdout:7/294: dread d5/f59 [4194304,4194304] 0 2024-09-13T21:40:40.425 INFO:tasks.workunit.client.1.smithi116.stdout:7/295: rmdir d5/d9/db/d21 39 2024-09-13T21:40:40.427 INFO:tasks.workunit.client.1.smithi116.stdout:7/296: creat d5/d9/db/d21/f63 x:0 0 0 2024-09-13T21:40:40.428 INFO:tasks.workunit.client.1.smithi116.stdout:7/297: creat d5/d9/d1c/d22/d24/d5f/f64 x:0 0 0 2024-09-13T21:40:40.435 INFO:tasks.workunit.client.1.smithi116.stdout:9/157: dwrite d2/f1e [0,4194304] 0 2024-09-13T21:40:40.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/158: creat d2/d8/f33 x:0 0 0 2024-09-13T21:40:40.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/159: chown d2/d10/d14/f21 18900 1 2024-09-13T21:40:40.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/160: read d2/d10/f32 [3542971,21443] 0 2024-09-13T21:40:40.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/161: read d2/d8/f1a [545700,109784] 0 2024-09-13T21:40:40.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/162: chown d2/f1e 905 1 2024-09-13T21:40:40.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/163: write d2/d10/d14/f21 [17213,41036] 0 2024-09-13T21:40:40.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/164: fsync d2/d8/f11 0 2024-09-13T21:40:40.438 INFO:tasks.workunit.client.1.smithi116.stdout:4/323: dwrite d0/dd/f1b [0,4194304] 0 2024-09-13T21:40:40.440 INFO:tasks.workunit.client.1.smithi116.stdout:9/165: rename d2/d10/d14/c27 to d2/c34 0 2024-09-13T21:40:40.440 INFO:tasks.workunit.client.1.smithi116.stdout:5/324: dwrite d7/d1d/d46/d5c/f63 [0,4194304] 0 2024-09-13T21:40:40.440 INFO:tasks.workunit.client.1.smithi116.stdout:5/325: chown d7/da/d5e/l28 0 1 2024-09-13T21:40:40.440 INFO:tasks.workunit.client.1.smithi116.stdout:5/326: read - d7/da/d5e/f4e zero size 2024-09-13T21:40:40.441 INFO:tasks.workunit.client.1.smithi116.stdout:4/324: rmdir d0/dd/d13 39 2024-09-13T21:40:40.441 INFO:tasks.workunit.client.1.smithi116.stdout:6/271: dwrite d8/f16 [0,4194304] 0 2024-09-13T21:40:40.441 INFO:tasks.workunit.client.1.smithi116.stdout:6/272: readlink d8/l5f 0 2024-09-13T21:40:40.442 INFO:tasks.workunit.client.1.smithi116.stdout:3/372: dwrite d3/db/f3f [0,4194304] 0 2024-09-13T21:40:40.442 INFO:tasks.workunit.client.1.smithi116.stdout:3/373: creat d3/db/d10/d1c/d34/f8f x:0 0 0 2024-09-13T21:40:40.442 INFO:tasks.workunit.client.1.smithi116.stdout:9/166: mknod d2/d8/c35 0 2024-09-13T21:40:40.442 INFO:tasks.workunit.client.1.smithi116.stdout:9/167: write d2/d10/d14/f21 [869918,39273] 0 2024-09-13T21:40:40.442 INFO:tasks.workunit.client.1.smithi116.stdout:9/168: dread - d2/f1d zero size 2024-09-13T21:40:40.443 INFO:tasks.workunit.client.1.smithi116.stdout:7/298: write f2 [698026,37797] 0 2024-09-13T21:40:40.445 INFO:tasks.workunit.client.1.smithi116.stdout:9/169: dread d2/d8/f11 [0,4194304] 0 2024-09-13T21:40:40.446 INFO:tasks.workunit.client.1.smithi116.stdout:5/327: mknod d7/d40/d53/c69 0 2024-09-13T21:40:40.447 INFO:tasks.workunit.client.1.smithi116.stdout:4/325: getdents d0/d56 0 2024-09-13T21:40:40.450 INFO:tasks.workunit.client.1.smithi116.stdout:6/273: mkdir d8/d10/d65 0 2024-09-13T21:40:40.453 INFO:tasks.workunit.client.1.smithi116.stdout:3/374: write d3/db/d20/d50/f84 [116309,105856] 0 2024-09-13T21:40:40.457 INFO:tasks.workunit.client.1.smithi116.stdout:7/299: creat d5/d9/db/f65 x:0 0 0 2024-09-13T21:40:40.457 INFO:tasks.workunit.client.1.smithi116.stdout:7/300: fdatasync d5/d9/d1c/d22/d24/d3a/f46 0 2024-09-13T21:40:40.459 INFO:tasks.workunit.client.1.smithi116.stdout:9/170: link d2/d10/c30 d2/d10/d14/c36 0 2024-09-13T21:40:40.459 INFO:tasks.workunit.client.1.smithi116.stdout:9/171: dread - d2/d10/d14/f31 zero size 2024-09-13T21:40:40.461 INFO:tasks.workunit.client.1.smithi116.stdout:5/328: mkdir d7/da/d5e/d65/d6a 0 2024-09-13T21:40:40.464 INFO:tasks.workunit.client.1.smithi116.stdout:4/326: creat d0/dd/d48/f5c x:0 0 0 2024-09-13T21:40:40.464 INFO:tasks.workunit.client.1.smithi116.stdout:4/327: fsync d0/dd/d13/f46 0 2024-09-13T21:40:40.464 INFO:tasks.workunit.client.1.smithi116.stdout:4/328: write d0/dd/f3f [578906,38296] 0 2024-09-13T21:40:40.464 INFO:tasks.workunit.client.1.smithi116.stdout:4/329: chown d0/l25 5 1 2024-09-13T21:40:40.465 INFO:tasks.workunit.client.1.smithi116.stdout:6/274: symlink d8/d15/l66 0 2024-09-13T21:40:40.466 INFO:tasks.workunit.client.1.smithi116.stdout:3/375: dread d3/db/d3d/d40/f4c [0,4194304] 0 2024-09-13T21:40:40.468 INFO:tasks.workunit.client.1.smithi116.stdout:7/301: mknod d5/d9/d27/d31/d38/c66 0 2024-09-13T21:40:40.468 INFO:tasks.workunit.client.1.smithi116.stdout:7/302: write d5/d9/db/f3c [8230367,118996] 0 2024-09-13T21:40:40.470 INFO:tasks.workunit.client.1.smithi116.stdout:9/172: truncate d2/f2d 1872904 0 2024-09-13T21:40:40.470 INFO:tasks.workunit.client.1.smithi116.stdout:9/173: fdatasync d2/d8/f1a 0 2024-09-13T21:40:40.473 INFO:tasks.workunit.client.1.smithi116.stdout:4/330: mkdir d0/d32/d5d 0 2024-09-13T21:40:40.479 INFO:tasks.workunit.client.1.smithi116.stdout:4/331: read d0/f8 [7598688,12086] 0 2024-09-13T21:40:40.479 INFO:tasks.workunit.client.1.smithi116.stdout:4/332: chown d0/dd/c50 3 1 2024-09-13T21:40:40.479 INFO:tasks.workunit.client.1.smithi116.stdout:4/333: dread - d0/d32/f49 zero size 2024-09-13T21:40:40.479 INFO:tasks.workunit.client.1.smithi116.stdout:4/334: chown d0/d56/d57 925 1 2024-09-13T21:40:40.480 INFO:tasks.workunit.client.1.smithi116.stdout:7/303: symlink d5/d9/l67 0 2024-09-13T21:40:40.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:40 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:40.491 INFO:tasks.workunit.client.1.smithi116.stdout:3/376: dwrite d3/db/d10/d1d/f75 [0,4194304] 0 2024-09-13T21:40:40.491 INFO:tasks.workunit.client.1.smithi116.stdout:3/377: fsync d3/db/d10/d1c/d34/d55/d57/f7a 0 2024-09-13T21:40:40.493 INFO:tasks.workunit.client.1.smithi116.stdout:7/304: rename d5/d9/d1c/d22/d24/d3a/l43 to d5/d9/d1c/d2e/l68 0 2024-09-13T21:40:40.499 INFO:tasks.workunit.client.1.smithi116.stdout:3/378: mknod d3/db/d26/c90 0 2024-09-13T21:40:40.499 INFO:tasks.workunit.client.1.smithi116.stdout:3/379: chown d3/db/d10/d1d/d5f/d6f/d71 1 1 2024-09-13T21:40:40.499 INFO:tasks.workunit.client.1.smithi116.stdout:3/380: read d3/db/d10/d1d/d5f/d6f/f80 [337140,17786] 0 2024-09-13T21:40:40.502 INFO:tasks.workunit.client.1.smithi116.stdout:7/305: rename d5/d9/d1c/c5c to d5/d9/db/d21/c69 0 2024-09-13T21:40:40.504 INFO:tasks.workunit.client.1.smithi116.stdout:3/381: link d3/f82 d3/db/d3d/f91 0 2024-09-13T21:40:40.504 INFO:tasks.workunit.client.1.smithi116.stdout:3/382: creat d3/db/d10/d1c/d63/f92 x:0 0 0 2024-09-13T21:40:40.504 INFO:tasks.workunit.client.1.smithi116.stdout:3/383: write d3/db/d20/d50/f84 [1479721,90075] 0 2024-09-13T21:40:40.504 INFO:tasks.workunit.client.1.smithi116.stdout:3/384: write d3/db/d10/d1d/f2d [227731,55263] 0 2024-09-13T21:40:40.505 INFO:tasks.workunit.client.1.smithi116.stdout:6/275: write d8/f16 [4498715,72918] 0 2024-09-13T21:40:40.509 INFO:tasks.workunit.client.1.smithi116.stdout:6/276: link d8/d10/d33/f4a d8/d10/d33/f67 0 2024-09-13T21:40:40.511 INFO:tasks.workunit.client.1.smithi116.stdout:3/385: unlink d3/db/d10/d1c/d63/f92 0 2024-09-13T21:40:40.513 INFO:tasks.workunit.client.1.smithi116.stdout:9/174: rmdir d2/d10 39 2024-09-13T21:40:40.513 INFO:tasks.workunit.client.1.smithi116.stdout:9/175: write d2/d10/f20 [980420,126560] 0 2024-09-13T21:40:40.514 INFO:tasks.workunit.client.1.smithi116.stdout:9/176: readlink d2/d8/lb 0 2024-09-13T21:40:40.514 INFO:tasks.workunit.client.1.smithi116.stdout:9/177: write d2/d10/f20 [1441294,79112] 0 2024-09-13T21:40:40.514 INFO:tasks.workunit.client.1.smithi116.stdout:9/178: mknod d2/d8/c37 0 2024-09-13T21:40:40.517 INFO:tasks.workunit.client.1.smithi116.stdout:9/179: mkdir d2/d10/d14/d38 0 2024-09-13T21:40:40.517 INFO:tasks.workunit.client.1.smithi116.stdout:9/180: chown d2/d8 11654278 1 2024-09-13T21:40:40.520 INFO:tasks.workunit.client.1.smithi116.stdout:9/181: dread d2/f3 [0,4194304] 0 2024-09-13T21:40:40.525 INFO:tasks.workunit.client.1.smithi116.stdout:9/182: unlink d2/d8/c28 0 2024-09-13T21:40:40.526 INFO:tasks.workunit.client.1.smithi116.stdout:9/183: truncate d2/d8/f33 490856 0 2024-09-13T21:40:40.526 INFO:tasks.workunit.client.1.smithi116.stdout:9/184: fsync d2/f4 0 2024-09-13T21:40:40.526 INFO:tasks.workunit.client.1.smithi116.stdout:9/185: truncate d2/d10/f20 2084287 0 2024-09-13T21:40:40.526 INFO:tasks.workunit.client.1.smithi116.stdout:7/306: dwrite d5/f16 [0,4194304] 0 2024-09-13T21:40:40.526 INFO:tasks.workunit.client.1.smithi116.stdout:7/307: truncate d5/d9/d1c/d37/f62 985290 0 2024-09-13T21:40:40.529 INFO:tasks.workunit.client.1.smithi116.stdout:9/186: dread d2/d10/d14/f21 [0,4194304] 0 2024-09-13T21:40:40.529 INFO:tasks.workunit.client.1.smithi116.stdout:9/187: truncate d2/f1d 661349 0 2024-09-13T21:40:40.531 INFO:tasks.workunit.client.1.smithi116.stdout:9/188: dread d2/d10/d14/f21 [0,4194304] 0 2024-09-13T21:40:40.533 INFO:tasks.workunit.client.1.smithi116.stdout:3/386: dwrite d3/db/d10/f15 [8388608,4194304] 0 2024-09-13T21:40:40.533 INFO:tasks.workunit.client.1.smithi116.stdout:6/277: dwrite d8/d10/f55 [0,4194304] 0 2024-09-13T21:40:40.534 INFO:tasks.workunit.client.1.smithi116.stdout:9/189: link d2/d10/d14/c25 d2/d10/c39 0 2024-09-13T21:40:40.537 INFO:tasks.workunit.client.1.smithi116.stdout:3/387: dread d3/db/d26/f28 [0,4194304] 0 2024-09-13T21:40:40.541 INFO:tasks.workunit.client.1.smithi116.stdout:9/190: dread d2/d8/f11 [0,4194304] 0 2024-09-13T21:40:40.547 INFO:tasks.workunit.client.1.smithi116.stdout:6/278: write d8/d10/d33/f67 [2665879,72204] 0 2024-09-13T21:40:40.547 INFO:tasks.workunit.client.1.smithi116.stdout:6/279: chown d8/fe 4728 1 2024-09-13T21:40:40.547 INFO:tasks.workunit.client.1.smithi116.stdout:3/388: dread d3/db/d10/d1c/d63/f64 [0,4194304] 0 2024-09-13T21:40:40.551 INFO:tasks.workunit.client.1.smithi116.stdout:6/280: creat d8/d15/d2e/d2f/d57/f68 x:0 0 0 2024-09-13T21:40:40.552 INFO:tasks.workunit.client.1.smithi116.stdout:3/389: mknod d3/db/d3d/d40/c93 0 2024-09-13T21:40:40.554 INFO:tasks.workunit.client.1.smithi116.stdout:3/390: rename d3/db/d10/d1d/f1e to d3/db/d10/d1d/d5f/f94 0 2024-09-13T21:40:40.554 INFO:tasks.workunit.client.1.smithi116.stdout:3/391: chown d3/db/d10/d1d/d5f/d7f/c88 1383 1 2024-09-13T21:40:40.555 INFO:tasks.workunit.client.1.smithi116.stdout:7/308: dwrite d5/f59 [0,4194304] 0 2024-09-13T21:40:40.555 INFO:tasks.workunit.client.1.smithi116.stdout:3/392: link d3/db/d3d/d40/c4f d3/db/d20/d50/c95 0 2024-09-13T21:40:40.558 INFO:tasks.workunit.client.1.smithi116.stdout:3/393: mkdir d3/db/d10/d1c/d34/d55/d96 0 2024-09-13T21:40:40.558 INFO:tasks.workunit.client.1.smithi116.stdout:6/281: dread d8/d10/d33/f3b [0,4194304] 0 2024-09-13T21:40:40.559 INFO:tasks.workunit.client.1.smithi116.stdout:7/309: getdents d5/d9 0 2024-09-13T21:40:40.559 INFO:tasks.workunit.client.1.smithi116.stdout:7/310: fdatasync d5/d9/f3d 0 2024-09-13T21:40:40.561 INFO:tasks.workunit.client.1.smithi116.stdout:3/394: symlink d3/db/d26/l97 0 2024-09-13T21:40:40.563 INFO:tasks.workunit.client.1.smithi116.stdout:7/311: write d5/f8 [3592222,123268] 0 2024-09-13T21:40:40.567 INFO:tasks.workunit.client.1.smithi116.stdout:7/312: truncate d5/f16 2468019 0 2024-09-13T21:40:40.569 INFO:tasks.workunit.client.1.smithi116.stdout:7/313: creat d5/d9/d27/d31/d38/f6a x:0 0 0 2024-09-13T21:40:40.569 INFO:tasks.workunit.client.1.smithi116.stdout:6/282: dread d8/fe [0,4194304] 0 2024-09-13T21:40:40.571 INFO:tasks.workunit.client.1.smithi116.stdout:7/314: mkdir d5/d9/d1c/d22/d24/d6b 0 2024-09-13T21:40:40.571 INFO:tasks.workunit.client.1.smithi116.stdout:7/315: chown d5/c2c 25 1 2024-09-13T21:40:40.580 INFO:tasks.workunit.client.1.smithi116.stdout:7/316: write d5/d9/db/f45 [2559770,53042] 0 2024-09-13T21:40:40.580 INFO:tasks.workunit.client.1.smithi116.stdout:7/317: truncate f2 13304379 0 2024-09-13T21:40:40.587 INFO:tasks.workunit.client.1.smithi116.stdout:7/318: read d5/f59 [7696284,80387] 0 2024-09-13T21:40:40.589 INFO:tasks.workunit.client.1.smithi116.stdout:7/319: truncate d5/d9/f14 3992554 0 2024-09-13T21:40:40.591 INFO:tasks.workunit.client.1.smithi116.stdout:7/320: truncate d5/f8 5877540 0 2024-09-13T21:40:40.592 INFO:tasks.workunit.client.1.smithi116.stdout:7/321: truncate d5/d9/d1c/f3b 2412991 0 2024-09-13T21:40:40.595 INFO:tasks.workunit.client.1.smithi116.stdout:7/322: rename d5/d9/db/f65 to d5/f6c 0 2024-09-13T21:40:40.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:40 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:40.612 INFO:tasks.workunit.client.1.smithi116.stdout:7/323: dread d5/d9/f14 [0,4194304] 0 2024-09-13T21:40:40.612 INFO:tasks.workunit.client.1.smithi116.stdout:7/324: write d5/f35 [130253,26529] 0 2024-09-13T21:40:40.621 INFO:tasks.workunit.client.1.smithi116.stdout:7/325: dread f2 [0,4194304] 0 2024-09-13T21:40:40.622 INFO:tasks.workunit.client.1.smithi116.stdout:7/326: link d5/d9/db/c55 d5/d9/d27/c6d 0 2024-09-13T21:40:40.624 INFO:tasks.workunit.client.1.smithi116.stdout:7/327: mkdir d5/d9/db/d21/d6e 0 2024-09-13T21:40:40.624 INFO:tasks.workunit.client.1.smithi116.stdout:7/328: chown d5/d9/d1c/f3b 706 1 2024-09-13T21:40:40.624 INFO:tasks.workunit.client.1.smithi116.stdout:7/329: chown d5/d9/db/ff 6 1 2024-09-13T21:40:40.625 INFO:tasks.workunit.client.1.smithi116.stdout:7/330: mkdir d5/d9/db/d21/d6e/d6f 0 2024-09-13T21:40:40.646 INFO:tasks.workunit.client.1.smithi116.stdout:7/331: dwrite d5/f6c [0,4194304] 0 2024-09-13T21:40:40.649 INFO:tasks.workunit.client.1.smithi116.stdout:7/332: truncate d5/d9/d1c/d37/f62 327488 0 2024-09-13T21:40:40.649 INFO:tasks.workunit.client.1.smithi116.stdout:7/333: readlink d5/d9/d1c/d22/l2f 0 2024-09-13T21:40:40.650 INFO:tasks.workunit.client.1.smithi116.stdout:7/334: mkdir d5/d9/db/d21/d6e/d6f/d70 0 2024-09-13T21:40:40.650 INFO:tasks.workunit.client.1.smithi116.stdout:7/335: dread - d5/d9/d1c/d22/d24/f58 zero size 2024-09-13T21:40:40.677 INFO:tasks.workunit.client.1.smithi116.stdout:7/336: dwrite d5/d9/db/f12 [4194304,4194304] 0 2024-09-13T21:40:40.678 INFO:tasks.workunit.client.1.smithi116.stdout:7/337: dread d5/d9/db/d21/f3e [0,4194304] 0 2024-09-13T21:40:40.681 INFO:tasks.workunit.client.1.smithi116.stdout:7/338: creat d5/d9/d27/d31/f71 x:0 0 0 2024-09-13T21:40:40.682 INFO:tasks.workunit.client.1.smithi116.stdout:7/339: getdents d5/d9/d1c/d22/d24/d3a 0 2024-09-13T21:40:40.683 INFO:tasks.workunit.client.1.smithi116.stdout:7/340: stat d5/d9/d1c/c57 0 2024-09-13T21:40:40.695 INFO:tasks.workunit.client.1.smithi116.stdout:7/341: dread d5/d9/f33 [0,4194304] 0 2024-09-13T21:40:40.695 INFO:tasks.workunit.client.1.smithi116.stdout:7/342: chown d5/d9/db/d21 38 1 2024-09-13T21:40:40.695 INFO:tasks.workunit.client.1.smithi116.stdout:7/343: stat d5/d9/db/d21/f63 0 2024-09-13T21:40:40.695 INFO:tasks.workunit.client.1.smithi116.stdout:7/344: dread - d5/d9/d27/d31/f71 zero size 2024-09-13T21:40:40.695 INFO:tasks.workunit.client.1.smithi116.stdout:7/345: dread - d5/d9/db/d21/f63 zero size 2024-09-13T21:40:40.732 INFO:tasks.workunit.client.1.smithi116.stdout:8/194: sync 2024-09-13T21:40:40.732 INFO:tasks.workunit.client.1.smithi116.stdout:1/168: sync 2024-09-13T21:40:40.733 INFO:tasks.workunit.client.1.smithi116.stdout:1/169: creat d4/f33 x:0 0 0 2024-09-13T21:40:40.735 INFO:tasks.workunit.client.1.smithi116.stdout:1/170: rmdir d4/d23 39 2024-09-13T21:40:40.735 INFO:tasks.workunit.client.1.smithi116.stdout:1/171: fdatasync d4/d14/f19 0 2024-09-13T21:40:40.736 INFO:tasks.workunit.client.1.smithi116.stdout:8/195: dread d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:40.736 INFO:tasks.workunit.client.1.smithi116.stdout:8/196: chown d2/l38 835095 1 2024-09-13T21:40:40.736 INFO:tasks.workunit.client.1.smithi116.stdout:8/197: getdents d2/d10/d3e 0 2024-09-13T21:40:40.736 INFO:tasks.workunit.client.1.smithi116.stdout:8/198: stat d2/d10/d19/d3a/f3b 0 2024-09-13T21:40:40.738 INFO:tasks.workunit.client.1.smithi116.stdout:8/199: rename d2/d10/d19/c1a to d2/d10/d37/c40 0 2024-09-13T21:40:40.749 INFO:tasks.workunit.client.1.smithi116.stdout:8/200: dread d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:40.751 INFO:tasks.workunit.client.1.smithi116.stdout:8/201: dread d2/d10/f2c [0,4194304] 0 2024-09-13T21:40:40.753 INFO:tasks.workunit.client.1.smithi116.stdout:8/202: dread d2/d10/f2c [0,4194304] 0 2024-09-13T21:40:40.754 INFO:tasks.workunit.client.1.smithi116.stdout:8/203: unlink d2/f13 0 2024-09-13T21:40:40.754 INFO:tasks.workunit.client.1.smithi116.stdout:1/172: dwrite d4/ff [4194304,4194304] 0 2024-09-13T21:40:40.755 INFO:tasks.workunit.client.1.smithi116.stdout:1/173: truncate d4/f17 2551750 0 2024-09-13T21:40:40.783 INFO:tasks.workunit.client.1.smithi116.stdout:8/204: dwrite d2/d10/f11 [4194304,4194304] 0 2024-09-13T21:40:40.783 INFO:tasks.workunit.client.1.smithi116.stdout:8/205: readlink d2/d10/d19/d21/d22/l26 0 2024-09-13T21:40:40.783 INFO:tasks.workunit.client.1.smithi116.stdout:1/174: dwrite d4/f8 [0,4194304] 0 2024-09-13T21:40:40.785 INFO:tasks.workunit.client.1.smithi116.stdout:1/175: dread d4/f10 [0,4194304] 0 2024-09-13T21:40:40.786 INFO:tasks.workunit.client.1.smithi116.stdout:1/176: link d4/c21 d4/d14/d2a/c34 0 2024-09-13T21:40:40.787 INFO:tasks.workunit.client.1.smithi116.stdout:8/206: dread d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:40.787 INFO:tasks.workunit.client.1.smithi116.stdout:8/207: write d2/d10/d19/d3a/f3b [271700,42971] 0 2024-09-13T21:40:40.787 INFO:tasks.workunit.client.1.smithi116.stdout:8/208: rename d2/d27 to d2/d27/d41 22 2024-09-13T21:40:40.787 INFO:tasks.workunit.client.1.smithi116.stdout:1/177: symlink d4/l35 0 2024-09-13T21:40:40.787 INFO:tasks.workunit.client.1.smithi116.stdout:1/178: write d4/fa [2581404,127240] 0 2024-09-13T21:40:40.788 INFO:tasks.workunit.client.1.smithi116.stdout:1/179: symlink d4/d23/l36 0 2024-09-13T21:40:40.788 INFO:tasks.workunit.client.1.smithi116.stdout:1/180: chown d4/c1a 97110179 1 2024-09-13T21:40:40.788 INFO:tasks.workunit.client.1.smithi116.stdout:1/181: creat d4/f37 x:0 0 0 2024-09-13T21:40:40.789 INFO:tasks.workunit.client.1.smithi116.stdout:1/182: creat d4/d14/d2a/d2c/f38 x:0 0 0 2024-09-13T21:40:40.789 INFO:tasks.workunit.client.1.smithi116.stdout:1/183: chown d4/c5 5112653 1 2024-09-13T21:40:40.790 INFO:tasks.workunit.client.1.smithi116.stdout:1/184: rename d4/d23/l2e to d4/d14/d2a/d2c/d2f/l39 0 2024-09-13T21:40:40.791 INFO:tasks.workunit.client.1.smithi116.stdout:1/185: mkdir d4/d14/d2a/d3a 0 2024-09-13T21:40:40.792 INFO:tasks.workunit.client.1.smithi116.stdout:1/186: unlink d4/d14/c32 0 2024-09-13T21:40:40.795 INFO:tasks.workunit.client.1.smithi116.stdout:8/209: write d2/d10/f11 [6976388,30764] 0 2024-09-13T21:40:40.795 INFO:tasks.workunit.client.1.smithi116.stdout:8/210: chown d2/d10/f3f 0 1 2024-09-13T21:40:40.795 INFO:tasks.workunit.client.1.smithi116.stdout:8/211: write d2/d10/d19/d3a/f3b [535336,38772] 0 2024-09-13T21:40:40.797 INFO:tasks.workunit.client.1.smithi116.stdout:1/187: getdents d4/d14/d2a/d2c/d2f 0 2024-09-13T21:40:40.797 INFO:tasks.workunit.client.1.smithi116.stdout:1/188: creat d4/d14/d2a/d2c/f3b x:0 0 0 2024-09-13T21:40:40.797 INFO:tasks.workunit.client.1.smithi116.stdout:8/212: dread d2/d10/f2c [0,4194304] 0 2024-09-13T21:40:40.797 INFO:tasks.workunit.client.1.smithi116.stdout:8/213: chown d2/l12 8212794 1 2024-09-13T21:40:40.798 INFO:tasks.workunit.client.1.smithi116.stdout:1/189: mknod d4/d23/c3c 0 2024-09-13T21:40:40.799 INFO:tasks.workunit.client.1.smithi116.stdout:1/190: mknod d4/d23/c3d 0 2024-09-13T21:40:40.800 INFO:tasks.workunit.client.1.smithi116.stdout:8/214: mkdir d2/d10/d19/d42 0 2024-09-13T21:40:40.801 INFO:tasks.workunit.client.1.smithi116.stdout:1/191: rmdir d4/d14/d2a/d3a 0 2024-09-13T21:40:40.802 INFO:tasks.workunit.client.1.smithi116.stdout:8/215: mkdir d2/d27/d43 0 2024-09-13T21:40:40.802 INFO:tasks.workunit.client.1.smithi116.stdout:1/192: symlink d4/d14/d2a/d2c/d2f/l3e 0 2024-09-13T21:40:40.803 INFO:tasks.workunit.client.1.smithi116.stdout:1/193: unlink d4/d14/f29 0 2024-09-13T21:40:40.804 INFO:tasks.workunit.client.1.smithi116.stdout:1/194: fdatasync d4/f1b 0 2024-09-13T21:40:40.804 INFO:tasks.workunit.client.1.smithi116.stdout:1/195: mknod d4/d14/d2a/d2c/d2f/c3f 0 2024-09-13T21:40:40.804 INFO:tasks.workunit.client.1.smithi116.stdout:1/196: creat d4/d14/d2a/d2c/f40 x:0 0 0 2024-09-13T21:40:40.804 INFO:tasks.workunit.client.1.smithi116.stdout:1/197: write d4/f10 [608959,89045] 0 2024-09-13T21:40:40.805 INFO:tasks.workunit.client.1.smithi116.stdout:8/216: dread d2/d10/d19/f1d [0,4194304] 0 2024-09-13T21:40:40.809 INFO:tasks.workunit.client.1.smithi116.stdout:1/198: write f1 [311101,14755] 0 2024-09-13T21:40:40.810 INFO:tasks.workunit.client.1.smithi116.stdout:1/199: mkdir d4/d14/d41 0 2024-09-13T21:40:40.810 INFO:tasks.workunit.client.1.smithi116.stdout:1/200: chown d4/d14/l26 879868 1 2024-09-13T21:40:40.812 INFO:tasks.workunit.client.1.smithi116.stdout:1/201: creat d4/d14/d2a/f42 x:0 0 0 2024-09-13T21:40:40.812 INFO:tasks.workunit.client.1.smithi116.stdout:1/202: read - d4/d23/f27 zero size 2024-09-13T21:40:40.812 INFO:tasks.workunit.client.1.smithi116.stdout:1/203: dread - d4/f20 zero size 2024-09-13T21:40:40.812 INFO:tasks.workunit.client.1.smithi116.stdout:1/204: write d4/f17 [875332,91844] 0 2024-09-13T21:40:40.812 INFO:tasks.workunit.client.1.smithi116.stdout:1/205: dread - d4/d23/f2b zero size 2024-09-13T21:40:40.812 INFO:tasks.workunit.client.1.smithi116.stdout:1/206: mknod d4/d23/c43 0 2024-09-13T21:40:40.814 INFO:tasks.workunit.client.1.smithi116.stdout:1/207: mkdir d4/d14/d44 0 2024-09-13T21:40:40.814 INFO:tasks.workunit.client.1.smithi116.stdout:1/208: write d4/f37 [61632,124884] 0 2024-09-13T21:40:40.814 INFO:tasks.workunit.client.1.smithi116.stdout:1/209: read d4/d14/f24 [193229,76694] 0 2024-09-13T21:40:40.814 INFO:tasks.workunit.client.1.smithi116.stdout:8/217: truncate d2/d10/f11 492194 0 2024-09-13T21:40:40.815 INFO:tasks.workunit.client.1.smithi116.stdout:8/218: chown d2/d10/d19/l30 97049138 1 2024-09-13T21:40:40.815 INFO:tasks.workunit.client.1.smithi116.stdout:1/210: mknod d4/d14/d2a/d2c/d2f/c45 0 2024-09-13T21:40:40.815 INFO:tasks.workunit.client.1.smithi116.stdout:1/211: write d4/d14/f24 [217466,4827] 0 2024-09-13T21:40:40.816 INFO:tasks.workunit.client.1.smithi116.stdout:1/212: symlink d4/d14/d44/l46 0 2024-09-13T21:40:40.819 INFO:tasks.workunit.client.1.smithi116.stdout:8/219: dread d2/d10/d19/d3a/f3b [0,4194304] 0 2024-09-13T21:40:40.819 INFO:tasks.workunit.client.1.smithi116.stdout:1/213: fsync d4/f17 0 2024-09-13T21:40:40.820 INFO:tasks.workunit.client.1.smithi116.stdout:8/220: link d2/d10/d19/d21/c2b d2/d10/d19/d21/c44 0 2024-09-13T21:40:40.822 INFO:tasks.workunit.client.1.smithi116.stdout:1/214: symlink d4/l47 0 2024-09-13T21:40:40.823 INFO:tasks.workunit.client.1.smithi116.stdout:8/221: rmdir d2/d27 39 2024-09-13T21:40:40.824 INFO:tasks.workunit.client.1.smithi116.stdout:1/215: rename d4/d14/f19 to d4/d14/f48 0 2024-09-13T21:40:40.825 INFO:tasks.workunit.client.1.smithi116.stdout:1/216: creat d4/d14/d41/f49 x:0 0 0 2024-09-13T21:40:40.826 INFO:tasks.workunit.client.1.smithi116.stdout:1/217: dread - d4/d14/d2a/d2c/f40 zero size 2024-09-13T21:40:40.826 INFO:tasks.workunit.client.1.smithi116.stdout:1/218: creat d4/d14/d2a/d2c/f4a x:0 0 0 2024-09-13T21:40:40.826 INFO:tasks.workunit.client.1.smithi116.stdout:1/219: fdatasync d4/d14/f48 0 2024-09-13T21:40:40.828 INFO:tasks.workunit.client.1.smithi116.stdout:1/220: creat d4/d14/d2a/d2c/d2f/f4b x:0 0 0 2024-09-13T21:40:40.847 INFO:tasks.workunit.client.1.smithi116.stdout:8/222: dwrite d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:40.847 INFO:tasks.workunit.client.1.smithi116.stdout:1/221: dwrite d4/f17 [0,4194304] 0 2024-09-13T21:40:40.849 INFO:tasks.workunit.client.1.smithi116.stdout:1/222: rename d4/d14/d2a/d2c/d2f/l3e to d4/d14/d2a/l4c 0 2024-09-13T21:40:40.849 INFO:tasks.workunit.client.1.smithi116.stdout:1/223: write d4/d14/d2a/f42 [971312,49964] 0 2024-09-13T21:40:40.850 INFO:tasks.workunit.client.1.smithi116.stdout:1/224: creat d4/d14/d41/f4d x:0 0 0 2024-09-13T21:40:40.850 INFO:tasks.workunit.client.1.smithi116.stdout:8/223: unlink d2/lb 0 2024-09-13T21:40:40.851 INFO:tasks.workunit.client.1.smithi116.stdout:1/225: symlink d4/d14/d2a/d2c/d2f/l4e 0 2024-09-13T21:40:40.856 INFO:tasks.workunit.client.1.smithi116.stdout:1/226: fdatasync d4/f10 0 2024-09-13T21:40:40.856 INFO:tasks.workunit.client.1.smithi116.stdout:1/227: chown f1 464395649 1 2024-09-13T21:40:40.856 INFO:tasks.workunit.client.1.smithi116.stdout:1/228: chown d4/d14/d2a/l4c 5072753 1 2024-09-13T21:40:40.861 INFO:tasks.workunit.client.1.smithi116.stdout:8/224: dread d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:40.861 INFO:tasks.workunit.client.1.smithi116.stdout:8/225: chown d2/d10/d37 3 1 2024-09-13T21:40:40.861 INFO:tasks.workunit.client.1.smithi116.stdout:8/226: chown d2/f8 343 1 2024-09-13T21:40:40.865 INFO:tasks.workunit.client.1.smithi116.stdout:1/229: write f1 [1523199,24631] 0 2024-09-13T21:40:40.882 INFO:tasks.workunit.client.1.smithi116.stdout:8/227: dwrite d2/d10/d19/f1d [0,4194304] 0 2024-09-13T21:40:40.882 INFO:tasks.workunit.client.1.smithi116.stdout:8/228: stat d2/d10/d19/d21/d22/l36 0 2024-09-13T21:40:40.884 INFO:tasks.workunit.client.1.smithi116.stdout:8/229: mkdir d2/d10/d19/d42/d45 0 2024-09-13T21:40:40.884 INFO:tasks.workunit.client.1.smithi116.stdout:1/230: dwrite d4/f33 [0,4194304] 0 2024-09-13T21:40:40.884 INFO:tasks.workunit.client.1.smithi116.stdout:1/231: write d4/d23/f2b [624652,95103] 0 2024-09-13T21:40:40.884 INFO:tasks.workunit.client.1.smithi116.stdout:1/232: creat d4/d14/f4f x:0 0 0 2024-09-13T21:40:40.884 INFO:tasks.workunit.client.1.smithi116.stdout:1/233: chown d4/ld 53092286 1 2024-09-13T21:40:40.884 INFO:tasks.workunit.client.1.smithi116.stdout:1/234: write d4/d14/d2a/d2c/f38 [361759,42098] 0 2024-09-13T21:40:40.884 INFO:tasks.workunit.client.1.smithi116.stdout:8/230: mkdir d2/d27/d43/d46 0 2024-09-13T21:40:40.886 INFO:tasks.workunit.client.1.smithi116.stdout:1/235: symlink d4/l50 0 2024-09-13T21:40:40.886 INFO:tasks.workunit.client.1.smithi116.stdout:1/236: dread - d4/d14/f4f zero size 2024-09-13T21:40:40.887 INFO:tasks.workunit.client.1.smithi116.stdout:8/231: creat d2/d10/d19/d21/f47 x:0 0 0 2024-09-13T21:40:40.889 INFO:tasks.workunit.client.1.smithi116.stdout:8/232: mknod d2/c48 0 2024-09-13T21:40:40.889 INFO:tasks.workunit.client.1.smithi116.stdout:8/233: dread - d2/d10/d19/d21/f47 zero size 2024-09-13T21:40:40.889 INFO:tasks.workunit.client.1.smithi116.stdout:8/234: chown d2/d10/f3f 228476168 1 2024-09-13T21:40:40.891 INFO:tasks.workunit.client.1.smithi116.stdout:8/235: getdents d2/d10 0 2024-09-13T21:40:40.892 INFO:tasks.workunit.client.1.smithi116.stdout:8/236: symlink d2/d10/l49 0 2024-09-13T21:40:40.893 INFO:tasks.workunit.client.1.smithi116.stdout:8/237: chown d2/d10/l3d 8296 1 2024-09-13T21:40:40.895 INFO:tasks.workunit.client.1.smithi116.stdout:8/238: chown d2/d10/d19/f1d 99228 1 2024-09-13T21:40:40.895 INFO:tasks.workunit.client.1.smithi116.stdout:8/239: readlink d2/d10/l49 0 2024-09-13T21:40:40.896 INFO:tasks.workunit.client.1.smithi116.stdout:8/240: creat d2/d10/d19/d21/d22/f4a x:0 0 0 2024-09-13T21:40:40.905 INFO:tasks.workunit.client.1.smithi116.stdout:1/237: dwrite d4/f17 [0,4194304] 0 2024-09-13T21:40:40.908 INFO:tasks.workunit.client.1.smithi116.stdout:8/241: dread d2/f2f [0,4194304] 0 2024-09-13T21:40:40.911 INFO:tasks.workunit.client.1.smithi116.stdout:1/238: rename d4/fa to d4/d23/f51 0 2024-09-13T21:40:40.912 INFO:tasks.workunit.client.1.smithi116.stdout:8/242: getdents d2/d10/d3e 0 2024-09-13T21:40:40.917 INFO:tasks.workunit.client.1.smithi116.stdout:8/243: mkdir d2/d10/d4b 0 2024-09-13T21:40:40.917 INFO:tasks.workunit.client.1.smithi116.stdout:8/244: chown d2/d10/d19/d42 290 1 2024-09-13T21:40:40.918 INFO:tasks.workunit.client.1.smithi116.stdout:1/239: rename d4/d14/d2a/d2c to d4/d14/d52 0 2024-09-13T21:40:40.939 INFO:tasks.workunit.client.1.smithi116.stdout:8/245: dwrite d2/d10/d19/d21/f47 [0,4194304] 0 2024-09-13T21:40:40.939 INFO:tasks.workunit.client.1.smithi116.stdout:1/240: dwrite d4/d14/d52/f4a [0,4194304] 0 2024-09-13T21:40:40.941 INFO:tasks.workunit.client.1.smithi116.stdout:8/246: mkdir d2/d10/d19/d3a/d4c 0 2024-09-13T21:40:40.943 INFO:tasks.workunit.client.1.smithi116.stdout:1/241: mknod d4/d14/d52/d2f/c53 0 2024-09-13T21:40:40.945 INFO:tasks.workunit.client.1.smithi116.stdout:1/242: unlink d4/f17 0 2024-09-13T21:40:40.945 INFO:tasks.workunit.client.1.smithi116.stdout:1/243: fsync f3 0 2024-09-13T21:40:40.946 INFO:tasks.workunit.client.1.smithi116.stdout:8/247: symlink d2/l4d 0 2024-09-13T21:40:40.947 INFO:tasks.workunit.client.1.smithi116.stdout:8/248: mkdir d2/d27/d43/d46/d4e 0 2024-09-13T21:40:40.954 INFO:tasks.workunit.client.1.smithi116.stdout:1/244: write d4/f33 [2242190,64878] 0 2024-09-13T21:40:40.955 INFO:tasks.workunit.client.1.smithi116.stdout:0/227: sync 2024-09-13T21:40:40.956 INFO:tasks.workunit.client.1.smithi116.stdout:1/245: mknod d4/d14/d41/c54 0 2024-09-13T21:40:40.956 INFO:tasks.workunit.client.1.smithi116.stdout:0/228: mkdir d2/dc/d47 0 2024-09-13T21:40:40.956 INFO:tasks.workunit.client.1.smithi116.stdout:1/246: read - d4/d14/d52/d2f/f4b zero size 2024-09-13T21:40:40.957 INFO:tasks.workunit.client.1.smithi116.stdout:0/229: rename d2/c3a to d2/dc/c48 0 2024-09-13T21:40:40.958 INFO:tasks.workunit.client.1.smithi116.stdout:1/247: rename d4/f33 to d4/d14/d44/f55 0 2024-09-13T21:40:40.958 INFO:tasks.workunit.client.1.smithi116.stdout:1/248: write d4/d14/d52/f3b [254940,19898] 0 2024-09-13T21:40:40.960 INFO:tasks.workunit.client.1.smithi116.stdout:0/230: rename d2/d5/fd to d2/dc/d12/f49 0 2024-09-13T21:40:40.960 INFO:tasks.workunit.client.1.smithi116.stdout:0/231: creat d2/d5/f4a x:0 0 0 2024-09-13T21:40:40.961 INFO:tasks.workunit.client.1.smithi116.stdout:0/232: getdents d2/d5/d3e 0 2024-09-13T21:40:40.962 INFO:tasks.workunit.client.1.smithi116.stdout:0/233: rename d2/fb to d2/dc/d47/f4b 0 2024-09-13T21:40:40.962 INFO:tasks.workunit.client.1.smithi116.stdout:0/234: fsync d2/d5/f1f 0 2024-09-13T21:40:40.963 INFO:tasks.workunit.client.1.smithi116.stdout:0/235: symlink d2/dc/d12/l4c 0 2024-09-13T21:40:40.965 INFO:tasks.workunit.client.1.smithi116.stdout:0/236: rename d2/d5/f9 to d2/dc/d47/f4d 0 2024-09-13T21:40:40.965 INFO:tasks.workunit.client.1.smithi116.stdout:0/237: chown d2/f3f 29 1 2024-09-13T21:40:40.965 INFO:tasks.workunit.client.1.smithi116.stdout:0/238: chown d2/dc/d12/d28/f32 87 1 2024-09-13T21:40:40.967 INFO:tasks.workunit.client.1.smithi116.stdout:0/239: dread d2/f38 [0,4194304] 0 2024-09-13T21:40:40.967 INFO:tasks.workunit.client.1.smithi116.stdout:0/240: readlink d2/dc/d12/d28/l30 0 2024-09-13T21:40:40.967 INFO:tasks.workunit.client.1.smithi116.stdout:1/249: dread d4/f1b [0,4194304] 0 2024-09-13T21:40:40.968 INFO:tasks.workunit.client.1.smithi116.stdout:1/250: mkdir d4/d23/d56 0 2024-09-13T21:40:40.969 INFO:tasks.workunit.client.1.smithi116.stdout:1/251: mkdir d4/d23/d57 0 2024-09-13T21:40:40.981 INFO:tasks.workunit.client.1.smithi116.stdout:0/241: dwrite d2/d5/f27 [0,4194304] 0 2024-09-13T21:40:40.985 INFO:tasks.workunit.client.1.smithi116.stdout:0/242: rename d2/dc/d12/d28/c3c to d2/dc/c4e 0 2024-09-13T21:40:40.985 INFO:tasks.workunit.client.1.smithi116.stdout:1/252: truncate d4/d14/d44/f55 732663 0 2024-09-13T21:40:40.986 INFO:tasks.workunit.client.1.smithi116.stdout:0/243: symlink d2/dc/d12/d28/l4f 0 2024-09-13T21:40:40.993 INFO:tasks.workunit.client.1.smithi116.stdout:0/244: dread d2/d5/f16 [0,4194304] 0 2024-09-13T21:40:40.997 INFO:tasks.workunit.client.1.smithi116.stdout:1/253: write d4/f8 [1339597,4429] 0 2024-09-13T21:40:40.998 INFO:tasks.workunit.client.1.smithi116.stdout:1/254: mknod d4/d23/d57/c58 0 2024-09-13T21:40:40.999 INFO:tasks.workunit.client.1.smithi116.stdout:1/255: truncate f1 2846178 0 2024-09-13T21:40:41.001 INFO:tasks.workunit.client.1.smithi116.stdout:1/256: symlink d4/d14/d44/l59 0 2024-09-13T21:40:41.001 INFO:tasks.workunit.client.1.smithi116.stdout:1/257: fsync d4/d14/f48 0 2024-09-13T21:40:41.002 INFO:tasks.workunit.client.1.smithi116.stdout:1/258: rename d4/d14/d44/l59 to d4/d14/d52/l5a 0 2024-09-13T21:40:41.002 INFO:tasks.workunit.client.1.smithi116.stdout:0/245: write d2/dc/f31 [449750,88880] 0 2024-09-13T21:40:41.004 INFO:tasks.workunit.client.1.smithi116.stdout:1/259: mknod d4/d23/d56/c5b 0 2024-09-13T21:40:41.005 INFO:tasks.workunit.client.1.smithi116.stdout:1/260: dread - d4/d14/d41/f4d zero size 2024-09-13T21:40:41.022 INFO:tasks.workunit.client.1.smithi116.stdout:1/261: dwrite d4/f10 [0,4194304] 0 2024-09-13T21:40:41.022 INFO:tasks.workunit.client.1.smithi116.stdout:0/246: dwrite d2/f38 [0,4194304] 0 2024-09-13T21:40:41.022 INFO:tasks.workunit.client.1.smithi116.stdout:1/262: chown d4/d14/d52/d2f/f4b 55 1 2024-09-13T21:40:41.022 INFO:tasks.workunit.client.1.smithi116.stdout:1/263: write d4/d14/d41/f49 [979196,130125] 0 2024-09-13T21:40:41.103 INFO:tasks.workunit.client.1.smithi116.stdout:2/254: sync 2024-09-13T21:40:41.103 INFO:tasks.workunit.client.1.smithi116.stdout:2/255: fsync d0/d7/d2b/d2c/f42 0 2024-09-13T21:40:41.103 INFO:tasks.workunit.client.1.smithi116.stdout:2/256: chown d0/d5 6548504 1 2024-09-13T21:40:41.103 INFO:tasks.workunit.client.1.smithi116.stdout:2/257: chown d0/d7/d2b/d2c/f52 7185 1 2024-09-13T21:40:41.120 INFO:tasks.workunit.client.1.smithi116.stdout:2/258: dwrite d0/d5/f4b [0,4194304] 0 2024-09-13T21:40:41.120 INFO:tasks.workunit.client.1.smithi116.stdout:2/259: chown d0/d5/f4b 201400206 1 2024-09-13T21:40:41.120 INFO:tasks.workunit.client.1.smithi116.stdout:2/260: creat d0/d7/d2b/d2c/f5c x:0 0 0 2024-09-13T21:40:41.123 INFO:tasks.workunit.client.1.smithi116.stdout:2/261: truncate d0/d7/d2d/f34 365040 0 2024-09-13T21:40:41.123 INFO:tasks.workunit.client.1.smithi116.stdout:2/262: write d0/d7/f24 [946017,67695] 0 2024-09-13T21:40:41.181 INFO:tasks.workunit.client.1.smithi116.stdout:9/191: sync 2024-09-13T21:40:41.181 INFO:tasks.workunit.client.1.smithi116.stdout:6/283: sync 2024-09-13T21:40:41.181 INFO:tasks.workunit.client.1.smithi116.stdout:3/395: sync 2024-09-13T21:40:41.181 INFO:tasks.workunit.client.1.smithi116.stdout:5/329: sync 2024-09-13T21:40:41.181 INFO:tasks.workunit.client.1.smithi116.stdout:4/335: sync 2024-09-13T21:40:41.182 INFO:tasks.workunit.client.1.smithi116.stdout:7/346: sync 2024-09-13T21:40:41.182 INFO:tasks.workunit.client.1.smithi116.stdout:9/192: fdatasync d2/d10/f2a 0 2024-09-13T21:40:41.182 INFO:tasks.workunit.client.1.smithi116.stdout:7/347: dread - d5/d9/d1c/d22/d24/f58 zero size 2024-09-13T21:40:41.182 INFO:tasks.workunit.client.1.smithi116.stdout:3/396: write d3/db/d10/d1d/d2f/d61/f2a [4767192,11692] 0 2024-09-13T21:40:41.182 INFO:tasks.workunit.client.1.smithi116.stdout:6/284: creat d8/d15/d2e/f69 x:0 0 0 2024-09-13T21:40:41.182 INFO:tasks.workunit.client.1.smithi116.stdout:6/285: dread - d8/d10/f44 zero size 2024-09-13T21:40:41.182 INFO:tasks.workunit.client.1.smithi116.stdout:6/286: write d8/d15/d2e/d2f/d38/f45 [498640,5969] 0 2024-09-13T21:40:41.184 INFO:tasks.workunit.client.1.smithi116.stdout:9/193: dread d2/f3 [0,4194304] 0 2024-09-13T21:40:41.185 INFO:tasks.workunit.client.1.smithi116.stdout:5/330: symlink d7/da/d5e/d65/l6b 0 2024-09-13T21:40:41.185 INFO:tasks.workunit.client.1.smithi116.stdout:5/331: truncate d7/f5d 1148792 0 2024-09-13T21:40:41.185 INFO:tasks.workunit.client.1.smithi116.stdout:5/332: readlink d7/da/d5e/l5f 0 2024-09-13T21:40:41.187 INFO:tasks.workunit.client.1.smithi116.stdout:7/348: mkdir d5/d9/d1c/d22/d24/d6b/d72 0 2024-09-13T21:40:41.187 INFO:tasks.workunit.client.1.smithi116.stdout:3/397: symlink d3/db/d20/d50/l98 0 2024-09-13T21:40:41.188 INFO:tasks.workunit.client.1.smithi116.stdout:3/398: truncate d3/db/d10/d1d/d2f/f38 5229710 0 2024-09-13T21:40:41.190 INFO:tasks.workunit.client.1.smithi116.stdout:3/399: mkdir d3/db/d10/d99 0 2024-09-13T21:40:41.190 INFO:tasks.workunit.client.1.smithi116.stdout:3/400: chown d3/f9 6 1 2024-09-13T21:40:41.192 INFO:tasks.workunit.client.1.smithi116.stdout:5/333: mknod d7/c6c 0 2024-09-13T21:40:41.193 INFO:tasks.workunit.client.1.smithi116.stdout:7/349: dread d5/d9/f14 [0,4194304] 0 2024-09-13T21:40:41.193 INFO:tasks.workunit.client.1.smithi116.stdout:7/350: truncate d5/d9/d27/d31/f71 765632 0 2024-09-13T21:40:41.193 INFO:tasks.workunit.client.1.smithi116.stdout:7/351: truncate d5/d9/db/d21/f53 736141 0 2024-09-13T21:40:41.194 INFO:tasks.workunit.client.1.smithi116.stdout:5/334: rmdir d7/d40 39 2024-09-13T21:40:41.196 INFO:tasks.workunit.client.1.smithi116.stdout:5/335: symlink d7/da/d5e/d65/d6a/l6d 0 2024-09-13T21:40:41.196 INFO:tasks.workunit.client.1.smithi116.stdout:5/336: truncate d7/d40/f5b 442059 0 2024-09-13T21:40:41.203 INFO:tasks.workunit.client.1.smithi116.stdout:3/401: write d3/db/d10/f15 [7318112,126684] 0 2024-09-13T21:40:41.209 INFO:tasks.workunit.client.1.smithi116.stdout:5/337: dread d7/fc [0,4194304] 0 2024-09-13T21:40:41.210 INFO:tasks.workunit.client.1.smithi116.stdout:5/338: creat d7/d40/d53/f6e x:0 0 0 2024-09-13T21:40:41.212 INFO:tasks.workunit.client.1.smithi116.stdout:5/339: mkdir d7/da/d5e/d65/d6f 0 2024-09-13T21:40:41.217 INFO:tasks.workunit.client.1.smithi116.stdout:4/336: dwrite d0/d32/f53 [0,4194304] 0 2024-09-13T21:40:41.217 INFO:tasks.workunit.client.1.smithi116.stdout:4/337: write d0/f10 [2716223,84803] 0 2024-09-13T21:40:41.225 INFO:tasks.workunit.client.1.smithi116.stdout:5/340: dread d7/d40/d53/f61 [0,4194304] 0 2024-09-13T21:40:41.226 INFO:tasks.workunit.client.1.smithi116.stdout:6/287: dwrite d8/d1e/f53 [0,4194304] 0 2024-09-13T21:40:41.229 INFO:tasks.workunit.client.1.smithi116.stdout:6/288: unlink d8/d15/d2e/f5a 0 2024-09-13T21:40:41.231 INFO:tasks.workunit.client.1.smithi116.stdout:6/289: link d8/d1e/f63 d8/d15/d2e/f6a 0 2024-09-13T21:40:41.237 INFO:tasks.workunit.client.1.smithi116.stdout:9/194: dwrite d2/d10/d14/f31 [0,4194304] 0 2024-09-13T21:40:41.238 INFO:tasks.workunit.client.1.smithi116.stdout:9/195: read d2/f2f [657871,21560] 0 2024-09-13T21:40:41.239 INFO:tasks.workunit.client.1.smithi116.stdout:3/402: dwrite d3/f11 [0,4194304] 0 2024-09-13T21:40:41.239 INFO:tasks.workunit.client.1.smithi116.stdout:3/403: fsync d3/db/d10/d1c/f5d 0 2024-09-13T21:40:41.240 INFO:tasks.workunit.client.1.smithi116.stdout:5/341: dread d7/d1d/f29 [4194304,4194304] 0 2024-09-13T21:40:41.241 INFO:tasks.workunit.client.1.smithi116.stdout:5/342: fsync d7/f12 0 2024-09-13T21:40:41.241 INFO:tasks.workunit.client.1.smithi116.stdout:5/343: truncate d7/d1d/f20 2501881 0 2024-09-13T21:40:41.242 INFO:tasks.workunit.client.1.smithi116.stdout:5/344: write d7/f3f [189988,107682] 0 2024-09-13T21:40:41.242 INFO:tasks.workunit.client.1.smithi116.stdout:5/345: chown d7/d1d/d64 1098 1 2024-09-13T21:40:41.245 INFO:tasks.workunit.client.1.smithi116.stdout:7/352: dwrite d5/f59 [0,4194304] 0 2024-09-13T21:40:41.245 INFO:tasks.workunit.client.1.smithi116.stdout:4/338: dwrite d0/f39 [0,4194304] 0 2024-09-13T21:40:41.251 INFO:tasks.workunit.client.1.smithi116.stdout:6/290: dwrite d8/d1e/f31 [0,4194304] 0 2024-09-13T21:40:41.252 INFO:tasks.workunit.client.1.smithi116.stdout:9/196: write d2/d10/d14/f31 [872435,96218] 0 2024-09-13T21:40:41.252 INFO:tasks.workunit.client.1.smithi116.stdout:9/197: fdatasync d2/d8/f1a 0 2024-09-13T21:40:41.256 INFO:tasks.workunit.client.1.smithi116.stdout:7/353: link d5/d9/c44 d5/d9/d27/c73 0 2024-09-13T21:40:41.257 INFO:tasks.workunit.client.1.smithi116.stdout:4/339: mknod d0/d56/c5e 0 2024-09-13T21:40:41.259 INFO:tasks.workunit.client.1.smithi116.stdout:6/291: dread d8/d15/d2e/f3f [0,4194304] 0 2024-09-13T21:40:41.259 INFO:tasks.workunit.client.1.smithi116.stdout:6/292: write d8/d15/f64 [820328,105113] 0 2024-09-13T21:40:41.259 INFO:tasks.workunit.client.1.smithi116.stdout:5/346: dwrite d7/d1d/f45 [0,4194304] 0 2024-09-13T21:40:41.260 INFO:tasks.workunit.client.1.smithi116.stdout:5/347: dread d7/d40/f5b [0,4194304] 0 2024-09-13T21:40:41.262 INFO:tasks.workunit.client.1.smithi116.stdout:7/354: rename d5/d9/d27/d31/d38/d56 to d5/d9/d1c/d22/d24/d6b/d72/d74 0 2024-09-13T21:40:41.264 INFO:tasks.workunit.client.1.smithi116.stdout:4/340: mkdir d0/d32/d5f 0 2024-09-13T21:40:41.264 INFO:tasks.workunit.client.1.smithi116.stdout:4/341: fdatasync d0/d32/f49 0 2024-09-13T21:40:41.267 INFO:tasks.workunit.client.1.smithi116.stdout:5/348: readlink d7/l47 0 2024-09-13T21:40:41.267 INFO:tasks.workunit.client.1.smithi116.stdout:5/349: write d7/da/f1c [4162480,6466] 0 2024-09-13T21:40:41.268 INFO:tasks.workunit.client.1.smithi116.stdout:3/404: truncate d3/f11 3712790 0 2024-09-13T21:40:41.270 INFO:tasks.workunit.client.1.smithi116.stdout:7/355: creat d5/d9/d27/d31/d38/d48/f75 x:0 0 0 2024-09-13T21:40:41.270 INFO:tasks.workunit.client.1.smithi116.stdout:7/356: chown d5/d9/db/d21/d6e/d6f/d70 6439 1 2024-09-13T21:40:41.270 INFO:tasks.workunit.client.1.smithi116.stdout:7/357: readlink d5/d9/d1c/d22/l2f 0 2024-09-13T21:40:41.271 INFO:tasks.workunit.client.1.smithi116.stdout:3/405: unlink d3/db/d26/c32 0 2024-09-13T21:40:41.271 INFO:tasks.workunit.client.1.smithi116.stdout:3/406: readlink d3/db/d20/d50/l74 0 2024-09-13T21:40:41.273 INFO:tasks.workunit.client.1.smithi116.stdout:7/358: unlink d5/d9/d27/d31/d38/d48/l4a 0 2024-09-13T21:40:41.275 INFO:tasks.workunit.client.1.smithi116.stdout:7/359: rmdir d5/d9/d1c/d22/d24/d5f 39 2024-09-13T21:40:41.283 INFO:tasks.workunit.client.1.smithi116.stdout:3/407: dread d3/db/d10/d1c/d34/f56 [0,4194304] 0 2024-09-13T21:40:41.283 INFO:tasks.workunit.client.1.smithi116.stdout:9/198: dwrite d2/d8/f11 [0,4194304] 0 2024-09-13T21:40:41.283 INFO:tasks.workunit.client.1.smithi116.stdout:3/408: chown d3/db/d10/d1d/d2f/c81 6 1 2024-09-13T21:40:41.283 INFO:tasks.workunit.client.1.smithi116.stdout:3/409: write d3/db/f68 [204332,5539] 0 2024-09-13T21:40:41.283 INFO:tasks.workunit.client.1.smithi116.stdout:3/410: readlink d3/l6d 0 2024-09-13T21:40:41.283 INFO:tasks.workunit.client.1.smithi116.stdout:9/199: write d2/f2b [854962,69902] 0 2024-09-13T21:40:41.284 INFO:tasks.workunit.client.1.smithi116.stdout:6/293: dwrite d8/d17/f23 [0,4194304] 0 2024-09-13T21:40:41.284 INFO:tasks.workunit.client.1.smithi116.stdout:3/411: mknod d3/db/d10/d1d/d2f/c9a 0 2024-09-13T21:40:41.285 INFO:tasks.workunit.client.1.smithi116.stdout:3/412: fsync d3/db/d10/d1c/f5d 0 2024-09-13T21:40:41.285 INFO:tasks.workunit.client.1.smithi116.stdout:3/413: chown d3/db/d20/d50/l74 13239 1 2024-09-13T21:40:41.285 INFO:tasks.workunit.client.1.smithi116.stdout:3/414: read - d3/db/d10/f7e zero size 2024-09-13T21:40:41.285 INFO:tasks.workunit.client.1.smithi116.stdout:3/415: stat d3/db/d10/d1c/f5d 0 2024-09-13T21:40:41.290 INFO:tasks.workunit.client.1.smithi116.stdout:4/342: dwrite d0/dd/d13/f46 [0,4194304] 0 2024-09-13T21:40:41.297 INFO:tasks.workunit.client.1.smithi116.stdout:6/294: truncate d8/d1e/f53 838683 0 2024-09-13T21:40:41.297 INFO:tasks.workunit.client.1.smithi116.stdout:6/295: fsync d8/d15/d2e/f3f 0 2024-09-13T21:40:41.297 INFO:tasks.workunit.client.1.smithi116.stdout:6/296: getdents d8/d10/d65 0 2024-09-13T21:40:41.297 INFO:tasks.workunit.client.1.smithi116.stdout:6/297: stat d8/d17/f23 0 2024-09-13T21:40:41.298 INFO:tasks.workunit.client.1.smithi116.stdout:4/343: getdents d0/d56 0 2024-09-13T21:40:41.298 INFO:tasks.workunit.client.1.smithi116.stdout:4/344: read d0/dd/d13/f4c [4144297,46104] 0 2024-09-13T21:40:41.299 INFO:tasks.workunit.client.1.smithi116.stdout:4/345: creat d0/dd/f60 x:0 0 0 2024-09-13T21:40:41.299 INFO:tasks.workunit.client.1.smithi116.stdout:4/346: chown d0/ce 441824283 1 2024-09-13T21:40:41.305 INFO:tasks.workunit.client.1.smithi116.stdout:9/200: dwrite d2/d10/f32 [0,4194304] 0 2024-09-13T21:40:41.313 INFO:tasks.workunit.client.1.smithi116.stdout:4/347: read d0/dd/d13/f21 [2906528,63428] 0 2024-09-13T21:40:41.314 INFO:tasks.workunit.client.1.smithi116.stdout:6/298: read d8/ff [6053798,115125] 0 2024-09-13T21:40:41.315 INFO:tasks.workunit.client.1.smithi116.stdout:6/299: mknod d8/d17/c6b 0 2024-09-13T21:40:41.317 INFO:tasks.workunit.client.1.smithi116.stdout:6/300: mknod d8/d15/c6c 0 2024-09-13T21:40:41.326 INFO:tasks.workunit.client.1.smithi116.stdout:9/201: dwrite d2/d10/f20 [0,4194304] 0 2024-09-13T21:40:41.333 INFO:tasks.workunit.client.1.smithi116.stdout:8/249: sync 2024-09-13T21:40:41.333 INFO:tasks.workunit.client.1.smithi116.stdout:8/250: chown d2/d10/d19/d21/d22/f4a 40870 1 2024-09-13T21:40:41.333 INFO:tasks.workunit.client.1.smithi116.stdout:8/251: fdatasync d2/d10/d19/d21/d22/f4a 0 2024-09-13T21:40:41.334 INFO:tasks.workunit.client.1.smithi116.stdout:8/252: creat d2/d27/d43/d46/f4f x:0 0 0 2024-09-13T21:40:41.334 INFO:tasks.workunit.client.1.smithi116.stdout:9/202: write d2/d8/f11 [335304,124436] 0 2024-09-13T21:40:41.335 INFO:tasks.workunit.client.1.smithi116.stdout:8/253: creat d2/d10/d4b/f50 x:0 0 0 2024-09-13T21:40:41.335 INFO:tasks.workunit.client.1.smithi116.stdout:9/203: truncate d2/f2b 601406 0 2024-09-13T21:40:41.337 INFO:tasks.workunit.client.1.smithi116.stdout:9/204: mkdir d2/d10/d14/d38/d3a 0 2024-09-13T21:40:41.338 INFO:tasks.workunit.client.1.smithi116.stdout:8/254: read d2/d10/f11 [102031,34953] 0 2024-09-13T21:40:41.338 INFO:tasks.workunit.client.1.smithi116.stdout:8/255: creat d2/d10/d4b/f51 x:0 0 0 2024-09-13T21:40:41.338 INFO:tasks.workunit.client.1.smithi116.stdout:9/205: symlink d2/l3b 0 2024-09-13T21:40:41.345 INFO:tasks.workunit.client.1.smithi116.stdout:8/256: write d2/d10/d19/f1d [1239993,29160] 0 2024-09-13T21:40:41.347 INFO:tasks.workunit.client.1.smithi116.stdout:9/206: write d2/d8/f1a [3505354,79843] 0 2024-09-13T21:40:41.347 INFO:tasks.workunit.client.1.smithi116.stdout:8/257: creat d2/d27/d43/f52 x:0 0 0 2024-09-13T21:40:41.348 INFO:tasks.workunit.client.1.smithi116.stdout:9/207: symlink d2/d10/d14/d38/d3a/l3c 0 2024-09-13T21:40:41.350 INFO:tasks.workunit.client.1.smithi116.stdout:9/208: dread d2/d10/d14/f21 [0,4194304] 0 2024-09-13T21:40:41.350 INFO:tasks.workunit.client.1.smithi116.stdout:9/209: chown d2/f13 5234603 1 2024-09-13T21:40:41.351 INFO:tasks.workunit.client.1.smithi116.stdout:4/348: truncate d0/f30 1442179 0 2024-09-13T21:40:41.352 INFO:tasks.workunit.client.1.smithi116.stdout:8/258: dread d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:41.352 INFO:tasks.workunit.client.1.smithi116.stdout:4/349: rmdir d0/dd/d48 39 2024-09-13T21:40:41.353 INFO:tasks.workunit.client.1.smithi116.stdout:8/259: symlink d2/d27/l53 0 2024-09-13T21:40:41.355 INFO:tasks.workunit.client.1.smithi116.stdout:9/210: truncate d2/d10/f32 3249148 0 2024-09-13T21:40:41.355 INFO:tasks.workunit.client.1.smithi116.stdout:9/211: chown d2/d10/d14/d38 0 1 2024-09-13T21:40:41.357 INFO:tasks.workunit.client.1.smithi116.stdout:9/212: link d2/c1c d2/d10/c3d 0 2024-09-13T21:40:41.358 INFO:tasks.workunit.client.1.smithi116.stdout:8/260: dread d2/d10/f2c [0,4194304] 0 2024-09-13T21:40:41.358 INFO:tasks.workunit.client.1.smithi116.stdout:8/261: read - d2/d27/d43/f52 zero size 2024-09-13T21:40:41.358 INFO:tasks.workunit.client.1.smithi116.stdout:8/262: readlink d2/d10/l3d 0 2024-09-13T21:40:41.370 INFO:tasks.workunit.client.1.smithi116.stdout:9/213: dread d2/d8/f1a [0,4194304] 0 2024-09-13T21:40:41.376 INFO:tasks.workunit.client.1.smithi116.stdout:4/350: dwrite d0/f43 [0,4194304] 0 2024-09-13T21:40:41.376 INFO:tasks.workunit.client.1.smithi116.stdout:8/263: dwrite d2/d10/d4b/f51 [0,4194304] 0 2024-09-13T21:40:41.378 INFO:tasks.workunit.client.1.smithi116.stdout:4/351: creat d0/dd/d13/f61 x:0 0 0 2024-09-13T21:40:41.378 INFO:tasks.workunit.client.1.smithi116.stdout:4/352: readlink d0/l11 0 2024-09-13T21:40:41.381 INFO:tasks.workunit.client.1.smithi116.stdout:4/353: link d0/d32/c42 d0/d56/d57/c62 0 2024-09-13T21:40:41.383 INFO:tasks.workunit.client.1.smithi116.stdout:4/354: creat d0/d32/d5f/f63 x:0 0 0 2024-09-13T21:40:41.383 INFO:tasks.workunit.client.1.smithi116.stdout:4/355: readlink d0/dd/l1a 0 2024-09-13T21:40:41.384 INFO:tasks.workunit.client.1.smithi116.stdout:9/214: dwrite d2/d10/d14/f21 [0,4194304] 0 2024-09-13T21:40:41.384 INFO:tasks.workunit.client.1.smithi116.stdout:4/356: rename d0/l11 to d0/d32/d5d/l64 0 2024-09-13T21:40:41.389 INFO:tasks.workunit.client.1.smithi116.stdout:4/357: creat d0/dd/d13/d5a/f65 x:0 0 0 2024-09-13T21:40:41.389 INFO:tasks.workunit.client.1.smithi116.stdout:9/215: read d2/f2d [1064726,105204] 0 2024-09-13T21:40:41.389 INFO:tasks.workunit.client.1.smithi116.stdout:9/216: write d2/d10/f12 [248254,8083] 0 2024-09-13T21:40:41.392 INFO:tasks.workunit.client.1.smithi116.stdout:9/217: dread d2/f3 [0,4194304] 0 2024-09-13T21:40:41.394 INFO:tasks.workunit.client.1.smithi116.stdout:9/218: mkdir d2/d8/d3e 0 2024-09-13T21:40:41.394 INFO:tasks.workunit.client.1.smithi116.stdout:9/219: truncate d2/f1d 1332720 0 2024-09-13T21:40:41.395 INFO:tasks.workunit.client.1.smithi116.stdout:4/358: dread d0/d32/f52 [0,4194304] 0 2024-09-13T21:40:41.395 INFO:tasks.workunit.client.1.smithi116.stdout:4/359: creat d0/d32/f66 x:0 0 0 2024-09-13T21:40:41.397 INFO:tasks.workunit.client.1.smithi116.stdout:4/360: mkdir d0/d32/d5f/d67 0 2024-09-13T21:40:41.398 INFO:tasks.workunit.client.1.smithi116.stdout:4/361: unlink d0/d32/c58 0 2024-09-13T21:40:41.406 INFO:tasks.workunit.client.1.smithi116.stdout:9/220: write d2/d10/f20 [1938812,28150] 0 2024-09-13T21:40:41.410 INFO:tasks.workunit.client.1.smithi116.stdout:8/264: dwrite d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:41.458 INFO:tasks.workunit.client.1.smithi116.stdout:4/362: dread d0/f10 [0,4194304] 0 2024-09-13T21:40:41.461 INFO:tasks.workunit.client.1.smithi116.stdout:4/363: link d0/dd/d13/l2f d0/d32/d5d/l68 0 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:8/265: truncate d2/f2f 2872506 0 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:9/221: dread d2/d8/f11 [0,4194304] 0 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:9/222: dread d2/f1d [0,4194304] 0 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:4/364: rename d0/d32/f34 to d0/d56/f69 0 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:8/266: read d2/f2f [964888,93909] 0 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:8/267: chown d2/l7 16000974 1 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:9/223: write d2/fc [1863175,98165] 0 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:2/263: sync 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:1/264: sync 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:1/265: chown d4/d14/d52/d2f/l4e 33 1 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:0/247: sync 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:2/264: mkdir d0/da/d1f/d5d 0 2024-09-13T21:40:41.462 INFO:tasks.workunit.client.1.smithi116.stdout:0/248: truncate d2/d5/f6 263033 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:0/249: write d2/d5/f44 [776179,10677] 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/265: mknod d0/da/d1f/d5d/c5e 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/266: stat d0/da/d1f/f27 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/267: dread - d0/d7/d2b/d2c/f5c zero size 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/268: mknod d0/da/d1f/c5f 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/269: chown d0/d7/d2b/d2c/c15 156 1 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/270: mkdir d0/da/d1f/d5d/d60 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/271: dread d0/da/d1f/f27 [0,4194304] 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/272: fdatasync d0/d5/f10 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/273: chown d0/d7/c17 1 1 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:2/274: mkdir d0/d7/d2b/d61 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:8/268: dwrite d2/d10/f11 [0,4194304] 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:1/266: dwrite d4/ff [4194304,4194304] 0 2024-09-13T21:40:41.463 INFO:tasks.workunit.client.1.smithi116.stdout:1/267: write d4/d14/d2a/f42 [145812,22166] 0 2024-09-13T21:40:41.464 INFO:tasks.workunit.client.1.smithi116.stdout:1/268: chown d4 1 1 2024-09-13T21:40:41.464 INFO:tasks.workunit.client.1.smithi116.stdout:8/269: symlink d2/d10/d19/d42/l54 0 2024-09-13T21:40:41.464 INFO:tasks.workunit.client.1.smithi116.stdout:8/270: creat d2/d10/d19/d3a/f55 x:0 0 0 2024-09-13T21:40:41.464 INFO:tasks.workunit.client.1.smithi116.stdout:8/271: readlink d2/d10/d19/l30 0 2024-09-13T21:40:41.464 INFO:tasks.workunit.client.1.smithi116.stdout:1/269: mkdir d4/d14/d52/d2f/d5c 0 2024-09-13T21:40:41.464 INFO:tasks.workunit.client.1.smithi116.stdout:2/275: rename d0/da to d0/d7/d2b/d2c/d62 0 2024-09-13T21:40:41.465 INFO:tasks.workunit.client.1.smithi116.stdout:2/276: dread - d0/d7/d2b/d2c/f5c zero size 2024-09-13T21:40:41.465 INFO:tasks.workunit.client.1.smithi116.stdout:1/270: getdents d4/d23/d56 0 2024-09-13T21:40:41.465 INFO:tasks.workunit.client.1.smithi116.stdout:8/272: mknod d2/d10/d19/c56 0 2024-09-13T21:40:41.467 INFO:tasks.workunit.client.1.smithi116.stdout:1/271: mkdir d4/d14/d52/d2f/d5d 0 2024-09-13T21:40:41.468 INFO:tasks.workunit.client.1.smithi116.stdout:8/273: chown d2/d10/f31 119330933 1 2024-09-13T21:40:41.469 INFO:tasks.workunit.client.1.smithi116.stdout:8/274: write d2/f2f [2834059,61895] 0 2024-09-13T21:40:41.469 INFO:tasks.workunit.client.1.smithi116.stdout:8/275: dread - d2/d10/d4b/f50 zero size 2024-09-13T21:40:41.469 INFO:tasks.workunit.client.1.smithi116.stdout:8/276: write d2/d10/f11 [4442824,39054] 0 2024-09-13T21:40:41.469 INFO:tasks.workunit.client.1.smithi116.stdout:8/277: rename d2/d10 to d2/d10/d37/d57 22 2024-09-13T21:40:41.469 INFO:tasks.workunit.client.1.smithi116.stdout:8/278: fdatasync d2/d10/d19/d21/f47 0 2024-09-13T21:40:41.469 INFO:tasks.workunit.client.1.smithi116.stdout:8/279: stat d2/d10/d4b 0 2024-09-13T21:40:41.470 INFO:tasks.workunit.client.1.smithi116.stdout:1/272: creat d4/d14/d52/d2f/d5d/f5e x:0 0 0 2024-09-13T21:40:41.480 INFO:tasks.workunit.client.1.smithi116.stdout:8/280: fdatasync d2/d10/f11 0 2024-09-13T21:40:41.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:41 smithi088 ceph-mon[27963]: pgmap v260: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 176 MiB/s rd, 230 MiB/s wr, 393 op/s 2024-09-13T21:40:41.487 INFO:tasks.workunit.client.1.smithi116.stdout:1/273: dwrite f1 [0,4194304] 0 2024-09-13T21:40:41.492 INFO:tasks.workunit.client.1.smithi116.stdout:1/274: dread d4/d14/d52/f38 [0,4194304] 0 2024-09-13T21:40:41.492 INFO:tasks.workunit.client.1.smithi116.stdout:1/275: fsync d4/f1b 0 2024-09-13T21:40:41.493 INFO:tasks.workunit.client.1.smithi116.stdout:1/276: mkdir d4/d14/d44/d5f 0 2024-09-13T21:40:41.495 INFO:tasks.workunit.client.1.smithi116.stdout:1/277: mknod d4/d14/d52/c60 0 2024-09-13T21:40:41.496 INFO:tasks.workunit.client.1.smithi116.stdout:1/278: mknod d4/d14/d44/d5f/c61 0 2024-09-13T21:40:41.498 INFO:tasks.workunit.client.1.smithi116.stdout:1/279: link d4/ld d4/d14/d2a/l62 0 2024-09-13T21:40:41.498 INFO:tasks.workunit.client.1.smithi116.stdout:8/281: dwrite d2/d10/f31 [0,4194304] 0 2024-09-13T21:40:41.503 INFO:tasks.workunit.client.1.smithi116.stdout:1/280: dread d4/d14/d52/f3b [0,4194304] 0 2024-09-13T21:40:41.505 INFO:tasks.workunit.client.1.smithi116.stdout:1/281: unlink d4/f1b 0 2024-09-13T21:40:41.508 INFO:tasks.workunit.client.1.smithi116.stdout:1/282: mknod d4/d14/d2a/c63 0 2024-09-13T21:40:41.508 INFO:tasks.workunit.client.1.smithi116.stdout:1/283: readlink d4/d14/d44/l46 0 2024-09-13T21:40:41.508 INFO:tasks.workunit.client.1.smithi116.stdout:8/282: dread d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:41.509 INFO:tasks.workunit.client.1.smithi116.stdout:8/283: symlink d2/d10/d19/d3a/l58 0 2024-09-13T21:40:41.511 INFO:tasks.workunit.client.1.smithi116.stdout:8/284: symlink d2/d10/d4b/l59 0 2024-09-13T21:40:41.513 INFO:tasks.workunit.client.1.smithi116.stdout:8/285: symlink d2/d10/d19/d42/l5a 0 2024-09-13T21:40:41.514 INFO:tasks.workunit.client.1.smithi116.stdout:8/286: getdents d2/d10 0 2024-09-13T21:40:41.514 INFO:tasks.workunit.client.1.smithi116.stdout:8/287: creat d2/d27/d43/d46/f5b x:0 0 0 2024-09-13T21:40:41.514 INFO:tasks.workunit.client.1.smithi116.stdout:8/288: truncate d2/d27/d43/d46/f5b 491518 0 2024-09-13T21:40:41.518 INFO:tasks.workunit.client.1.smithi116.stdout:8/289: getdents d2/d27/d43 0 2024-09-13T21:40:41.518 INFO:tasks.workunit.client.1.smithi116.stdout:8/290: write d2/d10/d19/d3a/f3b [1128103,54969] 0 2024-09-13T21:40:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:41 smithi116 ceph-mon[33391]: pgmap v260: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 176 MiB/s rd, 230 MiB/s wr, 393 op/s 2024-09-13T21:40:41.609 INFO:tasks.workunit.client.1.smithi116.stdout:8/291: dwrite d2/d10/d19/d3a/f3b [0,4194304] 0 2024-09-13T21:40:41.609 INFO:tasks.workunit.client.1.smithi116.stdout:8/292: truncate d2/d10/f2c 2428604 0 2024-09-13T21:40:41.614 INFO:tasks.workunit.client.1.smithi116.stdout:8/293: mkdir d2/d5c 0 2024-09-13T21:40:41.631 INFO:tasks.workunit.client.1.smithi116.stdout:8/294: dwrite d2/d10/d19/d21/f47 [0,4194304] 0 2024-09-13T21:40:41.631 INFO:tasks.workunit.client.1.smithi116.stdout:8/295: getdents d2/d27/d43 0 2024-09-13T21:40:41.631 INFO:tasks.workunit.client.1.smithi116.stdout:8/296: dread - d2/d10/d4b/f50 zero size 2024-09-13T21:40:41.634 INFO:tasks.workunit.client.1.smithi116.stdout:8/297: rename d2/d27/d43 to d2/d10/d19/d21/d22/d5d 0 2024-09-13T21:40:41.634 INFO:tasks.workunit.client.1.smithi116.stdout:8/298: dread - d2/d10/d19/d21/d22/d5d/f52 zero size 2024-09-13T21:40:41.636 INFO:tasks.workunit.client.1.smithi116.stdout:8/299: rename d2/d10/c17 to d2/d10/d37/c5e 0 2024-09-13T21:40:41.645 INFO:tasks.workunit.client.1.smithi116.stdout:5/350: sync 2024-09-13T21:40:41.645 INFO:tasks.workunit.client.1.smithi116.stdout:5/351: chown d7/da/d5e/l60 430855 1 2024-09-13T21:40:41.645 INFO:tasks.workunit.client.1.smithi116.stdout:5/352: write d7/d40/d53/f6e [223010,13180] 0 2024-09-13T21:40:41.650 INFO:tasks.workunit.client.1.smithi116.stdout:5/353: write d7/d40/d53/f61 [4075425,68342] 0 2024-09-13T21:40:41.650 INFO:tasks.workunit.client.1.smithi116.stdout:5/354: chown d7/da/d5e 34983 1 2024-09-13T21:40:41.650 INFO:tasks.workunit.client.1.smithi116.stdout:5/355: write d7/da/f3e [1491628,11417] 0 2024-09-13T21:40:41.651 INFO:tasks.workunit.client.1.smithi116.stdout:5/356: creat d7/d1d/f70 x:0 0 0 2024-09-13T21:40:41.652 INFO:tasks.workunit.client.1.smithi116.stdout:5/357: readlink d7/da/d5e/d65/l6b 0 2024-09-13T21:40:41.655 INFO:tasks.workunit.client.1.smithi116.stdout:5/358: rename d7/c24 to d7/da/d5e/d65/d6f/c71 0 2024-09-13T21:40:41.661 INFO:tasks.workunit.client.1.smithi116.stdout:5/359: dread d7/da/f48 [0,4194304] 0 2024-09-13T21:40:41.662 INFO:tasks.workunit.client.1.smithi116.stdout:5/360: stat d7/da/c68 0 2024-09-13T21:40:41.663 INFO:tasks.workunit.client.1.smithi116.stdout:5/361: creat d7/f72 x:0 0 0 2024-09-13T21:40:41.663 INFO:tasks.workunit.client.1.smithi116.stdout:5/362: truncate d7/d40/f55 474718 0 2024-09-13T21:40:41.665 INFO:tasks.workunit.client.1.smithi116.stdout:5/363: rename d7/l2c to d7/d1d/d46/d5c/l73 0 2024-09-13T21:40:41.665 INFO:tasks.workunit.client.1.smithi116.stdout:5/364: chown d7/f12 761112820 1 2024-09-13T21:40:41.667 INFO:tasks.workunit.client.1.smithi116.stdout:5/365: symlink d7/da/d5e/d65/d6a/l74 0 2024-09-13T21:40:41.667 INFO:tasks.workunit.client.1.smithi116.stdout:5/366: write d7/d40/f5b [217946,30009] 0 2024-09-13T21:40:41.668 INFO:tasks.workunit.client.1.smithi116.stdout:5/367: write d7/da/f52 [345012,64245] 0 2024-09-13T21:40:41.668 INFO:tasks.workunit.client.1.smithi116.stdout:5/368: creat d7/d40/f75 x:0 0 0 2024-09-13T21:40:41.670 INFO:tasks.workunit.client.1.smithi116.stdout:5/369: creat d7/da/d5e/d65/d6a/f76 x:0 0 0 2024-09-13T21:40:41.674 INFO:tasks.workunit.client.1.smithi116.stdout:5/370: dread d7/d40/f5b [0,4194304] 0 2024-09-13T21:40:41.674 INFO:tasks.workunit.client.1.smithi116.stdout:5/371: chown d7/da/d5e/d65/d6a/l74 2377531 1 2024-09-13T21:40:41.690 INFO:tasks.workunit.client.1.smithi116.stdout:5/372: dwrite d7/f5d [0,4194304] 0 2024-09-13T21:40:41.693 INFO:tasks.workunit.client.1.smithi116.stdout:5/373: dread d7/f12 [0,4194304] 0 2024-09-13T21:40:41.693 INFO:tasks.workunit.client.1.smithi116.stdout:5/374: write d7/da/f3e [1742718,101334] 0 2024-09-13T21:40:41.693 INFO:tasks.workunit.client.1.smithi116.stdout:5/375: creat d7/da/d5e/d65/d6a/f77 x:0 0 0 2024-09-13T21:40:41.693 INFO:tasks.workunit.client.1.smithi116.stdout:5/376: write d7/d40/d53/f59 [731107,121102] 0 2024-09-13T21:40:41.700 INFO:tasks.workunit.client.1.smithi116.stdout:5/377: dread d7/da/f37 [0,4194304] 0 2024-09-13T21:40:41.704 INFO:tasks.workunit.client.1.smithi116.stdout:5/378: truncate d7/d40/d53/f61 3449375 0 2024-09-13T21:40:41.704 INFO:tasks.workunit.client.1.smithi116.stdout:5/379: creat d7/d1d/d46/d5c/f78 x:0 0 0 2024-09-13T21:40:41.704 INFO:tasks.workunit.client.1.smithi116.stdout:5/380: write d7/d1d/f70 [577373,108350] 0 2024-09-13T21:40:41.705 INFO:tasks.workunit.client.1.smithi116.stdout:5/381: mkdir d7/da/d5e/d79 0 2024-09-13T21:40:41.705 INFO:tasks.workunit.client.1.smithi116.stdout:5/382: chown d7/d1d/f45 246 1 2024-09-13T21:40:41.706 INFO:tasks.workunit.client.1.smithi116.stdout:5/383: creat d7/da/d5e/f7a x:0 0 0 2024-09-13T21:40:41.708 INFO:tasks.workunit.client.1.smithi116.stdout:5/384: rename d7/d40/f50 to d7/da/d5e/f7b 0 2024-09-13T21:40:41.708 INFO:tasks.workunit.client.1.smithi116.stdout:5/385: fdatasync d7/f72 0 2024-09-13T21:40:41.718 INFO:tasks.workunit.client.1.smithi116.stdout:5/386: dread d7/d1d/d46/d5c/f63 [0,4194304] 0 2024-09-13T21:40:41.732 INFO:tasks.workunit.client.1.smithi116.stdout:5/387: dwrite d7/f16 [4194304,4194304] 0 2024-09-13T21:40:41.733 INFO:tasks.workunit.client.1.smithi116.stdout:5/388: unlink d7/da/d5e/d65/d6a/f77 0 2024-09-13T21:40:41.751 INFO:tasks.workunit.client.1.smithi116.stdout:5/389: dwrite d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:41.751 INFO:tasks.workunit.client.1.smithi116.stdout:5/390: write d7/d40/f55 [845472,36598] 0 2024-09-13T21:40:41.764 INFO:tasks.workunit.client.1.smithi116.stdout:5/391: dwrite d7/d40/f75 [0,4194304] 0 2024-09-13T21:40:41.769 INFO:tasks.workunit.client.1.smithi116.stdout:5/392: dread d7/d1d/f20 [0,4194304] 0 2024-09-13T21:40:41.769 INFO:tasks.workunit.client.1.smithi116.stdout:5/393: fsync d7/f25 0 2024-09-13T21:40:41.784 INFO:tasks.workunit.client.1.smithi116.stdout:5/394: dwrite d7/f3f [0,4194304] 0 2024-09-13T21:40:41.785 INFO:tasks.workunit.client.1.smithi116.stdout:5/395: truncate d7/da/f48 2614588 0 2024-09-13T21:40:41.786 INFO:tasks.workunit.client.1.smithi116.stdout:5/396: symlink d7/d1d/l7c 0 2024-09-13T21:40:41.787 INFO:tasks.workunit.client.1.smithi116.stdout:5/397: write d7/da/d5e/f4e [1884933,47565] 0 2024-09-13T21:40:41.789 INFO:tasks.workunit.client.1.smithi116.stdout:5/398: getdents d7/d1d 0 2024-09-13T21:40:41.796 INFO:tasks.workunit.client.1.smithi116.stdout:7/360: sync 2024-09-13T21:40:41.796 INFO:tasks.workunit.client.1.smithi116.stdout:3/416: sync 2024-09-13T21:40:41.796 INFO:tasks.workunit.client.1.smithi116.stdout:3/417: truncate d3/db/d10/d1d/d2f/f38 5267396 0 2024-09-13T21:40:41.805 INFO:tasks.workunit.client.1.smithi116.stdout:3/418: dread d3/db/d10/d1d/f75 [0,4194304] 0 2024-09-13T21:40:41.806 INFO:tasks.workunit.client.1.smithi116.stdout:3/419: symlink d3/l9b 0 2024-09-13T21:40:41.807 INFO:tasks.workunit.client.1.smithi116.stdout:3/420: mknod d3/db/d10/d1c/d63/c9c 0 2024-09-13T21:40:41.808 INFO:tasks.workunit.client.1.smithi116.stdout:3/421: mknod d3/db/d10/d1d/d2f/c9d 0 2024-09-13T21:40:41.809 INFO:tasks.workunit.client.1.smithi116.stdout:3/422: creat d3/db/d26/f9e x:0 0 0 2024-09-13T21:40:41.809 INFO:tasks.workunit.client.1.smithi116.stdout:3/423: truncate d3/db/d10/d1d/f2d 108624 0 2024-09-13T21:40:41.810 INFO:tasks.workunit.client.1.smithi116.stdout:7/361: dwrite d5/f16 [0,4194304] 0 2024-09-13T21:40:41.811 INFO:tasks.workunit.client.1.smithi116.stdout:3/424: symlink d3/db/d3d/l9f 0 2024-09-13T21:40:41.816 INFO:tasks.workunit.client.1.smithi116.stdout:7/362: rmdir d5/d9/db 39 2024-09-13T21:40:41.819 INFO:tasks.workunit.client.1.smithi116.stdout:7/363: link d5/d9/f51 d5/d9/d27/d31/d38/d48/f76 0 2024-09-13T21:40:41.835 INFO:tasks.workunit.client.1.smithi116.stdout:3/425: dwrite d3/db/d3d/d40/f48 [4194304,4194304] 0 2024-09-13T21:40:41.836 INFO:tasks.workunit.client.1.smithi116.stdout:3/426: readlink d3/l2b 0 2024-09-13T21:40:41.836 INFO:tasks.workunit.client.1.smithi116.stdout:3/427: creat d3/db/d26/fa0 x:0 0 0 2024-09-13T21:40:41.836 INFO:tasks.workunit.client.1.smithi116.stdout:3/428: write d3/db/d20/f65 [84544,82643] 0 2024-09-13T21:40:41.837 INFO:tasks.workunit.client.1.smithi116.stdout:7/364: dwrite d5/d9/d1c/d37/f62 [0,4194304] 0 2024-09-13T21:40:41.860 INFO:tasks.workunit.client.1.smithi116.stdout:3/429: dwrite d3/db/d10/d1d/f2d [0,4194304] 0 2024-09-13T21:40:41.860 INFO:tasks.workunit.client.1.smithi116.stdout:7/365: dwrite d5/d9/f51 [0,4194304] 0 2024-09-13T21:40:41.860 INFO:tasks.workunit.client.1.smithi116.stdout:7/366: chown d5/d9/d1c/d22/l25 63449826 1 2024-09-13T21:40:41.861 INFO:tasks.workunit.client.1.smithi116.stdout:7/367: creat d5/d9/d27/d31/d38/d48/f77 x:0 0 0 2024-09-13T21:40:41.863 INFO:tasks.workunit.client.1.smithi116.stdout:3/430: unlink d3/db/d10/d1c/d34/f56 0 2024-09-13T21:40:41.866 INFO:tasks.workunit.client.1.smithi116.stdout:3/431: symlink d3/db/la1 0 2024-09-13T21:40:41.866 INFO:tasks.workunit.client.1.smithi116.stdout:3/432: read - d3/db/d10/d1d/f60 zero size 2024-09-13T21:40:41.869 INFO:tasks.workunit.client.1.smithi116.stdout:3/433: mkdir d3/db/d10/d62/da2 0 2024-09-13T21:40:41.869 INFO:tasks.workunit.client.1.smithi116.stdout:3/434: fsync d3/db/d10/d1d/f60 0 2024-09-13T21:40:41.869 INFO:tasks.workunit.client.1.smithi116.stdout:3/435: chown d3/db/d20/c4e 108996 1 2024-09-13T21:40:41.869 INFO:tasks.workunit.client.1.smithi116.stdout:3/436: creat d3/db/d10/d62/fa3 x:0 0 0 2024-09-13T21:40:41.870 INFO:tasks.workunit.client.1.smithi116.stdout:3/437: dread d3/db/d10/d62/f69 [0,4194304] 0 2024-09-13T21:40:41.870 INFO:tasks.workunit.client.1.smithi116.stdout:3/438: write d3/db/d10/d1d/d2f/d61/f2a [3859949,32701] 0 2024-09-13T21:40:41.870 INFO:tasks.workunit.client.1.smithi116.stdout:3/439: write d3/db/d10/d29/f83 [610236,106472] 0 2024-09-13T21:40:41.883 INFO:tasks.workunit.client.1.smithi116.stdout:7/368: dwrite d5/d9/d27/d31/d38/d48/f77 [0,4194304] 0 2024-09-13T21:40:41.883 INFO:tasks.workunit.client.1.smithi116.stdout:3/440: dread d3/db/d20/f23 [0,4194304] 0 2024-09-13T21:40:41.887 INFO:tasks.workunit.client.1.smithi116.stdout:7/369: dread d5/f8 [0,4194304] 0 2024-09-13T21:40:41.889 INFO:tasks.workunit.client.1.smithi116.stdout:7/370: symlink d5/d9/d27/d31/d38/l78 0 2024-09-13T21:40:41.891 INFO:tasks.workunit.client.1.smithi116.stdout:7/371: rename d5/f18 to d5/d9/d1c/d22/d24/d6b/d72/f79 0 2024-09-13T21:40:41.891 INFO:tasks.workunit.client.1.smithi116.stdout:7/372: chown d5/d9/d1c/d22/d24/d6b/d72 192358 1 2024-09-13T21:40:41.891 INFO:tasks.workunit.client.1.smithi116.stdout:7/373: rmdir d5/d9 39 2024-09-13T21:40:41.891 INFO:tasks.workunit.client.1.smithi116.stdout:7/374: write d5/d9/db/ff [2549519,121893] 0 2024-09-13T21:40:41.900 INFO:tasks.workunit.client.1.smithi116.stdout:7/375: dread d5/d9/f51 [0,4194304] 0 2024-09-13T21:40:41.901 INFO:tasks.workunit.client.1.smithi116.stdout:7/376: creat d5/d9/d1c/d22/f7a x:0 0 0 2024-09-13T21:40:41.902 INFO:tasks.workunit.client.1.smithi116.stdout:7/377: symlink d5/d9/d27/l7b 0 2024-09-13T21:40:41.905 INFO:tasks.workunit.client.1.smithi116.stdout:3/441: dwrite d3/db/d3d/d40/f42 [0,4194304] 0 2024-09-13T21:40:41.909 INFO:tasks.workunit.client.1.smithi116.stdout:7/378: rmdir d5/d9/d27 39 2024-09-13T21:40:41.909 INFO:tasks.workunit.client.1.smithi116.stdout:7/379: truncate d5/d9/f3d 13366611 0 2024-09-13T21:40:41.910 INFO:tasks.workunit.client.1.smithi116.stdout:7/380: fdatasync d5/d9/d27/d31/d38/d48/f76 0 2024-09-13T21:40:41.910 INFO:tasks.workunit.client.1.smithi116.stdout:7/381: stat d5/d9/d1c/d22/d24/f58 0 2024-09-13T21:40:41.912 INFO:tasks.workunit.client.1.smithi116.stdout:3/442: creat d3/db/d10/d1c/d34/d55/fa4 x:0 0 0 2024-09-13T21:40:41.912 INFO:tasks.workunit.client.1.smithi116.stdout:3/443: readlink d3/l9b 0 2024-09-13T21:40:41.912 INFO:tasks.workunit.client.1.smithi116.stdout:3/444: chown d3/db/d20/d50/l74 88 1 2024-09-13T21:40:41.913 INFO:tasks.workunit.client.1.smithi116.stdout:3/445: rmdir d3/db/d10/d1d/d2f/d61 39 2024-09-13T21:40:41.915 INFO:tasks.workunit.client.1.smithi116.stdout:3/446: link d3/db/d10/d1c/d63/c9c d3/db/d20/d50/ca5 0 2024-09-13T21:40:41.915 INFO:tasks.workunit.client.1.smithi116.stdout:3/447: truncate d3/db/d10/d1c/d34/d55/fa4 176684 0 2024-09-13T21:40:41.919 INFO:tasks.workunit.client.1.smithi116.stdout:7/382: dread d5/d9/db/f12 [4194304,4194304] 0 2024-09-13T21:40:41.921 INFO:tasks.workunit.client.1.smithi116.stdout:9/224: sync 2024-09-13T21:40:41.921 INFO:tasks.workunit.client.1.smithi116.stdout:4/365: sync 2024-09-13T21:40:41.921 INFO:tasks.workunit.client.1.smithi116.stdout:8/300: sync 2024-09-13T21:40:41.921 INFO:tasks.workunit.client.1.smithi116.stdout:6/301: sync 2024-09-13T21:40:41.921 INFO:tasks.workunit.client.1.smithi116.stdout:0/250: sync 2024-09-13T21:40:41.921 INFO:tasks.workunit.client.1.smithi116.stdout:6/302: fsync d8/d15/f1b 0 2024-09-13T21:40:41.921 INFO:tasks.workunit.client.1.smithi116.stdout:2/277: sync 2024-09-13T21:40:41.921 INFO:tasks.workunit.client.1.smithi116.stdout:1/284: sync 2024-09-13T21:40:41.922 INFO:tasks.workunit.client.1.smithi116.stdout:5/399: sync 2024-09-13T21:40:41.923 INFO:tasks.workunit.client.1.smithi116.stdout:4/366: unlink d0/ce 0 2024-09-13T21:40:41.924 INFO:tasks.workunit.client.1.smithi116.stdout:3/448: write d3/db/d10/d1d/f2d [443382,45054] 0 2024-09-13T21:40:41.924 INFO:tasks.workunit.client.1.smithi116.stdout:3/449: readlink d3/db/d10/d1d/d5f/d6f/l7b 0 2024-09-13T21:40:41.925 INFO:tasks.workunit.client.1.smithi116.stdout:8/301: rename d2/d10/f2c to d2/d10/d19/d3a/f5f 0 2024-09-13T21:40:41.926 INFO:tasks.workunit.client.1.smithi116.stdout:2/278: read d0/d7/d2b/f3e [882218,36277] 0 2024-09-13T21:40:41.926 INFO:tasks.workunit.client.1.smithi116.stdout:1/285: creat d4/d14/d52/f64 x:0 0 0 2024-09-13T21:40:41.927 INFO:tasks.workunit.client.1.smithi116.stdout:5/400: symlink d7/d1d/l7d 0 2024-09-13T21:40:41.928 INFO:tasks.workunit.client.1.smithi116.stdout:3/450: mkdir d3/db/d20/d86/da6 0 2024-09-13T21:40:41.929 INFO:tasks.workunit.client.1.smithi116.stdout:3/451: write d3/db/f30 [856969,25337] 0 2024-09-13T21:40:41.929 INFO:tasks.workunit.client.1.smithi116.stdout:3/452: write d3/db/d20/d50/f8b [717118,73608] 0 2024-09-13T21:40:41.930 INFO:tasks.workunit.client.1.smithi116.stdout:3/453: truncate d3/db/d10/d1c/d34/d55/d57/f7a 874794 0 2024-09-13T21:40:41.930 INFO:tasks.workunit.client.1.smithi116.stdout:8/302: creat d2/d27/f60 x:0 0 0 2024-09-13T21:40:41.933 INFO:tasks.workunit.client.1.smithi116.stdout:4/367: rename d0/dd/d13/f61 to d0/dd/d48/f6a 0 2024-09-13T21:40:41.934 INFO:tasks.workunit.client.1.smithi116.stdout:1/286: creat d4/d23/d57/f65 x:0 0 0 2024-09-13T21:40:41.934 INFO:tasks.workunit.client.1.smithi116.stdout:5/401: write d7/fc [1992295,117129] 0 2024-09-13T21:40:41.934 INFO:tasks.workunit.client.1.smithi116.stdout:1/287: truncate d4/d14/f24 988890 0 2024-09-13T21:40:41.934 INFO:tasks.workunit.client.1.smithi116.stdout:0/251: dread d2/d5/f1f [0,4194304] 0 2024-09-13T21:40:41.934 INFO:tasks.workunit.client.1.smithi116.stdout:0/252: creat d2/d5/f50 x:0 0 0 2024-09-13T21:40:41.935 INFO:tasks.workunit.client.1.smithi116.stdout:3/454: creat d3/db/d10/d1d/d5f/fa7 x:0 0 0 2024-09-13T21:40:41.935 INFO:tasks.workunit.client.1.smithi116.stdout:5/402: dread d7/f25 [0,4194304] 0 2024-09-13T21:40:41.936 INFO:tasks.workunit.client.1.smithi116.stdout:2/279: rename d0/d7/f43 to d0/f63 0 2024-09-13T21:40:41.937 INFO:tasks.workunit.client.1.smithi116.stdout:4/368: mkdir d0/dd/d6b 0 2024-09-13T21:40:41.939 INFO:tasks.workunit.client.1.smithi116.stdout:0/253: mkdir d2/dc/d12/d51 0 2024-09-13T21:40:41.940 INFO:tasks.workunit.client.1.smithi116.stdout:3/455: truncate d3/db/d10/d1d/d2f/d61/f2a 352527 0 2024-09-13T21:40:41.942 INFO:tasks.workunit.client.1.smithi116.stdout:5/403: rename d7/d40/d53/f59 to d7/da/d5e/d65/d6f/f7e 0 2024-09-13T21:40:41.944 INFO:tasks.workunit.client.1.smithi116.stdout:2/280: symlink d0/d7/l64 0 2024-09-13T21:40:41.944 INFO:tasks.workunit.client.1.smithi116.stdout:2/281: write d0/d7/f1e [5791331,100228] 0 2024-09-13T21:40:41.944 INFO:tasks.workunit.client.1.smithi116.stdout:2/282: chown d0/l53 0 1 2024-09-13T21:40:41.944 INFO:tasks.workunit.client.1.smithi116.stdout:2/283: truncate d0/d7/d2b/d2c/d62/f4a 935126 0 2024-09-13T21:40:41.945 INFO:tasks.workunit.client.1.smithi116.stdout:4/369: mknod d0/dd/d13/d4e/c6c 0 2024-09-13T21:40:41.946 INFO:tasks.workunit.client.1.smithi116.stdout:3/456: dread d3/db/f5e [0,4194304] 0 2024-09-13T21:40:41.948 INFO:tasks.workunit.client.1.smithi116.stdout:4/370: creat d0/d32/d5f/d67/f6d x:0 0 0 2024-09-13T21:40:41.949 INFO:tasks.workunit.client.1.smithi116.stdout:3/457: creat d3/db/d10/d99/fa8 x:0 0 0 2024-09-13T21:40:41.949 INFO:tasks.workunit.client.1.smithi116.stdout:5/404: symlink d7/l7f 0 2024-09-13T21:40:41.949 INFO:tasks.workunit.client.1.smithi116.stdout:4/371: chown d0/c2d 760 1 2024-09-13T21:40:41.950 INFO:tasks.workunit.client.1.smithi116.stdout:5/405: mkdir d7/d40/d80 0 2024-09-13T21:40:41.951 INFO:tasks.workunit.client.1.smithi116.stdout:5/406: link d7/f5d d7/d40/f81 0 2024-09-13T21:40:41.956 INFO:tasks.workunit.client.1.smithi116.stdout:5/407: dread d7/d1d/d46/d5c/f63 [0,4194304] 0 2024-09-13T21:40:41.958 INFO:tasks.workunit.client.1.smithi116.stdout:5/408: write d7/d1d/f70 [572874,7747] 0 2024-09-13T21:40:41.961 INFO:tasks.workunit.client.1.smithi116.stdout:7/383: dwrite d5/f6c [0,4194304] 0 2024-09-13T21:40:41.961 INFO:tasks.workunit.client.1.smithi116.stdout:7/384: fsync d5/d9/d1c/f3b 0 2024-09-13T21:40:41.961 INFO:tasks.workunit.client.1.smithi116.stdout:7/385: fsync f2 0 2024-09-13T21:40:41.962 INFO:tasks.workunit.client.1.smithi116.stdout:7/386: write d5/d9/d1c/d22/f7a [490665,124041] 0 2024-09-13T21:40:41.962 INFO:tasks.workunit.client.1.smithi116.stdout:6/303: dwrite d8/d15/d2e/f69 [0,4194304] 0 2024-09-13T21:40:41.964 INFO:tasks.workunit.client.1.smithi116.stdout:3/458: write d3/db/d10/d1c/d34/d47/f51 [3606867,23850] 0 2024-09-13T21:40:41.964 INFO:tasks.workunit.client.1.smithi116.stdout:1/288: dwrite d4/d14/d44/f55 [0,4194304] 0 2024-09-13T21:40:41.965 INFO:tasks.workunit.client.1.smithi116.stdout:1/289: stat d4/f20 0 2024-09-13T21:40:41.965 INFO:tasks.workunit.client.1.smithi116.stdout:3/459: truncate d3/db/d10/d1c/d34/d55/fa4 340491 0 2024-09-13T21:40:41.965 INFO:tasks.workunit.client.1.smithi116.stdout:1/290: rename d4 to d4/d14/d2a/d66 22 2024-09-13T21:40:41.965 INFO:tasks.workunit.client.1.smithi116.stdout:3/460: chown d3/db/d10/d1d/d2f/f38 1065 1 2024-09-13T21:40:41.965 INFO:tasks.workunit.client.1.smithi116.stdout:3/461: creat d3/db/d10/d1d/fa9 x:0 0 0 2024-09-13T21:40:41.965 INFO:tasks.workunit.client.1.smithi116.stdout:3/462: chown d3/db/d10/d1c/d34/d55/fa4 8199566 1 2024-09-13T21:40:41.965 INFO:tasks.workunit.client.1.smithi116.stdout:3/463: write d3/db/d10/d1d/f60 [296183,122078] 0 2024-09-13T21:40:41.965 INFO:tasks.workunit.client.1.smithi116.stdout:3/464: stat d3/db/d10/d99/fa8 0 2024-09-13T21:40:41.965 INFO:tasks.workunit.client.1.smithi116.stdout:7/387: mknod d5/d9/db/d21/d6e/d6f/c7c 0 2024-09-13T21:40:41.966 INFO:tasks.workunit.client.1.smithi116.stdout:1/291: write d4/d14/d41/f49 [83211,109222] 0 2024-09-13T21:40:41.966 INFO:tasks.workunit.client.1.smithi116.stdout:1/292: chown d4/c6 6159 1 2024-09-13T21:40:41.968 INFO:tasks.workunit.client.1.smithi116.stdout:5/409: dread d7/d1d/f70 [0,4194304] 0 2024-09-13T21:40:41.968 INFO:tasks.workunit.client.1.smithi116.stdout:4/372: dwrite d0/d56/f69 [0,4194304] 0 2024-09-13T21:40:41.969 INFO:tasks.workunit.client.1.smithi116.stdout:6/304: symlink d8/d10/d33/l6d 0 2024-09-13T21:40:41.969 INFO:tasks.workunit.client.1.smithi116.stdout:6/305: readlink d8/d15/d2e/l51 0 2024-09-13T21:40:41.969 INFO:tasks.workunit.client.1.smithi116.stdout:6/306: write d8/d15/d2e/d2f/f35 [904138,108444] 0 2024-09-13T21:40:41.971 INFO:tasks.workunit.client.1.smithi116.stdout:3/465: mknod d3/db/d20/d86/da6/caa 0 2024-09-13T21:40:41.971 INFO:tasks.workunit.client.1.smithi116.stdout:3/466: fsync d3/db/d10/d1c/d34/d55/d57/f7a 0 2024-09-13T21:40:41.972 INFO:tasks.workunit.client.1.smithi116.stdout:7/388: link d5/d9/d1c/d22/f7a d5/d9/d1c/d22/d24/f7d 0 2024-09-13T21:40:41.973 INFO:tasks.workunit.client.1.smithi116.stdout:3/467: dread d3/db/f5e [0,4194304] 0 2024-09-13T21:40:41.974 INFO:tasks.workunit.client.1.smithi116.stdout:1/293: creat d4/d14/d44/f67 x:0 0 0 2024-09-13T21:40:41.977 INFO:tasks.workunit.client.1.smithi116.stdout:5/410: symlink d7/d1d/d64/l82 0 2024-09-13T21:40:41.982 INFO:tasks.workunit.client.1.smithi116.stdout:6/307: link d8/d1e/f31 d8/d15/d2e/d2f/d57/f6e 0 2024-09-13T21:40:41.986 INFO:tasks.workunit.client.1.smithi116.stdout:4/373: dwrite d0/dd/d13/f3c [0,4194304] 0 2024-09-13T21:40:41.986 INFO:tasks.workunit.client.1.smithi116.stdout:7/389: creat d5/d9/db/d21/f7e x:0 0 0 2024-09-13T21:40:41.988 INFO:tasks.workunit.client.1.smithi116.stdout:1/294: mknod d4/d23/c68 0 2024-09-13T21:40:41.995 INFO:tasks.workunit.client.1.smithi116.stdout:4/374: creat d0/d56/d57/f6e x:0 0 0 2024-09-13T21:40:41.996 INFO:tasks.workunit.client.1.smithi116.stdout:7/390: truncate d5/d9/d27/d31/d38/d48/f77 2904096 0 2024-09-13T21:40:41.997 INFO:tasks.workunit.client.1.smithi116.stdout:7/391: creat d5/d9/d1c/d37/f7f x:0 0 0 2024-09-13T21:40:41.998 INFO:tasks.workunit.client.1.smithi116.stdout:1/295: unlink f3 0 2024-09-13T21:40:41.999 INFO:tasks.workunit.client.1.smithi116.stdout:6/308: symlink d8/l6f 0 2024-09-13T21:40:41.999 INFO:tasks.workunit.client.1.smithi116.stdout:6/309: chown d8/d15/d2e/d2f/l4b 195411876 1 2024-09-13T21:40:42.002 INFO:tasks.workunit.client.1.smithi116.stdout:6/310: unlink d8/d1e/l41 0 2024-09-13T21:40:42.002 INFO:tasks.workunit.client.1.smithi116.stdout:6/311: stat d8/d1e/f63 0 2024-09-13T21:40:42.004 INFO:tasks.workunit.client.1.smithi116.stdout:6/312: write d8/d10/d33/f4a [4520996,3842] 0 2024-09-13T21:40:42.005 INFO:tasks.workunit.client.1.smithi116.stdout:6/313: mkdir d8/d17/d70 0 2024-09-13T21:40:42.007 INFO:tasks.workunit.client.1.smithi116.stdout:6/314: creat d8/d17/f71 x:0 0 0 2024-09-13T21:40:42.008 INFO:tasks.workunit.client.1.smithi116.stdout:6/315: rmdir d8/d10/d24 39 2024-09-13T21:40:42.009 INFO:tasks.workunit.client.1.smithi116.stdout:6/316: creat d8/d15/d2e/d2f/d57/f72 x:0 0 0 2024-09-13T21:40:42.015 INFO:tasks.workunit.client.1.smithi116.stdout:4/375: dread d0/dd/f3b [0,4194304] 0 2024-09-13T21:40:42.015 INFO:tasks.workunit.client.1.smithi116.stdout:4/376: chown d0/c45 1145992979 1 2024-09-13T21:40:42.017 INFO:tasks.workunit.client.1.smithi116.stdout:4/377: creat d0/d32/d5d/f6f x:0 0 0 2024-09-13T21:40:42.017 INFO:tasks.workunit.client.1.smithi116.stdout:4/378: truncate d0/dd/f2e 3065792 0 2024-09-13T21:40:42.021 INFO:tasks.workunit.client.1.smithi116.stdout:5/411: dwrite d7/d1d/f29 [0,4194304] 0 2024-09-13T21:40:42.021 INFO:tasks.workunit.client.1.smithi116.stdout:5/412: readlink d7/da/d5e/l5f 0 2024-09-13T21:40:42.022 INFO:tasks.workunit.client.1.smithi116.stdout:5/413: symlink d7/d1d/d46/l83 0 2024-09-13T21:40:42.028 INFO:tasks.workunit.client.1.smithi116.stdout:6/317: dwrite d8/d10/d33/f52 [0,4194304] 0 2024-09-13T21:40:42.032 INFO:tasks.workunit.client.1.smithi116.stdout:5/414: dread d7/d40/f75 [0,4194304] 0 2024-09-13T21:40:42.035 INFO:tasks.workunit.client.1.smithi116.stdout:6/318: rename d8/d15/f40 to d8/d15/d2e/d2f/d38/f73 0 2024-09-13T21:40:42.038 INFO:tasks.workunit.client.1.smithi116.stdout:7/392: fsync d5/d9/d1c/d37/f7f 0 2024-09-13T21:40:42.047 INFO:tasks.workunit.client.1.smithi116.stdout:4/379: dwrite d0/dd/d13/f46 [0,4194304] 0 2024-09-13T21:40:42.047 INFO:tasks.workunit.client.1.smithi116.stdout:5/415: write d7/f5d [1325567,53064] 0 2024-09-13T21:40:42.047 INFO:tasks.workunit.client.1.smithi116.stdout:4/380: write d0/dd/f1b [5041261,14502] 0 2024-09-13T21:40:42.047 INFO:tasks.workunit.client.1.smithi116.stdout:4/381: chown d0/dd/f2e 0 1 2024-09-13T21:40:42.049 INFO:tasks.workunit.client.1.smithi116.stdout:5/416: symlink d7/d40/d53/l84 0 2024-09-13T21:40:42.051 INFO:tasks.workunit.client.1.smithi116.stdout:4/382: getdents d0/dd 0 2024-09-13T21:40:42.051 INFO:tasks.workunit.client.1.smithi116.stdout:4/383: chown d0/dd/d13/f41 1983057 1 2024-09-13T21:40:42.051 INFO:tasks.workunit.client.1.smithi116.stdout:4/384: truncate d0/d32/f49 595098 0 2024-09-13T21:40:42.052 INFO:tasks.workunit.client.1.smithi116.stdout:4/385: creat d0/dd/f70 x:0 0 0 2024-09-13T21:40:42.053 INFO:tasks.workunit.client.1.smithi116.stdout:7/393: dread d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:42.053 INFO:tasks.workunit.client.1.smithi116.stdout:4/386: mkdir d0/dd/d6b/d71 0 2024-09-13T21:40:42.054 INFO:tasks.workunit.client.1.smithi116.stdout:7/394: mkdir d5/d9/db/d21/d6e/d6f/d70/d80 0 2024-09-13T21:40:42.055 INFO:tasks.workunit.client.1.smithi116.stdout:7/395: symlink d5/d9/d27/d31/d38/d48/l81 0 2024-09-13T21:40:42.056 INFO:tasks.workunit.client.1.smithi116.stdout:7/396: symlink d5/d9/d1c/d37/l82 0 2024-09-13T21:40:42.056 INFO:tasks.workunit.client.1.smithi116.stdout:7/397: read d5/d9/db/d21/f3e [700417,64433] 0 2024-09-13T21:40:42.057 INFO:tasks.workunit.client.1.smithi116.stdout:5/417: write d7/d1d/f45 [240255,98862] 0 2024-09-13T21:40:42.058 INFO:tasks.workunit.client.1.smithi116.stdout:7/398: creat d5/d9/db/d21/d6e/d6f/f83 x:0 0 0 2024-09-13T21:40:42.058 INFO:tasks.workunit.client.1.smithi116.stdout:7/399: dread - d5/d9/d1c/d37/f7f zero size 2024-09-13T21:40:42.058 INFO:tasks.workunit.client.1.smithi116.stdout:5/418: mkdir d7/d1d/d46/d85 0 2024-09-13T21:40:42.058 INFO:tasks.workunit.client.1.smithi116.stdout:6/319: dwrite d8/d1e/f28 [4194304,4194304] 0 2024-09-13T21:40:42.059 INFO:tasks.workunit.client.1.smithi116.stdout:7/400: creat d5/d9/db/d21/d6e/d6f/d70/f84 x:0 0 0 2024-09-13T21:40:42.059 INFO:tasks.workunit.client.1.smithi116.stdout:4/387: dread d0/f30 [0,4194304] 0 2024-09-13T21:40:42.060 INFO:tasks.workunit.client.1.smithi116.stdout:5/419: rename d7 to d7/d86 22 2024-09-13T21:40:42.062 INFO:tasks.workunit.client.1.smithi116.stdout:4/388: symlink d0/dd/l72 0 2024-09-13T21:40:42.062 INFO:tasks.workunit.client.1.smithi116.stdout:6/320: dread d8/d10/d33/f3b [0,4194304] 0 2024-09-13T21:40:42.062 INFO:tasks.workunit.client.1.smithi116.stdout:5/420: mkdir d7/d1d/d64/d87 0 2024-09-13T21:40:42.066 INFO:tasks.workunit.client.1.smithi116.stdout:5/421: creat d7/d1d/d64/d87/f88 x:0 0 0 2024-09-13T21:40:42.066 INFO:tasks.workunit.client.1.smithi116.stdout:5/422: stat d7/f72 0 2024-09-13T21:40:42.068 INFO:tasks.workunit.client.1.smithi116.stdout:4/389: rmdir d0/dd/d13 39 2024-09-13T21:40:42.068 INFO:tasks.workunit.client.1.smithi116.stdout:7/401: dread f2 [0,4194304] 0 2024-09-13T21:40:42.070 INFO:tasks.workunit.client.1.smithi116.stdout:5/423: write d7/da/f48 [487309,53875] 0 2024-09-13T21:40:42.070 INFO:tasks.workunit.client.1.smithi116.stdout:5/424: chown d7/d1d/d46/d5c/l73 7 1 2024-09-13T21:40:42.071 INFO:tasks.workunit.client.1.smithi116.stdout:4/390: link d0/d32/f53 d0/dd/d13/d4e/f73 0 2024-09-13T21:40:42.075 INFO:tasks.workunit.client.1.smithi116.stdout:5/425: truncate d7/f3d 11598715 0 2024-09-13T21:40:42.077 INFO:tasks.workunit.client.1.smithi116.stdout:5/426: rename d7/d40/f5b to d7/d40/d53/f89 0 2024-09-13T21:40:42.077 INFO:tasks.workunit.client.1.smithi116.stdout:5/427: write d7/f12 [2456659,79345] 0 2024-09-13T21:40:42.077 INFO:tasks.workunit.client.1.smithi116.stdout:5/428: dread - d7/d1d/d46/d5c/f78 zero size 2024-09-13T21:40:42.077 INFO:tasks.workunit.client.1.smithi116.stdout:5/429: creat d7/d1d/d64/d87/f8a x:0 0 0 2024-09-13T21:40:42.077 INFO:tasks.workunit.client.1.smithi116.stdout:5/430: chown d7/da/d5e/c44 0 1 2024-09-13T21:40:42.077 INFO:tasks.workunit.client.1.smithi116.stdout:7/402: dread d5/f6c [0,4194304] 0 2024-09-13T21:40:42.077 INFO:tasks.workunit.client.1.smithi116.stdout:7/403: readlink d5/d9/d27/l47 0 2024-09-13T21:40:42.077 INFO:tasks.workunit.client.1.smithi116.stdout:7/404: chown d5/d9/d27/c73 185685276 1 2024-09-13T21:40:42.078 INFO:tasks.workunit.client.1.smithi116.stdout:7/405: chown d5/d9/f10 118 1 2024-09-13T21:40:42.078 INFO:tasks.workunit.client.1.smithi116.stdout:5/431: creat d7/d1d/d46/f8b x:0 0 0 2024-09-13T21:40:42.078 INFO:tasks.workunit.client.1.smithi116.stdout:5/432: write d7/da/d5e/f7a [450974,25075] 0 2024-09-13T21:40:42.078 INFO:tasks.workunit.client.1.smithi116.stdout:7/406: getdents d5/d9/d27/d31 0 2024-09-13T21:40:42.078 INFO:tasks.workunit.client.1.smithi116.stdout:4/391: dread d0/f43 [0,4194304] 0 2024-09-13T21:40:42.079 INFO:tasks.workunit.client.1.smithi116.stdout:5/433: link d7/d40/d53/f6e d7/da/d5e/d65/f8c 0 2024-09-13T21:40:42.082 INFO:tasks.workunit.client.1.smithi116.stdout:5/434: symlink d7/d1d/d64/d87/l8d 0 2024-09-13T21:40:42.113 INFO:tasks.workunit.client.1.smithi116.stdout:5/435: dwrite d7/da/d5e/d65/d6f/f7e [0,4194304] 0 2024-09-13T21:40:42.113 INFO:tasks.workunit.client.1.smithi116.stdout:5/436: creat d7/d40/f8e x:0 0 0 2024-09-13T21:40:42.116 INFO:tasks.workunit.client.1.smithi116.stdout:7/407: dwrite f2 [0,4194304] 0 2024-09-13T21:40:42.116 INFO:tasks.workunit.client.1.smithi116.stdout:7/408: chown d5/d9/d1c/d22/d24/d3a/f46 3793 1 2024-09-13T21:40:42.116 INFO:tasks.workunit.client.1.smithi116.stdout:7/409: chown d5/ld 13322205 1 2024-09-13T21:40:42.116 INFO:tasks.workunit.client.1.smithi116.stdout:5/437: mkdir d7/da/d5e/d79/d8f 0 2024-09-13T21:40:42.116 INFO:tasks.workunit.client.1.smithi116.stdout:4/392: dwrite d0/f30 [0,4194304] 0 2024-09-13T21:40:42.119 INFO:tasks.workunit.client.1.smithi116.stdout:5/438: truncate d7/d1d/d46/d5c/f63 778769 0 2024-09-13T21:40:42.120 INFO:tasks.workunit.client.1.smithi116.stdout:4/393: symlink d0/dd/d6b/d71/l74 0 2024-09-13T21:40:42.121 INFO:tasks.workunit.client.1.smithi116.stdout:7/410: rename d5/d9/db/l36 to d5/d9/d27/d31/d38/d42/l85 0 2024-09-13T21:40:42.123 INFO:tasks.workunit.client.1.smithi116.stdout:5/439: mkdir d7/d40/d90 0 2024-09-13T21:40:42.125 INFO:tasks.workunit.client.1.smithi116.stdout:7/411: getdents d5/d9/d1c/d22/d24/d6b/d72 0 2024-09-13T21:40:42.126 INFO:tasks.workunit.client.1.smithi116.stdout:7/412: dread - d5/d9/db/d21/f63 zero size 2024-09-13T21:40:42.131 INFO:tasks.workunit.client.1.smithi116.stdout:4/394: rmdir d0/d32 39 2024-09-13T21:40:42.133 INFO:tasks.workunit.client.1.smithi116.stdout:7/413: rename d5/d9/d1c/d22/d24/f7d to d5/d9/d1c/d2e/f86 0 2024-09-13T21:40:42.133 INFO:tasks.workunit.client.1.smithi116.stdout:7/414: write d5/f59 [9068244,5198] 0 2024-09-13T21:40:42.134 INFO:tasks.workunit.client.1.smithi116.stdout:5/440: getdents d7/d1d/d64/d87 0 2024-09-13T21:40:42.139 INFO:tasks.workunit.client.1.smithi116.stdout:4/395: rename d0/d56/c5e to d0/d32/d5d/c75 0 2024-09-13T21:40:42.142 INFO:tasks.workunit.client.1.smithi116.stdout:4/396: rename d0/dd/c19 to d0/d32/d5f/d67/c76 0 2024-09-13T21:40:42.142 INFO:tasks.workunit.client.1.smithi116.stdout:4/397: rename d0 to d0/dd/d77 22 2024-09-13T21:40:42.143 INFO:tasks.workunit.client.1.smithi116.stdout:4/398: creat d0/d32/d5d/f78 x:0 0 0 2024-09-13T21:40:42.147 INFO:tasks.workunit.client.1.smithi116.stdout:7/415: dwrite d5/d9/d1c/d37/f62 [0,4194304] 0 2024-09-13T21:40:42.149 INFO:tasks.workunit.client.1.smithi116.stdout:7/416: getdents d5/d9/d1c/d22/d24/d5f 0 2024-09-13T21:40:42.155 INFO:tasks.workunit.client.1.smithi116.stdout:7/417: dread d5/d9/db/ff [0,4194304] 0 2024-09-13T21:40:42.155 INFO:tasks.workunit.client.1.smithi116.stdout:7/418: chown d5/d9/db/d21/f63 415102 1 2024-09-13T21:40:42.156 INFO:tasks.workunit.client.1.smithi116.stdout:7/419: symlink d5/d9/db/d21/l87 0 2024-09-13T21:40:42.156 INFO:tasks.workunit.client.1.smithi116.stdout:7/420: dread - d5/d9/d1c/d37/f7f zero size 2024-09-13T21:40:42.157 INFO:tasks.workunit.client.1.smithi116.stdout:7/421: unlink d5/d9/db/l7 0 2024-09-13T21:40:42.158 INFO:tasks.workunit.client.1.smithi116.stdout:7/422: truncate d5/d9/d1c/d22/d24/d6b/d72/f79 92428 0 2024-09-13T21:40:42.158 INFO:tasks.workunit.client.1.smithi116.stdout:7/423: fsync d5/d9/db/d21/f63 0 2024-09-13T21:40:42.159 INFO:tasks.workunit.client.1.smithi116.stdout:4/399: dwrite d0/d32/f52 [0,4194304] 0 2024-09-13T21:40:42.160 INFO:tasks.workunit.client.1.smithi116.stdout:7/424: rename d5/d9/d1c/d37/f7f to d5/d9/db/d21/d6e/d6f/f88 0 2024-09-13T21:40:42.161 INFO:tasks.workunit.client.1.smithi116.stdout:7/425: rename d5/d9/d27/l61 to d5/d9/d1c/d22/d24/d6b/l89 0 2024-09-13T21:40:42.167 INFO:tasks.workunit.client.1.smithi116.stdout:7/426: dread d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:42.167 INFO:tasks.workunit.client.1.smithi116.stdout:7/427: dread - d5/d9/d27/d31/d38/d48/f75 zero size 2024-09-13T21:40:42.167 INFO:tasks.workunit.client.1.smithi116.stdout:7/428: read - d5/d9/db/d21/d6e/d6f/f83 zero size 2024-09-13T21:40:42.168 INFO:tasks.workunit.client.1.smithi116.stdout:7/429: creat d5/d9/d1c/d22/d24/d3a/f8a x:0 0 0 2024-09-13T21:40:42.168 INFO:tasks.workunit.client.1.smithi116.stdout:7/430: write d5/d9/d27/d31/d38/d48/f75 [818641,56789] 0 2024-09-13T21:40:42.168 INFO:tasks.workunit.client.1.smithi116.stdout:7/431: truncate d5/d9/db/f45 5122253 0 2024-09-13T21:40:42.168 INFO:tasks.workunit.client.1.smithi116.stdout:7/432: chown d5/d9/db/l60 41 1 2024-09-13T21:40:42.169 INFO:tasks.workunit.client.1.smithi116.stdout:7/433: mknod d5/d9/d27/d31/d38/d48/c8b 0 2024-09-13T21:40:42.170 INFO:tasks.workunit.client.1.smithi116.stdout:4/400: dread d0/dd/d13/f4c [0,4194304] 0 2024-09-13T21:40:42.172 INFO:tasks.workunit.client.1.smithi116.stdout:7/434: creat d5/d9/d1c/d22/d24/d6b/d72/f8c x:0 0 0 2024-09-13T21:40:42.172 INFO:tasks.workunit.client.1.smithi116.stdout:7/435: dread - d5/d9/db/d21/d6e/d6f/f83 zero size 2024-09-13T21:40:42.173 INFO:tasks.workunit.client.1.smithi116.stdout:4/401: mknod d0/dd/d6b/d71/c79 0 2024-09-13T21:40:42.175 INFO:tasks.workunit.client.1.smithi116.stdout:7/436: link d5/d9/d27/c6d d5/d9/d1c/c8d 0 2024-09-13T21:40:42.175 INFO:tasks.workunit.client.1.smithi116.stdout:4/402: mkdir d0/dd/d13/d5a/d7a 0 2024-09-13T21:40:42.179 INFO:tasks.workunit.client.1.smithi116.stdout:7/437: getdents d5/d9/d1c/d22 0 2024-09-13T21:40:42.179 INFO:tasks.workunit.client.1.smithi116.stdout:7/438: dread - d5/d9/d27/d31/d38/f6a zero size 2024-09-13T21:40:42.180 INFO:tasks.workunit.client.1.smithi116.stdout:7/439: truncate d5/d9/d1c/d2e/f86 383928 0 2024-09-13T21:40:42.180 INFO:tasks.workunit.client.1.smithi116.stdout:4/403: getdents d0/dd/d6b/d71 0 2024-09-13T21:40:42.182 INFO:tasks.workunit.client.1.smithi116.stdout:7/440: creat d5/d9/d27/f8e x:0 0 0 2024-09-13T21:40:42.213 INFO:tasks.workunit.client.1.smithi116.stdout:4/404: dwrite d0/dd/d13/f3c [0,4194304] 0 2024-09-13T21:40:42.213 INFO:tasks.workunit.client.1.smithi116.stdout:7/441: dwrite d5/f59 [0,4194304] 0 2024-09-13T21:40:42.215 INFO:tasks.workunit.client.1.smithi116.stdout:7/442: unlink d5/d9/d27/l7b 0 2024-09-13T21:40:42.215 INFO:tasks.workunit.client.1.smithi116.stdout:7/443: stat d5/d9/db/d21/f53 0 2024-09-13T21:40:42.216 INFO:tasks.workunit.client.1.smithi116.stdout:7/444: symlink d5/d9/db/d21/d6e/d6f/d70/d80/l8f 0 2024-09-13T21:40:42.217 INFO:tasks.workunit.client.1.smithi116.stdout:7/445: chown d5/d9/db/d21/f63 7 1 2024-09-13T21:40:42.218 INFO:tasks.workunit.client.1.smithi116.stdout:7/446: dread d5/d9/db/d21/f3e [0,4194304] 0 2024-09-13T21:40:42.218 INFO:tasks.workunit.client.1.smithi116.stdout:7/447: readlink d5/d9/d27/d31/l34 0 2024-09-13T21:40:42.227 INFO:tasks.workunit.client.1.smithi116.stdout:7/448: dread f2 [0,4194304] 0 2024-09-13T21:40:42.227 INFO:tasks.workunit.client.1.smithi116.stdout:7/449: write d5/d9/d1c/d2e/f86 [979117,124597] 0 2024-09-13T21:40:42.227 INFO:tasks.workunit.client.1.smithi116.stdout:7/450: creat d5/d9/d27/f90 x:0 0 0 2024-09-13T21:40:42.227 INFO:tasks.workunit.client.1.smithi116.stdout:7/451: chown d5/d9/d27/d31/f71 432955 1 2024-09-13T21:40:42.227 INFO:tasks.workunit.client.1.smithi116.stdout:4/405: dwrite d0/dd/d48/f5c [0,4194304] 0 2024-09-13T21:40:42.227 INFO:tasks.workunit.client.1.smithi116.stdout:4/406: creat d0/dd/f7b x:0 0 0 2024-09-13T21:40:42.227 INFO:tasks.workunit.client.1.smithi116.stdout:4/407: truncate d0/d32/d5d/f6f 697981 0 2024-09-13T21:40:42.255 INFO:tasks.workunit.client.1.smithi116.stdout:4/408: dwrite d0/f31 [0,4194304] 0 2024-09-13T21:40:42.256 INFO:tasks.workunit.client.1.smithi116.stdout:4/409: unlink d0/d32/d5f/d67/f6d 0 2024-09-13T21:40:42.257 INFO:tasks.workunit.client.1.smithi116.stdout:7/452: dwrite d5/d9/db/f3c [0,4194304] 0 2024-09-13T21:40:42.261 INFO:tasks.workunit.client.1.smithi116.stdout:7/453: creat d5/d9/db/d21/d6e/d6f/d70/d80/f91 x:0 0 0 2024-09-13T21:40:42.266 INFO:tasks.workunit.client.1.smithi116.stdout:4/410: rename d0/d32/d5f/d67 to d0/dd/d7c 0 2024-09-13T21:40:42.267 INFO:tasks.workunit.client.1.smithi116.stdout:4/411: rmdir d0/dd/d13/d4e 39 2024-09-13T21:40:42.269 INFO:tasks.workunit.client.1.smithi116.stdout:4/412: rename d0/dd/c50 to d0/d32/c7d 0 2024-09-13T21:40:42.269 INFO:tasks.workunit.client.1.smithi116.stdout:4/413: stat d0/dd/d7c/c76 0 2024-09-13T21:40:42.269 INFO:tasks.workunit.client.1.smithi116.stdout:4/414: chown d0/d32 476 1 2024-09-13T21:40:42.271 INFO:tasks.workunit.client.1.smithi116.stdout:4/415: symlink d0/dd/d13/l7e 0 2024-09-13T21:40:42.283 INFO:tasks.workunit.client.1.smithi116.stdout:7/454: dwrite f2 [4194304,4194304] 0 2024-09-13T21:40:42.284 INFO:tasks.workunit.client.1.smithi116.stdout:7/455: truncate d5/d9/d1c/f3b 90979 0 2024-09-13T21:40:42.285 INFO:tasks.workunit.client.1.smithi116.stdout:7/456: mknod d5/d9/d1c/d22/c92 0 2024-09-13T21:40:42.286 INFO:tasks.workunit.client.1.smithi116.stdout:7/457: mkdir d5/d9/d1c/d22/d24/d6b/d72/d74/d93 0 2024-09-13T21:40:42.291 INFO:tasks.workunit.client.1.smithi116.stdout:4/416: dwrite d0/dd/f3f [0,4194304] 0 2024-09-13T21:40:42.295 INFO:tasks.workunit.client.1.smithi116.stdout:4/417: creat d0/dd/d13/d4e/f7f x:0 0 0 2024-09-13T21:40:42.296 INFO:tasks.workunit.client.1.smithi116.stdout:4/418: chown d0/dd/f60 230789018 1 2024-09-13T21:40:42.298 INFO:tasks.workunit.client.1.smithi116.stdout:4/419: symlink d0/l80 0 2024-09-13T21:40:42.298 INFO:tasks.workunit.client.1.smithi116.stdout:4/420: fdatasync d0/dd/f3f 0 2024-09-13T21:40:42.306 INFO:tasks.workunit.client.1.smithi116.stdout:9/225: sync 2024-09-13T21:40:42.306 INFO:tasks.workunit.client.1.smithi116.stdout:9/226: readlink d2/d10/d14/l2e 0 2024-09-13T21:40:42.307 INFO:tasks.workunit.client.1.smithi116.stdout:9/227: dread d2/f2b [0,4194304] 0 2024-09-13T21:40:42.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/228: rmdir d2 39 2024-09-13T21:40:42.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/229: mknod d2/d10/d14/d38/d3a/c3f 0 2024-09-13T21:40:42.310 INFO:tasks.workunit.client.1.smithi116.stdout:9/230: rmdir d2/d10/d14/d38/d3a 39 2024-09-13T21:40:42.311 INFO:tasks.workunit.client.1.smithi116.stdout:9/231: dread d2/f2b [0,4194304] 0 2024-09-13T21:40:42.312 INFO:tasks.workunit.client.1.smithi116.stdout:9/232: creat d2/d8/f40 x:0 0 0 2024-09-13T21:40:42.315 INFO:tasks.workunit.client.1.smithi116.stdout:9/233: rmdir d2/d8 39 2024-09-13T21:40:42.316 INFO:tasks.workunit.client.1.smithi116.stdout:0/254: sync 2024-09-13T21:40:42.316 INFO:tasks.workunit.client.1.smithi116.stdout:8/303: sync 2024-09-13T21:40:42.316 INFO:tasks.workunit.client.1.smithi116.stdout:9/234: mkdir d2/d10/d41 0 2024-09-13T21:40:42.316 INFO:tasks.workunit.client.1.smithi116.stdout:9/235: readlink d2/d8/le 0 2024-09-13T21:40:42.317 INFO:tasks.workunit.client.1.smithi116.stdout:8/304: stat d2/d10/d19/l30 0 2024-09-13T21:40:42.317 INFO:tasks.workunit.client.1.smithi116.stdout:9/236: dread d2/f2f [0,4194304] 0 2024-09-13T21:40:42.317 INFO:tasks.workunit.client.1.smithi116.stdout:8/305: mknod d2/d10/d19/d3a/d4c/c61 0 2024-09-13T21:40:42.319 INFO:tasks.workunit.client.1.smithi116.stdout:8/306: truncate d2/d10/d19/f1d 2183582 0 2024-09-13T21:40:42.324 INFO:tasks.workunit.client.1.smithi116.stdout:0/255: dread d2/dc/d47/f4b [0,4194304] 0 2024-09-13T21:40:42.326 INFO:tasks.workunit.client.1.smithi116.stdout:0/256: symlink d2/d5/l52 0 2024-09-13T21:40:42.328 INFO:tasks.workunit.client.1.smithi116.stdout:0/257: mknod d2/d5/d3e/c53 0 2024-09-13T21:40:42.329 INFO:tasks.workunit.client.1.smithi116.stdout:4/421: dwrite d0/d32/f52 [0,4194304] 0 2024-09-13T21:40:42.330 INFO:tasks.workunit.client.1.smithi116.stdout:4/422: dread - d0/d32/f3e zero size 2024-09-13T21:40:42.330 INFO:tasks.workunit.client.1.smithi116.stdout:4/423: write d0/dd/f2e [865357,19524] 0 2024-09-13T21:40:42.331 INFO:tasks.workunit.client.1.smithi116.stdout:4/424: rename d0/d32/c5b to d0/d56/c81 0 2024-09-13T21:40:42.331 INFO:tasks.workunit.client.1.smithi116.stdout:4/425: chown d0/dd/d13/l1c 5153 1 2024-09-13T21:40:42.333 INFO:tasks.workunit.client.1.smithi116.stdout:4/426: creat d0/d32/d5f/f82 x:0 0 0 2024-09-13T21:40:42.334 INFO:tasks.workunit.client.1.smithi116.stdout:4/427: symlink d0/d32/l83 0 2024-09-13T21:40:42.336 INFO:tasks.workunit.client.1.smithi116.stdout:4/428: unlink d0/dd/c40 0 2024-09-13T21:40:42.336 INFO:tasks.workunit.client.1.smithi116.stdout:4/429: mkdir d0/d56/d84 0 2024-09-13T21:40:42.337 INFO:tasks.workunit.client.1.smithi116.stdout:4/430: mkdir d0/d32/d5d/d85 0 2024-09-13T21:40:42.349 INFO:tasks.workunit.client.1.smithi116.stdout:8/307: dwrite d2/d10/d19/d3a/f5f [0,4194304] 0 2024-09-13T21:40:42.349 INFO:tasks.workunit.client.1.smithi116.stdout:9/237: dwrite d2/d10/f20 [0,4194304] 0 2024-09-13T21:40:42.349 INFO:tasks.workunit.client.1.smithi116.stdout:9/238: readlink d2/d10/l1f 0 2024-09-13T21:40:42.350 INFO:tasks.workunit.client.1.smithi116.stdout:0/258: dwrite d2/d5/f44 [0,4194304] 0 2024-09-13T21:40:42.351 INFO:tasks.workunit.client.1.smithi116.stdout:9/239: dread d2/f3 [0,4194304] 0 2024-09-13T21:40:42.353 INFO:tasks.workunit.client.1.smithi116.stdout:0/259: unlink d2/ca 0 2024-09-13T21:40:42.356 INFO:tasks.workunit.client.1.smithi116.stdout:0/260: rename d2/f1d to d2/dc/d12/d28/f54 0 2024-09-13T21:40:42.358 INFO:tasks.workunit.client.1.smithi116.stdout:0/261: unlink d2/d5/l52 0 2024-09-13T21:40:42.368 INFO:tasks.workunit.client.1.smithi116.stdout:0/262: dread d2/dc/f22 [0,4194304] 0 2024-09-13T21:40:42.373 INFO:tasks.workunit.client.1.smithi116.stdout:0/263: link d2/dc/d12/c46 d2/dc/d12/d51/c55 0 2024-09-13T21:40:42.373 INFO:tasks.workunit.client.1.smithi116.stdout:8/308: dwrite d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:42.382 INFO:tasks.workunit.client.1.smithi116.stdout:9/240: dwrite d2/d8/f11 [0,4194304] 0 2024-09-13T21:40:42.384 INFO:tasks.workunit.client.1.smithi116.stdout:9/241: read d2/f2b [41258,112001] 0 2024-09-13T21:40:42.386 INFO:tasks.workunit.client.1.smithi116.stdout:8/309: read d2/d10/d37/f25 [1577271,99775] 0 2024-09-13T21:40:42.387 INFO:tasks.workunit.client.1.smithi116.stdout:8/310: chown d2/d10/d4b/f50 0 1 2024-09-13T21:40:42.391 INFO:tasks.workunit.client.1.smithi116.stdout:8/311: dread d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:42.391 INFO:tasks.workunit.client.1.smithi116.stdout:8/312: write d2/f8 [3932401,57043] 0 2024-09-13T21:40:42.392 INFO:tasks.workunit.client.1.smithi116.stdout:8/313: mkdir d2/d27/d62 0 2024-09-13T21:40:42.420 INFO:tasks.workunit.client.1.smithi116.stdout:0/264: dwrite d2/dc/f29 [0,4194304] 0 2024-09-13T21:40:42.422 INFO:tasks.workunit.client.1.smithi116.stdout:9/242: dwrite d2/fc [0,4194304] 0 2024-09-13T21:40:42.422 INFO:tasks.workunit.client.1.smithi116.stdout:8/314: dwrite d2/d10/d19/d3a/f3b [0,4194304] 0 2024-09-13T21:40:42.423 INFO:tasks.workunit.client.1.smithi116.stdout:8/315: read - d2/d10/d19/d3a/f55 zero size 2024-09-13T21:40:42.426 INFO:tasks.workunit.client.1.smithi116.stdout:0/265: fsync d2/dc/d12/d28/f54 0 2024-09-13T21:40:42.426 INFO:tasks.workunit.client.1.smithi116.stdout:0/266: truncate d2/d5/f6 928176 0 2024-09-13T21:40:42.426 INFO:tasks.workunit.client.1.smithi116.stdout:0/267: truncate d2/dc/d12/d28/f54 5153161 0 2024-09-13T21:40:42.431 INFO:tasks.workunit.client.1.smithi116.stdout:9/243: dread d2/d10/f20 [0,4194304] 0 2024-09-13T21:40:42.434 INFO:tasks.workunit.client.1.smithi116.stdout:8/316: rename d2/d10/l49 to d2/d10/d19/d3a/d4c/l63 0 2024-09-13T21:40:42.437 INFO:tasks.workunit.client.1.smithi116.stdout:1/296: sync 2024-09-13T21:40:42.437 INFO:tasks.workunit.client.1.smithi116.stdout:6/321: sync 2024-09-13T21:40:42.437 INFO:tasks.workunit.client.1.smithi116.stdout:1/297: stat d4/c5 0 2024-09-13T21:40:42.437 INFO:tasks.workunit.client.1.smithi116.stdout:2/284: sync 2024-09-13T21:40:42.437 INFO:tasks.workunit.client.1.smithi116.stdout:3/468: sync 2024-09-13T21:40:42.438 INFO:tasks.workunit.client.1.smithi116.stdout:9/244: truncate d2/f2d 1357801 0 2024-09-13T21:40:42.440 INFO:tasks.workunit.client.1.smithi116.stdout:1/298: mknod d4/d14/c69 0 2024-09-13T21:40:42.440 INFO:tasks.workunit.client.1.smithi116.stdout:5/441: sync 2024-09-13T21:40:42.442 INFO:tasks.workunit.client.1.smithi116.stdout:6/322: mknod d8/d10/d65/c74 0 2024-09-13T21:40:42.442 INFO:tasks.workunit.client.1.smithi116.stdout:6/323: fsync d8/d10/d33/f50 0 2024-09-13T21:40:42.442 INFO:tasks.workunit.client.1.smithi116.stdout:6/324: creat d8/d15/d2e/d2f/d38/f75 x:0 0 0 2024-09-13T21:40:42.444 INFO:tasks.workunit.client.1.smithi116.stdout:3/469: truncate d3/db/d10/d1d/d5f/f94 4824082 0 2024-09-13T21:40:42.446 INFO:tasks.workunit.client.1.smithi116.stdout:1/299: rename d4/c9 to d4/d14/d52/d2f/d5c/c6a 0 2024-09-13T21:40:42.446 INFO:tasks.workunit.client.1.smithi116.stdout:1/300: chown d4/f20 1623 1 2024-09-13T21:40:42.446 INFO:tasks.workunit.client.1.smithi116.stdout:0/268: truncate d2/d5/f6 608554 0 2024-09-13T21:40:42.447 INFO:tasks.workunit.client.1.smithi116.stdout:8/317: dread d2/f8 [4194304,4194304] 0 2024-09-13T21:40:42.447 INFO:tasks.workunit.client.1.smithi116.stdout:5/442: mknod d7/d1d/d46/d5c/c91 0 2024-09-13T21:40:42.447 INFO:tasks.workunit.client.1.smithi116.stdout:5/443: dread - d7/da/d5e/d65/d6a/f76 zero size 2024-09-13T21:40:42.449 INFO:tasks.workunit.client.1.smithi116.stdout:6/325: truncate d8/d10/d33/f67 2515483 0 2024-09-13T21:40:42.449 INFO:tasks.workunit.client.1.smithi116.stdout:6/326: truncate d8/d1e/f63 666546 0 2024-09-13T21:40:42.450 INFO:tasks.workunit.client.1.smithi116.stdout:3/470: creat d3/db/d10/d1d/d2f/d61/fab x:0 0 0 2024-09-13T21:40:42.450 INFO:tasks.workunit.client.1.smithi116.stdout:3/471: write d3/f73 [416769,74054] 0 2024-09-13T21:40:42.453 INFO:tasks.workunit.client.1.smithi116.stdout:1/301: rename d4/d14/d52/l5a to d4/d14/d52/l6b 0 2024-09-13T21:40:42.454 INFO:tasks.workunit.client.1.smithi116.stdout:0/269: unlink d2/d5/f44 0 2024-09-13T21:40:42.455 INFO:tasks.workunit.client.1.smithi116.stdout:3/472: creat d3/db/fac x:0 0 0 2024-09-13T21:40:42.460 INFO:tasks.workunit.client.1.smithi116.stdout:3/473: rename d3/l9b to d3/db/d10/d1d/d5f/d7f/lad 0 2024-09-13T21:40:42.466 INFO:tasks.workunit.client.1.smithi116.stdout:6/327: write d8/d10/f55 [1131725,83018] 0 2024-09-13T21:40:42.478 INFO:tasks.workunit.client.1.smithi116.stdout:0/270: truncate d2/d5/f6 1167806 0 2024-09-13T21:40:42.478 INFO:tasks.workunit.client.1.smithi116.stdout:0/271: fsync d2/d5/f39 0 2024-09-13T21:40:42.478 INFO:tasks.workunit.client.1.smithi116.stdout:7/458: sync 2024-09-13T21:40:42.479 INFO:tasks.workunit.client.1.smithi116.stdout:0/272: chown d2/dc/d12 35 1 2024-09-13T21:40:42.479 INFO:tasks.workunit.client.1.smithi116.stdout:0/273: write d2/d5/f16 [3040222,16787] 0 2024-09-13T21:40:42.481 INFO:tasks.workunit.client.1.smithi116.stdout:0/274: chown d2/dc/c4e 1 1 2024-09-13T21:40:42.481 INFO:tasks.workunit.client.1.smithi116.stdout:7/459: unlink d5/d9/d1c/d22/d24/d3a/f46 0 2024-09-13T21:40:42.482 INFO:tasks.workunit.client.1.smithi116.stdout:7/460: chown d5/d9/l30 1161 1 2024-09-13T21:40:42.482 INFO:tasks.workunit.client.1.smithi116.stdout:2/285: dwrite d0/d7/d2b/f3e [0,4194304] 0 2024-09-13T21:40:42.483 INFO:tasks.workunit.client.1.smithi116.stdout:8/318: dwrite d2/d10/d19/d21/f2d [0,4194304] 0 2024-09-13T21:40:42.483 INFO:tasks.workunit.client.1.smithi116.stdout:9/245: dwrite d2/f1e [0,4194304] 0 2024-09-13T21:40:42.493 INFO:tasks.workunit.client.1.smithi116.stdout:2/286: rmdir d0/d5/d8 39 2024-09-13T21:40:42.494 INFO:tasks.workunit.client.1.smithi116.stdout:9/246: truncate d2/d10/f20 2550102 0 2024-09-13T21:40:42.496 INFO:tasks.workunit.client.1.smithi116.stdout:1/302: dwrite d4/d14/d52/f64 [0,4194304] 0 2024-09-13T21:40:42.497 INFO:tasks.workunit.client.1.smithi116.stdout:9/247: rename d2/l1b to d2/d8/d3e/l42 0 2024-09-13T21:40:42.497 INFO:tasks.workunit.client.1.smithi116.stdout:9/248: write d2/d10/f32 [3038214,73033] 0 2024-09-13T21:40:42.498 INFO:tasks.workunit.client.1.smithi116.stdout:1/303: write d4/d23/f51 [4200950,19826] 0 2024-09-13T21:40:42.500 INFO:tasks.workunit.client.1.smithi116.stdout:9/249: unlink d2/d8/f40 0 2024-09-13T21:40:42.500 INFO:tasks.workunit.client.1.smithi116.stdout:9/250: fdatasync d2/d10/f12 0 2024-09-13T21:40:42.500 INFO:tasks.workunit.client.1.smithi116.stdout:9/251: write d2/f1d [1376885,97602] 0 2024-09-13T21:40:42.500 INFO:tasks.workunit.client.1.smithi116.stdout:9/252: stat d2/l3b 0 2024-09-13T21:40:42.500 INFO:tasks.workunit.client.1.smithi116.stdout:1/304: mknod d4/d14/c6c 0 2024-09-13T21:40:42.504 INFO:tasks.workunit.client.1.smithi116.stdout:8/319: read d2/d10/d4b/f51 [2105753,120086] 0 2024-09-13T21:40:42.504 INFO:tasks.workunit.client.1.smithi116.stdout:1/305: creat d4/d14/d52/d2f/f6d x:0 0 0 2024-09-13T21:40:42.505 INFO:tasks.workunit.client.1.smithi116.stdout:1/306: mknod d4/d14/d52/d2f/d5d/c6e 0 2024-09-13T21:40:42.505 INFO:tasks.workunit.client.1.smithi116.stdout:1/307: write d4/d14/f48 [1363597,102959] 0 2024-09-13T21:40:42.507 INFO:tasks.workunit.client.1.smithi116.stdout:5/444: dwrite d7/d1d/d46/f8b [0,4194304] 0 2024-09-13T21:40:42.507 INFO:tasks.workunit.client.1.smithi116.stdout:1/308: rename d4/d14/d52/d2f/d5d/f5e to d4/f6f 0 2024-09-13T21:40:42.509 INFO:tasks.workunit.client.1.smithi116.stdout:2/287: dread d0/d5/f4b [0,4194304] 0 2024-09-13T21:40:42.511 INFO:tasks.workunit.client.1.smithi116.stdout:1/309: rename d4/d14/d52/d2f/d5c/c6a to d4/d23/c70 0 2024-09-13T21:40:42.512 INFO:tasks.workunit.client.1.smithi116.stdout:1/310: link d4/d14/d52/d2f/l4e d4/d14/d52/l71 0 2024-09-13T21:40:42.512 INFO:tasks.workunit.client.1.smithi116.stdout:1/311: write d4/d14/f4f [218511,100873] 0 2024-09-13T21:40:42.513 INFO:tasks.workunit.client.1.smithi116.stdout:3/474: dwrite d3/f11 [4194304,4194304] 0 2024-09-13T21:40:42.515 INFO:tasks.workunit.client.1.smithi116.stdout:2/288: rename d0/d5/c5b to d0/d3a/c65 0 2024-09-13T21:40:42.516 INFO:tasks.workunit.client.1.smithi116.stdout:5/445: dread d7/d1d/f45 [0,4194304] 0 2024-09-13T21:40:42.518 INFO:tasks.workunit.client.1.smithi116.stdout:7/461: dwrite d5/d9/d27/d31/d38/d48/f77 [0,4194304] 0 2024-09-13T21:40:42.518 INFO:tasks.workunit.client.1.smithi116.stdout:0/275: dwrite d2/d5/f39 [0,4194304] 0 2024-09-13T21:40:42.519 INFO:tasks.workunit.client.1.smithi116.stdout:6/328: dwrite d8/d10/d24/f37 [0,4194304] 0 2024-09-13T21:40:42.519 INFO:tasks.workunit.client.1.smithi116.stdout:1/312: rename d4/d14/d52/d2f/l4e to d4/d14/d52/d2f/d5d/l72 0 2024-09-13T21:40:42.519 INFO:tasks.workunit.client.1.smithi116.stdout:0/276: write d2/dc/d12/d28/f54 [4642373,82268] 0 2024-09-13T21:40:42.527 INFO:tasks.workunit.client.1.smithi116.stdout:3/475: write d3/db/d10/f15 [8994497,82779] 0 2024-09-13T21:40:42.527 INFO:tasks.workunit.client.1.smithi116.stdout:2/289: dread d0/d5/f10 [0,4194304] 0 2024-09-13T21:40:42.527 INFO:tasks.workunit.client.1.smithi116.stdout:2/290: chown d0/d7/d2b/d2c/f5c 324695 1 2024-09-13T21:40:42.529 INFO:tasks.workunit.client.1.smithi116.stdout:6/329: unlink d8/f16 0 2024-09-13T21:40:42.532 INFO:tasks.workunit.client.1.smithi116.stdout:8/320: dwrite d2/f2f [0,4194304] 0 2024-09-13T21:40:42.532 INFO:tasks.workunit.client.1.smithi116.stdout:5/446: write d7/da/d5e/d65/d6f/f7e [3203978,57830] 0 2024-09-13T21:40:42.533 INFO:tasks.workunit.client.1.smithi116.stdout:0/277: rmdir d2/d5/d3e 39 2024-09-13T21:40:42.535 INFO:tasks.workunit.client.1.smithi116.stdout:2/291: mkdir d0/d7/d2b/d66 0 2024-09-13T21:40:42.537 INFO:tasks.workunit.client.1.smithi116.stdout:1/313: getdents d4/d14 0 2024-09-13T21:40:42.537 INFO:tasks.workunit.client.1.smithi116.stdout:1/314: chown d4/c5 1 1 2024-09-13T21:40:42.537 INFO:tasks.workunit.client.1.smithi116.stdout:6/330: write d8/fa [325628,66651] 0 2024-09-13T21:40:42.542 INFO:tasks.workunit.client.1.smithi116.stdout:7/462: dwrite d5/d9/d1c/d22/f7a [0,4194304] 0 2024-09-13T21:40:42.549 INFO:tasks.workunit.client.1.smithi116.stdout:5/447: symlink d7/da/d5e/d79/l92 0 2024-09-13T21:40:42.550 INFO:tasks.workunit.client.1.smithi116.stdout:0/278: unlink d2/d5/f13 0 2024-09-13T21:40:42.551 INFO:tasks.workunit.client.1.smithi116.stdout:5/448: dread d7/da/d5e/d65/f8c [0,4194304] 0 2024-09-13T21:40:42.552 INFO:tasks.workunit.client.1.smithi116.stdout:8/321: dwrite d2/d10/d19/d21/d22/d5d/d46/f5b [0,4194304] 0 2024-09-13T21:40:42.552 INFO:tasks.workunit.client.1.smithi116.stdout:8/322: fdatasync d2/d10/d19/d3a/f3b 0 2024-09-13T21:40:42.553 INFO:tasks.workunit.client.1.smithi116.stdout:8/323: stat d2/d10/d4b 0 2024-09-13T21:40:42.553 INFO:tasks.workunit.client.1.smithi116.stdout:2/292: link d0/d7/d2b/d2c/d62/l2e d0/d7/d2b/d61/l67 0 2024-09-13T21:40:42.553 INFO:tasks.workunit.client.1.smithi116.stdout:2/293: dread - d0/f63 zero size 2024-09-13T21:40:42.554 INFO:tasks.workunit.client.1.smithi116.stdout:1/315: mknod d4/d14/d52/d2f/d5d/c73 0 2024-09-13T21:40:42.561 INFO:tasks.workunit.client.1.smithi116.stdout:7/463: truncate d5/d9/db/ff 2093231 0 2024-09-13T21:40:42.561 INFO:tasks.workunit.client.1.smithi116.stdout:7/464: chown d5/d9/d1c/c8d 6782922 1 2024-09-13T21:40:42.563 INFO:tasks.workunit.client.1.smithi116.stdout:0/279: symlink d2/d5/d3e/l56 0 2024-09-13T21:40:42.564 INFO:tasks.workunit.client.1.smithi116.stdout:5/449: creat d7/d1d/d46/d85/f93 x:0 0 0 2024-09-13T21:40:42.571 INFO:tasks.workunit.client.1.smithi116.stdout:8/324: mkdir d2/d10/d37/d64 0 2024-09-13T21:40:42.573 INFO:tasks.workunit.client.1.smithi116.stdout:2/294: mkdir d0/d7/d2b/d2c/d68 0 2024-09-13T21:40:42.576 INFO:tasks.workunit.client.1.smithi116.stdout:1/316: truncate d4/f8 2044277 0 2024-09-13T21:40:42.576 INFO:tasks.workunit.client.1.smithi116.stdout:6/331: link d8/cb d8/d1e/c76 0 2024-09-13T21:40:42.576 INFO:tasks.workunit.client.1.smithi116.stdout:4/431: sync 2024-09-13T21:40:42.582 INFO:tasks.workunit.client.1.smithi116.stdout:5/450: mkdir d7/d1d/d64/d94 0 2024-09-13T21:40:42.582 INFO:tasks.workunit.client.1.smithi116.stdout:5/451: fdatasync d7/d1d/f29 0 2024-09-13T21:40:42.582 INFO:tasks.workunit.client.1.smithi116.stdout:5/452: fdatasync d7/d1d/d46/f8b 0 2024-09-13T21:40:42.584 INFO:tasks.workunit.client.1.smithi116.stdout:5/453: dread d7/d40/d53/f6e [0,4194304] 0 2024-09-13T21:40:42.585 INFO:tasks.workunit.client.1.smithi116.stdout:6/332: dread f5 [0,4194304] 0 2024-09-13T21:40:42.587 INFO:tasks.workunit.client.1.smithi116.stdout:8/325: symlink d2/d10/d37/d64/l65 0 2024-09-13T21:40:42.590 INFO:tasks.workunit.client.1.smithi116.stdout:2/295: symlink d0/d7/d2b/d2c/d62/d1f/l69 0 2024-09-13T21:40:42.592 INFO:tasks.workunit.client.1.smithi116.stdout:1/317: mkdir d4/d74 0 2024-09-13T21:40:42.593 INFO:tasks.workunit.client.1.smithi116.stdout:4/432: getdents d0/dd/d48 0 2024-09-13T21:40:42.596 INFO:tasks.workunit.client.1.smithi116.stdout:7/465: rmdir d5/d9/db/d21 39 2024-09-13T21:40:42.598 INFO:tasks.workunit.client.1.smithi116.stdout:8/326: mkdir d2/d27/d66 0 2024-09-13T21:40:42.598 INFO:tasks.workunit.client.1.smithi116.stdout:8/327: stat d2/d10/d19/d3a/d4c/c61 0 2024-09-13T21:40:42.599 INFO:tasks.workunit.client.1.smithi116.stdout:8/328: chown d2/d27/l53 1 1 2024-09-13T21:40:42.601 INFO:tasks.workunit.client.1.smithi116.stdout:0/280: dwrite d2/dc/fe [4194304,4194304] 0 2024-09-13T21:40:42.601 INFO:tasks.workunit.client.1.smithi116.stdout:2/296: link d0/d7/d2b/d2c/d62/f4a d0/d7/d2d/f6a 0 2024-09-13T21:40:42.601 INFO:tasks.workunit.client.1.smithi116.stdout:2/297: chown d0/d5/d8/c35 112587428 1 2024-09-13T21:40:42.601 INFO:tasks.workunit.client.1.smithi116.stdout:2/298: dread - d0/d7/d2b/d2c/f42 zero size 2024-09-13T21:40:42.604 INFO:tasks.workunit.client.1.smithi116.stdout:1/318: link d4/ld d4/l75 0 2024-09-13T21:40:42.604 INFO:tasks.workunit.client.1.smithi116.stdout:1/319: creat d4/d14/d44/f76 x:0 0 0 2024-09-13T21:40:42.605 INFO:tasks.workunit.client.1.smithi116.stdout:6/333: mknod d8/d10/d24/c77 0 2024-09-13T21:40:42.606 INFO:tasks.workunit.client.1.smithi116.stdout:6/334: fsync d8/d15/d2e/f6a 0 2024-09-13T21:40:42.607 INFO:tasks.workunit.client.1.smithi116.stdout:0/281: truncate d2/d5/f34 1093248 0 2024-09-13T21:40:42.609 INFO:tasks.workunit.client.1.smithi116.stdout:2/299: mknod d0/d7/d2b/c6b 0 2024-09-13T21:40:42.609 INFO:tasks.workunit.client.1.smithi116.stdout:2/300: stat d0/l53 0 2024-09-13T21:40:42.609 INFO:tasks.workunit.client.1.smithi116.stdout:2/301: dread - d0/d7/d2b/d2c/d62/f46 zero size 2024-09-13T21:40:42.609 INFO:tasks.workunit.client.1.smithi116.stdout:4/433: dread d0/f8 [0,4194304] 0 2024-09-13T21:40:42.613 INFO:tasks.workunit.client.1.smithi116.stdout:8/329: dread d2/d10/d19/d21/f47 [0,4194304] 0 2024-09-13T21:40:42.615 INFO:tasks.workunit.client.1.smithi116.stdout:1/320: creat d4/d14/f77 x:0 0 0 2024-09-13T21:40:42.616 INFO:tasks.workunit.client.1.smithi116.stdout:1/321: write d4/d23/d57/f65 [387852,97617] 0 2024-09-13T21:40:42.617 INFO:tasks.workunit.client.1.smithi116.stdout:2/302: symlink d0/d7/d2b/d61/l6c 0 2024-09-13T21:40:42.620 INFO:tasks.workunit.client.1.smithi116.stdout:8/330: mkdir d2/d10/d37/d67 0 2024-09-13T21:40:42.622 INFO:tasks.workunit.client.1.smithi116.stdout:6/335: mkdir d8/d10/d78 0 2024-09-13T21:40:42.622 INFO:tasks.workunit.client.1.smithi116.stdout:4/434: dread d0/dd/f1b [0,4194304] 0 2024-09-13T21:40:42.622 INFO:tasks.workunit.client.1.smithi116.stdout:4/435: chown d0/dd/d6b/d71/c79 3769134 1 2024-09-13T21:40:42.623 INFO:tasks.workunit.client.1.smithi116.stdout:4/436: getdents d0/dd/d48 0 2024-09-13T21:40:42.623 INFO:tasks.workunit.client.1.smithi116.stdout:7/466: dwrite d5/f4b [0,4194304] 0 2024-09-13T21:40:42.624 INFO:tasks.workunit.client.1.smithi116.stdout:0/282: getdents d2/d5 0 2024-09-13T21:40:42.624 INFO:tasks.workunit.client.1.smithi116.stdout:0/283: truncate d2/dc/d12/f41 1250697 0 2024-09-13T21:40:42.627 INFO:tasks.workunit.client.1.smithi116.stdout:1/322: dread d4/d14/f1d [0,4194304] 0 2024-09-13T21:40:42.627 INFO:tasks.workunit.client.1.smithi116.stdout:1/323: write d4/f6f [1044472,88123] 0 2024-09-13T21:40:42.627 INFO:tasks.workunit.client.1.smithi116.stdout:1/324: fdatasync d4/f8 0 2024-09-13T21:40:42.629 INFO:tasks.workunit.client.1.smithi116.stdout:8/331: truncate d2/f8 1908089 0 2024-09-13T21:40:42.629 INFO:tasks.workunit.client.1.smithi116.stdout:6/336: chown d8/d10/l4c 13545 1 2024-09-13T21:40:42.629 INFO:tasks.workunit.client.1.smithi116.stdout:6/337: readlink d8/d15/l56 0 2024-09-13T21:40:42.634 INFO:tasks.workunit.client.1.smithi116.stdout:4/437: mkdir d0/dd/d13/d5a/d86 0 2024-09-13T21:40:42.637 INFO:tasks.workunit.client.1.smithi116.stdout:7/467: link d5/d9/db/d21/d6e/d6f/d70/f84 d5/d9/d27/d31/d38/d48/f94 0 2024-09-13T21:40:42.639 INFO:tasks.workunit.client.1.smithi116.stdout:0/284: mkdir d2/dc/d12/d28/d57 0 2024-09-13T21:40:42.640 INFO:tasks.workunit.client.1.smithi116.stdout:6/338: rename d8/d15/d2e/d2f/d57/l59 to d8/d10/d24/l79 0 2024-09-13T21:40:42.642 INFO:tasks.workunit.client.1.smithi116.stdout:2/303: dwrite d0/d7/f59 [0,4194304] 0 2024-09-13T21:40:42.642 INFO:tasks.workunit.client.1.smithi116.stdout:7/468: creat d5/d9/d27/d31/f95 x:0 0 0 2024-09-13T21:40:42.642 INFO:tasks.workunit.client.1.smithi116.stdout:8/332: dread d2/d10/d19/d3a/f5f [0,4194304] 0 2024-09-13T21:40:42.643 INFO:tasks.workunit.client.1.smithi116.stdout:0/285: creat d2/d5/f58 x:0 0 0 2024-09-13T21:40:42.643 INFO:tasks.workunit.client.1.smithi116.stdout:0/286: chown d2/d5/d3e 242 1 2024-09-13T21:40:42.644 INFO:tasks.workunit.client.1.smithi116.stdout:6/339: symlink d8/d1e/l7a 0 2024-09-13T21:40:42.645 INFO:tasks.workunit.client.1.smithi116.stdout:4/438: rename d0/dd/d13/l2f to d0/dd/d6b/l87 0 2024-09-13T21:40:42.646 INFO:tasks.workunit.client.1.smithi116.stdout:0/287: write d2/dc/d12/f41 [429989,122337] 0 2024-09-13T21:40:42.648 INFO:tasks.workunit.client.1.smithi116.stdout:1/325: dwrite d4/d14/f4f [0,4194304] 0 2024-09-13T21:40:42.649 INFO:tasks.workunit.client.1.smithi116.stdout:8/333: mknod d2/d10/d37/d64/c68 0 2024-09-13T21:40:42.650 INFO:tasks.workunit.client.1.smithi116.stdout:8/334: fsync d2/d10/f31 0 2024-09-13T21:40:42.650 INFO:tasks.workunit.client.1.smithi116.stdout:8/335: readlink d2/lf 0 2024-09-13T21:40:42.653 INFO:tasks.workunit.client.1.smithi116.stdout:2/304: rename d0/d7/d2b/d2c/f5c to d0/d5/d2a/f6d 0 2024-09-13T21:40:42.657 INFO:tasks.workunit.client.1.smithi116.stdout:4/439: dread d0/dd/d13/f1e [0,4194304] 0 2024-09-13T21:40:42.662 INFO:tasks.workunit.client.1.smithi116.stdout:6/340: rmdir d8/d10/d65 39 2024-09-13T21:40:42.663 INFO:tasks.workunit.client.1.smithi116.stdout:6/341: chown d8/d15/f1b 5767 1 2024-09-13T21:40:42.663 INFO:tasks.workunit.client.1.smithi116.stdout:6/342: chown d8/d15/d2e/d2f/d38 251 1 2024-09-13T21:40:42.664 INFO:tasks.workunit.client.1.smithi116.stdout:2/305: unlink d0/d3a/c65 0 2024-09-13T21:40:42.666 INFO:tasks.workunit.client.1.smithi116.stdout:7/469: rename d5/f6c to d5/d9/d1c/d2e/f96 0 2024-09-13T21:40:42.667 INFO:tasks.workunit.client.1.smithi116.stdout:4/440: link d0/dd/f2e d0/dd/f88 0 2024-09-13T21:40:42.667 INFO:tasks.workunit.client.1.smithi116.stdout:4/441: write d0/dd/f2e [988453,93682] 0 2024-09-13T21:40:42.667 INFO:tasks.workunit.client.1.smithi116.stdout:4/442: truncate d0/dd/d13/d4e/f7f 547309 0 2024-09-13T21:40:42.667 INFO:tasks.workunit.client.1.smithi116.stdout:4/443: creat d0/d56/d57/f89 x:0 0 0 2024-09-13T21:40:42.671 INFO:tasks.workunit.client.1.smithi116.stdout:8/336: rename d2/d10/d37/d67 to d2/d10/d19/d21/d69 0 2024-09-13T21:40:42.673 INFO:tasks.workunit.client.1.smithi116.stdout:7/470: unlink d5/d9/l67 0 2024-09-13T21:40:42.676 INFO:tasks.workunit.client.1.smithi116.stdout:0/288: write d2/dc/d47/f4d [3748937,68789] 0 2024-09-13T21:40:42.676 INFO:tasks.workunit.client.1.smithi116.stdout:1/326: dwrite d4/d23/d57/f65 [0,4194304] 0 2024-09-13T21:40:42.678 INFO:tasks.workunit.client.1.smithi116.stdout:6/343: getdents d8/d15 0 2024-09-13T21:40:42.678 INFO:tasks.workunit.client.1.smithi116.stdout:6/344: write d8/d15/d2e/d2f/d38/f45 [697266,8832] 0 2024-09-13T21:40:42.680 INFO:tasks.workunit.client.1.smithi116.stdout:8/337: creat d2/d5c/f6a x:0 0 0 2024-09-13T21:40:42.682 INFO:tasks.workunit.client.1.smithi116.stdout:0/289: write d2/d5/f1f [576730,79909] 0 2024-09-13T21:40:42.686 INFO:tasks.workunit.client.1.smithi116.stdout:6/345: creat d8/d10/f7b x:0 0 0 2024-09-13T21:40:42.689 INFO:tasks.workunit.client.1.smithi116.stdout:8/338: mknod d2/d10/c6b 0 2024-09-13T21:40:42.689 INFO:tasks.workunit.client.1.smithi116.stdout:8/339: stat d2/d10/d19/d42 0 2024-09-13T21:40:42.689 INFO:tasks.workunit.client.1.smithi116.stdout:8/340: readlink d2/d10/l1c 0 2024-09-13T21:40:42.689 INFO:tasks.workunit.client.1.smithi116.stdout:8/341: write d2/d10/d19/d21/d22/f4a [731001,121529] 0 2024-09-13T21:40:42.693 INFO:tasks.workunit.client.1.smithi116.stdout:0/290: symlink d2/dc/d12/d51/l59 0 2024-09-13T21:40:42.693 INFO:tasks.workunit.client.1.smithi116.stdout:6/346: link d8/ff d8/d17/d70/f7c 0 2024-09-13T21:40:42.695 INFO:tasks.workunit.client.1.smithi116.stdout:0/291: rename d2/dc/c4e to d2/d5/d3e/c5a 0 2024-09-13T21:40:42.696 INFO:tasks.workunit.client.1.smithi116.stdout:6/347: symlink d8/d10/d78/l7d 0 2024-09-13T21:40:42.696 INFO:tasks.workunit.client.1.smithi116.stdout:0/292: readlink d2/dc/l43 0 2024-09-13T21:40:42.696 INFO:tasks.workunit.client.1.smithi116.stdout:0/293: readlink d2/dc/d12/d28/l45 0 2024-09-13T21:40:42.697 INFO:tasks.workunit.client.1.smithi116.stdout:0/294: mkdir d2/d5b 0 2024-09-13T21:40:42.697 INFO:tasks.workunit.client.1.smithi116.stdout:0/295: chown d2/dc/c48 84488872 1 2024-09-13T21:40:42.699 INFO:tasks.workunit.client.1.smithi116.stdout:7/471: dwrite d5/d9/db/d21/d6e/d6f/f83 [0,4194304] 0 2024-09-13T21:40:42.699 INFO:tasks.workunit.client.1.smithi116.stdout:4/444: dwrite d0/dd/f1b [0,4194304] 0 2024-09-13T21:40:42.699 INFO:tasks.workunit.client.1.smithi116.stdout:0/296: creat d2/d5b/f5c x:0 0 0 2024-09-13T21:40:42.702 INFO:tasks.workunit.client.1.smithi116.stdout:4/445: unlink d0/dd/l72 0 2024-09-13T21:40:42.702 INFO:tasks.workunit.client.1.smithi116.stdout:4/446: stat d0 0 2024-09-13T21:40:42.702 INFO:tasks.workunit.client.1.smithi116.stdout:4/447: mknod d0/d32/c8a 0 2024-09-13T21:40:42.702 INFO:tasks.workunit.client.1.smithi116.stdout:7/472: dread d5/d9/d1c/d2e/f96 [0,4194304] 0 2024-09-13T21:40:42.703 INFO:tasks.workunit.client.1.smithi116.stdout:7/473: read d5/d9/db/d21/f53 [194597,60930] 0 2024-09-13T21:40:42.706 INFO:tasks.workunit.client.1.smithi116.stdout:7/474: getdents d5/d9/d1c/d22/d24 0 2024-09-13T21:40:42.706 INFO:tasks.workunit.client.1.smithi116.stdout:7/475: write d5/d9/db/f3c [6182154,41142] 0 2024-09-13T21:40:42.707 INFO:tasks.workunit.client.1.smithi116.stdout:1/327: dwrite d4/d14/d52/f38 [0,4194304] 0 2024-09-13T21:40:42.709 INFO:tasks.workunit.client.1.smithi116.stdout:7/476: rename d5/d9/db/c1f to d5/d9/d1c/d22/d24/d5f/c97 0 2024-09-13T21:40:42.713 INFO:tasks.workunit.client.1.smithi116.stdout:0/297: dread d2/dc/d12/f23 [0,4194304] 0 2024-09-13T21:40:42.713 INFO:tasks.workunit.client.1.smithi116.stdout:8/342: dwrite d2/d27/f60 [0,4194304] 0 2024-09-13T21:40:42.713 INFO:tasks.workunit.client.1.smithi116.stdout:6/348: fsync d8/d10/f7b 0 2024-09-13T21:40:42.714 INFO:tasks.workunit.client.1.smithi116.stdout:7/477: write d5/d9/f3d [13146451,119695] 0 2024-09-13T21:40:42.718 INFO:tasks.workunit.client.1.smithi116.stdout:8/343: stat d2/ce 0 2024-09-13T21:40:42.719 INFO:tasks.workunit.client.1.smithi116.stdout:6/349: write d8/d10/f55 [3669315,85685] 0 2024-09-13T21:40:42.720 INFO:tasks.workunit.client.1.smithi116.stdout:1/328: dread d4/d23/d57/f65 [0,4194304] 0 2024-09-13T21:40:42.723 INFO:tasks.workunit.client.1.smithi116.stdout:6/350: truncate d8/d15/d2e/f69 326928 0 2024-09-13T21:40:42.723 INFO:tasks.workunit.client.1.smithi116.stdout:6/351: creat d8/d15/d2e/f7e x:0 0 0 2024-09-13T21:40:42.726 INFO:tasks.workunit.client.1.smithi116.stdout:1/329: creat d4/d14/d44/d5f/f78 x:0 0 0 2024-09-13T21:40:42.728 INFO:tasks.workunit.client.1.smithi116.stdout:8/344: rmdir d2/d27 39 2024-09-13T21:40:42.730 INFO:tasks.workunit.client.1.smithi116.stdout:6/352: symlink d8/d10/d65/l7f 0 2024-09-13T21:40:42.731 INFO:tasks.workunit.client.1.smithi116.stdout:6/353: write d8/d10/d33/f67 [1567758,102565] 0 2024-09-13T21:40:42.732 INFO:tasks.workunit.client.1.smithi116.stdout:6/354: chown d8/l6f 53 1 2024-09-13T21:40:42.732 INFO:tasks.workunit.client.1.smithi116.stdout:6/355: truncate d8/fe 3264830 0 2024-09-13T21:40:42.733 INFO:tasks.workunit.client.1.smithi116.stdout:8/345: write d2/d10/d19/d3a/f5f [1685359,35462] 0 2024-09-13T21:40:42.734 INFO:tasks.workunit.client.1.smithi116.stdout:8/346: mknod d2/d10/d19/d21/d22/d5d/d46/c6c 0 2024-09-13T21:40:42.734 INFO:tasks.workunit.client.1.smithi116.stdout:8/347: chown d2/d10/d19/d21 3825537 1 2024-09-13T21:40:42.735 INFO:tasks.workunit.client.1.smithi116.stdout:8/348: truncate d2/d10/f18 2363297 0 2024-09-13T21:40:42.737 INFO:tasks.workunit.client.1.smithi116.stdout:1/330: dread d4/f8 [0,4194304] 0 2024-09-13T21:40:42.738 INFO:tasks.workunit.client.1.smithi116.stdout:8/349: creat d2/f6d x:0 0 0 2024-09-13T21:40:42.738 INFO:tasks.workunit.client.1.smithi116.stdout:8/350: fsync d2/d10/d37/f25 0 2024-09-13T21:40:42.739 INFO:tasks.workunit.client.1.smithi116.stdout:1/331: mknod d4/d74/c79 0 2024-09-13T21:40:42.742 INFO:tasks.workunit.client.1.smithi116.stdout:1/332: write d4/d14/f24 [834081,92466] 0 2024-09-13T21:40:42.742 INFO:tasks.workunit.client.1.smithi116.stdout:0/298: dwrite d2/d5/f50 [0,4194304] 0 2024-09-13T21:40:42.742 INFO:tasks.workunit.client.1.smithi116.stdout:7/478: dwrite d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:42.748 INFO:tasks.workunit.client.1.smithi116.stdout:7/479: symlink d5/d9/l98 0 2024-09-13T21:40:42.749 INFO:tasks.workunit.client.1.smithi116.stdout:1/333: getdents d4/d14 0 2024-09-13T21:40:42.749 INFO:tasks.workunit.client.1.smithi116.stdout:6/356: dread d8/d10/d33/f4a [0,4194304] 0 2024-09-13T21:40:42.751 INFO:tasks.workunit.client.1.smithi116.stdout:1/334: truncate f1 3882879 0 2024-09-13T21:40:42.752 INFO:tasks.workunit.client.1.smithi116.stdout:1/335: truncate d4/d14/d41/f49 1379225 0 2024-09-13T21:40:42.752 INFO:tasks.workunit.client.1.smithi116.stdout:1/336: chown d4/d14/d52/f4a 389629608 1 2024-09-13T21:40:42.752 INFO:tasks.workunit.client.1.smithi116.stdout:1/337: write d4/d14/d44/d5f/f78 [115338,41218] 0 2024-09-13T21:40:42.754 INFO:tasks.workunit.client.1.smithi116.stdout:1/338: mknod d4/d14/d44/c7a 0 2024-09-13T21:40:42.754 INFO:tasks.workunit.client.1.smithi116.stdout:1/339: stat d4/f20 0 2024-09-13T21:40:42.756 INFO:tasks.workunit.client.1.smithi116.stdout:1/340: mknod d4/d14/d52/d2f/c7b 0 2024-09-13T21:40:42.757 INFO:tasks.workunit.client.1.smithi116.stdout:0/299: dread d2/dc/f3d [4194304,4194304] 0 2024-09-13T21:40:42.757 INFO:tasks.workunit.client.1.smithi116.stdout:8/351: dread d2/f2f [0,4194304] 0 2024-09-13T21:40:42.758 INFO:tasks.workunit.client.1.smithi116.stdout:1/341: creat d4/d23/f7c x:0 0 0 2024-09-13T21:40:42.760 INFO:tasks.workunit.client.1.smithi116.stdout:0/300: truncate d2/dc/fe 4407291 0 2024-09-13T21:40:42.760 INFO:tasks.workunit.client.1.smithi116.stdout:0/301: chown d2/dc/f3d 80439 1 2024-09-13T21:40:42.763 INFO:tasks.workunit.client.1.smithi116.stdout:8/352: rename d2/d10/d19/d21/d22/d5d/d46/d4e to d2/d10/d4b/d6e 0 2024-09-13T21:40:42.763 INFO:tasks.workunit.client.1.smithi116.stdout:8/353: creat d2/d10/d19/d3a/f6f x:0 0 0 2024-09-13T21:40:42.765 INFO:tasks.workunit.client.1.smithi116.stdout:0/302: unlink d2/dc/c48 0 2024-09-13T21:40:42.768 INFO:tasks.workunit.client.1.smithi116.stdout:8/354: symlink d2/d27/d66/l70 0 2024-09-13T21:40:42.768 INFO:tasks.workunit.client.1.smithi116.stdout:8/355: chown d2/d10/d19/d21/d22/l39 23221 1 2024-09-13T21:40:42.768 INFO:tasks.workunit.client.1.smithi116.stdout:0/303: mkdir d2/dc/d47/d5d 0 2024-09-13T21:40:42.769 INFO:tasks.workunit.client.1.smithi116.stdout:8/356: mknod d2/d10/d19/d3a/c71 0 2024-09-13T21:40:42.769 INFO:tasks.workunit.client.1.smithi116.stdout:8/357: readlink d2/d10/d19/l30 0 2024-09-13T21:40:42.769 INFO:tasks.workunit.client.1.smithi116.stdout:8/358: write d2/f6d [568527,88595] 0 2024-09-13T21:40:42.769 INFO:tasks.workunit.client.1.smithi116.stdout:8/359: write d2/d10/d19/d3a/f3b [4494747,6766] 0 2024-09-13T21:40:42.769 INFO:tasks.workunit.client.1.smithi116.stdout:8/360: chown d2/d27/l53 101278085 1 2024-09-13T21:40:42.770 INFO:tasks.workunit.client.1.smithi116.stdout:8/361: readlink d2/d10/d19/l35 0 2024-09-13T21:40:42.770 INFO:tasks.workunit.client.1.smithi116.stdout:8/362: creat d2/d27/f72 x:0 0 0 2024-09-13T21:40:42.771 INFO:tasks.workunit.client.1.smithi116.stdout:8/363: mknod d2/d10/d19/d3a/c73 0 2024-09-13T21:40:42.772 INFO:tasks.workunit.client.1.smithi116.stdout:8/364: getdents d2/d10/d19 0 2024-09-13T21:40:42.772 INFO:tasks.workunit.client.1.smithi116.stdout:1/342: write d4/f1c [1124119,2616] 0 2024-09-13T21:40:42.775 INFO:tasks.workunit.client.1.smithi116.stdout:7/480: dwrite d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:42.776 INFO:tasks.workunit.client.1.smithi116.stdout:6/357: dwrite d8/f2c [0,4194304] 0 2024-09-13T21:40:42.784 INFO:tasks.workunit.client.1.smithi116.stdout:0/304: write d2/dc/d12/d28/f54 [1166849,61602] 0 2024-09-13T21:40:42.788 INFO:tasks.workunit.client.1.smithi116.stdout:7/481: creat d5/d9/db/f99 x:0 0 0 2024-09-13T21:40:42.788 INFO:tasks.workunit.client.1.smithi116.stdout:7/482: readlink d5/d9/db/d21/l2a 0 2024-09-13T21:40:42.792 INFO:tasks.workunit.client.1.smithi116.stdout:8/365: rmdir d2 39 2024-09-13T21:40:42.795 INFO:tasks.workunit.client.1.smithi116.stdout:0/305: write d2/f38 [2774777,18561] 0 2024-09-13T21:40:42.796 INFO:tasks.workunit.client.1.smithi116.stdout:0/306: chown d2/dc/d12 4952147 1 2024-09-13T21:40:42.798 INFO:tasks.workunit.client.1.smithi116.stdout:7/483: rmdir d5/d9/db/d21/d6e/d6f 39 2024-09-13T21:40:42.799 INFO:tasks.workunit.client.1.smithi116.stdout:8/366: symlink d2/d10/d19/d21/d22/d5d/l74 0 2024-09-13T21:40:42.799 INFO:tasks.workunit.client.1.smithi116.stdout:8/367: chown d2/d10/c16 3908781 1 2024-09-13T21:40:42.801 INFO:tasks.workunit.client.1.smithi116.stdout:8/368: mkdir d2/d10/d75 0 2024-09-13T21:40:42.802 INFO:tasks.workunit.client.1.smithi116.stdout:8/369: symlink d2/d10/d19/d21/l76 0 2024-09-13T21:40:42.802 INFO:tasks.workunit.client.1.smithi116.stdout:8/370: fdatasync d2/d10/d37/f25 0 2024-09-13T21:40:42.802 INFO:tasks.workunit.client.1.smithi116.stdout:0/307: dread d2/dc/f2c [0,4194304] 0 2024-09-13T21:40:42.803 INFO:tasks.workunit.client.1.smithi116.stdout:6/358: dwrite d8/d15/d2e/f3f [0,4194304] 0 2024-09-13T21:40:42.803 INFO:tasks.workunit.client.1.smithi116.stdout:6/359: chown d8/d10/d33/f4a 83948 1 2024-09-13T21:40:42.803 INFO:tasks.workunit.client.1.smithi116.stdout:8/371: truncate d2/d10/d4b/f51 2952260 0 2024-09-13T21:40:42.805 INFO:tasks.workunit.client.1.smithi116.stdout:8/372: creat d2/d10/d19/d21/d22/d5d/d46/f77 x:0 0 0 2024-09-13T21:40:42.807 INFO:tasks.workunit.client.1.smithi116.stdout:6/360: mknod d8/d10/c80 0 2024-09-13T21:40:42.809 INFO:tasks.workunit.client.1.smithi116.stdout:6/361: mknod d8/d10/d65/c81 0 2024-09-13T21:40:42.810 INFO:tasks.workunit.client.1.smithi116.stdout:6/362: truncate d8/f2c 24446 0 2024-09-13T21:40:42.811 INFO:tasks.workunit.client.1.smithi116.stdout:1/343: truncate f1 2765165 0 2024-09-13T21:40:42.813 INFO:tasks.workunit.client.1.smithi116.stdout:6/363: link d8/d10/d33/f5c d8/d17/f82 0 2024-09-13T21:40:42.815 INFO:tasks.workunit.client.1.smithi116.stdout:1/344: getdents d4/d14/d52 0 2024-09-13T21:40:42.815 INFO:tasks.workunit.client.1.smithi116.stdout:1/345: chown d4/f10 32448 1 2024-09-13T21:40:42.824 INFO:tasks.workunit.client.1.smithi116.stdout:7/484: dwrite d5/d9/d1c/d37/f62 [0,4194304] 0 2024-09-13T21:40:42.824 INFO:tasks.workunit.client.1.smithi116.stdout:0/308: dwrite d2/dc/fe [0,4194304] 0 2024-09-13T21:40:42.824 INFO:tasks.workunit.client.1.smithi116.stdout:0/309: readlink d2/dc/l43 0 2024-09-13T21:40:42.825 INFO:tasks.workunit.client.1.smithi116.stdout:7/485: creat d5/d9/db/d21/d6e/f9a x:0 0 0 2024-09-13T21:40:42.825 INFO:tasks.workunit.client.1.smithi116.stdout:7/486: truncate d5/d9/d27/d31/d38/d48/f94 733516 0 2024-09-13T21:40:42.826 INFO:tasks.workunit.client.1.smithi116.stdout:0/310: mknod d2/d5/d3e/c5e 0 2024-09-13T21:40:42.835 INFO:tasks.workunit.client.1.smithi116.stdout:7/487: truncate d5/d9/f51 1345332 0 2024-09-13T21:40:42.845 INFO:tasks.workunit.client.1.smithi116.stdout:7/488: dread d5/d9/f3d [4194304,4194304] 0 2024-09-13T21:40:42.845 INFO:tasks.workunit.client.1.smithi116.stdout:7/489: chown d5/d9/d1c/d22/d24/d6b/d72/f79 37933270 1 2024-09-13T21:40:42.845 INFO:tasks.workunit.client.1.smithi116.stdout:7/490: readlink d5/d9/db/d21/l2a 0 2024-09-13T21:40:42.845 INFO:tasks.workunit.client.1.smithi116.stdout:0/311: dwrite d2/dc/d47/f4b [0,4194304] 0 2024-09-13T21:40:42.847 INFO:tasks.workunit.client.1.smithi116.stdout:1/346: read d4/d23/f51 [1887951,66556] 0 2024-09-13T21:40:42.847 INFO:tasks.workunit.client.1.smithi116.stdout:0/312: symlink d2/dc/l5f 0 2024-09-13T21:40:42.848 INFO:tasks.workunit.client.1.smithi116.stdout:1/347: unlink d4/d14/d52/f64 0 2024-09-13T21:40:42.849 INFO:tasks.workunit.client.1.smithi116.stdout:1/348: dread - d4/d14/d44/f67 zero size 2024-09-13T21:40:42.849 INFO:tasks.workunit.client.1.smithi116.stdout:1/349: truncate d4/d14/f1d 5089290 0 2024-09-13T21:40:42.849 INFO:tasks.workunit.client.1.smithi116.stdout:1/350: write d4/d14/d41/f4d [882493,47294] 0 2024-09-13T21:40:42.849 INFO:tasks.workunit.client.1.smithi116.stdout:1/351: truncate d4/d14/f77 142648 0 2024-09-13T21:40:42.863 INFO:tasks.workunit.client.1.smithi116.stdout:1/352: dwrite d4/d14/d44/f67 [0,4194304] 0 2024-09-13T21:40:42.873 INFO:tasks.workunit.client.1.smithi116.stdout:0/313: rmdir d2/dc/d47/d5d 0 2024-09-13T21:40:42.873 INFO:tasks.workunit.client.1.smithi116.stdout:9/253: sync 2024-09-13T21:40:42.873 INFO:tasks.workunit.client.1.smithi116.stdout:3/476: sync 2024-09-13T21:40:42.873 INFO:tasks.workunit.client.1.smithi116.stdout:5/454: sync 2024-09-13T21:40:42.873 INFO:tasks.workunit.client.1.smithi116.stdout:5/455: chown d7/d1d/d46/l4f 30229 1 2024-09-13T21:40:42.873 INFO:tasks.workunit.client.1.smithi116.stdout:9/254: write d2/d10/d14/f31 [1873264,104082] 0 2024-09-13T21:40:42.874 INFO:tasks.workunit.client.1.smithi116.stdout:5/456: write d7/f72 [184256,68218] 0 2024-09-13T21:40:42.947 INFO:tasks.workunit.client.1.smithi116.stdout:9/255: mkdir d2/d43 0 2024-09-13T21:40:42.948 INFO:tasks.workunit.client.1.smithi116.stdout:9/256: unlink d2/f1d 0 2024-09-13T21:40:42.949 INFO:tasks.workunit.client.1.smithi116.stdout:9/257: truncate d2/f4 306632 0 2024-09-13T21:40:42.960 INFO:tasks.workunit.client.1.smithi116.stdout:0/314: rename d2/d5/f1f to d2/f60 0 2024-09-13T21:40:42.960 INFO:tasks.workunit.client.1.smithi116.stdout:0/315: fsync d2/dc/d12/d28/f54 0 2024-09-13T21:40:42.961 INFO:tasks.workunit.client.1.smithi116.stdout:3/477: rename d3/db/d26/f28 to d3/db/d3d/fae 0 2024-09-13T21:40:42.963 INFO:tasks.workunit.client.1.smithi116.stdout:5/457: rename d7/da/d5e/d65/d6a/l6d to d7/d1d/d46/d85/l95 0 2024-09-13T21:40:42.965 INFO:tasks.workunit.client.1.smithi116.stdout:3/478: mkdir d3/db/d10/d1d/d5f/d6f/d71/daf 0 2024-09-13T21:40:42.966 INFO:tasks.workunit.client.1.smithi116.stdout:5/458: mkdir d7/d1d/d46/d85/d96 0 2024-09-13T21:40:42.969 INFO:tasks.workunit.client.1.smithi116.stdout:5/459: symlink d7/d40/d80/l97 0 2024-09-13T21:40:42.971 INFO:tasks.workunit.client.1.smithi116.stdout:5/460: unlink d7/da/d5e/c42 0 2024-09-13T21:40:42.972 INFO:tasks.workunit.client.1.smithi116.stdout:5/461: creat d7/d1d/d64/d87/f98 x:0 0 0 2024-09-13T21:40:42.979 INFO:tasks.workunit.client.1.smithi116.stdout:0/316: dwrite d2/dc/d47/f4d [0,4194304] 0 2024-09-13T21:40:42.980 INFO:tasks.workunit.client.1.smithi116.stdout:9/258: dread d2/d10/f32 [0,4194304] 0 2024-09-13T21:40:42.980 INFO:tasks.workunit.client.1.smithi116.stdout:0/317: mkdir d2/d5/d61 0 2024-09-13T21:40:42.982 INFO:tasks.workunit.client.1.smithi116.stdout:9/259: creat d2/d10/d14/f44 x:0 0 0 2024-09-13T21:40:42.982 INFO:tasks.workunit.client.1.smithi116.stdout:9/260: creat d2/d10/d14/f45 x:0 0 0 2024-09-13T21:40:42.982 INFO:tasks.workunit.client.1.smithi116.stdout:9/261: write d2/d8/f1a [686224,37720] 0 2024-09-13T21:40:42.983 INFO:tasks.workunit.client.1.smithi116.stdout:0/318: rename d2/d5/d3e to d2/dc/d12/d51/d62 0 2024-09-13T21:40:42.988 INFO:tasks.workunit.client.1.smithi116.stdout:9/262: link d2/d10/d14/c26 d2/c46 0 2024-09-13T21:40:42.988 INFO:tasks.workunit.client.1.smithi116.stdout:9/263: fsync d2/f13 0 2024-09-13T21:40:42.988 INFO:tasks.workunit.client.1.smithi116.stdout:0/319: fsync d2/f60 0 2024-09-13T21:40:42.988 INFO:tasks.workunit.client.1.smithi116.stdout:4/448: sync 2024-09-13T21:40:42.988 INFO:tasks.workunit.client.1.smithi116.stdout:2/306: sync 2024-09-13T21:40:42.989 INFO:tasks.workunit.client.1.smithi116.stdout:5/462: dwrite d7/da/f52 [0,4194304] 0 2024-09-13T21:40:42.991 INFO:tasks.workunit.client.1.smithi116.stdout:4/449: rename d0/dd/d13/l1c to d0/d32/d5d/l8b 0 2024-09-13T21:40:42.991 INFO:tasks.workunit.client.1.smithi116.stdout:4/450: stat d0/dd/d48/f5c 0 2024-09-13T21:40:42.993 INFO:tasks.workunit.client.1.smithi116.stdout:0/320: mkdir d2/dc/d47/d63 0 2024-09-13T21:40:42.993 INFO:tasks.workunit.client.1.smithi116.stdout:0/321: write d2/dc/d12/f23 [1593477,16813] 0 2024-09-13T21:40:42.995 INFO:tasks.workunit.client.1.smithi116.stdout:2/307: creat d0/d7/f6e x:0 0 0 2024-09-13T21:40:43.000 INFO:tasks.workunit.client.1.smithi116.stdout:5/463: rename d7/d40/f55 to d7/d1d/f99 0 2024-09-13T21:40:43.001 INFO:tasks.workunit.client.1.smithi116.stdout:4/451: symlink d0/d32/d5d/l8c 0 2024-09-13T21:40:43.001 INFO:tasks.workunit.client.1.smithi116.stdout:4/452: write d0/dd/d13/f21 [2150750,47597] 0 2024-09-13T21:40:43.002 INFO:tasks.workunit.client.1.smithi116.stdout:0/322: symlink d2/dc/d12/d28/l64 0 2024-09-13T21:40:43.005 INFO:tasks.workunit.client.1.smithi116.stdout:4/453: link d0/dd/l1a d0/dd/d13/d5a/d7a/l8d 0 2024-09-13T21:40:43.007 INFO:tasks.workunit.client.1.smithi116.stdout:0/323: mkdir d2/dc/d12/d28/d57/d65 0 2024-09-13T21:40:43.007 INFO:tasks.workunit.client.1.smithi116.stdout:0/324: fsync d2/dc/d12/d28/f54 0 2024-09-13T21:40:43.007 INFO:tasks.workunit.client.1.smithi116.stdout:0/325: fsync d2/dc/fe 0 2024-09-13T21:40:43.007 INFO:tasks.workunit.client.1.smithi116.stdout:9/264: dwrite d2/f3 [0,4194304] 0 2024-09-13T21:40:43.009 INFO:tasks.workunit.client.1.smithi116.stdout:4/454: mknod d0/dd/d13/d5a/c8e 0 2024-09-13T21:40:43.011 INFO:tasks.workunit.client.1.smithi116.stdout:0/326: creat d2/dc/d47/f66 x:0 0 0 2024-09-13T21:40:43.011 INFO:tasks.workunit.client.1.smithi116.stdout:0/327: chown d2/f38 5 1 2024-09-13T21:40:43.011 INFO:tasks.workunit.client.1.smithi116.stdout:5/464: dread d7/f3f [0,4194304] 0 2024-09-13T21:40:43.014 INFO:tasks.workunit.client.1.smithi116.stdout:9/265: mkdir d2/d10/d41/d47 0 2024-09-13T21:40:43.015 INFO:tasks.workunit.client.1.smithi116.stdout:4/455: truncate d0/dd/d13/f1e 1847971 0 2024-09-13T21:40:43.015 INFO:tasks.workunit.client.1.smithi116.stdout:4/456: write d0/dd/d13/f41 [3276336,108478] 0 2024-09-13T21:40:43.018 INFO:tasks.workunit.client.1.smithi116.stdout:0/328: creat d2/d5/d61/f67 x:0 0 0 2024-09-13T21:40:43.019 INFO:tasks.workunit.client.1.smithi116.stdout:9/266: symlink d2/d10/d14/l48 0 2024-09-13T21:40:43.020 INFO:tasks.workunit.client.1.smithi116.stdout:9/267: readlink d2/d10/l1f 0 2024-09-13T21:40:43.021 INFO:tasks.workunit.client.1.smithi116.stdout:4/457: rename d0/d32/d5d/f78 to d0/dd/d13/d5a/d86/f8f 0 2024-09-13T21:40:43.021 INFO:tasks.workunit.client.1.smithi116.stdout:4/458: dread - d0/dd/d13/d5a/d86/f8f zero size 2024-09-13T21:40:43.021 INFO:tasks.workunit.client.1.smithi116.stdout:4/459: dread - d0/dd/d48/f6a zero size 2024-09-13T21:40:43.022 INFO:tasks.workunit.client.1.smithi116.stdout:0/329: mknod d2/d5/d61/c68 0 2024-09-13T21:40:43.023 INFO:tasks.workunit.client.1.smithi116.stdout:9/268: truncate d2/f2f 14602 0 2024-09-13T21:40:43.025 INFO:tasks.workunit.client.1.smithi116.stdout:9/269: symlink d2/d10/d41/d47/l49 0 2024-09-13T21:40:43.026 INFO:tasks.workunit.client.1.smithi116.stdout:0/330: dread d2/dc/d12/d28/f54 [0,4194304] 0 2024-09-13T21:40:43.027 INFO:tasks.workunit.client.1.smithi116.stdout:5/465: dwrite d7/d1d/d46/d5c/f78 [0,4194304] 0 2024-09-13T21:40:43.029 INFO:tasks.workunit.client.1.smithi116.stdout:0/331: creat d2/dc/d12/d51/f69 x:0 0 0 2024-09-13T21:40:43.033 INFO:tasks.workunit.client.1.smithi116.stdout:5/466: truncate d7/d1d/f20 1862343 0 2024-09-13T21:40:43.036 INFO:tasks.workunit.client.1.smithi116.stdout:5/467: unlink d7/da/f48 0 2024-09-13T21:40:43.036 INFO:tasks.workunit.client.1.smithi116.stdout:5/468: write d7/da/d5e/f7a [1049873,89808] 0 2024-09-13T21:40:43.039 INFO:tasks.workunit.client.1.smithi116.stdout:5/469: mkdir d7/d9a 0 2024-09-13T21:40:43.041 INFO:tasks.workunit.client.1.smithi116.stdout:5/470: link d7/da/d5e/d65/c66 d7/da/c9b 0 2024-09-13T21:40:43.041 INFO:tasks.workunit.client.1.smithi116.stdout:5/471: rmdir d7/da/d5e/d79 39 2024-09-13T21:40:43.047 INFO:tasks.workunit.client.1.smithi116.stdout:4/460: truncate d0/dd/d13/f1e 1497360 0 2024-09-13T21:40:43.048 INFO:tasks.workunit.client.1.smithi116.stdout:4/461: chown d0/dd/d13/d5a 285 1 2024-09-13T21:40:43.049 INFO:tasks.workunit.client.1.smithi116.stdout:9/270: read d2/f3 [3712316,123301] 0 2024-09-13T21:40:43.049 INFO:tasks.workunit.client.1.smithi116.stdout:0/332: dwrite d2/d5/f34 [0,4194304] 0 2024-09-13T21:40:43.049 INFO:tasks.workunit.client.1.smithi116.stdout:0/333: creat d2/d5/d61/f6a x:0 0 0 2024-09-13T21:40:43.050 INFO:tasks.workunit.client.1.smithi116.stdout:4/462: mknod d0/dd/d13/d4e/c90 0 2024-09-13T21:40:43.051 INFO:tasks.workunit.client.1.smithi116.stdout:4/463: write d0/dd/f1b [5452359,53735] 0 2024-09-13T21:40:43.051 INFO:tasks.workunit.client.1.smithi116.stdout:4/464: stat d0/dd/d6b 0 2024-09-13T21:40:43.076 INFO:tasks.workunit.client.1.smithi116.stdout:5/472: dwrite d7/d1d/f20 [0,4194304] 0 2024-09-13T21:40:43.076 INFO:tasks.workunit.client.1.smithi116.stdout:5/473: write d7/fc [4014099,103053] 0 2024-09-13T21:40:43.076 INFO:tasks.workunit.client.1.smithi116.stdout:5/474: chown d7/da/d5e/f7b 315 1 2024-09-13T21:40:43.076 INFO:tasks.workunit.client.1.smithi116.stdout:5/475: creat d7/d1d/d64/d87/f9c x:0 0 0 2024-09-13T21:40:43.079 INFO:tasks.workunit.client.1.smithi116.stdout:5/476: symlink d7/d1d/l9d 0 2024-09-13T21:40:43.079 INFO:tasks.workunit.client.1.smithi116.stdout:5/477: stat d7/d1d/d46/d5c/f78 0 2024-09-13T21:40:43.080 INFO:tasks.workunit.client.1.smithi116.stdout:5/478: getdents d7 0 2024-09-13T21:40:43.080 INFO:tasks.workunit.client.1.smithi116.stdout:5/479: write d7/d40/d53/f89 [1375167,8818] 0 2024-09-13T21:40:43.081 INFO:tasks.workunit.client.1.smithi116.stdout:0/334: dwrite d2/d5/d61/f6a [0,4194304] 0 2024-09-13T21:40:43.081 INFO:tasks.workunit.client.1.smithi116.stdout:9/271: dwrite d2/d10/d14/f21 [0,4194304] 0 2024-09-13T21:40:43.082 INFO:tasks.workunit.client.1.smithi116.stdout:4/465: dwrite d0/dd/f3f [0,4194304] 0 2024-09-13T21:40:43.090 INFO:tasks.workunit.client.1.smithi116.stdout:5/480: write d7/da/f52 [3543068,54707] 0 2024-09-13T21:40:43.093 INFO:tasks.workunit.client.1.smithi116.stdout:8/373: sync 2024-09-13T21:40:43.093 INFO:tasks.workunit.client.1.smithi116.stdout:8/374: write d2/d10/d19/d3a/f6f [918563,47805] 0 2024-09-13T21:40:43.094 INFO:tasks.workunit.client.1.smithi116.stdout:4/466: write d0/f8 [4139760,91423] 0 2024-09-13T21:40:43.094 INFO:tasks.workunit.client.1.smithi116.stdout:8/375: unlink d2/d10/f3f 0 2024-09-13T21:40:43.095 INFO:tasks.workunit.client.1.smithi116.stdout:0/335: write d2/dc/f2e [3606500,72148] 0 2024-09-13T21:40:43.095 INFO:tasks.workunit.client.1.smithi116.stdout:0/336: write d2/dc/f2e [3090141,105366] 0 2024-09-13T21:40:43.096 INFO:tasks.workunit.client.1.smithi116.stdout:8/376: creat d2/d10/d19/d21/d22/f78 x:0 0 0 2024-09-13T21:40:43.096 INFO:tasks.workunit.client.1.smithi116.stdout:8/377: symlink d2/d27/d62/l79 0 2024-09-13T21:40:43.097 INFO:tasks.workunit.client.1.smithi116.stdout:8/378: mkdir d2/d10/d19/d3a/d4c/d7a 0 2024-09-13T21:40:43.100 INFO:tasks.workunit.client.1.smithi116.stdout:8/379: creat d2/d27/d62/f7b x:0 0 0 2024-09-13T21:40:43.100 INFO:tasks.workunit.client.1.smithi116.stdout:8/380: truncate d2/f6d 1179590 0 2024-09-13T21:40:43.102 INFO:tasks.workunit.client.1.smithi116.stdout:9/272: dwrite d2/f3 [4194304,4194304] 0 2024-09-13T21:40:43.105 INFO:tasks.workunit.client.1.smithi116.stdout:9/273: rename d2/d10/d14/c36 to d2/d10/d41/c4a 0 2024-09-13T21:40:43.106 INFO:tasks.workunit.client.1.smithi116.stdout:0/337: dread d2/d5/f27 [0,4194304] 0 2024-09-13T21:40:43.114 INFO:tasks.workunit.client.1.smithi116.stdout:5/481: dwrite d7/f16 [0,4194304] 0 2024-09-13T21:40:43.114 INFO:tasks.workunit.client.1.smithi116.stdout:5/482: creat d7/d40/f9e x:0 0 0 2024-09-13T21:40:43.114 INFO:tasks.workunit.client.1.smithi116.stdout:5/483: chown d7/f3f 662 1 2024-09-13T21:40:43.116 INFO:tasks.workunit.client.1.smithi116.stdout:4/467: dread d0/dd/d13/f3c [0,4194304] 0 2024-09-13T21:40:43.118 INFO:tasks.workunit.client.1.smithi116.stdout:5/484: symlink d7/da/d5e/d79/l9f 0 2024-09-13T21:40:43.128 INFO:tasks.workunit.client.1.smithi116.stdout:8/381: dwrite d2/d10/f11 [0,4194304] 0 2024-09-13T21:40:43.128 INFO:tasks.workunit.client.1.smithi116.stdout:8/382: dread - d2/d10/d19/d21/d22/d5d/d46/f4f zero size 2024-09-13T21:40:43.128 INFO:tasks.workunit.client.1.smithi116.stdout:8/383: chown d2/d10/d37/c40 52571 1 2024-09-13T21:40:43.128 INFO:tasks.workunit.client.1.smithi116.stdout:8/384: chown d2/d10/d4b/f51 9560380 1 2024-09-13T21:40:43.129 INFO:tasks.workunit.client.1.smithi116.stdout:8/385: mkdir d2/d27/d66/d7c 0 2024-09-13T21:40:43.129 INFO:tasks.workunit.client.1.smithi116.stdout:8/386: write d2/f8 [354093,66506] 0 2024-09-13T21:40:43.129 INFO:tasks.workunit.client.1.smithi116.stdout:8/387: fsync d2/d10/d19/d3a/f3b 0 2024-09-13T21:40:43.129 INFO:tasks.workunit.client.1.smithi116.stdout:8/388: creat d2/d10/d19/d21/d22/d5d/d46/f7d x:0 0 0 2024-09-13T21:40:43.130 INFO:tasks.workunit.client.1.smithi116.stdout:8/389: symlink d2/d10/d19/d3a/l7e 0 2024-09-13T21:40:43.130 INFO:tasks.workunit.client.1.smithi116.stdout:8/390: chown d2/d10/d19/d3a/c73 1383559 1 2024-09-13T21:40:43.130 INFO:tasks.workunit.client.1.smithi116.stdout:8/391: getdents d2/d27 0 2024-09-13T21:40:43.131 INFO:tasks.workunit.client.1.smithi116.stdout:0/338: dwrite d2/dc/fe [0,4194304] 0 2024-09-13T21:40:43.132 INFO:tasks.workunit.client.1.smithi116.stdout:5/485: dread d7/d1d/f20 [0,4194304] 0 2024-09-13T21:40:43.132 INFO:tasks.workunit.client.1.smithi116.stdout:5/486: readlink d7/d1d/d46/d5c/l73 0 2024-09-13T21:40:43.132 INFO:tasks.workunit.client.1.smithi116.stdout:8/392: rename d2/ce to d2/d10/d19/d21/d22/d5d/c7f 0 2024-09-13T21:40:43.132 INFO:tasks.workunit.client.1.smithi116.stdout:4/468: dwrite d0/dd/f70 [0,4194304] 0 2024-09-13T21:40:43.134 INFO:tasks.workunit.client.1.smithi116.stdout:0/339: symlink d2/dc/d12/d28/d57/l6b 0 2024-09-13T21:40:43.135 INFO:tasks.workunit.client.1.smithi116.stdout:5/487: unlink d7/da/l15 0 2024-09-13T21:40:43.136 INFO:tasks.workunit.client.1.smithi116.stdout:5/488: write d7/d1d/d64/d87/f98 [1014124,9201] 0 2024-09-13T21:40:43.136 INFO:tasks.workunit.client.1.smithi116.stdout:5/489: creat d7/d1d/d46/d85/fa0 x:0 0 0 2024-09-13T21:40:43.140 INFO:tasks.workunit.client.1.smithi116.stdout:5/490: dread d7/d1d/f70 [0,4194304] 0 2024-09-13T21:40:43.140 INFO:tasks.workunit.client.1.smithi116.stdout:5/491: readlink d7/d1d/l7c 0 2024-09-13T21:40:43.140 INFO:tasks.workunit.client.1.smithi116.stdout:8/393: rename d2/d10/d19/d3a/l58 to d2/d10/d19/d42/d45/l80 0 2024-09-13T21:40:43.145 INFO:tasks.workunit.client.1.smithi116.stdout:5/492: symlink d7/d1d/d46/d5c/la1 0 2024-09-13T21:40:43.148 INFO:tasks.workunit.client.1.smithi116.stdout:8/394: truncate d2/d10/d37/f25 3531228 0 2024-09-13T21:40:43.151 INFO:tasks.workunit.client.1.smithi116.stdout:5/493: truncate d7/d40/d53/f89 559517 0 2024-09-13T21:40:43.151 INFO:tasks.workunit.client.1.smithi116.stdout:5/494: stat d7/da/d5e/d65/d6f/c71 0 2024-09-13T21:40:43.163 INFO:tasks.workunit.client.1.smithi116.stdout:5/495: dread d7/d1d/d46/f8b [0,4194304] 0 2024-09-13T21:40:43.172 INFO:tasks.workunit.client.1.smithi116.stdout:4/469: dwrite d0/dd/f60 [0,4194304] 0 2024-09-13T21:40:43.172 INFO:tasks.workunit.client.1.smithi116.stdout:4/470: truncate d0/d32/f3e 95161 0 2024-09-13T21:40:43.172 INFO:tasks.workunit.client.1.smithi116.stdout:0/340: dwrite d2/dc/d47/f4d [0,4194304] 0 2024-09-13T21:40:43.173 INFO:tasks.workunit.client.1.smithi116.stdout:8/395: dwrite d2/d10/d19/d3a/f55 [0,4194304] 0 2024-09-13T21:40:43.173 INFO:tasks.workunit.client.1.smithi116.stdout:8/396: write d2/d10/d4b/f50 [221692,27916] 0 2024-09-13T21:40:43.175 INFO:tasks.workunit.client.1.smithi116.stdout:4/471: creat d0/dd/d13/f91 x:0 0 0 2024-09-13T21:40:43.180 INFO:tasks.workunit.client.1.smithi116.stdout:5/496: link d7/da/f1c d7/fa2 0 2024-09-13T21:40:43.181 INFO:tasks.workunit.client.1.smithi116.stdout:4/472: mkdir d0/dd/d6b/d92 0 2024-09-13T21:40:43.182 INFO:tasks.workunit.client.1.smithi116.stdout:0/341: rmdir d2/dc/d47 39 2024-09-13T21:40:43.184 INFO:tasks.workunit.client.1.smithi116.stdout:8/397: mkdir d2/d81 0 2024-09-13T21:40:43.184 INFO:tasks.workunit.client.1.smithi116.stdout:8/398: truncate d2/d5c/f6a 973377 0 2024-09-13T21:40:43.184 INFO:tasks.workunit.client.1.smithi116.stdout:8/399: truncate d2/d10/d19/d21/d22/d5d/d46/f7d 739054 0 2024-09-13T21:40:43.186 INFO:tasks.workunit.client.1.smithi116.stdout:4/473: creat d0/dd/d6b/f93 x:0 0 0 2024-09-13T21:40:43.187 INFO:tasks.workunit.client.1.smithi116.stdout:0/342: mknod d2/dc/d12/c6c 0 2024-09-13T21:40:43.187 INFO:tasks.workunit.client.1.smithi116.stdout:0/343: fdatasync d2/d5/f50 0 2024-09-13T21:40:43.188 INFO:tasks.workunit.client.1.smithi116.stdout:8/400: link d2/d10/l3d d2/d10/d19/l82 0 2024-09-13T21:40:43.188 INFO:tasks.workunit.client.1.smithi116.stdout:8/401: chown d2/d10/d19/d3a/f6f 27 1 2024-09-13T21:40:43.188 INFO:tasks.workunit.client.1.smithi116.stdout:8/402: write d2/d10/d19/f1d [3042449,35888] 0 2024-09-13T21:40:43.192 INFO:tasks.workunit.client.1.smithi116.stdout:5/497: link d7/d1d/d46/d5c/c91 d7/d1d/d46/d85/d96/ca3 0 2024-09-13T21:40:43.193 INFO:tasks.workunit.client.1.smithi116.stdout:0/344: write d2/d5/f27 [2530394,25587] 0 2024-09-13T21:40:43.193 INFO:tasks.workunit.client.1.smithi116.stdout:4/474: creat d0/dd/d48/f94 x:0 0 0 2024-09-13T21:40:43.193 INFO:tasks.workunit.client.1.smithi116.stdout:4/475: dread - d0/dd/d48/f94 zero size 2024-09-13T21:40:43.193 INFO:tasks.workunit.client.1.smithi116.stdout:5/498: creat d7/da/d5e/d65/fa4 x:0 0 0 2024-09-13T21:40:43.193 INFO:tasks.workunit.client.1.smithi116.stdout:0/345: link d2/dc/d12/d28/l4f d2/d5/l6d 0 2024-09-13T21:40:43.193 INFO:tasks.workunit.client.1.smithi116.stdout:0/346: chown d2/d5b/f5c 27456296 1 2024-09-13T21:40:43.194 INFO:tasks.workunit.client.1.smithi116.stdout:5/499: mkdir d7/da/d5e/d65/da5 0 2024-09-13T21:40:43.194 INFO:tasks.workunit.client.1.smithi116.stdout:8/403: dread d2/f2f [0,4194304] 0 2024-09-13T21:40:43.197 INFO:tasks.workunit.client.1.smithi116.stdout:5/500: write d7/d1d/f99 [1666676,44827] 0 2024-09-13T21:40:43.198 INFO:tasks.workunit.client.1.smithi116.stdout:5/501: write d7/d40/f9e [803650,130144] 0 2024-09-13T21:40:43.199 INFO:tasks.workunit.client.1.smithi116.stdout:5/502: mknod d7/da/d5e/d65/d6a/ca6 0 2024-09-13T21:40:43.202 INFO:tasks.workunit.client.1.smithi116.stdout:5/503: link d7/d40/d80/l97 d7/d1d/d46/d5c/la7 0 2024-09-13T21:40:43.202 INFO:tasks.workunit.client.1.smithi116.stdout:6/364: sync 2024-09-13T21:40:43.202 INFO:tasks.workunit.client.1.smithi116.stdout:7/491: sync 2024-09-13T21:40:43.202 INFO:tasks.workunit.client.1.smithi116.stdout:7/492: getdents d5/d9/d1c/d2e/d52 0 2024-09-13T21:40:43.203 INFO:tasks.workunit.client.1.smithi116.stdout:5/504: mkdir d7/d1d/d46/d85/d96/da8 0 2024-09-13T21:40:43.205 INFO:tasks.workunit.client.1.smithi116.stdout:8/404: dread d2/d10/f11 [0,4194304] 0 2024-09-13T21:40:43.205 INFO:tasks.workunit.client.1.smithi116.stdout:7/493: mkdir d5/d9/db/d21/d9b 0 2024-09-13T21:40:43.205 INFO:tasks.workunit.client.1.smithi116.stdout:0/347: dread d2/dc/fe [0,4194304] 0 2024-09-13T21:40:43.205 INFO:tasks.workunit.client.1.smithi116.stdout:0/348: write d2/d5/d61/f67 [955936,68362] 0 2024-09-13T21:40:43.205 INFO:tasks.workunit.client.1.smithi116.stdout:6/365: getdents d8/d15/d2e/d2f/d38 0 2024-09-13T21:40:43.206 INFO:tasks.workunit.client.1.smithi116.stdout:4/476: dwrite d0/d32/f3e [0,4194304] 0 2024-09-13T21:40:43.206 INFO:tasks.workunit.client.1.smithi116.stdout:4/477: readlink d0/dd/d13/l20 0 2024-09-13T21:40:43.206 INFO:tasks.workunit.client.1.smithi116.stdout:8/405: symlink d2/d10/d75/l83 0 2024-09-13T21:40:43.207 INFO:tasks.workunit.client.1.smithi116.stdout:7/494: symlink d5/d9/d1c/d2e/l9c 0 2024-09-13T21:40:43.212 INFO:tasks.workunit.client.1.smithi116.stdout:8/406: write d2/d10/d19/d3a/f6f [27630,30714] 0 2024-09-13T21:40:43.212 INFO:tasks.workunit.client.1.smithi116.stdout:8/407: chown d2/d27/d66 104 1 2024-09-13T21:40:43.212 INFO:tasks.workunit.client.1.smithi116.stdout:4/478: dread d0/dd/d13/f1e [0,4194304] 0 2024-09-13T21:40:43.212 INFO:tasks.workunit.client.1.smithi116.stdout:8/408: fdatasync d2/d27/f72 0 2024-09-13T21:40:43.212 INFO:tasks.workunit.client.1.smithi116.stdout:4/479: write d0/d32/f52 [4336527,33292] 0 2024-09-13T21:40:43.212 INFO:tasks.workunit.client.1.smithi116.stdout:0/349: rename d2/dc/d12/d51/f69 to d2/dc/d12/d28/f6e 0 2024-09-13T21:40:43.212 INFO:tasks.workunit.client.1.smithi116.stdout:0/350: creat d2/d5b/f6f x:0 0 0 2024-09-13T21:40:43.213 INFO:tasks.workunit.client.1.smithi116.stdout:0/351: stat d2/dc/f2c 0 2024-09-13T21:40:43.213 INFO:tasks.workunit.client.1.smithi116.stdout:0/352: write d2/dc/d12/f36 [556556,15216] 0 2024-09-13T21:40:43.215 INFO:tasks.workunit.client.1.smithi116.stdout:5/505: getdents d7/d1d/d46/d5c 0 2024-09-13T21:40:43.216 INFO:tasks.workunit.client.1.smithi116.stdout:5/506: readlink d7/d1d/l7d 0 2024-09-13T21:40:43.219 INFO:tasks.workunit.client.1.smithi116.stdout:4/480: dread d0/f43 [0,4194304] 0 2024-09-13T21:40:43.220 INFO:tasks.workunit.client.1.smithi116.stdout:4/481: chown d0/d56/d57 15429073 1 2024-09-13T21:40:43.220 INFO:tasks.workunit.client.1.smithi116.stdout:7/495: rmdir d5/d9/d27/d31/d38/d42 39 2024-09-13T21:40:43.220 INFO:tasks.workunit.client.1.smithi116.stdout:4/482: dread d0/d32/d5d/f6f [0,4194304] 0 2024-09-13T21:40:43.221 INFO:tasks.workunit.client.1.smithi116.stdout:0/353: truncate d2/dc/d12/f41 80437 0 2024-09-13T21:40:43.221 INFO:tasks.workunit.client.1.smithi116.stdout:5/507: getdents d7/d40/d80 0 2024-09-13T21:40:43.222 INFO:tasks.workunit.client.1.smithi116.stdout:7/496: mknod d5/d9/db/d21/d6e/d6f/d70/c9d 0 2024-09-13T21:40:43.224 INFO:tasks.workunit.client.1.smithi116.stdout:7/497: mknod d5/d9/d1c/d22/d24/d6b/c9e 0 2024-09-13T21:40:43.224 INFO:tasks.workunit.client.1.smithi116.stdout:7/498: fdatasync d5/d9/db/f99 0 2024-09-13T21:40:43.227 INFO:tasks.workunit.client.1.smithi116.stdout:5/508: write d7/d40/f75 [3564912,36931] 0 2024-09-13T21:40:43.227 INFO:tasks.workunit.client.1.smithi116.stdout:5/509: creat d7/d40/fa9 x:0 0 0 2024-09-13T21:40:43.227 INFO:tasks.workunit.client.1.smithi116.stdout:5/510: truncate d7/d1d/d64/d87/f98 1705501 0 2024-09-13T21:40:43.229 INFO:tasks.workunit.client.1.smithi116.stdout:5/511: mkdir d7/d1d/d64/d94/daa 0 2024-09-13T21:40:43.231 INFO:tasks.workunit.client.1.smithi116.stdout:5/512: creat d7/d1d/d64/fab x:0 0 0 2024-09-13T21:40:43.232 INFO:tasks.workunit.client.1.smithi116.stdout:5/513: creat d7/d1d/d46/d85/d96/da8/fac x:0 0 0 2024-09-13T21:40:43.233 INFO:tasks.workunit.client.1.smithi116.stdout:5/514: symlink d7/d1d/d64/d94/lad 0 2024-09-13T21:40:43.233 INFO:tasks.workunit.client.1.smithi116.stdout:5/515: write d7/d1d/f70 [961577,122112] 0 2024-09-13T21:40:43.234 INFO:tasks.workunit.client.1.smithi116.stdout:4/483: write d0/f24 [4021652,37525] 0 2024-09-13T21:40:43.234 INFO:tasks.workunit.client.1.smithi116.stdout:6/366: dwrite d8/d15/f1f [4194304,4194304] 0 2024-09-13T21:40:43.235 INFO:tasks.workunit.client.1.smithi116.stdout:8/409: dwrite d2/d10/d19/d21/d22/f78 [0,4194304] 0 2024-09-13T21:40:43.237 INFO:tasks.workunit.client.1.smithi116.stdout:6/367: dread d8/d10/d24/f29 [0,4194304] 0 2024-09-13T21:40:43.237 INFO:tasks.workunit.client.1.smithi116.stdout:6/368: fdatasync d8/d15/d2e/f69 0 2024-09-13T21:40:43.238 INFO:tasks.workunit.client.1.smithi116.stdout:8/410: dread d2/d10/d19/d21/d22/f4a [0,4194304] 0 2024-09-13T21:40:43.238 INFO:tasks.workunit.client.1.smithi116.stdout:0/354: dread d2/dc/f3d [0,4194304] 0 2024-09-13T21:40:43.241 INFO:tasks.workunit.client.1.smithi116.stdout:5/516: dread d7/f12 [0,4194304] 0 2024-09-13T21:40:43.241 INFO:tasks.workunit.client.1.smithi116.stdout:5/517: fsync d7/da/d5e/f7b 0 2024-09-13T21:40:43.241 INFO:tasks.workunit.client.1.smithi116.stdout:5/518: dread - d7/da/d5e/d65/fa4 zero size 2024-09-13T21:40:43.241 INFO:tasks.workunit.client.1.smithi116.stdout:6/369: unlink d8/ff 0 2024-09-13T21:40:43.243 INFO:tasks.workunit.client.1.smithi116.stdout:4/484: rmdir d0/dd/d13 39 2024-09-13T21:40:43.244 INFO:tasks.workunit.client.1.smithi116.stdout:3/479: sync 2024-09-13T21:40:43.244 INFO:tasks.workunit.client.1.smithi116.stdout:1/353: sync 2024-09-13T21:40:43.244 INFO:tasks.workunit.client.1.smithi116.stdout:2/308: sync 2024-09-13T21:40:43.244 INFO:tasks.workunit.client.1.smithi116.stdout:3/480: stat d3/db/d10/d1c/d34 0 2024-09-13T21:40:43.244 INFO:tasks.workunit.client.1.smithi116.stdout:3/481: chown d3/db/d3d/d40 377 1 2024-09-13T21:40:43.245 INFO:tasks.workunit.client.1.smithi116.stdout:8/411: unlink d2/d10/d19/d21/d22/d5d/d46/c6c 0 2024-09-13T21:40:43.245 INFO:tasks.workunit.client.1.smithi116.stdout:8/412: chown d2/d10/d19/d21/l2e 11597 1 2024-09-13T21:40:43.246 INFO:tasks.workunit.client.1.smithi116.stdout:0/355: creat d2/dc/d47/f70 x:0 0 0 2024-09-13T21:40:43.253 INFO:tasks.workunit.client.1.smithi116.stdout:5/519: read d7/f72 [244032,101182] 0 2024-09-13T21:40:43.253 INFO:tasks.workunit.client.1.smithi116.stdout:5/520: write d7/d1d/f45 [4115501,104339] 0 2024-09-13T21:40:43.255 INFO:tasks.workunit.client.1.smithi116.stdout:6/370: mknod d8/d17/c83 0 2024-09-13T21:40:43.255 INFO:tasks.workunit.client.1.smithi116.stdout:6/371: truncate d8/d15/f64 1567108 0 2024-09-13T21:40:43.256 INFO:tasks.workunit.client.1.smithi116.stdout:4/485: mkdir d0/dd/d6b/d92/d95 0 2024-09-13T21:40:43.256 INFO:tasks.workunit.client.1.smithi116.stdout:4/486: fsync d0/f39 0 2024-09-13T21:40:43.256 INFO:tasks.workunit.client.1.smithi116.stdout:4/487: chown d0/c35 0 1 2024-09-13T21:40:43.257 INFO:tasks.workunit.client.1.smithi116.stdout:2/309: symlink d0/d7/d2b/d2c/d68/l6f 0 2024-09-13T21:40:43.258 INFO:tasks.workunit.client.1.smithi116.stdout:6/372: write d8/d15/d2e/d2f/f35 [283444,71499] 0 2024-09-13T21:40:43.258 INFO:tasks.workunit.client.1.smithi116.stdout:2/310: write d0/d7/d2b/d2c/d62/f4a [457600,39587] 0 2024-09-13T21:40:43.258 INFO:tasks.workunit.client.1.smithi116.stdout:8/413: creat d2/d10/d19/f84 x:0 0 0 2024-09-13T21:40:43.258 INFO:tasks.workunit.client.1.smithi116.stdout:8/414: dread - d2/d27/d62/f7b zero size 2024-09-13T21:40:43.260 INFO:tasks.workunit.client.1.smithi116.stdout:4/488: mknod d0/dd/d13/d5a/d7a/c96 0 2024-09-13T21:40:43.263 INFO:tasks.workunit.client.1.smithi116.stdout:2/311: symlink d0/d7/d2b/d2c/d62/d1f/l70 0 2024-09-13T21:40:43.263 INFO:tasks.workunit.client.1.smithi116.stdout:2/312: creat d0/d7/d2b/d2c/f71 x:0 0 0 2024-09-13T21:40:43.263 INFO:tasks.workunit.client.1.smithi116.stdout:0/356: dread d2/d5/f34 [0,4194304] 0 2024-09-13T21:40:43.263 INFO:tasks.workunit.client.1.smithi116.stdout:0/357: read - d2/d5/f4a zero size 2024-09-13T21:40:43.264 INFO:tasks.workunit.client.1.smithi116.stdout:8/415: unlink d2/d10/c34 0 2024-09-13T21:40:43.264 INFO:tasks.workunit.client.1.smithi116.stdout:5/521: link d7/f2f d7/d1d/d64/d94/daa/fae 0 2024-09-13T21:40:43.269 INFO:tasks.workunit.client.1.smithi116.stdout:5/522: read d7/d1d/f99 [162603,4881] 0 2024-09-13T21:40:43.269 INFO:tasks.workunit.client.1.smithi116.stdout:5/523: write d7/d1d/f70 [1021783,117918] 0 2024-09-13T21:40:43.269 INFO:tasks.workunit.client.1.smithi116.stdout:5/524: chown d7/d40/d53/f6e 134 1 2024-09-13T21:40:43.269 INFO:tasks.workunit.client.1.smithi116.stdout:5/525: readlink d7/d1d/d64/d87/l8d 0 2024-09-13T21:40:43.269 INFO:tasks.workunit.client.1.smithi116.stdout:2/313: rename d0/d5/d8/d58 to d0/d7/d2b/d2c/d62/d1f/d5d/d72 0 2024-09-13T21:40:43.271 INFO:tasks.workunit.client.1.smithi116.stdout:0/358: creat d2/f71 x:0 0 0 2024-09-13T21:40:43.274 INFO:tasks.workunit.client.1.smithi116.stdout:8/416: creat d2/d5c/f85 x:0 0 0 2024-09-13T21:40:43.275 INFO:tasks.workunit.client.1.smithi116.stdout:3/482: dwrite d3/db/d10/d1c/f1f [4194304,4194304] 0 2024-09-13T21:40:43.275 INFO:tasks.workunit.client.1.smithi116.stdout:3/483: chown d3/l6d 1203 1 2024-09-13T21:40:43.275 INFO:tasks.workunit.client.1.smithi116.stdout:3/484: fsync d3/f82 0 2024-09-13T21:40:43.275 INFO:tasks.workunit.client.1.smithi116.stdout:2/314: mkdir d0/d7/d2b/d2c/d62/d1f/d73 0 2024-09-13T21:40:43.277 INFO:tasks.workunit.client.1.smithi116.stdout:9/274: sync 2024-09-13T21:40:43.279 INFO:tasks.workunit.client.1.smithi116.stdout:8/417: rmdir d2/d10/d19/d42/d45 39 2024-09-13T21:40:43.282 INFO:tasks.workunit.client.1.smithi116.stdout:3/485: symlink d3/db/d20/d86/lb0 0 2024-09-13T21:40:43.282 INFO:tasks.workunit.client.1.smithi116.stdout:3/486: readlink d3/db/d10/d1c/l8c 0 2024-09-13T21:40:43.286 INFO:tasks.workunit.client.1.smithi116.stdout:9/275: creat d2/d10/d41/f4b x:0 0 0 2024-09-13T21:40:43.286 INFO:tasks.workunit.client.1.smithi116.stdout:9/276: write d2/d10/d14/f31 [2425959,129228] 0 2024-09-13T21:40:43.287 INFO:tasks.workunit.client.1.smithi116.stdout:5/526: read d7/da/f27 [3193596,110584] 0 2024-09-13T21:40:43.287 INFO:tasks.workunit.client.1.smithi116.stdout:3/487: rmdir d3/db/d20/d86/da6 39 2024-09-13T21:40:43.289 INFO:tasks.workunit.client.1.smithi116.stdout:6/373: dwrite d8/d10/f55 [0,4194304] 0 2024-09-13T21:40:43.290 INFO:tasks.workunit.client.1.smithi116.stdout:9/277: mkdir d2/d10/d4c 0 2024-09-13T21:40:43.291 INFO:tasks.workunit.client.1.smithi116.stdout:5/527: chown d7/f5d 4 1 2024-09-13T21:40:43.294 INFO:tasks.workunit.client.1.smithi116.stdout:3/488: mkdir d3/db/d10/d1c/d34/d55/d57/db1 0 2024-09-13T21:40:43.295 INFO:tasks.workunit.client.1.smithi116.stdout:4/489: dwrite d0/dd/d48/f5c [0,4194304] 0 2024-09-13T21:40:43.297 INFO:tasks.workunit.client.1.smithi116.stdout:6/374: symlink d8/d1e/l84 0 2024-09-13T21:40:43.297 INFO:tasks.workunit.client.1.smithi116.stdout:5/528: mknod d7/da/caf 0 2024-09-13T21:40:43.299 INFO:tasks.workunit.client.1.smithi116.stdout:5/529: write d7/da/d5e/f7a [229491,32358] 0 2024-09-13T21:40:43.303 INFO:tasks.workunit.client.1.smithi116.stdout:3/489: dread d3/db/f5e [0,4194304] 0 2024-09-13T21:40:43.305 INFO:tasks.workunit.client.1.smithi116.stdout:6/375: chown d8/d10/f2b 924229 1 2024-09-13T21:40:43.308 INFO:tasks.workunit.client.1.smithi116.stdout:0/359: dwrite d2/dc/d12/d28/f6e [0,4194304] 0 2024-09-13T21:40:43.308 INFO:tasks.workunit.client.1.smithi116.stdout:0/360: readlink d2/dc/d12/d28/l64 0 2024-09-13T21:40:43.308 INFO:tasks.workunit.client.1.smithi116.stdout:3/490: rename d3/db/d10/d1d/f75 to d3/db/d10/d1c/d34/d55/d57/db1/fb2 0 2024-09-13T21:40:43.309 INFO:tasks.workunit.client.1.smithi116.stdout:5/530: rmdir d7/d40/d53 39 2024-09-13T21:40:43.311 INFO:tasks.workunit.client.1.smithi116.stdout:0/361: link d2/dc/l5f d2/dc/d47/d63/l72 0 2024-09-13T21:40:43.311 INFO:tasks.workunit.client.1.smithi116.stdout:0/362: readlink d2/dc/l5f 0 2024-09-13T21:40:43.313 INFO:tasks.workunit.client.1.smithi116.stdout:0/363: link d2/d5/f34 d2/f73 0 2024-09-13T21:40:43.313 INFO:tasks.workunit.client.1.smithi116.stdout:0/364: fsync d2/dc/f2e 0 2024-09-13T21:40:43.315 INFO:tasks.workunit.client.1.smithi116.stdout:9/278: dwrite d2/d10/d14/f21 [4194304,4194304] 0 2024-09-13T21:40:43.315 INFO:tasks.workunit.client.1.smithi116.stdout:2/315: dwrite d0/d7/d2b/d2c/d62/f1d [0,4194304] 0 2024-09-13T21:40:43.315 INFO:tasks.workunit.client.1.smithi116.stdout:8/418: dwrite d2/d10/d19/d3a/f55 [4194304,4194304] 0 2024-09-13T21:40:43.315 INFO:tasks.workunit.client.1.smithi116.stdout:8/419: write d2/d27/f72 [16765,35360] 0 2024-09-13T21:40:43.315 INFO:tasks.workunit.client.1.smithi116.stdout:8/420: fsync d2/d10/d19/d3a/f3b 0 2024-09-13T21:40:43.317 INFO:tasks.workunit.client.1.smithi116.stdout:8/421: dread d2/d5c/f6a [0,4194304] 0 2024-09-13T21:40:43.321 INFO:tasks.workunit.client.1.smithi116.stdout:9/279: creat d2/d8/d3e/f4d x:0 0 0 2024-09-13T21:40:43.321 INFO:tasks.workunit.client.1.smithi116.stdout:8/422: creat d2/d27/d66/d7c/f86 x:0 0 0 2024-09-13T21:40:43.321 INFO:tasks.workunit.client.1.smithi116.stdout:8/423: chown d2/d10/d19/l82 4468846 1 2024-09-13T21:40:43.321 INFO:tasks.workunit.client.1.smithi116.stdout:9/280: write d2/d10/d14/f45 [857536,78882] 0 2024-09-13T21:40:43.326 INFO:tasks.workunit.client.1.smithi116.stdout:0/365: dread d2/d5/f50 [0,4194304] 0 2024-09-13T21:40:43.327 INFO:tasks.workunit.client.1.smithi116.stdout:0/366: truncate d2/dc/fe 2508525 0 2024-09-13T21:40:43.328 INFO:tasks.workunit.client.1.smithi116.stdout:0/367: write d2/dc/d47/f70 [177447,77191] 0 2024-09-13T21:40:43.330 INFO:tasks.workunit.client.1.smithi116.stdout:0/368: creat d2/dc/d12/d28/f74 x:0 0 0 2024-09-13T21:40:43.334 INFO:tasks.workunit.client.1.smithi116.stdout:0/369: write d2/dc/d12/f49 [324853,92364] 0 2024-09-13T21:40:43.334 INFO:tasks.workunit.client.1.smithi116.stdout:5/531: dread d7/f3d [4194304,4194304] 0 2024-09-13T21:40:43.334 INFO:tasks.workunit.client.1.smithi116.stdout:5/532: fsync d7/d40/d53/f6e 0 2024-09-13T21:40:43.337 INFO:tasks.workunit.client.1.smithi116.stdout:5/533: symlink d7/d1d/d64/d94/lb0 0 2024-09-13T21:40:43.337 INFO:tasks.workunit.client.1.smithi116.stdout:5/534: creat d7/da/d5e/d65/d6a/fb1 x:0 0 0 2024-09-13T21:40:43.339 INFO:tasks.workunit.client.1.smithi116.stdout:5/535: mkdir d7/da/db2 0 2024-09-13T21:40:43.347 INFO:tasks.workunit.client.1.smithi116.stdout:6/376: dwrite d8/f47 [0,4194304] 0 2024-09-13T21:40:43.347 INFO:tasks.workunit.client.1.smithi116.stdout:6/377: dread - d8/d15/f32 zero size 2024-09-13T21:40:43.347 INFO:tasks.workunit.client.1.smithi116.stdout:3/491: dwrite d3/db/d10/d1c/f5d [0,4194304] 0 2024-09-13T21:40:43.348 INFO:tasks.workunit.client.1.smithi116.stdout:3/492: write d3/db/d10/d1d/d2f/d61/f2a [1380187,113662] 0 2024-09-13T21:40:43.348 INFO:tasks.workunit.client.1.smithi116.stdout:3/493: dread - d3/db/d10/d1d/d5f/fa7 zero size 2024-09-13T21:40:43.348 INFO:tasks.workunit.client.1.smithi116.stdout:3/494: chown d3/db/f5e 600232117 1 2024-09-13T21:40:43.348 INFO:tasks.workunit.client.1.smithi116.stdout:3/495: readlink d3/l2b 0 2024-09-13T21:40:43.348 INFO:tasks.workunit.client.1.smithi116.stdout:4/490: dwrite d0/d32/f49 [0,4194304] 0 2024-09-13T21:40:43.349 INFO:tasks.workunit.client.1.smithi116.stdout:6/378: chown d8/d10/c39 23285 1 2024-09-13T21:40:43.349 INFO:tasks.workunit.client.1.smithi116.stdout:6/379: read - d8/d15/d2e/d2f/d57/f68 zero size 2024-09-13T21:40:43.349 INFO:tasks.workunit.client.1.smithi116.stdout:6/380: write d8/d15/d2e/d2f/d38/f75 [17602,10836] 0 2024-09-13T21:40:43.349 INFO:tasks.workunit.client.1.smithi116.stdout:6/381: write d8/d15/d2e/d2f/f35 [411248,23526] 0 2024-09-13T21:40:43.350 INFO:tasks.workunit.client.1.smithi116.stdout:6/382: dread - d8/d15/f32 zero size 2024-09-13T21:40:43.350 INFO:tasks.workunit.client.1.smithi116.stdout:3/496: creat d3/db/d10/d1d/d5f/d6f/fb3 x:0 0 0 2024-09-13T21:40:43.353 INFO:tasks.workunit.client.1.smithi116.stdout:6/383: creat d8/d10/d78/f85 x:0 0 0 2024-09-13T21:40:43.353 INFO:tasks.workunit.client.1.smithi116.stdout:6/384: write d8/d10/d33/f46 [763912,67050] 0 2024-09-13T21:40:43.353 INFO:tasks.workunit.client.1.smithi116.stdout:6/385: chown d8/d1e/f63 467985 1 2024-09-13T21:40:43.360 INFO:tasks.workunit.client.1.smithi116.stdout:4/491: write d0/dd/d48/f5c [845698,60580] 0 2024-09-13T21:40:43.361 INFO:tasks.workunit.client.1.smithi116.stdout:4/492: mknod d0/dd/d13/d5a/c97 0 2024-09-13T21:40:43.362 INFO:tasks.workunit.client.1.smithi116.stdout:4/493: mknod d0/d56/d57/c98 0 2024-09-13T21:40:43.363 INFO:tasks.workunit.client.1.smithi116.stdout:2/316: dwrite d0/d7/f24 [0,4194304] 0 2024-09-13T21:40:43.363 INFO:tasks.workunit.client.1.smithi116.stdout:2/317: fdatasync d0/d7/d2d/f56 0 2024-09-13T21:40:43.363 INFO:tasks.workunit.client.1.smithi116.stdout:2/318: truncate d0/d5/d2a/f6d 384860 0 2024-09-13T21:40:43.363 INFO:tasks.workunit.client.1.smithi116.stdout:9/281: dwrite d2/f2b [0,4194304] 0 2024-09-13T21:40:43.363 INFO:tasks.workunit.client.1.smithi116.stdout:9/282: fsync d2/d10/f32 0 2024-09-13T21:40:43.365 INFO:tasks.workunit.client.1.smithi116.stdout:8/424: dwrite d2/d10/d4b/f51 [0,4194304] 0 2024-09-13T21:40:43.365 INFO:tasks.workunit.client.1.smithi116.stdout:8/425: chown d2/d10/d19/d21/c44 2678 1 2024-09-13T21:40:43.366 INFO:tasks.workunit.client.1.smithi116.stdout:4/494: mkdir d0/dd/d6b/d92/d99 0 2024-09-13T21:40:43.366 INFO:tasks.workunit.client.1.smithi116.stdout:4/495: chown d0/dd/d13/f4c 7 1 2024-09-13T21:40:43.366 INFO:tasks.workunit.client.1.smithi116.stdout:4/496: dread - d0/dd/d48/f94 zero size 2024-09-13T21:40:43.366 INFO:tasks.workunit.client.1.smithi116.stdout:0/370: dwrite d2/d5/f27 [0,4194304] 0 2024-09-13T21:40:43.366 INFO:tasks.workunit.client.1.smithi116.stdout:5/536: dwrite d7/d1d/d46/d5c/f63 [0,4194304] 0 2024-09-13T21:40:43.369 INFO:tasks.workunit.client.1.smithi116.stdout:2/319: truncate d0/d7/d2b/f3f 324604 0 2024-09-13T21:40:43.369 INFO:tasks.workunit.client.1.smithi116.stdout:2/320: write d0/d7/d2b/d2c/d62/f4a [1104545,130549] 0 2024-09-13T21:40:43.375 INFO:tasks.workunit.client.1.smithi116.stdout:4/497: mkdir d0/dd/d6b/d92/d99/d9a 0 2024-09-13T21:40:43.375 INFO:tasks.workunit.client.1.smithi116.stdout:4/498: truncate d0/d32/d5f/f63 737219 0 2024-09-13T21:40:43.377 INFO:tasks.workunit.client.1.smithi116.stdout:0/371: symlink d2/dc/d12/d51/l75 0 2024-09-13T21:40:43.377 INFO:tasks.workunit.client.1.smithi116.stdout:0/372: write d2/dc/d47/f70 [1173753,21372] 0 2024-09-13T21:40:43.382 INFO:tasks.workunit.client.1.smithi116.stdout:5/537: unlink d7/da/d5e/f30 0 2024-09-13T21:40:43.382 INFO:tasks.workunit.client.1.smithi116.stdout:5/538: dread - d7/d1d/d64/d87/f9c zero size 2024-09-13T21:40:43.383 INFO:tasks.workunit.client.1.smithi116.stdout:8/426: dwrite d2/d5c/f6a [0,4194304] 0 2024-09-13T21:40:43.383 INFO:tasks.workunit.client.1.smithi116.stdout:8/427: read d2/d10/d19/d21/d22/d5d/d46/f7d [676702,6396] 0 2024-09-13T21:40:43.384 INFO:tasks.workunit.client.1.smithi116.stdout:2/321: truncate d0/d5/d8/f3c 3763319 0 2024-09-13T21:40:43.385 INFO:tasks.workunit.client.1.smithi116.stdout:4/499: rename d0/d32/f53 to d0/dd/f9b 0 2024-09-13T21:40:43.387 INFO:tasks.workunit.client.1.smithi116.stdout:0/373: mknod d2/c76 0 2024-09-13T21:40:43.387 INFO:tasks.workunit.client.1.smithi116.stdout:0/374: write d2/dc/d12/f49 [3879569,128616] 0 2024-09-13T21:40:43.387 INFO:tasks.workunit.client.1.smithi116.stdout:0/375: creat d2/d5/d61/f77 x:0 0 0 2024-09-13T21:40:43.387 INFO:tasks.workunit.client.1.smithi116.stdout:5/539: mknod d7/d1d/d46/d5c/cb3 0 2024-09-13T21:40:43.390 INFO:tasks.workunit.client.1.smithi116.stdout:8/428: getdents d2/d27/d66 0 2024-09-13T21:40:43.392 INFO:tasks.workunit.client.1.smithi116.stdout:2/322: rename d0/fe to d0/d7/d2b/d2c/d62/f74 0 2024-09-13T21:40:43.392 INFO:tasks.workunit.client.1.smithi116.stdout:4/500: symlink d0/dd/d13/d5a/d7a/l9c 0 2024-09-13T21:40:43.396 INFO:tasks.workunit.client.1.smithi116.stdout:8/429: unlink d2/d27/d66/l70 0 2024-09-13T21:40:43.396 INFO:tasks.workunit.client.1.smithi116.stdout:8/430: chown d2/f2f 16110 1 2024-09-13T21:40:43.397 INFO:tasks.workunit.client.1.smithi116.stdout:4/501: write d0/f43 [1279182,7369] 0 2024-09-13T21:40:43.397 INFO:tasks.workunit.client.1.smithi116.stdout:0/376: rename d2/dc/d47/f4d to d2/d5b/f78 0 2024-09-13T21:40:43.398 INFO:tasks.workunit.client.1.smithi116.stdout:2/323: mkdir d0/d7/d2b/d2c/d62/d75 0 2024-09-13T21:40:43.399 INFO:tasks.workunit.client.1.smithi116.stdout:8/431: mkdir d2/d10/d19/d42/d45/d87 0 2024-09-13T21:40:43.401 INFO:tasks.workunit.client.1.smithi116.stdout:4/502: unlink d0/d56/c81 0 2024-09-13T21:40:43.401 INFO:tasks.workunit.client.1.smithi116.stdout:4/503: creat d0/dd/d48/f9d x:0 0 0 2024-09-13T21:40:43.401 INFO:tasks.workunit.client.1.smithi116.stdout:4/504: write d0/dd/d13/f4c [452167,102687] 0 2024-09-13T21:40:43.401 INFO:tasks.workunit.client.1.smithi116.stdout:4/505: chown d0/dd 2861505 1 2024-09-13T21:40:43.401 INFO:tasks.workunit.client.1.smithi116.stdout:0/377: symlink d2/d5/l79 0 2024-09-13T21:40:43.402 INFO:tasks.workunit.client.1.smithi116.stdout:2/324: getdents d0/d7/d2b/d2c/d62/d1f 0 2024-09-13T21:40:43.403 INFO:tasks.workunit.client.1.smithi116.stdout:2/325: chown d0/d7/d2b/d2c/d68/l6f 1426 1 2024-09-13T21:40:43.403 INFO:tasks.workunit.client.1.smithi116.stdout:5/540: write d7/f16 [1464760,41607] 0 2024-09-13T21:40:43.403 INFO:tasks.workunit.client.1.smithi116.stdout:8/432: symlink d2/d10/d3e/l88 0 2024-09-13T21:40:43.405 INFO:tasks.workunit.client.1.smithi116.stdout:4/506: mknod d0/dd/d48/c9e 0 2024-09-13T21:40:43.406 INFO:tasks.workunit.client.1.smithi116.stdout:0/378: mknod d2/dc/d12/c7a 0 2024-09-13T21:40:43.409 INFO:tasks.workunit.client.1.smithi116.stdout:2/326: dread d0/d5/d2a/f3d [0,4194304] 0 2024-09-13T21:40:43.412 INFO:tasks.workunit.client.1.smithi116.stdout:8/433: creat d2/d10/d19/d3a/d4c/d7a/f89 x:0 0 0 2024-09-13T21:40:43.412 INFO:tasks.workunit.client.1.smithi116.stdout:8/434: stat d2/d10/d37/d64 0 2024-09-13T21:40:43.414 INFO:tasks.workunit.client.1.smithi116.stdout:0/379: dread d2/d5/f34 [0,4194304] 0 2024-09-13T21:40:43.417 INFO:tasks.workunit.client.1.smithi116.stdout:2/327: read d0/d5/f10 [1705761,97545] 0 2024-09-13T21:40:43.417 INFO:tasks.workunit.client.1.smithi116.stdout:2/328: write d0/d7/d2d/f6a [1154144,13688] 0 2024-09-13T21:40:43.417 INFO:tasks.workunit.client.1.smithi116.stdout:5/541: getdents d7/d1d/d46 0 2024-09-13T21:40:43.423 INFO:tasks.workunit.client.1.smithi116.stdout:0/380: write d2/d5/f6 [915229,111035] 0 2024-09-13T21:40:43.423 INFO:tasks.workunit.client.1.smithi116.stdout:0/381: dread - d2/d5/d61/f77 zero size 2024-09-13T21:40:43.429 INFO:tasks.workunit.client.1.smithi116.stdout:0/382: mkdir d2/dc/d47/d63/d7b 0 2024-09-13T21:40:43.435 INFO:tasks.workunit.client.1.smithi116.stdout:0/383: read d2/dc/fe [2258618,10801] 0 2024-09-13T21:40:43.436 INFO:tasks.workunit.client.1.smithi116.stdout:0/384: write d2/d5/f6 [115564,62945] 0 2024-09-13T21:40:43.442 INFO:tasks.workunit.client.1.smithi116.stdout:8/435: dwrite d2/d10/f31 [0,4194304] 0 2024-09-13T21:40:43.443 INFO:tasks.workunit.client.1.smithi116.stdout:4/507: dwrite d0/dd/d13/f46 [0,4194304] 0 2024-09-13T21:40:43.443 INFO:tasks.workunit.client.1.smithi116.stdout:2/329: dwrite d0/d7/d2b/d2c/d62/f46 [0,4194304] 0 2024-09-13T21:40:43.444 INFO:tasks.workunit.client.1.smithi116.stdout:8/436: creat d2/f8a x:0 0 0 2024-09-13T21:40:43.446 INFO:tasks.workunit.client.1.smithi116.stdout:0/385: dread d2/d5/f27 [0,4194304] 0 2024-09-13T21:40:43.447 INFO:tasks.workunit.client.1.smithi116.stdout:0/386: getdents d2/dc/d12/d28/d57/d65 0 2024-09-13T21:40:43.447 INFO:tasks.workunit.client.1.smithi116.stdout:0/387: write d2/f38 [1792954,80686] 0 2024-09-13T21:40:43.456 INFO:tasks.workunit.client.1.smithi116.stdout:4/508: read d0/dd/f9b [3973403,130991] 0 2024-09-13T21:40:43.466 INFO:tasks.workunit.client.1.smithi116.stdout:8/437: read d2/d10/d19/d3a/f55 [8084943,6309] 0 2024-09-13T21:40:43.467 INFO:tasks.workunit.client.1.smithi116.stdout:2/330: dwrite d0/d7/d2d/f56 [4194304,4194304] 0 2024-09-13T21:40:43.475 INFO:tasks.workunit.client.1.smithi116.stdout:4/509: dread d0/f30 [0,4194304] 0 2024-09-13T21:40:43.477 INFO:tasks.workunit.client.1.smithi116.stdout:8/438: write d2/d10/d19/d3a/f3b [1242097,56069] 0 2024-09-13T21:40:43.480 INFO:tasks.workunit.client.1.smithi116.stdout:0/388: dwrite d2/d5/f16 [0,4194304] 0 2024-09-13T21:40:43.481 INFO:tasks.workunit.client.1.smithi116.stdout:2/331: write d0/d7/d2d/f56 [7824942,51042] 0 2024-09-13T21:40:43.481 INFO:tasks.workunit.client.1.smithi116.stdout:2/332: chown d0/d5/d8/l1b 2 1 2024-09-13T21:40:43.483 INFO:tasks.workunit.client.1.smithi116.stdout:0/389: rmdir d2/dc/d47/d63/d7b 0 2024-09-13T21:40:43.485 INFO:tasks.workunit.client.1.smithi116.stdout:2/333: dread d0/d7/f12 [0,4194304] 0 2024-09-13T21:40:43.486 INFO:tasks.workunit.client.1.smithi116.stdout:2/334: getdents d0/d7/d2b/d2c/d68 0 2024-09-13T21:40:43.498 INFO:tasks.workunit.client.1.smithi116.stdout:4/510: dwrite d0/dd/d13/f4c [0,4194304] 0 2024-09-13T21:40:43.498 INFO:tasks.workunit.client.1.smithi116.stdout:4/511: fdatasync d0/dd/d13/f4c 0 2024-09-13T21:40:43.505 INFO:tasks.workunit.client.1.smithi116.stdout:2/335: dread d0/d7/d2d/f56 [4194304,4194304] 0 2024-09-13T21:40:43.508 INFO:tasks.workunit.client.1.smithi116.stdout:8/439: dwrite d2/d10/d19/f1d [0,4194304] 0 2024-09-13T21:40:43.508 INFO:tasks.workunit.client.1.smithi116.stdout:7/499: sync 2024-09-13T21:40:43.508 INFO:tasks.workunit.client.1.smithi116.stdout:1/354: sync 2024-09-13T21:40:43.511 INFO:tasks.workunit.client.1.smithi116.stdout:8/440: unlink d2/d27/f72 0 2024-09-13T21:40:43.512 INFO:tasks.workunit.client.1.smithi116.stdout:1/355: mknod d4/d14/d52/d2f/d5c/c7d 0 2024-09-13T21:40:43.513 INFO:tasks.workunit.client.1.smithi116.stdout:7/500: mknod d5/d9/d1c/d2e/d52/c9f 0 2024-09-13T21:40:43.513 INFO:tasks.workunit.client.1.smithi116.stdout:7/501: chown d5/d9/db/l32 436162 1 2024-09-13T21:40:43.513 INFO:tasks.workunit.client.1.smithi116.stdout:7/502: write d5/d9/d27/d31/d38/f6a [103097,71716] 0 2024-09-13T21:40:43.514 INFO:tasks.workunit.client.1.smithi116.stdout:8/441: truncate d2/d10/d19/d3a/f55 5268353 0 2024-09-13T21:40:43.514 INFO:tasks.workunit.client.1.smithi116.stdout:8/442: chown d2/d10/d19/d42/l5a 452291 1 2024-09-13T21:40:43.514 INFO:tasks.workunit.client.1.smithi116.stdout:1/356: symlink d4/d14/d2a/l7e 0 2024-09-13T21:40:43.515 INFO:tasks.workunit.client.1.smithi116.stdout:8/443: rmdir d2/d10/d37/d64 39 2024-09-13T21:40:43.516 INFO:tasks.workunit.client.1.smithi116.stdout:0/390: dwrite d2/d5/f58 [0,4194304] 0 2024-09-13T21:40:43.517 INFO:tasks.workunit.client.1.smithi116.stdout:1/357: rename d4/c6 to d4/d14/d41/c7f 0 2024-09-13T21:40:43.520 INFO:tasks.workunit.client.1.smithi116.stdout:0/391: symlink d2/dc/d12/d28/d57/l7c 0 2024-09-13T21:40:43.522 INFO:tasks.workunit.client.1.smithi116.stdout:1/358: creat d4/d74/f80 x:0 0 0 2024-09-13T21:40:43.522 INFO:tasks.workunit.client.1.smithi116.stdout:1/359: chown d4/d14/f1d 109945 1 2024-09-13T21:40:43.522 INFO:tasks.workunit.client.1.smithi116.stdout:8/444: getdents d2/d10/d19 0 2024-09-13T21:40:43.523 INFO:tasks.workunit.client.1.smithi116.stdout:8/445: dread - d2/d5c/f85 zero size 2024-09-13T21:40:43.523 INFO:tasks.workunit.client.1.smithi116.stdout:8/446: fdatasync d2/d10/d19/d21/d22/f78 0 2024-09-13T21:40:43.524 INFO:tasks.workunit.client.1.smithi116.stdout:2/336: dwrite d0/d7/d2d/f34 [0,4194304] 0 2024-09-13T21:40:43.524 INFO:tasks.workunit.client.1.smithi116.stdout:0/392: symlink d2/dc/d12/l7d 0 2024-09-13T21:40:43.524 INFO:tasks.workunit.client.1.smithi116.stdout:0/393: creat d2/d5/f7e x:0 0 0 2024-09-13T21:40:43.526 INFO:tasks.workunit.client.1.smithi116.stdout:1/360: rename c0 to d4/d14/d52/c81 0 2024-09-13T21:40:43.527 INFO:tasks.workunit.client.1.smithi116.stdout:2/337: creat d0/f76 x:0 0 0 2024-09-13T21:40:43.528 INFO:tasks.workunit.client.1.smithi116.stdout:0/394: creat d2/dc/d47/d63/f7f x:0 0 0 2024-09-13T21:40:43.528 INFO:tasks.workunit.client.1.smithi116.stdout:0/395: chown d2/d5/d61/f67 604 1 2024-09-13T21:40:43.528 INFO:tasks.workunit.client.1.smithi116.stdout:0/396: truncate d2/dc/d12/f36 1140187 0 2024-09-13T21:40:43.528 INFO:tasks.workunit.client.1.smithi116.stdout:0/397: fsync d2/d5/d61/f67 0 2024-09-13T21:40:43.529 INFO:tasks.workunit.client.1.smithi116.stdout:0/398: write d2/d5/d61/f6a [5202734,100111] 0 2024-09-13T21:40:43.529 INFO:tasks.workunit.client.1.smithi116.stdout:1/361: symlink d4/d23/d57/l82 0 2024-09-13T21:40:43.530 INFO:tasks.workunit.client.1.smithi116.stdout:1/362: write d4/f20 [352062,46454] 0 2024-09-13T21:40:43.530 INFO:tasks.workunit.client.1.smithi116.stdout:2/338: mkdir d0/d7/d2b/d2c/d62/d75/d77 0 2024-09-13T21:40:43.533 INFO:tasks.workunit.client.1.smithi116.stdout:1/363: creat d4/f83 x:0 0 0 2024-09-13T21:40:43.533 INFO:tasks.workunit.client.1.smithi116.stdout:7/503: dwrite d5/d9/db/d21/f3e [0,4194304] 0 2024-09-13T21:40:43.537 INFO:tasks.workunit.client.1.smithi116.stdout:1/364: symlink d4/d14/d44/l84 0 2024-09-13T21:40:43.537 INFO:tasks.workunit.client.1.smithi116.stdout:1/365: chown d4/d14/d52/l71 700 1 2024-09-13T21:40:43.543 INFO:tasks.workunit.client.1.smithi116.stdout:7/504: unlink d5/l15 0 2024-09-13T21:40:43.545 INFO:tasks.workunit.client.1.smithi116.stdout:1/366: truncate d4/d14/d52/f4a 3987136 0 2024-09-13T21:40:43.545 INFO:tasks.workunit.client.1.smithi116.stdout:1/367: truncate d4/d14/d41/f4d 1410548 0 2024-09-13T21:40:43.545 INFO:tasks.workunit.client.1.smithi116.stdout:1/368: write d4/d14/f4f [4234240,75067] 0 2024-09-13T21:40:43.547 INFO:tasks.workunit.client.1.smithi116.stdout:7/505: unlink d5/d9/db/d21/d6e/d6f/d70/d80/f91 0 2024-09-13T21:40:43.551 INFO:tasks.workunit.client.1.smithi116.stdout:0/399: getdents d2/dc/d12 0 2024-09-13T21:40:43.552 INFO:tasks.workunit.client.1.smithi116.stdout:0/400: stat d2/d5/l6d 0 2024-09-13T21:40:43.555 INFO:tasks.workunit.client.1.smithi116.stdout:2/339: dwrite d0/d7/f1e [0,4194304] 0 2024-09-13T21:40:43.555 INFO:tasks.workunit.client.1.smithi116.stdout:2/340: fsync d0/d5/d8/f39 0 2024-09-13T21:40:43.555 INFO:tasks.workunit.client.1.smithi116.stdout:2/341: fsync d0/d7/f24 0 2024-09-13T21:40:43.555 INFO:tasks.workunit.client.1.smithi116.stdout:2/342: readlink d0/d3a/l4e 0 2024-09-13T21:40:43.555 INFO:tasks.workunit.client.1.smithi116.stdout:2/343: chown d0/d5/c37 97683682 1 2024-09-13T21:40:43.555 INFO:tasks.workunit.client.1.smithi116.stdout:2/344: creat d0/d7/d2b/f78 x:0 0 0 2024-09-13T21:40:43.555 INFO:tasks.workunit.client.1.smithi116.stdout:2/345: dread - d0/d7/d2b/f78 zero size 2024-09-13T21:40:43.555 INFO:tasks.workunit.client.1.smithi116.stdout:2/346: creat d0/f79 x:0 0 0 2024-09-13T21:40:43.555 INFO:tasks.workunit.client.1.smithi116.stdout:2/347: fdatasync d0/f54 0 2024-09-13T21:40:43.556 INFO:tasks.workunit.client.1.smithi116.stdout:2/348: chown d0/d7/d2b/d2c/d62/d1f 173647 1 2024-09-13T21:40:43.556 INFO:tasks.workunit.client.1.smithi116.stdout:0/401: mknod d2/dc/d12/c80 0 2024-09-13T21:40:43.556 INFO:tasks.workunit.client.1.smithi116.stdout:7/506: dread d5/f16 [0,4194304] 0 2024-09-13T21:40:43.559 INFO:tasks.workunit.client.1.smithi116.stdout:2/349: mkdir d0/d5/d8/d7a 0 2024-09-13T21:40:43.561 INFO:tasks.workunit.client.1.smithi116.stdout:7/507: symlink d5/d9/d27/d31/la0 0 2024-09-13T21:40:43.561 INFO:tasks.workunit.client.1.smithi116.stdout:7/508: write d5/d9/db/d21/d6e/f9a [835829,19876] 0 2024-09-13T21:40:43.561 INFO:tasks.workunit.client.1.smithi116.stdout:7/509: chown d5/d9/db/l60 47641957 1 2024-09-13T21:40:43.561 INFO:tasks.workunit.client.1.smithi116.stdout:7/510: chown d5/d9/d1c/d22/l25 3 1 2024-09-13T21:40:43.562 INFO:tasks.workunit.client.1.smithi116.stdout:7/511: fsync d5/d9/db/d21/f7e 0 2024-09-13T21:40:43.564 INFO:tasks.workunit.client.1.smithi116.stdout:0/402: link d2/dc/d12/d51/c55 d2/dc/c81 0 2024-09-13T21:40:43.564 INFO:tasks.workunit.client.1.smithi116.stdout:0/403: write d2/dc/d12/f36 [1453970,102300] 0 2024-09-13T21:40:43.564 INFO:tasks.workunit.client.1.smithi116.stdout:0/404: stat d2/dc/f3d 0 2024-09-13T21:40:43.564 INFO:tasks.workunit.client.1.smithi116.stdout:0/405: chown d2/f71 1811276301 1 2024-09-13T21:40:43.566 INFO:tasks.workunit.client.1.smithi116.stdout:0/406: creat d2/dc/d12/d28/d57/f82 x:0 0 0 2024-09-13T21:40:43.567 INFO:tasks.workunit.client.1.smithi116.stdout:7/512: mknod d5/d9/db/ca1 0 2024-09-13T21:40:43.569 INFO:tasks.workunit.client.1.smithi116.stdout:0/407: link d2/dc/d47/f70 d2/f83 0 2024-09-13T21:40:43.569 INFO:tasks.workunit.client.1.smithi116.stdout:0/408: chown d2/c40 1499438 1 2024-09-13T21:40:43.572 INFO:tasks.workunit.client.1.smithi116.stdout:0/409: unlink d2/f71 0 2024-09-13T21:40:43.574 INFO:tasks.workunit.client.1.smithi116.stdout:0/410: rename d2/dc/d12/c46 to d2/c84 0 2024-09-13T21:40:43.574 INFO:tasks.workunit.client.1.smithi116.stdout:0/411: fdatasync d2/d5/f16 0 2024-09-13T21:40:43.574 INFO:tasks.workunit.client.1.smithi116.stdout:0/412: creat d2/d5b/f85 x:0 0 0 2024-09-13T21:40:43.576 INFO:tasks.workunit.client.1.smithi116.stdout:0/413: fdatasync d2/dc/f33 0 2024-09-13T21:40:43.577 INFO:tasks.workunit.client.1.smithi116.stdout:0/414: mkdir d2/d5/d86 0 2024-09-13T21:40:43.577 INFO:tasks.workunit.client.1.smithi116.stdout:0/415: chown d2/dc/d12/d28/f6e 4017710 1 2024-09-13T21:40:43.578 INFO:tasks.workunit.client.1.smithi116.stdout:0/416: rename d2/dc/d47/f66 to d2/f87 0 2024-09-13T21:40:43.580 INFO:tasks.workunit.client.1.smithi116.stdout:0/417: getdents d2/dc/d47/d63 0 2024-09-13T21:40:43.585 INFO:tasks.workunit.client.1.smithi116.stdout:0/418: dread d2/d5/f6 [0,4194304] 0 2024-09-13T21:40:43.585 INFO:tasks.workunit.client.1.smithi116.stdout:0/419: creat d2/dc/d12/d28/f88 x:0 0 0 2024-09-13T21:40:43.587 INFO:tasks.workunit.client.1.smithi116.stdout:0/420: rename d2/d5/f6 to d2/f89 0 2024-09-13T21:40:43.588 INFO:tasks.workunit.client.1.smithi116.stdout:0/421: write d2/dc/d12/d28/f88 [780487,58990] 0 2024-09-13T21:40:43.588 INFO:tasks.workunit.client.1.smithi116.stdout:1/369: write d4/d14/d52/f4a [2645093,68748] 0 2024-09-13T21:40:43.589 INFO:tasks.workunit.client.1.smithi116.stdout:0/422: mkdir d2/d5/d86/d8a 0 2024-09-13T21:40:43.589 INFO:tasks.workunit.client.1.smithi116.stdout:0/423: fsync d2/dc/f2c 0 2024-09-13T21:40:43.589 INFO:tasks.workunit.client.1.smithi116.stdout:0/424: fsync d2/f38 0 2024-09-13T21:40:43.589 INFO:tasks.workunit.client.1.smithi116.stdout:0/425: read d2/dc/f2e [1890291,967] 0 2024-09-13T21:40:43.591 INFO:tasks.workunit.client.1.smithi116.stdout:1/370: getdents d4/d14/d2a 0 2024-09-13T21:40:43.591 INFO:tasks.workunit.client.1.smithi116.stdout:1/371: truncate d4/d23/f7c 82746 0 2024-09-13T21:40:43.591 INFO:tasks.workunit.client.1.smithi116.stdout:2/350: dwrite d0/d7/d2b/d2c/d62/f4a [0,4194304] 0 2024-09-13T21:40:43.593 INFO:tasks.workunit.client.1.smithi116.stdout:1/372: dread d4/d14/d52/f3b [0,4194304] 0 2024-09-13T21:40:43.593 INFO:tasks.workunit.client.1.smithi116.stdout:1/373: dread - d4/d14/d52/d2f/f4b zero size 2024-09-13T21:40:43.594 INFO:tasks.workunit.client.1.smithi116.stdout:7/513: dwrite d5/d9/db/f45 [0,4194304] 0 2024-09-13T21:40:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:43 smithi116 ceph-mon[33391]: pgmap v261: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 115 MiB/s rd, 137 MiB/s wr, 268 op/s 2024-09-13T21:40:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:43 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:43 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:43.596 INFO:tasks.workunit.client.1.smithi116.stdout:2/351: unlink d0/d7/c17 0 2024-09-13T21:40:43.597 INFO:tasks.workunit.client.1.smithi116.stdout:2/352: fdatasync d0/d7/d2b/f3f 0 2024-09-13T21:40:43.600 INFO:tasks.workunit.client.1.smithi116.stdout:1/374: symlink d4/d74/l85 0 2024-09-13T21:40:43.614 INFO:tasks.workunit.client.1.smithi116.stdout:0/426: truncate d2/d5/d61/f6a 2411009 0 2024-09-13T21:40:43.614 INFO:tasks.workunit.client.1.smithi116.stdout:0/427: readlink d2/dc/d12/l4c 0 2024-09-13T21:40:43.617 INFO:tasks.workunit.client.1.smithi116.stdout:7/514: getdents d5/d9/d1c/d2e/d52 0 2024-09-13T21:40:43.619 INFO:tasks.workunit.client.1.smithi116.stdout:0/428: chown d2/dc/l35 101 1 2024-09-13T21:40:43.620 INFO:tasks.workunit.client.1.smithi116.stdout:7/515: creat d5/d9/db/d21/d9b/fa2 x:0 0 0 2024-09-13T21:40:43.623 INFO:tasks.workunit.client.1.smithi116.stdout:1/375: rmdir d4/d23 39 2024-09-13T21:40:43.623 INFO:tasks.workunit.client.1.smithi116.stdout:1/376: chown d4/d14/d52/d2f/d5c 496720 1 2024-09-13T21:40:43.625 INFO:tasks.workunit.client.1.smithi116.stdout:0/429: mknod d2/dc/d12/d28/d57/c8b 0 2024-09-13T21:40:43.626 INFO:tasks.workunit.client.1.smithi116.stdout:0/430: symlink d2/dc/d12/d28/d57/l8c 0 2024-09-13T21:40:43.627 INFO:tasks.workunit.client.1.smithi116.stdout:0/431: link d2/dc/d12/d28/l45 d2/dc/d12/d28/d57/l8d 0 2024-09-13T21:40:43.631 INFO:tasks.workunit.client.1.smithi116.stdout:0/432: unlink d2/d5/d61/f67 0 2024-09-13T21:40:43.634 INFO:tasks.workunit.client.1.smithi116.stdout:7/516: dread d5/d9/db/f3c [0,4194304] 0 2024-09-13T21:40:43.636 INFO:tasks.workunit.client.1.smithi116.stdout:0/433: mknod d2/dc/d12/d28/d57/d65/c8e 0 2024-09-13T21:40:43.636 INFO:tasks.workunit.client.1.smithi116.stdout:0/434: write d2/dc/d12/f41 [67555,517] 0 2024-09-13T21:40:43.641 INFO:tasks.workunit.client.1.smithi116.stdout:6/386: sync 2024-09-13T21:40:43.641 INFO:tasks.workunit.client.1.smithi116.stdout:3/497: sync 2024-09-13T21:40:43.642 INFO:tasks.workunit.client.1.smithi116.stdout:6/387: link d8/d10/d33/f46 d8/d15/f86 0 2024-09-13T21:40:43.642 INFO:tasks.workunit.client.1.smithi116.stdout:6/388: chown d8/d1e/l61 20 1 2024-09-13T21:40:43.644 INFO:tasks.workunit.client.1.smithi116.stdout:6/389: creat d8/f87 x:0 0 0 2024-09-13T21:40:43.644 INFO:tasks.workunit.client.1.smithi116.stdout:6/390: truncate d8/d10/d33/f50 914766 0 2024-09-13T21:40:43.646 INFO:tasks.workunit.client.1.smithi116.stdout:1/377: dwrite d4/d14/d41/f49 [0,4194304] 0 2024-09-13T21:40:43.651 INFO:tasks.workunit.client.1.smithi116.stdout:1/378: rename d4/c1a to d4/d14/d52/d2f/d5c/c86 0 2024-09-13T21:40:43.653 INFO:tasks.workunit.client.1.smithi116.stdout:0/435: rmdir d2/dc/d12/d28/d57 39 2024-09-13T21:40:43.655 INFO:tasks.workunit.client.1.smithi116.stdout:0/436: symlink d2/dc/d12/l8f 0 2024-09-13T21:40:43.656 INFO:tasks.workunit.client.1.smithi116.stdout:0/437: creat d2/dc/d12/d28/d57/f90 x:0 0 0 2024-09-13T21:40:43.666 INFO:tasks.workunit.client.1.smithi116.stdout:3/498: dwrite d3/db/d10/d1d/d5f/d6f/fb3 [0,4194304] 0 2024-09-13T21:40:43.667 INFO:tasks.workunit.client.1.smithi116.stdout:6/391: dwrite d8/d15/d2e/d2f/d57/f72 [0,4194304] 0 2024-09-13T21:40:43.668 INFO:tasks.workunit.client.1.smithi116.stdout:3/499: rename d3/db/d10/d29/c36 to d3/db/d10/d99/cb4 0 2024-09-13T21:40:43.669 INFO:tasks.workunit.client.1.smithi116.stdout:6/392: symlink d8/d15/d2e/d2f/d38/l88 0 2024-09-13T21:40:43.669 INFO:tasks.workunit.client.1.smithi116.stdout:6/393: chown d8/d10/d33/f5c 0 1 2024-09-13T21:40:43.670 INFO:tasks.workunit.client.1.smithi116.stdout:6/394: chown f3 116 1 2024-09-13T21:40:43.677 INFO:tasks.workunit.client.1.smithi116.stdout:3/500: write d3/db/d3d/d40/f42 [3015108,118152] 0 2024-09-13T21:40:43.677 INFO:tasks.workunit.client.1.smithi116.stdout:3/501: dread - d3/db/d10/d1d/d5f/fa7 zero size 2024-09-13T21:40:43.678 INFO:tasks.workunit.client.1.smithi116.stdout:3/502: mknod d3/db/d10/d1c/d34/d55/cb5 0 2024-09-13T21:40:43.678 INFO:tasks.workunit.client.1.smithi116.stdout:3/503: stat d3/db 0 2024-09-13T21:40:43.678 INFO:tasks.workunit.client.1.smithi116.stdout:3/504: write d3/db/d3d/fae [1060376,114005] 0 2024-09-13T21:40:43.679 INFO:tasks.workunit.client.1.smithi116.stdout:3/505: creat d3/db/d10/d1c/d34/d55/d96/fb6 x:0 0 0 2024-09-13T21:40:43.679 INFO:tasks.workunit.client.1.smithi116.stdout:3/506: read - d3/db/d10/f7e zero size 2024-09-13T21:40:43.679 INFO:tasks.workunit.client.1.smithi116.stdout:3/507: chown d3/db/d10/d1d/d5f/d6f/f80 4489718 1 2024-09-13T21:40:43.680 INFO:tasks.workunit.client.1.smithi116.stdout:3/508: truncate d3/db/d10/d1d/d2f/d61/fab 624711 0 2024-09-13T21:40:43.680 INFO:tasks.workunit.client.1.smithi116.stdout:3/509: mknod d3/db/d10/d1d/d5f/cb7 0 2024-09-13T21:40:43.680 INFO:tasks.workunit.client.1.smithi116.stdout:3/510: chown d3/db/d10/d1d/d5f/l6a 14676 1 2024-09-13T21:40:43.681 INFO:tasks.workunit.client.1.smithi116.stdout:3/511: mknod d3/db/d10/d1c/d34/d55/cb8 0 2024-09-13T21:40:43.682 INFO:tasks.workunit.client.1.smithi116.stdout:3/512: creat d3/db/d10/d1d/d5f/d6f/fb9 x:0 0 0 2024-09-13T21:40:43.682 INFO:tasks.workunit.client.1.smithi116.stdout:6/395: dread d8/d1e/f31 [0,4194304] 0 2024-09-13T21:40:43.683 INFO:tasks.workunit.client.1.smithi116.stdout:6/396: creat d8/d15/d2e/d2f/d38/f89 x:0 0 0 2024-09-13T21:40:43.683 INFO:tasks.workunit.client.1.smithi116.stdout:6/397: write d8/d1e/f53 [1332639,83995] 0 2024-09-13T21:40:43.684 INFO:tasks.workunit.client.1.smithi116.stdout:6/398: creat d8/d10/d33/f8a x:0 0 0 2024-09-13T21:40:43.689 INFO:tasks.workunit.client.1.smithi116.stdout:6/399: symlink d8/d10/l8b 0 2024-09-13T21:40:43.690 INFO:tasks.workunit.client.1.smithi116.stdout:6/400: link d8/d15/d2e/f69 d8/d10/f8c 0 2024-09-13T21:40:43.691 INFO:tasks.workunit.client.1.smithi116.stdout:6/401: write d8/fa [2031936,123174] 0 2024-09-13T21:40:43.691 INFO:tasks.workunit.client.1.smithi116.stdout:6/402: write f3 [2806461,102967] 0 2024-09-13T21:40:43.692 INFO:tasks.workunit.client.1.smithi116.stdout:6/403: unlink d8/d1e/f31 0 2024-09-13T21:40:43.699 INFO:tasks.workunit.client.1.smithi116.stdout:6/404: read d8/d10/d33/f3b [4108344,4013] 0 2024-09-13T21:40:43.699 INFO:tasks.workunit.client.1.smithi116.stdout:6/405: write d8/d10/f4d [227494,22962] 0 2024-09-13T21:40:43.700 INFO:tasks.workunit.client.1.smithi116.stdout:6/406: fsync d8/d15/f64 0 2024-09-13T21:40:43.700 INFO:tasks.workunit.client.1.smithi116.stdout:6/407: mknod d8/d1e/c8d 0 2024-09-13T21:40:43.700 INFO:tasks.workunit.client.1.smithi116.stdout:6/408: write d8/d15/d2e/d2f/f35 [2038865,106031] 0 2024-09-13T21:40:43.700 INFO:tasks.workunit.client.1.smithi116.stdout:6/409: chown d8/d10/c39 7 1 2024-09-13T21:40:43.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:43 smithi088 ceph-mon[27963]: pgmap v261: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 115 MiB/s rd, 137 MiB/s wr, 268 op/s 2024-09-13T21:40:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:43 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:43 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:43.754 INFO:tasks.workunit.client.1.smithi116.stdout:1/379: dwrite d4/d14/f4f [0,4194304] 0 2024-09-13T21:40:43.754 INFO:tasks.workunit.client.1.smithi116.stdout:0/438: dwrite d2/dc/fe [0,4194304] 0 2024-09-13T21:40:43.755 INFO:tasks.workunit.client.1.smithi116.stdout:6/410: dwrite d8/d15/d2e/f6a [0,4194304] 0 2024-09-13T21:40:43.755 INFO:tasks.workunit.client.1.smithi116.stdout:6/411: fsync d8/d10/d33/f54 0 2024-09-13T21:40:43.758 INFO:tasks.workunit.client.1.smithi116.stdout:1/380: dread d4/f20 [0,4194304] 0 2024-09-13T21:40:43.758 INFO:tasks.workunit.client.1.smithi116.stdout:3/513: dwrite d3/db/d10/d1d/d5f/fa7 [0,4194304] 0 2024-09-13T21:40:43.758 INFO:tasks.workunit.client.1.smithi116.stdout:3/514: chown d3/db/d10/d1c/d63 2032212 1 2024-09-13T21:40:43.759 INFO:tasks.workunit.client.1.smithi116.stdout:3/515: truncate d3/db/d10/d1c/f5d 4892645 0 2024-09-13T21:40:43.762 INFO:tasks.workunit.client.1.smithi116.stdout:6/412: creat d8/d10/d65/f8e x:0 0 0 2024-09-13T21:40:43.772 INFO:tasks.workunit.client.1.smithi116.stdout:1/381: symlink d4/d14/d44/d5f/l87 0 2024-09-13T21:40:43.775 INFO:tasks.workunit.client.1.smithi116.stdout:3/516: rmdir d3/db/d10/d1d/d5f/d6f/d71/daf 0 2024-09-13T21:40:43.775 INFO:tasks.workunit.client.1.smithi116.stdout:0/439: dread d2/dc/d12/f49 [0,4194304] 0 2024-09-13T21:40:43.775 INFO:tasks.workunit.client.1.smithi116.stdout:0/440: creat d2/dc/d12/d51/f91 x:0 0 0 2024-09-13T21:40:43.776 INFO:tasks.workunit.client.1.smithi116.stdout:3/517: unlink d3/db/d10/d99/cb4 0 2024-09-13T21:40:43.779 INFO:tasks.workunit.client.1.smithi116.stdout:0/441: unlink d2/d5/f4a 0 2024-09-13T21:40:43.780 INFO:tasks.workunit.client.1.smithi116.stdout:0/442: chown d2/dc/d12/f49 33255891 1 2024-09-13T21:40:43.783 INFO:tasks.workunit.client.1.smithi116.stdout:6/413: mknod d8/d17/d70/c8f 0 2024-09-13T21:40:43.785 INFO:tasks.workunit.client.1.smithi116.stdout:3/518: creat d3/db/d10/fba x:0 0 0 2024-09-13T21:40:43.787 INFO:tasks.workunit.client.1.smithi116.stdout:0/443: mknod d2/d5/d61/c92 0 2024-09-13T21:40:43.790 INFO:tasks.workunit.client.1.smithi116.stdout:3/519: unlink d3/db/d10/d1c/f1f 0 2024-09-13T21:40:43.792 INFO:tasks.workunit.client.1.smithi116.stdout:1/382: dwrite d4/f83 [0,4194304] 0 2024-09-13T21:40:43.793 INFO:tasks.workunit.client.1.smithi116.stdout:0/444: link d2/dc/f2e d2/d5b/f93 0 2024-09-13T21:40:43.793 INFO:tasks.workunit.client.1.smithi116.stdout:0/445: write d2/d5/f7e [5077,87789] 0 2024-09-13T21:40:43.794 INFO:tasks.workunit.client.1.smithi116.stdout:3/520: mknod d3/db/d3d/cbb 0 2024-09-13T21:40:43.799 INFO:tasks.workunit.client.1.smithi116.stdout:0/446: rename d2/c84 to d2/d5/d86/c94 0 2024-09-13T21:40:43.799 INFO:tasks.workunit.client.1.smithi116.stdout:0/447: write d2/dc/f3d [3645929,119646] 0 2024-09-13T21:40:43.799 INFO:tasks.workunit.client.1.smithi116.stdout:0/448: chown d2/dc/d12/d28/f32 6605446 1 2024-09-13T21:40:43.801 INFO:tasks.workunit.client.1.smithi116.stdout:3/521: link d3/db/d10/d1d/d2f/d61/f2a d3/db/d20/d86/fbc 0 2024-09-13T21:40:43.801 INFO:tasks.workunit.client.1.smithi116.stdout:3/522: fsync d3/db/d26/f78 0 2024-09-13T21:40:43.803 INFO:tasks.workunit.client.1.smithi116.stdout:0/449: rename d2/c24 to d2/dc/c95 0 2024-09-13T21:40:43.804 INFO:tasks.workunit.client.1.smithi116.stdout:1/383: write d4/d14/f1d [1145314,93319] 0 2024-09-13T21:40:43.806 INFO:tasks.workunit.client.1.smithi116.stdout:0/450: mknod d2/dc/d12/d28/d57/d65/c96 0 2024-09-13T21:40:43.806 INFO:tasks.workunit.client.1.smithi116.stdout:0/451: write d2/d5b/f85 [387407,39743] 0 2024-09-13T21:40:43.807 INFO:tasks.workunit.client.1.smithi116.stdout:0/452: symlink d2/d5/d61/l97 0 2024-09-13T21:40:43.812 INFO:tasks.workunit.client.1.smithi116.stdout:0/453: rename d2/dc/f2d to d2/dc/d12/d51/f98 0 2024-09-13T21:40:43.813 INFO:tasks.workunit.client.1.smithi116.stdout:3/523: write d3/f11 [842903,44550] 0 2024-09-13T21:40:43.817 INFO:tasks.workunit.client.1.smithi116.stdout:1/384: dread d4/d14/d44/f55 [0,4194304] 0 2024-09-13T21:40:43.817 INFO:tasks.workunit.client.1.smithi116.stdout:3/524: mknod d3/cbd 0 2024-09-13T21:40:43.819 INFO:tasks.workunit.client.1.smithi116.stdout:1/385: rename d4/d23/f51 to d4/d14/d2a/f88 0 2024-09-13T21:40:43.820 INFO:tasks.workunit.client.1.smithi116.stdout:0/454: write d2/d5/f34 [1901444,41151] 0 2024-09-13T21:40:43.821 INFO:tasks.workunit.client.1.smithi116.stdout:1/386: symlink d4/d14/d52/d2f/d5d/l89 0 2024-09-13T21:40:43.823 INFO:tasks.workunit.client.1.smithi116.stdout:0/455: unlink d2/dc/d12/l4c 0 2024-09-13T21:40:43.823 INFO:tasks.workunit.client.1.smithi116.stdout:3/525: rmdir d3/db/d10/d62 39 2024-09-13T21:40:43.825 INFO:tasks.workunit.client.1.smithi116.stdout:1/387: rename d4/d14/d44/d5f/c61 to d4/d74/c8a 0 2024-09-13T21:40:43.825 INFO:tasks.workunit.client.1.smithi116.stdout:1/388: dread - d4/d14/d52/f40 zero size 2024-09-13T21:40:43.825 INFO:tasks.workunit.client.1.smithi116.stdout:1/389: creat d4/f8b x:0 0 0 2024-09-13T21:40:43.830 INFO:tasks.workunit.client.1.smithi116.stdout:3/526: creat d3/db/d10/d1c/d34/d55/d57/db1/fbe x:0 0 0 2024-09-13T21:40:43.832 INFO:tasks.workunit.client.1.smithi116.stdout:0/456: truncate d2/dc/f31 374442 0 2024-09-13T21:40:43.832 INFO:tasks.workunit.client.1.smithi116.stdout:0/457: fsync d2/dc/d12/d28/f74 0 2024-09-13T21:40:43.833 INFO:tasks.workunit.client.1.smithi116.stdout:0/458: symlink d2/d5/d86/d8a/l99 0 2024-09-13T21:40:43.833 INFO:tasks.workunit.client.1.smithi116.stdout:0/459: chown d2/dc/d12/d51/f91 0 1 2024-09-13T21:40:43.833 INFO:tasks.workunit.client.1.smithi116.stdout:0/460: chown d2/dc/d12/d28/f6e 73 1 2024-09-13T21:40:43.833 INFO:tasks.workunit.client.1.smithi116.stdout:0/461: creat d2/dc/d12/d51/f9a x:0 0 0 2024-09-13T21:40:43.834 INFO:tasks.workunit.client.1.smithi116.stdout:3/527: dread d3/db/d10/d1c/d34/d55/d57/f7a [0,4194304] 0 2024-09-13T21:40:43.834 INFO:tasks.workunit.client.1.smithi116.stdout:3/528: chown d3/l6 88 1 2024-09-13T21:40:43.834 INFO:tasks.workunit.client.1.smithi116.stdout:3/529: fsync d3/db/d10/d1d/d2f/f38 0 2024-09-13T21:40:43.834 INFO:tasks.workunit.client.1.smithi116.stdout:3/530: fdatasync d3/db/d10/fba 0 2024-09-13T21:40:43.837 INFO:tasks.workunit.client.1.smithi116.stdout:0/462: rename d2/f87 to d2/dc/d47/f9b 0 2024-09-13T21:40:43.837 INFO:tasks.workunit.client.1.smithi116.stdout:0/463: write d2/dc/f3d [3685070,2805] 0 2024-09-13T21:40:43.839 INFO:tasks.workunit.client.1.smithi116.stdout:3/531: rename d3/db/d20/d86/lb0 to d3/db/d10/d62/da2/lbf 0 2024-09-13T21:40:43.839 INFO:tasks.workunit.client.1.smithi116.stdout:3/532: getdents d3/db/d20/d86/da6 0 2024-09-13T21:40:43.842 INFO:tasks.workunit.client.1.smithi116.stdout:3/533: creat d3/db/d20/fc0 x:0 0 0 2024-09-13T21:40:43.842 INFO:tasks.workunit.client.1.smithi116.stdout:3/534: fdatasync d3/db/d10/d1d/d5f/d6f/d71/f7d 0 2024-09-13T21:40:43.843 INFO:tasks.workunit.client.1.smithi116.stdout:1/390: dwrite d4/d14/d2a/f88 [0,4194304] 0 2024-09-13T21:40:43.843 INFO:tasks.workunit.client.1.smithi116.stdout:6/414: truncate f3 1998073 0 2024-09-13T21:40:43.843 INFO:tasks.workunit.client.1.smithi116.stdout:6/415: fdatasync d8/d17/f71 0 2024-09-13T21:40:43.843 INFO:tasks.workunit.client.1.smithi116.stdout:0/464: fsync d2/dc/f3d 0 2024-09-13T21:40:43.844 INFO:tasks.workunit.client.1.smithi116.stdout:3/535: rename d3/db/d10/d29/f83 to d3/fc1 0 2024-09-13T21:40:43.846 INFO:tasks.workunit.client.1.smithi116.stdout:3/536: dread d3/db/d10/d1c/d34/d55/fa4 [0,4194304] 0 2024-09-13T21:40:43.846 INFO:tasks.workunit.client.1.smithi116.stdout:3/537: fdatasync d3/db/d10/fba 0 2024-09-13T21:40:43.846 INFO:tasks.workunit.client.1.smithi116.stdout:1/391: creat d4/d14/d52/d2f/d5c/f8c x:0 0 0 2024-09-13T21:40:43.846 INFO:tasks.workunit.client.1.smithi116.stdout:1/392: dread - d4/d14/d52/d2f/f6d zero size 2024-09-13T21:40:43.848 INFO:tasks.workunit.client.1.smithi116.stdout:3/538: mknod d3/db/d20/d86/da6/cc2 0 2024-09-13T21:40:43.848 INFO:tasks.workunit.client.1.smithi116.stdout:3/539: stat d3/db/d10/d1c/f5d 0 2024-09-13T21:40:43.848 INFO:tasks.workunit.client.1.smithi116.stdout:3/540: fsync d3/db/d10/f7e 0 2024-09-13T21:40:43.853 INFO:tasks.workunit.client.1.smithi116.stdout:5/542: sync 2024-09-13T21:40:43.853 INFO:tasks.workunit.client.1.smithi116.stdout:9/283: sync 2024-09-13T21:40:43.856 INFO:tasks.workunit.client.1.smithi116.stdout:9/284: creat d2/d10/d4c/f4e x:0 0 0 2024-09-13T21:40:43.857 INFO:tasks.workunit.client.1.smithi116.stdout:9/285: creat d2/d10/d14/d38/f4f x:0 0 0 2024-09-13T21:40:43.865 INFO:tasks.workunit.client.1.smithi116.stdout:5/543: write d7/d1d/f20 [2974960,88937] 0 2024-09-13T21:40:43.870 INFO:tasks.workunit.client.1.smithi116.stdout:5/544: write d7/d1d/d46/f8b [282388,32134] 0 2024-09-13T21:40:43.871 INFO:tasks.workunit.client.1.smithi116.stdout:6/416: dwrite d8/d10/f8c [0,4194304] 0 2024-09-13T21:40:43.873 INFO:tasks.workunit.client.1.smithi116.stdout:0/465: dwrite d2/d5/d61/f77 [0,4194304] 0 2024-09-13T21:40:43.873 INFO:tasks.workunit.client.1.smithi116.stdout:5/545: creat d7/da/fb4 x:0 0 0 2024-09-13T21:40:43.876 INFO:tasks.workunit.client.1.smithi116.stdout:1/393: rename d4/d14/d44 to d4/d74/d8d 0 2024-09-13T21:40:43.876 INFO:tasks.workunit.client.1.smithi116.stdout:9/286: rename d2/d10/d41 to d2/d10/d41/d50 22 2024-09-13T21:40:43.877 INFO:tasks.workunit.client.1.smithi116.stdout:9/287: creat d2/d10/d4c/f51 x:0 0 0 2024-09-13T21:40:43.881 INFO:tasks.workunit.client.1.smithi116.stdout:5/546: symlink d7/d40/d90/lb5 0 2024-09-13T21:40:43.883 INFO:tasks.workunit.client.1.smithi116.stdout:6/417: getdents d8/d17 0 2024-09-13T21:40:43.883 INFO:tasks.workunit.client.1.smithi116.stdout:6/418: dread - d8/d17/f82 zero size 2024-09-13T21:40:43.886 INFO:tasks.workunit.client.1.smithi116.stdout:0/466: rename d2/d5/f27 to d2/dc/d12/d28/f9c 0 2024-09-13T21:40:43.886 INFO:tasks.workunit.client.1.smithi116.stdout:0/467: fdatasync d2/dc/d12/d51/f98 0 2024-09-13T21:40:43.886 INFO:tasks.workunit.client.1.smithi116.stdout:0/468: readlink d2/dc/d12/d51/l75 0 2024-09-13T21:40:43.888 INFO:tasks.workunit.client.1.smithi116.stdout:0/469: dread d2/f89 [0,4194304] 0 2024-09-13T21:40:43.890 INFO:tasks.workunit.client.1.smithi116.stdout:0/470: creat d2/dc/d47/d63/f9d x:0 0 0 2024-09-13T21:40:43.890 INFO:tasks.workunit.client.1.smithi116.stdout:0/471: dread - d2/dc/d12/d28/f74 zero size 2024-09-13T21:40:43.891 INFO:tasks.workunit.client.1.smithi116.stdout:7/517: sync 2024-09-13T21:40:43.891 INFO:tasks.workunit.client.1.smithi116.stdout:8/447: sync 2024-09-13T21:40:43.891 INFO:tasks.workunit.client.1.smithi116.stdout:2/353: sync 2024-09-13T21:40:43.891 INFO:tasks.workunit.client.1.smithi116.stdout:4/512: sync 2024-09-13T21:40:43.891 INFO:tasks.workunit.client.1.smithi116.stdout:4/513: stat d0/d32 0 2024-09-13T21:40:43.892 INFO:tasks.workunit.client.1.smithi116.stdout:5/547: link d7/d1d/d64/d94/lb0 d7/da/d5e/d65/lb6 0 2024-09-13T21:40:43.893 INFO:tasks.workunit.client.1.smithi116.stdout:6/419: symlink d8/d17/d70/l90 0 2024-09-13T21:40:43.893 INFO:tasks.workunit.client.1.smithi116.stdout:6/420: chown d8/d17/l25 22556 1 2024-09-13T21:40:43.894 INFO:tasks.workunit.client.1.smithi116.stdout:6/421: chown d8/d17/c4e 16037 1 2024-09-13T21:40:43.895 INFO:tasks.workunit.client.1.smithi116.stdout:8/448: unlink d2/d10/d19/d3a/f55 0 2024-09-13T21:40:43.896 INFO:tasks.workunit.client.1.smithi116.stdout:2/354: creat d0/d7/d2b/d2c/d62/f7b x:0 0 0 2024-09-13T21:40:43.896 INFO:tasks.workunit.client.1.smithi116.stdout:2/355: stat d0/f63 0 2024-09-13T21:40:43.900 INFO:tasks.workunit.client.1.smithi116.stdout:6/422: creat d8/f91 x:0 0 0 2024-09-13T21:40:43.900 INFO:tasks.workunit.client.1.smithi116.stdout:6/423: dread - d8/d10/d65/f8e zero size 2024-09-13T21:40:43.900 INFO:tasks.workunit.client.1.smithi116.stdout:6/424: stat d8/d15/l20 0 2024-09-13T21:40:43.900 INFO:tasks.workunit.client.1.smithi116.stdout:7/518: mkdir d5/d9/db/da3 0 2024-09-13T21:40:43.903 INFO:tasks.workunit.client.1.smithi116.stdout:8/449: creat d2/d10/d19/d21/d69/f8b x:0 0 0 2024-09-13T21:40:43.903 INFO:tasks.workunit.client.1.smithi116.stdout:5/548: getdents d7/d1d/d46/d85/d96/da8 0 2024-09-13T21:40:43.904 INFO:tasks.workunit.client.1.smithi116.stdout:2/356: mknod d0/d7/d2b/d2c/d62/d1f/d73/c7c 0 2024-09-13T21:40:43.904 INFO:tasks.workunit.client.1.smithi116.stdout:6/425: creat d8/d15/f92 x:0 0 0 2024-09-13T21:40:43.904 INFO:tasks.workunit.client.1.smithi116.stdout:6/426: readlink d8/d1e/l7a 0 2024-09-13T21:40:43.908 INFO:tasks.workunit.client.1.smithi116.stdout:7/519: symlink d5/la4 0 2024-09-13T21:40:43.908 INFO:tasks.workunit.client.1.smithi116.stdout:7/520: creat d5/d9/d1c/d22/d24/d6b/d72/fa5 x:0 0 0 2024-09-13T21:40:43.908 INFO:tasks.workunit.client.1.smithi116.stdout:7/521: write d5/d9/db/d21/f63 [71054,57626] 0 2024-09-13T21:40:43.908 INFO:tasks.workunit.client.1.smithi116.stdout:7/522: chown d5/d9/db/d21/d6e/d6f/d70/d80 119 1 2024-09-13T21:40:43.908 INFO:tasks.workunit.client.1.smithi116.stdout:5/549: write d7/da/d5e/f7a [1690840,109345] 0 2024-09-13T21:40:43.909 INFO:tasks.workunit.client.1.smithi116.stdout:7/523: dread d5/d9/d27/d31/f71 [0,4194304] 0 2024-09-13T21:40:43.910 INFO:tasks.workunit.client.1.smithi116.stdout:6/427: symlink d8/d10/d33/l93 0 2024-09-13T21:40:43.910 INFO:tasks.workunit.client.1.smithi116.stdout:5/550: symlink d7/d40/d90/lb7 0 2024-09-13T21:40:43.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/551: readlink d7/d1d/d64/d87/l8d 0 2024-09-13T21:40:43.911 INFO:tasks.workunit.client.1.smithi116.stdout:7/524: truncate d5/d9/db/ff 1639748 0 2024-09-13T21:40:43.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/552: rmdir d7/d1d/d46/d85/d96/da8 39 2024-09-13T21:40:43.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/553: write d7/da/d5e/d65/fa4 [183557,4043] 0 2024-09-13T21:40:43.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/554: fdatasync d7/d1d/d64/d87/f98 0 2024-09-13T21:40:43.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/555: write d7/d40/d53/f61 [4239668,107722] 0 2024-09-13T21:40:43.913 INFO:tasks.workunit.client.1.smithi116.stdout:7/525: rename d5/d9/d1c/f3b to d5/fa6 0 2024-09-13T21:40:43.913 INFO:tasks.workunit.client.1.smithi116.stdout:9/288: dwrite d2/d10/d14/f44 [0,4194304] 0 2024-09-13T21:40:43.913 INFO:tasks.workunit.client.1.smithi116.stdout:9/289: chown d2/f4 109 1 2024-09-13T21:40:43.914 INFO:tasks.workunit.client.1.smithi116.stdout:9/290: write d2/d8/d3e/f4d [672015,29548] 0 2024-09-13T21:40:43.914 INFO:tasks.workunit.client.1.smithi116.stdout:9/291: truncate d2/d8/fd 774484 0 2024-09-13T21:40:43.915 INFO:tasks.workunit.client.1.smithi116.stdout:7/526: unlink d5/d9/d1c/d2e/c5a 0 2024-09-13T21:40:43.917 INFO:tasks.workunit.client.1.smithi116.stdout:5/556: symlink d7/d9a/lb8 0 2024-09-13T21:40:43.918 INFO:tasks.workunit.client.1.smithi116.stdout:2/357: read d0/d7/d2b/d2c/d62/f46 [1536175,128028] 0 2024-09-13T21:40:43.918 INFO:tasks.workunit.client.1.smithi116.stdout:2/358: dread - d0/d7/d2b/d2c/d62/f7b zero size 2024-09-13T21:40:43.923 INFO:tasks.workunit.client.1.smithi116.stdout:2/359: unlink d0/l53 0 2024-09-13T21:40:43.923 INFO:tasks.workunit.client.1.smithi116.stdout:2/360: dread - d0/d7/d2b/d2c/f71 zero size 2024-09-13T21:40:43.923 INFO:tasks.workunit.client.1.smithi116.stdout:2/361: chown d0/d7/d2b/d2c/d62/c28 1908578941 1 2024-09-13T21:40:43.928 INFO:tasks.workunit.client.1.smithi116.stdout:9/292: rmdir d2 39 2024-09-13T21:40:43.930 INFO:tasks.workunit.client.1.smithi116.stdout:2/362: mknod d0/d7/d2b/d61/c7d 0 2024-09-13T21:40:43.931 INFO:tasks.workunit.client.1.smithi116.stdout:2/363: getdents d0/d5 0 2024-09-13T21:40:43.931 INFO:tasks.workunit.client.1.smithi116.stdout:7/527: dread d5/d9/f3d [8388608,4194304] 0 2024-09-13T21:40:43.932 INFO:tasks.workunit.client.1.smithi116.stdout:0/472: dwrite d2/dc/d12/f23 [0,4194304] 0 2024-09-13T21:40:43.941 INFO:tasks.workunit.client.1.smithi116.stdout:8/450: dwrite d2/d10/d19/f84 [0,4194304] 0 2024-09-13T21:40:43.941 INFO:tasks.workunit.client.1.smithi116.stdout:8/451: stat d2/d10/d4b/f50 0 2024-09-13T21:40:43.941 INFO:tasks.workunit.client.1.smithi116.stdout:8/452: truncate d2/f2f 4447696 0 2024-09-13T21:40:43.948 INFO:tasks.workunit.client.1.smithi116.stdout:2/364: dread d0/d7/d2b/f3e [0,4194304] 0 2024-09-13T21:40:43.948 INFO:tasks.workunit.client.1.smithi116.stdout:7/528: dread d5/d9/f33 [0,4194304] 0 2024-09-13T21:40:43.948 INFO:tasks.workunit.client.1.smithi116.stdout:4/514: dwrite d0/fb [0,4194304] 0 2024-09-13T21:40:43.948 INFO:tasks.workunit.client.1.smithi116.stdout:4/515: dread - d0/dd/d13/f51 zero size 2024-09-13T21:40:43.948 INFO:tasks.workunit.client.1.smithi116.stdout:4/516: readlink d0/dd/l38 0 2024-09-13T21:40:43.948 INFO:tasks.workunit.client.1.smithi116.stdout:6/428: dwrite d8/f87 [0,4194304] 0 2024-09-13T21:40:43.949 INFO:tasks.workunit.client.1.smithi116.stdout:1/394: dwrite d4/f1c [0,4194304] 0 2024-09-13T21:40:43.949 INFO:tasks.workunit.client.1.smithi116.stdout:1/395: write d4/d14/f48 [3593894,10362] 0 2024-09-13T21:40:43.950 INFO:tasks.workunit.client.1.smithi116.stdout:7/529: unlink d5/d9/d1c/d22/d24/d6b/l89 0 2024-09-13T21:40:43.951 INFO:tasks.workunit.client.1.smithi116.stdout:5/557: dread d7/da/f37 [4194304,4194304] 0 2024-09-13T21:40:43.953 INFO:tasks.workunit.client.1.smithi116.stdout:6/429: mknod d8/d15/d2e/d2f/d38/c94 0 2024-09-13T21:40:43.954 INFO:tasks.workunit.client.1.smithi116.stdout:1/396: symlink d4/d14/d52/d2f/d5c/l8e 0 2024-09-13T21:40:43.954 INFO:tasks.workunit.client.1.smithi116.stdout:0/473: dwrite d2/f38 [4194304,4194304] 0 2024-09-13T21:40:43.954 INFO:tasks.workunit.client.1.smithi116.stdout:8/453: write d2/d10/d4b/f51 [1724698,43191] 0 2024-09-13T21:40:43.955 INFO:tasks.workunit.client.1.smithi116.stdout:5/558: readlink d7/l2b 0 2024-09-13T21:40:43.955 INFO:tasks.workunit.client.1.smithi116.stdout:5/559: stat d7/d40/f9e 0 2024-09-13T21:40:43.955 INFO:tasks.workunit.client.1.smithi116.stdout:5/560: chown d7/d1d/d64/d87/f9c 0 1 2024-09-13T21:40:43.956 INFO:tasks.workunit.client.1.smithi116.stdout:5/561: fsync d7/d40/fa9 0 2024-09-13T21:40:43.956 INFO:tasks.workunit.client.1.smithi116.stdout:5/562: stat d7/d40/d53/l62 0 2024-09-13T21:40:43.956 INFO:tasks.workunit.client.1.smithi116.stdout:5/563: write d7/da/f19 [5618305,110199] 0 2024-09-13T21:40:43.956 INFO:tasks.workunit.client.1.smithi116.stdout:5/564: chown d7/da/d5e 381 1 2024-09-13T21:40:43.956 INFO:tasks.workunit.client.1.smithi116.stdout:5/565: stat d7/d1d/l7d 0 2024-09-13T21:40:43.957 INFO:tasks.workunit.client.1.smithi116.stdout:6/430: rmdir d8/d17 39 2024-09-13T21:40:43.957 INFO:tasks.workunit.client.1.smithi116.stdout:7/530: dread d5/f16 [0,4194304] 0 2024-09-13T21:40:43.958 INFO:tasks.workunit.client.1.smithi116.stdout:9/293: dwrite d2/d8/f1a [0,4194304] 0 2024-09-13T21:40:43.959 INFO:tasks.workunit.client.1.smithi116.stdout:0/474: symlink d2/d5/d86/d8a/l9e 0 2024-09-13T21:40:43.961 INFO:tasks.workunit.client.1.smithi116.stdout:5/566: rmdir d7/d1d/d46/d5c 39 2024-09-13T21:40:43.964 INFO:tasks.workunit.client.1.smithi116.stdout:0/475: mkdir d2/dc/d47/d63/d9f 0 2024-09-13T21:40:43.971 INFO:tasks.workunit.client.1.smithi116.stdout:2/365: dwrite d0/d7/f12 [0,4194304] 0 2024-09-13T21:40:43.972 INFO:tasks.workunit.client.1.smithi116.stdout:9/294: dread d2/f3 [4194304,4194304] 0 2024-09-13T21:40:43.975 INFO:tasks.workunit.client.1.smithi116.stdout:7/531: mkdir d5/d9/db/da7 0 2024-09-13T21:40:43.976 INFO:tasks.workunit.client.1.smithi116.stdout:0/476: getdents d2/dc/d12/d51/d62 0 2024-09-13T21:40:43.979 INFO:tasks.workunit.client.1.smithi116.stdout:2/366: symlink d0/d7/d2b/d2c/d62/d1f/d73/l7e 0 2024-09-13T21:40:43.979 INFO:tasks.workunit.client.1.smithi116.stdout:2/367: fsync d0/d7/d2b/d2c/d62/f4a 0 2024-09-13T21:40:43.979 INFO:tasks.workunit.client.1.smithi116.stdout:9/295: creat d2/d10/f52 x:0 0 0 2024-09-13T21:40:43.979 INFO:tasks.workunit.client.1.smithi116.stdout:9/296: readlink d2/d10/d14/d38/d3a/l3c 0 2024-09-13T21:40:43.980 INFO:tasks.workunit.client.1.smithi116.stdout:8/454: rmdir d2/d27/d66/d7c 39 2024-09-13T21:40:43.981 INFO:tasks.workunit.client.1.smithi116.stdout:6/431: link d8/d10/c13 d8/c95 0 2024-09-13T21:40:43.982 INFO:tasks.workunit.client.1.smithi116.stdout:6/432: dread - d8/d15/f92 zero size 2024-09-13T21:40:43.983 INFO:tasks.workunit.client.1.smithi116.stdout:7/532: truncate d5/f8 3288121 0 2024-09-13T21:40:43.985 INFO:tasks.workunit.client.1.smithi116.stdout:8/455: creat d2/d27/d66/f8c x:0 0 0 2024-09-13T21:40:43.986 INFO:tasks.workunit.client.1.smithi116.stdout:6/433: write d8/d10/f18 [3035115,79123] 0 2024-09-13T21:40:43.989 INFO:tasks.workunit.client.1.smithi116.stdout:8/456: chown d2/c6 8078512 1 2024-09-13T21:40:43.989 INFO:tasks.workunit.client.1.smithi116.stdout:8/457: truncate d2/d10/d19/d21/d22/d5d/d46/f4f 5219 0 2024-09-13T21:40:43.990 INFO:tasks.workunit.client.1.smithi116.stdout:6/434: mknod d8/d10/d24/c96 0 2024-09-13T21:40:43.991 INFO:tasks.workunit.client.1.smithi116.stdout:6/435: chown d8/d17/d70/l90 89 1 2024-09-13T21:40:43.991 INFO:tasks.workunit.client.1.smithi116.stdout:6/436: write d8/d10/d33/f5c [757969,122875] 0 2024-09-13T21:40:43.992 INFO:tasks.workunit.client.1.smithi116.stdout:7/533: rmdir d5/d9/d1c/d22/d24/d6b 39 2024-09-13T21:40:43.993 INFO:tasks.workunit.client.1.smithi116.stdout:8/458: mknod d2/d10/d19/d42/d45/c8d 0 2024-09-13T21:40:43.994 INFO:tasks.workunit.client.1.smithi116.stdout:7/534: symlink d5/d9/la8 0 2024-09-13T21:40:43.994 INFO:tasks.workunit.client.1.smithi116.stdout:7/535: fsync d5/d9/d1c/d22/d24/d6b/d72/f8c 0 2024-09-13T21:40:43.995 INFO:tasks.workunit.client.1.smithi116.stdout:8/459: creat d2/d10/d19/d42/f8e x:0 0 0 2024-09-13T21:40:43.996 INFO:tasks.workunit.client.1.smithi116.stdout:8/460: symlink d2/d27/d66/d7c/l8f 0 2024-09-13T21:40:43.997 INFO:tasks.workunit.client.1.smithi116.stdout:2/368: dread d0/d7/d2d/f6a [0,4194304] 0 2024-09-13T21:40:43.997 INFO:tasks.workunit.client.1.smithi116.stdout:2/369: write d0/d7/d2b/d2c/f42 [1015173,26147] 0 2024-09-13T21:40:43.997 INFO:tasks.workunit.client.1.smithi116.stdout:2/370: truncate d0/d7/d2b/d2c/f71 476481 0 2024-09-13T21:40:43.997 INFO:tasks.workunit.client.1.smithi116.stdout:8/461: rmdir d2/d10/d19/d3a/d4c 39 2024-09-13T21:40:43.997 INFO:tasks.workunit.client.1.smithi116.stdout:8/462: write d2/d27/d66/d7c/f86 [819688,87764] 0 2024-09-13T21:40:43.998 INFO:tasks.workunit.client.1.smithi116.stdout:8/463: truncate d2/d27/d66/d7c/f86 1000776 0 2024-09-13T21:40:43.998 INFO:tasks.workunit.client.1.smithi116.stdout:8/464: read - d2/d10/d19/d3a/d4c/d7a/f89 zero size 2024-09-13T21:40:43.999 INFO:tasks.workunit.client.1.smithi116.stdout:2/371: creat d0/d5/d8/d7a/f7f x:0 0 0 2024-09-13T21:40:43.999 INFO:tasks.workunit.client.1.smithi116.stdout:2/372: truncate d0/f79 908452 0 2024-09-13T21:40:43.999 INFO:tasks.workunit.client.1.smithi116.stdout:2/373: write d0/d7/d2b/f3e [4622649,67446] 0 2024-09-13T21:40:43.999 INFO:tasks.workunit.client.1.smithi116.stdout:2/374: chown d0/d7/d2b/d2c/d62/d1f 3 1 2024-09-13T21:40:44.000 INFO:tasks.workunit.client.1.smithi116.stdout:8/465: rename d2/d81 to d2/d10/d19/d21/d69/d90 0 2024-09-13T21:40:44.002 INFO:tasks.workunit.client.1.smithi116.stdout:2/375: creat d0/d7/d49/f80 x:0 0 0 2024-09-13T21:40:44.003 INFO:tasks.workunit.client.1.smithi116.stdout:6/437: dread d8/d17/f23 [0,4194304] 0 2024-09-13T21:40:44.003 INFO:tasks.workunit.client.1.smithi116.stdout:8/466: stat d2/d10/d37/c40 0 2024-09-13T21:40:44.003 INFO:tasks.workunit.client.1.smithi116.stdout:8/467: stat d2/d10/d19/d21/d69/f8b 0 2024-09-13T21:40:44.008 INFO:tasks.workunit.client.1.smithi116.stdout:6/438: dread d8/d10/d24/f29 [0,4194304] 0 2024-09-13T21:40:44.012 INFO:tasks.workunit.client.1.smithi116.stdout:6/439: rmdir d8/d15 39 2024-09-13T21:40:44.012 INFO:tasks.workunit.client.1.smithi116.stdout:5/567: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:44.012 INFO:tasks.workunit.client.1.smithi116.stdout:6/440: truncate d8/d15/d2e/d2f/d38/f45 130773 0 2024-09-13T21:40:44.013 INFO:tasks.workunit.client.1.smithi116.stdout:5/568: mkdir d7/d1d/d46/d85/d96/da8/db9 0 2024-09-13T21:40:44.013 INFO:tasks.workunit.client.1.smithi116.stdout:5/569: stat d7/da/d5e/f7b 0 2024-09-13T21:40:44.015 INFO:tasks.workunit.client.1.smithi116.stdout:2/376: dread d0/d7/f12 [0,4194304] 0 2024-09-13T21:40:44.015 INFO:tasks.workunit.client.1.smithi116.stdout:5/570: symlink d7/d40/d53/lba 0 2024-09-13T21:40:44.015 INFO:tasks.workunit.client.1.smithi116.stdout:5/571: write d7/da/fb4 [766312,3848] 0 2024-09-13T21:40:44.016 INFO:tasks.workunit.client.1.smithi116.stdout:5/572: fsync d7/f25 0 2024-09-13T21:40:44.016 INFO:tasks.workunit.client.1.smithi116.stdout:5/573: truncate d7/d1d/d46/d85/f93 794227 0 2024-09-13T21:40:44.016 INFO:tasks.workunit.client.1.smithi116.stdout:5/574: truncate d7/d1d/d46/d85/fa0 659151 0 2024-09-13T21:40:44.017 INFO:tasks.workunit.client.1.smithi116.stdout:5/575: unlink d7/f12 0 2024-09-13T21:40:44.017 INFO:tasks.workunit.client.1.smithi116.stdout:2/377: write d0/d7/d2d/f34 [167195,51212] 0 2024-09-13T21:40:44.019 INFO:tasks.workunit.client.1.smithi116.stdout:2/378: unlink d0/d7/d2d/f34 0 2024-09-13T21:40:44.021 INFO:tasks.workunit.client.1.smithi116.stdout:2/379: mknod d0/d7/d2b/d2c/d62/d75/d77/c81 0 2024-09-13T21:40:44.021 INFO:tasks.workunit.client.1.smithi116.stdout:2/380: fsync d0/d7/d2b/d2c/d62/f7b 0 2024-09-13T21:40:44.021 INFO:tasks.workunit.client.1.smithi116.stdout:0/477: dwrite d2/dc/d12/f36 [0,4194304] 0 2024-09-13T21:40:44.022 INFO:tasks.workunit.client.1.smithi116.stdout:9/297: dwrite d2/d8/fd [0,4194304] 0 2024-09-13T21:40:44.023 INFO:tasks.workunit.client.1.smithi116.stdout:6/441: dread f5 [4194304,4194304] 0 2024-09-13T21:40:44.024 INFO:tasks.workunit.client.1.smithi116.stdout:8/468: dwrite d2/d10/d19/d21/d69/f8b [0,4194304] 0 2024-09-13T21:40:44.026 INFO:tasks.workunit.client.1.smithi116.stdout:5/576: dread d7/d1d/f29 [4194304,4194304] 0 2024-09-13T21:40:44.027 INFO:tasks.workunit.client.1.smithi116.stdout:7/536: dwrite d5/d9/db/f12 [8388608,4194304] 0 2024-09-13T21:40:44.029 INFO:tasks.workunit.client.1.smithi116.stdout:9/298: creat d2/f53 x:0 0 0 2024-09-13T21:40:44.033 INFO:tasks.workunit.client.1.smithi116.stdout:8/469: read d2/d10/f18 [2283951,42138] 0 2024-09-13T21:40:44.033 INFO:tasks.workunit.client.1.smithi116.stdout:8/470: write d2/d27/d66/f8c [306361,97489] 0 2024-09-13T21:40:44.038 INFO:tasks.workunit.client.1.smithi116.stdout:0/478: rmdir d2/d5 39 2024-09-13T21:40:44.040 INFO:tasks.workunit.client.1.smithi116.stdout:7/537: creat d5/d9/d27/fa9 x:0 0 0 2024-09-13T21:40:44.040 INFO:tasks.workunit.client.1.smithi116.stdout:7/538: truncate d5/d9/db/d21/d9b/fa2 310701 0 2024-09-13T21:40:44.040 INFO:tasks.workunit.client.1.smithi116.stdout:7/539: fsync d5/f16 0 2024-09-13T21:40:44.042 INFO:tasks.workunit.client.1.smithi116.stdout:9/299: symlink d2/d8/l54 0 2024-09-13T21:40:44.043 INFO:tasks.workunit.client.1.smithi116.stdout:2/381: dwrite d0/d7/d2b/d2c/d62/f7b [0,4194304] 0 2024-09-13T21:40:44.043 INFO:tasks.workunit.client.1.smithi116.stdout:2/382: read - d0/d7/f6e zero size 2024-09-13T21:40:44.047 INFO:tasks.workunit.client.1.smithi116.stdout:8/471: dread d2/d10/f31 [0,4194304] 0 2024-09-13T21:40:44.047 INFO:tasks.workunit.client.1.smithi116.stdout:8/472: stat d2/d10/d37/d64/l65 0 2024-09-13T21:40:44.047 INFO:tasks.workunit.client.1.smithi116.stdout:0/479: getdents d2 0 2024-09-13T21:40:44.048 INFO:tasks.workunit.client.1.smithi116.stdout:9/300: write d2/f3 [6234397,4728] 0 2024-09-13T21:40:44.048 INFO:tasks.workunit.client.1.smithi116.stdout:6/442: write d8/d15/d2e/d2f/d57/f72 [293344,46167] 0 2024-09-13T21:40:44.048 INFO:tasks.workunit.client.1.smithi116.stdout:6/443: readlink d8/d17/l42 0 2024-09-13T21:40:44.049 INFO:tasks.workunit.client.1.smithi116.stdout:6/444: chown d8/d17/f71 23070607 1 2024-09-13T21:40:44.051 INFO:tasks.workunit.client.1.smithi116.stdout:0/480: rmdir d2/d5 39 2024-09-13T21:40:44.051 INFO:tasks.workunit.client.1.smithi116.stdout:9/301: symlink d2/d10/l55 0 2024-09-13T21:40:44.053 INFO:tasks.workunit.client.1.smithi116.stdout:0/481: fdatasync d2/d5/d61/f6a 0 2024-09-13T21:40:44.054 INFO:tasks.workunit.client.1.smithi116.stdout:9/302: creat d2/d8/d3e/f56 x:0 0 0 2024-09-13T21:40:44.054 INFO:tasks.workunit.client.1.smithi116.stdout:9/303: fdatasync d2/f2f 0 2024-09-13T21:40:44.055 INFO:tasks.workunit.client.1.smithi116.stdout:7/540: dread d5/d9/db/d21/d6e/d6f/f83 [0,4194304] 0 2024-09-13T21:40:44.055 INFO:tasks.workunit.client.1.smithi116.stdout:6/445: mknod d8/d10/c97 0 2024-09-13T21:40:44.055 INFO:tasks.workunit.client.1.smithi116.stdout:0/482: write d2/f73 [1736341,46524] 0 2024-09-13T21:40:44.057 INFO:tasks.workunit.client.1.smithi116.stdout:5/577: dwrite d7/d40/f9e [0,4194304] 0 2024-09-13T21:40:44.057 INFO:tasks.workunit.client.1.smithi116.stdout:7/541: creat d5/d9/d1c/d22/faa x:0 0 0 2024-09-13T21:40:44.057 INFO:tasks.workunit.client.1.smithi116.stdout:7/542: fsync d5/d9/d1c/d22/d24/d6b/d72/fa5 0 2024-09-13T21:40:44.059 INFO:tasks.workunit.client.1.smithi116.stdout:6/446: creat d8/d15/f98 x:0 0 0 2024-09-13T21:40:44.060 INFO:tasks.workunit.client.1.smithi116.stdout:0/483: creat d2/dc/d12/d51/fa0 x:0 0 0 2024-09-13T21:40:44.064 INFO:tasks.workunit.client.1.smithi116.stdout:5/578: mkdir d7/d1d/dbb 0 2024-09-13T21:40:44.064 INFO:tasks.workunit.client.1.smithi116.stdout:9/304: dread d2/d8/f11 [0,4194304] 0 2024-09-13T21:40:44.064 INFO:tasks.workunit.client.1.smithi116.stdout:9/305: creat d2/d8/d3e/f57 x:0 0 0 2024-09-13T21:40:44.064 INFO:tasks.workunit.client.1.smithi116.stdout:9/306: rename d2/d10 to d2/d10/d58 22 2024-09-13T21:40:44.064 INFO:tasks.workunit.client.1.smithi116.stdout:7/543: getdents d5/d9/d1c/d22/d24/d6b/d72 0 2024-09-13T21:40:44.064 INFO:tasks.workunit.client.1.smithi116.stdout:7/544: readlink d5/d9/d27/d31/l34 0 2024-09-13T21:40:44.066 INFO:tasks.workunit.client.1.smithi116.stdout:0/484: write d2/f83 [1617021,128713] 0 2024-09-13T21:40:44.066 INFO:tasks.workunit.client.1.smithi116.stdout:5/579: readlink d7/l47 0 2024-09-13T21:40:44.068 INFO:tasks.workunit.client.1.smithi116.stdout:9/307: creat d2/d10/d14/f59 x:0 0 0 2024-09-13T21:40:44.070 INFO:tasks.workunit.client.1.smithi116.stdout:8/473: dwrite d2/d10/d19/d3a/d4c/d7a/f89 [0,4194304] 0 2024-09-13T21:40:44.071 INFO:tasks.workunit.client.1.smithi116.stdout:6/447: link d8/d17/f19 d8/f99 0 2024-09-13T21:40:44.072 INFO:tasks.workunit.client.1.smithi116.stdout:5/580: symlink d7/d1d/lbc 0 2024-09-13T21:40:44.073 INFO:tasks.workunit.client.1.smithi116.stdout:9/308: creat d2/d10/d4c/f5a x:0 0 0 2024-09-13T21:40:44.073 INFO:tasks.workunit.client.1.smithi116.stdout:9/309: write d2/f13 [234078,69640] 0 2024-09-13T21:40:44.074 INFO:tasks.workunit.client.1.smithi116.stdout:2/383: dwrite d0/d5/d8/f3c [0,4194304] 0 2024-09-13T21:40:44.074 INFO:tasks.workunit.client.1.smithi116.stdout:2/384: fdatasync d0/d7/d2b/d2c/d62/f7b 0 2024-09-13T21:40:44.077 INFO:tasks.workunit.client.1.smithi116.stdout:0/485: mknod d2/d5b/ca1 0 2024-09-13T21:40:44.077 INFO:tasks.workunit.client.1.smithi116.stdout:5/581: fsync d7/f16 0 2024-09-13T21:40:44.078 INFO:tasks.workunit.client.1.smithi116.stdout:6/448: creat d8/f9a x:0 0 0 2024-09-13T21:40:44.081 INFO:tasks.workunit.client.1.smithi116.stdout:5/582: stat d7/d40/d53/f89 0 2024-09-13T21:40:44.082 INFO:tasks.workunit.client.1.smithi116.stdout:8/474: write d2/d10/d19/f84 [2942057,22693] 0 2024-09-13T21:40:44.084 INFO:tasks.workunit.client.1.smithi116.stdout:7/545: dwrite d5/d9/db/d21/d6e/f9a [0,4194304] 0 2024-09-13T21:40:44.085 INFO:tasks.workunit.client.1.smithi116.stdout:0/486: truncate d2/dc/f22 2302922 0 2024-09-13T21:40:44.086 INFO:tasks.workunit.client.1.smithi116.stdout:0/487: chown d2/dc/d47 449 1 2024-09-13T21:40:44.087 INFO:tasks.workunit.client.1.smithi116.stdout:5/583: rmdir d7/da/db2 0 2024-09-13T21:40:44.087 INFO:tasks.workunit.client.1.smithi116.stdout:5/584: readlink d7/d1d/lbc 0 2024-09-13T21:40:44.087 INFO:tasks.workunit.client.1.smithi116.stdout:5/585: fdatasync d7/da/d5e/f7a 0 2024-09-13T21:40:44.087 INFO:tasks.workunit.client.1.smithi116.stdout:5/586: write d7/d1d/d64/fab [601846,38891] 0 2024-09-13T21:40:44.087 INFO:tasks.workunit.client.1.smithi116.stdout:9/310: dread d2/d10/f32 [0,4194304] 0 2024-09-13T21:40:44.089 INFO:tasks.workunit.client.1.smithi116.stdout:6/449: dread d8/d15/d2e/d2f/d57/f72 [0,4194304] 0 2024-09-13T21:40:44.089 INFO:tasks.workunit.client.1.smithi116.stdout:2/385: rename d0/d7/d2b/d2c to d0/d3a/d82 0 2024-09-13T21:40:44.090 INFO:tasks.workunit.client.1.smithi116.stdout:6/450: dread d8/f3c [0,4194304] 0 2024-09-13T21:40:44.105 INFO:tasks.workunit.client.1.smithi116.stdout:2/386: write d0/d3a/d82/d62/d1f/f27 [72358,8291] 0 2024-09-13T21:40:44.111 INFO:tasks.workunit.client.1.smithi116.stdout:9/311: symlink d2/l5b 0 2024-09-13T21:40:44.113 INFO:tasks.workunit.client.1.smithi116.stdout:6/451: dwrite d8/d17/f19 [0,4194304] 0 2024-09-13T21:40:44.113 INFO:tasks.workunit.client.1.smithi116.stdout:8/475: rename d2/l38 to d2/d10/d19/d21/d69/d90/l91 0 2024-09-13T21:40:44.113 INFO:tasks.workunit.client.1.smithi116.stdout:8/476: truncate d2/d10/d19/d21/d22/d5d/d46/f4f 515323 0 2024-09-13T21:40:44.114 INFO:tasks.workunit.client.1.smithi116.stdout:0/488: rmdir d2/dc/d12/d28/d57 39 2024-09-13T21:40:44.117 INFO:tasks.workunit.client.1.smithi116.stdout:9/312: unlink d2/d10/d14/f31 0 2024-09-13T21:40:44.118 INFO:tasks.workunit.client.1.smithi116.stdout:6/452: symlink d8/d10/d33/l9b 0 2024-09-13T21:40:44.120 INFO:tasks.workunit.client.1.smithi116.stdout:5/587: rename d7/da/f3e to d7/d40/d80/fbd 0 2024-09-13T21:40:44.120 INFO:tasks.workunit.client.1.smithi116.stdout:2/387: read d0/d7/f24 [562429,72865] 0 2024-09-13T21:40:44.120 INFO:tasks.workunit.client.1.smithi116.stdout:8/477: mknod d2/d10/d19/d3a/d4c/d7a/c92 0 2024-09-13T21:40:44.122 INFO:tasks.workunit.client.1.smithi116.stdout:6/453: mkdir d8/d15/d2e/d2f/d38/d9c 0 2024-09-13T21:40:44.125 INFO:tasks.workunit.client.1.smithi116.stdout:9/313: rename d2/d8/lb to d2/d10/d41/l5c 0 2024-09-13T21:40:44.127 INFO:tasks.workunit.client.1.smithi116.stdout:8/478: mknod d2/d10/d19/d21/d69/c93 0 2024-09-13T21:40:44.128 INFO:tasks.workunit.client.1.smithi116.stdout:6/454: creat d8/d10/d24/f9d x:0 0 0 2024-09-13T21:40:44.130 INFO:tasks.workunit.client.1.smithi116.stdout:2/388: rename d0/d3a/d82/d62/d75/d77/c81 to d0/d5/d2a/c83 0 2024-09-13T21:40:44.130 INFO:tasks.workunit.client.1.smithi116.stdout:2/389: dread - d0/d7/f6e zero size 2024-09-13T21:40:44.130 INFO:tasks.workunit.client.1.smithi116.stdout:2/390: creat d0/d7/f84 x:0 0 0 2024-09-13T21:40:44.131 INFO:tasks.workunit.client.1.smithi116.stdout:9/314: mkdir d2/d5d 0 2024-09-13T21:40:44.133 INFO:tasks.workunit.client.1.smithi116.stdout:8/479: mknod d2/d10/d19/d21/d22/c94 0 2024-09-13T21:40:44.133 INFO:tasks.workunit.client.1.smithi116.stdout:8/480: creat d2/d27/d62/f95 x:0 0 0 2024-09-13T21:40:44.133 INFO:tasks.workunit.client.1.smithi116.stdout:6/455: mkdir d8/d15/d2e/d9e 0 2024-09-13T21:40:44.133 INFO:tasks.workunit.client.1.smithi116.stdout:6/456: read d8/d10/d33/f3b [1562329,68361] 0 2024-09-13T21:40:44.136 INFO:tasks.workunit.client.1.smithi116.stdout:0/489: dwrite d2/f89 [0,4194304] 0 2024-09-13T21:40:44.137 INFO:tasks.workunit.client.1.smithi116.stdout:8/481: unlink d2/d10/d4b/l59 0 2024-09-13T21:40:44.139 INFO:tasks.workunit.client.1.smithi116.stdout:0/490: truncate d2/dc/f2e 1013279 0 2024-09-13T21:40:44.140 INFO:tasks.workunit.client.1.smithi116.stdout:8/482: mknod d2/d10/d19/d42/d45/c96 0 2024-09-13T21:40:44.140 INFO:tasks.workunit.client.1.smithi116.stdout:8/483: chown d2/d27/d62 50599001 1 2024-09-13T21:40:44.141 INFO:tasks.workunit.client.1.smithi116.stdout:5/588: getdents d7/da 0 2024-09-13T21:40:44.143 INFO:tasks.workunit.client.1.smithi116.stdout:6/457: rename d8/d15/d2e/d2f/d38/c5d to d8/c9f 0 2024-09-13T21:40:44.144 INFO:tasks.workunit.client.1.smithi116.stdout:0/491: link d2/dc/f33 d2/dc/d12/d51/d62/fa2 0 2024-09-13T21:40:44.145 INFO:tasks.workunit.client.1.smithi116.stdout:5/589: readlink d7/da/d5e/l5f 0 2024-09-13T21:40:44.146 INFO:tasks.workunit.client.1.smithi116.stdout:5/590: fsync d7/d1d/d64/d87/f9c 0 2024-09-13T21:40:44.146 INFO:tasks.workunit.client.1.smithi116.stdout:2/391: dwrite d0/d7/d2b/f3f [0,4194304] 0 2024-09-13T21:40:44.148 INFO:tasks.workunit.client.1.smithi116.stdout:0/492: mknod d2/d5/d86/d8a/ca3 0 2024-09-13T21:40:44.151 INFO:tasks.workunit.client.1.smithi116.stdout:8/484: write d2/d5c/f6a [976956,44012] 0 2024-09-13T21:40:44.151 INFO:tasks.workunit.client.1.smithi116.stdout:8/485: write d2/d10/d19/d3a/f6f [950162,98784] 0 2024-09-13T21:40:44.151 INFO:tasks.workunit.client.1.smithi116.stdout:8/486: write d2/d10/d19/f84 [4561806,125325] 0 2024-09-13T21:40:44.151 INFO:tasks.workunit.client.1.smithi116.stdout:8/487: getdents d2/d10/d4b/d6e 0 2024-09-13T21:40:44.152 INFO:tasks.workunit.client.1.smithi116.stdout:2/392: symlink d0/d3a/d82/d62/d1f/d5d/d60/l85 0 2024-09-13T21:40:44.152 INFO:tasks.workunit.client.1.smithi116.stdout:2/393: truncate d0/d7/d49/f80 853054 0 2024-09-13T21:40:44.152 INFO:tasks.workunit.client.1.smithi116.stdout:0/493: symlink d2/dc/d12/d51/la4 0 2024-09-13T21:40:44.155 INFO:tasks.workunit.client.1.smithi116.stdout:5/591: write d7/da/f19 [11068194,75874] 0 2024-09-13T21:40:44.155 INFO:tasks.workunit.client.1.smithi116.stdout:2/394: mkdir d0/d7/d86 0 2024-09-13T21:40:44.158 INFO:tasks.workunit.client.1.smithi116.stdout:5/592: read d7/d40/d53/f6e [65236,85376] 0 2024-09-13T21:40:44.160 INFO:tasks.workunit.client.1.smithi116.stdout:5/593: creat d7/d1d/d46/d85/d96/da8/fbe x:0 0 0 2024-09-13T21:40:44.161 INFO:tasks.workunit.client.1.smithi116.stdout:0/494: dread d2/dc/f2c [0,4194304] 0 2024-09-13T21:40:44.161 INFO:tasks.workunit.client.1.smithi116.stdout:5/594: rename d7/d1d/d64/d87/f88 to d7/d40/d53/fbf 0 2024-09-13T21:40:44.163 INFO:tasks.workunit.client.1.smithi116.stdout:0/495: mknod d2/d5b/ca5 0 2024-09-13T21:40:44.163 INFO:tasks.workunit.client.1.smithi116.stdout:5/595: chown d7/da/d5e/l60 49 1 2024-09-13T21:40:44.164 INFO:tasks.workunit.client.1.smithi116.stdout:5/596: write d7/d40/d53/f89 [291707,53767] 0 2024-09-13T21:40:44.165 INFO:tasks.workunit.client.1.smithi116.stdout:5/597: getdents d7/da/d5e/d79/d8f 0 2024-09-13T21:40:44.165 INFO:tasks.workunit.client.1.smithi116.stdout:0/496: getdents d2/dc/d12 0 2024-09-13T21:40:44.165 INFO:tasks.workunit.client.1.smithi116.stdout:0/497: dread - d2/dc/d12/d28/f74 zero size 2024-09-13T21:40:44.166 INFO:tasks.workunit.client.1.smithi116.stdout:5/598: mkdir d7/d1d/d46/dc0 0 2024-09-13T21:40:44.167 INFO:tasks.workunit.client.1.smithi116.stdout:5/599: creat d7/d1d/d46/fc1 x:0 0 0 2024-09-13T21:40:44.168 INFO:tasks.workunit.client.1.smithi116.stdout:2/395: dread d0/d3a/d82/d62/f1d [0,4194304] 0 2024-09-13T21:40:44.168 INFO:tasks.workunit.client.1.smithi116.stdout:2/396: readlink d0/d3a/d82/d62/d1f/d73/l7e 0 2024-09-13T21:40:44.168 INFO:tasks.workunit.client.1.smithi116.stdout:5/600: mknod d7/d1d/dbb/cc2 0 2024-09-13T21:40:44.168 INFO:tasks.workunit.client.1.smithi116.stdout:2/397: truncate d0/d7/d2b/f3e 5275992 0 2024-09-13T21:40:44.168 INFO:tasks.workunit.client.1.smithi116.stdout:2/398: write d0/d5/d8/d7a/f7f [385283,25784] 0 2024-09-13T21:40:44.169 INFO:tasks.workunit.client.1.smithi116.stdout:2/399: symlink d0/d3a/d82/d62/l87 0 2024-09-13T21:40:44.169 INFO:tasks.workunit.client.1.smithi116.stdout:2/400: write d0/d5/f4b [4516316,1855] 0 2024-09-13T21:40:44.171 INFO:tasks.workunit.client.1.smithi116.stdout:8/488: dwrite d2/d10/d19/d21/d22/f78 [0,4194304] 0 2024-09-13T21:40:44.171 INFO:tasks.workunit.client.1.smithi116.stdout:8/489: write d2/d10/d4b/f51 [1118415,89420] 0 2024-09-13T21:40:44.173 INFO:tasks.workunit.client.1.smithi116.stdout:2/401: mknod d0/d3a/d82/d62/d1f/d5d/d60/c88 0 2024-09-13T21:40:44.173 INFO:tasks.workunit.client.1.smithi116.stdout:8/490: read d2/d27/d66/d7c/f86 [475502,122933] 0 2024-09-13T21:40:44.175 INFO:tasks.workunit.client.1.smithi116.stdout:2/402: mkdir d0/d3a/d82/d62/d1f/d5d/d89 0 2024-09-13T21:40:44.176 INFO:tasks.workunit.client.1.smithi116.stdout:8/491: mkdir d2/d10/d19/d97 0 2024-09-13T21:40:44.179 INFO:tasks.workunit.client.1.smithi116.stdout:2/403: truncate d0/d7/d2d/f56 41483 0 2024-09-13T21:40:44.180 INFO:tasks.workunit.client.1.smithi116.stdout:8/492: mknod d2/d10/d19/c98 0 2024-09-13T21:40:44.182 INFO:tasks.workunit.client.1.smithi116.stdout:0/498: dwrite d2/dc/d12/f23 [4194304,4194304] 0 2024-09-13T21:40:44.187 INFO:tasks.workunit.client.1.smithi116.stdout:0/499: dread d2/d5/f34 [0,4194304] 0 2024-09-13T21:40:44.189 INFO:tasks.workunit.client.1.smithi116.stdout:3/541: sync 2024-09-13T21:40:44.189 INFO:tasks.workunit.client.1.smithi116.stdout:3/542: fdatasync d3/f11 0 2024-09-13T21:40:44.189 INFO:tasks.workunit.client.1.smithi116.stdout:3/543: readlink d3/db/d10/d1d/d5f/d7f/lad 0 2024-09-13T21:40:44.195 INFO:tasks.workunit.client.1.smithi116.stdout:3/544: dread d3/db/f3e [0,4194304] 0 2024-09-13T21:40:44.195 INFO:tasks.workunit.client.1.smithi116.stdout:3/545: truncate d3/db/d26/f78 704516 0 2024-09-13T21:40:44.195 INFO:tasks.workunit.client.1.smithi116.stdout:3/546: creat d3/db/d10/d29/fc3 x:0 0 0 2024-09-13T21:40:44.196 INFO:tasks.workunit.client.1.smithi116.stdout:8/493: dwrite d2/d27/d62/f7b [0,4194304] 0 2024-09-13T21:40:44.199 INFO:tasks.workunit.client.1.smithi116.stdout:0/500: dread d2/dc/d12/f36 [0,4194304] 0 2024-09-13T21:40:44.200 INFO:tasks.workunit.client.1.smithi116.stdout:8/494: mknod d2/d10/d19/d21/d69/c99 0 2024-09-13T21:40:44.202 INFO:tasks.workunit.client.1.smithi116.stdout:0/501: link d2/d5/f7e d2/dc/d12/d51/d62/fa6 0 2024-09-13T21:40:44.203 INFO:tasks.workunit.client.1.smithi116.stdout:0/502: chown d2/dc/c3b 292 1 2024-09-13T21:40:44.204 INFO:tasks.workunit.client.1.smithi116.stdout:0/503: fdatasync d2/dc/d12/d28/f74 0 2024-09-13T21:40:44.210 INFO:tasks.workunit.client.1.smithi116.stdout:8/495: dread d2/d10/d19/d21/d22/f78 [0,4194304] 0 2024-09-13T21:40:44.213 INFO:tasks.workunit.client.1.smithi116.stdout:8/496: symlink d2/d27/d66/d7c/l9a 0 2024-09-13T21:40:44.214 INFO:tasks.workunit.client.1.smithi116.stdout:8/497: unlink d2/d10/d19/l30 0 2024-09-13T21:40:44.215 INFO:tasks.workunit.client.1.smithi116.stdout:8/498: symlink d2/d10/d3e/l9b 0 2024-09-13T21:40:44.215 INFO:tasks.workunit.client.1.smithi116.stdout:8/499: write d2/d10/d19/d21/d22/d5d/f52 [482636,91369] 0 2024-09-13T21:40:44.215 INFO:tasks.workunit.client.1.smithi116.stdout:8/500: stat d2/d10/d19/d3a/f3b 0 2024-09-13T21:40:44.216 INFO:tasks.workunit.client.1.smithi116.stdout:8/501: write d2/d10/d19/f84 [2543987,4653] 0 2024-09-13T21:40:44.219 INFO:tasks.workunit.client.1.smithi116.stdout:3/547: dwrite d3/db/d10/d1c/d34/d55/d57/db1/fb2 [0,4194304] 0 2024-09-13T21:40:44.250 INFO:tasks.workunit.client.1.smithi116.stdout:0/504: dwrite d2/dc/f29 [0,4194304] 0 2024-09-13T21:40:44.250 INFO:tasks.workunit.client.1.smithi116.stdout:8/502: dwrite d2/d10/d19/d3a/d4c/d7a/f89 [0,4194304] 0 2024-09-13T21:40:44.251 INFO:tasks.workunit.client.1.smithi116.stdout:3/548: dwrite d3/db/d10/d62/f69 [0,4194304] 0 2024-09-13T21:40:44.251 INFO:tasks.workunit.client.1.smithi116.stdout:3/549: chown d3/db/d3d/d40/f4c 86653585 1 2024-09-13T21:40:44.251 INFO:tasks.workunit.client.1.smithi116.stdout:0/505: symlink d2/d5/d86/d8a/la7 0 2024-09-13T21:40:44.253 INFO:tasks.workunit.client.1.smithi116.stdout:8/503: creat d2/d10/d4b/d6e/f9c x:0 0 0 2024-09-13T21:40:44.255 INFO:tasks.workunit.client.1.smithi116.stdout:3/550: creat d3/db/d10/d1c/d34/fc4 x:0 0 0 2024-09-13T21:40:44.256 INFO:tasks.workunit.client.1.smithi116.stdout:0/506: getdents d2 0 2024-09-13T21:40:44.258 INFO:tasks.workunit.client.1.smithi116.stdout:3/551: creat d3/db/d10/d62/fc5 x:0 0 0 2024-09-13T21:40:44.258 INFO:tasks.workunit.client.1.smithi116.stdout:3/552: truncate d3/db/f43 979026 0 2024-09-13T21:40:44.260 INFO:tasks.workunit.client.1.smithi116.stdout:0/507: rename d2/d5/d86/d8a/l9e to d2/dc/d47/d63/la8 0 2024-09-13T21:40:44.262 INFO:tasks.workunit.client.1.smithi116.stdout:0/508: rename d2/l1e to d2/d5/la9 0 2024-09-13T21:40:44.262 INFO:tasks.workunit.client.1.smithi116.stdout:0/509: creat d2/d5b/faa x:0 0 0 2024-09-13T21:40:44.263 INFO:tasks.workunit.client.1.smithi116.stdout:3/553: dread d3/db/d10/f15 [8388608,4194304] 0 2024-09-13T21:40:44.264 INFO:tasks.workunit.client.1.smithi116.stdout:0/510: mknod d2/dc/d12/d51/cab 0 2024-09-13T21:40:44.264 INFO:tasks.workunit.client.1.smithi116.stdout:0/511: chown d2/dc/d12/d51/fa0 714 1 2024-09-13T21:40:44.264 INFO:tasks.workunit.client.1.smithi116.stdout:8/504: dread d2/d10/d19/d21/d69/f8b [0,4194304] 0 2024-09-13T21:40:44.265 INFO:tasks.workunit.client.1.smithi116.stdout:3/554: mkdir d3/db/d10/d1c/d34/d55/d57/dc6 0 2024-09-13T21:40:44.265 INFO:tasks.workunit.client.1.smithi116.stdout:8/505: rmdir d2/d10/d19/d3a/d4c 39 2024-09-13T21:40:44.267 INFO:tasks.workunit.client.1.smithi116.stdout:3/555: creat d3/fc7 x:0 0 0 2024-09-13T21:40:44.268 INFO:tasks.workunit.client.1.smithi116.stdout:3/556: symlink d3/db/d26/lc8 0 2024-09-13T21:40:44.272 INFO:tasks.workunit.client.1.smithi116.stdout:3/557: symlink d3/db/d10/d1c/d34/lc9 0 2024-09-13T21:40:44.273 INFO:tasks.workunit.client.1.smithi116.stdout:3/558: write d3/f9 [1077480,65841] 0 2024-09-13T21:40:44.273 INFO:tasks.workunit.client.1.smithi116.stdout:3/559: chown d3/db/d10/d1d/d5f/cb7 59372 1 2024-09-13T21:40:44.273 INFO:tasks.workunit.client.1.smithi116.stdout:0/512: dread d2/dc/d47/f4b [0,4194304] 0 2024-09-13T21:40:44.273 INFO:tasks.workunit.client.1.smithi116.stdout:0/513: chown d2/dc/d12/d28/d57/l7c 9 1 2024-09-13T21:40:44.273 INFO:tasks.workunit.client.1.smithi116.stdout:0/514: write d2/dc/d12/d51/fa0 [769502,81948] 0 2024-09-13T21:40:44.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/560: rename d3/db/d10/d1d/c41 to d3/db/d26/cca 0 2024-09-13T21:40:44.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/561: dread - d3/db/d10/d1d/d5f/d6f/d71/f7d zero size 2024-09-13T21:40:44.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/562: fsync d3/db/d26/fa0 0 2024-09-13T21:40:44.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/563: truncate d3/db/d10/d99/fa8 76861 0 2024-09-13T21:40:44.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/564: truncate d3/db/d10/d1c/d34/fc4 281924 0 2024-09-13T21:40:44.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/565: creat d3/db/d10/d1d/d5f/fcb x:0 0 0 2024-09-13T21:40:44.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/566: write d3/db/d10/d1d/d5f/d6f/d71/f7d [339463,129086] 0 2024-09-13T21:40:44.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/567: dread - d3/db/d26/f9e zero size 2024-09-13T21:40:44.276 INFO:tasks.workunit.client.1.smithi116.stdout:3/568: truncate d3/db/d10/d1c/d34/f8f 71463 0 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:3/569: creat d3/db/d10/d99/fcc x:0 0 0 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:8/506: read d2/d10/d19/d21/f2d [1959890,66917] 0 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:8/507: read d2/d10/d19/d3a/f5f [1522623,81920] 0 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:8/508: fsync d2/d5c/f85 0 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:8/509: chown d2/d10/d19/d42 50 1 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:8/510: chown d2/c48 1224672 1 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:0/515: mknod d2/d5/cac 0 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:0/516: write d2/d5b/f93 [1642509,77210] 0 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:0/517: write d2/d5/d61/f6a [2672551,21488] 0 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:0/518: write d2/d5b/f85 [390188,78997] 0 2024-09-13T21:40:44.277 INFO:tasks.workunit.client.1.smithi116.stdout:0/519: chown d2/f3f 24982737 1 2024-09-13T21:40:44.280 INFO:tasks.workunit.client.1.smithi116.stdout:3/570: symlink d3/db/d10/d1c/d34/d55/d57/lcd 0 2024-09-13T21:40:44.286 INFO:tasks.workunit.client.1.smithi116.stdout:3/571: creat d3/db/d10/d1d/fce x:0 0 0 2024-09-13T21:40:44.287 INFO:tasks.workunit.client.1.smithi116.stdout:3/572: write d3/db/d10/d1d/d5f/d6f/f80 [411033,17275] 0 2024-09-13T21:40:44.293 INFO:tasks.workunit.client.1.smithi116.stdout:0/520: dwrite d2/dc/d12/d51/d62/fa2 [0,4194304] 0 2024-09-13T21:40:44.294 INFO:tasks.workunit.client.1.smithi116.stdout:3/573: write d3/db/d3d/d40/f48 [785337,71745] 0 2024-09-13T21:40:44.296 INFO:tasks.workunit.client.1.smithi116.stdout:0/521: mkdir d2/dc/d47/d63/d9f/dad 0 2024-09-13T21:40:44.296 INFO:tasks.workunit.client.1.smithi116.stdout:0/522: fsync d2/dc/d12/d28/f9c 0 2024-09-13T21:40:44.296 INFO:tasks.workunit.client.1.smithi116.stdout:0/523: stat d2/d5b/f85 0 2024-09-13T21:40:44.296 INFO:tasks.workunit.client.1.smithi116.stdout:3/574: rmdir d3/db/d10/d1c 39 2024-09-13T21:40:44.296 INFO:tasks.workunit.client.1.smithi116.stdout:3/575: dread - d3/db/d10/f7e zero size 2024-09-13T21:40:44.296 INFO:tasks.workunit.client.1.smithi116.stdout:3/576: read - d3/db/d10/d29/fc3 zero size 2024-09-13T21:40:44.296 INFO:tasks.workunit.client.1.smithi116.stdout:3/577: chown d3/l6 761387 1 2024-09-13T21:40:44.296 INFO:tasks.workunit.client.1.smithi116.stdout:3/578: readlink d3/db/d10/d62/da2/lbf 0 2024-09-13T21:40:44.296 INFO:tasks.workunit.client.1.smithi116.stdout:3/579: stat d3/db/d10/d1c/d34/d55/d57/f7a 0 2024-09-13T21:40:44.298 INFO:tasks.workunit.client.1.smithi116.stdout:0/524: mknod d2/dc/cae 0 2024-09-13T21:40:44.300 INFO:tasks.workunit.client.1.smithi116.stdout:0/525: unlink d2/d5/cac 0 2024-09-13T21:40:44.300 INFO:tasks.workunit.client.1.smithi116.stdout:0/526: readlink d2/dc/d12/d28/l30 0 2024-09-13T21:40:44.301 INFO:tasks.workunit.client.1.smithi116.stdout:0/527: link d2/dc/d12/d51/l75 d2/dc/d47/d63/d9f/dad/laf 0 2024-09-13T21:40:44.301 INFO:tasks.workunit.client.1.smithi116.stdout:0/528: dread - d2/d5b/f5c zero size 2024-09-13T21:40:44.301 INFO:tasks.workunit.client.1.smithi116.stdout:0/529: fsync d2/dc/d12/d28/f88 0 2024-09-13T21:40:44.319 INFO:tasks.workunit.client.1.smithi116.stdout:3/580: dwrite d3/db/d10/d1d/d5f/fa7 [0,4194304] 0 2024-09-13T21:40:44.321 INFO:tasks.workunit.client.1.smithi116.stdout:3/581: symlink d3/db/d3d/lcf 0 2024-09-13T21:40:44.321 INFO:tasks.workunit.client.1.smithi116.stdout:3/582: chown d3/db/d10/d62/l77 6151869 1 2024-09-13T21:40:44.322 INFO:tasks.workunit.client.1.smithi116.stdout:3/583: write d3/db/d3d/fae [1050932,53662] 0 2024-09-13T21:40:44.322 INFO:tasks.workunit.client.1.smithi116.stdout:0/530: dwrite d2/dc/d12/d51/f9a [0,4194304] 0 2024-09-13T21:40:44.323 INFO:tasks.workunit.client.1.smithi116.stdout:3/584: dread d3/db/f43 [0,4194304] 0 2024-09-13T21:40:44.323 INFO:tasks.workunit.client.1.smithi116.stdout:3/585: truncate d3/db/d10/d1d/f60 1209719 0 2024-09-13T21:40:44.325 INFO:tasks.workunit.client.1.smithi116.stdout:0/531: creat d2/d5/fb0 x:0 0 0 2024-09-13T21:40:44.326 INFO:tasks.workunit.client.1.smithi116.stdout:3/586: mknod d3/db/d3d/cd0 0 2024-09-13T21:40:44.327 INFO:tasks.workunit.client.1.smithi116.stdout:1/397: sync 2024-09-13T21:40:44.327 INFO:tasks.workunit.client.1.smithi116.stdout:4/517: sync 2024-09-13T21:40:44.327 INFO:tasks.workunit.client.1.smithi116.stdout:3/587: link d3/db/d10/d1c/d34/d55/d57/f7a d3/db/d10/d29/fd1 0 2024-09-13T21:40:44.328 INFO:tasks.workunit.client.1.smithi116.stdout:0/532: dread d2/dc/d47/f70 [0,4194304] 0 2024-09-13T21:40:44.329 INFO:tasks.workunit.client.1.smithi116.stdout:1/398: creat d4/d23/f8f x:0 0 0 2024-09-13T21:40:44.331 INFO:tasks.workunit.client.1.smithi116.stdout:3/588: link d3/db/d20/c53 d3/db/d10/d1d/d5f/d7f/cd2 0 2024-09-13T21:40:44.331 INFO:tasks.workunit.client.1.smithi116.stdout:3/589: chown d3/db/la1 19227 1 2024-09-13T21:40:44.332 INFO:tasks.workunit.client.1.smithi116.stdout:0/533: mkdir d2/d5/d86/d8a/db1 0 2024-09-13T21:40:44.334 INFO:tasks.workunit.client.1.smithi116.stdout:1/399: mkdir d4/d14/d52/d2f/d5d/d90 0 2024-09-13T21:40:44.334 INFO:tasks.workunit.client.1.smithi116.stdout:1/400: readlink d4/d14/d52/d2f/d5c/l8e 0 2024-09-13T21:40:44.336 INFO:tasks.workunit.client.1.smithi116.stdout:3/590: mkdir d3/dd3 0 2024-09-13T21:40:44.337 INFO:tasks.workunit.client.1.smithi116.stdout:3/591: creat d3/db/d10/d1c/d34/d55/d96/fd4 x:0 0 0 2024-09-13T21:40:44.338 INFO:tasks.workunit.client.1.smithi116.stdout:0/534: unlink d2/dc/d12/d51/c55 0 2024-09-13T21:40:44.338 INFO:tasks.workunit.client.1.smithi116.stdout:0/535: creat d2/dc/d12/d51/fb2 x:0 0 0 2024-09-13T21:40:44.338 INFO:tasks.workunit.client.1.smithi116.stdout:1/401: mkdir d4/d14/d52/d2f/d91 0 2024-09-13T21:40:44.339 INFO:tasks.workunit.client.1.smithi116.stdout:0/536: rmdir d2/d5/d86 39 2024-09-13T21:40:44.340 INFO:tasks.workunit.client.1.smithi116.stdout:0/537: getdents d2/d5/d86/d8a/db1 0 2024-09-13T21:40:44.340 INFO:tasks.workunit.client.1.smithi116.stdout:1/402: getdents d4/d74/d8d/d5f 0 2024-09-13T21:40:44.340 INFO:tasks.workunit.client.1.smithi116.stdout:1/403: truncate d4/d74/d8d/d5f/f78 692231 0 2024-09-13T21:40:44.341 INFO:tasks.workunit.client.1.smithi116.stdout:0/538: unlink d2/c40 0 2024-09-13T21:40:44.344 INFO:tasks.workunit.client.1.smithi116.stdout:1/404: mkdir d4/d23/d57/d92 0 2024-09-13T21:40:44.344 INFO:tasks.workunit.client.1.smithi116.stdout:0/539: dread d2/dc/f22 [0,4194304] 0 2024-09-13T21:40:44.345 INFO:tasks.workunit.client.1.smithi116.stdout:0/540: symlink d2/lb3 0 2024-09-13T21:40:44.358 INFO:tasks.workunit.client.1.smithi116.stdout:1/405: read d4/d14/f4f [3844216,2807] 0 2024-09-13T21:40:44.358 INFO:tasks.workunit.client.1.smithi116.stdout:3/592: dwrite d3/db/d20/fc0 [0,4194304] 0 2024-09-13T21:40:44.358 INFO:tasks.workunit.client.1.smithi116.stdout:3/593: write d3/db/d3d/d40/f48 [1937703,113805] 0 2024-09-13T21:40:44.366 INFO:tasks.workunit.client.1.smithi116.stdout:3/594: write d3/db/d10/d1d/d5f/fa7 [4145758,46125] 0 2024-09-13T21:40:44.366 INFO:tasks.workunit.client.1.smithi116.stdout:0/541: dwrite d2/dc/f2c [0,4194304] 0 2024-09-13T21:40:44.366 INFO:tasks.workunit.client.1.smithi116.stdout:0/542: readlink d2/dc/d12/d28/l45 0 2024-09-13T21:40:44.367 INFO:tasks.workunit.client.1.smithi116.stdout:3/595: getdents d3/db 0 2024-09-13T21:40:44.368 INFO:tasks.workunit.client.1.smithi116.stdout:0/543: mkdir d2/d5b/db4 0 2024-09-13T21:40:44.369 INFO:tasks.workunit.client.1.smithi116.stdout:3/596: mknod d3/db/d20/cd5 0 2024-09-13T21:40:44.370 INFO:tasks.workunit.client.1.smithi116.stdout:3/597: link d3/db/d20/c4e d3/db/d10/d62/da2/cd6 0 2024-09-13T21:40:44.370 INFO:tasks.workunit.client.1.smithi116.stdout:3/598: fsync d3/db/d10/d1d/d5f/d6f/fb3 0 2024-09-13T21:40:44.371 INFO:tasks.workunit.client.1.smithi116.stdout:3/599: rename d3/db/d3d/d40/c93 to d3/db/d20/d86/cd7 0 2024-09-13T21:40:44.371 INFO:tasks.workunit.client.1.smithi116.stdout:3/600: creat d3/db/d10/d1d/d5f/fd8 x:0 0 0 2024-09-13T21:40:44.373 INFO:tasks.workunit.client.1.smithi116.stdout:3/601: unlink d3/db/c3a 0 2024-09-13T21:40:44.373 INFO:tasks.workunit.client.1.smithi116.stdout:0/544: dread d2/d5b/f93 [0,4194304] 0 2024-09-13T21:40:44.373 INFO:tasks.workunit.client.1.smithi116.stdout:0/545: chown d2/dc 1961287 1 2024-09-13T21:40:44.374 INFO:tasks.workunit.client.1.smithi116.stdout:0/546: creat d2/d5b/fb5 x:0 0 0 2024-09-13T21:40:44.374 INFO:tasks.workunit.client.1.smithi116.stdout:0/547: fdatasync d2/dc/d12/d28/d57/f82 0 2024-09-13T21:40:44.375 INFO:tasks.workunit.client.1.smithi116.stdout:0/548: mkdir d2/dc/d47/d63/d9f/db6 0 2024-09-13T21:40:44.376 INFO:tasks.workunit.client.1.smithi116.stdout:3/602: rmdir d3/db/d10/d1d/d5f/d6f/d71 39 2024-09-13T21:40:44.376 INFO:tasks.workunit.client.1.smithi116.stdout:3/603: dread - d3/db/d10/d29/fc3 zero size 2024-09-13T21:40:44.376 INFO:tasks.workunit.client.1.smithi116.stdout:3/604: chown d3/db/d26 140105698 1 2024-09-13T21:40:44.376 INFO:tasks.workunit.client.1.smithi116.stdout:3/605: fsync d3/db/d10/d1d/d5f/d6f/d71/f7d 0 2024-09-13T21:40:44.378 INFO:tasks.workunit.client.1.smithi116.stdout:0/549: unlink d2/d5/d86/d8a/l99 0 2024-09-13T21:40:44.381 INFO:tasks.workunit.client.1.smithi116.stdout:3/606: getdents d3/db/d3d 0 2024-09-13T21:40:44.381 INFO:tasks.workunit.client.1.smithi116.stdout:3/607: dread d3/db/d20/f65 [0,4194304] 0 2024-09-13T21:40:44.382 INFO:tasks.workunit.client.1.smithi116.stdout:0/550: rename d2/dc/d12/f41 to d2/d5/fb7 0 2024-09-13T21:40:44.382 INFO:tasks.workunit.client.1.smithi116.stdout:0/551: write d2/dc/d12/f23 [8621368,28960] 0 2024-09-13T21:40:44.401 INFO:tasks.workunit.client.1.smithi116.stdout:3/608: dwrite d3/db/d10/d1d/d5f/d6f/d71/f7d [0,4194304] 0 2024-09-13T21:40:44.401 INFO:tasks.workunit.client.1.smithi116.stdout:3/609: write d3/db/d10/d99/fa8 [200175,47695] 0 2024-09-13T21:40:44.401 INFO:tasks.workunit.client.1.smithi116.stdout:0/552: dwrite d2/dc/d12/d28/f9c [0,4194304] 0 2024-09-13T21:40:44.401 INFO:tasks.workunit.client.1.smithi116.stdout:0/553: write d2/f38 [62152,70893] 0 2024-09-13T21:40:44.413 INFO:tasks.workunit.client.1.smithi116.stdout:0/554: dread d2/f38 [0,4194304] 0 2024-09-13T21:40:44.417 INFO:tasks.workunit.client.1.smithi116.stdout:0/555: mkdir d2/dc/d12/d51/db8 0 2024-09-13T21:40:44.417 INFO:tasks.workunit.client.1.smithi116.stdout:0/556: chown d2/d5/d86 11780 1 2024-09-13T21:40:44.417 INFO:tasks.workunit.client.1.smithi116.stdout:0/557: chown d2/dc/d12/d51/fa0 106 1 2024-09-13T21:40:44.417 INFO:tasks.workunit.client.1.smithi116.stdout:0/558: creat d2/dc/d12/d28/fb9 x:0 0 0 2024-09-13T21:40:44.420 INFO:tasks.workunit.client.1.smithi116.stdout:0/559: link d2/dc/d12/l8f d2/d5/d86/d8a/lba 0 2024-09-13T21:40:44.420 INFO:tasks.workunit.client.1.smithi116.stdout:0/560: getdents d2/dc 0 2024-09-13T21:40:44.422 INFO:tasks.workunit.client.1.smithi116.stdout:0/561: creat d2/d5/d86/d8a/fbb x:0 0 0 2024-09-13T21:40:44.424 INFO:tasks.workunit.client.1.smithi116.stdout:0/562: unlink d2/dc/d12/c6c 0 2024-09-13T21:40:44.424 INFO:tasks.workunit.client.1.smithi116.stdout:0/563: chown d2/dc/d47/d63/d9f 3127097 1 2024-09-13T21:40:44.424 INFO:tasks.workunit.client.1.smithi116.stdout:0/564: write d2/f3f [226581,64592] 0 2024-09-13T21:40:44.424 INFO:tasks.workunit.client.1.smithi116.stdout:0/565: write d2/dc/d47/f4b [4977295,18833] 0 2024-09-13T21:40:44.426 INFO:tasks.workunit.client.1.smithi116.stdout:0/566: unlink d2/dc/d12/d28/d57/l8c 0 2024-09-13T21:40:44.440 INFO:tasks.workunit.client.1.smithi116.stdout:0/567: dwrite d2/dc/d12/d28/d57/f90 [0,4194304] 0 2024-09-13T21:40:44.442 INFO:tasks.workunit.client.1.smithi116.stdout:0/568: dread d2/d5/f7e [0,4194304] 0 2024-09-13T21:40:44.442 INFO:tasks.workunit.client.1.smithi116.stdout:0/569: stat d2/d5b/db4 0 2024-09-13T21:40:44.443 INFO:tasks.workunit.client.1.smithi116.stdout:0/570: creat d2/d5/d61/fbc x:0 0 0 2024-09-13T21:40:44.453 INFO:tasks.workunit.client.1.smithi116.stdout:7/546: sync 2024-09-13T21:40:44.453 INFO:tasks.workunit.client.1.smithi116.stdout:9/315: sync 2024-09-13T21:40:44.453 INFO:tasks.workunit.client.1.smithi116.stdout:9/316: chown d2/d8/c29 377691 1 2024-09-13T21:40:44.455 INFO:tasks.workunit.client.1.smithi116.stdout:9/317: rename d2/d10/d14/c25 to d2/d43/c5e 0 2024-09-13T21:40:44.456 INFO:tasks.workunit.client.1.smithi116.stdout:9/318: truncate d2/d10/f2a 2433228 0 2024-09-13T21:40:44.456 INFO:tasks.workunit.client.1.smithi116.stdout:9/319: write d2/d10/d4c/f5a [200664,96762] 0 2024-09-13T21:40:44.458 INFO:tasks.workunit.client.1.smithi116.stdout:0/571: dwrite d2/dc/d12/d28/d57/f82 [0,4194304] 0 2024-09-13T21:40:44.461 INFO:tasks.workunit.client.1.smithi116.stdout:0/572: mknod d2/cbd 0 2024-09-13T21:40:44.462 INFO:tasks.workunit.client.1.smithi116.stdout:9/320: dread d2/f2d [0,4194304] 0 2024-09-13T21:40:44.462 INFO:tasks.workunit.client.1.smithi116.stdout:9/321: fdatasync d2/d10/d4c/f51 0 2024-09-13T21:40:44.464 INFO:tasks.workunit.client.1.smithi116.stdout:7/547: write d5/d9/d27/f2b [858606,2218] 0 2024-09-13T21:40:44.464 INFO:tasks.workunit.client.1.smithi116.stdout:7/548: write d5/d9/d1c/d22/d24/d5f/f64 [657149,604] 0 2024-09-13T21:40:44.464 INFO:tasks.workunit.client.1.smithi116.stdout:7/549: stat d5/d9/d27/d31/d38/d48/f77 0 2024-09-13T21:40:44.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/322: write d2/d10/d14/f44 [506236,15557] 0 2024-09-13T21:40:44.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/323: fsync d2/d8/f11 0 2024-09-13T21:40:44.475 INFO:tasks.workunit.client.1.smithi116.stdout:7/550: dread d5/f8 [0,4194304] 0 2024-09-13T21:40:44.476 INFO:tasks.workunit.client.1.smithi116.stdout:7/551: truncate d5/f35 3216082 0 2024-09-13T21:40:44.477 INFO:tasks.workunit.client.1.smithi116.stdout:7/552: symlink d5/d9/db/lab 0 2024-09-13T21:40:44.477 INFO:tasks.workunit.client.1.smithi116.stdout:7/553: truncate d5/d9/d27/d31/d38/d48/f75 1335804 0 2024-09-13T21:40:44.477 INFO:tasks.workunit.client.1.smithi116.stdout:7/554: write d5/d9/d27/f90 [528323,52770] 0 2024-09-13T21:40:44.478 INFO:tasks.workunit.client.1.smithi116.stdout:7/555: mknod d5/d9/db/d21/d6e/d6f/d70/cac 0 2024-09-13T21:40:44.478 INFO:tasks.workunit.client.1.smithi116.stdout:7/556: readlink d5/d9/d1c/d2e/l9c 0 2024-09-13T21:40:44.478 INFO:tasks.workunit.client.1.smithi116.stdout:7/557: readlink d5/d9/db/d21/l87 0 2024-09-13T21:40:44.479 INFO:tasks.workunit.client.1.smithi116.stdout:7/558: mknod d5/d9/d1c/d2e/d52/cad 0 2024-09-13T21:40:44.480 INFO:tasks.workunit.client.1.smithi116.stdout:0/573: dwrite d2/dc/f2e [0,4194304] 0 2024-09-13T21:40:44.481 INFO:tasks.workunit.client.1.smithi116.stdout:0/574: mkdir d2/d5/dbe 0 2024-09-13T21:40:44.482 INFO:tasks.workunit.client.1.smithi116.stdout:0/575: truncate d2/d5b/f93 5063440 0 2024-09-13T21:40:44.483 INFO:tasks.workunit.client.1.smithi116.stdout:0/576: dread d2/dc/f2e [4194304,4194304] 0 2024-09-13T21:40:44.483 INFO:tasks.workunit.client.1.smithi116.stdout:0/577: dread - d2/d5/d61/fbc zero size 2024-09-13T21:40:44.484 INFO:tasks.workunit.client.1.smithi116.stdout:0/578: mknod d2/dc/d47/cbf 0 2024-09-13T21:40:44.484 INFO:tasks.workunit.client.1.smithi116.stdout:0/579: dread - d2/d5b/faa zero size 2024-09-13T21:40:44.485 INFO:tasks.workunit.client.1.smithi116.stdout:9/324: dread d2/f1e [0,4194304] 0 2024-09-13T21:40:44.490 INFO:tasks.workunit.client.1.smithi116.stdout:9/325: dread d2/f13 [0,4194304] 0 2024-09-13T21:40:44.505 INFO:tasks.workunit.client.1.smithi116.stdout:0/580: dwrite d2/dc/d12/d28/f32 [0,4194304] 0 2024-09-13T21:40:44.505 INFO:tasks.workunit.client.1.smithi116.stdout:0/581: fdatasync d2/dc/d12/f36 0 2024-09-13T21:40:44.506 INFO:tasks.workunit.client.1.smithi116.stdout:0/582: getdents d2/dc/d12/d51/db8 0 2024-09-13T21:40:44.506 INFO:tasks.workunit.client.1.smithi116.stdout:9/326: write d2/d8/fd [1500779,59632] 0 2024-09-13T21:40:44.506 INFO:tasks.workunit.client.1.smithi116.stdout:9/327: creat d2/f5f x:0 0 0 2024-09-13T21:40:44.506 INFO:tasks.workunit.client.1.smithi116.stdout:7/559: dwrite d5/d9/d27/f90 [0,4194304] 0 2024-09-13T21:40:44.506 INFO:tasks.workunit.client.1.smithi116.stdout:0/583: mknod d2/dc/d12/d51/db8/cc0 0 2024-09-13T21:40:44.508 INFO:tasks.workunit.client.1.smithi116.stdout:9/328: mknod d2/d10/d41/d47/c60 0 2024-09-13T21:40:44.508 INFO:tasks.workunit.client.1.smithi116.stdout:9/329: write d2/f2d [436622,12029] 0 2024-09-13T21:40:44.511 INFO:tasks.workunit.client.1.smithi116.stdout:7/560: mkdir d5/d9/d1c/d22/dae 0 2024-09-13T21:40:44.512 INFO:tasks.workunit.client.1.smithi116.stdout:0/584: mkdir d2/d5/dbe/dc1 0 2024-09-13T21:40:44.514 INFO:tasks.workunit.client.1.smithi116.stdout:9/330: link d2/d43/c5e d2/d10/d4c/c61 0 2024-09-13T21:40:44.514 INFO:tasks.workunit.client.1.smithi116.stdout:9/331: write d2/f5f [588246,64136] 0 2024-09-13T21:40:44.516 INFO:tasks.workunit.client.1.smithi116.stdout:9/332: creat d2/d5d/f62 x:0 0 0 2024-09-13T21:40:44.516 INFO:tasks.workunit.client.1.smithi116.stdout:9/333: truncate d2/d10/d14/d38/f4f 457629 0 2024-09-13T21:40:44.516 INFO:tasks.workunit.client.1.smithi116.stdout:9/334: fdatasync d2/d10/d4c/f4e 0 2024-09-13T21:40:44.516 INFO:tasks.workunit.client.1.smithi116.stdout:9/335: truncate d2/d10/d4c/f51 326069 0 2024-09-13T21:40:44.518 INFO:tasks.workunit.client.1.smithi116.stdout:9/336: creat d2/d43/f63 x:0 0 0 2024-09-13T21:40:44.519 INFO:tasks.workunit.client.1.smithi116.stdout:9/337: mknod d2/d10/d14/d38/c64 0 2024-09-13T21:40:44.522 INFO:tasks.workunit.client.1.smithi116.stdout:9/338: rename d2/d10/c3d to d2/d10/d4c/c65 0 2024-09-13T21:40:44.523 INFO:tasks.workunit.client.1.smithi116.stdout:9/339: rename d2/d10/l55 to d2/d10/d4c/l66 0 2024-09-13T21:40:44.523 INFO:tasks.workunit.client.1.smithi116.stdout:6/458: sync 2024-09-13T21:40:44.524 INFO:tasks.workunit.client.1.smithi116.stdout:6/459: chown d8/d17/l25 242567 1 2024-09-13T21:40:44.525 INFO:tasks.workunit.client.1.smithi116.stdout:6/460: mkdir d8/d17/d70/da0 0 2024-09-13T21:40:44.525 INFO:tasks.workunit.client.1.smithi116.stdout:6/461: truncate d8/d15/d2e/d2f/d57/f68 291080 0 2024-09-13T21:40:44.526 INFO:tasks.workunit.client.1.smithi116.stdout:6/462: symlink d8/d15/d2e/d9e/la1 0 2024-09-13T21:40:44.526 INFO:tasks.workunit.client.1.smithi116.stdout:6/463: fdatasync d8/d15/f64 0 2024-09-13T21:40:44.526 INFO:tasks.workunit.client.1.smithi116.stdout:6/464: creat d8/d15/fa2 x:0 0 0 2024-09-13T21:40:44.527 INFO:tasks.workunit.client.1.smithi116.stdout:6/465: truncate d8/fe 1168982 0 2024-09-13T21:40:44.530 INFO:tasks.workunit.client.1.smithi116.stdout:0/585: write d2/d5/d61/f6a [2084272,180] 0 2024-09-13T21:40:44.531 INFO:tasks.workunit.client.1.smithi116.stdout:7/561: dwrite d5/d9/f51 [0,4194304] 0 2024-09-13T21:40:44.531 INFO:tasks.workunit.client.1.smithi116.stdout:9/340: dread d2/f13 [0,4194304] 0 2024-09-13T21:40:44.532 INFO:tasks.workunit.client.1.smithi116.stdout:6/466: dread d8/d10/d33/f5c [0,4194304] 0 2024-09-13T21:40:44.532 INFO:tasks.workunit.client.1.smithi116.stdout:0/586: creat d2/dc/d47/d63/d9f/db6/fc2 x:0 0 0 2024-09-13T21:40:44.532 INFO:tasks.workunit.client.1.smithi116.stdout:0/587: chown d2/d5/d61/fbc 253 1 2024-09-13T21:40:44.532 INFO:tasks.workunit.client.1.smithi116.stdout:0/588: creat d2/dc/d12/d28/fc3 x:0 0 0 2024-09-13T21:40:44.532 INFO:tasks.workunit.client.1.smithi116.stdout:0/589: stat d2/dc/d47/f9b 0 2024-09-13T21:40:44.533 INFO:tasks.workunit.client.1.smithi116.stdout:9/341: mkdir d2/d8/d67 0 2024-09-13T21:40:44.533 INFO:tasks.workunit.client.1.smithi116.stdout:6/467: dread d8/d17/f82 [0,4194304] 0 2024-09-13T21:40:44.533 INFO:tasks.workunit.client.1.smithi116.stdout:7/562: creat d5/d9/db/d21/d6e/d6f/faf x:0 0 0 2024-09-13T21:40:44.537 INFO:tasks.workunit.client.1.smithi116.stdout:0/590: symlink d2/d5/dbe/lc4 0 2024-09-13T21:40:44.539 INFO:tasks.workunit.client.1.smithi116.stdout:7/563: mkdir d5/db0 0 2024-09-13T21:40:44.540 INFO:tasks.workunit.client.1.smithi116.stdout:0/591: creat d2/d5/d86/fc5 x:0 0 0 2024-09-13T21:40:44.541 INFO:tasks.workunit.client.1.smithi116.stdout:9/342: getdents d2/d8/d3e 0 2024-09-13T21:40:44.541 INFO:tasks.workunit.client.1.smithi116.stdout:9/343: creat d2/d43/f68 x:0 0 0 2024-09-13T21:40:44.542 INFO:tasks.workunit.client.1.smithi116.stdout:9/344: chown c1 70 1 2024-09-13T21:40:44.543 INFO:tasks.workunit.client.1.smithi116.stdout:7/564: mkdir d5/d9/db/d21/d6e/d6f/d70/d80/db1 0 2024-09-13T21:40:44.543 INFO:tasks.workunit.client.1.smithi116.stdout:6/468: dread d8/f87 [0,4194304] 0 2024-09-13T21:40:44.544 INFO:tasks.workunit.client.1.smithi116.stdout:6/469: dread d8/d10/d33/f50 [0,4194304] 0 2024-09-13T21:40:44.545 INFO:tasks.workunit.client.1.smithi116.stdout:7/565: mknod d5/d9/d1c/d22/d24/d6b/d72/cb2 0 2024-09-13T21:40:44.546 INFO:tasks.workunit.client.1.smithi116.stdout:6/470: symlink d8/d17/la3 0 2024-09-13T21:40:44.547 INFO:tasks.workunit.client.1.smithi116.stdout:7/566: mknod d5/d9/d27/d31/cb3 0 2024-09-13T21:40:44.548 INFO:tasks.workunit.client.1.smithi116.stdout:7/567: creat d5/d9/d27/fb4 x:0 0 0 2024-09-13T21:40:44.548 INFO:tasks.workunit.client.1.smithi116.stdout:7/568: fsync d5/d9/db/d21/f63 0 2024-09-13T21:40:44.548 INFO:tasks.workunit.client.1.smithi116.stdout:9/345: dread d2/d10/f2a [0,4194304] 0 2024-09-13T21:40:44.549 INFO:tasks.workunit.client.1.smithi116.stdout:6/471: creat d8/d17/d70/da0/fa4 x:0 0 0 2024-09-13T21:40:44.549 INFO:tasks.workunit.client.1.smithi116.stdout:6/472: getdents d8/d15/d2e/d2f/d38/d9c 0 2024-09-13T21:40:44.549 INFO:tasks.workunit.client.1.smithi116.stdout:6/473: write d8/d15/fa2 [467704,14523] 0 2024-09-13T21:40:44.552 INFO:tasks.workunit.client.1.smithi116.stdout:0/592: write d2/d5b/f93 [3431384,71106] 0 2024-09-13T21:40:44.552 INFO:tasks.workunit.client.1.smithi116.stdout:9/346: rename d2/d10/d41 to d2/d5d/d69 0 2024-09-13T21:40:44.552 INFO:tasks.workunit.client.1.smithi116.stdout:9/347: write d2/d8/d3e/f4d [1258447,10870] 0 2024-09-13T21:40:44.552 INFO:tasks.workunit.client.1.smithi116.stdout:9/348: chown d2/d10/d14/c19 45871303 1 2024-09-13T21:40:44.553 INFO:tasks.workunit.client.1.smithi116.stdout:9/349: mknod d2/d8/c6a 0 2024-09-13T21:40:44.555 INFO:tasks.workunit.client.1.smithi116.stdout:9/350: creat d2/d10/d14/d38/f6b x:0 0 0 2024-09-13T21:40:44.562 INFO:tasks.workunit.client.1.smithi116.stdout:9/351: dread d2/d10/d4c/f5a [0,4194304] 0 2024-09-13T21:40:44.564 INFO:tasks.workunit.client.1.smithi116.stdout:9/352: creat d2/d10/d14/d38/d3a/f6c x:0 0 0 2024-09-13T21:40:44.564 INFO:tasks.workunit.client.1.smithi116.stdout:9/353: creat d2/f6d x:0 0 0 2024-09-13T21:40:44.567 INFO:tasks.workunit.client.1.smithi116.stdout:0/593: read d2/d5/f58 [3596401,105336] 0 2024-09-13T21:40:44.573 INFO:tasks.workunit.client.1.smithi116.stdout:7/569: dwrite d5/f35 [0,4194304] 0 2024-09-13T21:40:44.582 INFO:tasks.workunit.client.1.smithi116.stdout:6/474: dwrite d8/d10/d24/f29 [0,4194304] 0 2024-09-13T21:40:44.589 INFO:tasks.workunit.client.1.smithi116.stdout:0/594: dwrite d2/dc/d47/f9b [0,4194304] 0 2024-09-13T21:40:44.589 INFO:tasks.workunit.client.1.smithi116.stdout:7/570: dwrite d5/d9/d27/fb4 [0,4194304] 0 2024-09-13T21:40:44.592 INFO:tasks.workunit.client.1.smithi116.stdout:0/595: truncate d2/dc/d12/f36 2819947 0 2024-09-13T21:40:44.595 INFO:tasks.workunit.client.1.smithi116.stdout:0/596: creat d2/dc/d12/d28/d57/d65/fc6 x:0 0 0 2024-09-13T21:40:44.595 INFO:tasks.workunit.client.1.smithi116.stdout:0/597: chown d2/dc/d47/cbf 0 1 2024-09-13T21:40:44.597 INFO:tasks.workunit.client.1.smithi116.stdout:0/598: rename d2/d5/d61/f6a to d2/dc/d47/d63/d9f/dad/fc7 0 2024-09-13T21:40:44.602 INFO:tasks.workunit.client.1.smithi116.stdout:6/475: dwrite d8/d15/d2e/d2f/d57/f6e [0,4194304] 0 2024-09-13T21:40:44.602 INFO:tasks.workunit.client.1.smithi116.stdout:6/476: stat f3 0 2024-09-13T21:40:44.608 INFO:tasks.workunit.client.1.smithi116.stdout:0/599: dread d2/f38 [4194304,4194304] 0 2024-09-13T21:40:44.608 INFO:tasks.workunit.client.1.smithi116.stdout:0/600: dread - d2/d5/d61/fbc zero size 2024-09-13T21:40:44.609 INFO:tasks.workunit.client.1.smithi116.stdout:0/601: link d2/dc/f33 d2/dc/d47/d63/d9f/db6/fc8 0 2024-09-13T21:40:44.612 INFO:tasks.workunit.client.1.smithi116.stdout:6/477: write d8/d15/d2e/f6a [2206190,101271] 0 2024-09-13T21:40:44.612 INFO:tasks.workunit.client.1.smithi116.stdout:6/478: write d8/d10/f55 [4904443,36249] 0 2024-09-13T21:40:44.612 INFO:tasks.workunit.client.1.smithi116.stdout:6/479: chown d8/d10/d33/f8a 242528282 1 2024-09-13T21:40:44.613 INFO:tasks.workunit.client.1.smithi116.stdout:6/480: creat d8/d15/d2e/fa5 x:0 0 0 2024-09-13T21:40:44.613 INFO:tasks.workunit.client.1.smithi116.stdout:6/481: mkdir d8/d17/da6 0 2024-09-13T21:40:44.614 INFO:tasks.workunit.client.1.smithi116.stdout:6/482: mknod d8/d15/ca7 0 2024-09-13T21:40:44.614 INFO:tasks.workunit.client.1.smithi116.stdout:6/483: chown d8/c36 9 1 2024-09-13T21:40:44.614 INFO:tasks.workunit.client.1.smithi116.stdout:6/484: write d8/d15/d2e/d2f/f35 [642458,60795] 0 2024-09-13T21:40:44.615 INFO:tasks.workunit.client.1.smithi116.stdout:6/485: link d8/d1e/f63 d8/d15/d2e/d2f/fa8 0 2024-09-13T21:40:44.618 INFO:tasks.workunit.client.1.smithi116.stdout:0/602: dread d2/dc/d12/d28/f54 [0,4194304] 0 2024-09-13T21:40:44.618 INFO:tasks.workunit.client.1.smithi116.stdout:0/603: chown d2/dc/f33 297531319 1 2024-09-13T21:40:44.640 INFO:tasks.workunit.client.1.smithi116.stdout:6/486: dwrite d8/d15/d2e/d2f/d38/f89 [0,4194304] 0 2024-09-13T21:40:44.641 INFO:tasks.workunit.client.1.smithi116.stdout:0/604: dwrite d2/f3f [0,4194304] 0 2024-09-13T21:40:44.643 INFO:tasks.workunit.client.1.smithi116.stdout:6/487: symlink d8/d17/la9 0 2024-09-13T21:40:44.648 INFO:tasks.workunit.client.1.smithi116.stdout:0/605: dread d2/d5/f50 [0,4194304] 0 2024-09-13T21:40:44.649 INFO:tasks.workunit.client.1.smithi116.stdout:6/488: dread d8/d15/f1b [0,4194304] 0 2024-09-13T21:40:44.653 INFO:tasks.workunit.client.1.smithi116.stdout:0/606: dread d2/dc/d47/f4b [0,4194304] 0 2024-09-13T21:40:44.653 INFO:tasks.workunit.client.1.smithi116.stdout:0/607: stat d2/dc/d12/f23 0 2024-09-13T21:40:44.661 INFO:tasks.workunit.client.1.smithi116.stdout:0/608: write d2/dc/d12/d28/f6e [1145875,68865] 0 2024-09-13T21:40:44.661 INFO:tasks.workunit.client.1.smithi116.stdout:0/609: fdatasync d2/dc/d12/d51/fb2 0 2024-09-13T21:40:44.664 INFO:tasks.workunit.client.1.smithi116.stdout:6/489: dwrite d8/d10/d78/f85 [0,4194304] 0 2024-09-13T21:40:44.666 INFO:tasks.workunit.client.1.smithi116.stdout:6/490: creat d8/d10/faa x:0 0 0 2024-09-13T21:40:44.666 INFO:tasks.workunit.client.1.smithi116.stdout:6/491: chown d8/l60 123205 1 2024-09-13T21:40:44.667 INFO:tasks.workunit.client.1.smithi116.stdout:6/492: mkdir d8/d10/d24/dab 0 2024-09-13T21:40:44.668 INFO:tasks.workunit.client.1.smithi116.stdout:6/493: rename d8/d10/f4d to d8/d17/da6/fac 0 2024-09-13T21:40:44.670 INFO:tasks.workunit.client.1.smithi116.stdout:6/494: rename d8/l6f to d8/d15/d2e/lad 0 2024-09-13T21:40:44.670 INFO:tasks.workunit.client.1.smithi116.stdout:6/495: dread - d8/d10/d33/f8a zero size 2024-09-13T21:40:44.670 INFO:tasks.workunit.client.1.smithi116.stdout:0/610: dread d2/dc/f3d [0,4194304] 0 2024-09-13T21:40:44.671 INFO:tasks.workunit.client.1.smithi116.stdout:0/611: creat d2/d5b/fc9 x:0 0 0 2024-09-13T21:40:44.671 INFO:tasks.workunit.client.1.smithi116.stdout:0/612: creat d2/d5/d86/d8a/fca x:0 0 0 2024-09-13T21:40:44.671 INFO:tasks.workunit.client.1.smithi116.stdout:0/613: creat d2/d5/fcb x:0 0 0 2024-09-13T21:40:44.671 INFO:tasks.workunit.client.1.smithi116.stdout:0/614: chown d2/dc/d47/f4b 36548517 1 2024-09-13T21:40:44.671 INFO:tasks.workunit.client.1.smithi116.stdout:6/496: unlink d8/d10/f8c 0 2024-09-13T21:40:44.674 INFO:tasks.workunit.client.1.smithi116.stdout:0/615: mkdir d2/dc/dcc 0 2024-09-13T21:40:44.675 INFO:tasks.workunit.client.1.smithi116.stdout:6/497: truncate d8/d15/f1f 6092246 0 2024-09-13T21:40:44.677 INFO:tasks.workunit.client.1.smithi116.stdout:6/498: symlink d8/lae 0 2024-09-13T21:40:44.677 INFO:tasks.workunit.client.1.smithi116.stdout:6/499: write d8/d15/f64 [1883042,128528] 0 2024-09-13T21:40:44.677 INFO:tasks.workunit.client.1.smithi116.stdout:6/500: chown d8/d15/d2e/d2f/d57/f72 28314640 1 2024-09-13T21:40:44.679 INFO:tasks.workunit.client.1.smithi116.stdout:6/501: mkdir d8/d17/d70/da0/daf 0 2024-09-13T21:40:44.679 INFO:tasks.workunit.client.1.smithi116.stdout:6/502: write d8/d15/d2e/fa5 [63063,49853] 0 2024-09-13T21:40:44.679 INFO:tasks.workunit.client.1.smithi116.stdout:6/503: fdatasync d8/d15/f98 0 2024-09-13T21:40:44.679 INFO:tasks.workunit.client.1.smithi116.stdout:6/504: chown d8/f9a 3080333 1 2024-09-13T21:40:44.690 INFO:tasks.workunit.client.1.smithi116.stdout:0/616: dwrite d2/d5b/f85 [0,4194304] 0 2024-09-13T21:40:44.690 INFO:tasks.workunit.client.1.smithi116.stdout:0/617: creat d2/d5/d86/d8a/fcd x:0 0 0 2024-09-13T21:40:44.693 INFO:tasks.workunit.client.1.smithi116.stdout:0/618: mkdir d2/dc/dce 0 2024-09-13T21:40:44.694 INFO:tasks.workunit.client.1.smithi116.stdout:0/619: unlink d2/d5b/f78 0 2024-09-13T21:40:44.695 INFO:tasks.workunit.client.1.smithi116.stdout:0/620: truncate d2/d5/d86/d8a/fcd 841848 0 2024-09-13T21:40:44.695 INFO:tasks.workunit.client.1.smithi116.stdout:0/621: fdatasync d2/dc/f31 0 2024-09-13T21:40:44.695 INFO:tasks.workunit.client.1.smithi116.stdout:0/622: truncate d2/dc/d12/d51/fa0 877992 0 2024-09-13T21:40:44.695 INFO:tasks.workunit.client.1.smithi116.stdout:0/623: chown d2/d5/f50 14199 1 2024-09-13T21:40:44.698 INFO:tasks.workunit.client.1.smithi116.stdout:0/624: read d2/f38 [4276577,74187] 0 2024-09-13T21:40:44.698 INFO:tasks.workunit.client.1.smithi116.stdout:6/505: dwrite d8/d17/f23 [0,4194304] 0 2024-09-13T21:40:44.698 INFO:tasks.workunit.client.1.smithi116.stdout:6/506: write f3 [93054,9663] 0 2024-09-13T21:40:44.699 INFO:tasks.workunit.client.1.smithi116.stdout:0/625: mkdir d2/dc/dcf 0 2024-09-13T21:40:44.704 INFO:tasks.workunit.client.1.smithi116.stdout:0/626: rename d2/d5b/ca5 to d2/dc/d47/d63/d9f/cd0 0 2024-09-13T21:40:44.708 INFO:tasks.workunit.client.1.smithi116.stdout:0/627: dread d2/dc/f3d [0,4194304] 0 2024-09-13T21:40:44.723 INFO:tasks.workunit.client.1.smithi116.stdout:6/507: dwrite d8/f99 [0,4194304] 0 2024-09-13T21:40:44.724 INFO:tasks.workunit.client.1.smithi116.stdout:0/628: dwrite d2/dc/f2e [0,4194304] 0 2024-09-13T21:40:44.724 INFO:tasks.workunit.client.1.smithi116.stdout:6/508: creat d8/d15/d2e/d2f/d38/d9c/fb0 x:0 0 0 2024-09-13T21:40:44.725 INFO:tasks.workunit.client.1.smithi116.stdout:0/629: rmdir d2/dc/d47/d63/d9f 39 2024-09-13T21:40:44.725 INFO:tasks.workunit.client.1.smithi116.stdout:0/630: stat d2/dc/dce 0 2024-09-13T21:40:44.727 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T21:40:44.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T21:40:44.745 INFO:tasks.workunit.client.1.smithi116.stdout:0/631: dwrite d2/d5b/fb5 [0,4194304] 0 2024-09-13T21:40:44.747 INFO:tasks.workunit.client.1.smithi116.stdout:6/509: dwrite d8/d15/f1f [0,4194304] 0 2024-09-13T21:40:44.759 INFO:tasks.workunit.client.1.smithi116.stdout:0/632: dwrite d2/dc/d12/d28/f88 [0,4194304] 0 2024-09-13T21:40:44.759 INFO:tasks.workunit.client.1.smithi116.stdout:0/633: readlink d2/dc/l35 0 2024-09-13T21:40:44.761 INFO:tasks.workunit.client.1.smithi116.stdout:0/634: creat d2/fd1 x:0 0 0 2024-09-13T21:40:44.761 INFO:tasks.workunit.client.1.smithi116.stdout:0/635: write d2/d5b/f5c [506222,9921] 0 2024-09-13T21:40:44.763 INFO:tasks.workunit.client.1.smithi116.stdout:5/601: sync 2024-09-13T21:40:44.763 INFO:tasks.workunit.client.1.smithi116.stdout:0/636: link d2/dc/d12/d51/d62/fa6 d2/dc/dcc/fd2 0 2024-09-13T21:40:44.764 INFO:tasks.workunit.client.1.smithi116.stdout:0/637: mkdir d2/d5/d86/d8a/dd3 0 2024-09-13T21:40:44.765 INFO:tasks.workunit.client.1.smithi116.stdout:0/638: creat d2/dc/d12/d51/fd4 x:0 0 0 2024-09-13T21:40:44.766 INFO:tasks.workunit.client.1.smithi116.stdout:0/639: mknod d2/d5/d61/cd5 0 2024-09-13T21:40:44.766 INFO:tasks.workunit.client.1.smithi116.stdout:5/602: dread d7/da/d5e/f7a [0,4194304] 0 2024-09-13T21:40:44.768 INFO:tasks.workunit.client.1.smithi116.stdout:0/640: unlink d2/dc/d12/d28/f6e 0 2024-09-13T21:40:44.769 INFO:tasks.workunit.client.1.smithi116.stdout:5/603: creat d7/d40/d90/fc3 x:0 0 0 2024-09-13T21:40:44.770 INFO:tasks.workunit.client.1.smithi116.stdout:0/641: creat d2/dc/d12/d51/db8/fd6 x:0 0 0 2024-09-13T21:40:44.771 INFO:tasks.workunit.client.1.smithi116.stdout:5/604: symlink d7/da/d5e/d79/d8f/lc4 0 2024-09-13T21:40:44.772 INFO:tasks.workunit.client.1.smithi116.stdout:0/642: mkdir d2/dc/dcf/dd7 0 2024-09-13T21:40:44.784 INFO:tasks.workunit.client.1.smithi116.stdout:5/605: dread d7/d1d/f20 [0,4194304] 0 2024-09-13T21:40:44.784 INFO:tasks.workunit.client.1.smithi116.stdout:5/606: truncate d7/d40/f8e 427801 0 2024-09-13T21:40:44.785 INFO:tasks.workunit.client.1.smithi116.stdout:5/607: getdents d7/d40 0 2024-09-13T21:40:44.786 INFO:tasks.workunit.client.1.smithi116.stdout:5/608: creat d7/d40/d90/fc5 x:0 0 0 2024-09-13T21:40:44.795 INFO:tasks.workunit.client.1.smithi116.stdout:0/643: dwrite d2/dc/d12/d51/f9a [4194304,4194304] 0 2024-09-13T21:40:44.795 INFO:tasks.workunit.client.1.smithi116.stdout:0/644: truncate d2/d5/fb0 873996 0 2024-09-13T21:40:44.795 INFO:tasks.workunit.client.1.smithi116.stdout:0/645: chown d2/dc/d12/d51/d62/c5a 56107256 1 2024-09-13T21:40:44.797 INFO:tasks.workunit.client.1.smithi116.stdout:0/646: mknod d2/d5/d86/d8a/cd8 0 2024-09-13T21:40:44.797 INFO:tasks.workunit.client.1.smithi116.stdout:5/609: dread d7/fa2 [0,4194304] 0 2024-09-13T21:40:44.799 INFO:tasks.workunit.client.1.smithi116.stdout:5/610: unlink d7/d40/fa9 0 2024-09-13T21:40:44.802 INFO:tasks.workunit.client.1.smithi116.stdout:5/611: link d7/da/d5e/c43 d7/d1d/d46/d85/d96/cc6 0 2024-09-13T21:40:44.802 INFO:tasks.workunit.client.1.smithi116.stdout:5/612: fdatasync d7/da/d5e/d65/fa4 0 2024-09-13T21:40:44.802 INFO:tasks.workunit.client.1.smithi116.stdout:5/613: fsync d7/da/f1c 0 2024-09-13T21:40:44.802 INFO:tasks.workunit.client.1.smithi116.stdout:5/614: creat d7/d1d/d64/d87/fc7 x:0 0 0 2024-09-13T21:40:44.803 INFO:tasks.workunit.client.1.smithi116.stdout:5/615: truncate d7/da/d5e/d65/d6f/f7e 525580 0 2024-09-13T21:40:44.813 INFO:tasks.workunit.client.1.smithi116.stdout:0/647: dwrite d2/dc/d12/d51/db8/fd6 [0,4194304] 0 2024-09-13T21:40:44.813 INFO:tasks.workunit.client.1.smithi116.stdout:0/648: fdatasync d2/dc/d12/d51/fd4 0 2024-09-13T21:40:44.816 INFO:tasks.workunit.client.1.smithi116.stdout:0/649: stat d2/dc/d12/d28/l45 0 2024-09-13T21:40:44.816 INFO:tasks.workunit.client.1.smithi116.stdout:0/650: chown d2/f60 0 1 2024-09-13T21:40:44.816 INFO:tasks.workunit.client.1.smithi116.stdout:5/616: write d7/f16 [5072451,23906] 0 2024-09-13T21:40:44.817 INFO:tasks.workunit.client.1.smithi116.stdout:5/617: stat d7/f5d 0 2024-09-13T21:40:44.817 INFO:tasks.workunit.client.1.smithi116.stdout:5/618: write d7/f25 [1170864,31350] 0 2024-09-13T21:40:44.817 INFO:tasks.workunit.client.1.smithi116.stdout:5/619: mkdir d7/d40/d53/dc8 0 2024-09-13T21:40:44.823 INFO:tasks.workunit.client.1.smithi116.stdout:0/651: dread d2/dc/d12/d28/f9c [0,4194304] 0 2024-09-13T21:40:44.825 INFO:tasks.workunit.client.1.smithi116.stdout:0/652: creat d2/d5/d86/d8a/dd3/fd9 x:0 0 0 2024-09-13T21:40:44.825 INFO:tasks.workunit.client.1.smithi116.stdout:0/653: truncate d2/d5/fcb 4616 0 2024-09-13T21:40:44.825 INFO:tasks.workunit.client.1.smithi116.stdout:5/620: dread d7/f16 [0,4194304] 0 2024-09-13T21:40:44.826 INFO:tasks.workunit.client.1.smithi116.stdout:0/654: creat d2/dc/d12/fda x:0 0 0 2024-09-13T21:40:44.826 INFO:tasks.workunit.client.1.smithi116.stdout:0/655: truncate d2/d5/fb7 711663 0 2024-09-13T21:40:44.828 INFO:tasks.workunit.client.1.smithi116.stdout:5/621: symlink d7/da/d5e/d79/lc9 0 2024-09-13T21:40:44.828 INFO:tasks.workunit.client.1.smithi116.stdout:0/656: rename d2/dc/d12/l2f to d2/d5/dbe/ldb 0 2024-09-13T21:40:44.828 INFO:tasks.workunit.client.1.smithi116.stdout:5/622: dread d7/da/fb4 [0,4194304] 0 2024-09-13T21:40:44.829 INFO:tasks.workunit.client.1.smithi116.stdout:5/623: readlink d7/da/d5e/d79/l9f 0 2024-09-13T21:40:44.838 INFO:tasks.workunit.client.1.smithi116.stdout:0/657: write d2/d5/f16 [1534742,22560] 0 2024-09-13T21:40:44.839 INFO:tasks.workunit.client.1.smithi116.stdout:0/658: mknod d2/d5/d86/d8a/db1/cdc 0 2024-09-13T21:40:44.948 INFO:tasks.workunit.client.1.smithi116.stdout:2/404: sync 2024-09-13T21:40:44.948 INFO:tasks.workunit.client.1.smithi116.stdout:8/511: sync 2024-09-13T21:40:44.948 INFO:tasks.workunit.client.1.smithi116.stdout:7/571: sync 2024-09-13T21:40:44.948 INFO:tasks.workunit.client.1.smithi116.stdout:3/610: sync 2024-09-13T21:40:44.948 INFO:tasks.workunit.client.1.smithi116.stdout:9/354: sync 2024-09-13T21:40:44.948 INFO:tasks.workunit.client.1.smithi116.stdout:2/405: stat d0/d5/f4b 0 2024-09-13T21:40:44.948 INFO:tasks.workunit.client.1.smithi116.stdout:3/611: fsync d3/db/d10/d62/fa3 0 2024-09-13T21:40:44.948 INFO:tasks.workunit.client.1.smithi116.stdout:1/406: sync 2024-09-13T21:40:44.949 INFO:tasks.workunit.client.1.smithi116.stdout:4/518: sync 2024-09-13T21:40:44.949 INFO:tasks.workunit.client.1.smithi116.stdout:6/510: sync 2024-09-13T21:40:44.949 INFO:tasks.workunit.client.1.smithi116.stdout:6/511: fsync d8/d15/f1b 0 2024-09-13T21:40:44.949 INFO:tasks.workunit.client.1.smithi116.stdout:4/519: chown d0/d32/d5d/l8c 81 1 2024-09-13T21:40:44.949 INFO:tasks.workunit.client.1.smithi116.stdout:4/520: stat d0/dd/d6b/d92/d99/d9a 0 2024-09-13T21:40:44.949 INFO:tasks.workunit.client.1.smithi116.stdout:2/406: creat d0/d3a/d82/d62/d1f/d5d/d60/f8a x:0 0 0 2024-09-13T21:40:44.949 INFO:tasks.workunit.client.1.smithi116.stdout:3/612: mknod d3/db/d10/d1c/cd9 0 2024-09-13T21:40:44.950 INFO:tasks.workunit.client.1.smithi116.stdout:1/407: rename d4/d14/d41/f4d to d4/d14/d52/d2f/d5d/d90/f93 0 2024-09-13T21:40:44.950 INFO:tasks.workunit.client.1.smithi116.stdout:1/408: fsync d4/ff 0 2024-09-13T21:40:44.951 INFO:tasks.workunit.client.1.smithi116.stdout:6/512: creat d8/d17/d70/da0/daf/fb1 x:0 0 0 2024-09-13T21:40:44.951 INFO:tasks.workunit.client.1.smithi116.stdout:6/513: fdatasync d8/d10/d24/f29 0 2024-09-13T21:40:44.952 INFO:tasks.workunit.client.1.smithi116.stdout:4/521: unlink d0/dd/f7b 0 2024-09-13T21:40:44.953 INFO:tasks.workunit.client.1.smithi116.stdout:2/407: creat d0/d3a/d82/d62/d75/d77/f8b x:0 0 0 2024-09-13T21:40:44.953 INFO:tasks.workunit.client.1.smithi116.stdout:2/408: write d0/f76 [661511,64040] 0 2024-09-13T21:40:44.953 INFO:tasks.workunit.client.1.smithi116.stdout:2/409: chown d0/c3 33 1 2024-09-13T21:40:44.954 INFO:tasks.workunit.client.1.smithi116.stdout:3/613: mkdir d3/db/d10/d1c/d34/d55/d57/dda 0 2024-09-13T21:40:44.954 INFO:tasks.workunit.client.1.smithi116.stdout:3/614: read d3/db/d10/d1c/d34/d47/f51 [2382081,86296] 0 2024-09-13T21:40:44.956 INFO:tasks.workunit.client.1.smithi116.stdout:1/409: getdents d4/d14 0 2024-09-13T21:40:44.956 INFO:tasks.workunit.client.1.smithi116.stdout:1/410: readlink d4/d14/d2a/l4c 0 2024-09-13T21:40:44.957 INFO:tasks.workunit.client.1.smithi116.stdout:8/512: dread d2/d10/d37/f25 [0,4194304] 0 2024-09-13T21:40:44.959 INFO:tasks.workunit.client.1.smithi116.stdout:6/514: link d8/d10/d33/f50 d8/d17/d70/fb2 0 2024-09-13T21:40:44.959 INFO:tasks.workunit.client.1.smithi116.stdout:6/515: fdatasync d8/d15/f86 0 2024-09-13T21:40:44.960 INFO:tasks.workunit.client.1.smithi116.stdout:6/516: symlink d8/d15/d2e/d9e/lb3 0 2024-09-13T21:40:44.961 INFO:tasks.workunit.client.1.smithi116.stdout:8/513: dread d2/d10/d19/f84 [0,4194304] 0 2024-09-13T21:40:44.961 INFO:tasks.workunit.client.1.smithi116.stdout:7/572: dread d5/d9/db/d21/f63 [0,4194304] 0 2024-09-13T21:40:44.962 INFO:tasks.workunit.client.1.smithi116.stdout:6/517: link d8/cb d8/d17/da6/cb4 0 2024-09-13T21:40:44.963 INFO:tasks.workunit.client.1.smithi116.stdout:8/514: mknod d2/d10/d19/d42/d45/c9d 0 2024-09-13T21:40:44.964 INFO:tasks.workunit.client.1.smithi116.stdout:2/410: write d0/d3a/d82/d62/f7b [2770170,50287] 0 2024-09-13T21:40:44.964 INFO:tasks.workunit.client.1.smithi116.stdout:2/411: truncate d0/d7/f59 4996613 0 2024-09-13T21:40:44.965 INFO:tasks.workunit.client.1.smithi116.stdout:8/515: mkdir d2/d10/d19/d21/d69/d9e 0 2024-09-13T21:40:44.965 INFO:tasks.workunit.client.1.smithi116.stdout:8/516: chown d2/d10/d19 3516 1 2024-09-13T21:40:44.966 INFO:tasks.workunit.client.1.smithi116.stdout:6/518: mkdir d8/db5 0 2024-09-13T21:40:44.966 INFO:tasks.workunit.client.1.smithi116.stdout:1/411: dread d4/f8 [0,4194304] 0 2024-09-13T21:40:44.968 INFO:tasks.workunit.client.1.smithi116.stdout:2/412: rename d0/d5/d2a/l4f to d0/d3a/d82/d62/l8c 0 2024-09-13T21:40:44.968 INFO:tasks.workunit.client.1.smithi116.stdout:2/413: creat d0/d3a/d82/d62/d75/d77/f8d x:0 0 0 2024-09-13T21:40:44.969 INFO:tasks.workunit.client.1.smithi116.stdout:6/519: creat d8/d17/fb6 x:0 0 0 2024-09-13T21:40:44.971 INFO:tasks.workunit.client.1.smithi116.stdout:1/412: creat d4/d14/d52/d2f/d91/f94 x:0 0 0 2024-09-13T21:40:44.973 INFO:tasks.workunit.client.1.smithi116.stdout:2/414: unlink d0/d3a/d82/d62/d1f/c5f 0 2024-09-13T21:40:44.975 INFO:tasks.workunit.client.1.smithi116.stdout:8/517: getdents d2/d10/d19/d21/d22 0 2024-09-13T21:40:44.977 INFO:tasks.workunit.client.1.smithi116.stdout:6/520: rename d8/c36 to d8/d15/d2e/d9e/cb7 0 2024-09-13T21:40:44.978 INFO:tasks.workunit.client.1.smithi116.stdout:6/521: chown d8/fe 1560559832 1 2024-09-13T21:40:44.978 INFO:tasks.workunit.client.1.smithi116.stdout:7/573: write d5/d9/f51 [3193402,37482] 0 2024-09-13T21:40:44.978 INFO:tasks.workunit.client.1.smithi116.stdout:9/355: dwrite d2/d10/f20 [0,4194304] 0 2024-09-13T21:40:44.978 INFO:tasks.workunit.client.1.smithi116.stdout:3/615: dwrite d3/db/f3e [0,4194304] 0 2024-09-13T21:40:44.979 INFO:tasks.workunit.client.1.smithi116.stdout:7/574: chown d5/d9/d27/f8e 496576 1 2024-09-13T21:40:44.979 INFO:tasks.workunit.client.1.smithi116.stdout:1/413: symlink d4/d23/d56/l95 0 2024-09-13T21:40:44.981 INFO:tasks.workunit.client.1.smithi116.stdout:8/518: creat d2/d10/d19/d21/d69/f9f x:0 0 0 2024-09-13T21:40:44.981 INFO:tasks.workunit.client.1.smithi116.stdout:8/519: read d2/d10/d19/d3a/f5f [265022,71642] 0 2024-09-13T21:40:44.981 INFO:tasks.workunit.client.1.smithi116.stdout:8/520: chown d2/d10/d4b 25619 1 2024-09-13T21:40:44.982 INFO:tasks.workunit.client.1.smithi116.stdout:6/522: rename d8/d10/d33/f5c to d8/d15/d2e/d2f/d38/fb8 0 2024-09-13T21:40:44.982 INFO:tasks.workunit.client.1.smithi116.stdout:6/523: creat d8/d10/d33/fb9 x:0 0 0 2024-09-13T21:40:44.982 INFO:tasks.workunit.client.1.smithi116.stdout:6/524: creat d8/d10/d33/fba x:0 0 0 2024-09-13T21:40:44.986 INFO:tasks.workunit.client.1.smithi116.stdout:3/616: symlink d3/db/d10/d1c/ldb 0 2024-09-13T21:40:44.988 INFO:tasks.workunit.client.1.smithi116.stdout:1/414: creat d4/d74/d8d/f96 x:0 0 0 2024-09-13T21:40:44.989 INFO:tasks.workunit.client.1.smithi116.stdout:2/415: rmdir d0/d7/d49 39 2024-09-13T21:40:44.989 INFO:tasks.workunit.client.1.smithi116.stdout:2/416: truncate d0/d7/d49/f80 902154 0 2024-09-13T21:40:44.990 INFO:tasks.workunit.client.1.smithi116.stdout:4/522: dwrite d0/f30 [0,4194304] 0 2024-09-13T21:40:44.991 INFO:tasks.workunit.client.1.smithi116.stdout:8/521: creat d2/d10/d19/d42/d45/d87/fa0 x:0 0 0 2024-09-13T21:40:44.993 INFO:tasks.workunit.client.1.smithi116.stdout:7/575: rename d5/d9/db/lab to d5/d9/d27/d31/d38/d42/lb5 0 2024-09-13T21:40:44.993 INFO:tasks.workunit.client.1.smithi116.stdout:7/576: creat d5/d9/d1c/d22/d24/d3a/fb6 x:0 0 0 2024-09-13T21:40:44.996 INFO:tasks.workunit.client.1.smithi116.stdout:6/525: mkdir d8/d1e/dbb 0 2024-09-13T21:40:44.997 INFO:tasks.workunit.client.1.smithi116.stdout:9/356: rmdir d2/d10/d14/d38/d3a 39 2024-09-13T21:40:44.997 INFO:tasks.workunit.client.1.smithi116.stdout:9/357: chown d2/d10/c39 0 1 2024-09-13T21:40:44.998 INFO:tasks.workunit.client.1.smithi116.stdout:9/358: truncate d2/d10/d14/d38/f6b 968268 0 2024-09-13T21:40:44.998 INFO:tasks.workunit.client.1.smithi116.stdout:4/523: dread d0/fb [0,4194304] 0 2024-09-13T21:40:44.999 INFO:tasks.workunit.client.1.smithi116.stdout:4/524: write d0/dd/d13/f51 [369582,93131] 0 2024-09-13T21:40:44.999 INFO:tasks.workunit.client.1.smithi116.stdout:3/617: creat d3/db/d10/d1c/fdc x:0 0 0 2024-09-13T21:40:44.999 INFO:tasks.workunit.client.1.smithi116.stdout:3/618: chown d3/l6d 3 1 2024-09-13T21:40:44.999 INFO:tasks.workunit.client.1.smithi116.stdout:3/619: dread - d3/db/d10/d1d/fce zero size 2024-09-13T21:40:45.000 INFO:tasks.workunit.client.1.smithi116.stdout:3/620: dread d3/db/f68 [0,4194304] 0 2024-09-13T21:40:45.000 INFO:tasks.workunit.client.1.smithi116.stdout:2/417: creat d0/d7/d2b/d61/f8e x:0 0 0 2024-09-13T21:40:45.004 INFO:tasks.workunit.client.1.smithi116.stdout:1/415: rename d4/d14/d52/f38 to d4/d23/d57/f97 0 2024-09-13T21:40:45.004 INFO:tasks.workunit.client.1.smithi116.stdout:1/416: dread - d4/d23/f27 zero size 2024-09-13T21:40:45.006 INFO:tasks.workunit.client.1.smithi116.stdout:7/577: mknod d5/cb7 0 2024-09-13T21:40:45.007 INFO:tasks.workunit.client.1.smithi116.stdout:9/359: mkdir d2/d10/d6e 0 2024-09-13T21:40:45.007 INFO:tasks.workunit.client.1.smithi116.stdout:9/360: dread - d2/d10/d14/f59 zero size 2024-09-13T21:40:45.008 INFO:tasks.workunit.client.1.smithi116.stdout:3/621: mknod d3/db/d10/d1c/d34/d55/d57/dc6/cdd 0 2024-09-13T21:40:45.009 INFO:tasks.workunit.client.1.smithi116.stdout:2/418: read d0/d7/d2d/f6a [3614913,70207] 0 2024-09-13T21:40:45.010 INFO:tasks.workunit.client.1.smithi116.stdout:2/419: fsync d0/d3a/d82/f42 0 2024-09-13T21:40:45.012 INFO:tasks.workunit.client.1.smithi116.stdout:1/417: dread d4/d23/d57/f97 [0,4194304] 0 2024-09-13T21:40:45.012 INFO:tasks.workunit.client.1.smithi116.stdout:1/418: dread - d4/d74/d8d/f76 zero size 2024-09-13T21:40:45.013 INFO:tasks.workunit.client.1.smithi116.stdout:1/419: creat d4/d14/d41/f98 x:0 0 0 2024-09-13T21:40:45.015 INFO:tasks.workunit.client.1.smithi116.stdout:8/522: rmdir d2/d10/d19 39 2024-09-13T21:40:45.017 INFO:tasks.workunit.client.1.smithi116.stdout:6/526: rename d8/d17/l5e to d8/d1e/dbb/lbc 0 2024-09-13T21:40:45.018 INFO:tasks.workunit.client.1.smithi116.stdout:7/578: symlink d5/d9/d1c/d22/d24/lb8 0 2024-09-13T21:40:45.019 INFO:tasks.workunit.client.1.smithi116.stdout:9/361: mknod d2/d10/c6f 0 2024-09-13T21:40:45.020 INFO:tasks.workunit.client.1.smithi116.stdout:3/622: symlink d3/db/d10/d1d/d2f/lde 0 2024-09-13T21:40:45.020 INFO:tasks.workunit.client.1.smithi116.stdout:3/623: chown d3/db/d26 404326380 1 2024-09-13T21:40:45.021 INFO:tasks.workunit.client.1.smithi116.stdout:1/420: creat d4/d14/d52/f99 x:0 0 0 2024-09-13T21:40:45.022 INFO:tasks.workunit.client.1.smithi116.stdout:8/523: creat d2/d10/d75/fa1 x:0 0 0 2024-09-13T21:40:45.023 INFO:tasks.workunit.client.1.smithi116.stdout:8/524: readlink d2/d27/d66/d7c/l9a 0 2024-09-13T21:40:45.023 INFO:tasks.workunit.client.1.smithi116.stdout:8/525: write d2/d10/d19/d21/f2d [223091,93043] 0 2024-09-13T21:40:45.023 INFO:tasks.workunit.client.1.smithi116.stdout:8/526: readlink d2/d10/d19/l35 0 2024-09-13T21:40:45.023 INFO:tasks.workunit.client.1.smithi116.stdout:8/527: truncate d2/d10/d4b/d6e/f9c 914142 0 2024-09-13T21:40:45.024 INFO:tasks.workunit.client.1.smithi116.stdout:8/528: write d2/d10/d19/d3a/f5f [2924804,111127] 0 2024-09-13T21:40:45.024 INFO:tasks.workunit.client.1.smithi116.stdout:8/529: dread d2/d10/d4b/d6e/f9c [0,4194304] 0 2024-09-13T21:40:45.025 INFO:tasks.workunit.client.1.smithi116.stdout:2/420: rename d0/d7/l64 to d0/d7/d2d/l8f 0 2024-09-13T21:40:45.025 INFO:tasks.workunit.client.1.smithi116.stdout:6/527: symlink d8/d10/d24/lbd 0 2024-09-13T21:40:45.025 INFO:tasks.workunit.client.1.smithi116.stdout:7/579: creat d5/d9/db/fb9 x:0 0 0 2024-09-13T21:40:45.027 INFO:tasks.workunit.client.1.smithi116.stdout:3/624: rename d3/db/d3d/d40/f4c to d3/dd3/fdf 0 2024-09-13T21:40:45.029 INFO:tasks.workunit.client.1.smithi116.stdout:6/528: unlink d8/d15/d2e/d2f/d38/l88 0 2024-09-13T21:40:45.029 INFO:tasks.workunit.client.1.smithi116.stdout:9/362: rmdir d2/d10/d4c 39 2024-09-13T21:40:45.033 INFO:tasks.workunit.client.1.smithi116.stdout:2/421: rename d0/d7/d2b/d61/f8e to d0/d7/d49/f90 0 2024-09-13T21:40:45.034 INFO:tasks.workunit.client.1.smithi116.stdout:2/422: write d0/d3a/d82/f71 [442070,96006] 0 2024-09-13T21:40:45.034 INFO:tasks.workunit.client.1.smithi116.stdout:2/423: fsync d0/d7/f6e 0 2024-09-13T21:40:45.034 INFO:tasks.workunit.client.1.smithi116.stdout:3/625: creat d3/db/d3d/d40/fe0 x:0 0 0 2024-09-13T21:40:45.036 INFO:tasks.workunit.client.1.smithi116.stdout:6/529: mknod d8/d10/d24/dab/cbe 0 2024-09-13T21:40:45.036 INFO:tasks.workunit.client.1.smithi116.stdout:6/530: write d8/d15/d2e/f3f [4503394,86102] 0 2024-09-13T21:40:45.038 INFO:tasks.workunit.client.1.smithi116.stdout:3/626: unlink d3/db/d10/d62/fc5 0 2024-09-13T21:40:45.046 INFO:tasks.workunit.client.1.smithi116.stdout:2/424: dread d0/d5/d2a/f3b [0,4194304] 0 2024-09-13T21:40:45.051 INFO:tasks.workunit.client.1.smithi116.stdout:2/425: dread d0/f76 [0,4194304] 0 2024-09-13T21:40:45.051 INFO:tasks.workunit.client.1.smithi116.stdout:2/426: fsync d0/d3a/d82/d62/f7b 0 2024-09-13T21:40:45.052 INFO:tasks.workunit.client.1.smithi116.stdout:3/627: dread d3/db/ff [0,4194304] 0 2024-09-13T21:40:45.053 INFO:tasks.workunit.client.1.smithi116.stdout:3/628: truncate d3/f11 5623823 0 2024-09-13T21:40:45.053 INFO:tasks.workunit.client.1.smithi116.stdout:3/629: creat d3/db/d10/d1d/d5f/fe1 x:0 0 0 2024-09-13T21:40:45.053 INFO:tasks.workunit.client.1.smithi116.stdout:3/630: readlink d3/db/d10/d1d/d5f/l6a 0 2024-09-13T21:40:45.062 INFO:tasks.workunit.client.1.smithi116.stdout:1/421: dwrite d4/d14/d52/f4a [0,4194304] 0 2024-09-13T21:40:45.064 INFO:tasks.workunit.client.1.smithi116.stdout:6/531: dwrite d8/d1e/f28 [0,4194304] 0 2024-09-13T21:40:45.064 INFO:tasks.workunit.client.1.smithi116.stdout:6/532: stat f3 0 2024-09-13T21:40:45.064 INFO:tasks.workunit.client.1.smithi116.stdout:8/530: dwrite d2/d10/d19/d21/f47 [0,4194304] 0 2024-09-13T21:40:45.064 INFO:tasks.workunit.client.1.smithi116.stdout:7/580: dwrite d5/d9/db/d21/d6e/d6f/f88 [0,4194304] 0 2024-09-13T21:40:45.065 INFO:tasks.workunit.client.1.smithi116.stdout:6/533: rename d8/d15/f32 to d8/d10/d78/fbf 0 2024-09-13T21:40:45.069 INFO:tasks.workunit.client.1.smithi116.stdout:2/427: rmdir d0/d7/d2b 39 2024-09-13T21:40:45.071 INFO:tasks.workunit.client.1.smithi116.stdout:7/581: rename d5/f16 to d5/d9/d1c/d22/dae/fba 0 2024-09-13T21:40:45.071 INFO:tasks.workunit.client.1.smithi116.stdout:7/582: dread - d5/d9/d1c/d22/d24/d3a/fb6 zero size 2024-09-13T21:40:45.072 INFO:tasks.workunit.client.1.smithi116.stdout:6/534: link d8/d17/d70/fb2 d8/d10/d24/dab/fc0 0 2024-09-13T21:40:45.072 INFO:tasks.workunit.client.1.smithi116.stdout:3/631: dwrite d3/db/d20/f23 [0,4194304] 0 2024-09-13T21:40:45.073 INFO:tasks.workunit.client.1.smithi116.stdout:1/422: dread d4/d14/d2a/f88 [0,4194304] 0 2024-09-13T21:40:45.075 INFO:tasks.workunit.client.1.smithi116.stdout:8/531: dread d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:45.076 INFO:tasks.workunit.client.1.smithi116.stdout:6/535: rename d8/f47 to d8/d17/d70/da0/daf/fc1 0 2024-09-13T21:40:45.076 INFO:tasks.workunit.client.1.smithi116.stdout:6/536: chown d8/d15/fa2 15 1 2024-09-13T21:40:45.076 INFO:tasks.workunit.client.1.smithi116.stdout:3/632: truncate d3/db/ff 2325463 0 2024-09-13T21:40:45.077 INFO:tasks.workunit.client.1.smithi116.stdout:2/428: getdents d0 0 2024-09-13T21:40:45.077 INFO:tasks.workunit.client.1.smithi116.stdout:2/429: stat d0/d3a/d82/d62/d1f 0 2024-09-13T21:40:45.078 INFO:tasks.workunit.client.1.smithi116.stdout:2/430: chown d0/d5/d8/c35 67445399 1 2024-09-13T21:40:45.080 INFO:tasks.workunit.client.1.smithi116.stdout:3/633: truncate d3/db/d20/d50/f84 3008594 0 2024-09-13T21:40:45.080 INFO:tasks.workunit.client.1.smithi116.stdout:3/634: chown d3/db/d10/d1c/d34/d47 8415 1 2024-09-13T21:40:45.081 INFO:tasks.workunit.client.1.smithi116.stdout:2/431: dread d0/d3a/d82/f52 [0,4194304] 0 2024-09-13T21:40:45.081 INFO:tasks.workunit.client.1.smithi116.stdout:2/432: truncate d0/d7/f84 436047 0 2024-09-13T21:40:45.081 INFO:tasks.workunit.client.1.smithi116.stdout:2/433: creat d0/d5/d8/d7a/f91 x:0 0 0 2024-09-13T21:40:45.081 INFO:tasks.workunit.client.1.smithi116.stdout:2/434: fsync d0/f63 0 2024-09-13T21:40:45.081 INFO:tasks.workunit.client.1.smithi116.stdout:6/537: dread d8/d15/f22 [4194304,4194304] 0 2024-09-13T21:40:45.081 INFO:tasks.workunit.client.1.smithi116.stdout:6/538: chown d8/d17/f19 6 1 2024-09-13T21:40:45.081 INFO:tasks.workunit.client.1.smithi116.stdout:6/539: creat d8/d15/d2e/d2f/d38/d9c/fc2 x:0 0 0 2024-09-13T21:40:45.081 INFO:tasks.workunit.client.1.smithi116.stdout:6/540: write d8/d15/f92 [463611,85298] 0 2024-09-13T21:40:45.082 INFO:tasks.workunit.client.1.smithi116.stdout:6/541: write d8/d10/d33/f4a [2987666,95047] 0 2024-09-13T21:40:45.082 INFO:tasks.workunit.client.1.smithi116.stdout:3/635: symlink d3/db/d20/d50/le2 0 2024-09-13T21:40:45.082 INFO:tasks.workunit.client.1.smithi116.stdout:3/636: creat d3/db/d10/d1c/fe3 x:0 0 0 2024-09-13T21:40:45.082 INFO:tasks.workunit.client.1.smithi116.stdout:1/423: read f1 [59964,107853] 0 2024-09-13T21:40:45.082 INFO:tasks.workunit.client.1.smithi116.stdout:1/424: creat d4/d74/d8d/f9a x:0 0 0 2024-09-13T21:40:45.083 INFO:tasks.workunit.client.1.smithi116.stdout:2/435: link d0/d3a/d82/d62/d1f/l70 d0/d3a/d82/d62/d1f/d73/l92 0 2024-09-13T21:40:45.083 INFO:tasks.workunit.client.1.smithi116.stdout:2/436: read d0/d7/d2d/f56 [12670,89928] 0 2024-09-13T21:40:45.087 INFO:tasks.workunit.client.1.smithi116.stdout:3/637: link d3/db/fac d3/db/d10/d1c/d63/fe4 0 2024-09-13T21:40:45.090 INFO:tasks.workunit.client.1.smithi116.stdout:1/425: symlink d4/d14/l9b 0 2024-09-13T21:40:45.090 INFO:tasks.workunit.client.1.smithi116.stdout:1/426: write d4/d23/d57/f97 [4658648,26384] 0 2024-09-13T21:40:45.090 INFO:tasks.workunit.client.1.smithi116.stdout:1/427: write d4/d74/f80 [386781,57159] 0 2024-09-13T21:40:45.091 INFO:tasks.workunit.client.1.smithi116.stdout:1/428: dread d4/d23/f7c [0,4194304] 0 2024-09-13T21:40:45.091 INFO:tasks.workunit.client.1.smithi116.stdout:1/429: write d4/d23/f27 [45967,30501] 0 2024-09-13T21:40:45.091 INFO:tasks.workunit.client.1.smithi116.stdout:3/638: mknod d3/db/d20/d50/ce5 0 2024-09-13T21:40:45.092 INFO:tasks.workunit.client.1.smithi116.stdout:3/639: creat d3/db/d10/d1c/d34/d55/d57/dc6/fe6 x:0 0 0 2024-09-13T21:40:45.097 INFO:tasks.workunit.client.1.smithi116.stdout:2/437: dread d0/d5/d8/f16 [0,4194304] 0 2024-09-13T21:40:45.097 INFO:tasks.workunit.client.1.smithi116.stdout:3/640: dread d3/db/d10/d1d/d5f/d6f/f80 [0,4194304] 0 2024-09-13T21:40:45.099 INFO:tasks.workunit.client.1.smithi116.stdout:3/641: dread d3/db/d10/d1c/d34/d55/fa4 [0,4194304] 0 2024-09-13T21:40:45.100 INFO:tasks.workunit.client.1.smithi116.stdout:3/642: dread - d3/db/d10/d1c/d34/d55/d57/dc6/fe6 zero size 2024-09-13T21:40:45.101 INFO:tasks.workunit.client.1.smithi116.stdout:2/438: dread d0/f76 [0,4194304] 0 2024-09-13T21:40:45.103 INFO:tasks.workunit.client.1.smithi116.stdout:2/439: getdents d0/d3a/d82/d62/d75/d77 0 2024-09-13T21:40:45.103 INFO:tasks.workunit.client.1.smithi116.stdout:2/440: fdatasync d0/d5/d2a/f3b 0 2024-09-13T21:40:45.103 INFO:tasks.workunit.client.1.smithi116.stdout:2/441: readlink d0/d7/d2b/l4d 0 2024-09-13T21:40:45.110 INFO:tasks.workunit.client.1.smithi116.stdout:2/442: dread d0/d3a/d82/f71 [0,4194304] 0 2024-09-13T21:40:45.110 INFO:tasks.workunit.client.1.smithi116.stdout:2/443: fdatasync d0/d3a/d82/f42 0 2024-09-13T21:40:45.130 INFO:tasks.workunit.client.1.smithi116.stdout:1/430: dwrite d4/d14/d41/f98 [0,4194304] 0 2024-09-13T21:40:45.130 INFO:tasks.workunit.client.1.smithi116.stdout:6/542: dwrite d8/d10/f44 [0,4194304] 0 2024-09-13T21:40:45.130 INFO:tasks.workunit.client.1.smithi116.stdout:6/543: fdatasync d8/d10/f7b 0 2024-09-13T21:40:45.130 INFO:tasks.workunit.client.1.smithi116.stdout:6/544: write d8/d17/f71 [133732,24371] 0 2024-09-13T21:40:45.133 INFO:tasks.workunit.client.1.smithi116.stdout:3/643: dwrite d3/db/d10/d1d/d5f/fd8 [0,4194304] 0 2024-09-13T21:40:45.135 INFO:tasks.workunit.client.1.smithi116.stdout:2/444: dwrite d0/d3a/d82/d62/f74 [0,4194304] 0 2024-09-13T21:40:45.135 INFO:tasks.workunit.client.1.smithi116.stdout:2/445: fdatasync d0/d3a/d82/d62/d75/d77/f8d 0 2024-09-13T21:40:45.135 INFO:tasks.workunit.client.1.smithi116.stdout:2/446: write d0/d7/f6e [616204,45569] 0 2024-09-13T21:40:45.136 INFO:tasks.workunit.client.1.smithi116.stdout:3/644: dread d3/db/d10/d1d/d2f/d61/f2a [0,4194304] 0 2024-09-13T21:40:45.137 INFO:tasks.workunit.client.1.smithi116.stdout:6/545: mknod d8/d1e/dbb/cc3 0 2024-09-13T21:40:45.139 INFO:tasks.workunit.client.1.smithi116.stdout:2/447: mkdir d0/d7/d49/d93 0 2024-09-13T21:40:45.139 INFO:tasks.workunit.client.1.smithi116.stdout:2/448: dread - d0/d7/d2b/f78 zero size 2024-09-13T21:40:45.141 INFO:tasks.workunit.client.1.smithi116.stdout:1/431: rmdir d4/d14/d52/d2f 39 2024-09-13T21:40:45.143 INFO:tasks.workunit.client.1.smithi116.stdout:6/546: rename f5 to d8/d17/fc4 0 2024-09-13T21:40:45.144 INFO:tasks.workunit.client.1.smithi116.stdout:1/432: creat d4/d14/f9c x:0 0 0 2024-09-13T21:40:45.145 INFO:tasks.workunit.client.1.smithi116.stdout:3/645: getdents d3/db/d10/d1c/d34/d55/d57 0 2024-09-13T21:40:45.145 INFO:tasks.workunit.client.1.smithi116.stdout:3/646: dread - d3/db/d10/d1c/d34/d55/d96/fb6 zero size 2024-09-13T21:40:45.147 INFO:tasks.workunit.client.1.smithi116.stdout:2/449: rename d0/d7/d2d/c44 to d0/d3a/d82/d62/d1f/d5d/c94 0 2024-09-13T21:40:45.147 INFO:tasks.workunit.client.1.smithi116.stdout:2/450: fsync d0/d7/f6e 0 2024-09-13T21:40:45.148 INFO:tasks.workunit.client.1.smithi116.stdout:2/451: readlink d0/d3a/l55 0 2024-09-13T21:40:45.148 INFO:tasks.workunit.client.1.smithi116.stdout:2/452: creat d0/d3a/d82/d62/d1f/d5d/d60/f95 x:0 0 0 2024-09-13T21:40:45.149 INFO:tasks.workunit.client.1.smithi116.stdout:3/647: symlink d3/db/d10/d1c/d34/d55/d57/dc6/le7 0 2024-09-13T21:40:45.149 INFO:tasks.workunit.client.1.smithi116.stdout:3/648: write d3/fc7 [491363,122969] 0 2024-09-13T21:40:45.152 INFO:tasks.workunit.client.1.smithi116.stdout:3/649: symlink d3/db/d10/d1d/d5f/d6f/le8 0 2024-09-13T21:40:45.153 INFO:tasks.workunit.client.1.smithi116.stdout:3/650: dread d3/db/f68 [0,4194304] 0 2024-09-13T21:40:45.154 INFO:tasks.workunit.client.1.smithi116.stdout:3/651: mknod d3/db/d10/d29/ce9 0 2024-09-13T21:40:45.156 INFO:tasks.workunit.client.1.smithi116.stdout:3/652: mknod d3/db/d20/d86/da6/cea 0 2024-09-13T21:40:45.156 INFO:tasks.workunit.client.1.smithi116.stdout:3/653: stat d3/db/d10/d1c/d34/d55/d96/fd4 0 2024-09-13T21:40:45.156 INFO:tasks.workunit.client.1.smithi116.stdout:3/654: write d3/db/d10/d29/fc3 [480582,8370] 0 2024-09-13T21:40:45.157 INFO:tasks.workunit.client.1.smithi116.stdout:3/655: mknod d3/db/d20/d86/ceb 0 2024-09-13T21:40:45.157 INFO:tasks.workunit.client.1.smithi116.stdout:3/656: creat d3/db/d10/d1c/fec x:0 0 0 2024-09-13T21:40:45.160 INFO:tasks.workunit.client.1.smithi116.stdout:3/657: creat d3/db/d10/d1d/d5f/d6f/d71/fed x:0 0 0 2024-09-13T21:40:45.161 INFO:tasks.workunit.client.1.smithi116.stdout:3/658: mkdir d3/db/d10/d1c/d34/d55/d96/dee 0 2024-09-13T21:40:45.162 INFO:tasks.workunit.client.1.smithi116.stdout:3/659: rename d3/db/d10/d1c/d34/d55/d57/db1/fbe to d3/db/d10/d1c/d34/d55/d57/db1/fef 0 2024-09-13T21:40:45.173 INFO:tasks.workunit.client.1.smithi116.stdout:2/453: dwrite d0/d3a/d82/d62/d1f/d5d/d60/f95 [0,4194304] 0 2024-09-13T21:40:45.173 INFO:tasks.workunit.client.1.smithi116.stdout:1/433: dwrite d4/f20 [0,4194304] 0 2024-09-13T21:40:45.173 INFO:tasks.workunit.client.1.smithi116.stdout:5/624: sync 2024-09-13T21:40:45.173 INFO:tasks.workunit.client.1.smithi116.stdout:0/659: sync 2024-09-13T21:40:45.173 INFO:tasks.workunit.client.1.smithi116.stdout:5/625: chown d7/d40/d53/f6e 7281 1 2024-09-13T21:40:45.175 INFO:tasks.workunit.client.1.smithi116.stdout:3/660: write d3/db/f3f [1726459,103713] 0 2024-09-13T21:40:45.176 INFO:tasks.workunit.client.1.smithi116.stdout:2/454: rename d0/c2 to d0/d3a/c96 0 2024-09-13T21:40:45.176 INFO:tasks.workunit.client.1.smithi116.stdout:2/455: read d0/d7/f24 [2752893,127701] 0 2024-09-13T21:40:45.177 INFO:tasks.workunit.client.1.smithi116.stdout:1/434: symlink d4/d14/d52/d2f/d5d/l9d 0 2024-09-13T21:40:45.178 INFO:tasks.workunit.client.1.smithi116.stdout:0/660: creat d2/dc/d47/d63/d9f/dad/fdd x:0 0 0 2024-09-13T21:40:45.181 INFO:tasks.workunit.client.1.smithi116.stdout:3/661: getdents d3/db/d10/d1c/d34/d55 0 2024-09-13T21:40:45.184 INFO:tasks.workunit.client.1.smithi116.stdout:5/626: rename d7/d40/f75 to d7/da/d5e/d65/d6a/fca 0 2024-09-13T21:40:45.186 INFO:tasks.workunit.client.1.smithi116.stdout:2/456: symlink d0/d5/d2a/l97 0 2024-09-13T21:40:45.186 INFO:tasks.workunit.client.1.smithi116.stdout:2/457: chown d0/d7/d2b/l4c 75 1 2024-09-13T21:40:45.188 INFO:tasks.workunit.client.1.smithi116.stdout:0/661: unlink d2/dc/d12/d51/fb2 0 2024-09-13T21:40:45.188 INFO:tasks.workunit.client.1.smithi116.stdout:0/662: dread - d2/dc/d12/fda zero size 2024-09-13T21:40:45.189 INFO:tasks.workunit.client.1.smithi116.stdout:3/662: truncate d3/db/d10/d1c/d34/d47/f51 3857865 0 2024-09-13T21:40:45.190 INFO:tasks.workunit.client.1.smithi116.stdout:2/458: creat d0/d3a/d82/d62/f98 x:0 0 0 2024-09-13T21:40:45.191 INFO:tasks.workunit.client.1.smithi116.stdout:0/663: symlink d2/d5/d86/lde 0 2024-09-13T21:40:45.191 INFO:tasks.workunit.client.1.smithi116.stdout:0/664: read d2/dc/f3d [2629606,13052] 0 2024-09-13T21:40:45.191 INFO:tasks.workunit.client.1.smithi116.stdout:0/665: chown d2/dc/d47/d63/la8 13881230 1 2024-09-13T21:40:45.194 INFO:tasks.workunit.client.1.smithi116.stdout:2/459: creat d0/d3a/d82/d62/d75/d77/f99 x:0 0 0 2024-09-13T21:40:45.196 INFO:tasks.workunit.client.1.smithi116.stdout:1/435: dwrite d4/d14/d52/d2f/d5c/f8c [0,4194304] 0 2024-09-13T21:40:45.196 INFO:tasks.workunit.client.1.smithi116.stdout:1/436: write d4/d14/f24 [51937,124998] 0 2024-09-13T21:40:45.203 INFO:tasks.workunit.client.1.smithi116.stdout:2/460: symlink d0/d3a/d82/d68/l9a 0 2024-09-13T21:40:45.208 INFO:tasks.workunit.client.1.smithi116.stdout:2/461: creat d0/d3a/f9b x:0 0 0 2024-09-13T21:40:45.208 INFO:tasks.workunit.client.1.smithi116.stdout:2/462: truncate d0/d7/d2b/f3f 4991692 0 2024-09-13T21:40:45.208 INFO:tasks.workunit.client.1.smithi116.stdout:2/463: truncate d0/d3a/d82/d62/f4a 4421259 0 2024-09-13T21:40:45.210 INFO:tasks.workunit.client.1.smithi116.stdout:2/464: creat d0/d3a/d82/d62/d1f/d5d/d89/f9c x:0 0 0 2024-09-13T21:40:45.214 INFO:tasks.workunit.client.1.smithi116.stdout:5/627: dwrite d7/f5d [0,4194304] 0 2024-09-13T21:40:45.214 INFO:tasks.workunit.client.1.smithi116.stdout:5/628: fsync d7/d1d/f29 0 2024-09-13T21:40:45.214 INFO:tasks.workunit.client.1.smithi116.stdout:5/629: readlink d7/d1d/d46/d5c/l73 0 2024-09-13T21:40:45.214 INFO:tasks.workunit.client.1.smithi116.stdout:5/630: rmdir d7/d9a 39 2024-09-13T21:40:45.214 INFO:tasks.workunit.client.1.smithi116.stdout:5/631: write d7/d1d/d64/d87/f98 [2430572,27075] 0 2024-09-13T21:40:45.216 INFO:tasks.workunit.client.1.smithi116.stdout:5/632: mkdir d7/da/d5e/d79/dcb 0 2024-09-13T21:40:45.219 INFO:tasks.workunit.client.1.smithi116.stdout:5/633: dread d7/da/d5e/d65/fa4 [0,4194304] 0 2024-09-13T21:40:45.220 INFO:tasks.workunit.client.1.smithi116.stdout:5/634: mkdir d7/d1d/d46/d5c/dcc 0 2024-09-13T21:40:45.221 INFO:tasks.workunit.client.1.smithi116.stdout:5/635: creat d7/da/d5e/d79/dcb/fcd x:0 0 0 2024-09-13T21:40:45.224 INFO:tasks.workunit.client.1.smithi116.stdout:3/663: dwrite d3/db/d10/d1c/d63/f64 [0,4194304] 0 2024-09-13T21:40:45.225 INFO:tasks.workunit.client.1.smithi116.stdout:0/666: dwrite d2/d5/fb7 [0,4194304] 0 2024-09-13T21:40:45.229 INFO:tasks.workunit.client.1.smithi116.stdout:5/636: dread d7/da/f27 [0,4194304] 0 2024-09-13T21:40:45.229 INFO:tasks.workunit.client.1.smithi116.stdout:1/437: dwrite d4/d14/d52/d2f/d5c/f8c [0,4194304] 0 2024-09-13T21:40:45.229 INFO:tasks.workunit.client.1.smithi116.stdout:1/438: dread - d4/d74/d8d/f96 zero size 2024-09-13T21:40:45.229 INFO:tasks.workunit.client.1.smithi116.stdout:5/637: write d7/da/f52 [4635054,86824] 0 2024-09-13T21:40:45.229 INFO:tasks.workunit.client.1.smithi116.stdout:1/439: write d4/d14/d52/d2f/f4b [31888,118529] 0 2024-09-13T21:40:45.229 INFO:tasks.workunit.client.1.smithi116.stdout:5/638: dread - d7/d1d/d46/fc1 zero size 2024-09-13T21:40:45.229 INFO:tasks.workunit.client.1.smithi116.stdout:1/440: dread - d4/d14/d52/d2f/f6d zero size 2024-09-13T21:40:45.229 INFO:tasks.workunit.client.1.smithi116.stdout:1/441: truncate d4/d14/d2a/f88 4803497 0 2024-09-13T21:40:45.231 INFO:tasks.workunit.client.1.smithi116.stdout:0/667: creat d2/dc/fdf x:0 0 0 2024-09-13T21:40:45.233 INFO:tasks.workunit.client.1.smithi116.stdout:5/639: symlink d7/d1d/d46/d85/lce 0 2024-09-13T21:40:45.236 INFO:tasks.workunit.client.1.smithi116.stdout:0/668: rename d2/f38 to d2/d5/fe0 0 2024-09-13T21:40:45.236 INFO:tasks.workunit.client.1.smithi116.stdout:0/669: creat d2/dc/d12/d28/fe1 x:0 0 0 2024-09-13T21:40:45.236 INFO:tasks.workunit.client.1.smithi116.stdout:0/670: write d2/d5/f16 [187300,23860] 0 2024-09-13T21:40:45.236 INFO:tasks.workunit.client.1.smithi116.stdout:0/671: chown d2/d5/la9 0 1 2024-09-13T21:40:45.237 INFO:tasks.workunit.client.1.smithi116.stdout:5/640: link d7/da/d5e/f7a d7/d40/fcf 0 2024-09-13T21:40:45.241 INFO:tasks.workunit.client.1.smithi116.stdout:5/641: symlink d7/d1d/d46/d5c/dcc/ld0 0 2024-09-13T21:40:45.242 INFO:tasks.workunit.client.1.smithi116.stdout:5/642: creat d7/da/d5e/fd1 x:0 0 0 2024-09-13T21:40:45.243 INFO:tasks.workunit.client.1.smithi116.stdout:5/643: readlink d7/l2b 0 2024-09-13T21:40:45.245 INFO:tasks.workunit.client.1.smithi116.stdout:3/664: dwrite d3/db/d10/d1c/d34/d47/f51 [0,4194304] 0 2024-09-13T21:40:45.245 INFO:tasks.workunit.client.1.smithi116.stdout:3/665: write d3/db/d20/d50/f84 [3837222,83535] 0 2024-09-13T21:40:45.245 INFO:tasks.workunit.client.1.smithi116.stdout:3/666: truncate d3/db/f79 122518 0 2024-09-13T21:40:45.245 INFO:tasks.workunit.client.1.smithi116.stdout:5/644: getdents d7/da/d5e/d65/d6f 0 2024-09-13T21:40:45.245 INFO:tasks.workunit.client.1.smithi116.stdout:5/645: fdatasync d7/d1d/d46/f8b 0 2024-09-13T21:40:45.246 INFO:tasks.workunit.client.1.smithi116.stdout:3/667: mknod d3/db/d10/d62/da2/cf0 0 2024-09-13T21:40:45.247 INFO:tasks.workunit.client.1.smithi116.stdout:3/668: chown d3/db/d3d/cbb 447 1 2024-09-13T21:40:45.247 INFO:tasks.workunit.client.1.smithi116.stdout:3/669: creat d3/db/d20/ff1 x:0 0 0 2024-09-13T21:40:45.247 INFO:tasks.workunit.client.1.smithi116.stdout:3/670: truncate d3/db/d3d/f91 538547 0 2024-09-13T21:40:45.247 INFO:tasks.workunit.client.1.smithi116.stdout:3/671: write d3/db/d3d/d40/f48 [1195266,113976] 0 2024-09-13T21:40:45.247 INFO:tasks.workunit.client.1.smithi116.stdout:3/672: read - d3/db/d20/ff1 zero size 2024-09-13T21:40:45.247 INFO:tasks.workunit.client.1.smithi116.stdout:3/673: write d3/db/d10/d62/fa3 [925140,8104] 0 2024-09-13T21:40:45.247 INFO:tasks.workunit.client.1.smithi116.stdout:3/674: chown d3/db/d10/d1c/d34/d55/d96/fd4 0 1 2024-09-13T21:40:45.247 INFO:tasks.workunit.client.1.smithi116.stdout:3/675: dread - d3/db/d10/d1d/d5f/d6f/fb9 zero size 2024-09-13T21:40:45.248 INFO:tasks.workunit.client.1.smithi116.stdout:5/646: link d7/d1d/f20 d7/d1d/d46/d85/fd2 0 2024-09-13T21:40:45.248 INFO:tasks.workunit.client.1.smithi116.stdout:5/647: write d7/da/d5e/fd1 [6193,87188] 0 2024-09-13T21:40:45.248 INFO:tasks.workunit.client.1.smithi116.stdout:5/648: readlink d7/d40/d80/l97 0 2024-09-13T21:40:45.250 INFO:tasks.workunit.client.1.smithi116.stdout:3/676: rmdir d3/dd3 39 2024-09-13T21:40:45.256 INFO:tasks.workunit.client.1.smithi116.stdout:0/672: dwrite d2/dc/d12/d51/f91 [0,4194304] 0 2024-09-13T21:40:45.258 INFO:tasks.workunit.client.1.smithi116.stdout:0/673: mknod d2/dc/d12/d51/db8/ce2 0 2024-09-13T21:40:45.258 INFO:tasks.workunit.client.1.smithi116.stdout:0/674: read - d2/fd1 zero size 2024-09-13T21:40:45.259 INFO:tasks.workunit.client.1.smithi116.stdout:0/675: mkdir d2/dc/d12/d28/d57/de3 0 2024-09-13T21:40:45.259 INFO:tasks.workunit.client.1.smithi116.stdout:0/676: creat d2/dc/d12/d28/d57/d65/fe4 x:0 0 0 2024-09-13T21:40:45.260 INFO:tasks.workunit.client.1.smithi116.stdout:5/649: dread d7/d1d/f45 [0,4194304] 0 2024-09-13T21:40:45.261 INFO:tasks.workunit.client.1.smithi116.stdout:5/650: creat d7/d1d/dbb/fd3 x:0 0 0 2024-09-13T21:40:45.261 INFO:tasks.workunit.client.1.smithi116.stdout:5/651: write d7/d1d/d64/fab [955059,5127] 0 2024-09-13T21:40:45.265 INFO:tasks.workunit.client.1.smithi116.stdout:3/677: dwrite d3/db/d10/d1d/f60 [0,4194304] 0 2024-09-13T21:40:45.265 INFO:tasks.workunit.client.1.smithi116.stdout:3/678: chown d3/db/d20/d50/ca5 4069140 1 2024-09-13T21:40:45.267 INFO:tasks.workunit.client.1.smithi116.stdout:3/679: symlink d3/db/d10/d1c/d34/lf2 0 2024-09-13T21:40:45.273 INFO:tasks.workunit.client.1.smithi116.stdout:5/652: rename d7/da to d7/d1d/d46/dd4 0 2024-09-13T21:40:45.273 INFO:tasks.workunit.client.1.smithi116.stdout:5/653: chown d7/d40/d90/fc3 53 1 2024-09-13T21:40:45.282 INFO:tasks.workunit.client.1.smithi116.stdout:3/680: dwrite d3/db/d10/d1d/d2f/f38 [0,4194304] 0 2024-09-13T21:40:45.282 INFO:tasks.workunit.client.1.smithi116.stdout:3/681: chown d3/db/d10/d1c/ldb 30 1 2024-09-13T21:40:45.287 INFO:tasks.workunit.client.1.smithi116.stdout:3/682: mknod d3/db/d10/d1c/d34/cf3 0 2024-09-13T21:40:45.293 INFO:tasks.workunit.client.1.smithi116.stdout:5/654: dwrite d7/d1d/d64/fab [0,4194304] 0 2024-09-13T21:40:45.295 INFO:tasks.workunit.client.1.smithi116.stdout:5/655: mkdir d7/d1d/d46/dd4/d5e/d65/d6f/dd5 0 2024-09-13T21:40:45.296 INFO:tasks.workunit.client.1.smithi116.stdout:5/656: mkdir d7/d1d/d46/d85/d96/dd6 0 2024-09-13T21:40:45.309 INFO:tasks.workunit.client.1.smithi116.stdout:5/657: dwrite d7/d1d/d46/dd4/d5e/f7a [0,4194304] 0 2024-09-13T21:40:45.312 INFO:tasks.workunit.client.1.smithi116.stdout:5/658: rename d7/d1d/d46/d85/d96/ca3 to d7/d1d/d46/d85/d96/cd7 0 2024-09-13T21:40:45.312 INFO:tasks.workunit.client.1.smithi116.stdout:5/659: mkdir d7/d1d/d46/d85/d96/dd6/dd8 0 2024-09-13T21:40:45.314 INFO:tasks.workunit.client.1.smithi116.stdout:5/660: truncate d7/d1d/d46/dd4/d5e/f4e 1407218 0 2024-09-13T21:40:45.316 INFO:tasks.workunit.client.1.smithi116.stdout:5/661: rename d7/d1d/d46/dd4/d5e/d65/fa4 to d7/d1d/dbb/fd9 0 2024-09-13T21:40:45.317 INFO:tasks.workunit.client.1.smithi116.stdout:5/662: rename d7/d1d/d46/dd4/d5e/d65/d6a/f76 to d7/d1d/d46/fda 0 2024-09-13T21:40:45.318 INFO:tasks.workunit.client.1.smithi116.stdout:5/663: creat d7/d1d/d46/dd4/d5e/d65/d6f/dd5/fdb x:0 0 0 2024-09-13T21:40:45.319 INFO:tasks.workunit.client.1.smithi116.stdout:5/664: symlink d7/d1d/d46/d85/d96/dd6/dd8/ldc 0 2024-09-13T21:40:45.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:45.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:45 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:45.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:45 smithi116 ceph-mon[33391]: pgmap v262: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 114 MiB/s rd, 135 MiB/s wr, 276 op/s 2024-09-13T21:40:45.348 INFO:tasks.workunit.client.1.smithi116.stdout:4/525: sync 2024-09-13T21:40:45.348 INFO:tasks.workunit.client.1.smithi116.stdout:7/583: sync 2024-09-13T21:40:45.349 INFO:tasks.workunit.client.1.smithi116.stdout:9/363: sync 2024-09-13T21:40:45.349 INFO:tasks.workunit.client.1.smithi116.stdout:7/584: creat d5/d9/d27/d31/d38/fbb x:0 0 0 2024-09-13T21:40:45.350 INFO:tasks.workunit.client.1.smithi116.stdout:9/364: write d2/d10/d14/f45 [827207,62074] 0 2024-09-13T21:40:45.350 INFO:tasks.workunit.client.1.smithi116.stdout:9/365: mknod d2/c70 0 2024-09-13T21:40:45.352 INFO:tasks.workunit.client.1.smithi116.stdout:9/366: dread d2/f2d [0,4194304] 0 2024-09-13T21:40:45.352 INFO:tasks.workunit.client.1.smithi116.stdout:9/367: chown d2/d8/d3e/f57 3330751 1 2024-09-13T21:40:45.438 INFO:tasks.workunit.client.1.smithi116.stdout:8/532: sync 2024-09-13T21:40:45.438 INFO:tasks.workunit.client.1.smithi116.stdout:8/533: write d2/d10/d19/d21/d22/d5d/d46/f7d [1583676,98923] 0 2024-09-13T21:40:45.439 INFO:tasks.workunit.client.1.smithi116.stdout:8/534: mknod d2/d10/d37/ca2 0 2024-09-13T21:40:45.444 INFO:tasks.workunit.client.1.smithi116.stdout:8/535: dread d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:45.445 INFO:tasks.workunit.client.1.smithi116.stdout:8/536: getdents d2/d10/d4b/d6e 0 2024-09-13T21:40:45.445 INFO:tasks.workunit.client.1.smithi116.stdout:8/537: write d2/d10/d19/d21/d22/d5d/d46/f4f [1251825,78665] 0 2024-09-13T21:40:45.445 INFO:tasks.workunit.client.1.smithi116.stdout:8/538: stat d2/d10/d19/d3a/d4c/l63 0 2024-09-13T21:40:45.446 INFO:tasks.workunit.client.1.smithi116.stdout:8/539: rmdir d2/d10/d19/d3a 39 2024-09-13T21:40:45.446 INFO:tasks.workunit.client.1.smithi116.stdout:8/540: dread - d2/d27/d62/f95 zero size 2024-09-13T21:40:45.447 INFO:tasks.workunit.client.1.smithi116.stdout:8/541: unlink d2/d10/d19/d21/d22/l39 0 2024-09-13T21:40:45.451 INFO:tasks.workunit.client.1.smithi116.stdout:8/542: rmdir d2/d10/d19/d21/d22 39 2024-09-13T21:40:45.452 INFO:tasks.workunit.client.1.smithi116.stdout:8/543: mknod d2/d5c/ca3 0 2024-09-13T21:40:45.453 INFO:tasks.workunit.client.1.smithi116.stdout:8/544: mkdir d2/d10/d3e/da4 0 2024-09-13T21:40:45.453 INFO:tasks.workunit.client.1.smithi116.stdout:8/545: getdents d2/d10/d19/d21/d22/d5d 0 2024-09-13T21:40:45.453 INFO:tasks.workunit.client.1.smithi116.stdout:8/546: chown d2/d10/d19/d21/d69/d90 846786 1 2024-09-13T21:40:45.454 INFO:tasks.workunit.client.1.smithi116.stdout:8/547: mknod d2/d10/d19/d21/d69/ca5 0 2024-09-13T21:40:45.455 INFO:tasks.workunit.client.1.smithi116.stdout:8/548: symlink d2/d10/la6 0 2024-09-13T21:40:45.455 INFO:tasks.workunit.client.1.smithi116.stdout:8/549: write d2/d10/d4b/f50 [120305,68687] 0 2024-09-13T21:40:45.456 INFO:tasks.workunit.client.1.smithi116.stdout:8/550: chown d2/f6d 2154 1 2024-09-13T21:40:45.456 INFO:tasks.workunit.client.1.smithi116.stdout:8/551: creat d2/d10/d3e/da4/fa7 x:0 0 0 2024-09-13T21:40:45.476 INFO:tasks.workunit.client.1.smithi116.stdout:8/552: dwrite d2/d10/d19/d21/d22/d5d/d46/f7d [0,4194304] 0 2024-09-13T21:40:45.479 INFO:tasks.workunit.client.1.smithi116.stdout:8/553: unlink d2/d5c/f6a 0 2024-09-13T21:40:45.480 INFO:tasks.workunit.client.1.smithi116.stdout:8/554: rmdir d2/d10/d19 39 2024-09-13T21:40:45.480 INFO:tasks.workunit.client.1.smithi116.stdout:8/555: write d2/d10/f18 [772285,81688] 0 2024-09-13T21:40:45.480 INFO:tasks.workunit.client.1.smithi116.stdout:8/556: chown d2/d10/d19/d21/d69/d90/l91 36 1 2024-09-13T21:40:45.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:45.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:45 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:45.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:45 smithi088 ceph-mon[27963]: pgmap v262: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 114 MiB/s rd, 135 MiB/s wr, 276 op/s 2024-09-13T21:40:45.495 INFO:tasks.workunit.client.1.smithi116.stdout:8/557: dwrite d2/d10/d19/d21/f47 [0,4194304] 0 2024-09-13T21:40:45.495 INFO:tasks.workunit.client.1.smithi116.stdout:8/558: write d2/d10/d4b/f50 [1078661,123425] 0 2024-09-13T21:40:45.495 INFO:tasks.workunit.client.1.smithi116.stdout:8/559: chown d2/d10/c6b 16063 1 2024-09-13T21:40:45.512 INFO:tasks.workunit.client.1.smithi116.stdout:8/560: dwrite d2/d27/d62/f95 [0,4194304] 0 2024-09-13T21:40:45.514 INFO:tasks.workunit.client.1.smithi116.stdout:8/561: rmdir d2/d10/d19/d42/d45 39 2024-09-13T21:40:45.519 INFO:tasks.workunit.client.1.smithi116.stdout:8/562: dread d2/d10/d19/d3a/f6f [0,4194304] 0 2024-09-13T21:40:45.519 INFO:tasks.workunit.client.1.smithi116.stdout:8/563: write d2/d10/d37/f25 [3785458,76892] 0 2024-09-13T21:40:45.530 INFO:tasks.workunit.client.1.smithi116.stdout:8/564: write d2/d27/d62/f95 [2139393,117142] 0 2024-09-13T21:40:45.531 INFO:tasks.workunit.client.1.smithi116.stdout:8/565: symlink d2/d10/d19/d42/la8 0 2024-09-13T21:40:45.543 INFO:tasks.workunit.client.1.smithi116.stdout:8/566: dread d2/d10/f11 [0,4194304] 0 2024-09-13T21:40:45.544 INFO:tasks.workunit.client.1.smithi116.stdout:8/567: mkdir d2/d10/d19/d21/d69/d90/da9 0 2024-09-13T21:40:45.545 INFO:tasks.workunit.client.1.smithi116.stdout:8/568: symlink d2/d10/d3e/laa 0 2024-09-13T21:40:45.547 INFO:tasks.workunit.client.1.smithi116.stdout:8/569: rename d2/d27/d66/d7c/f86 to d2/d27/d62/fab 0 2024-09-13T21:40:45.550 INFO:tasks.workunit.client.1.smithi116.stdout:8/570: unlink d2/l12 0 2024-09-13T21:40:45.551 INFO:tasks.workunit.client.1.smithi116.stdout:8/571: dread d2/d10/d4b/d6e/f9c [0,4194304] 0 2024-09-13T21:40:45.552 INFO:tasks.workunit.client.1.smithi116.stdout:8/572: rmdir d2/d10/d19/d21/d22/d5d/d46 39 2024-09-13T21:40:45.553 INFO:tasks.workunit.client.1.smithi116.stdout:8/573: rmdir d2/d10/d19/d42/d45/d87 39 2024-09-13T21:40:45.562 INFO:tasks.workunit.client.1.smithi116.stdout:2/465: sync 2024-09-13T21:40:45.563 INFO:tasks.workunit.client.1.smithi116.stdout:2/466: creat d0/d3a/d82/d62/f9d x:0 0 0 2024-09-13T21:40:45.565 INFO:tasks.workunit.client.1.smithi116.stdout:2/467: link d0/d3a/d82/c15 d0/d7/d86/c9e 0 2024-09-13T21:40:45.565 INFO:tasks.workunit.client.1.smithi116.stdout:8/574: dread d2/d10/d19/d3a/d4c/d7a/f89 [0,4194304] 0 2024-09-13T21:40:45.565 INFO:tasks.workunit.client.1.smithi116.stdout:8/575: truncate d2/d27/d66/f8c 987649 0 2024-09-13T21:40:45.565 INFO:tasks.workunit.client.1.smithi116.stdout:8/576: fsync d2/d10/d75/fa1 0 2024-09-13T21:40:45.566 INFO:tasks.workunit.client.1.smithi116.stdout:2/468: rmdir d0/d7/d2b/d66 0 2024-09-13T21:40:45.567 INFO:tasks.workunit.client.1.smithi116.stdout:2/469: read d0/d7/d49/f80 [272921,60246] 0 2024-09-13T21:40:45.568 INFO:tasks.workunit.client.1.smithi116.stdout:8/577: truncate d2/f8 626532 0 2024-09-13T21:40:45.570 INFO:tasks.workunit.client.1.smithi116.stdout:2/470: rename d0/d7/d2b/l4d to d0/d3a/d82/d68/l9f 0 2024-09-13T21:40:45.570 INFO:tasks.workunit.client.1.smithi116.stdout:2/471: write d0/d3a/d82/f42 [1143698,42587] 0 2024-09-13T21:40:45.573 INFO:tasks.workunit.client.1.smithi116.stdout:2/472: rename d0/d3a/d82/d62/l8c to d0/d7/d86/la0 0 2024-09-13T21:40:45.573 INFO:tasks.workunit.client.1.smithi116.stdout:2/473: dread - d0/d7/d2b/f78 zero size 2024-09-13T21:40:45.573 INFO:tasks.workunit.client.1.smithi116.stdout:2/474: creat d0/d3a/d82/d62/d1f/d5d/d89/fa1 x:0 0 0 2024-09-13T21:40:45.577 INFO:tasks.workunit.client.1.smithi116.stdout:2/475: rename d0/d7/d2b/c6b to d0/d3a/ca2 0 2024-09-13T21:40:45.579 INFO:tasks.workunit.client.1.smithi116.stdout:2/476: creat d0/d3a/d82/d62/d1f/fa3 x:0 0 0 2024-09-13T21:40:45.582 INFO:tasks.workunit.client.1.smithi116.stdout:2/477: creat d0/d5/fa4 x:0 0 0 2024-09-13T21:40:45.583 INFO:tasks.workunit.client.1.smithi116.stdout:2/478: mknod d0/d7/d2d/ca5 0 2024-09-13T21:40:45.586 INFO:tasks.workunit.client.1.smithi116.stdout:8/578: dwrite d2/d10/d19/d21/d22/d5d/f52 [0,4194304] 0 2024-09-13T21:40:45.587 INFO:tasks.workunit.client.1.smithi116.stdout:6/547: sync 2024-09-13T21:40:45.587 INFO:tasks.workunit.client.1.smithi116.stdout:6/548: creat d8/d10/d65/fc5 x:0 0 0 2024-09-13T21:40:45.587 INFO:tasks.workunit.client.1.smithi116.stdout:1/442: sync 2024-09-13T21:40:45.591 INFO:tasks.workunit.client.1.smithi116.stdout:6/549: unlink d8/d15/d2e/d2f/d38/d9c/fb0 0 2024-09-13T21:40:45.592 INFO:tasks.workunit.client.1.smithi116.stdout:1/443: mknod d4/d23/d56/c9e 0 2024-09-13T21:40:45.596 INFO:tasks.workunit.client.1.smithi116.stdout:1/444: creat d4/d14/d52/d2f/d5d/f9f x:0 0 0 2024-09-13T21:40:45.597 INFO:tasks.workunit.client.1.smithi116.stdout:8/579: write d2/d10/d19/d21/f47 [2352993,67709] 0 2024-09-13T21:40:45.599 INFO:tasks.workunit.client.1.smithi116.stdout:1/445: truncate d4/d14/d2a/f88 2144849 0 2024-09-13T21:40:45.599 INFO:tasks.workunit.client.1.smithi116.stdout:1/446: creat d4/d14/fa0 x:0 0 0 2024-09-13T21:40:45.601 INFO:tasks.workunit.client.1.smithi116.stdout:8/580: rename d2/d10/d75/fa1 to d2/d10/d19/d21/d69/d90/fac 0 2024-09-13T21:40:45.601 INFO:tasks.workunit.client.1.smithi116.stdout:8/581: stat d2/d10/d19/d3a/d4c/c61 0 2024-09-13T21:40:45.601 INFO:tasks.workunit.client.1.smithi116.stdout:2/479: rmdir d0/d3a 39 2024-09-13T21:40:45.605 INFO:tasks.workunit.client.1.smithi116.stdout:2/480: dread d0/f76 [0,4194304] 0 2024-09-13T21:40:45.605 INFO:tasks.workunit.client.1.smithi116.stdout:6/550: rmdir d8/d10/d65 39 2024-09-13T21:40:45.606 INFO:tasks.workunit.client.1.smithi116.stdout:6/551: creat d8/d17/d70/da0/fc6 x:0 0 0 2024-09-13T21:40:45.610 INFO:tasks.workunit.client.1.smithi116.stdout:6/552: symlink d8/d10/d78/lc7 0 2024-09-13T21:40:45.613 INFO:tasks.workunit.client.1.smithi116.stdout:8/582: dread d2/d10/d19/d21/d22/f78 [0,4194304] 0 2024-09-13T21:40:45.613 INFO:tasks.workunit.client.1.smithi116.stdout:8/583: stat d2/d10/d19/d21/d22/d5d/d46/f5b 0 2024-09-13T21:40:45.613 INFO:tasks.workunit.client.1.smithi116.stdout:6/553: getdents d8/d17/d70 0 2024-09-13T21:40:45.615 INFO:tasks.workunit.client.1.smithi116.stdout:8/584: creat d2/d10/d19/d3a/d4c/fad x:0 0 0 2024-09-13T21:40:45.615 INFO:tasks.workunit.client.1.smithi116.stdout:8/585: chown d2/d27/d62/f95 162514369 1 2024-09-13T21:40:45.615 INFO:tasks.workunit.client.1.smithi116.stdout:8/586: dread - d2/d5c/f85 zero size 2024-09-13T21:40:45.615 INFO:tasks.workunit.client.1.smithi116.stdout:8/587: write d2/d10/d19/d3a/f5f [3573138,41058] 0 2024-09-13T21:40:45.616 INFO:tasks.workunit.client.1.smithi116.stdout:8/588: mknod d2/d10/d4b/cae 0 2024-09-13T21:40:45.622 INFO:tasks.workunit.client.1.smithi116.stdout:6/554: dread d8/d10/d33/f67 [0,4194304] 0 2024-09-13T21:40:45.623 INFO:tasks.workunit.client.1.smithi116.stdout:6/555: creat d8/d15/d2e/d2f/fc8 x:0 0 0 2024-09-13T21:40:45.627 INFO:tasks.workunit.client.1.smithi116.stdout:6/556: write d8/d1e/f53 [944636,33524] 0 2024-09-13T21:40:45.627 INFO:tasks.workunit.client.1.smithi116.stdout:6/557: stat d8/d15/c6c 0 2024-09-13T21:40:45.627 INFO:tasks.workunit.client.1.smithi116.stdout:6/558: creat d8/d15/d2e/d2f/fc9 x:0 0 0 2024-09-13T21:40:45.627 INFO:tasks.workunit.client.1.smithi116.stdout:2/481: dwrite d0/d7/f1e [0,4194304] 0 2024-09-13T21:40:45.628 INFO:tasks.workunit.client.1.smithi116.stdout:2/482: write d0/d3a/d82/d62/f4a [713679,23264] 0 2024-09-13T21:40:45.628 INFO:tasks.workunit.client.1.smithi116.stdout:2/483: readlink d0/d3a/d82/d68/l6f 0 2024-09-13T21:40:45.629 INFO:tasks.workunit.client.1.smithi116.stdout:8/589: write d2/d10/f11 [447598,94743] 0 2024-09-13T21:40:45.631 INFO:tasks.workunit.client.1.smithi116.stdout:8/590: rmdir d2/d10/d19/d3a 39 2024-09-13T21:40:45.632 INFO:tasks.workunit.client.1.smithi116.stdout:6/559: getdents d8/d1e 0 2024-09-13T21:40:45.635 INFO:tasks.workunit.client.1.smithi116.stdout:8/591: creat d2/d10/d19/d21/d69/d9e/faf x:0 0 0 2024-09-13T21:40:45.635 INFO:tasks.workunit.client.1.smithi116.stdout:8/592: readlink d2/d10/d3e/laa 0 2024-09-13T21:40:45.637 INFO:tasks.workunit.client.1.smithi116.stdout:6/560: mkdir d8/dca 0 2024-09-13T21:40:45.637 INFO:tasks.workunit.client.1.smithi116.stdout:6/561: readlink d8/d17/d70/l90 0 2024-09-13T21:40:45.637 INFO:tasks.workunit.client.1.smithi116.stdout:6/562: read d8/d15/f1b [684673,68402] 0 2024-09-13T21:40:45.637 INFO:tasks.workunit.client.1.smithi116.stdout:6/563: chown d8/d15/f98 171 1 2024-09-13T21:40:45.637 INFO:tasks.workunit.client.1.smithi116.stdout:6/564: dread - d8/d15/d2e/d2f/d38/d9c/fc2 zero size 2024-09-13T21:40:45.641 INFO:tasks.workunit.client.1.smithi116.stdout:2/484: write d0/d7/d2b/f3f [2166156,113068] 0 2024-09-13T21:40:45.647 INFO:tasks.workunit.client.1.smithi116.stdout:8/593: dread d2/d27/d62/f7b [0,4194304] 0 2024-09-13T21:40:45.647 INFO:tasks.workunit.client.1.smithi116.stdout:8/594: chown d2/d10/d19/d21/d22/f4a 0 1 2024-09-13T21:40:45.649 INFO:tasks.workunit.client.1.smithi116.stdout:8/595: creat d2/d10/d4b/d6e/fb0 x:0 0 0 2024-09-13T21:40:45.652 INFO:tasks.workunit.client.1.smithi116.stdout:8/596: link d2/d10/d19/d21/f2d d2/d10/d19/fb1 0 2024-09-13T21:40:45.654 INFO:tasks.workunit.client.1.smithi116.stdout:8/597: rename d2/d27/d62/f95 to d2/d10/d3e/da4/fb2 0 2024-09-13T21:40:45.657 INFO:tasks.workunit.client.1.smithi116.stdout:8/598: dread d2/f6d [0,4194304] 0 2024-09-13T21:40:45.658 INFO:tasks.workunit.client.1.smithi116.stdout:8/599: creat d2/d10/d19/d97/fb3 x:0 0 0 2024-09-13T21:40:45.658 INFO:tasks.workunit.client.1.smithi116.stdout:8/600: write d2/d10/d19/d97/fb3 [182895,71655] 0 2024-09-13T21:40:45.662 INFO:tasks.workunit.client.1.smithi116.stdout:2/485: dwrite d0/d3a/d82/d62/f1d [0,4194304] 0 2024-09-13T21:40:45.663 INFO:tasks.workunit.client.1.smithi116.stdout:2/486: chown d0/d7/d86/c9e 7108794 1 2024-09-13T21:40:45.663 INFO:tasks.workunit.client.1.smithi116.stdout:2/487: fsync d0/d5/d8/d7a/f7f 0 2024-09-13T21:40:45.663 INFO:tasks.workunit.client.1.smithi116.stdout:2/488: dread - d0/d3a/d82/d62/f98 zero size 2024-09-13T21:40:45.663 INFO:tasks.workunit.client.1.smithi116.stdout:2/489: stat d0/d3a/d82/d62/d1f/d5d 0 2024-09-13T21:40:45.663 INFO:tasks.workunit.client.1.smithi116.stdout:2/490: fsync d0/d5/d8/f39 0 2024-09-13T21:40:45.663 INFO:tasks.workunit.client.1.smithi116.stdout:2/491: chown d0/d5/d8/c19 97449032 1 2024-09-13T21:40:45.667 INFO:tasks.workunit.client.1.smithi116.stdout:2/492: creat d0/d3a/d82/d62/d1f/d5d/fa6 x:0 0 0 2024-09-13T21:40:45.667 INFO:tasks.workunit.client.1.smithi116.stdout:2/493: creat d0/d5/d2a/fa7 x:0 0 0 2024-09-13T21:40:45.668 INFO:tasks.workunit.client.1.smithi116.stdout:2/494: symlink d0/d7/d86/la8 0 2024-09-13T21:40:45.669 INFO:tasks.workunit.client.1.smithi116.stdout:2/495: mkdir d0/d3a/d82/d62/d1f/d73/da9 0 2024-09-13T21:40:45.670 INFO:tasks.workunit.client.1.smithi116.stdout:2/496: getdents d0/d7/d2b/d61 0 2024-09-13T21:40:45.682 INFO:tasks.workunit.client.1.smithi116.stdout:9/368: sync 2024-09-13T21:40:45.682 INFO:tasks.workunit.client.1.smithi116.stdout:9/369: chown d2/d10/c6f 1 1 2024-09-13T21:40:45.682 INFO:tasks.workunit.client.1.smithi116.stdout:9/370: fdatasync d2/d10/d4c/f4e 0 2024-09-13T21:40:45.682 INFO:tasks.workunit.client.1.smithi116.stdout:4/526: sync 2024-09-13T21:40:45.682 INFO:tasks.workunit.client.1.smithi116.stdout:7/585: sync 2024-09-13T21:40:45.683 INFO:tasks.workunit.client.1.smithi116.stdout:7/586: write d5/d9/d27/d31/f71 [1446625,32832] 0 2024-09-13T21:40:45.683 INFO:tasks.workunit.client.1.smithi116.stdout:3/683: sync 2024-09-13T21:40:45.683 INFO:tasks.workunit.client.1.smithi116.stdout:5/665: sync 2024-09-13T21:40:45.683 INFO:tasks.workunit.client.1.smithi116.stdout:3/684: dread - d3/db/d3d/d40/fe0 zero size 2024-09-13T21:40:45.683 INFO:tasks.workunit.client.1.smithi116.stdout:0/677: sync 2024-09-13T21:40:45.683 INFO:tasks.workunit.client.1.smithi116.stdout:0/678: creat d2/dc/d12/d28/fe5 x:0 0 0 2024-09-13T21:40:45.685 INFO:tasks.workunit.client.1.smithi116.stdout:2/497: rename d0/d3a/d82/d62/d1f/d73 to d0/d3a/d82/d62/d1f/d5d/d72/daa 0 2024-09-13T21:40:45.685 INFO:tasks.workunit.client.1.smithi116.stdout:2/498: chown d0/d7/d2b/l4c 2 1 2024-09-13T21:40:45.686 INFO:tasks.workunit.client.1.smithi116.stdout:9/371: symlink d2/d10/l71 0 2024-09-13T21:40:45.687 INFO:tasks.workunit.client.1.smithi116.stdout:4/527: symlink d0/dd/d7c/l9f 0 2024-09-13T21:40:45.687 INFO:tasks.workunit.client.1.smithi116.stdout:9/372: dread d2/d10/d4c/f51 [0,4194304] 0 2024-09-13T21:40:45.690 INFO:tasks.workunit.client.1.smithi116.stdout:7/587: creat d5/d9/db/d21/d6e/d6f/d70/fbc x:0 0 0 2024-09-13T21:40:45.690 INFO:tasks.workunit.client.1.smithi116.stdout:2/499: dread d0/d7/f6e [0,4194304] 0 2024-09-13T21:40:45.690 INFO:tasks.workunit.client.1.smithi116.stdout:2/500: fsync d0/d7/f59 0 2024-09-13T21:40:45.692 INFO:tasks.workunit.client.1.smithi116.stdout:5/666: unlink d7/d1d/d46/dd4/d5e/d65/d6a/fca 0 2024-09-13T21:40:45.692 INFO:tasks.workunit.client.1.smithi116.stdout:3/685: creat d3/db/d10/d1c/d34/d55/d57/dda/ff4 x:0 0 0 2024-09-13T21:40:45.693 INFO:tasks.workunit.client.1.smithi116.stdout:3/686: creat d3/db/d10/d1d/d5f/ff5 x:0 0 0 2024-09-13T21:40:45.693 INFO:tasks.workunit.client.1.smithi116.stdout:3/687: fsync d3/db/d10/d1c/d63/fe4 0 2024-09-13T21:40:45.695 INFO:tasks.workunit.client.1.smithi116.stdout:7/588: symlink d5/d9/d27/d31/lbd 0 2024-09-13T21:40:45.696 INFO:tasks.workunit.client.1.smithi116.stdout:5/667: symlink d7/d1d/d46/dd4/d5e/d65/da5/ldd 0 2024-09-13T21:40:45.696 INFO:tasks.workunit.client.1.smithi116.stdout:5/668: read d7/d1d/f45 [2962417,47550] 0 2024-09-13T21:40:45.696 INFO:tasks.workunit.client.1.smithi116.stdout:5/669: chown d7/d1d/d46/dc0 28 1 2024-09-13T21:40:45.697 INFO:tasks.workunit.client.1.smithi116.stdout:7/589: dread d5/d9/d27/d31/d38/d48/f75 [0,4194304] 0 2024-09-13T21:40:45.698 INFO:tasks.workunit.client.1.smithi116.stdout:5/670: mknod d7/d1d/d64/cde 0 2024-09-13T21:40:45.699 INFO:tasks.workunit.client.1.smithi116.stdout:7/590: mkdir d5/d9/d27/dbe 0 2024-09-13T21:40:45.712 INFO:tasks.workunit.client.1.smithi116.stdout:3/688: write d3/db/d10/d1d/d5f/d6f/d71/f7d [587262,33827] 0 2024-09-13T21:40:45.712 INFO:tasks.workunit.client.1.smithi116.stdout:3/689: write d3/db/d10/d1d/d5f/fcb [888502,117668] 0 2024-09-13T21:40:45.713 INFO:tasks.workunit.client.1.smithi116.stdout:3/690: truncate d3/db/d20/f23 482360 0 2024-09-13T21:40:45.716 INFO:tasks.workunit.client.1.smithi116.stdout:4/528: dwrite d0/d56/d57/f6e [0,4194304] 0 2024-09-13T21:40:45.716 INFO:tasks.workunit.client.1.smithi116.stdout:4/529: creat d0/d56/d57/fa0 x:0 0 0 2024-09-13T21:40:45.716 INFO:tasks.workunit.client.1.smithi116.stdout:4/530: readlink d0/dd/l1a 0 2024-09-13T21:40:45.717 INFO:tasks.workunit.client.1.smithi116.stdout:7/591: dwrite d5/d9/db/d21/f53 [0,4194304] 0 2024-09-13T21:40:45.717 INFO:tasks.workunit.client.1.smithi116.stdout:7/592: truncate d5/d9/f10 4026378 0 2024-09-13T21:40:45.717 INFO:tasks.workunit.client.1.smithi116.stdout:7/593: getdents d5/d9/d1c/d22/d24/d6b/d72/d74/d93 0 2024-09-13T21:40:45.718 INFO:tasks.workunit.client.1.smithi116.stdout:2/501: dwrite d0/d3a/d82/f71 [0,4194304] 0 2024-09-13T21:40:45.721 INFO:tasks.workunit.client.1.smithi116.stdout:9/373: rmdir d2/d10 39 2024-09-13T21:40:45.725 INFO:tasks.workunit.client.1.smithi116.stdout:7/594: symlink d5/d9/db/d21/lbf 0 2024-09-13T21:40:45.728 INFO:tasks.workunit.client.1.smithi116.stdout:4/531: write d0/f39 [1850271,125246] 0 2024-09-13T21:40:45.729 INFO:tasks.workunit.client.1.smithi116.stdout:2/502: creat d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/fab x:0 0 0 2024-09-13T21:40:45.731 INFO:tasks.workunit.client.1.smithi116.stdout:9/374: mkdir d2/d72 0 2024-09-13T21:40:45.734 INFO:tasks.workunit.client.1.smithi116.stdout:7/595: link d5/d9/d1c/d22/d24/c4c d5/d9/d1c/d22/d24/d6b/cc0 0 2024-09-13T21:40:45.734 INFO:tasks.workunit.client.1.smithi116.stdout:7/596: truncate d5/d9/db/d21/d6e/d6f/d70/fbc 495297 0 2024-09-13T21:40:45.735 INFO:tasks.workunit.client.1.smithi116.stdout:7/597: chown d5/d9/d1c/d22/d24/d6b/d72/f8c 659 1 2024-09-13T21:40:45.736 INFO:tasks.workunit.client.1.smithi116.stdout:4/532: creat d0/fa1 x:0 0 0 2024-09-13T21:40:45.738 INFO:tasks.workunit.client.1.smithi116.stdout:9/375: rmdir d2/d8/d67 0 2024-09-13T21:40:45.740 INFO:tasks.workunit.client.1.smithi116.stdout:9/376: getdents d2/d10/d14/d38 0 2024-09-13T21:40:45.742 INFO:tasks.workunit.client.1.smithi116.stdout:2/503: dread d0/d7/f59 [0,4194304] 0 2024-09-13T21:40:45.742 INFO:tasks.workunit.client.1.smithi116.stdout:2/504: chown d0/d7/f84 181 1 2024-09-13T21:40:45.744 INFO:tasks.workunit.client.1.smithi116.stdout:9/377: unlink d2/d8/d3e/f57 0 2024-09-13T21:40:45.744 INFO:tasks.workunit.client.1.smithi116.stdout:9/378: truncate d2/d10/f12 4980467 0 2024-09-13T21:40:45.745 INFO:tasks.workunit.client.1.smithi116.stdout:7/598: dread d5/d9/f33 [0,4194304] 0 2024-09-13T21:40:45.745 INFO:tasks.workunit.client.1.smithi116.stdout:2/505: mkdir d0/d7/d2d/dac 0 2024-09-13T21:40:45.748 INFO:tasks.workunit.client.1.smithi116.stdout:9/379: unlink d2/d5d/d69/l5c 0 2024-09-13T21:40:45.750 INFO:tasks.workunit.client.1.smithi116.stdout:7/599: mknod d5/d9/db/d21/d6e/cc1 0 2024-09-13T21:40:45.751 INFO:tasks.workunit.client.1.smithi116.stdout:2/506: creat d0/fad x:0 0 0 2024-09-13T21:40:45.753 INFO:tasks.workunit.client.1.smithi116.stdout:7/600: truncate d5/d9/f51 3744669 0 2024-09-13T21:40:45.754 INFO:tasks.workunit.client.1.smithi116.stdout:7/601: creat d5/d9/d1c/d22/fc2 x:0 0 0 2024-09-13T21:40:45.756 INFO:tasks.workunit.client.1.smithi116.stdout:2/507: dread d0/d7/f1e [4194304,4194304] 0 2024-09-13T21:40:45.757 INFO:tasks.workunit.client.1.smithi116.stdout:2/508: dread - d0/d3a/d82/d62/d1f/d5d/d89/f9c zero size 2024-09-13T21:40:45.757 INFO:tasks.workunit.client.1.smithi116.stdout:2/509: write d0/d3a/d82/d62/d75/d77/f99 [901091,59685] 0 2024-09-13T21:40:45.757 INFO:tasks.workunit.client.1.smithi116.stdout:2/510: readlink d0/d7/d86/la8 0 2024-09-13T21:40:45.757 INFO:tasks.workunit.client.1.smithi116.stdout:2/511: creat d0/fae x:0 0 0 2024-09-13T21:40:45.758 INFO:tasks.workunit.client.1.smithi116.stdout:4/533: dwrite d0/dd/d48/f6a [0,4194304] 0 2024-09-13T21:40:45.763 INFO:tasks.workunit.client.1.smithi116.stdout:4/534: truncate d0/f31 2509673 0 2024-09-13T21:40:45.763 INFO:tasks.workunit.client.1.smithi116.stdout:4/535: write d0/dd/d6b/f93 [431931,125921] 0 2024-09-13T21:40:45.763 INFO:tasks.workunit.client.1.smithi116.stdout:4/536: write d0/dd/d13/f4f [1308654,101222] 0 2024-09-13T21:40:45.763 INFO:tasks.workunit.client.1.smithi116.stdout:4/537: readlink d0/d32/d5d/l64 0 2024-09-13T21:40:45.766 INFO:tasks.workunit.client.1.smithi116.stdout:4/538: creat d0/dd/d6b/d92/fa2 x:0 0 0 2024-09-13T21:40:45.767 INFO:tasks.workunit.client.1.smithi116.stdout:4/539: mkdir d0/d32/da3 0 2024-09-13T21:40:45.769 INFO:tasks.workunit.client.1.smithi116.stdout:9/380: rmdir d2/d8/d3e 39 2024-09-13T21:40:45.769 INFO:tasks.workunit.client.1.smithi116.stdout:9/381: dread - d2/d10/f52 zero size 2024-09-13T21:40:45.776 INFO:tasks.workunit.client.1.smithi116.stdout:7/602: dwrite d5/d9/d1c/d2e/f86 [0,4194304] 0 2024-09-13T21:40:45.777 INFO:tasks.workunit.client.1.smithi116.stdout:2/512: dwrite d0/d3a/d82/d62/d1f/d5d/d60/f8a [0,4194304] 0 2024-09-13T21:40:45.793 INFO:tasks.workunit.client.1.smithi116.stdout:4/540: dwrite d0/dd/d48/f6a [0,4194304] 0 2024-09-13T21:40:45.793 INFO:tasks.workunit.client.1.smithi116.stdout:4/541: fdatasync d0/f31 0 2024-09-13T21:40:45.810 INFO:tasks.workunit.client.1.smithi116.stdout:2/513: dwrite d0/d3a/d82/d62/d1f/f27 [0,4194304] 0 2024-09-13T21:40:45.811 INFO:tasks.workunit.client.1.smithi116.stdout:7/603: dwrite f2 [12582912,4194304] 0 2024-09-13T21:40:45.812 INFO:tasks.workunit.client.1.smithi116.stdout:4/542: dwrite d0/d32/f3e [0,4194304] 0 2024-09-13T21:40:45.812 INFO:tasks.workunit.client.1.smithi116.stdout:4/543: write d0/fa1 [464050,25651] 0 2024-09-13T21:40:45.820 INFO:tasks.workunit.client.1.smithi116.stdout:7/604: dread d5/d9/d1c/d22/dae/fba [0,4194304] 0 2024-09-13T21:40:45.823 INFO:tasks.workunit.client.1.smithi116.stdout:7/605: rename d5/d9/db/d21/c69 to d5/d9/d27/d31/d38/d42/cc3 0 2024-09-13T21:40:45.825 INFO:tasks.workunit.client.1.smithi116.stdout:4/544: dread d0/d32/f52 [0,4194304] 0 2024-09-13T21:40:45.825 INFO:tasks.workunit.client.1.smithi116.stdout:4/545: fdatasync d0/d56/f69 0 2024-09-13T21:40:45.825 INFO:tasks.workunit.client.1.smithi116.stdout:4/546: chown d0/dd/d13/d5a/d86/f8f 2002 1 2024-09-13T21:40:45.825 INFO:tasks.workunit.client.1.smithi116.stdout:4/547: fsync d0/dd/d13/f4d 0 2024-09-13T21:40:45.825 INFO:tasks.workunit.client.1.smithi116.stdout:4/548: stat d0/dd/d13/f46 0 2024-09-13T21:40:45.825 INFO:tasks.workunit.client.1.smithi116.stdout:4/549: readlink d0/dd/l1a 0 2024-09-13T21:40:45.827 INFO:tasks.workunit.client.1.smithi116.stdout:4/550: rename d0/dd/f88 to d0/d56/d84/fa4 0 2024-09-13T21:40:45.827 INFO:tasks.workunit.client.1.smithi116.stdout:4/551: readlink d0/dd/d13/l14 0 2024-09-13T21:40:45.827 INFO:tasks.workunit.client.1.smithi116.stdout:4/552: rmdir d0/dd/d6b/d92/d99 39 2024-09-13T21:40:45.827 INFO:tasks.workunit.client.1.smithi116.stdout:4/553: fdatasync d0/dd/f3f 0 2024-09-13T21:40:45.827 INFO:tasks.workunit.client.1.smithi116.stdout:4/554: write d0/d32/d5f/f63 [1369115,83502] 0 2024-09-13T21:40:45.830 INFO:tasks.workunit.client.1.smithi116.stdout:7/606: read d5/d9/d1c/d22/dae/fba [3211405,95718] 0 2024-09-13T21:40:45.830 INFO:tasks.workunit.client.1.smithi116.stdout:7/607: fdatasync d5/d9/db/d21/d6e/f9a 0 2024-09-13T21:40:45.830 INFO:tasks.workunit.client.1.smithi116.stdout:2/514: dwrite d0/d5/d8/d7a/f91 [0,4194304] 0 2024-09-13T21:40:45.833 INFO:tasks.workunit.client.1.smithi116.stdout:2/515: creat d0/d7/d2d/faf x:0 0 0 2024-09-13T21:40:45.835 INFO:tasks.workunit.client.1.smithi116.stdout:2/516: truncate d0/d5/f10 3434252 0 2024-09-13T21:40:45.835 INFO:tasks.workunit.client.1.smithi116.stdout:2/517: chown d0/d5/d2a/fa7 0 1 2024-09-13T21:40:45.836 INFO:tasks.workunit.client.1.smithi116.stdout:2/518: creat d0/fb0 x:0 0 0 2024-09-13T21:40:45.836 INFO:tasks.workunit.client.1.smithi116.stdout:2/519: fdatasync d0/d3a/d82/d62/f7b 0 2024-09-13T21:40:45.836 INFO:tasks.workunit.client.1.smithi116.stdout:2/520: fsync d0/f63 0 2024-09-13T21:40:45.837 INFO:tasks.workunit.client.1.smithi116.stdout:2/521: getdents d0/d3a/d82/d62/d75/d77 0 2024-09-13T21:40:45.838 INFO:tasks.workunit.client.1.smithi116.stdout:2/522: symlink d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/lb1 0 2024-09-13T21:40:45.838 INFO:tasks.workunit.client.1.smithi116.stdout:2/523: chown d0/d7/d2b/d61/c7d 3974082 1 2024-09-13T21:40:45.839 INFO:tasks.workunit.client.1.smithi116.stdout:2/524: rmdir d0/d7/d2d/dac 0 2024-09-13T21:40:45.840 INFO:tasks.workunit.client.1.smithi116.stdout:4/555: dread d0/dd/d13/f1e [0,4194304] 0 2024-09-13T21:40:45.841 INFO:tasks.workunit.client.1.smithi116.stdout:2/525: rename d0/d3a/d82/d62/c28 to d0/d3a/cb2 0 2024-09-13T21:40:45.841 INFO:tasks.workunit.client.1.smithi116.stdout:2/526: fsync d0/d7/d49/f80 0 2024-09-13T21:40:45.841 INFO:tasks.workunit.client.1.smithi116.stdout:7/608: read d5/d9/d1c/d2e/f86 [358802,101267] 0 2024-09-13T21:40:45.841 INFO:tasks.workunit.client.1.smithi116.stdout:7/609: write d5/d9/d27/d31/d38/d48/f94 [1104533,90619] 0 2024-09-13T21:40:45.842 INFO:tasks.workunit.client.1.smithi116.stdout:4/556: mknod d0/dd/d13/d4e/ca5 0 2024-09-13T21:40:45.843 INFO:tasks.workunit.client.1.smithi116.stdout:2/527: getdents d0/d3a/d82 0 2024-09-13T21:40:45.843 INFO:tasks.workunit.client.1.smithi116.stdout:7/610: dread d5/d9/f17 [0,4194304] 0 2024-09-13T21:40:45.843 INFO:tasks.workunit.client.1.smithi116.stdout:7/611: fdatasync d5/d9/db/d21/f63 0 2024-09-13T21:40:45.843 INFO:tasks.workunit.client.1.smithi116.stdout:7/612: readlink d5/d9/d1c/d22/l54 0 2024-09-13T21:40:45.844 INFO:tasks.workunit.client.1.smithi116.stdout:4/557: rmdir d0/dd/d6b/d92/d99/d9a 0 2024-09-13T21:40:45.845 INFO:tasks.workunit.client.1.smithi116.stdout:2/528: mknod d0/d3a/d82/d62/d1f/d5d/d72/cb3 0 2024-09-13T21:40:45.846 INFO:tasks.workunit.client.1.smithi116.stdout:7/613: unlink d5/d9/db/c55 0 2024-09-13T21:40:45.846 INFO:tasks.workunit.client.1.smithi116.stdout:7/614: chown d5/d9/f14 101543761 1 2024-09-13T21:40:45.847 INFO:tasks.workunit.client.1.smithi116.stdout:4/558: unlink d0/dd/d13/f21 0 2024-09-13T21:40:45.848 INFO:tasks.workunit.client.1.smithi116.stdout:2/529: rmdir d0/d3a/d82/d62/d1f/d5d/d60 39 2024-09-13T21:40:45.850 INFO:tasks.workunit.client.1.smithi116.stdout:4/559: getdents d0/dd/d6b/d92 0 2024-09-13T21:40:45.859 INFO:tasks.workunit.client.1.smithi116.stdout:2/530: rmdir d0 39 2024-09-13T21:40:45.860 INFO:tasks.workunit.client.1.smithi116.stdout:4/560: symlink d0/dd/d6b/d71/la6 0 2024-09-13T21:40:45.860 INFO:tasks.workunit.client.1.smithi116.stdout:7/615: dwrite d5/d9/db/ff [0,4194304] 0 2024-09-13T21:40:45.864 INFO:tasks.workunit.client.1.smithi116.stdout:4/561: rename d0/dd/d13/d5a/d7a/l9c to d0/d32/d5f/la7 0 2024-09-13T21:40:45.864 INFO:tasks.workunit.client.1.smithi116.stdout:4/562: stat d0/dd/d13/d5a/c97 0 2024-09-13T21:40:45.866 INFO:tasks.workunit.client.1.smithi116.stdout:4/563: dread d0/dd/d6b/f93 [0,4194304] 0 2024-09-13T21:40:45.868 INFO:tasks.workunit.client.1.smithi116.stdout:4/564: unlink d0/f24 0 2024-09-13T21:40:45.868 INFO:tasks.workunit.client.1.smithi116.stdout:4/565: chown d0 9 1 2024-09-13T21:40:45.873 INFO:tasks.workunit.client.1.smithi116.stdout:4/566: unlink d0/dd/d48/f6a 0 2024-09-13T21:40:45.873 INFO:tasks.workunit.client.1.smithi116.stdout:4/567: chown d0/dd/d48/l4a 594969 1 2024-09-13T21:40:45.873 INFO:tasks.workunit.client.1.smithi116.stdout:4/568: write d0/d32/f66 [288893,34752] 0 2024-09-13T21:40:45.878 INFO:tasks.workunit.client.1.smithi116.stdout:4/569: dread d0/dd/d13/f4f [0,4194304] 0 2024-09-13T21:40:45.879 INFO:tasks.workunit.client.1.smithi116.stdout:4/570: creat d0/d32/d5d/d85/fa8 x:0 0 0 2024-09-13T21:40:45.880 INFO:tasks.workunit.client.1.smithi116.stdout:4/571: mknod d0/dd/d13/d5a/d7a/ca9 0 2024-09-13T21:40:45.880 INFO:tasks.workunit.client.1.smithi116.stdout:7/616: dwrite d5/d9/d1c/d22/d24/d3a/fb6 [0,4194304] 0 2024-09-13T21:40:45.881 INFO:tasks.workunit.client.1.smithi116.stdout:4/572: symlink d0/d32/d5d/d85/laa 0 2024-09-13T21:40:45.883 INFO:tasks.workunit.client.1.smithi116.stdout:7/617: creat d5/d9/d1c/d22/d24/d6b/d72/d74/d93/fc4 x:0 0 0 2024-09-13T21:40:45.883 INFO:tasks.workunit.client.1.smithi116.stdout:4/573: chown d0/l2c 1920824592 1 2024-09-13T21:40:45.885 INFO:tasks.workunit.client.1.smithi116.stdout:7/618: write d5/d9/d27/d31/d38/d48/f75 [292884,65632] 0 2024-09-13T21:40:45.885 INFO:tasks.workunit.client.1.smithi116.stdout:4/574: getdents d0/dd/d48 0 2024-09-13T21:40:45.887 INFO:tasks.workunit.client.1.smithi116.stdout:4/575: mknod d0/d32/da3/cab 0 2024-09-13T21:40:45.887 INFO:tasks.workunit.client.1.smithi116.stdout:4/576: write d0/dd/f9b [1010367,112107] 0 2024-09-13T21:40:45.888 INFO:tasks.workunit.client.1.smithi116.stdout:7/619: symlink d5/d9/db/lc5 0 2024-09-13T21:40:45.889 INFO:tasks.workunit.client.1.smithi116.stdout:7/620: truncate d5/d9/db/d21/f63 11388 0 2024-09-13T21:40:45.889 INFO:tasks.workunit.client.1.smithi116.stdout:2/531: dwrite d0/d7/f12 [4194304,4194304] 0 2024-09-13T21:40:45.890 INFO:tasks.workunit.client.1.smithi116.stdout:2/532: mknod d0/d5/d2a/cb4 0 2024-09-13T21:40:45.891 INFO:tasks.workunit.client.1.smithi116.stdout:2/533: creat d0/d3a/d82/d62/fb5 x:0 0 0 2024-09-13T21:40:45.892 INFO:tasks.workunit.client.1.smithi116.stdout:2/534: write d0/f79 [871223,48895] 0 2024-09-13T21:40:45.895 INFO:tasks.workunit.client.1.smithi116.stdout:7/621: write d5/d9/db/d21/f63 [499079,65737] 0 2024-09-13T21:40:45.897 INFO:tasks.workunit.client.1.smithi116.stdout:7/622: creat d5/d9/d1c/d22/d24/d5f/fc6 x:0 0 0 2024-09-13T21:40:45.899 INFO:tasks.workunit.client.1.smithi116.stdout:7/623: creat d5/d9/db/d21/d6e/d6f/d70/d80/db1/fc7 x:0 0 0 2024-09-13T21:40:45.900 INFO:tasks.workunit.client.1.smithi116.stdout:7/624: creat d5/d9/db/fc8 x:0 0 0 2024-09-13T21:40:45.900 INFO:tasks.workunit.client.1.smithi116.stdout:7/625: chown d5/d9/d1c/d22/fc2 39 1 2024-09-13T21:40:45.901 INFO:tasks.workunit.client.1.smithi116.stdout:7/626: mknod d5/d9/db/d21/d6e/d6f/d70/d80/db1/cc9 0 2024-09-13T21:40:45.902 INFO:tasks.workunit.client.1.smithi116.stdout:7/627: mkdir d5/d9/d27/d31/dca 0 2024-09-13T21:40:45.902 INFO:tasks.workunit.client.1.smithi116.stdout:2/535: dread d0/d7/f1e [0,4194304] 0 2024-09-13T21:40:45.903 INFO:tasks.workunit.client.1.smithi116.stdout:7/628: rename d5/d9/d1c/d22/d24/d6b/d72/cb2 to d5/d9/db/d21/d9b/ccb 0 2024-09-13T21:40:45.903 INFO:tasks.workunit.client.1.smithi116.stdout:2/536: mkdir d0/d7/d2b/db6 0 2024-09-13T21:40:45.903 INFO:tasks.workunit.client.1.smithi116.stdout:2/537: fdatasync d0/d3a/d82/d62/f9d 0 2024-09-13T21:40:45.906 INFO:tasks.workunit.client.1.smithi116.stdout:7/629: getdents d5/d9/d1c/d2e 0 2024-09-13T21:40:45.909 INFO:tasks.workunit.client.1.smithi116.stdout:4/577: dwrite d0/dd/d13/d5a/f65 [0,4194304] 0 2024-09-13T21:40:45.909 INFO:tasks.workunit.client.1.smithi116.stdout:4/578: fdatasync d0/dd/d13/d4e/f73 0 2024-09-13T21:40:45.909 INFO:tasks.workunit.client.1.smithi116.stdout:4/579: dread - d0/dd/d13/f91 zero size 2024-09-13T21:40:45.909 INFO:tasks.workunit.client.1.smithi116.stdout:4/580: write d0/dd/d13/d4e/f73 [2970755,73342] 0 2024-09-13T21:40:45.920 INFO:tasks.workunit.client.1.smithi116.stdout:7/630: dwrite d5/d9/db/d21/d6e/d6f/faf [0,4194304] 0 2024-09-13T21:40:45.922 INFO:tasks.workunit.client.1.smithi116.stdout:7/631: readlink d5/d9/d27/l47 0 2024-09-13T21:40:45.922 INFO:tasks.workunit.client.1.smithi116.stdout:7/632: chown d5/d9/db/d21/d6e/d6f/d70/d80/l8f 1879 1 2024-09-13T21:40:45.943 INFO:tasks.workunit.client.1.smithi116.stdout:7/633: dwrite d5/d9/d27/d31/f95 [0,4194304] 0 2024-09-13T21:40:45.945 INFO:tasks.workunit.client.1.smithi116.stdout:7/634: rename d5/d9/d27/d31/c50 to d5/d9/d1c/d2e/d52/ccc 0 2024-09-13T21:40:45.945 INFO:tasks.workunit.client.1.smithi116.stdout:7/635: truncate d5/d9/d27/d31/f71 1658284 0 2024-09-13T21:40:45.945 INFO:tasks.workunit.client.1.smithi116.stdout:7/636: write d5/f5e [95831,80515] 0 2024-09-13T21:40:45.945 INFO:tasks.workunit.client.1.smithi116.stdout:7/637: readlink d5/ld 0 2024-09-13T21:40:45.946 INFO:tasks.workunit.client.1.smithi116.stdout:7/638: symlink d5/d9/d1c/d22/d24/lcd 0 2024-09-13T21:40:45.946 INFO:tasks.workunit.client.1.smithi116.stdout:7/639: fsync d5/d9/d27/d31/f95 0 2024-09-13T21:40:45.946 INFO:tasks.workunit.client.1.smithi116.stdout:7/640: write d5/d9/d1c/d22/d24/d6b/d72/f8c [866737,81368] 0 2024-09-13T21:40:45.947 INFO:tasks.workunit.client.1.smithi116.stdout:7/641: link d5/d9/d1c/d22/d24/d3a/fb6 d5/db0/fce 0 2024-09-13T21:40:45.948 INFO:tasks.workunit.client.1.smithi116.stdout:7/642: mknod d5/d9/db/da7/ccf 0 2024-09-13T21:40:45.949 INFO:tasks.workunit.client.1.smithi116.stdout:7/643: getdents d5/d9/db/d21 0 2024-09-13T21:40:45.950 INFO:tasks.workunit.client.1.smithi116.stdout:7/644: rename d5/f35 to d5/d9/db/d21/d6e/d6f/fd0 0 2024-09-13T21:40:45.957 INFO:tasks.workunit.client.1.smithi116.stdout:7/645: dread d5/d9/d1c/d22/d24/d3a/fb6 [0,4194304] 0 2024-09-13T21:40:45.958 INFO:tasks.workunit.client.1.smithi116.stdout:7/646: creat d5/db0/fd1 x:0 0 0 2024-09-13T21:40:45.958 INFO:tasks.workunit.client.1.smithi116.stdout:7/647: truncate d5/d9/d1c/d22/d24/d6b/d72/fa5 568669 0 2024-09-13T21:40:45.958 INFO:tasks.workunit.client.1.smithi116.stdout:7/648: write d5/d9/d1c/d22/fc2 [71604,76297] 0 2024-09-13T21:40:45.959 INFO:tasks.workunit.client.1.smithi116.stdout:7/649: creat d5/d9/d27/dbe/fd2 x:0 0 0 2024-09-13T21:40:45.965 INFO:tasks.workunit.client.1.smithi116.stdout:7/650: write d5/f4b [1033882,115448] 0 2024-09-13T21:40:45.965 INFO:tasks.workunit.client.1.smithi116.stdout:7/651: creat d5/d9/d27/d31/d38/fd3 x:0 0 0 2024-09-13T21:40:45.967 INFO:tasks.workunit.client.1.smithi116.stdout:7/652: chown d5/d9/d27/c73 1568438 1 2024-09-13T21:40:46.119 INFO:tasks.workunit.client.1.smithi116.stdout:1/447: sync 2024-09-13T21:40:46.119 INFO:tasks.workunit.client.1.smithi116.stdout:6/565: sync 2024-09-13T21:40:46.119 INFO:tasks.workunit.client.1.smithi116.stdout:6/566: chown d8/d15/ca7 27788945 1 2024-09-13T21:40:46.120 INFO:tasks.workunit.client.1.smithi116.stdout:1/448: link d4/d23/f7c d4/d23/d57/fa1 0 2024-09-13T21:40:46.121 INFO:tasks.workunit.client.1.smithi116.stdout:6/567: rename d8/d17/d70/l90 to d8/dca/lcb 0 2024-09-13T21:40:46.122 INFO:tasks.workunit.client.1.smithi116.stdout:1/449: symlink d4/d23/d57/la2 0 2024-09-13T21:40:46.122 INFO:tasks.workunit.client.1.smithi116.stdout:1/450: fdatasync d4/d14/d52/d2f/d91/f94 0 2024-09-13T21:40:46.122 INFO:tasks.workunit.client.1.smithi116.stdout:1/451: read - d4/d23/f8f zero size 2024-09-13T21:40:46.122 INFO:tasks.workunit.client.1.smithi116.stdout:6/568: creat d8/d17/d70/fcc x:0 0 0 2024-09-13T21:40:46.123 INFO:tasks.workunit.client.1.smithi116.stdout:1/452: mkdir d4/d23/d56/da3 0 2024-09-13T21:40:46.123 INFO:tasks.workunit.client.1.smithi116.stdout:1/453: readlink d4/l50 0 2024-09-13T21:40:46.131 INFO:tasks.workunit.client.1.smithi116.stdout:6/569: dread d8/d10/f55 [0,4194304] 0 2024-09-13T21:40:46.133 INFO:tasks.workunit.client.1.smithi116.stdout:6/570: truncate d8/d15/d2e/f69 2192118 0 2024-09-13T21:40:46.133 INFO:tasks.workunit.client.1.smithi116.stdout:6/571: truncate d8/d17/da6/fac 671256 0 2024-09-13T21:40:46.134 INFO:tasks.workunit.client.1.smithi116.stdout:6/572: mkdir d8/d15/d2e/d2f/d38/d9c/dcd 0 2024-09-13T21:40:46.135 INFO:tasks.workunit.client.1.smithi116.stdout:6/573: rename d8/d17/d70/da0/fc6 to d8/d15/d2e/d2f/d38/fce 0 2024-09-13T21:40:46.135 INFO:tasks.workunit.client.1.smithi116.stdout:6/574: readlink d8/d10/d33/l9b 0 2024-09-13T21:40:46.137 INFO:tasks.workunit.client.1.smithi116.stdout:6/575: rename d8/d17/f71 to d8/d15/d2e/fcf 0 2024-09-13T21:40:46.152 INFO:tasks.workunit.client.1.smithi116.stdout:6/576: dwrite d8/d10/f44 [0,4194304] 0 2024-09-13T21:40:46.153 INFO:tasks.workunit.client.1.smithi116.stdout:6/577: read d8/d15/d2e/d2f/d38/f73 [536343,94427] 0 2024-09-13T21:40:46.153 INFO:tasks.workunit.client.1.smithi116.stdout:6/578: readlink d8/d1e/l61 0 2024-09-13T21:40:46.155 INFO:tasks.workunit.client.1.smithi116.stdout:6/579: symlink d8/d1e/dbb/ld0 0 2024-09-13T21:40:46.155 INFO:tasks.workunit.client.1.smithi116.stdout:6/580: chown d8/d17/d70/c8f 224 1 2024-09-13T21:40:46.155 INFO:tasks.workunit.client.1.smithi116.stdout:6/581: chown d8/d15/d2e/d2f/d38 6565 1 2024-09-13T21:40:46.155 INFO:tasks.workunit.client.1.smithi116.stdout:6/582: write d8/d10/d65/f8e [791417,13339] 0 2024-09-13T21:40:46.155 INFO:tasks.workunit.client.1.smithi116.stdout:6/583: truncate d8/d10/d78/fbf 978421 0 2024-09-13T21:40:46.155 INFO:tasks.workunit.client.1.smithi116.stdout:6/584: write d8/d10/d33/fba [526260,40845] 0 2024-09-13T21:40:46.157 INFO:tasks.workunit.client.1.smithi116.stdout:6/585: fsync d8/d10/d65/f8e 0 2024-09-13T21:40:46.157 INFO:tasks.workunit.client.1.smithi116.stdout:6/586: fsync d8/d17/d70/da0/fa4 0 2024-09-13T21:40:46.158 INFO:tasks.workunit.client.1.smithi116.stdout:6/587: symlink d8/d17/da6/ld1 0 2024-09-13T21:40:46.167 INFO:tasks.workunit.client.1.smithi116.stdout:6/588: write d8/d10/d33/f52 [1871628,112301] 0 2024-09-13T21:40:46.185 INFO:tasks.workunit.client.1.smithi116.stdout:6/589: dwrite d8/f87 [0,4194304] 0 2024-09-13T21:40:46.187 INFO:tasks.workunit.client.1.smithi116.stdout:6/590: creat d8/d1e/fd2 x:0 0 0 2024-09-13T21:40:46.188 INFO:tasks.workunit.client.1.smithi116.stdout:6/591: rename d8/d17/l42 to d8/d15/d2e/d2f/ld3 0 2024-09-13T21:40:46.189 INFO:tasks.workunit.client.1.smithi116.stdout:6/592: dread d8/d15/d2e/d2f/d38/f73 [0,4194304] 0 2024-09-13T21:40:46.203 INFO:tasks.workunit.client.1.smithi116.stdout:6/593: dwrite d8/d15/f1f [4194304,4194304] 0 2024-09-13T21:40:46.203 INFO:tasks.workunit.client.1.smithi116.stdout:6/594: dread - d8/d10/f7b zero size 2024-09-13T21:40:46.203 INFO:tasks.workunit.client.1.smithi116.stdout:6/595: chown d8/d10/d24/dab 5 1 2024-09-13T21:40:46.203 INFO:tasks.workunit.client.1.smithi116.stdout:6/596: readlink d8/d10/d24/lbd 0 2024-09-13T21:40:46.204 INFO:tasks.workunit.client.1.smithi116.stdout:6/597: link d8/d15/d2e/d2f/fc9 d8/d10/d78/fd4 0 2024-09-13T21:40:46.205 INFO:tasks.workunit.client.1.smithi116.stdout:6/598: symlink d8/d17/ld5 0 2024-09-13T21:40:46.206 INFO:tasks.workunit.client.1.smithi116.stdout:6/599: mknod d8/d1e/cd6 0 2024-09-13T21:40:46.207 INFO:tasks.workunit.client.1.smithi116.stdout:6/600: mknod d8/d10/d24/dab/cd7 0 2024-09-13T21:40:46.207 INFO:tasks.workunit.client.1.smithi116.stdout:6/601: fdatasync d8/d1e/fd2 0 2024-09-13T21:40:46.207 INFO:tasks.workunit.client.1.smithi116.stdout:6/602: chown d8/d15/d2e/d2f/d38/f73 305 1 2024-09-13T21:40:46.207 INFO:tasks.workunit.client.1.smithi116.stdout:6/603: creat d8/d17/fd8 x:0 0 0 2024-09-13T21:40:46.219 INFO:tasks.workunit.client.1.smithi116.stdout:6/604: dwrite d8/d17/fd8 [0,4194304] 0 2024-09-13T21:40:46.219 INFO:tasks.workunit.client.1.smithi116.stdout:6/605: write d8/d10/d33/f3b [153013,41762] 0 2024-09-13T21:40:46.219 INFO:tasks.workunit.client.1.smithi116.stdout:6/606: write d8/d10/faa [248364,75995] 0 2024-09-13T21:40:46.219 INFO:tasks.workunit.client.1.smithi116.stdout:6/607: chown d8/d15/d2e/d2f/d38/fb8 1 1 2024-09-13T21:40:46.221 INFO:tasks.workunit.client.1.smithi116.stdout:6/608: creat d8/d10/fd9 x:0 0 0 2024-09-13T21:40:46.222 INFO:tasks.workunit.client.1.smithi116.stdout:6/609: symlink d8/d1e/lda 0 2024-09-13T21:40:46.224 INFO:tasks.workunit.client.1.smithi116.stdout:6/610: getdents d8/d10/d24 0 2024-09-13T21:40:46.225 INFO:tasks.workunit.client.1.smithi116.stdout:6/611: symlink d8/dca/ldb 0 2024-09-13T21:40:46.225 INFO:tasks.workunit.client.1.smithi116.stdout:6/612: readlink d8/d15/d2e/l62 0 2024-09-13T21:40:46.228 INFO:tasks.workunit.client.1.smithi116.stdout:6/613: rmdir d8/d10/d78 39 2024-09-13T21:40:46.237 INFO:tasks.workunit.client.1.smithi116.stdout:6/614: read d8/f99 [1773349,98822] 0 2024-09-13T21:40:46.246 INFO:tasks.workunit.client.1.smithi116.stdout:6/615: dread d8/d15/d2e/d2f/d57/f6e [0,4194304] 0 2024-09-13T21:40:46.246 INFO:tasks.workunit.client.1.smithi116.stdout:6/616: dread d8/d10/d78/fbf [0,4194304] 0 2024-09-13T21:40:46.252 INFO:tasks.workunit.client.1.smithi116.stdout:6/617: write d8/d15/d2e/d2f/d57/f6e [1585547,2128] 0 2024-09-13T21:40:46.252 INFO:tasks.workunit.client.1.smithi116.stdout:6/618: chown d8/d17/la9 370884 1 2024-09-13T21:40:46.255 INFO:tasks.workunit.client.1.smithi116.stdout:6/619: dread d8/d15/f1b [0,4194304] 0 2024-09-13T21:40:46.260 INFO:tasks.workunit.client.1.smithi116.stdout:6/620: dread d8/d10/d33/f3b [0,4194304] 0 2024-09-13T21:40:46.261 INFO:tasks.workunit.client.1.smithi116.stdout:6/621: symlink d8/d17/d70/da0/daf/ldc 0 2024-09-13T21:40:46.277 INFO:tasks.workunit.client.1.smithi116.stdout:6/622: dwrite d8/d10/f55 [0,4194304] 0 2024-09-13T21:40:46.277 INFO:tasks.workunit.client.1.smithi116.stdout:6/623: write d8/d10/d33/f67 [3457781,8762] 0 2024-09-13T21:40:46.278 INFO:tasks.workunit.client.1.smithi116.stdout:6/624: dread d8/d15/d2e/d2f/d38/f45 [0,4194304] 0 2024-09-13T21:40:46.298 INFO:tasks.workunit.client.1.smithi116.stdout:6/625: dwrite d8/f99 [0,4194304] 0 2024-09-13T21:40:46.299 INFO:tasks.workunit.client.1.smithi116.stdout:6/626: mkdir d8/d17/d70/da0/daf/ddd 0 2024-09-13T21:40:46.299 INFO:tasks.workunit.client.1.smithi116.stdout:6/627: chown d8/d15/ca7 7971 1 2024-09-13T21:40:46.299 INFO:tasks.workunit.client.1.smithi116.stdout:6/628: chown d8/f9a 26 1 2024-09-13T21:40:46.300 INFO:tasks.workunit.client.1.smithi116.stdout:6/629: creat d8/d15/d2e/d2f/d38/fde x:0 0 0 2024-09-13T21:40:46.300 INFO:tasks.workunit.client.1.smithi116.stdout:6/630: fdatasync d8/d10/f7b 0 2024-09-13T21:40:46.301 INFO:tasks.workunit.client.1.smithi116.stdout:6/631: rmdir d8/d1e 39 2024-09-13T21:40:46.302 INFO:tasks.workunit.client.1.smithi116.stdout:6/632: creat d8/d1e/fdf x:0 0 0 2024-09-13T21:40:46.305 INFO:tasks.workunit.client.1.smithi116.stdout:6/633: rmdir d8/d15/d2e/d2f/d38 39 2024-09-13T21:40:46.307 INFO:tasks.workunit.client.1.smithi116.stdout:6/634: unlink d8/d10/d33/fb9 0 2024-09-13T21:40:46.307 INFO:tasks.workunit.client.1.smithi116.stdout:6/635: mkdir d8/d17/de0 0 2024-09-13T21:40:46.311 INFO:tasks.workunit.client.1.smithi116.stdout:6/636: dread f3 [0,4194304] 0 2024-09-13T21:40:46.367 INFO:tasks.workunit.client.1.smithi116.stdout:8/601: sync 2024-09-13T21:40:46.369 INFO:tasks.workunit.client.1.smithi116.stdout:8/602: getdents d2/d10 0 2024-09-13T21:40:46.371 INFO:tasks.workunit.client.1.smithi116.stdout:8/603: link d2/d27/d62/fab d2/d10/d19/d21/d22/d5d/d46/fb4 0 2024-09-13T21:40:46.372 INFO:tasks.workunit.client.1.smithi116.stdout:8/604: mkdir d2/d10/d19/d21/d69/d90/da9/db5 0 2024-09-13T21:40:46.373 INFO:tasks.workunit.client.1.smithi116.stdout:8/605: mknod d2/d10/d4b/d6e/cb6 0 2024-09-13T21:40:46.373 INFO:tasks.workunit.client.1.smithi116.stdout:8/606: dread - d2/d10/d3e/da4/fa7 zero size 2024-09-13T21:40:46.373 INFO:tasks.workunit.client.1.smithi116.stdout:8/607: dread - d2/d10/d4b/d6e/fb0 zero size 2024-09-13T21:40:46.391 INFO:tasks.workunit.client.1.smithi116.stdout:8/608: dwrite d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:46.393 INFO:tasks.workunit.client.1.smithi116.stdout:8/609: write d2/d10/d19/d21/d22/d5d/d46/f4f [837230,118634] 0 2024-09-13T21:40:46.478 INFO:tasks.workunit.client.1.smithi116.stdout:5/671: sync 2024-09-13T21:40:46.479 INFO:tasks.workunit.client.1.smithi116.stdout:0/679: sync 2024-09-13T21:40:46.479 INFO:tasks.workunit.client.1.smithi116.stdout:5/672: stat d7/d1d/d46/dd4/d5e/c44 0 2024-09-13T21:40:46.479 INFO:tasks.workunit.client.1.smithi116.stdout:5/673: chown d7/d1d/d46/d85 204011 1 2024-09-13T21:40:46.480 INFO:tasks.workunit.client.1.smithi116.stdout:0/680: truncate d2/f60 641682 0 2024-09-13T21:40:46.480 INFO:tasks.workunit.client.1.smithi116.stdout:0/681: write d2/d5/d86/d8a/fca [799067,37602] 0 2024-09-13T21:40:46.487 INFO:tasks.workunit.client.1.smithi116.stdout:5/674: dread d7/d40/d53/f61 [0,4194304] 0 2024-09-13T21:40:46.490 INFO:tasks.workunit.client.1.smithi116.stdout:5/675: link d7/d1d/d46/dd4/d5e/l60 d7/d1d/d46/dd4/d5e/d65/d6a/ldf 0 2024-09-13T21:40:46.497 INFO:tasks.workunit.client.1.smithi116.stdout:0/682: dwrite d2/f73 [4194304,4194304] 0 2024-09-13T21:40:46.500 INFO:tasks.workunit.client.1.smithi116.stdout:0/683: symlink d2/dc/dcf/le6 0 2024-09-13T21:40:46.506 INFO:tasks.workunit.client.1.smithi116.stdout:5/676: dwrite d7/d1d/d46/dd4/d5e/d65/d6f/dd5/fdb [0,4194304] 0 2024-09-13T21:40:46.506 INFO:tasks.workunit.client.1.smithi116.stdout:5/677: chown d7/d40/d53/f61 12 1 2024-09-13T21:40:46.509 INFO:tasks.workunit.client.1.smithi116.stdout:5/678: creat d7/d9a/fe0 x:0 0 0 2024-09-13T21:40:46.511 INFO:tasks.workunit.client.1.smithi116.stdout:5/679: chown d7/c57 228 1 2024-09-13T21:40:46.511 INFO:tasks.workunit.client.1.smithi116.stdout:5/680: dread - d7/d1d/d46/d85/d96/da8/fbe zero size 2024-09-13T21:40:46.512 INFO:tasks.workunit.client.1.smithi116.stdout:5/681: truncate d7/d40/fcf 1504428 0 2024-09-13T21:40:46.513 INFO:tasks.workunit.client.1.smithi116.stdout:5/682: mkdir d7/d1d/d46/de1 0 2024-09-13T21:40:46.514 INFO:tasks.workunit.client.1.smithi116.stdout:5/683: creat d7/d1d/d64/d94/daa/fe2 x:0 0 0 2024-09-13T21:40:46.515 INFO:tasks.workunit.client.1.smithi116.stdout:5/684: mkdir d7/d1d/de3 0 2024-09-13T21:40:46.515 INFO:tasks.workunit.client.1.smithi116.stdout:5/685: symlink d7/d1d/d64/d87/le4 0 2024-09-13T21:40:46.517 INFO:tasks.workunit.client.1.smithi116.stdout:5/686: creat d7/d1d/d46/d85/d96/dd6/fe5 x:0 0 0 2024-09-13T21:40:46.518 INFO:tasks.workunit.client.1.smithi116.stdout:5/687: rmdir d7/d1d/d46/dd4/d5e/d65/da5 39 2024-09-13T21:40:46.518 INFO:tasks.workunit.client.1.smithi116.stdout:0/684: dwrite d2/f73 [0,4194304] 0 2024-09-13T21:40:46.519 INFO:tasks.workunit.client.1.smithi116.stdout:0/685: readlink d2/dc/d12/d51/la4 0 2024-09-13T21:40:46.519 INFO:tasks.workunit.client.1.smithi116.stdout:5/688: dread d7/d40/d53/f6e [0,4194304] 0 2024-09-13T21:40:46.520 INFO:tasks.workunit.client.1.smithi116.stdout:0/686: creat d2/d5/d86/d8a/db1/fe7 x:0 0 0 2024-09-13T21:40:46.521 INFO:tasks.workunit.client.1.smithi116.stdout:5/689: rename d7/d1d/d46/dd4/cd to d7/d40/d80/ce6 0 2024-09-13T21:40:46.522 INFO:tasks.workunit.client.1.smithi116.stdout:5/690: fsync d7/d1d/f45 0 2024-09-13T21:40:46.522 INFO:tasks.workunit.client.1.smithi116.stdout:5/691: truncate d7/d1d/d64/fab 3101688 0 2024-09-13T21:40:46.522 INFO:tasks.workunit.client.1.smithi116.stdout:5/692: chown d7/d1d/d46 4332890 1 2024-09-13T21:40:46.524 INFO:tasks.workunit.client.1.smithi116.stdout:5/693: read d7/d1d/d46/dd4/fb4 [80996,112320] 0 2024-09-13T21:40:46.526 INFO:tasks.workunit.client.1.smithi116.stdout:5/694: rename d7/d1d/d46/d85/d96/cc6 to d7/d1d/d46/d5c/ce7 0 2024-09-13T21:40:46.526 INFO:tasks.workunit.client.1.smithi116.stdout:5/695: fdatasync d7/d1d/d46/d85/fd2 0 2024-09-13T21:40:46.526 INFO:tasks.workunit.client.1.smithi116.stdout:5/696: creat d7/d40/d90/fe8 x:0 0 0 2024-09-13T21:40:46.527 INFO:tasks.workunit.client.1.smithi116.stdout:5/697: creat d7/d1d/d46/d85/d96/fe9 x:0 0 0 2024-09-13T21:40:46.529 INFO:tasks.workunit.client.1.smithi116.stdout:5/698: symlink d7/d1d/dbb/lea 0 2024-09-13T21:40:46.530 INFO:tasks.workunit.client.1.smithi116.stdout:5/699: dread d7/d1d/d46/dd4/fb4 [0,4194304] 0 2024-09-13T21:40:46.531 INFO:tasks.workunit.client.1.smithi116.stdout:5/700: chown d7/d1d/d46/d5c/la7 74 1 2024-09-13T21:40:46.532 INFO:tasks.workunit.client.1.smithi116.stdout:5/701: link d7/d1d/d46/d85/d96/da8/fbe d7/d1d/d64/d94/feb 0 2024-09-13T21:40:46.536 INFO:tasks.workunit.client.1.smithi116.stdout:5/702: dread d7/fa2 [0,4194304] 0 2024-09-13T21:40:46.540 INFO:tasks.workunit.client.1.smithi116.stdout:5/703: fsync d7/d1d/d64/d94/feb 0 2024-09-13T21:40:46.542 INFO:tasks.workunit.client.1.smithi116.stdout:5/704: rmdir d7/d1d/d46/de1 0 2024-09-13T21:40:46.544 INFO:tasks.workunit.client.1.smithi116.stdout:5/705: getdents d7/d40/d90 0 2024-09-13T21:40:46.544 INFO:tasks.workunit.client.1.smithi116.stdout:5/706: chown d7/d1d/d64/d87/f98 1372 1 2024-09-13T21:40:46.544 INFO:tasks.workunit.client.1.smithi116.stdout:5/707: stat d7/d1d/d46/d85/lce 0 2024-09-13T21:40:46.545 INFO:tasks.workunit.client.1.smithi116.stdout:5/708: symlink d7/d1d/d46/dd4/d5e/d65/d6f/lec 0 2024-09-13T21:40:46.725 INFO:tasks.workunit.client.1.smithi116.stdout:3/691: sync 2024-09-13T21:40:46.725 INFO:tasks.workunit.client.1.smithi116.stdout:9/382: sync 2024-09-13T21:40:46.725 INFO:tasks.workunit.client.1.smithi116.stdout:9/383: chown d2/d10/d14/f44 31 1 2024-09-13T21:40:46.725 INFO:tasks.workunit.client.1.smithi116.stdout:3/692: dread - d3/db/d26/f9e zero size 2024-09-13T21:40:46.725 INFO:tasks.workunit.client.1.smithi116.stdout:3/693: fdatasync d3/db/f3e 0 2024-09-13T21:40:46.726 INFO:tasks.workunit.client.1.smithi116.stdout:3/694: mknod d3/db/d10/d1c/d34/d55/d96/cf6 0 2024-09-13T21:40:46.726 INFO:tasks.workunit.client.1.smithi116.stdout:3/695: fsync d3/f73 0 2024-09-13T21:40:46.727 INFO:tasks.workunit.client.1.smithi116.stdout:9/384: symlink d2/d8/l73 0 2024-09-13T21:40:46.727 INFO:tasks.workunit.client.1.smithi116.stdout:9/385: fdatasync d2/f1e 0 2024-09-13T21:40:46.749 INFO:tasks.workunit.client.1.smithi116.stdout:3/696: dwrite d3/db/d3d/d40/f42 [4194304,4194304] 0 2024-09-13T21:40:46.749 INFO:tasks.workunit.client.1.smithi116.stdout:9/386: dwrite d2/d10/d14/f44 [4194304,4194304] 0 2024-09-13T21:40:46.750 INFO:tasks.workunit.client.1.smithi116.stdout:9/387: chown d2/d5d/d69/d47/c60 263408190 1 2024-09-13T21:40:46.752 INFO:tasks.workunit.client.1.smithi116.stdout:9/388: getdents d2/d10/d14 0 2024-09-13T21:40:46.752 INFO:tasks.workunit.client.1.smithi116.stdout:9/389: chown d2/f3 30052 1 2024-09-13T21:40:46.754 INFO:tasks.workunit.client.1.smithi116.stdout:9/390: mknod d2/d5d/d69/c74 0 2024-09-13T21:40:46.756 INFO:tasks.workunit.client.1.smithi116.stdout:9/391: link d2/d10/f20 d2/d5d/d69/f75 0 2024-09-13T21:40:46.766 INFO:tasks.workunit.client.1.smithi116.stdout:9/392: dread d2/f4 [0,4194304] 0 2024-09-13T21:40:46.767 INFO:tasks.workunit.client.1.smithi116.stdout:9/393: getdents d2/d8/d3e 0 2024-09-13T21:40:46.767 INFO:tasks.workunit.client.1.smithi116.stdout:9/394: readlink d2/d8/l16 0 2024-09-13T21:40:46.773 INFO:tasks.workunit.client.1.smithi116.stdout:9/395: dread d2/d8/f1a [0,4194304] 0 2024-09-13T21:40:46.773 INFO:tasks.workunit.client.1.smithi116.stdout:3/697: dwrite d3/db/d10/d1c/d34/d47/f51 [0,4194304] 0 2024-09-13T21:40:46.773 INFO:tasks.workunit.client.1.smithi116.stdout:9/396: chown d2/d5d/d69/d47/l49 2 1 2024-09-13T21:40:46.774 INFO:tasks.workunit.client.1.smithi116.stdout:9/397: chown d2/d10/d14/d38 908000673 1 2024-09-13T21:40:46.775 INFO:tasks.workunit.client.1.smithi116.stdout:9/398: creat d2/d8/f76 x:0 0 0 2024-09-13T21:40:46.778 INFO:tasks.workunit.client.1.smithi116.stdout:3/698: mknod d3/db/d10/d1d/d2f/d61/cf7 0 2024-09-13T21:40:46.780 INFO:tasks.workunit.client.1.smithi116.stdout:3/699: symlink d3/db/d10/d1d/lf8 0 2024-09-13T21:40:46.781 INFO:tasks.workunit.client.1.smithi116.stdout:3/700: dread d3/f73 [0,4194304] 0 2024-09-13T21:40:46.784 INFO:tasks.workunit.client.1.smithi116.stdout:7/653: sync 2024-09-13T21:40:46.784 INFO:tasks.workunit.client.1.smithi116.stdout:4/581: sync 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:2/538: sync 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:7/654: fsync d5/d9/db/fc8 0 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:1/454: sync 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:6/637: sync 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:0/687: sync 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:5/709: sync 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:5/710: truncate d7/d1d/d64/d87/f8a 788150 0 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:5/711: write d7/d1d/d64/d87/f98 [3416898,88002] 0 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:5/712: truncate d7/d9a/fe0 1014053 0 2024-09-13T21:40:46.785 INFO:tasks.workunit.client.1.smithi116.stdout:8/610: sync 2024-09-13T21:40:46.786 INFO:tasks.workunit.client.1.smithi116.stdout:7/655: read d5/d9/d27/d31/d38/d48/f94 [798935,1335] 0 2024-09-13T21:40:46.786 INFO:tasks.workunit.client.1.smithi116.stdout:1/455: truncate d4/d14/d2a/f88 345566 0 2024-09-13T21:40:46.788 INFO:tasks.workunit.client.1.smithi116.stdout:8/611: dread d2/d10/d19/d21/d22/d5d/d46/f4f [0,4194304] 0 2024-09-13T21:40:46.788 INFO:tasks.workunit.client.1.smithi116.stdout:8/612: dread - d2/d5c/f85 zero size 2024-09-13T21:40:46.788 INFO:tasks.workunit.client.1.smithi116.stdout:8/613: chown d2/d10/d4b/f50 1499785 1 2024-09-13T21:40:46.789 INFO:tasks.workunit.client.1.smithi116.stdout:2/539: dread d0/d3a/d82/d62/d75/d77/f99 [0,4194304] 0 2024-09-13T21:40:46.790 INFO:tasks.workunit.client.1.smithi116.stdout:3/701: rename d3/db/d10/d62 to d3/df9 0 2024-09-13T21:40:46.790 INFO:tasks.workunit.client.1.smithi116.stdout:1/456: getdents d4/d14/d52/d2f/d91 0 2024-09-13T21:40:46.790 INFO:tasks.workunit.client.1.smithi116.stdout:1/457: creat d4/d14/fa4 x:0 0 0 2024-09-13T21:40:46.791 INFO:tasks.workunit.client.1.smithi116.stdout:2/540: mknod d0/d3a/d82/d62/d75/d77/cb7 0 2024-09-13T21:40:46.791 INFO:tasks.workunit.client.1.smithi116.stdout:2/541: dread - d0/d5/d2a/f57 zero size 2024-09-13T21:40:46.792 INFO:tasks.workunit.client.1.smithi116.stdout:4/582: write d0/dd/d13/f4c [681398,53883] 0 2024-09-13T21:40:46.794 INFO:tasks.workunit.client.1.smithi116.stdout:3/702: rename d3/db/d20/f23 to d3/db/d10/d99/ffa 0 2024-09-13T21:40:46.794 INFO:tasks.workunit.client.1.smithi116.stdout:3/703: dread d3/db/f43 [0,4194304] 0 2024-09-13T21:40:46.794 INFO:tasks.workunit.client.1.smithi116.stdout:3/704: stat d3/db/d10/d1c/d34/d55/d57/f7a 0 2024-09-13T21:40:46.796 INFO:tasks.workunit.client.1.smithi116.stdout:1/458: mknod d4/d14/d52/d2f/d91/ca5 0 2024-09-13T21:40:46.797 INFO:tasks.workunit.client.1.smithi116.stdout:5/713: write d7/fc [3598561,38941] 0 2024-09-13T21:40:46.798 INFO:tasks.workunit.client.1.smithi116.stdout:2/542: mknod d0/d3a/cb8 0 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:2/543: write d0/d5/d2a/fa7 [118495,97418] 0 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:9/399: dwrite d2/d10/d14/d38/f6b [0,4194304] 0 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:9/400: dread - d2/d5d/f62 zero size 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:2/544: write d0/d5/d2a/fa7 [648124,18181] 0 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:2/545: write d0/fae [591138,98342] 0 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:2/546: fdatasync d0/d3a/d82/d62/f1d 0 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:2/547: write d0/d7/d49/f90 [230461,50478] 0 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:8/614: dread d2/d10/d19/d21/d69/f8b [0,4194304] 0 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:2/548: write d0/d3a/d82/d62/d1f/d5d/d89/f9c [579251,50166] 0 2024-09-13T21:40:46.799 INFO:tasks.workunit.client.1.smithi116.stdout:2/549: fdatasync d0/d7/f6e 0 2024-09-13T21:40:46.800 INFO:tasks.workunit.client.1.smithi116.stdout:4/583: symlink d0/d32/d5f/lac 0 2024-09-13T21:40:46.801 INFO:tasks.workunit.client.1.smithi116.stdout:5/714: dread d7/d1d/dbb/fd9 [0,4194304] 0 2024-09-13T21:40:46.802 INFO:tasks.workunit.client.1.smithi116.stdout:0/688: rename d2/d5/l6d to d2/dc/dcf/le8 0 2024-09-13T21:40:46.804 INFO:tasks.workunit.client.1.smithi116.stdout:1/459: creat d4/d23/d57/d92/fa6 x:0 0 0 2024-09-13T21:40:46.804 INFO:tasks.workunit.client.1.smithi116.stdout:1/460: creat d4/d74/d8d/fa7 x:0 0 0 2024-09-13T21:40:46.805 INFO:tasks.workunit.client.1.smithi116.stdout:6/638: dwrite d8/d17/d70/fb2 [0,4194304] 0 2024-09-13T21:40:46.806 INFO:tasks.workunit.client.1.smithi116.stdout:5/715: symlink d7/d1d/d46/d85/d96/da8/led 0 2024-09-13T21:40:46.808 INFO:tasks.workunit.client.1.smithi116.stdout:2/550: dread d0/d5/f4b [0,4194304] 0 2024-09-13T21:40:46.809 INFO:tasks.workunit.client.1.smithi116.stdout:2/551: read - d0/d5/d2a/f57 zero size 2024-09-13T21:40:46.810 INFO:tasks.workunit.client.1.smithi116.stdout:0/689: mkdir d2/d5/de9 0 2024-09-13T21:40:46.810 INFO:tasks.workunit.client.1.smithi116.stdout:0/690: write d2/dc/d12/d28/fe1 [301022,92797] 0 2024-09-13T21:40:46.814 INFO:tasks.workunit.client.1.smithi116.stdout:5/716: dread d7/fc [0,4194304] 0 2024-09-13T21:40:46.815 INFO:tasks.workunit.client.1.smithi116.stdout:6/639: symlink d8/d15/d2e/d2f/d38/le1 0 2024-09-13T21:40:46.815 INFO:tasks.workunit.client.1.smithi116.stdout:1/461: write d4/d14/d41/f98 [1525023,56135] 0 2024-09-13T21:40:46.815 INFO:tasks.workunit.client.1.smithi116.stdout:1/462: write d4/d74/f80 [1010110,76350] 0 2024-09-13T21:40:46.818 INFO:tasks.workunit.client.1.smithi116.stdout:0/691: mkdir d2/dc/dcc/dea 0 2024-09-13T21:40:46.818 INFO:tasks.workunit.client.1.smithi116.stdout:9/401: dread d2/d10/f32 [0,4194304] 0 2024-09-13T21:40:46.818 INFO:tasks.workunit.client.1.smithi116.stdout:0/692: write d2/d5b/f6f [262049,95404] 0 2024-09-13T21:40:46.820 INFO:tasks.workunit.client.1.smithi116.stdout:6/640: mkdir d8/d10/d78/de2 0 2024-09-13T21:40:46.822 INFO:tasks.workunit.client.1.smithi116.stdout:7/656: rename d5/d9/db/d21/d9b to d5/d9/d1c/d22/d24/d6b/d72/dd4 0 2024-09-13T21:40:46.822 INFO:tasks.workunit.client.1.smithi116.stdout:7/657: stat d5/d9/db/d21/f49 0 2024-09-13T21:40:46.822 INFO:tasks.workunit.client.1.smithi116.stdout:7/658: write d5/d9/db/d21/d6e/f9a [4860394,15494] 0 2024-09-13T21:40:46.822 INFO:tasks.workunit.client.1.smithi116.stdout:7/659: chown d5/d9/d27/d31/lbd 41269504 1 2024-09-13T21:40:46.822 INFO:tasks.workunit.client.1.smithi116.stdout:7/660: fsync d5/d9/d1c/d22/d24/d5f/fc6 0 2024-09-13T21:40:46.822 INFO:tasks.workunit.client.1.smithi116.stdout:0/693: dread d2/dc/d12/d28/f9c [0,4194304] 0 2024-09-13T21:40:46.823 INFO:tasks.workunit.client.1.smithi116.stdout:6/641: mknod d8/d15/d2e/d2f/d38/ce3 0 2024-09-13T21:40:46.824 INFO:tasks.workunit.client.1.smithi116.stdout:1/463: rename d4/d14/d52/d2f/d91/ca5 to d4/d23/d57/ca8 0 2024-09-13T21:40:46.825 INFO:tasks.workunit.client.1.smithi116.stdout:1/464: chown f1 339940190 1 2024-09-13T21:40:46.825 INFO:tasks.workunit.client.1.smithi116.stdout:7/661: creat d5/fd5 x:0 0 0 2024-09-13T21:40:46.825 INFO:tasks.workunit.client.1.smithi116.stdout:7/662: chown d5/d9/d1c/d22/d24/d6b/d72/f8c 728045090 1 2024-09-13T21:40:46.826 INFO:tasks.workunit.client.1.smithi116.stdout:6/642: symlink d8/d15/d2e/d9e/le4 0 2024-09-13T21:40:46.827 INFO:tasks.workunit.client.1.smithi116.stdout:9/402: rename d2/d10/c17 to d2/d5d/d69/c77 0 2024-09-13T21:40:46.830 INFO:tasks.workunit.client.1.smithi116.stdout:7/663: write d5/d9/d27/d31/f71 [102724,11464] 0 2024-09-13T21:40:46.830 INFO:tasks.workunit.client.1.smithi116.stdout:9/403: link d2/d10/l1f d2/d10/d14/d38/d3a/l78 0 2024-09-13T21:40:46.830 INFO:tasks.workunit.client.1.smithi116.stdout:9/404: dread - d2/d43/f68 zero size 2024-09-13T21:40:46.831 INFO:tasks.workunit.client.1.smithi116.stdout:7/664: creat d5/d9/d1c/d22/d24/d6b/fd6 x:0 0 0 2024-09-13T21:40:46.831 INFO:tasks.workunit.client.1.smithi116.stdout:7/665: stat d5/d9/d1c/d37 0 2024-09-13T21:40:46.831 INFO:tasks.workunit.client.1.smithi116.stdout:9/405: creat d2/d72/f79 x:0 0 0 2024-09-13T21:40:46.833 INFO:tasks.workunit.client.1.smithi116.stdout:3/705: dwrite d3/db/d10/d1d/d5f/d6f/fb9 [0,4194304] 0 2024-09-13T21:40:46.833 INFO:tasks.workunit.client.1.smithi116.stdout:3/706: write d3/db/d10/d1d/d5f/ff5 [464157,90764] 0 2024-09-13T21:40:46.833 INFO:tasks.workunit.client.1.smithi116.stdout:3/707: truncate d3/db/ff 2853315 0 2024-09-13T21:40:46.835 INFO:tasks.workunit.client.1.smithi116.stdout:9/406: write d2/d10/d14/d38/f4f [13134,92733] 0 2024-09-13T21:40:46.835 INFO:tasks.workunit.client.1.smithi116.stdout:9/407: write d2/f2f [779981,114406] 0 2024-09-13T21:40:46.835 INFO:tasks.workunit.client.1.smithi116.stdout:9/408: chown d2/d5d/d69/f4b 1122745540 1 2024-09-13T21:40:46.837 INFO:tasks.workunit.client.1.smithi116.stdout:9/409: getdents d2/d43 0 2024-09-13T21:40:46.839 INFO:tasks.workunit.client.1.smithi116.stdout:9/410: creat d2/d10/d4c/f7a x:0 0 0 2024-09-13T21:40:46.839 INFO:tasks.workunit.client.1.smithi116.stdout:9/411: fsync d2/f5f 0 2024-09-13T21:40:46.839 INFO:tasks.workunit.client.1.smithi116.stdout:9/412: chown d2/d10/d4c/f5a 5 1 2024-09-13T21:40:46.839 INFO:tasks.workunit.client.1.smithi116.stdout:9/413: write d2/d10/d14/d38/f4f [788723,118288] 0 2024-09-13T21:40:46.839 INFO:tasks.workunit.client.1.smithi116.stdout:9/414: write d2/d10/d4c/f7a [181775,17313] 0 2024-09-13T21:40:46.844 INFO:tasks.workunit.client.1.smithi116.stdout:4/584: dwrite d0/d32/f3e [4194304,4194304] 0 2024-09-13T21:40:46.844 INFO:tasks.workunit.client.1.smithi116.stdout:4/585: fsync d0/d56/d84/fa4 0 2024-09-13T21:40:46.845 INFO:tasks.workunit.client.1.smithi116.stdout:4/586: fdatasync d0/dd/d13/d4e/f7f 0 2024-09-13T21:40:46.845 INFO:tasks.workunit.client.1.smithi116.stdout:5/717: dwrite d7/d1d/f99 [0,4194304] 0 2024-09-13T21:40:46.851 INFO:tasks.workunit.client.1.smithi116.stdout:3/708: read d3/db/d10/d1c/d63/f64 [2726397,84800] 0 2024-09-13T21:40:46.851 INFO:tasks.workunit.client.1.smithi116.stdout:2/552: dwrite d0/d5/f4b [0,4194304] 0 2024-09-13T21:40:46.852 INFO:tasks.workunit.client.1.smithi116.stdout:5/718: creat d7/d1d/de3/fee x:0 0 0 2024-09-13T21:40:46.861 INFO:tasks.workunit.client.1.smithi116.stdout:5/719: creat d7/d1d/d46/d85/d96/da8/db9/fef x:0 0 0 2024-09-13T21:40:46.861 INFO:tasks.workunit.client.1.smithi116.stdout:5/720: fsync d7/d40/f81 0 2024-09-13T21:40:46.864 INFO:tasks.workunit.client.1.smithi116.stdout:1/465: dwrite d4/f20 [4194304,4194304] 0 2024-09-13T21:40:46.866 INFO:tasks.workunit.client.1.smithi116.stdout:1/466: creat d4/d14/d52/d2f/d91/fa9 x:0 0 0 2024-09-13T21:40:46.866 INFO:tasks.workunit.client.1.smithi116.stdout:1/467: creat d4/d14/d52/faa x:0 0 0 2024-09-13T21:40:46.866 INFO:tasks.workunit.client.1.smithi116.stdout:1/468: fdatasync d4/d14/d52/d2f/f4b 0 2024-09-13T21:40:46.866 INFO:tasks.workunit.client.1.smithi116.stdout:1/469: truncate d4/d14/d2a/f88 1295605 0 2024-09-13T21:40:46.868 INFO:tasks.workunit.client.1.smithi116.stdout:0/694: dwrite d2/dc/d12/d28/f32 [4194304,4194304] 0 2024-09-13T21:40:46.868 INFO:tasks.workunit.client.1.smithi116.stdout:0/695: readlink d2/d5/dbe/ldb 0 2024-09-13T21:40:46.868 INFO:tasks.workunit.client.1.smithi116.stdout:1/470: mkdir d4/d14/d41/dab 0 2024-09-13T21:40:46.871 INFO:tasks.workunit.client.1.smithi116.stdout:0/696: link d2/dc/d12/d51/f91 d2/d5/d61/feb 0 2024-09-13T21:40:46.873 INFO:tasks.workunit.client.1.smithi116.stdout:0/697: symlink d2/dc/dcf/lec 0 2024-09-13T21:40:46.874 INFO:tasks.workunit.client.1.smithi116.stdout:1/471: getdents d4 0 2024-09-13T21:40:46.874 INFO:tasks.workunit.client.1.smithi116.stdout:1/472: write d4/d14/d52/d2f/d5d/f9f [415661,95674] 0 2024-09-13T21:40:46.876 INFO:tasks.workunit.client.1.smithi116.stdout:0/698: link d2/dc/d47/d63/d9f/db6/fc2 d2/dc/d47/d63/fed 0 2024-09-13T21:40:46.876 INFO:tasks.workunit.client.1.smithi116.stdout:0/699: chown d2/d5/d86/d8a/lba 137710 1 2024-09-13T21:40:46.878 INFO:tasks.workunit.client.1.smithi116.stdout:1/473: unlink d4/d23/d57/c58 0 2024-09-13T21:40:46.881 INFO:tasks.workunit.client.1.smithi116.stdout:5/721: write d7/f5d [4928,119316] 0 2024-09-13T21:40:46.882 INFO:tasks.workunit.client.1.smithi116.stdout:5/722: readlink d7/d1d/d46/dd4/d5e/l28 0 2024-09-13T21:40:46.884 INFO:tasks.workunit.client.1.smithi116.stdout:5/723: mkdir d7/d1d/d46/d85/d96/da8/df0 0 2024-09-13T21:40:46.884 INFO:tasks.workunit.client.1.smithi116.stdout:5/724: write d7/d1d/d46/d85/d96/dd6/fe5 [516140,23758] 0 2024-09-13T21:40:46.887 INFO:tasks.workunit.client.1.smithi116.stdout:0/700: dread d2/dc/d12/d28/f88 [0,4194304] 0 2024-09-13T21:40:46.887 INFO:tasks.workunit.client.1.smithi116.stdout:0/701: stat d2/d5/d61/l97 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:6/643: dwrite d8/d10/d33/f8a [0,4194304] 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:4/587: dwrite d0/dd/d13/f4c [0,4194304] 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:7/666: dwrite d5/d9/db/d21/d6e/d6f/faf [0,4194304] 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:7/667: creat d5/fd7 x:0 0 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:7/668: readlink d5/d9/d1c/d2e/l9c 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:9/415: dwrite d2/d10/d14/d38/d3a/f6c [0,4194304] 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:9/416: read d2/d10/d4c/f51 [232589,71029] 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:5/725: rmdir d7/d1d/d46/dd4/d5e/d65/d6f 39 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:3/709: dwrite d3/db/d10/d1c/d34/f8f [0,4194304] 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:3/710: creat d3/db/d20/d50/ffb x:0 0 0 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:3/711: chown d3/db/d20/d50/ffb 72805 1 2024-09-13T21:40:46.890 INFO:tasks.workunit.client.1.smithi116.stdout:3/712: readlink d3/db/d20/d50/l74 0 2024-09-13T21:40:46.891 INFO:tasks.workunit.client.1.smithi116.stdout:3/713: creat d3/db/d10/d29/ffc x:0 0 0 2024-09-13T21:40:46.891 INFO:tasks.workunit.client.1.smithi116.stdout:3/714: fsync d3/db/d10/d1c/d63/f64 0 2024-09-13T21:40:46.891 INFO:tasks.workunit.client.1.smithi116.stdout:0/702: rename d2/dc/d12/d51/l59 to d2/dc/dce/lee 0 2024-09-13T21:40:46.895 INFO:tasks.workunit.client.1.smithi116.stdout:7/669: creat d5/d9/d27/d31/fd8 x:0 0 0 2024-09-13T21:40:46.900 INFO:tasks.workunit.client.1.smithi116.stdout:1/474: getdents d4/d14/d41 0 2024-09-13T21:40:46.901 INFO:tasks.workunit.client.1.smithi116.stdout:9/417: creat d2/d5d/d69/d47/f7b x:0 0 0 2024-09-13T21:40:46.905 INFO:tasks.workunit.client.1.smithi116.stdout:6/644: dwrite d8/d15/d2e/d2f/d57/f6e [4194304,4194304] 0 2024-09-13T21:40:46.905 INFO:tasks.workunit.client.1.smithi116.stdout:4/588: write d0/dd/d13/d5a/f65 [3688523,84977] 0 2024-09-13T21:40:46.905 INFO:tasks.workunit.client.1.smithi116.stdout:6/645: write d8/d1e/f53 [2331515,60974] 0 2024-09-13T21:40:46.906 INFO:tasks.workunit.client.1.smithi116.stdout:3/715: creat d3/df9/ffd x:0 0 0 2024-09-13T21:40:46.906 INFO:tasks.workunit.client.1.smithi116.stdout:3/716: creat d3/db/d10/d99/ffe x:0 0 0 2024-09-13T21:40:46.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/726: rename d7/d1d/d46/d5c/dcc/ld0 to d7/d1d/d46/dd4/d5e/d65/d6f/dd5/lf1 0 2024-09-13T21:40:46.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/727: creat d7/d1d/d46/d85/d96/da8/db9/ff2 x:0 0 0 2024-09-13T21:40:46.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/728: read d7/d40/d53/f6e [229884,15577] 0 2024-09-13T21:40:46.911 INFO:tasks.workunit.client.1.smithi116.stdout:5/729: chown d7/d1d/d46/dd4/d5e/d65/d6a/ldf 65 1 2024-09-13T21:40:46.912 INFO:tasks.workunit.client.1.smithi116.stdout:0/703: creat d2/d5/de9/fef x:0 0 0 2024-09-13T21:40:46.912 INFO:tasks.workunit.client.1.smithi116.stdout:4/589: dread d0/d32/d5f/f63 [0,4194304] 0 2024-09-13T21:40:46.913 INFO:tasks.workunit.client.1.smithi116.stdout:7/670: symlink d5/d9/d1c/d22/d24/d3a/ld9 0 2024-09-13T21:40:46.913 INFO:tasks.workunit.client.1.smithi116.stdout:7/671: creat d5/d9/d1c/d22/fda x:0 0 0 2024-09-13T21:40:46.913 INFO:tasks.workunit.client.1.smithi116.stdout:7/672: creat d5/d9/d1c/d22/fdb x:0 0 0 2024-09-13T21:40:46.913 INFO:tasks.workunit.client.1.smithi116.stdout:7/673: stat d5/d9/d1c/d22/l2f 0 2024-09-13T21:40:46.914 INFO:tasks.workunit.client.1.smithi116.stdout:6/646: mkdir d8/d15/d2e/d2f/d38/d9c/dcd/de5 0 2024-09-13T21:40:46.915 INFO:tasks.workunit.client.1.smithi116.stdout:6/647: fsync d8/d15/d2e/d2f/d57/f6e 0 2024-09-13T21:40:46.915 INFO:tasks.workunit.client.1.smithi116.stdout:6/648: write d8/d10/d78/fd4 [913124,21739] 0 2024-09-13T21:40:46.916 INFO:tasks.workunit.client.1.smithi116.stdout:9/418: dread d2/d10/f20 [0,4194304] 0 2024-09-13T21:40:46.920 INFO:tasks.workunit.client.1.smithi116.stdout:0/704: mknod d2/dc/d47/d63/d9f/cf0 0 2024-09-13T21:40:46.920 INFO:tasks.workunit.client.1.smithi116.stdout:5/730: mkdir d7/d1d/d46/dc0/df3 0 2024-09-13T21:40:46.921 INFO:tasks.workunit.client.1.smithi116.stdout:3/717: dread d3/db/f3e [0,4194304] 0 2024-09-13T21:40:46.922 INFO:tasks.workunit.client.1.smithi116.stdout:3/718: dread d3/f82 [0,4194304] 0 2024-09-13T21:40:46.923 INFO:tasks.workunit.client.1.smithi116.stdout:7/674: mkdir d5/d9/d1c/d22/d24/d3a/ddc 0 2024-09-13T21:40:46.923 INFO:tasks.workunit.client.1.smithi116.stdout:7/675: fsync d5/d9/d27/dbe/fd2 0 2024-09-13T21:40:46.925 INFO:tasks.workunit.client.1.smithi116.stdout:9/419: truncate d2/d10/d4c/f51 167918 0 2024-09-13T21:40:46.927 INFO:tasks.workunit.client.1.smithi116.stdout:4/590: rmdir d0/d32/d5d 39 2024-09-13T21:40:46.929 INFO:tasks.workunit.client.1.smithi116.stdout:5/731: rename d7/d1d/d46/d5c/la1 to d7/d1d/d46/dd4/d5e/d65/d6f/lf4 0 2024-09-13T21:40:46.929 INFO:tasks.workunit.client.1.smithi116.stdout:5/732: write d7/d1d/f70 [516889,26447] 0 2024-09-13T21:40:46.929 INFO:tasks.workunit.client.1.smithi116.stdout:5/733: fdatasync d7/d40/d53/f89 0 2024-09-13T21:40:46.930 INFO:tasks.workunit.client.1.smithi116.stdout:7/676: mknod d5/d9/d27/d31/d38/d42/cdd 0 2024-09-13T21:40:46.932 INFO:tasks.workunit.client.1.smithi116.stdout:9/420: creat d2/d10/d14/d38/d3a/f7c x:0 0 0 2024-09-13T21:40:46.932 INFO:tasks.workunit.client.1.smithi116.stdout:9/421: dread - d2/d5d/d69/d47/f7b zero size 2024-09-13T21:40:46.932 INFO:tasks.workunit.client.1.smithi116.stdout:0/705: write d2/dc/d12/d28/f32 [5781414,443] 0 2024-09-13T21:40:46.933 INFO:tasks.workunit.client.1.smithi116.stdout:1/475: dwrite d4/f8b [0,4194304] 0 2024-09-13T21:40:46.937 INFO:tasks.workunit.client.1.smithi116.stdout:3/719: rmdir d3/db/d26 39 2024-09-13T21:40:46.937 INFO:tasks.workunit.client.1.smithi116.stdout:3/720: fsync d3/db/d10/d1c/d34/d55/d57/dc6/fe6 0 2024-09-13T21:40:46.938 INFO:tasks.workunit.client.1.smithi116.stdout:1/476: dread d4/d14/d41/f98 [0,4194304] 0 2024-09-13T21:40:46.938 INFO:tasks.workunit.client.1.smithi116.stdout:1/477: chown d4/d23/f8f 8914 1 2024-09-13T21:40:46.938 INFO:tasks.workunit.client.1.smithi116.stdout:1/478: chown d4/l47 4 1 2024-09-13T21:40:46.939 INFO:tasks.workunit.client.1.smithi116.stdout:9/422: mkdir d2/d5d/d69/d7d 0 2024-09-13T21:40:46.939 INFO:tasks.workunit.client.1.smithi116.stdout:9/423: fsync d2/d8/d3e/f4d 0 2024-09-13T21:40:46.943 INFO:tasks.workunit.client.1.smithi116.stdout:3/721: mknod d3/cff 0 2024-09-13T21:40:46.945 INFO:tasks.workunit.client.1.smithi116.stdout:6/649: dwrite d8/d10/d33/f52 [0,4194304] 0 2024-09-13T21:40:46.945 INFO:tasks.workunit.client.1.smithi116.stdout:7/677: dread d5/d9/f3d [4194304,4194304] 0 2024-09-13T21:40:46.945 INFO:tasks.workunit.client.1.smithi116.stdout:6/650: chown d8/d10/d33/l9b 20 1 2024-09-13T21:40:46.946 INFO:tasks.workunit.client.1.smithi116.stdout:1/479: mkdir d4/d14/d52/d2f/d91/dac 0 2024-09-13T21:40:46.947 INFO:tasks.workunit.client.1.smithi116.stdout:7/678: creat d5/d9/d1c/d2e/d52/fde x:0 0 0 2024-09-13T21:40:46.948 INFO:tasks.workunit.client.1.smithi116.stdout:6/651: getdents d8/d10/d78 0 2024-09-13T21:40:46.950 INFO:tasks.workunit.client.1.smithi116.stdout:1/480: rename d4/d14/d52/d2f/d5d/l72 to d4/d74/d8d/lad 0 2024-09-13T21:40:46.952 INFO:tasks.workunit.client.1.smithi116.stdout:7/679: link d5/d9/d27/d31/lbd d5/d9/db/d21/d6e/d6f/d70/ldf 0 2024-09-13T21:40:46.954 INFO:tasks.workunit.client.1.smithi116.stdout:1/481: rename d4/d14/d2a/l62 to d4/d14/d41/dab/lae 0 2024-09-13T21:40:46.955 INFO:tasks.workunit.client.1.smithi116.stdout:5/734: getdents d7/d1d/d46/d5c 0 2024-09-13T21:40:46.957 INFO:tasks.workunit.client.1.smithi116.stdout:5/735: fdatasync d7/f3f 0 2024-09-13T21:40:46.957 INFO:tasks.workunit.client.1.smithi116.stdout:5/736: write d7/d1d/d46/dd4/d5e/d65/d6a/fb1 [389113,110555] 0 2024-09-13T21:40:46.961 INFO:tasks.workunit.client.1.smithi116.stdout:6/652: dread d8/d10/f44 [0,4194304] 0 2024-09-13T21:40:46.961 INFO:tasks.workunit.client.1.smithi116.stdout:6/653: write d8/d10/fd9 [134889,83785] 0 2024-09-13T21:40:46.961 INFO:tasks.workunit.client.1.smithi116.stdout:6/654: readlink d8/d15/d2e/l62 0 2024-09-13T21:40:46.961 INFO:tasks.workunit.client.1.smithi116.stdout:6/655: chown d8/d17/da6/fac 15901941 1 2024-09-13T21:40:46.965 INFO:tasks.workunit.client.1.smithi116.stdout:4/591: dwrite d0/f8 [0,4194304] 0 2024-09-13T21:40:46.968 INFO:tasks.workunit.client.1.smithi116.stdout:4/592: mkdir d0/dad 0 2024-09-13T21:40:46.969 INFO:tasks.workunit.client.1.smithi116.stdout:4/593: symlink d0/dd/d13/lae 0 2024-09-13T21:40:46.971 INFO:tasks.workunit.client.1.smithi116.stdout:4/594: unlink d0/dd/d13/l7e 0 2024-09-13T21:40:46.971 INFO:tasks.workunit.client.1.smithi116.stdout:4/595: fsync d0/dd/d13/d5a/d86/f8f 0 2024-09-13T21:40:46.971 INFO:tasks.workunit.client.1.smithi116.stdout:4/596: creat d0/dd/faf x:0 0 0 2024-09-13T21:40:46.973 INFO:tasks.workunit.client.1.smithi116.stdout:4/597: rename d0/f8 to d0/dd/d7c/fb0 0 2024-09-13T21:40:46.975 INFO:tasks.workunit.client.1.smithi116.stdout:0/706: dwrite d2/dc/d12/d28/f88 [4194304,4194304] 0 2024-09-13T21:40:46.976 INFO:tasks.workunit.client.1.smithi116.stdout:9/424: dwrite d2/f2f [0,4194304] 0 2024-09-13T21:40:46.976 INFO:tasks.workunit.client.1.smithi116.stdout:9/425: read - d2/d10/d4c/f4e zero size 2024-09-13T21:40:46.978 INFO:tasks.workunit.client.1.smithi116.stdout:7/680: dwrite d5/d9/db/f3c [0,4194304] 0 2024-09-13T21:40:46.979 INFO:tasks.workunit.client.1.smithi116.stdout:1/482: getdents d4/d14/d52/d2f/d91 0 2024-09-13T21:40:46.981 INFO:tasks.workunit.client.1.smithi116.stdout:9/426: mknod d2/d10/d4c/c7e 0 2024-09-13T21:40:46.985 INFO:tasks.workunit.client.1.smithi116.stdout:1/483: mkdir d4/d14/d52/d2f/d5c/daf 0 2024-09-13T21:40:46.985 INFO:tasks.workunit.client.1.smithi116.stdout:5/737: dwrite d7/d1d/d46/d85/d96/fe9 [0,4194304] 0 2024-09-13T21:40:46.989 INFO:tasks.workunit.client.1.smithi116.stdout:9/427: creat d2/d10/d6e/f7f x:0 0 0 2024-09-13T21:40:46.989 INFO:tasks.workunit.client.1.smithi116.stdout:1/484: mkdir d4/d14/db0 0 2024-09-13T21:40:46.991 INFO:tasks.workunit.client.1.smithi116.stdout:1/485: write d4/d23/d57/f97 [4401015,90212] 0 2024-09-13T21:40:46.991 INFO:tasks.workunit.client.1.smithi116.stdout:1/486: getdents d4/d14/d52/d2f/d5c/daf 0 2024-09-13T21:40:46.996 INFO:tasks.workunit.client.1.smithi116.stdout:0/707: write d2/dc/f2e [3486266,36489] 0 2024-09-13T21:40:46.999 INFO:tasks.workunit.client.1.smithi116.stdout:9/428: symlink d2/d10/d4c/l80 0 2024-09-13T21:40:47.000 INFO:tasks.workunit.client.1.smithi116.stdout:9/429: write d2/d43/f63 [1653,105466] 0 2024-09-13T21:40:47.000 INFO:tasks.workunit.client.1.smithi116.stdout:9/430: rename d2/d5d/d69/d7d to d2/d5d/d69/d7d/d81 22 2024-09-13T21:40:47.000 INFO:tasks.workunit.client.1.smithi116.stdout:3/722: dwrite d3/db/f79 [0,4194304] 0 2024-09-13T21:40:47.002 INFO:tasks.workunit.client.1.smithi116.stdout:1/487: mknod d4/d23/d56/cb1 0 2024-09-13T21:40:47.005 INFO:tasks.workunit.client.1.smithi116.stdout:4/598: dwrite d0/dd/d13/d5a/d86/f8f [0,4194304] 0 2024-09-13T21:40:47.017 INFO:tasks.workunit.client.1.smithi116.stdout:1/488: read d4/f8b [3216789,77787] 0 2024-09-13T21:40:47.017 INFO:tasks.workunit.client.1.smithi116.stdout:1/489: chown d4/d14/d52/d2f/d91 264100801 1 2024-09-13T21:40:47.017 INFO:tasks.workunit.client.1.smithi116.stdout:1/490: stat d4/d14/d52/d2f/d5c/f8c 0 2024-09-13T21:40:47.018 INFO:tasks.workunit.client.1.smithi116.stdout:1/491: symlink d4/d14/lb2 0 2024-09-13T21:40:47.018 INFO:tasks.workunit.client.1.smithi116.stdout:1/492: symlink d4/d14/d52/d2f/d5d/d90/lb3 0 2024-09-13T21:40:47.020 INFO:tasks.workunit.client.1.smithi116.stdout:5/738: dwrite d7/f16 [4194304,4194304] 0 2024-09-13T21:40:47.021 INFO:tasks.workunit.client.1.smithi116.stdout:5/739: link d7/d1d/d46/dd4/d5e/d65/d6a/fb1 d7/d1d/d46/dd4/d5e/d65/d6a/ff5 0 2024-09-13T21:40:47.029 INFO:tasks.workunit.client.1.smithi116.stdout:7/681: dwrite d5/d9/d27/f90 [0,4194304] 0 2024-09-13T21:40:47.029 INFO:tasks.workunit.client.1.smithi116.stdout:0/708: dwrite d2/dc/d12/d28/f54 [0,4194304] 0 2024-09-13T21:40:47.029 INFO:tasks.workunit.client.1.smithi116.stdout:7/682: creat d5/d9/db/d21/d6e/d6f/fe0 x:0 0 0 2024-09-13T21:40:47.031 INFO:tasks.workunit.client.1.smithi116.stdout:3/723: dwrite d3/db/d20/d86/fbc [0,4194304] 0 2024-09-13T21:40:47.033 INFO:tasks.workunit.client.1.smithi116.stdout:0/709: dread d2/d5b/f93 [0,4194304] 0 2024-09-13T21:40:47.041 INFO:tasks.workunit.client.1.smithi116.stdout:7/683: creat d5/d9/d1c/d22/d24/d6b/d72/fe1 x:0 0 0 2024-09-13T21:40:47.043 INFO:tasks.workunit.client.1.smithi116.stdout:5/740: dwrite d7/f3f [0,4194304] 0 2024-09-13T21:40:47.043 INFO:tasks.workunit.client.1.smithi116.stdout:1/493: dwrite d4/d14/d2a/f42 [0,4194304] 0 2024-09-13T21:40:47.043 INFO:tasks.workunit.client.1.smithi116.stdout:1/494: write d4/d14/d52/f40 [533685,35472] 0 2024-09-13T21:40:47.043 INFO:tasks.workunit.client.1.smithi116.stdout:3/724: rename d3/db/f79 to d3/f100 0 2024-09-13T21:40:47.046 INFO:tasks.workunit.client.1.smithi116.stdout:5/741: creat d7/d1d/d46/dd4/d5e/d79/d8f/ff6 x:0 0 0 2024-09-13T21:40:47.049 INFO:tasks.workunit.client.1.smithi116.stdout:1/495: rename d4/d14/c28 to d4/d23/d56/da3/cb4 0 2024-09-13T21:40:47.049 INFO:tasks.workunit.client.1.smithi116.stdout:1/496: stat d4/d14/f1d 0 2024-09-13T21:40:47.050 INFO:tasks.workunit.client.1.smithi116.stdout:3/725: symlink d3/db/d10/d99/l101 0 2024-09-13T21:40:47.050 INFO:tasks.workunit.client.1.smithi116.stdout:3/726: dread - d3/db/d10/d1c/fdc zero size 2024-09-13T21:40:47.050 INFO:tasks.workunit.client.1.smithi116.stdout:3/727: readlink d3/l54 0 2024-09-13T21:40:47.050 INFO:tasks.workunit.client.1.smithi116.stdout:3/728: write d3/df9/ffd [565584,106092] 0 2024-09-13T21:40:47.052 INFO:tasks.workunit.client.1.smithi116.stdout:5/742: unlink d7/d1d/d46/dd4/d5e/d65/d6f/lec 0 2024-09-13T21:40:47.053 INFO:tasks.workunit.client.1.smithi116.stdout:3/729: mknod d3/db/d20/d86/da6/c102 0 2024-09-13T21:40:47.053 INFO:tasks.workunit.client.1.smithi116.stdout:3/730: chown d3/db/d10/d1c 1071730 1 2024-09-13T21:40:47.053 INFO:tasks.workunit.client.1.smithi116.stdout:3/731: chown d3 0 1 2024-09-13T21:40:47.055 INFO:tasks.workunit.client.1.smithi116.stdout:5/743: symlink d7/d9a/lf7 0 2024-09-13T21:40:47.055 INFO:tasks.workunit.client.1.smithi116.stdout:5/744: readlink d7/d40/d53/lba 0 2024-09-13T21:40:47.055 INFO:tasks.workunit.client.1.smithi116.stdout:5/745: fsync d7/d1d/d64/fab 0 2024-09-13T21:40:47.056 INFO:tasks.workunit.client.1.smithi116.stdout:3/732: symlink d3/db/d20/d86/da6/l103 0 2024-09-13T21:40:47.056 INFO:tasks.workunit.client.1.smithi116.stdout:3/733: chown d3/df9/fa3 965 1 2024-09-13T21:40:47.056 INFO:tasks.workunit.client.1.smithi116.stdout:3/734: read - d3/db/fac zero size 2024-09-13T21:40:47.057 INFO:tasks.workunit.client.1.smithi116.stdout:3/735: dread d3/db/d26/f78 [0,4194304] 0 2024-09-13T21:40:47.057 INFO:tasks.workunit.client.1.smithi116.stdout:5/746: truncate d7/d1d/d46/dd4/f37 1456559 0 2024-09-13T21:40:47.057 INFO:tasks.workunit.client.1.smithi116.stdout:5/747: creat d7/d1d/d46/d85/d96/da8/ff8 x:0 0 0 2024-09-13T21:40:47.058 INFO:tasks.workunit.client.1.smithi116.stdout:3/736: mknod d3/db/d10/d1d/c104 0 2024-09-13T21:40:47.058 INFO:tasks.workunit.client.1.smithi116.stdout:1/497: read d4/f83 [1342917,57115] 0 2024-09-13T21:40:47.060 INFO:tasks.workunit.client.1.smithi116.stdout:0/710: dwrite d2/fd1 [0,4194304] 0 2024-09-13T21:40:47.060 INFO:tasks.workunit.client.1.smithi116.stdout:1/498: mknod d4/d74/d8d/d5f/cb5 0 2024-09-13T21:40:47.064 INFO:tasks.workunit.client.1.smithi116.stdout:7/684: rmdir d5/d9/db 39 2024-09-13T21:40:47.065 INFO:tasks.workunit.client.1.smithi116.stdout:0/711: symlink d2/d5/d86/d8a/lf1 0 2024-09-13T21:40:47.067 INFO:tasks.workunit.client.1.smithi116.stdout:7/685: symlink d5/d9/d1c/d22/d24/d6b/d72/d74/le2 0 2024-09-13T21:40:47.068 INFO:tasks.workunit.client.1.smithi116.stdout:0/712: symlink d2/d5b/lf2 0 2024-09-13T21:40:47.071 INFO:tasks.workunit.client.1.smithi116.stdout:0/713: creat d2/dc/d12/d51/d62/ff3 x:0 0 0 2024-09-13T21:40:47.072 INFO:tasks.workunit.client.1.smithi116.stdout:0/714: chown d2/dc/d12/c80 4413 1 2024-09-13T21:40:47.076 INFO:tasks.workunit.client.1.smithi116.stdout:3/737: dwrite d3/db/d10/d1c/fec [0,4194304] 0 2024-09-13T21:40:47.076 INFO:tasks.workunit.client.1.smithi116.stdout:3/738: creat d3/db/d10/d99/f105 x:0 0 0 2024-09-13T21:40:47.081 INFO:tasks.workunit.client.1.smithi116.stdout:5/748: rmdir d7/d1d/d46/d85/d96 39 2024-09-13T21:40:47.083 INFO:tasks.workunit.client.1.smithi116.stdout:5/749: rmdir d7/d1d/d46/d85/d96/dd6 39 2024-09-13T21:40:47.088 INFO:tasks.workunit.client.1.smithi116.stdout:5/750: unlink d7/d40/d53/f89 0 2024-09-13T21:40:47.088 INFO:tasks.workunit.client.1.smithi116.stdout:5/751: truncate d7/d1d/d64/d87/fc7 810181 0 2024-09-13T21:40:47.088 INFO:tasks.workunit.client.1.smithi116.stdout:5/752: rmdir d7/d1d/d46/dd4/d5e/d79/dcb 39 2024-09-13T21:40:47.088 INFO:tasks.workunit.client.1.smithi116.stdout:5/753: dread - d7/d1d/d46/d85/d96/da8/ff8 zero size 2024-09-13T21:40:47.089 INFO:tasks.workunit.client.1.smithi116.stdout:5/754: readlink d7/d40/l49 0 2024-09-13T21:40:47.090 INFO:tasks.workunit.client.1.smithi116.stdout:5/755: mkdir d7/d1d/d46/dd4/d5e/d65/df9 0 2024-09-13T21:40:47.090 INFO:tasks.workunit.client.1.smithi116.stdout:5/756: fdatasync d7/d1d/d46/d85/d96/da8/db9/fef 0 2024-09-13T21:40:47.090 INFO:tasks.workunit.client.1.smithi116.stdout:5/757: chown d7/d1d/c1f 42867 1 2024-09-13T21:40:47.090 INFO:tasks.workunit.client.1.smithi116.stdout:5/758: fsync d7/d1d/d46/fda 0 2024-09-13T21:40:47.090 INFO:tasks.workunit.client.1.smithi116.stdout:5/759: creat d7/d1d/d46/ffa x:0 0 0 2024-09-13T21:40:47.090 INFO:tasks.workunit.client.1.smithi116.stdout:7/686: dwrite d5/f8 [0,4194304] 0 2024-09-13T21:40:47.090 INFO:tasks.workunit.client.1.smithi116.stdout:7/687: creat d5/d9/d1c/d22/d24/d5f/fe3 x:0 0 0 2024-09-13T21:40:47.090 INFO:tasks.workunit.client.1.smithi116.stdout:7/688: creat d5/d9/d1c/d22/d24/d6b/d72/d74/d93/fe4 x:0 0 0 2024-09-13T21:40:47.091 INFO:tasks.workunit.client.1.smithi116.stdout:5/760: symlink d7/d1d/d46/dd4/d5e/d79/dcb/lfb 0 2024-09-13T21:40:47.099 INFO:tasks.workunit.client.1.smithi116.stdout:0/715: dwrite d2/dc/d12/f36 [0,4194304] 0 2024-09-13T21:40:47.101 INFO:tasks.workunit.client.1.smithi116.stdout:0/716: creat d2/dc/dcf/dd7/ff4 x:0 0 0 2024-09-13T21:40:47.103 INFO:tasks.workunit.client.1.smithi116.stdout:3/739: dwrite d3/db/d3d/fae [0,4194304] 0 2024-09-13T21:40:47.104 INFO:tasks.workunit.client.1.smithi116.stdout:7/689: write d5/d9/db/ff [4188841,56375] 0 2024-09-13T21:40:47.104 INFO:tasks.workunit.client.1.smithi116.stdout:7/690: chown d5/d9/d27/d31/d38/d42 486231205 1 2024-09-13T21:40:47.104 INFO:tasks.workunit.client.1.smithi116.stdout:7/691: dread - d5/d9/d1c/d22/d24/d6b/d72/d74/d93/fc4 zero size 2024-09-13T21:40:47.105 INFO:tasks.workunit.client.1.smithi116.stdout:5/761: dread d7/d1d/d46/dd4/d5e/f4e [0,4194304] 0 2024-09-13T21:40:47.106 INFO:tasks.workunit.client.1.smithi116.stdout:3/740: mknod d3/db/c106 0 2024-09-13T21:40:47.107 INFO:tasks.workunit.client.1.smithi116.stdout:5/762: symlink d7/d1d/d46/d85/d96/da8/lfc 0 2024-09-13T21:40:47.110 INFO:tasks.workunit.client.1.smithi116.stdout:7/692: rename d5/d9/d27/dbe to d5/d9/d1c/d22/d24/d5f/de5 0 2024-09-13T21:40:47.110 INFO:tasks.workunit.client.1.smithi116.stdout:7/693: creat d5/db0/fe6 x:0 0 0 2024-09-13T21:40:47.111 INFO:tasks.workunit.client.1.smithi116.stdout:5/763: mknod d7/cfd 0 2024-09-13T21:40:47.111 INFO:tasks.workunit.client.1.smithi116.stdout:5/764: fdatasync d7/d1d/f99 0 2024-09-13T21:40:47.115 INFO:tasks.workunit.client.1.smithi116.stdout:5/765: symlink d7/d1d/d64/d94/lfe 0 2024-09-13T21:40:47.116 INFO:tasks.workunit.client.1.smithi116.stdout:5/766: chown d7/d1d/l9d 12 1 2024-09-13T21:40:47.117 INFO:tasks.workunit.client.1.smithi116.stdout:5/767: symlink d7/d1d/d64/lff 0 2024-09-13T21:40:47.120 INFO:tasks.workunit.client.1.smithi116.stdout:5/768: creat d7/d1d/d46/dd4/f100 x:0 0 0 2024-09-13T21:40:47.125 INFO:tasks.workunit.client.1.smithi116.stdout:0/717: dwrite d2/dc/d12/d28/fe5 [0,4194304] 0 2024-09-13T21:40:47.135 INFO:tasks.workunit.client.1.smithi116.stdout:0/718: write d2/f73 [6611811,64505] 0 2024-09-13T21:40:47.136 INFO:tasks.workunit.client.1.smithi116.stdout:0/719: getdents d2/dc/dcc 0 2024-09-13T21:40:47.137 INFO:tasks.workunit.client.1.smithi116.stdout:0/720: creat d2/dc/d47/d63/d9f/dad/ff5 x:0 0 0 2024-09-13T21:40:47.137 INFO:tasks.workunit.client.1.smithi116.stdout:0/721: creat d2/d5b/ff6 x:0 0 0 2024-09-13T21:40:47.137 INFO:tasks.workunit.client.1.smithi116.stdout:0/722: creat d2/dc/d12/d28/d57/d65/ff7 x:0 0 0 2024-09-13T21:40:47.140 INFO:tasks.workunit.client.1.smithi116.stdout:0/723: symlink d2/dc/d12/lf8 0 2024-09-13T21:40:47.146 INFO:tasks.workunit.client.1.smithi116.stdout:3/741: dwrite d3/db/d10/d1d/d5f/ff5 [0,4194304] 0 2024-09-13T21:40:47.146 INFO:tasks.workunit.client.1.smithi116.stdout:5/769: dwrite d7/d1d/d64/fab [0,4194304] 0 2024-09-13T21:40:47.146 INFO:tasks.workunit.client.1.smithi116.stdout:5/770: fsync d7/d1d/d46/d5c/f78 0 2024-09-13T21:40:47.147 INFO:tasks.workunit.client.1.smithi116.stdout:7/694: dwrite d5/d9/d27/d31/d38/d48/f76 [0,4194304] 0 2024-09-13T21:40:47.150 INFO:tasks.workunit.client.1.smithi116.stdout:0/724: write d2/dc/d12/d51/d62/fa2 [208856,71754] 0 2024-09-13T21:40:47.150 INFO:tasks.workunit.client.1.smithi116.stdout:0/725: write d2/d5/f50 [4856440,51372] 0 2024-09-13T21:40:47.150 INFO:tasks.workunit.client.1.smithi116.stdout:0/726: creat d2/dc/d12/ff9 x:0 0 0 2024-09-13T21:40:47.150 INFO:tasks.workunit.client.1.smithi116.stdout:0/727: chown d2/d5/dbe/ldb 2 1 2024-09-13T21:40:47.150 INFO:tasks.workunit.client.1.smithi116.stdout:0/728: chown d2/dc/l5f 2885 1 2024-09-13T21:40:47.150 INFO:tasks.workunit.client.1.smithi116.stdout:0/729: fdatasync d2/dc/d47/d63/d9f/dad/fc7 0 2024-09-13T21:40:47.152 INFO:tasks.workunit.client.1.smithi116.stdout:0/730: read d2/d5b/f5c [121478,99609] 0 2024-09-13T21:40:47.153 INFO:tasks.workunit.client.1.smithi116.stdout:5/771: rename d7/d1d/d46/l54 to d7/d1d/d46/d85/d96/dd6/l101 0 2024-09-13T21:40:47.153 INFO:tasks.workunit.client.1.smithi116.stdout:5/772: dread - d7/d1d/d46/d85/d96/da8/fbe zero size 2024-09-13T21:40:47.153 INFO:tasks.workunit.client.1.smithi116.stdout:7/695: mkdir d5/d9/db/da3/de7 0 2024-09-13T21:40:47.153 INFO:tasks.workunit.client.1.smithi116.stdout:3/742: mknod d3/db/d10/d1d/d2f/d61/c107 0 2024-09-13T21:40:47.157 INFO:tasks.workunit.client.1.smithi116.stdout:5/773: rename d7/d40/d53/l58 to d7/d1d/d46/dd4/d5e/d79/l102 0 2024-09-13T21:40:47.157 INFO:tasks.workunit.client.1.smithi116.stdout:5/774: write d7/d1d/d46/dd4/d5e/d65/d6a/ff5 [1367550,47137] 0 2024-09-13T21:40:47.157 INFO:tasks.workunit.client.1.smithi116.stdout:3/743: mkdir d3/db/d10/d1c/d34/d55/d96/dee/d108 0 2024-09-13T21:40:47.159 INFO:tasks.workunit.client.1.smithi116.stdout:0/731: getdents d2/d5b 0 2024-09-13T21:40:47.160 INFO:tasks.workunit.client.1.smithi116.stdout:7/696: dread d5/d9/db/d21/d6e/d6f/f88 [0,4194304] 0 2024-09-13T21:40:47.160 INFO:tasks.workunit.client.1.smithi116.stdout:7/697: fdatasync d5/d9/db/fc8 0 2024-09-13T21:40:47.160 INFO:tasks.workunit.client.1.smithi116.stdout:5/775: dread d7/d40/d53/f61 [0,4194304] 0 2024-09-13T21:40:47.162 INFO:tasks.workunit.client.1.smithi116.stdout:7/698: creat d5/d9/db/da3/fe8 x:0 0 0 2024-09-13T21:40:47.164 INFO:tasks.workunit.client.1.smithi116.stdout:5/776: mkdir d7/d1d/de3/d103 0 2024-09-13T21:40:47.164 INFO:tasks.workunit.client.1.smithi116.stdout:5/777: write d7/d1d/d46/d85/d96/da8/db9/ff2 [80068,84088] 0 2024-09-13T21:40:47.164 INFO:tasks.workunit.client.1.smithi116.stdout:5/778: write d7/d1d/d46/dd4/d5e/d79/d8f/ff6 [636296,96570] 0 2024-09-13T21:40:47.164 INFO:tasks.workunit.client.1.smithi116.stdout:5/779: chown d7/d9a 7046 1 2024-09-13T21:40:47.166 INFO:tasks.workunit.client.1.smithi116.stdout:7/699: dread d5/d9/d27/d31/d38/d48/f75 [0,4194304] 0 2024-09-13T21:40:47.168 INFO:tasks.workunit.client.1.smithi116.stdout:7/700: rmdir d5/d9/d27/d31/dca 0 2024-09-13T21:40:47.172 INFO:tasks.workunit.client.1.smithi116.stdout:0/732: dread d2/f89 [0,4194304] 0 2024-09-13T21:40:47.176 INFO:tasks.workunit.client.1.smithi116.stdout:3/744: dwrite d3/df9/fa3 [0,4194304] 0 2024-09-13T21:40:47.178 INFO:tasks.workunit.client.1.smithi116.stdout:3/745: truncate d3/db/d3d/f91 528207 0 2024-09-13T21:40:47.182 INFO:tasks.workunit.client.1.smithi116.stdout:3/746: getdents d3/db/d10/d1c/d34/d55/d96/dee 0 2024-09-13T21:40:47.182 INFO:tasks.workunit.client.1.smithi116.stdout:7/701: dread d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:47.184 INFO:tasks.workunit.client.1.smithi116.stdout:7/702: getdents d5/d9/d1c/d2e/d52 0 2024-09-13T21:40:47.187 INFO:tasks.workunit.client.1.smithi116.stdout:7/703: dread d5/d9/d27/d31/f71 [0,4194304] 0 2024-09-13T21:40:47.188 INFO:tasks.workunit.client.1.smithi116.stdout:7/704: rename d5/d9/d27/d31/d38/d48/l81 to d5/d9/d27/d31/d38/le9 0 2024-09-13T21:40:47.188 INFO:tasks.workunit.client.1.smithi116.stdout:7/705: read d5/d9/d27/d31/f71 [730638,21979] 0 2024-09-13T21:40:47.189 INFO:tasks.workunit.client.1.smithi116.stdout:7/706: write d5/fd5 [90240,15667] 0 2024-09-13T21:40:47.189 INFO:tasks.workunit.client.1.smithi116.stdout:7/707: write d5/d9/d1c/d22/d24/d6b/d72/fe1 [180332,82872] 0 2024-09-13T21:40:47.190 INFO:tasks.workunit.client.1.smithi116.stdout:7/708: getdents d5/d9/db/da3 0 2024-09-13T21:40:47.191 INFO:tasks.workunit.client.1.smithi116.stdout:7/709: dread d5/d9/d1c/d22/d24/d6b/d72/dd4/fa2 [0,4194304] 0 2024-09-13T21:40:47.191 INFO:tasks.workunit.client.1.smithi116.stdout:7/710: read - d5/d9/d1c/d22/d24/d6b/d72/d74/d93/fc4 zero size 2024-09-13T21:40:47.191 INFO:tasks.workunit.client.1.smithi116.stdout:0/733: dwrite d2/dc/f3d [4194304,4194304] 0 2024-09-13T21:40:47.197 INFO:tasks.workunit.client.1.smithi116.stdout:3/747: dread d3/db/d3d/fae [0,4194304] 0 2024-09-13T21:40:47.223 INFO:tasks.workunit.client.1.smithi116.stdout:0/734: dwrite d2/d5b/f5c [0,4194304] 0 2024-09-13T21:40:47.223 INFO:tasks.workunit.client.1.smithi116.stdout:0/735: chown d2/d5/de9/fef 646951143 1 2024-09-13T21:40:47.226 INFO:tasks.workunit.client.1.smithi116.stdout:7/711: dwrite d5/d9/d1c/d22/f7a [0,4194304] 0 2024-09-13T21:40:47.227 INFO:tasks.workunit.client.1.smithi116.stdout:7/712: rmdir d5/d9/d27 39 2024-09-13T21:40:47.228 INFO:tasks.workunit.client.1.smithi116.stdout:7/713: truncate d5/d9/f33 3499135 0 2024-09-13T21:40:47.230 INFO:tasks.workunit.client.1.smithi116.stdout:7/714: truncate d5/d9/d27/f90 2350368 0 2024-09-13T21:40:47.232 INFO:tasks.workunit.client.1.smithi116.stdout:3/748: dwrite d3/db/d10/d99/ffe [0,4194304] 0 2024-09-13T21:40:47.232 INFO:tasks.workunit.client.1.smithi116.stdout:3/749: fsync d3/db/ff 0 2024-09-13T21:40:47.232 INFO:tasks.workunit.client.1.smithi116.stdout:3/750: creat d3/db/d10/d99/f109 x:0 0 0 2024-09-13T21:40:47.232 INFO:tasks.workunit.client.1.smithi116.stdout:7/715: getdents d5/d9/d27/d31 0 2024-09-13T21:40:47.233 INFO:tasks.workunit.client.1.smithi116.stdout:7/716: dread - d5/d9/d27/d31/fd8 zero size 2024-09-13T21:40:47.233 INFO:tasks.workunit.client.1.smithi116.stdout:7/717: chown d5/d9/db/l32 1490 1 2024-09-13T21:40:47.237 INFO:tasks.workunit.client.1.smithi116.stdout:3/751: mknod d3/db/d10/d1d/d5f/d7f/c10a 0 2024-09-13T21:40:47.237 INFO:tasks.workunit.client.1.smithi116.stdout:3/752: creat d3/db/d10/d1c/f10b x:0 0 0 2024-09-13T21:40:47.237 INFO:tasks.workunit.client.1.smithi116.stdout:3/753: fsync d3/db/f68 0 2024-09-13T21:40:47.247 INFO:tasks.workunit.client.1.smithi116.stdout:0/736: dwrite d2/dc/d12/d51/d62/fa2 [0,4194304] 0 2024-09-13T21:40:47.247 INFO:tasks.workunit.client.1.smithi116.stdout:0/737: chown d2/dc/d12/d28/d57/d65/c96 745 1 2024-09-13T21:40:47.253 INFO:tasks.workunit.client.1.smithi116.stdout:7/718: dwrite d5/d9/d27/d31/d38/d48/f77 [0,4194304] 0 2024-09-13T21:40:47.253 INFO:tasks.workunit.client.1.smithi116.stdout:7/719: truncate d5/d9/db/d21/d6e/d6f/f83 4216722 0 2024-09-13T21:40:47.255 INFO:tasks.workunit.client.1.smithi116.stdout:7/720: creat d5/d9/fea x:0 0 0 2024-09-13T21:40:47.256 INFO:tasks.workunit.client.1.smithi116.stdout:3/754: rmdir d3/db/d10/d1c 39 2024-09-13T21:40:47.257 INFO:tasks.workunit.client.1.smithi116.stdout:0/738: dread d2/d5/f39 [0,4194304] 0 2024-09-13T21:40:47.258 INFO:tasks.workunit.client.1.smithi116.stdout:7/721: link d5/d9/d27/d31/d38/fbb d5/d9/db/d21/d6e/d6f/feb 0 2024-09-13T21:40:47.258 INFO:tasks.workunit.client.1.smithi116.stdout:3/755: dread d3/db/d26/f78 [0,4194304] 0 2024-09-13T21:40:47.259 INFO:tasks.workunit.client.1.smithi116.stdout:7/722: mknod d5/d9/d1c/d22/d24/cec 0 2024-09-13T21:40:47.259 INFO:tasks.workunit.client.1.smithi116.stdout:7/723: chown d5/d9/d1c/d22/f7a 30972 1 2024-09-13T21:40:47.260 INFO:tasks.workunit.client.1.smithi116.stdout:3/756: symlink d3/db/d10/d1c/d63/l10c 0 2024-09-13T21:40:47.262 INFO:tasks.workunit.client.1.smithi116.stdout:3/757: creat d3/db/d10/d1c/d34/d55/f10d x:0 0 0 2024-09-13T21:40:47.264 INFO:tasks.workunit.client.1.smithi116.stdout:3/758: truncate d3/db/d20/fc0 1541568 0 2024-09-13T21:40:47.264 INFO:tasks.workunit.client.1.smithi116.stdout:3/759: stat d3/fc7 0 2024-09-13T21:40:47.286 INFO:tasks.workunit.client.1.smithi116.stdout:0/739: dwrite d2/dc/d47/d63/d9f/db6/fc2 [0,4194304] 0 2024-09-13T21:40:47.287 INFO:tasks.workunit.client.1.smithi116.stdout:0/740: write d2/d5/f58 [3650479,16555] 0 2024-09-13T21:40:47.287 INFO:tasks.workunit.client.1.smithi116.stdout:7/724: dwrite d5/d9/d1c/d22/d24/d5f/fe3 [0,4194304] 0 2024-09-13T21:40:47.287 INFO:tasks.workunit.client.1.smithi116.stdout:7/725: fdatasync d5/d9/d1c/d22/d24/d6b/d72/d74/d93/fc4 0 2024-09-13T21:40:47.287 INFO:tasks.workunit.client.1.smithi116.stdout:3/760: dwrite d3/df9/fa3 [0,4194304] 0 2024-09-13T21:40:47.287 INFO:tasks.workunit.client.1.smithi116.stdout:3/761: write d3/db/d20/f65 [672353,69749] 0 2024-09-13T21:40:47.290 INFO:tasks.workunit.client.1.smithi116.stdout:3/762: creat d3/db/f10e x:0 0 0 2024-09-13T21:40:47.291 INFO:tasks.workunit.client.1.smithi116.stdout:3/763: mknod d3/db/d10/d1c/d34/d55/d57/dda/c10f 0 2024-09-13T21:40:47.296 INFO:tasks.workunit.client.1.smithi116.stdout:7/726: rename d5/d9/d1c to d5/d9/d27/ded 0 2024-09-13T21:40:47.296 INFO:tasks.workunit.client.1.smithi116.stdout:7/727: truncate d5/d9/fea 376038 0 2024-09-13T21:40:47.296 INFO:tasks.workunit.client.1.smithi116.stdout:7/728: dread - d5/d9/d27/ded/d22/d24/d3a/f8a zero size 2024-09-13T21:40:47.298 INFO:tasks.workunit.client.1.smithi116.stdout:8/615: sync 2024-09-13T21:40:47.298 INFO:tasks.workunit.client.1.smithi116.stdout:8/616: write d2/d10/d19/f84 [3367730,52479] 0 2024-09-13T21:40:47.298 INFO:tasks.workunit.client.1.smithi116.stdout:8/617: fdatasync d2/d10/d19/d21/d69/d90/fac 0 2024-09-13T21:40:47.298 INFO:tasks.workunit.client.1.smithi116.stdout:8/618: creat d2/d10/d19/d21/d69/d9e/fb7 x:0 0 0 2024-09-13T21:40:47.298 INFO:tasks.workunit.client.1.smithi116.stdout:8/619: write d2/d10/d19/d21/d69/d90/fac [765011,7685] 0 2024-09-13T21:40:47.299 INFO:tasks.workunit.client.1.smithi116.stdout:8/620: write d2/d10/d19/d21/d69/f9f [564170,48413] 0 2024-09-13T21:40:47.302 INFO:tasks.workunit.client.1.smithi116.stdout:0/741: dread d2/dc/d12/d28/d57/f90 [0,4194304] 0 2024-09-13T21:40:47.303 INFO:tasks.workunit.client.1.smithi116.stdout:0/742: mknod d2/d5/d61/cfa 0 2024-09-13T21:40:47.303 INFO:tasks.workunit.client.1.smithi116.stdout:0/743: write d2/d5/fe0 [6106352,53380] 0 2024-09-13T21:40:47.303 INFO:tasks.workunit.client.1.smithi116.stdout:0/744: write d2/d5/fb7 [5150629,16923] 0 2024-09-13T21:40:47.304 INFO:tasks.workunit.client.1.smithi116.stdout:7/729: write d5/d9/db/d21/f3e [4092378,27189] 0 2024-09-13T21:40:47.312 INFO:tasks.workunit.client.1.smithi116.stdout:7/730: creat d5/d9/db/d21/d6e/d6f/fee x:0 0 0 2024-09-13T21:40:47.312 INFO:tasks.workunit.client.1.smithi116.stdout:7/731: chown d5/d9/l13 198 1 2024-09-13T21:40:47.318 INFO:tasks.workunit.client.1.smithi116.stdout:3/764: dwrite d3/db/d10/d1c/d34/f8f [0,4194304] 0 2024-09-13T21:40:47.322 INFO:tasks.workunit.client.1.smithi116.stdout:3/765: rename d3/db/d3d/d40 to d3/db/d3d/d110 0 2024-09-13T21:40:47.324 INFO:tasks.workunit.client.1.smithi116.stdout:3/766: mknod d3/db/d10/d1c/d34/d55/d57/dc6/c111 0 2024-09-13T21:40:47.324 INFO:tasks.workunit.client.1.smithi116.stdout:3/767: readlink d3/db/d10/d1c/l72 0 2024-09-13T21:40:47.324 INFO:tasks.workunit.client.1.smithi116.stdout:3/768: creat d3/db/d10/d1d/f112 x:0 0 0 2024-09-13T21:40:47.327 INFO:tasks.workunit.client.1.smithi116.stdout:3/769: rename d3/db/d10/d1c/fe3 to d3/db/d10/d29/f113 0 2024-09-13T21:40:47.327 INFO:tasks.workunit.client.1.smithi116.stdout:3/770: chown d3/db/d20/d50 161855 1 2024-09-13T21:40:47.327 INFO:tasks.workunit.client.1.smithi116.stdout:3/771: creat d3/db/d10/d1d/d2f/d61/f114 x:0 0 0 2024-09-13T21:40:47.330 INFO:tasks.workunit.client.1.smithi116.stdout:8/621: dwrite d2/d10/d19/d21/d22/d5d/d46/f7d [0,4194304] 0 2024-09-13T21:40:47.330 INFO:tasks.workunit.client.1.smithi116.stdout:8/622: fdatasync d2/d10/d19/d21/d69/f8b 0 2024-09-13T21:40:47.333 INFO:tasks.workunit.client.1.smithi116.stdout:8/623: rename d2/d10/d75/l83 to d2/d27/d62/lb8 0 2024-09-13T21:40:47.335 INFO:tasks.workunit.client.1.smithi116.stdout:8/624: dread d2/d10/d19/d21/d22/d5d/d46/f4f [0,4194304] 0 2024-09-13T21:40:47.338 INFO:tasks.workunit.client.1.smithi116.stdout:7/732: dwrite d5/d9/d27/ded/d2e/d52/fde [0,4194304] 0 2024-09-13T21:40:47.338 INFO:tasks.workunit.client.1.smithi116.stdout:7/733: truncate d5/d9/db/d21/d6e/d6f/feb 751336 0 2024-09-13T21:40:47.338 INFO:tasks.workunit.client.1.smithi116.stdout:7/734: truncate d5/d9/d27/ded/d2e/f96 4491918 0 2024-09-13T21:40:47.338 INFO:tasks.workunit.client.1.smithi116.stdout:7/735: chown d5/d9/d27/ded/d2e/d52/fde 682393926 1 2024-09-13T21:40:47.338 INFO:tasks.workunit.client.1.smithi116.stdout:0/745: dwrite d2/d5/d61/f77 [0,4194304] 0 2024-09-13T21:40:47.338 INFO:tasks.workunit.client.1.smithi116.stdout:0/746: truncate d2/d5/d86/fc5 71371 0 2024-09-13T21:40:47.338 INFO:tasks.workunit.client.1.smithi116.stdout:7/736: write d5/d9/d27/ded/d22/d24/d6b/d72/fe1 [54984,11146] 0 2024-09-13T21:40:47.342 INFO:tasks.workunit.client.1.smithi116.stdout:0/747: write d2/f83 [1000946,72014] 0 2024-09-13T21:40:47.342 INFO:tasks.workunit.client.1.smithi116.stdout:0/748: chown d2/d5/fe0 385788 1 2024-09-13T21:40:47.343 INFO:tasks.workunit.client.1.smithi116.stdout:3/772: dread d3/db/d10/d1d/f2d [0,4194304] 0 2024-09-13T21:40:47.343 INFO:tasks.workunit.client.1.smithi116.stdout:0/749: dread - d2/dc/d47/d63/f9d zero size 2024-09-13T21:40:47.345 INFO:tasks.workunit.client.1.smithi116.stdout:7/737: rename d5/d9/db/da7 to d5/db0/def 0 2024-09-13T21:40:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:46 smithi116 ceph-mon[33391]: pgmap v263: 65 pgs: 65 active+clean; 1.4 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 138 MiB/s rd, 155 MiB/s wr, 330 op/s 2024-09-13T21:40:47.350 INFO:tasks.workunit.client.1.smithi116.stdout:7/738: link d5/d9/f33 d5/d9/d27/ded/d37/ff0 0 2024-09-13T21:40:47.351 INFO:tasks.workunit.client.1.smithi116.stdout:3/773: dread d3/db/d10/d1c/d34/d47/f51 [0,4194304] 0 2024-09-13T21:40:47.360 INFO:tasks.workunit.client.1.smithi116.stdout:8/625: getdents d2/d10/d75 0 2024-09-13T21:40:47.360 INFO:tasks.workunit.client.1.smithi116.stdout:8/626: stat d2/d10/d19/d3a/d4c/l63 0 2024-09-13T21:40:47.363 INFO:tasks.workunit.client.1.smithi116.stdout:0/750: rmdir d2/dc 39 2024-09-13T21:40:47.363 INFO:tasks.workunit.client.1.smithi116.stdout:0/751: readlink d2/d5/d86/lde 0 2024-09-13T21:40:47.363 INFO:tasks.workunit.client.1.smithi116.stdout:0/752: dread - d2/dc/d47/d63/d9f/dad/ff5 zero size 2024-09-13T21:40:47.365 INFO:tasks.workunit.client.1.smithi116.stdout:3/774: mkdir d3/db/d10/d1d/d5f/d115 0 2024-09-13T21:40:47.365 INFO:tasks.workunit.client.1.smithi116.stdout:3/775: readlink d3/db/d20/d50/l98 0 2024-09-13T21:40:47.365 INFO:tasks.workunit.client.1.smithi116.stdout:3/776: write d3/db/d10/d99/ffe [4457320,31775] 0 2024-09-13T21:40:47.366 INFO:tasks.workunit.client.1.smithi116.stdout:8/627: symlink d2/d5c/lb9 0 2024-09-13T21:40:47.366 INFO:tasks.workunit.client.1.smithi116.stdout:8/628: chown d2/d10/d19/d21/d22/f4a 12227 1 2024-09-13T21:40:47.368 INFO:tasks.workunit.client.1.smithi116.stdout:0/753: mkdir d2/dc/d12/dfb 0 2024-09-13T21:40:47.369 INFO:tasks.workunit.client.1.smithi116.stdout:7/739: symlink d5/d9/d27/lf1 0 2024-09-13T21:40:47.370 INFO:tasks.workunit.client.1.smithi116.stdout:3/777: dread d3/db/d20/fc0 [0,4194304] 0 2024-09-13T21:40:47.370 INFO:tasks.workunit.client.1.smithi116.stdout:3/778: chown d3/db/d10/d1d/d2f/f38 0 1 2024-09-13T21:40:47.372 INFO:tasks.workunit.client.1.smithi116.stdout:8/629: mknod d2/d10/d19/d97/cba 0 2024-09-13T21:40:47.372 INFO:tasks.workunit.client.1.smithi116.stdout:8/630: chown d2/d10/d19/d21/d69/d90 6686622 1 2024-09-13T21:40:47.373 INFO:tasks.workunit.client.1.smithi116.stdout:7/740: symlink d5/d9/d27/ded/d22/d24/d6b/lf2 0 2024-09-13T21:40:47.375 INFO:tasks.workunit.client.1.smithi116.stdout:3/779: truncate d3/db/d3d/d110/f42 4982954 0 2024-09-13T21:40:47.375 INFO:tasks.workunit.client.1.smithi116.stdout:3/780: chown d3/db/d26/c85 38255357 1 2024-09-13T21:40:47.375 INFO:tasks.workunit.client.1.smithi116.stdout:3/781: chown d3/c87 7395 1 2024-09-13T21:40:47.375 INFO:tasks.workunit.client.1.smithi116.stdout:3/782: write d3/db/d20/d50/f8b [942739,13938] 0 2024-09-13T21:40:47.377 INFO:tasks.workunit.client.1.smithi116.stdout:8/631: mknod d2/d10/d37/d64/cbb 0 2024-09-13T21:40:47.378 INFO:tasks.workunit.client.1.smithi116.stdout:3/783: symlink d3/df9/da2/l116 0 2024-09-13T21:40:47.379 INFO:tasks.workunit.client.1.smithi116.stdout:8/632: mkdir d2/d10/d19/d21/d69/d90/da9/dbc 0 2024-09-13T21:40:47.379 INFO:tasks.workunit.client.1.smithi116.stdout:0/754: dread d2/fd1 [0,4194304] 0 2024-09-13T21:40:47.379 INFO:tasks.workunit.client.1.smithi116.stdout:8/633: read d2/d27/d62/fab [589906,38757] 0 2024-09-13T21:40:47.381 INFO:tasks.workunit.client.1.smithi116.stdout:3/784: creat d3/db/d10/d1c/d34/d55/d96/dee/d108/f117 x:0 0 0 2024-09-13T21:40:47.381 INFO:tasks.workunit.client.1.smithi116.stdout:3/785: write d3/db/d10/d1d/d2f/d61/fab [599717,118654] 0 2024-09-13T21:40:47.382 INFO:tasks.workunit.client.1.smithi116.stdout:0/755: mkdir d2/dc/d12/d51/d62/dfc 0 2024-09-13T21:40:47.383 INFO:tasks.workunit.client.1.smithi116.stdout:8/634: mknod d2/d10/d19/d3a/d4c/d7a/cbd 0 2024-09-13T21:40:47.385 INFO:tasks.workunit.client.1.smithi116.stdout:3/786: mkdir d3/df9/da2/d118 0 2024-09-13T21:40:47.385 INFO:tasks.workunit.client.1.smithi116.stdout:0/756: truncate d2/dc/d47/d63/d9f/db6/fc2 3940752 0 2024-09-13T21:40:47.386 INFO:tasks.workunit.client.1.smithi116.stdout:8/635: creat d2/d10/d19/d3a/fbe x:0 0 0 2024-09-13T21:40:47.387 INFO:tasks.workunit.client.1.smithi116.stdout:0/757: dread d2/dc/dcc/fd2 [0,4194304] 0 2024-09-13T21:40:47.387 INFO:tasks.workunit.client.1.smithi116.stdout:0/758: read - d2/dc/d12/d28/fb9 zero size 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:0/759: fdatasync d2/d5/f39 0 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:0/760: dread - d2/dc/d12/d28/fb9 zero size 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:2/553: sync 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:2/554: fdatasync d0/d3a/d82/d62/d1f/f27 0 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:2/555: chown d0/f79 0 1 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:2/556: stat d0/d3a/d82/d62/d1f/d5d/d72/daa 0 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:2/557: write d0/f63 [401165,37767] 0 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:3/787: rename d3/df9/da2/l116 to d3/db/d10/d1d/d5f/l119 0 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:3/788: truncate d3/db/d10/d99/fcc 367586 0 2024-09-13T21:40:47.388 INFO:tasks.workunit.client.1.smithi116.stdout:3/789: stat d3/db/d10/d29/fd1 0 2024-09-13T21:40:47.389 INFO:tasks.workunit.client.1.smithi116.stdout:8/636: mkdir d2/d10/d19/d21/d69/dbf 0 2024-09-13T21:40:47.389 INFO:tasks.workunit.client.1.smithi116.stdout:2/558: getdents d0 0 2024-09-13T21:40:47.389 INFO:tasks.workunit.client.1.smithi116.stdout:2/559: chown d0/d5/d8/f16 12 1 2024-09-13T21:40:47.391 INFO:tasks.workunit.client.1.smithi116.stdout:8/637: rename d2/d10/d19/d3a/fbe to d2/d10/d19/d3a/d4c/d7a/fc0 0 2024-09-13T21:40:47.392 INFO:tasks.workunit.client.1.smithi116.stdout:8/638: fsync d2/d10/d19/d21/d22/d5d/d46/f77 0 2024-09-13T21:40:47.403 INFO:tasks.workunit.client.1.smithi116.stdout:8/639: dread d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:47.404 INFO:tasks.workunit.client.1.smithi116.stdout:8/640: rmdir d2/d10/d19/d21/d69/dbf 0 2024-09-13T21:40:47.405 INFO:tasks.workunit.client.1.smithi116.stdout:8/641: mkdir d2/d10/d19/d42/d45/d87/dc1 0 2024-09-13T21:40:47.406 INFO:tasks.workunit.client.1.smithi116.stdout:8/642: creat d2/d27/d66/d7c/fc2 x:0 0 0 2024-09-13T21:40:47.407 INFO:tasks.workunit.client.1.smithi116.stdout:8/643: rmdir d2/d27/d62 39 2024-09-13T21:40:47.472 INFO:tasks.workunit.client.1.smithi116.stdout:2/560: dread d0/d5/f10 [0,4194304] 0 2024-09-13T21:40:47.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:46 smithi088 ceph-mon[27963]: pgmap v263: 65 pgs: 65 active+clean; 1.4 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 138 MiB/s rd, 155 MiB/s wr, 330 op/s 2024-09-13T21:40:47.543 INFO:tasks.workunit.client.1.smithi116.stdout:7/741: dwrite d5/f59 [0,4194304] 0 2024-09-13T21:40:47.543 INFO:tasks.workunit.client.1.smithi116.stdout:7/742: chown d5/d9/d27 63344710 1 2024-09-13T21:40:47.553 INFO:tasks.workunit.client.1.smithi116.stdout:2/561: dwrite d0/d5/d8/f3c [0,4194304] 0 2024-09-13T21:40:47.563 INFO:tasks.workunit.client.1.smithi116.stdout:7/743: dwrite d5/d9/db/d21/f3e [0,4194304] 0 2024-09-13T21:40:47.565 INFO:tasks.workunit.client.1.smithi116.stdout:7/744: creat d5/d9/db/d21/ff3 x:0 0 0 2024-09-13T21:40:47.573 INFO:tasks.workunit.client.1.smithi116.stdout:7/745: write d5/d9/db/d21/d6e/d6f/fd0 [3237001,20498] 0 2024-09-13T21:40:47.574 INFO:tasks.workunit.client.1.smithi116.stdout:7/746: symlink d5/db0/def/lf4 0 2024-09-13T21:40:47.575 INFO:tasks.workunit.client.1.smithi116.stdout:7/747: rmdir d5/d9/d27/ded/d22/d24/d6b/d72 39 2024-09-13T21:40:47.576 INFO:tasks.workunit.client.1.smithi116.stdout:7/748: link d5/d9/d27/ded/d22/d24/d3a/fb6 d5/d9/d27/ded/d22/d24/d3a/ddc/ff5 0 2024-09-13T21:40:47.577 INFO:tasks.workunit.client.1.smithi116.stdout:2/562: dwrite d0/d3a/f9b [0,4194304] 0 2024-09-13T21:40:47.577 INFO:tasks.workunit.client.1.smithi116.stdout:2/563: fsync d0/d7/d2b/f3e 0 2024-09-13T21:40:47.577 INFO:tasks.workunit.client.1.smithi116.stdout:2/564: chown d0/d5/d2a/l97 14975997 1 2024-09-13T21:40:47.578 INFO:tasks.workunit.client.1.smithi116.stdout:7/749: link d5/d9/f33 d5/d9/db/d21/d6e/d6f/d70/d80/ff6 0 2024-09-13T21:40:47.578 INFO:tasks.workunit.client.1.smithi116.stdout:7/750: write d5/d9/d27/ded/d22/fc2 [274053,19029] 0 2024-09-13T21:40:47.604 INFO:tasks.workunit.client.1.smithi116.stdout:2/565: dwrite d0/d7/d49/f80 [0,4194304] 0 2024-09-13T21:40:47.604 INFO:tasks.workunit.client.1.smithi116.stdout:2/566: chown d0/d5/d8/d7a/f91 465399 1 2024-09-13T21:40:47.604 INFO:tasks.workunit.client.1.smithi116.stdout:2/567: fdatasync d0/d7/d2d/f6a 0 2024-09-13T21:40:47.604 INFO:tasks.workunit.client.1.smithi116.stdout:7/751: dwrite d5/d9/d27/ded/d22/faa [0,4194304] 0 2024-09-13T21:40:47.605 INFO:tasks.workunit.client.1.smithi116.stdout:7/752: readlink d5/d9/l1b 0 2024-09-13T21:40:47.607 INFO:tasks.workunit.client.1.smithi116.stdout:2/568: mknod d0/d7/d2b/d61/cb9 0 2024-09-13T21:40:47.607 INFO:tasks.workunit.client.1.smithi116.stdout:2/569: fsync d0/d3a/d82/d62/f9d 0 2024-09-13T21:40:47.620 INFO:tasks.workunit.client.1.smithi116.stdout:7/753: dwrite d5/d9/d27/d31/fd8 [0,4194304] 0 2024-09-13T21:40:47.624 INFO:tasks.workunit.client.1.smithi116.stdout:7/754: dread d5/db0/fce [0,4194304] 0 2024-09-13T21:40:47.625 INFO:tasks.workunit.client.1.smithi116.stdout:7/755: mknod d5/d9/d27/ded/d22/d24/d3a/cf7 0 2024-09-13T21:40:47.625 INFO:tasks.workunit.client.1.smithi116.stdout:7/756: readlink d5/ld 0 2024-09-13T21:40:47.626 INFO:tasks.workunit.client.1.smithi116.stdout:7/757: symlink d5/d9/d27/ded/d22/d24/d6b/lf8 0 2024-09-13T21:40:47.626 INFO:tasks.workunit.client.1.smithi116.stdout:7/758: truncate d5/d9/db/d21/d6e/d6f/f88 5117552 0 2024-09-13T21:40:47.626 INFO:tasks.workunit.client.1.smithi116.stdout:7/759: read - d5/d9/d27/ded/d22/fda zero size 2024-09-13T21:40:47.626 INFO:tasks.workunit.client.1.smithi116.stdout:7/760: chown d5/d9/d27/ded/d22/d24/d6b/fd6 157730 1 2024-09-13T21:40:47.627 INFO:tasks.workunit.client.1.smithi116.stdout:7/761: creat d5/d9/d27/ded/ff9 x:0 0 0 2024-09-13T21:40:47.627 INFO:tasks.workunit.client.1.smithi116.stdout:7/762: chown d5/d9/d27/ded/d22/d24/d3a/f8a 378065905 1 2024-09-13T21:40:47.627 INFO:tasks.workunit.client.1.smithi116.stdout:7/763: mkdir d5/d9/d27/ded/d37/dfa 0 2024-09-13T21:40:47.629 INFO:tasks.workunit.client.1.smithi116.stdout:7/764: creat d5/d9/db/ffb x:0 0 0 2024-09-13T21:40:47.630 INFO:tasks.workunit.client.1.smithi116.stdout:7/765: mkdir d5/d9/d27/ded/d22/d24/d5f/dfc 0 2024-09-13T21:40:47.630 INFO:tasks.workunit.client.1.smithi116.stdout:7/766: rmdir d5/d9/d27/ded/d22/d24/d3a/ddc 39 2024-09-13T21:40:47.630 INFO:tasks.workunit.client.1.smithi116.stdout:7/767: readlink d5/d9/l13 0 2024-09-13T21:40:47.661 INFO:tasks.workunit.client.1.smithi116.stdout:9/431: sync 2024-09-13T21:40:47.662 INFO:tasks.workunit.client.1.smithi116.stdout:6/656: sync 2024-09-13T21:40:47.662 INFO:tasks.workunit.client.1.smithi116.stdout:4/599: sync 2024-09-13T21:40:47.662 INFO:tasks.workunit.client.1.smithi116.stdout:1/499: sync 2024-09-13T21:40:47.662 INFO:tasks.workunit.client.1.smithi116.stdout:5/780: sync 2024-09-13T21:40:47.663 INFO:tasks.workunit.client.1.smithi116.stdout:4/600: mkdir d0/d56/d84/db1 0 2024-09-13T21:40:47.665 INFO:tasks.workunit.client.1.smithi116.stdout:1/500: symlink d4/d14/d52/d2f/d91/lb6 0 2024-09-13T21:40:47.665 INFO:tasks.workunit.client.1.smithi116.stdout:6/657: dread d8/d10/d33/f46 [0,4194304] 0 2024-09-13T21:40:47.665 INFO:tasks.workunit.client.1.smithi116.stdout:6/658: stat d8/d10/d24 0 2024-09-13T21:40:47.666 INFO:tasks.workunit.client.1.smithi116.stdout:5/781: mknod d7/d1d/d46/dd4/d5e/d65/da5/c104 0 2024-09-13T21:40:47.668 INFO:tasks.workunit.client.1.smithi116.stdout:6/659: mknod d8/d15/d2e/d2f/d38/d9c/ce6 0 2024-09-13T21:40:47.670 INFO:tasks.workunit.client.1.smithi116.stdout:5/782: creat d7/d1d/d64/d94/f105 x:0 0 0 2024-09-13T21:40:47.672 INFO:tasks.workunit.client.1.smithi116.stdout:6/660: mknod d8/d10/d24/dab/ce7 0 2024-09-13T21:40:47.672 INFO:tasks.workunit.client.1.smithi116.stdout:6/661: write d8/d10/d33/f3b [5209865,103932] 0 2024-09-13T21:40:47.672 INFO:tasks.workunit.client.1.smithi116.stdout:6/662: getdents d8/d17/d70/da0/daf/ddd 0 2024-09-13T21:40:47.675 INFO:tasks.workunit.client.1.smithi116.stdout:6/663: mknod d8/d10/ce8 0 2024-09-13T21:40:47.675 INFO:tasks.workunit.client.1.smithi116.stdout:6/664: fdatasync d8/f3c 0 2024-09-13T21:40:47.675 INFO:tasks.workunit.client.1.smithi116.stdout:6/665: write d8/d15/d2e/d2f/d57/f72 [5060946,20195] 0 2024-09-13T21:40:47.677 INFO:tasks.workunit.client.1.smithi116.stdout:6/666: mkdir d8/d15/d2e/d9e/de9 0 2024-09-13T21:40:47.688 INFO:tasks.workunit.client.1.smithi116.stdout:5/783: write d7/d1d/d46/d5c/f63 [2933006,87202] 0 2024-09-13T21:40:47.689 INFO:tasks.workunit.client.1.smithi116.stdout:5/784: symlink d7/d40/d53/l106 0 2024-09-13T21:40:47.689 INFO:tasks.workunit.client.1.smithi116.stdout:5/785: write d7/d40/d53/f6e [262476,20536] 0 2024-09-13T21:40:47.691 INFO:tasks.workunit.client.1.smithi116.stdout:5/786: mknod d7/d1d/d46/d85/c107 0 2024-09-13T21:40:47.692 INFO:tasks.workunit.client.1.smithi116.stdout:9/432: dwrite d2/d10/d14/d38/d3a/f6c [4194304,4194304] 0 2024-09-13T21:40:47.692 INFO:tasks.workunit.client.1.smithi116.stdout:9/433: chown d2/d10/d14/f21 116956 1 2024-09-13T21:40:47.692 INFO:tasks.workunit.client.1.smithi116.stdout:9/434: chown d2/d8/fd 473228231 1 2024-09-13T21:40:47.692 INFO:tasks.workunit.client.1.smithi116.stdout:5/787: symlink d7/d1d/d46/l108 0 2024-09-13T21:40:47.694 INFO:tasks.workunit.client.1.smithi116.stdout:9/435: symlink d2/d10/d14/l82 0 2024-09-13T21:40:47.695 INFO:tasks.workunit.client.1.smithi116.stdout:9/436: readlink d2/d8/le 0 2024-09-13T21:40:47.695 INFO:tasks.workunit.client.1.smithi116.stdout:9/437: mknod d2/d5d/d69/d7d/c83 0 2024-09-13T21:40:47.697 INFO:tasks.workunit.client.1.smithi116.stdout:9/438: unlink d2/d5d/d69/d7d/c83 0 2024-09-13T21:40:47.700 INFO:tasks.workunit.client.1.smithi116.stdout:9/439: creat d2/d10/f84 x:0 0 0 2024-09-13T21:40:47.700 INFO:tasks.workunit.client.1.smithi116.stdout:9/440: mknod d2/d5d/c85 0 2024-09-13T21:40:47.700 INFO:tasks.workunit.client.1.smithi116.stdout:9/441: chown d2/d10/d14/d38 124000026 1 2024-09-13T21:40:47.700 INFO:tasks.workunit.client.1.smithi116.stdout:4/601: dwrite d0/d32/f3e [4194304,4194304] 0 2024-09-13T21:40:47.700 INFO:tasks.workunit.client.1.smithi116.stdout:4/602: readlink d0/dd/l1a 0 2024-09-13T21:40:47.701 INFO:tasks.workunit.client.1.smithi116.stdout:4/603: chown d0/dd/d13/d5a/d7a 3577918 1 2024-09-13T21:40:47.701 INFO:tasks.workunit.client.1.smithi116.stdout:6/667: dwrite d8/d10/d33/f67 [0,4194304] 0 2024-09-13T21:40:47.701 INFO:tasks.workunit.client.1.smithi116.stdout:6/668: fdatasync d8/d17/d70/f7c 0 2024-09-13T21:40:47.701 INFO:tasks.workunit.client.1.smithi116.stdout:6/669: chown d8/d10/d24/c96 78524 1 2024-09-13T21:40:47.702 INFO:tasks.workunit.client.1.smithi116.stdout:4/604: symlink d0/dd/lb2 0 2024-09-13T21:40:47.706 INFO:tasks.workunit.client.1.smithi116.stdout:4/605: mknod d0/d56/d84/db1/cb3 0 2024-09-13T21:40:47.706 INFO:tasks.workunit.client.1.smithi116.stdout:4/606: write d0/dd/d13/f41 [3364341,55777] 0 2024-09-13T21:40:47.708 INFO:tasks.workunit.client.1.smithi116.stdout:6/670: mkdir d8/d10/dea 0 2024-09-13T21:40:47.711 INFO:tasks.workunit.client.1.smithi116.stdout:4/607: unlink d0/d56/f69 0 2024-09-13T21:40:47.711 INFO:tasks.workunit.client.1.smithi116.stdout:4/608: write d0/dd/f9b [1815941,95906] 0 2024-09-13T21:40:47.712 INFO:tasks.workunit.client.1.smithi116.stdout:6/671: getdents d8/d10/d24/dab 0 2024-09-13T21:40:47.715 INFO:tasks.workunit.client.1.smithi116.stdout:4/609: mknod d0/d56/cb4 0 2024-09-13T21:40:47.716 INFO:tasks.workunit.client.1.smithi116.stdout:6/672: symlink d8/d17/da6/leb 0 2024-09-13T21:40:47.718 INFO:tasks.workunit.client.1.smithi116.stdout:4/610: creat d0/d56/fb5 x:0 0 0 2024-09-13T21:40:47.718 INFO:tasks.workunit.client.1.smithi116.stdout:4/611: fdatasync d0/d32/d5f/f63 0 2024-09-13T21:40:47.719 INFO:tasks.workunit.client.1.smithi116.stdout:4/612: unlink d0/dd/d13/f91 0 2024-09-13T21:40:47.724 INFO:tasks.workunit.client.1.smithi116.stdout:5/788: dwrite d7/d1d/d46/dd4/d5e/f4e [0,4194304] 0 2024-09-13T21:40:47.724 INFO:tasks.workunit.client.1.smithi116.stdout:5/789: readlink d7/d1d/d46/d85/d96/dd6/dd8/ldc 0 2024-09-13T21:40:47.724 INFO:tasks.workunit.client.1.smithi116.stdout:9/442: dwrite d2/d10/d6e/f7f [0,4194304] 0 2024-09-13T21:40:47.724 INFO:tasks.workunit.client.1.smithi116.stdout:9/443: truncate d2/d10/d14/f59 276537 0 2024-09-13T21:40:47.727 INFO:tasks.workunit.client.1.smithi116.stdout:5/790: link d7/d1d/dbb/fd3 d7/d1d/d46/dd4/d5e/d65/f109 0 2024-09-13T21:40:47.727 INFO:tasks.workunit.client.1.smithi116.stdout:5/791: read - d7/d1d/d46/d85/d96/da8/fac zero size 2024-09-13T21:40:47.729 INFO:tasks.workunit.client.1.smithi116.stdout:9/444: unlink d2/d10/c39 0 2024-09-13T21:40:47.729 INFO:tasks.workunit.client.1.smithi116.stdout:9/445: dread - d2/d10/f52 zero size 2024-09-13T21:40:47.729 INFO:tasks.workunit.client.1.smithi116.stdout:9/446: dread - d2/d8/d3e/f56 zero size 2024-09-13T21:40:47.730 INFO:tasks.workunit.client.1.smithi116.stdout:5/792: truncate d7/d1d/d64/fab 1582057 0 2024-09-13T21:40:47.730 INFO:tasks.workunit.client.1.smithi116.stdout:5/793: truncate d7/d1d/d64/d87/f8a 1045712 0 2024-09-13T21:40:47.731 INFO:tasks.workunit.client.1.smithi116.stdout:9/447: truncate d2/d8/f11 1260693 0 2024-09-13T21:40:47.732 INFO:tasks.workunit.client.1.smithi116.stdout:6/673: write d8/d10/d33/f67 [4037711,57896] 0 2024-09-13T21:40:47.733 INFO:tasks.workunit.client.1.smithi116.stdout:5/794: symlink d7/d1d/d46/d85/d96/dd6/l10a 0 2024-09-13T21:40:47.733 INFO:tasks.workunit.client.1.smithi116.stdout:4/613: write d0/d32/f52 [2976895,69156] 0 2024-09-13T21:40:47.735 INFO:tasks.workunit.client.1.smithi116.stdout:9/448: mknod d2/d8/c86 0 2024-09-13T21:40:47.735 INFO:tasks.workunit.client.1.smithi116.stdout:4/614: creat d0/fb6 x:0 0 0 2024-09-13T21:40:47.737 INFO:tasks.workunit.client.1.smithi116.stdout:6/674: dread d8/d15/d2e/fcf [0,4194304] 0 2024-09-13T21:40:47.737 INFO:tasks.workunit.client.1.smithi116.stdout:9/449: rename d2/d8/c37 to d2/d8/d3e/c87 0 2024-09-13T21:40:47.737 INFO:tasks.workunit.client.1.smithi116.stdout:9/450: chown d2/d5d/d69/c77 3152 1 2024-09-13T21:40:47.741 INFO:tasks.workunit.client.1.smithi116.stdout:4/615: mkdir d0/d32/da3/db7 0 2024-09-13T21:40:47.762 INFO:tasks.workunit.client.1.smithi116.stdout:5/795: dwrite d7/d1d/d46/d85/fa0 [0,4194304] 0 2024-09-13T21:40:47.763 INFO:tasks.workunit.client.1.smithi116.stdout:6/675: dwrite d8/d10/d24/dab/fc0 [0,4194304] 0 2024-09-13T21:40:47.763 INFO:tasks.workunit.client.1.smithi116.stdout:6/676: read - d8/d17/fb6 zero size 2024-09-13T21:40:47.764 INFO:tasks.workunit.client.1.smithi116.stdout:5/796: truncate d7/f72 310164 0 2024-09-13T21:40:47.765 INFO:tasks.workunit.client.1.smithi116.stdout:9/451: dwrite d2/d72/f79 [0,4194304] 0 2024-09-13T21:40:47.769 INFO:tasks.workunit.client.1.smithi116.stdout:9/452: mknod d2/d10/d6e/c88 0 2024-09-13T21:40:47.775 INFO:tasks.workunit.client.1.smithi116.stdout:6/677: write d8/d15/d2e/f3f [692551,8757] 0 2024-09-13T21:40:47.779 INFO:tasks.workunit.client.1.smithi116.stdout:5/797: rename d7/c6c to d7/d1d/c10b 0 2024-09-13T21:40:47.779 INFO:tasks.workunit.client.1.smithi116.stdout:5/798: readlink d7/d1d/d46/d5c/la7 0 2024-09-13T21:40:47.779 INFO:tasks.workunit.client.1.smithi116.stdout:5/799: dread - d7/d1d/d46/d85/d96/da8/fbe zero size 2024-09-13T21:40:47.779 INFO:tasks.workunit.client.1.smithi116.stdout:5/800: read d7/d40/d53/f61 [832478,31395] 0 2024-09-13T21:40:47.779 INFO:tasks.workunit.client.1.smithi116.stdout:5/801: write d7/d1d/d46/d85/d96/da8/db9/fef [280141,31908] 0 2024-09-13T21:40:47.780 INFO:tasks.workunit.client.1.smithi116.stdout:6/678: creat d8/db5/fec x:0 0 0 2024-09-13T21:40:47.782 INFO:tasks.workunit.client.1.smithi116.stdout:5/802: rename d7/d1d/d46/dd4/d5e/l5f to d7/d40/d90/l10c 0 2024-09-13T21:40:47.783 INFO:tasks.workunit.client.1.smithi116.stdout:6/679: creat d8/d17/de0/fed x:0 0 0 2024-09-13T21:40:47.784 INFO:tasks.workunit.client.1.smithi116.stdout:5/803: mknod d7/d1d/d46/dd4/d5e/d65/df9/c10d 0 2024-09-13T21:40:47.785 INFO:tasks.workunit.client.1.smithi116.stdout:6/680: creat d8/d15/d2e/d2f/d38/d9c/dcd/de5/fee x:0 0 0 2024-09-13T21:40:47.786 INFO:tasks.workunit.client.1.smithi116.stdout:9/453: dwrite d2/d8/f11 [0,4194304] 0 2024-09-13T21:40:47.788 INFO:tasks.workunit.client.1.smithi116.stdout:5/804: creat d7/d1d/d46/d85/d96/f10e x:0 0 0 2024-09-13T21:40:47.792 INFO:tasks.workunit.client.1.smithi116.stdout:9/454: rmdir d2/d5d 39 2024-09-13T21:40:47.793 INFO:tasks.workunit.client.1.smithi116.stdout:9/455: chown d2/c34 2 1 2024-09-13T21:40:47.794 INFO:tasks.workunit.client.1.smithi116.stdout:5/805: getdents d7/d9a 0 2024-09-13T21:40:47.796 INFO:tasks.workunit.client.1.smithi116.stdout:5/806: dread d7/d1d/d46/d85/d96/dd6/fe5 [0,4194304] 0 2024-09-13T21:40:47.797 INFO:tasks.workunit.client.1.smithi116.stdout:5/807: write d7/d1d/d46/d85/d96/dd6/fe5 [296950,37449] 0 2024-09-13T21:40:47.799 INFO:tasks.workunit.client.1.smithi116.stdout:5/808: rename d7/d40/d53/lba to d7/d1d/d46/dd4/d5e/d65/l10f 0 2024-09-13T21:40:47.801 INFO:tasks.workunit.client.1.smithi116.stdout:5/809: mkdir d7/d1d/d64/d110 0 2024-09-13T21:40:47.803 INFO:tasks.workunit.client.1.smithi116.stdout:5/810: write d7/d1d/d46/dd4/d5e/d79/d8f/ff6 [432598,60361] 0 2024-09-13T21:40:47.803 INFO:tasks.workunit.client.1.smithi116.stdout:5/811: chown d7/d1d/d46/dd4/d5e/d65/d6f/lf4 6403 1 2024-09-13T21:40:47.803 INFO:tasks.workunit.client.1.smithi116.stdout:5/812: read d7/d1d/d46/dd4/f37 [837475,30007] 0 2024-09-13T21:40:47.803 INFO:tasks.workunit.client.1.smithi116.stdout:5/813: readlink d7/l47 0 2024-09-13T21:40:47.803 INFO:tasks.workunit.client.1.smithi116.stdout:5/814: read d7/d1d/f20 [2115685,119494] 0 2024-09-13T21:40:47.804 INFO:tasks.workunit.client.1.smithi116.stdout:5/815: creat d7/d1d/d64/d110/f111 x:0 0 0 2024-09-13T21:40:47.804 INFO:tasks.workunit.client.1.smithi116.stdout:5/816: fsync d7/d40/d53/f61 0 2024-09-13T21:40:47.805 INFO:tasks.workunit.client.1.smithi116.stdout:5/817: rmdir d7/d1d 39 2024-09-13T21:40:47.806 INFO:tasks.workunit.client.1.smithi116.stdout:5/818: dread - d7/d1d/d64/d94/feb zero size 2024-09-13T21:40:47.807 INFO:tasks.workunit.client.1.smithi116.stdout:5/819: dread d7/d1d/d64/d87/fc7 [0,4194304] 0 2024-09-13T21:40:47.807 INFO:tasks.workunit.client.1.smithi116.stdout:5/820: truncate d7/d1d/d64/d94/daa/fe2 550240 0 2024-09-13T21:40:47.807 INFO:tasks.workunit.client.1.smithi116.stdout:5/821: creat d7/d1d/d64/d94/daa/f112 x:0 0 0 2024-09-13T21:40:47.807 INFO:tasks.workunit.client.1.smithi116.stdout:5/822: fsync d7/d1d/d46/dd4/d5e/d65/d6f/f7e 0 2024-09-13T21:40:47.808 INFO:tasks.workunit.client.1.smithi116.stdout:5/823: symlink d7/d1d/de3/l113 0 2024-09-13T21:40:47.810 INFO:tasks.workunit.client.1.smithi116.stdout:6/681: dwrite d8/fe [0,4194304] 0 2024-09-13T21:40:47.810 INFO:tasks.workunit.client.1.smithi116.stdout:5/824: creat d7/f114 x:0 0 0 2024-09-13T21:40:47.810 INFO:tasks.workunit.client.1.smithi116.stdout:5/825: write d7/d1d/d46/dd4/d5e/d65/d6a/ff5 [1508997,98770] 0 2024-09-13T21:40:47.810 INFO:tasks.workunit.client.1.smithi116.stdout:5/826: write d7/d1d/d46/dd4/f19 [4424269,66411] 0 2024-09-13T21:40:47.810 INFO:tasks.workunit.client.1.smithi116.stdout:9/456: dwrite d2/d5d/d69/f75 [0,4194304] 0 2024-09-13T21:40:47.810 INFO:tasks.workunit.client.1.smithi116.stdout:9/457: write d2/f2f [4747165,53776] 0 2024-09-13T21:40:47.811 INFO:tasks.workunit.client.1.smithi116.stdout:6/682: rename d8/d10/d78/f85 to d8/d15/d2e/d2f/fef 0 2024-09-13T21:40:47.813 INFO:tasks.workunit.client.1.smithi116.stdout:9/458: unlink c1 0 2024-09-13T21:40:47.814 INFO:tasks.workunit.client.1.smithi116.stdout:6/683: mknod d8/d17/cf0 0 2024-09-13T21:40:47.814 INFO:tasks.workunit.client.1.smithi116.stdout:6/684: chown d8/d17/c6b 19480 1 2024-09-13T21:40:47.815 INFO:tasks.workunit.client.1.smithi116.stdout:6/685: symlink d8/d17/de0/lf1 0 2024-09-13T21:40:47.815 INFO:tasks.workunit.client.1.smithi116.stdout:6/686: fsync d8/d15/f92 0 2024-09-13T21:40:47.815 INFO:tasks.workunit.client.1.smithi116.stdout:6/687: creat d8/d15/d2e/ff2 x:0 0 0 2024-09-13T21:40:47.815 INFO:tasks.workunit.client.1.smithi116.stdout:6/688: getdents d8/d15/d2e/d2f/d38/d9c/dcd 0 2024-09-13T21:40:47.816 INFO:tasks.workunit.client.1.smithi116.stdout:6/689: truncate d8/d17/fc4 9269560 0 2024-09-13T21:40:47.818 INFO:tasks.workunit.client.1.smithi116.stdout:5/827: write d7/f16 [5301133,15013] 0 2024-09-13T21:40:47.818 INFO:tasks.workunit.client.1.smithi116.stdout:5/828: write d7/f16 [6750588,71749] 0 2024-09-13T21:40:47.829 INFO:tasks.workunit.client.1.smithi116.stdout:9/459: write d2/d10/d14/f44 [7112485,12967] 0 2024-09-13T21:40:47.830 INFO:tasks.workunit.client.1.smithi116.stdout:9/460: truncate d2/d10/d14/f45 59791 0 2024-09-13T21:40:47.831 INFO:tasks.workunit.client.1.smithi116.stdout:9/461: creat d2/d5d/f89 x:0 0 0 2024-09-13T21:40:47.833 INFO:tasks.workunit.client.1.smithi116.stdout:9/462: symlink d2/d10/d14/d38/l8a 0 2024-09-13T21:40:47.835 INFO:tasks.workunit.client.1.smithi116.stdout:9/463: mknod d2/c8b 0 2024-09-13T21:40:47.835 INFO:tasks.workunit.client.1.smithi116.stdout:9/464: fsync d2/d5d/f62 0 2024-09-13T21:40:47.835 INFO:tasks.workunit.client.1.smithi116.stdout:9/465: dread - d2/d43/f68 zero size 2024-09-13T21:40:47.835 INFO:tasks.workunit.client.1.smithi116.stdout:9/466: truncate d2/f5f 691764 0 2024-09-13T21:40:47.836 INFO:tasks.workunit.client.1.smithi116.stdout:6/690: write d8/d1e/f28 [5955130,85576] 0 2024-09-13T21:40:47.837 INFO:tasks.workunit.client.1.smithi116.stdout:9/467: getdents d2/d8 0 2024-09-13T21:40:47.842 INFO:tasks.workunit.client.1.smithi116.stdout:9/468: rename d2/d10/d14/d38/d3a/c3f to d2/d10/d4c/c8c 0 2024-09-13T21:40:47.842 INFO:tasks.workunit.client.1.smithi116.stdout:9/469: dread d2/d10/d4c/f51 [0,4194304] 0 2024-09-13T21:40:47.848 INFO:tasks.workunit.client.1.smithi116.stdout:5/829: dwrite d7/d1d/d46/dd4/d5e/d65/f109 [0,4194304] 0 2024-09-13T21:40:47.848 INFO:tasks.workunit.client.1.smithi116.stdout:5/830: creat d7/d1d/d64/d87/f115 x:0 0 0 2024-09-13T21:40:47.848 INFO:tasks.workunit.client.1.smithi116.stdout:5/831: truncate d7/d1d/d46/dd4/d5e/fd1 593855 0 2024-09-13T21:40:47.849 INFO:tasks.workunit.client.1.smithi116.stdout:9/470: dread d2/f4 [0,4194304] 0 2024-09-13T21:40:47.887 INFO:tasks.workunit.client.1.smithi116.stdout:6/691: rmdir d8 39 2024-09-13T21:40:47.887 INFO:tasks.workunit.client.1.smithi116.stdout:6/692: chown d8/d17 1 1 2024-09-13T21:40:47.894 INFO:tasks.workunit.client.1.smithi116.stdout:6/693: dread d8/f3c [0,4194304] 0 2024-09-13T21:40:47.894 INFO:tasks.workunit.client.1.smithi116.stdout:5/832: mkdir d7/d1d/d64/d110/d116 0 2024-09-13T21:40:47.894 INFO:tasks.workunit.client.1.smithi116.stdout:5/833: stat d7/d1d/d46/dd4/d5e/d65/d6a/ca6 0 2024-09-13T21:40:47.895 INFO:tasks.workunit.client.1.smithi116.stdout:9/471: mknod d2/d5d/d69/c8d 0 2024-09-13T21:40:47.932 INFO:tasks.workunit.client.1.smithi116.stdout:6/694: creat d8/d1e/ff3 x:0 0 0 2024-09-13T21:40:47.933 INFO:tasks.workunit.client.1.smithi116.stdout:6/695: fdatasync d8/d10/d33/f52 0 2024-09-13T21:40:47.933 INFO:tasks.workunit.client.1.smithi116.stdout:6/696: write d8/d15/d2e/d2f/f35 [411887,128967] 0 2024-09-13T21:40:47.933 INFO:tasks.workunit.client.1.smithi116.stdout:5/834: symlink d7/d1d/d46/dd4/d5e/d65/df9/l117 0 2024-09-13T21:40:47.935 INFO:tasks.workunit.client.1.smithi116.stdout:9/472: rename d2/d8/f11 to d2/d43/f8e 0 2024-09-13T21:40:47.937 INFO:tasks.workunit.client.1.smithi116.stdout:5/835: rename d7/d1d/l38 to d7/d9a/l118 0 2024-09-13T21:40:47.937 INFO:tasks.workunit.client.1.smithi116.stdout:5/836: fdatasync d7/d1d/f70 0 2024-09-13T21:40:47.945 INFO:tasks.workunit.client.1.smithi116.stdout:0/761: sync 2024-09-13T21:40:47.945 INFO:tasks.workunit.client.1.smithi116.stdout:3/790: sync 2024-09-13T21:40:47.945 INFO:tasks.workunit.client.1.smithi116.stdout:3/791: write d3/db/d10/d99/ffa [1489244,126388] 0 2024-09-13T21:40:47.945 INFO:tasks.workunit.client.1.smithi116.stdout:8/644: sync 2024-09-13T21:40:47.949 INFO:tasks.workunit.client.1.smithi116.stdout:8/645: rename d2/d10/d19/d42/d45/c96 to d2/d10/d19/d3a/d4c/cc3 0 2024-09-13T21:40:47.949 INFO:tasks.workunit.client.1.smithi116.stdout:8/646: fsync d2/d10/d19/d21/d22/d5d/d46/f77 0 2024-09-13T21:40:47.949 INFO:tasks.workunit.client.1.smithi116.stdout:8/647: truncate d2/d10/d19/fb1 4356689 0 2024-09-13T21:40:47.949 INFO:tasks.workunit.client.1.smithi116.stdout:8/648: chown d2/d10/f18 7550186 1 2024-09-13T21:40:47.956 INFO:tasks.workunit.client.1.smithi116.stdout:0/762: dread d2/d5/fb7 [0,4194304] 0 2024-09-13T21:40:47.957 INFO:tasks.workunit.client.1.smithi116.stdout:0/763: write d2/dc/d47/d63/f7f [855650,30108] 0 2024-09-13T21:40:47.957 INFO:tasks.workunit.client.1.smithi116.stdout:0/764: write d2/dc/d47/d63/d9f/db6/fc2 [4769573,57531] 0 2024-09-13T21:40:47.957 INFO:tasks.workunit.client.1.smithi116.stdout:0/765: dread d2/dc/dcc/fd2 [0,4194304] 0 2024-09-13T21:40:47.957 INFO:tasks.workunit.client.1.smithi116.stdout:0/766: fsync d2/dc/f29 0 2024-09-13T21:40:47.959 INFO:tasks.workunit.client.1.smithi116.stdout:0/767: link d2/d5/f7e d2/dc/d12/d28/ffd 0 2024-09-13T21:40:47.959 INFO:tasks.workunit.client.1.smithi116.stdout:9/473: dwrite d2/d10/d4c/f7a [0,4194304] 0 2024-09-13T21:40:47.959 INFO:tasks.workunit.client.1.smithi116.stdout:9/474: dread - d2/f6d zero size 2024-09-13T21:40:47.960 INFO:tasks.workunit.client.1.smithi116.stdout:0/768: mknod d2/d5/cfe 0 2024-09-13T21:40:47.960 INFO:tasks.workunit.client.1.smithi116.stdout:0/769: write d2/dc/d47/d63/f9d [92400,82349] 0 2024-09-13T21:40:47.960 INFO:tasks.workunit.client.1.smithi116.stdout:8/649: write d2/d10/d19/d21/d69/f8b [3526960,45338] 0 2024-09-13T21:40:47.960 INFO:tasks.workunit.client.1.smithi116.stdout:8/650: write d2/f2f [4961040,100649] 0 2024-09-13T21:40:47.961 INFO:tasks.workunit.client.1.smithi116.stdout:9/475: mkdir d2/d5d/d8f 0 2024-09-13T21:40:47.968 INFO:tasks.workunit.client.1.smithi116.stdout:5/837: dwrite d7/d1d/d46/d85/f93 [0,4194304] 0 2024-09-13T21:40:47.974 INFO:tasks.workunit.client.1.smithi116.stdout:5/838: link d7/d1d/d46/dd4/caf d7/d1d/d46/dd4/d5e/d65/da5/c119 0 2024-09-13T21:40:47.975 INFO:tasks.workunit.client.1.smithi116.stdout:0/770: write d2/d5/d61/f77 [3772463,53441] 0 2024-09-13T21:40:47.975 INFO:tasks.workunit.client.1.smithi116.stdout:3/792: dwrite d3/db/d10/d1c/d34/d55/d57/db1/fef [0,4194304] 0 2024-09-13T21:40:47.975 INFO:tasks.workunit.client.1.smithi116.stdout:0/771: dread - d2/dc/d12/d28/d57/d65/ff7 zero size 2024-09-13T21:40:47.976 INFO:tasks.workunit.client.1.smithi116.stdout:9/476: read d2/d10/d14/d38/d3a/f6c [5722518,39883] 0 2024-09-13T21:40:47.976 INFO:tasks.workunit.client.1.smithi116.stdout:5/839: symlink d7/d1d/d64/l11a 0 2024-09-13T21:40:47.978 INFO:tasks.workunit.client.1.smithi116.stdout:8/651: dwrite d2/d27/d66/f8c [0,4194304] 0 2024-09-13T21:40:47.979 INFO:tasks.workunit.client.1.smithi116.stdout:8/652: chown d2/d10/d19/d3a/c71 771649897 1 2024-09-13T21:40:47.980 INFO:tasks.workunit.client.1.smithi116.stdout:8/653: dread d2/d10/d19/f84 [4194304,4194304] 0 2024-09-13T21:40:47.981 INFO:tasks.workunit.client.1.smithi116.stdout:0/772: link d2/dc/d12/d28/l64 d2/d5/lff 0 2024-09-13T21:40:47.992 INFO:tasks.workunit.client.1.smithi116.stdout:8/654: creat d2/d27/d66/fc4 x:0 0 0 2024-09-13T21:40:47.992 INFO:tasks.workunit.client.1.smithi116.stdout:8/655: truncate d2/d10/d19/fb1 5319190 0 2024-09-13T21:40:47.992 INFO:tasks.workunit.client.1.smithi116.stdout:8/656: truncate d2/d10/d19/d3a/d4c/d7a/fc0 163860 0 2024-09-13T21:40:47.992 INFO:tasks.workunit.client.1.smithi116.stdout:8/657: truncate d2/d10/d19/d21/d22/d5d/d46/f7d 4535657 0 2024-09-13T21:40:47.993 INFO:tasks.workunit.client.1.smithi116.stdout:0/773: creat d2/dc/dcf/dd7/f100 x:0 0 0 2024-09-13T21:40:47.994 INFO:tasks.workunit.client.1.smithi116.stdout:9/477: dread d2/d10/f12 [0,4194304] 0 2024-09-13T21:40:47.994 INFO:tasks.workunit.client.1.smithi116.stdout:9/478: write d2/d43/f63 [843646,49235] 0 2024-09-13T21:40:47.998 INFO:tasks.workunit.client.1.smithi116.stdout:0/774: dread d2/dc/f31 [0,4194304] 0 2024-09-13T21:40:47.998 INFO:tasks.workunit.client.1.smithi116.stdout:0/775: readlink d2/dc/l5f 0 2024-09-13T21:40:47.999 INFO:tasks.workunit.client.1.smithi116.stdout:0/776: unlink d2/f83 0 2024-09-13T21:40:47.999 INFO:tasks.workunit.client.1.smithi116.stdout:0/777: write d2/d5b/f93 [2063475,99099] 0 2024-09-13T21:40:48.000 INFO:tasks.workunit.client.1.smithi116.stdout:0/778: mkdir d2/d5b/db4/d101 0 2024-09-13T21:40:48.001 INFO:tasks.workunit.client.1.smithi116.stdout:8/658: dread d2/d10/d3e/da4/fb2 [0,4194304] 0 2024-09-13T21:40:48.001 INFO:tasks.workunit.client.1.smithi116.stdout:8/659: creat d2/d5c/fc5 x:0 0 0 2024-09-13T21:40:48.001 INFO:tasks.workunit.client.1.smithi116.stdout:8/660: write d2/d10/d37/f25 [1450838,127279] 0 2024-09-13T21:40:48.007 INFO:tasks.workunit.client.1.smithi116.stdout:3/793: dwrite d3/db/d10/d1d/d5f/fe1 [0,4194304] 0 2024-09-13T21:40:48.007 INFO:tasks.workunit.client.1.smithi116.stdout:3/794: truncate d3/df9/f69 4400034 0 2024-09-13T21:40:48.012 INFO:tasks.workunit.client.1.smithi116.stdout:8/661: dread d2/d10/d19/d21/f47 [0,4194304] 0 2024-09-13T21:40:48.013 INFO:tasks.workunit.client.1.smithi116.stdout:2/570: sync 2024-09-13T21:40:48.013 INFO:tasks.workunit.client.1.smithi116.stdout:1/501: sync 2024-09-13T21:40:48.013 INFO:tasks.workunit.client.1.smithi116.stdout:4/616: sync 2024-09-13T21:40:48.015 INFO:tasks.workunit.client.1.smithi116.stdout:4/617: truncate d0/fb 3383093 0 2024-09-13T21:40:48.015 INFO:tasks.workunit.client.1.smithi116.stdout:2/571: getdents d0/d3a/d82/d62/d1f/d5d/d72/daa 0 2024-09-13T21:40:48.015 INFO:tasks.workunit.client.1.smithi116.stdout:2/572: readlink d0/d3a/d82/d62/l2e 0 2024-09-13T21:40:48.015 INFO:tasks.workunit.client.1.smithi116.stdout:2/573: write d0/fae [1575102,84072] 0 2024-09-13T21:40:48.016 INFO:tasks.workunit.client.1.smithi116.stdout:2/574: truncate d0/d7/d2b/f3e 3142406 0 2024-09-13T21:40:48.022 INFO:tasks.workunit.client.1.smithi116.stdout:5/840: dwrite d7/d1d/f70 [0,4194304] 0 2024-09-13T21:40:48.025 INFO:tasks.workunit.client.1.smithi116.stdout:5/841: creat d7/d1d/d46/d5c/dcc/f11b x:0 0 0 2024-09-13T21:40:48.027 INFO:tasks.workunit.client.1.smithi116.stdout:5/842: symlink d7/d1d/d46/dd4/d5e/d65/l11c 0 2024-09-13T21:40:48.028 INFO:tasks.workunit.client.1.smithi116.stdout:4/618: dread d0/dd/d13/f4c [0,4194304] 0 2024-09-13T21:40:48.028 INFO:tasks.workunit.client.1.smithi116.stdout:4/619: chown d0/dd/d13/d4e 44 1 2024-09-13T21:40:48.028 INFO:tasks.workunit.client.1.smithi116.stdout:5/843: link d7/d1d/d46/d85/d96/da8/fbe d7/d40/d53/dc8/f11d 0 2024-09-13T21:40:48.029 INFO:tasks.workunit.client.1.smithi116.stdout:4/620: mknod d0/dd/cb8 0 2024-09-13T21:40:48.031 INFO:tasks.workunit.client.1.smithi116.stdout:5/844: unlink d7/d1d/d46/dd4/c23 0 2024-09-13T21:40:48.032 INFO:tasks.workunit.client.1.smithi116.stdout:4/621: mkdir d0/d56/d57/db9 0 2024-09-13T21:40:48.032 INFO:tasks.workunit.client.1.smithi116.stdout:5/845: mkdir d7/d1d/d64/d11e 0 2024-09-13T21:40:48.033 INFO:tasks.workunit.client.1.smithi116.stdout:5/846: write d7/d40/d53/f6e [1234804,61619] 0 2024-09-13T21:40:48.033 INFO:tasks.workunit.client.1.smithi116.stdout:4/622: symlink d0/dd/d13/lba 0 2024-09-13T21:40:48.040 INFO:tasks.workunit.client.1.smithi116.stdout:7/768: sync 2024-09-13T21:40:48.041 INFO:tasks.workunit.client.1.smithi116.stdout:9/479: dwrite d2/f4 [0,4194304] 0 2024-09-13T21:40:48.041 INFO:tasks.workunit.client.1.smithi116.stdout:9/480: chown d2/d10/d14/d38/d3a 39803 1 2024-09-13T21:40:48.042 INFO:tasks.workunit.client.1.smithi116.stdout:7/769: unlink d5/d9/d27/ded/d2e/l9c 0 2024-09-13T21:40:48.044 INFO:tasks.workunit.client.1.smithi116.stdout:9/481: rename d2/d8/le to d2/d10/l90 0 2024-09-13T21:40:48.045 INFO:tasks.workunit.client.1.smithi116.stdout:7/770: creat d5/d9/d27/d31/d38/d42/ffd x:0 0 0 2024-09-13T21:40:48.045 INFO:tasks.workunit.client.1.smithi116.stdout:7/771: write d5/f5e [664064,120851] 0 2024-09-13T21:40:48.046 INFO:tasks.workunit.client.1.smithi116.stdout:5/847: dread d7/d1d/d46/dd4/d5e/f3b [0,4194304] 0 2024-09-13T21:40:48.046 INFO:tasks.workunit.client.1.smithi116.stdout:5/848: creat d7/d1d/d64/d87/f11f x:0 0 0 2024-09-13T21:40:48.048 INFO:tasks.workunit.client.1.smithi116.stdout:9/482: truncate d2/d10/d4c/f51 96680 0 2024-09-13T21:40:48.049 INFO:tasks.workunit.client.1.smithi116.stdout:5/849: fsync d7/f2f 0 2024-09-13T21:40:48.050 INFO:tasks.workunit.client.1.smithi116.stdout:3/795: dwrite d3/db/d10/fba [0,4194304] 0 2024-09-13T21:40:48.050 INFO:tasks.workunit.client.1.smithi116.stdout:2/575: dwrite d0/f54 [0,4194304] 0 2024-09-13T21:40:48.051 INFO:tasks.workunit.client.1.smithi116.stdout:5/850: mkdir d7/d1d/d46/dd4/d5e/d79/dcb/d120 0 2024-09-13T21:40:48.053 INFO:tasks.workunit.client.1.smithi116.stdout:3/796: link d3/db/d20/d86/da6/c102 d3/db/d10/d1c/d34/d47/c11a 0 2024-09-13T21:40:48.055 INFO:tasks.workunit.client.1.smithi116.stdout:2/576: creat d0/d7/d2b/d61/fba x:0 0 0 2024-09-13T21:40:48.056 INFO:tasks.workunit.client.1.smithi116.stdout:2/577: creat d0/d3a/d82/d62/d1f/fbb x:0 0 0 2024-09-13T21:40:48.057 INFO:tasks.workunit.client.1.smithi116.stdout:5/851: rmdir d7/d1d/de3 39 2024-09-13T21:40:48.058 INFO:tasks.workunit.client.1.smithi116.stdout:2/578: creat d0/d5/d8/d7a/fbc x:0 0 0 2024-09-13T21:40:48.058 INFO:tasks.workunit.client.1.smithi116.stdout:2/579: getdents d0/d5 0 2024-09-13T21:40:48.059 INFO:tasks.workunit.client.1.smithi116.stdout:2/580: write d0/d3a/d82/d62/f4a [288872,3815] 0 2024-09-13T21:40:48.061 INFO:tasks.workunit.client.1.smithi116.stdout:2/581: link d0/d3a/d82/d62/l2e d0/d7/d49/lbd 0 2024-09-13T21:40:48.061 INFO:tasks.workunit.client.1.smithi116.stdout:1/502: dwrite d4/d14/d52/f99 [0,4194304] 0 2024-09-13T21:40:48.066 INFO:tasks.workunit.client.1.smithi116.stdout:9/483: write d2/d10/d14/f21 [7070619,39684] 0 2024-09-13T21:40:48.066 INFO:tasks.workunit.client.1.smithi116.stdout:9/484: chown d2/d8 10 1 2024-09-13T21:40:48.067 INFO:tasks.workunit.client.1.smithi116.stdout:1/503: rmdir d4/d74/d8d 39 2024-09-13T21:40:48.067 INFO:tasks.workunit.client.1.smithi116.stdout:3/797: dread d3/db/d10/d1d/d5f/d6f/fb3 [0,4194304] 0 2024-09-13T21:40:48.069 INFO:tasks.workunit.client.1.smithi116.stdout:9/485: creat d2/d43/f91 x:0 0 0 2024-09-13T21:40:48.070 INFO:tasks.workunit.client.1.smithi116.stdout:1/504: creat d4/d14/db0/fb7 x:0 0 0 2024-09-13T21:40:48.070 INFO:tasks.workunit.client.1.smithi116.stdout:1/505: write d4/d74/d8d/f9a [381443,20572] 0 2024-09-13T21:40:48.072 INFO:tasks.workunit.client.1.smithi116.stdout:8/662: dwrite d2/d10/d19/d21/d69/f8b [0,4194304] 0 2024-09-13T21:40:48.072 INFO:tasks.workunit.client.1.smithi116.stdout:3/798: unlink d3/db/d10/d1c/d34/d55/d57/c5a 0 2024-09-13T21:40:48.073 INFO:tasks.workunit.client.1.smithi116.stdout:4/623: dwrite d0/dd/d48/f5c [4194304,4194304] 0 2024-09-13T21:40:48.073 INFO:tasks.workunit.client.1.smithi116.stdout:4/624: readlink d0/l25 0 2024-09-13T21:40:48.074 INFO:tasks.workunit.client.1.smithi116.stdout:1/506: dread d4/d74/d8d/d5f/f78 [0,4194304] 0 2024-09-13T21:40:48.075 INFO:tasks.workunit.client.1.smithi116.stdout:7/772: dwrite d5/d9/d27/d31/d38/d48/f94 [0,4194304] 0 2024-09-13T21:40:48.080 INFO:tasks.workunit.client.1.smithi116.stdout:7/773: rename d5/f4b to d5/d9/d27/ded/d2e/d52/ffe 0 2024-09-13T21:40:48.080 INFO:tasks.workunit.client.1.smithi116.stdout:7/774: write d5/f8 [4317617,40145] 0 2024-09-13T21:40:48.080 INFO:tasks.workunit.client.1.smithi116.stdout:7/775: truncate d5/d9/d27/ded/d22/d24/d6b/d72/f8c 1169174 0 2024-09-13T21:40:48.081 INFO:tasks.workunit.client.1.smithi116.stdout:1/507: dread d4/d14/d41/f98 [0,4194304] 0 2024-09-13T21:40:48.081 INFO:tasks.workunit.client.1.smithi116.stdout:1/508: readlink d4/l47 0 2024-09-13T21:40:48.081 INFO:tasks.workunit.client.1.smithi116.stdout:1/509: getdents d4/d14/d52/d2f/d5c/daf 0 2024-09-13T21:40:48.081 INFO:tasks.workunit.client.1.smithi116.stdout:1/510: fdatasync d4/f8b 0 2024-09-13T21:40:48.081 INFO:tasks.workunit.client.1.smithi116.stdout:2/582: dread d0/d5/d8/f3c [0,4194304] 0 2024-09-13T21:40:48.081 INFO:tasks.workunit.client.1.smithi116.stdout:2/583: dread - d0/d5/d2a/f57 zero size 2024-09-13T21:40:48.081 INFO:tasks.workunit.client.1.smithi116.stdout:9/486: dread d2/d8/f1a [0,4194304] 0 2024-09-13T21:40:48.082 INFO:tasks.workunit.client.1.smithi116.stdout:5/852: dwrite d7/fc [0,4194304] 0 2024-09-13T21:40:48.084 INFO:tasks.workunit.client.1.smithi116.stdout:1/511: rename d4/d14/d52/f40 to d4/d14/db0/fb8 0 2024-09-13T21:40:48.084 INFO:tasks.workunit.client.1.smithi116.stdout:2/584: stat d0/l4 0 2024-09-13T21:40:48.089 INFO:tasks.workunit.client.1.smithi116.stdout:8/663: write d2/d10/d19/d21/d22/d5d/d46/f5b [1953658,116238] 0 2024-09-13T21:40:48.089 INFO:tasks.workunit.client.1.smithi116.stdout:8/664: fdatasync d2/d10/d19/d42/f8e 0 2024-09-13T21:40:48.090 INFO:tasks.workunit.client.1.smithi116.stdout:1/512: mkdir d4/d14/d52/d2f/d5c/daf/db9 0 2024-09-13T21:40:48.091 INFO:tasks.workunit.client.1.smithi116.stdout:2/585: creat d0/d3a/d82/d62/d1f/d5d/d60/fbe x:0 0 0 2024-09-13T21:40:48.095 INFO:tasks.workunit.client.1.smithi116.stdout:7/776: read d5/d9/db/d21/d6e/d6f/d70/f84 [712060,65564] 0 2024-09-13T21:40:48.095 INFO:tasks.workunit.client.1.smithi116.stdout:5/853: rmdir d7/d1d/d46/dd4/d5e/d65/d6f/dd5 39 2024-09-13T21:40:48.095 INFO:tasks.workunit.client.1.smithi116.stdout:5/854: read d7/d1d/d46/dd4/f27 [3825044,54832] 0 2024-09-13T21:40:48.095 INFO:tasks.workunit.client.1.smithi116.stdout:5/855: chown d7/d1d/d46/dd4/c9b 0 1 2024-09-13T21:40:48.097 INFO:tasks.workunit.client.1.smithi116.stdout:3/799: dwrite d3/f82 [0,4194304] 0 2024-09-13T21:40:48.097 INFO:tasks.workunit.client.1.smithi116.stdout:8/665: getdents d2/d10/d19/d42 0 2024-09-13T21:40:48.099 INFO:tasks.workunit.client.1.smithi116.stdout:2/586: symlink d0/d3a/d82/d62/d75/d77/lbf 0 2024-09-13T21:40:48.099 INFO:tasks.workunit.client.1.smithi116.stdout:2/587: dread - d0/d3a/d82/d62/f98 zero size 2024-09-13T21:40:48.100 INFO:tasks.workunit.client.1.smithi116.stdout:7/777: write d5/d9/d27/ded/d22/d24/d3a/fb6 [3314008,82079] 0 2024-09-13T21:40:48.102 INFO:tasks.workunit.client.1.smithi116.stdout:2/588: dread d0/fae [0,4194304] 0 2024-09-13T21:40:48.102 INFO:tasks.workunit.client.1.smithi116.stdout:2/589: read - d0/d3a/d82/d62/fb5 zero size 2024-09-13T21:40:48.105 INFO:tasks.workunit.client.1.smithi116.stdout:3/800: unlink d3/cbd 0 2024-09-13T21:40:48.105 INFO:tasks.workunit.client.1.smithi116.stdout:8/666: rmdir d2/d27 39 2024-09-13T21:40:48.108 INFO:tasks.workunit.client.1.smithi116.stdout:4/625: dread d0/f31 [0,4194304] 0 2024-09-13T21:40:48.113 INFO:tasks.workunit.client.1.smithi116.stdout:1/513: dwrite d4/d14/f9c [0,4194304] 0 2024-09-13T21:40:48.114 INFO:tasks.workunit.client.1.smithi116.stdout:5/856: dwrite d7/f3f [0,4194304] 0 2024-09-13T21:40:48.115 INFO:tasks.workunit.client.1.smithi116.stdout:7/778: unlink d5/d9/d27/ded/d2e/f86 0 2024-09-13T21:40:48.115 INFO:tasks.workunit.client.1.smithi116.stdout:7/779: write d5/d9/d27/ded/d22/d24/d3a/fb6 [90872,70570] 0 2024-09-13T21:40:48.115 INFO:tasks.workunit.client.1.smithi116.stdout:7/780: dread - d5/d9/d27/ded/d22/d24/d6b/d72/d74/d93/fe4 zero size 2024-09-13T21:40:48.116 INFO:tasks.workunit.client.1.smithi116.stdout:2/590: rename d0/d7/l25 to d0/d5/d8/lc0 0 2024-09-13T21:40:48.116 INFO:tasks.workunit.client.1.smithi116.stdout:2/591: truncate d0/d7/d2b/d61/fba 249743 0 2024-09-13T21:40:48.116 INFO:tasks.workunit.client.1.smithi116.stdout:2/592: write d0/d7/d2b/f78 [737714,36789] 0 2024-09-13T21:40:48.117 INFO:tasks.workunit.client.1.smithi116.stdout:3/801: creat d3/db/d10/d1c/d34/d55/d96/dee/f11b x:0 0 0 2024-09-13T21:40:48.118 INFO:tasks.workunit.client.1.smithi116.stdout:8/667: creat d2/d10/d75/fc6 x:0 0 0 2024-09-13T21:40:48.120 INFO:tasks.workunit.client.1.smithi116.stdout:4/626: symlink d0/dd/lbb 0 2024-09-13T21:40:48.124 INFO:tasks.workunit.client.1.smithi116.stdout:5/857: dread d7/d1d/d64/fab [0,4194304] 0 2024-09-13T21:40:48.124 INFO:tasks.workunit.client.1.smithi116.stdout:5/858: read - d7/d1d/d64/d110/f111 zero size 2024-09-13T21:40:48.124 INFO:tasks.workunit.client.1.smithi116.stdout:5/859: read d7/d1d/d46/dd4/d5e/d65/d6f/f7e [215561,30233] 0 2024-09-13T21:40:48.124 INFO:tasks.workunit.client.1.smithi116.stdout:2/593: dread d0/f63 [0,4194304] 0 2024-09-13T21:40:48.124 INFO:tasks.workunit.client.1.smithi116.stdout:2/594: fdatasync d0/d7/f6e 0 2024-09-13T21:40:48.127 INFO:tasks.workunit.client.1.smithi116.stdout:1/514: dread d4/f10 [0,4194304] 0 2024-09-13T21:40:48.127 INFO:tasks.workunit.client.1.smithi116.stdout:7/781: rmdir d5/d9/d27/ded/d22/d24/d5f/de5 39 2024-09-13T21:40:48.129 INFO:tasks.workunit.client.1.smithi116.stdout:2/595: creat d0/d7/d2d/fc1 x:0 0 0 2024-09-13T21:40:48.131 INFO:tasks.workunit.client.1.smithi116.stdout:1/515: symlink d4/d23/d56/da3/lba 0 2024-09-13T21:40:48.131 INFO:tasks.workunit.client.1.smithi116.stdout:1/516: write d4/ff [9299538,87570] 0 2024-09-13T21:40:48.131 INFO:tasks.workunit.client.1.smithi116.stdout:1/517: write d4/d14/f77 [506236,85830] 0 2024-09-13T21:40:48.132 INFO:tasks.workunit.client.1.smithi116.stdout:4/627: write d0/dd/f3f [1824485,34717] 0 2024-09-13T21:40:48.132 INFO:tasks.workunit.client.1.smithi116.stdout:4/628: stat d0/l7 0 2024-09-13T21:40:48.132 INFO:tasks.workunit.client.1.smithi116.stdout:7/782: creat d5/d9/d27/ded/d22/d24/d5f/dfc/fff x:0 0 0 2024-09-13T21:40:48.132 INFO:tasks.workunit.client.1.smithi116.stdout:7/783: chown d5/d9/d27/d31/d38/d42/cc3 17704 1 2024-09-13T21:40:48.136 INFO:tasks.workunit.client.1.smithi116.stdout:7/784: creat d5/d9/db/f100 x:0 0 0 2024-09-13T21:40:48.136 INFO:tasks.workunit.client.1.smithi116.stdout:7/785: getdents d5/d9/db/da3 0 2024-09-13T21:40:48.143 INFO:tasks.workunit.client.1.smithi116.stdout:3/802: dwrite d3/f9 [0,4194304] 0 2024-09-13T21:40:48.143 INFO:tasks.workunit.client.1.smithi116.stdout:3/803: creat d3/db/d10/d1d/d5f/d6f/d71/f11c x:0 0 0 2024-09-13T21:40:48.145 INFO:tasks.workunit.client.1.smithi116.stdout:4/629: dread d0/dd/d13/f3c [0,4194304] 0 2024-09-13T21:40:48.146 INFO:tasks.workunit.client.1.smithi116.stdout:8/668: dwrite d2/d27/d66/f8c [0,4194304] 0 2024-09-13T21:40:48.148 INFO:tasks.workunit.client.1.smithi116.stdout:4/630: mkdir d0/dd/d6b/d92/d99/dbc 0 2024-09-13T21:40:48.150 INFO:tasks.workunit.client.1.smithi116.stdout:8/669: unlink d2/d10/d37/d64/c68 0 2024-09-13T21:40:48.153 INFO:tasks.workunit.client.1.smithi116.stdout:7/786: dread d5/d9/d27/d31/d38/d48/f76 [0,4194304] 0 2024-09-13T21:40:48.154 INFO:tasks.workunit.client.1.smithi116.stdout:7/787: fsync d5/d9/db/d21/d6e/d6f/d70/d80/db1/fc7 0 2024-09-13T21:40:48.155 INFO:tasks.workunit.client.1.smithi116.stdout:8/670: mkdir d2/d10/d75/dc7 0 2024-09-13T21:40:48.155 INFO:tasks.workunit.client.1.smithi116.stdout:8/671: fsync d2/d10/d19/d21/d22/d5d/d46/f4f 0 2024-09-13T21:40:48.157 INFO:tasks.workunit.client.1.smithi116.stdout:7/788: creat d5/d9/d27/d31/d38/d48/f101 x:0 0 0 2024-09-13T21:40:48.159 INFO:tasks.workunit.client.1.smithi116.stdout:1/518: dread d4/ff [0,4194304] 0 2024-09-13T21:40:48.159 INFO:tasks.workunit.client.1.smithi116.stdout:8/672: truncate d2/d10/d19/d21/d22/d5d/d46/fb4 869836 0 2024-09-13T21:40:48.159 INFO:tasks.workunit.client.1.smithi116.stdout:8/673: dread - d2/d10/d19/d42/d45/d87/fa0 zero size 2024-09-13T21:40:48.160 INFO:tasks.workunit.client.1.smithi116.stdout:7/789: write d5/d9/d27/fb4 [5118187,108337] 0 2024-09-13T21:40:48.161 INFO:tasks.workunit.client.1.smithi116.stdout:8/674: read d2/d10/d19/d21/d69/f9f [485485,97800] 0 2024-09-13T21:40:48.162 INFO:tasks.workunit.client.1.smithi116.stdout:3/804: dwrite d3/db/f5e [0,4194304] 0 2024-09-13T21:40:48.162 INFO:tasks.workunit.client.1.smithi116.stdout:3/805: stat d3/db/d10/d1d/d5f/d6f/fb9 0 2024-09-13T21:40:48.162 INFO:tasks.workunit.client.1.smithi116.stdout:3/806: write d3/db/d10/d29/f113 [422301,46905] 0 2024-09-13T21:40:48.162 INFO:tasks.workunit.client.1.smithi116.stdout:3/807: dread - d3/db/d10/d1c/d34/d55/d96/dee/f11b zero size 2024-09-13T21:40:48.162 INFO:tasks.workunit.client.1.smithi116.stdout:3/808: chown d3/db/d10/d1d/d2f 458474350 1 2024-09-13T21:40:48.164 INFO:tasks.workunit.client.1.smithi116.stdout:7/790: creat d5/d9/d27/ded/d2e/d52/f102 x:0 0 0 2024-09-13T21:40:48.165 INFO:tasks.workunit.client.1.smithi116.stdout:8/675: symlink d2/d10/d19/d3a/d4c/lc8 0 2024-09-13T21:40:48.169 INFO:tasks.workunit.client.1.smithi116.stdout:3/809: rename d3/db/d10/d1c/f10b to d3/db/d10/d1c/d34/d55/f11d 0 2024-09-13T21:40:48.171 INFO:tasks.workunit.client.1.smithi116.stdout:3/810: mknod d3/db/d10/d1c/d34/d55/d96/dee/c11e 0 2024-09-13T21:40:48.171 INFO:tasks.workunit.client.1.smithi116.stdout:3/811: write d3/db/d10/d1c/d34/d55/f11d [822738,44231] 0 2024-09-13T21:40:48.171 INFO:tasks.workunit.client.1.smithi116.stdout:3/812: dread d3/db/f68 [0,4194304] 0 2024-09-13T21:40:48.172 INFO:tasks.workunit.client.1.smithi116.stdout:3/813: fsync d3/db/d26/f9e 0 2024-09-13T21:40:48.173 INFO:tasks.workunit.client.1.smithi116.stdout:7/791: write d5/d9/db/f45 [754017,101033] 0 2024-09-13T21:40:48.173 INFO:tasks.workunit.client.1.smithi116.stdout:7/792: write d5/d9/d27/d31/d38/f6a [1034224,111889] 0 2024-09-13T21:40:48.174 INFO:tasks.workunit.client.1.smithi116.stdout:4/631: dwrite d0/dd/f1b [0,4194304] 0 2024-09-13T21:40:48.175 INFO:tasks.workunit.client.1.smithi116.stdout:3/814: creat d3/db/d10/d1c/d63/f11f x:0 0 0 2024-09-13T21:40:48.175 INFO:tasks.workunit.client.1.smithi116.stdout:3/815: creat d3/db/d20/f120 x:0 0 0 2024-09-13T21:40:48.177 INFO:tasks.workunit.client.1.smithi116.stdout:4/632: symlink d0/dd/d13/lbd 0 2024-09-13T21:40:48.179 INFO:tasks.workunit.client.1.smithi116.stdout:8/676: write d2/d10/d19/f1d [780282,85082] 0 2024-09-13T21:40:48.180 INFO:tasks.workunit.client.1.smithi116.stdout:4/633: mknod d0/dd/cbe 0 2024-09-13T21:40:48.180 INFO:tasks.workunit.client.1.smithi116.stdout:4/634: fdatasync d0/dd/d13/f1e 0 2024-09-13T21:40:48.180 INFO:tasks.workunit.client.1.smithi116.stdout:1/519: dwrite d4/d23/f7c [0,4194304] 0 2024-09-13T21:40:48.180 INFO:tasks.workunit.client.1.smithi116.stdout:1/520: write d4/d14/fa4 [719837,2210] 0 2024-09-13T21:40:48.180 INFO:tasks.workunit.client.1.smithi116.stdout:1/521: chown d4/d74/d8d/f76 29698991 1 2024-09-13T21:40:48.180 INFO:tasks.workunit.client.1.smithi116.stdout:1/522: creat d4/d14/db0/fbb x:0 0 0 2024-09-13T21:40:48.181 INFO:tasks.workunit.client.1.smithi116.stdout:8/677: mkdir d2/d10/d19/d97/dc9 0 2024-09-13T21:40:48.181 INFO:tasks.workunit.client.1.smithi116.stdout:8/678: fsync d2/f6d 0 2024-09-13T21:40:48.182 INFO:tasks.workunit.client.1.smithi116.stdout:4/635: mknod d0/d56/d57/db9/cbf 0 2024-09-13T21:40:48.185 INFO:tasks.workunit.client.1.smithi116.stdout:1/523: link d4/d74/d8d/f67 d4/d23/fbc 0 2024-09-13T21:40:48.186 INFO:tasks.workunit.client.1.smithi116.stdout:8/679: symlink d2/d10/d37/d64/lca 0 2024-09-13T21:40:48.189 INFO:tasks.workunit.client.1.smithi116.stdout:3/816: dread d3/db/d3d/d110/f42 [0,4194304] 0 2024-09-13T21:40:48.190 INFO:tasks.workunit.client.1.smithi116.stdout:1/524: symlink d4/d14/d41/dab/lbd 0 2024-09-13T21:40:48.193 INFO:tasks.workunit.client.1.smithi116.stdout:1/525: link d4/d14/d2a/l4c d4/d14/d52/d2f/d5c/daf/db9/lbe 0 2024-09-13T21:40:48.193 INFO:tasks.workunit.client.1.smithi116.stdout:1/526: readlink d4/d14/d52/d2f/d5d/l89 0 2024-09-13T21:40:48.194 INFO:tasks.workunit.client.1.smithi116.stdout:1/527: read d4/d14/db0/fb8 [308252,118695] 0 2024-09-13T21:40:48.194 INFO:tasks.workunit.client.1.smithi116.stdout:1/528: fsync d4/d14/f4f 0 2024-09-13T21:40:48.197 INFO:tasks.workunit.client.1.smithi116.stdout:1/529: truncate d4/f1c 2115360 0 2024-09-13T21:40:48.207 INFO:tasks.workunit.client.1.smithi116.stdout:1/530: read d4/f20 [4231442,29419] 0 2024-09-13T21:40:48.213 INFO:tasks.workunit.client.1.smithi116.stdout:3/817: dwrite d3/db/d10/d1c/d34/d55/f11d [0,4194304] 0 2024-09-13T21:40:48.214 INFO:tasks.workunit.client.1.smithi116.stdout:8/680: dwrite d2/d10/d4b/f51 [0,4194304] 0 2024-09-13T21:40:48.218 INFO:tasks.workunit.client.1.smithi116.stdout:4/636: dwrite d0/f10 [0,4194304] 0 2024-09-13T21:40:48.218 INFO:tasks.workunit.client.1.smithi116.stdout:4/637: write d0/d56/d84/fa4 [1105173,1455] 0 2024-09-13T21:40:48.220 INFO:tasks.workunit.client.1.smithi116.stdout:4/638: mknod d0/dd/d13/d4e/cc0 0 2024-09-13T21:40:48.223 INFO:tasks.workunit.client.1.smithi116.stdout:4/639: dread d0/d32/f66 [0,4194304] 0 2024-09-13T21:40:48.223 INFO:tasks.workunit.client.1.smithi116.stdout:4/640: fdatasync d0/d32/f49 0 2024-09-13T21:40:48.223 INFO:tasks.workunit.client.1.smithi116.stdout:4/641: dread - d0/d56/d57/f89 zero size 2024-09-13T21:40:48.223 INFO:tasks.workunit.client.1.smithi116.stdout:4/642: fsync d0/dd/f1b 0 2024-09-13T21:40:48.231 INFO:tasks.workunit.client.1.smithi116.stdout:1/531: dwrite d4/d74/d8d/f55 [0,4194304] 0 2024-09-13T21:40:48.231 INFO:tasks.workunit.client.1.smithi116.stdout:1/532: fsync d4/d14/d41/f49 0 2024-09-13T21:40:48.233 INFO:tasks.workunit.client.1.smithi116.stdout:1/533: link d4/d14/d52/d2f/d5c/f8c d4/d14/d2a/fbf 0 2024-09-13T21:40:48.233 INFO:tasks.workunit.client.1.smithi116.stdout:1/534: write d4/d14/f4f [5313326,112356] 0 2024-09-13T21:40:48.233 INFO:tasks.workunit.client.1.smithi116.stdout:1/535: fdatasync d4/f10 0 2024-09-13T21:40:48.234 INFO:tasks.workunit.client.1.smithi116.stdout:1/536: mkdir d4/d14/db0/dc0 0 2024-09-13T21:40:48.235 INFO:tasks.workunit.client.1.smithi116.stdout:1/537: creat d4/d23/d57/d92/fc1 x:0 0 0 2024-09-13T21:40:48.237 INFO:tasks.workunit.client.1.smithi116.stdout:1/538: rename d4/f1c to d4/d14/d52/d2f/d5c/daf/fc2 0 2024-09-13T21:40:48.239 INFO:tasks.workunit.client.1.smithi116.stdout:1/539: getdents d4/d74 0 2024-09-13T21:40:48.239 INFO:tasks.workunit.client.1.smithi116.stdout:1/540: write d4/d14/d52/d2f/f6d [982623,49243] 0 2024-09-13T21:40:48.239 INFO:tasks.workunit.client.1.smithi116.stdout:3/818: dwrite d3/db/d10/d1d/d5f/f94 [4194304,4194304] 0 2024-09-13T21:40:48.239 INFO:tasks.workunit.client.1.smithi116.stdout:3/819: read - d3/db/d10/d1c/d34/d55/d57/dc6/fe6 zero size 2024-09-13T21:40:48.240 INFO:tasks.workunit.client.1.smithi116.stdout:8/681: dwrite d2/d10/d4b/d6e/fb0 [0,4194304] 0 2024-09-13T21:40:48.240 INFO:tasks.workunit.client.1.smithi116.stdout:1/541: mkdir d4/d14/d52/d2f/d5c/daf/dc3 0 2024-09-13T21:40:48.241 INFO:tasks.workunit.client.1.smithi116.stdout:1/542: chown d4/ld 62 1 2024-09-13T21:40:48.241 INFO:tasks.workunit.client.1.smithi116.stdout:1/543: chown d4/d74/d8d/d5f/cb5 305668418 1 2024-09-13T21:40:48.241 INFO:tasks.workunit.client.1.smithi116.stdout:1/544: write d4/d14/d2a/f88 [118516,39793] 0 2024-09-13T21:40:48.241 INFO:tasks.workunit.client.1.smithi116.stdout:1/545: truncate d4/d14/d52/faa 175625 0 2024-09-13T21:40:48.241 INFO:tasks.workunit.client.1.smithi116.stdout:3/820: mkdir d3/db/d121 0 2024-09-13T21:40:48.247 INFO:tasks.workunit.client.1.smithi116.stdout:4/643: dwrite d0/fa1 [0,4194304] 0 2024-09-13T21:40:48.251 INFO:tasks.workunit.client.1.smithi116.stdout:4/644: symlink d0/d32/d5f/lc1 0 2024-09-13T21:40:48.251 INFO:tasks.workunit.client.1.smithi116.stdout:4/645: chown d0/dd/f3f 34 1 2024-09-13T21:40:48.254 INFO:tasks.workunit.client.1.smithi116.stdout:4/646: rename d0/c2d to d0/dd/cc2 0 2024-09-13T21:40:48.254 INFO:tasks.workunit.client.1.smithi116.stdout:4/647: chown d0/dd/f3f 1218139 1 2024-09-13T21:40:48.257 INFO:tasks.workunit.client.1.smithi116.stdout:4/648: symlink d0/dad/lc3 0 2024-09-13T21:40:48.257 INFO:tasks.workunit.client.1.smithi116.stdout:8/682: dwrite d2/d27/d66/f8c [0,4194304] 0 2024-09-13T21:40:48.259 INFO:tasks.workunit.client.1.smithi116.stdout:1/546: truncate d4/d14/d52/d2f/f6d 188817 0 2024-09-13T21:40:48.259 INFO:tasks.workunit.client.1.smithi116.stdout:1/547: chown d4/d14/db0/fb7 45 1 2024-09-13T21:40:48.264 INFO:tasks.workunit.client.1.smithi116.stdout:8/683: rename d2/d10/d4b/d6e/f9c to d2/d27/d66/d7c/fcb 0 2024-09-13T21:40:48.265 INFO:tasks.workunit.client.1.smithi116.stdout:1/548: mkdir d4/d23/d56/da3/dc4 0 2024-09-13T21:40:48.265 INFO:tasks.workunit.client.1.smithi116.stdout:1/549: stat d4/d14/d2a/f88 0 2024-09-13T21:40:48.265 INFO:tasks.workunit.client.1.smithi116.stdout:1/550: write d4/d74/d8d/f9a [1207019,116985] 0 2024-09-13T21:40:48.267 INFO:tasks.workunit.client.1.smithi116.stdout:1/551: symlink d4/d23/d57/d92/lc5 0 2024-09-13T21:40:48.267 INFO:tasks.workunit.client.1.smithi116.stdout:1/552: stat d4/d74/c8a 0 2024-09-13T21:40:48.267 INFO:tasks.workunit.client.1.smithi116.stdout:1/553: chown d4/d14/db0/fbb 211559 1 2024-09-13T21:40:48.268 INFO:tasks.workunit.client.1.smithi116.stdout:8/684: mkdir d2/d27/d66/dcc 0 2024-09-13T21:40:48.269 INFO:tasks.workunit.client.1.smithi116.stdout:1/554: symlink d4/d74/lc6 0 2024-09-13T21:40:48.271 INFO:tasks.workunit.client.1.smithi116.stdout:1/555: mkdir d4/d14/d52/d2f/d5d/dc7 0 2024-09-13T21:40:48.272 INFO:tasks.workunit.client.1.smithi116.stdout:1/556: getdents d4/d74/d8d/d5f 0 2024-09-13T21:40:48.272 INFO:tasks.workunit.client.1.smithi116.stdout:1/557: truncate d4/d14/db0/fb7 874898 0 2024-09-13T21:40:48.275 INFO:tasks.workunit.client.1.smithi116.stdout:6/697: sync 2024-09-13T21:40:48.275 INFO:tasks.workunit.client.1.smithi116.stdout:0/779: sync 2024-09-13T21:40:48.277 INFO:tasks.workunit.client.1.smithi116.stdout:6/698: mkdir d8/dca/df4 0 2024-09-13T21:40:48.282 INFO:tasks.workunit.client.1.smithi116.stdout:1/558: dread d4/f83 [0,4194304] 0 2024-09-13T21:40:48.290 INFO:tasks.workunit.client.1.smithi116.stdout:8/685: dwrite d2/f6d [0,4194304] 0 2024-09-13T21:40:48.290 INFO:tasks.workunit.client.1.smithi116.stdout:8/686: readlink d2/d10/d19/d21/l28 0 2024-09-13T21:40:48.290 INFO:tasks.workunit.client.1.smithi116.stdout:8/687: chown d2/d10/d3e/da4/fa7 4118824 1 2024-09-13T21:40:48.291 INFO:tasks.workunit.client.1.smithi116.stdout:6/699: write d8/d10/d33/f8a [2410673,122463] 0 2024-09-13T21:40:48.294 INFO:tasks.workunit.client.1.smithi116.stdout:8/688: link d2/l3c d2/d27/d66/dcc/lcd 0 2024-09-13T21:40:48.294 INFO:tasks.workunit.client.1.smithi116.stdout:8/689: write d2/d27/d62/fab [20159,26472] 0 2024-09-13T21:40:48.294 INFO:tasks.workunit.client.1.smithi116.stdout:8/690: write d2/d10/d19/d21/d69/f9f [365618,100826] 0 2024-09-13T21:40:48.296 INFO:tasks.workunit.client.1.smithi116.stdout:8/691: mknod d2/d5c/cce 0 2024-09-13T21:40:48.298 INFO:tasks.workunit.client.1.smithi116.stdout:0/780: dwrite d2/d5b/faa [0,4194304] 0 2024-09-13T21:40:48.298 INFO:tasks.workunit.client.1.smithi116.stdout:0/781: chown d2/dc/d47/d63/d9f/db6/fc2 870009 1 2024-09-13T21:40:48.298 INFO:tasks.workunit.client.1.smithi116.stdout:0/782: fsync d2/dc/d47/d63/d9f/dad/fdd 0 2024-09-13T21:40:48.300 INFO:tasks.workunit.client.1.smithi116.stdout:1/559: dwrite d4/d14/db0/fb8 [0,4194304] 0 2024-09-13T21:40:48.308 INFO:tasks.workunit.client.1.smithi116.stdout:6/700: dread d8/d17/d70/f7c [0,4194304] 0 2024-09-13T21:40:48.308 INFO:tasks.workunit.client.1.smithi116.stdout:6/701: truncate d8/d10/d33/f54 918142 0 2024-09-13T21:40:48.310 INFO:tasks.workunit.client.1.smithi116.stdout:6/702: read d8/d15/d2e/d2f/d57/f68 [246272,19295] 0 2024-09-13T21:40:48.313 INFO:tasks.workunit.client.1.smithi116.stdout:6/703: rename d8/d15/d2e/d2f/fef to d8/d10/dea/ff5 0 2024-09-13T21:40:48.336 INFO:tasks.workunit.client.1.smithi116.stdout:8/692: dwrite d2/d10/d4b/d6e/fb0 [0,4194304] 0 2024-09-13T21:40:48.336 INFO:tasks.workunit.client.1.smithi116.stdout:8/693: write d2/d10/d19/f84 [3469635,70392] 0 2024-09-13T21:40:48.336 INFO:tasks.workunit.client.1.smithi116.stdout:1/560: dwrite d4/d74/d8d/f67 [0,4194304] 0 2024-09-13T21:40:48.336 INFO:tasks.workunit.client.1.smithi116.stdout:6/704: dwrite d8/d10/d33/f50 [0,4194304] 0 2024-09-13T21:40:48.336 INFO:tasks.workunit.client.1.smithi116.stdout:0/783: dwrite d2/dc/d12/d28/fb9 [0,4194304] 0 2024-09-13T21:40:48.338 INFO:tasks.workunit.client.1.smithi116.stdout:1/561: mknod d4/d14/d2a/cc8 0 2024-09-13T21:40:48.339 INFO:tasks.workunit.client.1.smithi116.stdout:6/705: symlink d8/d15/d2e/d2f/d38/d9c/dcd/de5/lf6 0 2024-09-13T21:40:48.340 INFO:tasks.workunit.client.1.smithi116.stdout:1/562: creat d4/d74/fc9 x:0 0 0 2024-09-13T21:40:48.341 INFO:tasks.workunit.client.1.smithi116.stdout:1/563: creat d4/d14/d52/d2f/d91/dac/fca x:0 0 0 2024-09-13T21:40:48.342 INFO:tasks.workunit.client.1.smithi116.stdout:1/564: write d4/d14/d52/d2f/f4b [459448,34334] 0 2024-09-13T21:40:48.342 INFO:tasks.workunit.client.1.smithi116.stdout:1/565: chown d4/d14/d52/d2f/c3f 3391458 1 2024-09-13T21:40:48.342 INFO:tasks.workunit.client.1.smithi116.stdout:1/566: creat d4/d74/fcb x:0 0 0 2024-09-13T21:40:48.345 INFO:tasks.workunit.client.1.smithi116.stdout:1/567: mknod d4/d14/ccc 0 2024-09-13T21:40:48.345 INFO:tasks.workunit.client.1.smithi116.stdout:1/568: write d4/f10 [4967469,115854] 0 2024-09-13T21:40:48.349 INFO:tasks.workunit.client.1.smithi116.stdout:0/784: dread d2/d5/f16 [0,4194304] 0 2024-09-13T21:40:48.369 INFO:tasks.workunit.client.1.smithi116.stdout:8/694: dwrite d2/d10/d4b/f51 [0,4194304] 0 2024-09-13T21:40:48.370 INFO:tasks.workunit.client.1.smithi116.stdout:8/695: write d2/d10/d19/d21/d22/d5d/d46/fb4 [1315290,96817] 0 2024-09-13T21:40:48.370 INFO:tasks.workunit.client.1.smithi116.stdout:0/785: dwrite d2/d5/d86/d8a/fcd [0,4194304] 0 2024-09-13T21:40:48.392 INFO:tasks.workunit.client.1.smithi116.stdout:0/786: dwrite d2/dc/d12/d28/f9c [0,4194304] 0 2024-09-13T21:40:48.392 INFO:tasks.workunit.client.1.smithi116.stdout:0/787: chown d2/dc/d12/f36 47032 1 2024-09-13T21:40:48.392 INFO:tasks.workunit.client.1.smithi116.stdout:0/788: symlink d2/dc/d12/dfb/l102 0 2024-09-13T21:40:48.395 INFO:tasks.workunit.client.1.smithi116.stdout:0/789: rename d2/d5/de9 to d2/dc/dcc/dea/d103 0 2024-09-13T21:40:48.395 INFO:tasks.workunit.client.1.smithi116.stdout:0/790: write d2/d5b/f93 [3043724,83843] 0 2024-09-13T21:40:48.395 INFO:tasks.workunit.client.1.smithi116.stdout:0/791: write d2/dc/d12/d51/d62/ff3 [653947,77057] 0 2024-09-13T21:40:48.395 INFO:tasks.workunit.client.1.smithi116.stdout:0/792: read - d2/dc/d12/d28/d57/d65/fc6 zero size 2024-09-13T21:40:48.396 INFO:tasks.workunit.client.1.smithi116.stdout:0/793: creat d2/dc/d12/d51/d62/dfc/f104 x:0 0 0 2024-09-13T21:40:48.405 INFO:tasks.workunit.client.1.smithi116.stdout:8/696: dwrite d2/d27/d62/fab [0,4194304] 0 2024-09-13T21:40:48.405 INFO:tasks.workunit.client.1.smithi116.stdout:6/706: dwrite d8/d10/d24/f37 [0,4194304] 0 2024-09-13T21:40:48.405 INFO:tasks.workunit.client.1.smithi116.stdout:6/707: readlink d8/d17/ld5 0 2024-09-13T21:40:48.410 INFO:tasks.workunit.client.1.smithi116.stdout:0/794: dread d2/dc/d12/d51/f98 [0,4194304] 0 2024-09-13T21:40:48.412 INFO:tasks.workunit.client.1.smithi116.stdout:0/795: dread d2/dc/d47/d63/f9d [0,4194304] 0 2024-09-13T21:40:48.414 INFO:tasks.workunit.client.1.smithi116.stdout:8/697: dread d2/d10/f31 [0,4194304] 0 2024-09-13T21:40:48.414 INFO:tasks.workunit.client.1.smithi116.stdout:0/796: creat d2/d5b/db4/d101/f105 x:0 0 0 2024-09-13T21:40:48.414 INFO:tasks.workunit.client.1.smithi116.stdout:6/708: getdents d8/d1e 0 2024-09-13T21:40:48.414 INFO:tasks.workunit.client.1.smithi116.stdout:6/709: read - d8/d1e/ff3 zero size 2024-09-13T21:40:48.416 INFO:tasks.workunit.client.1.smithi116.stdout:0/797: rename d2/dc/f3d to d2/d5b/db4/d101/f106 0 2024-09-13T21:40:48.416 INFO:tasks.workunit.client.1.smithi116.stdout:0/798: write d2/dc/d12/d51/d62/dfc/f104 [549036,96951] 0 2024-09-13T21:40:48.419 INFO:tasks.workunit.client.1.smithi116.stdout:6/710: rename d8/d15/d2e/d2f/d38/d9c/dcd/de5/fee to d8/d15/d2e/d2f/d38/d9c/ff7 0 2024-09-13T21:40:48.419 INFO:tasks.workunit.client.1.smithi116.stdout:6/711: mkdir d8/d17/da6/df8 0 2024-09-13T21:40:48.421 INFO:tasks.workunit.client.1.smithi116.stdout:6/712: rmdir d8/d15/d2e 39 2024-09-13T21:40:48.421 INFO:tasks.workunit.client.1.smithi116.stdout:6/713: readlink d8/d15/l20 0 2024-09-13T21:40:48.421 INFO:tasks.workunit.client.1.smithi116.stdout:6/714: stat d8/d1e/c76 0 2024-09-13T21:40:48.421 INFO:tasks.workunit.client.1.smithi116.stdout:6/715: fdatasync d8/d10/d24/f37 0 2024-09-13T21:40:48.423 INFO:tasks.workunit.client.1.smithi116.stdout:6/716: dread d8/d15/d2e/d2f/fc9 [0,4194304] 0 2024-09-13T21:40:48.425 INFO:tasks.workunit.client.1.smithi116.stdout:6/717: dread d8/d15/d2e/fcf [0,4194304] 0 2024-09-13T21:40:48.425 INFO:tasks.workunit.client.1.smithi116.stdout:6/718: stat d8/d17/da6/ld1 0 2024-09-13T21:40:48.427 INFO:tasks.workunit.client.1.smithi116.stdout:6/719: creat d8/d17/d70/da0/ff9 x:0 0 0 2024-09-13T21:40:48.427 INFO:tasks.workunit.client.1.smithi116.stdout:6/720: write d8/d15/d2e/d2f/fc9 [1526001,10062] 0 2024-09-13T21:40:48.427 INFO:tasks.workunit.client.1.smithi116.stdout:6/721: write d8/d10/d24/f9d [87591,69590] 0 2024-09-13T21:40:48.437 INFO:tasks.workunit.client.1.smithi116.stdout:6/722: dread d8/d15/d2e/f6a [0,4194304] 0 2024-09-13T21:40:48.437 INFO:tasks.workunit.client.1.smithi116.stdout:6/723: fsync d8/d17/d70/da0/daf/fc1 0 2024-09-13T21:40:48.437 INFO:tasks.workunit.client.1.smithi116.stdout:6/724: mknod d8/d15/cfa 0 2024-09-13T21:40:48.438 INFO:tasks.workunit.client.1.smithi116.stdout:8/698: dwrite d2/d10/d19/d21/f47 [0,4194304] 0 2024-09-13T21:40:48.439 INFO:tasks.workunit.client.1.smithi116.stdout:8/699: write d2/d10/d19/d21/d22/d5d/d46/f5b [1420024,107168] 0 2024-09-13T21:40:48.439 INFO:tasks.workunit.client.1.smithi116.stdout:0/799: dwrite d2/f3f [4194304,4194304] 0 2024-09-13T21:40:48.439 INFO:tasks.workunit.client.1.smithi116.stdout:0/800: dread - d2/dc/d12/d28/d57/d65/fe4 zero size 2024-09-13T21:40:48.440 INFO:tasks.workunit.client.1.smithi116.stdout:8/700: creat d2/d10/d19/d21/d22/fcf x:0 0 0 2024-09-13T21:40:48.443 INFO:tasks.workunit.client.1.smithi116.stdout:8/701: truncate d2/d10/d19/d21/d22/d5d/d46/f7d 2868059 0 2024-09-13T21:40:48.443 INFO:tasks.workunit.client.1.smithi116.stdout:0/801: dread d2/dc/d12/d51/f98 [0,4194304] 0 2024-09-13T21:40:48.443 INFO:tasks.workunit.client.1.smithi116.stdout:0/802: chown d2/dc/l5f 46867 1 2024-09-13T21:40:48.445 INFO:tasks.workunit.client.1.smithi116.stdout:0/803: link d2/dc/d47/d63/f7f d2/d5/f107 0 2024-09-13T21:40:48.447 INFO:tasks.workunit.client.1.smithi116.stdout:0/804: link d2/d5/f34 d2/dc/d12/d28/f108 0 2024-09-13T21:40:48.447 INFO:tasks.workunit.client.1.smithi116.stdout:0/805: dread - d2/dc/d12/d28/fc3 zero size 2024-09-13T21:40:48.454 INFO:tasks.workunit.client.1.smithi116.stdout:8/702: dread d2/d27/d62/fab [0,4194304] 0 2024-09-13T21:40:48.455 INFO:tasks.workunit.client.1.smithi116.stdout:9/487: sync 2024-09-13T21:40:48.456 INFO:tasks.workunit.client.1.smithi116.stdout:8/703: truncate d2/d10/d19/d21/d22/f78 2645461 0 2024-09-13T21:40:48.456 INFO:tasks.workunit.client.1.smithi116.stdout:8/704: creat d2/d10/d19/d21/d69/d9e/fd0 x:0 0 0 2024-09-13T21:40:48.456 INFO:tasks.workunit.client.1.smithi116.stdout:9/488: dread d2/d10/d4c/f51 [0,4194304] 0 2024-09-13T21:40:48.456 INFO:tasks.workunit.client.1.smithi116.stdout:9/489: dread - d2/d5d/f89 zero size 2024-09-13T21:40:48.457 INFO:tasks.workunit.client.1.smithi116.stdout:9/490: read - d2/d10/f52 zero size 2024-09-13T21:40:48.462 INFO:tasks.workunit.client.1.smithi116.stdout:8/705: symlink d2/d10/d3e/da4/ld1 0 2024-09-13T21:40:48.462 INFO:tasks.workunit.client.1.smithi116.stdout:0/806: write d2/dc/f33 [3435254,9909] 0 2024-09-13T21:40:48.462 INFO:tasks.workunit.client.1.smithi116.stdout:0/807: truncate d2/d5/d86/d8a/fbb 79577 0 2024-09-13T21:40:48.462 INFO:tasks.workunit.client.1.smithi116.stdout:9/491: creat d2/d5d/d69/f92 x:0 0 0 2024-09-13T21:40:48.462 INFO:tasks.workunit.client.1.smithi116.stdout:9/492: readlink d2/d10/d14/l82 0 2024-09-13T21:40:48.462 INFO:tasks.workunit.client.1.smithi116.stdout:6/725: dwrite d8/fa [0,4194304] 0 2024-09-13T21:40:48.463 INFO:tasks.workunit.client.1.smithi116.stdout:8/706: mknod d2/d10/cd2 0 2024-09-13T21:40:48.465 INFO:tasks.workunit.client.1.smithi116.stdout:0/808: mknod d2/dc/d12/d28/c109 0 2024-09-13T21:40:48.465 INFO:tasks.workunit.client.1.smithi116.stdout:0/809: readlink d2/dc/dcf/le8 0 2024-09-13T21:40:48.466 INFO:tasks.workunit.client.1.smithi116.stdout:9/493: mkdir d2/d8/d93 0 2024-09-13T21:40:48.468 INFO:tasks.workunit.client.1.smithi116.stdout:6/726: unlink d8/d10/d24/dab/fc0 0 2024-09-13T21:40:48.468 INFO:tasks.workunit.client.1.smithi116.stdout:6/727: write d8/d15/fa2 [1364749,100465] 0 2024-09-13T21:40:48.469 INFO:tasks.workunit.client.1.smithi116.stdout:8/707: unlink d2/d10/d19/d21/d69/d9e/fb7 0 2024-09-13T21:40:48.472 INFO:tasks.workunit.client.1.smithi116.stdout:9/494: creat d2/d8/d93/f94 x:0 0 0 2024-09-13T21:40:48.472 INFO:tasks.workunit.client.1.smithi116.stdout:9/495: write d2/d10/d14/f44 [4266335,87401] 0 2024-09-13T21:40:48.475 INFO:tasks.workunit.client.1.smithi116.stdout:9/496: link d2/d10/c30 d2/d5d/d69/c95 0 2024-09-13T21:40:48.475 INFO:tasks.workunit.client.1.smithi116.stdout:9/497: readlink d2/d5d/d69/d47/l49 0 2024-09-13T21:40:48.476 INFO:tasks.workunit.client.1.smithi116.stdout:6/728: getdents d8/d17/d70/da0 0 2024-09-13T21:40:48.478 INFO:tasks.workunit.client.1.smithi116.stdout:6/729: creat d8/d10/d78/ffb x:0 0 0 2024-09-13T21:40:48.479 INFO:tasks.workunit.client.1.smithi116.stdout:6/730: mkdir d8/dca/df4/dfc 0 2024-09-13T21:40:48.479 INFO:tasks.workunit.client.1.smithi116.stdout:6/731: chown d8/c95 30949 1 2024-09-13T21:40:48.481 INFO:tasks.workunit.client.1.smithi116.stdout:0/810: dwrite d2/d5b/ff6 [0,4194304] 0 2024-09-13T21:40:48.481 INFO:tasks.workunit.client.1.smithi116.stdout:6/732: rename d8/d17/ld5 to d8/d17/da6/lfd 0 2024-09-13T21:40:48.483 INFO:tasks.workunit.client.1.smithi116.stdout:0/811: symlink d2/dc/d12/dfb/l10a 0 2024-09-13T21:40:48.484 INFO:tasks.workunit.client.1.smithi116.stdout:6/733: creat d8/d17/d70/ffe x:0 0 0 2024-09-13T21:40:48.484 INFO:tasks.workunit.client.1.smithi116.stdout:6/734: stat d8/d15/l66 0 2024-09-13T21:40:48.484 INFO:tasks.workunit.client.1.smithi116.stdout:6/735: chown d8/d17/d70/fb2 470304248 1 2024-09-13T21:40:48.484 INFO:tasks.workunit.client.1.smithi116.stdout:6/736: dread - d8/d17/fb6 zero size 2024-09-13T21:40:48.485 INFO:tasks.workunit.client.1.smithi116.stdout:0/812: mknod d2/dc/dcc/dea/c10b 0 2024-09-13T21:40:48.485 INFO:tasks.workunit.client.1.smithi116.stdout:0/813: chown d2/dc/dcf/dd7 3096009 1 2024-09-13T21:40:48.485 INFO:tasks.workunit.client.1.smithi116.stdout:9/498: dread d2/f2b [0,4194304] 0 2024-09-13T21:40:48.485 INFO:tasks.workunit.client.1.smithi116.stdout:9/499: stat d2/d10/d4c/c7e 0 2024-09-13T21:40:48.486 INFO:tasks.workunit.client.1.smithi116.stdout:9/500: rename d2/d10/f20 to d2/d72/f96 0 2024-09-13T21:40:48.488 INFO:tasks.workunit.client.1.smithi116.stdout:6/737: dread d8/d15/f64 [0,4194304] 0 2024-09-13T21:40:48.489 INFO:tasks.workunit.client.1.smithi116.stdout:8/708: dwrite d2/d10/d19/d21/d69/d9e/fd0 [0,4194304] 0 2024-09-13T21:40:48.490 INFO:tasks.workunit.client.1.smithi116.stdout:8/709: read d2/d27/d66/d7c/fcb [619178,18148] 0 2024-09-13T21:40:48.490 INFO:tasks.workunit.client.1.smithi116.stdout:8/710: read d2/d10/d19/d21/d22/d5d/d46/f5b [3350916,84736] 0 2024-09-13T21:40:48.490 INFO:tasks.workunit.client.1.smithi116.stdout:6/738: rename d8/d10/d24/f37 to d8/d10/d33/fff 0 2024-09-13T21:40:48.492 INFO:tasks.workunit.client.1.smithi116.stdout:9/501: dread d2/d8/f1a [0,4194304] 0 2024-09-13T21:40:48.492 INFO:tasks.workunit.client.1.smithi116.stdout:9/502: fdatasync d2/f2b 0 2024-09-13T21:40:48.493 INFO:tasks.workunit.client.1.smithi116.stdout:6/739: creat d8/d15/d2e/f100 x:0 0 0 2024-09-13T21:40:48.493 INFO:tasks.workunit.client.1.smithi116.stdout:6/740: creat d8/d10/d78/f101 x:0 0 0 2024-09-13T21:40:48.496 INFO:tasks.workunit.client.1.smithi116.stdout:0/814: write d2/dc/d12/d51/f91 [3197090,123249] 0 2024-09-13T21:40:48.496 INFO:tasks.workunit.client.1.smithi116.stdout:6/741: link d8/d17/d70/da0/ff9 d8/d15/d2e/f102 0 2024-09-13T21:40:48.503 INFO:tasks.workunit.client.1.smithi116.stdout:9/503: rmdir d2 39 2024-09-13T21:40:48.505 INFO:tasks.workunit.client.1.smithi116.stdout:6/742: unlink d8/d10/f18 0 2024-09-13T21:40:48.506 INFO:tasks.workunit.client.1.smithi116.stdout:0/815: symlink d2/d5/l10c 0 2024-09-13T21:40:48.506 INFO:tasks.workunit.client.1.smithi116.stdout:0/816: creat d2/dc/d12/d51/d62/dfc/f10d x:0 0 0 2024-09-13T21:40:48.506 INFO:tasks.workunit.client.1.smithi116.stdout:9/504: getdents d2 0 2024-09-13T21:40:48.508 INFO:tasks.workunit.client.1.smithi116.stdout:6/743: rename d8/d17/f23 to d8/dca/f103 0 2024-09-13T21:40:48.509 INFO:tasks.workunit.client.1.smithi116.stdout:0/817: mkdir d2/dc/dcc/d10e 0 2024-09-13T21:40:48.510 INFO:tasks.workunit.client.1.smithi116.stdout:0/818: fsync d2/d5/f7e 0 2024-09-13T21:40:48.510 INFO:tasks.workunit.client.1.smithi116.stdout:0/819: write d2/dc/d47/d63/d9f/dad/ff5 [616607,91386] 0 2024-09-13T21:40:48.511 INFO:tasks.workunit.client.1.smithi116.stdout:0/820: mkdir d2/dc/d47/d63/d10f 0 2024-09-13T21:40:48.512 INFO:tasks.workunit.client.1.smithi116.stdout:6/744: rename d8/d17/da6/lfd to d8/d10/l104 0 2024-09-13T21:40:48.512 INFO:tasks.workunit.client.1.smithi116.stdout:6/745: fdatasync d8/d1e/fdf 0 2024-09-13T21:40:48.514 INFO:tasks.workunit.client.1.smithi116.stdout:0/821: rename d2/dc/dcc/dea to d2/dc/d12/d28/d57/d110 0 2024-09-13T21:40:48.516 INFO:tasks.workunit.client.1.smithi116.stdout:6/746: mkdir d8/d17/d70/d105 0 2024-09-13T21:40:48.516 INFO:tasks.workunit.client.1.smithi116.stdout:6/747: truncate d8/fa 466679 0 2024-09-13T21:40:48.519 INFO:tasks.workunit.client.1.smithi116.stdout:0/822: dread d2/dc/f22 [0,4194304] 0 2024-09-13T21:40:48.519 INFO:tasks.workunit.client.1.smithi116.stdout:0/823: fdatasync d2/dc/d47/d63/d9f/db6/fc8 0 2024-09-13T21:40:48.529 INFO:tasks.workunit.client.1.smithi116.stdout:0/824: dread d2/f73 [4194304,4194304] 0 2024-09-13T21:40:48.529 INFO:tasks.workunit.client.1.smithi116.stdout:0/825: dread - d2/dc/d12/d51/fd4 zero size 2024-09-13T21:40:48.529 INFO:tasks.workunit.client.1.smithi116.stdout:0/826: stat d2/dc/d12/d28/d57/d110/d103/fef 0 2024-09-13T21:40:48.529 INFO:tasks.workunit.client.1.smithi116.stdout:0/827: chown d2/dc/d12/d28/f32 7168 1 2024-09-13T21:40:48.532 INFO:tasks.workunit.client.1.smithi116.stdout:0/828: rmdir d2 39 2024-09-13T21:40:48.532 INFO:tasks.workunit.client.1.smithi116.stdout:0/829: write d2/d5b/f5c [4266848,52352] 0 2024-09-13T21:40:48.534 INFO:tasks.workunit.client.1.smithi116.stdout:6/748: dwrite d8/d15/f22 [8388608,4194304] 0 2024-09-13T21:40:48.534 INFO:tasks.workunit.client.1.smithi116.stdout:6/749: fsync d8/d17/d70/f7c 0 2024-09-13T21:40:48.535 INFO:tasks.workunit.client.1.smithi116.stdout:6/750: write d8/d17/d70/f7c [8088434,130865] 0 2024-09-13T21:40:48.535 INFO:tasks.workunit.client.1.smithi116.stdout:6/751: chown d8/d15/d2e/d2f/f35 64383767 1 2024-09-13T21:40:48.535 INFO:tasks.workunit.client.1.smithi116.stdout:6/752: truncate d8/d17/d70/da0/daf/fc1 4119217 0 2024-09-13T21:40:48.535 INFO:tasks.workunit.client.1.smithi116.stdout:6/753: chown d8/l60 780033 1 2024-09-13T21:40:48.535 INFO:tasks.workunit.client.1.smithi116.stdout:6/754: stat d8/d1e/l7a 0 2024-09-13T21:40:48.536 INFO:tasks.workunit.client.1.smithi116.stdout:6/755: link d8/d10/ce8 d8/d15/d2e/c106 0 2024-09-13T21:40:48.536 INFO:tasks.workunit.client.1.smithi116.stdout:6/756: stat d8/d15/d2e/d2f/ld3 0 2024-09-13T21:40:48.541 INFO:tasks.workunit.client.1.smithi116.stdout:9/505: dwrite d2/d5d/d69/f92 [0,4194304] 0 2024-09-13T21:40:48.541 INFO:tasks.workunit.client.1.smithi116.stdout:9/506: chown d2/d10/d4c/f4e 2 1 2024-09-13T21:40:48.542 INFO:tasks.workunit.client.1.smithi116.stdout:0/830: write d2/dc/d12/d51/f9a [4734198,4695] 0 2024-09-13T21:40:48.542 INFO:tasks.workunit.client.1.smithi116.stdout:9/507: readlink d2/d10/l1f 0 2024-09-13T21:40:48.542 INFO:tasks.workunit.client.1.smithi116.stdout:0/831: dread - d2/dc/d47/d63/d9f/dad/fdd zero size 2024-09-13T21:40:48.542 INFO:tasks.workunit.client.1.smithi116.stdout:6/757: write d8/d10/d33/fba [327503,72393] 0 2024-09-13T21:40:48.542 INFO:tasks.workunit.client.1.smithi116.stdout:6/758: read - d8/d17/fb6 zero size 2024-09-13T21:40:48.542 INFO:tasks.workunit.client.1.smithi116.stdout:6/759: fdatasync d8/d15/d2e/d2f/d38/fde 0 2024-09-13T21:40:48.542 INFO:tasks.workunit.client.1.smithi116.stdout:9/508: dread d2/d8/f33 [0,4194304] 0 2024-09-13T21:40:48.543 INFO:tasks.workunit.client.1.smithi116.stdout:9/509: dread d2/d10/d14/d38/f4f [0,4194304] 0 2024-09-13T21:40:48.544 INFO:tasks.workunit.client.1.smithi116.stdout:0/832: unlink d2/dc/d12/lf8 0 2024-09-13T21:40:48.545 INFO:tasks.workunit.client.1.smithi116.stdout:9/510: dread d2/d10/d4c/f5a [0,4194304] 0 2024-09-13T21:40:48.545 INFO:tasks.workunit.client.1.smithi116.stdout:9/511: write d2/f2d [1155414,130563] 0 2024-09-13T21:40:48.545 INFO:tasks.workunit.client.1.smithi116.stdout:9/512: chown d2/d10/d14/d38/d3a/l78 168091477 1 2024-09-13T21:40:48.545 INFO:tasks.workunit.client.1.smithi116.stdout:0/833: read d2/dc/d12/d51/d62/ff3 [131041,107057] 0 2024-09-13T21:40:48.546 INFO:tasks.workunit.client.1.smithi116.stdout:6/760: getdents d8/d17/d70 0 2024-09-13T21:40:48.546 INFO:tasks.workunit.client.1.smithi116.stdout:6/761: fdatasync d8/d15/d2e/d2f/fc8 0 2024-09-13T21:40:48.547 INFO:tasks.workunit.client.1.smithi116.stdout:9/513: creat d2/d8/d93/f97 x:0 0 0 2024-09-13T21:40:48.547 INFO:tasks.workunit.client.1.smithi116.stdout:9/514: readlink d2/d10/d14/l2e 0 2024-09-13T21:40:48.548 INFO:tasks.workunit.client.1.smithi116.stdout:0/834: creat d2/dc/d12/d28/d57/d65/f111 x:0 0 0 2024-09-13T21:40:48.550 INFO:tasks.workunit.client.1.smithi116.stdout:0/835: symlink d2/dc/d47/d63/d10f/l112 0 2024-09-13T21:40:48.550 INFO:tasks.workunit.client.1.smithi116.stdout:0/836: creat d2/dc/d12/d28/d57/d65/f113 x:0 0 0 2024-09-13T21:40:48.550 INFO:tasks.workunit.client.1.smithi116.stdout:0/837: write d2/dc/dcc/fd2 [1141099,77475] 0 2024-09-13T21:40:48.550 INFO:tasks.workunit.client.1.smithi116.stdout:0/838: chown d2/d5b/db4 8037 1 2024-09-13T21:40:48.550 INFO:tasks.workunit.client.1.smithi116.stdout:0/839: write d2/d5/d86/fc5 [408675,110282] 0 2024-09-13T21:40:48.551 INFO:tasks.workunit.client.1.smithi116.stdout:0/840: write d2/d5/f34 [6170632,78436] 0 2024-09-13T21:40:48.557 INFO:tasks.workunit.client.1.smithi116.stdout:6/762: write d8/fe [54065,87527] 0 2024-09-13T21:40:48.579 INFO:tasks.workunit.client.1.smithi116.stdout:0/841: dwrite d2/dc/dcc/fd2 [0,4194304] 0 2024-09-13T21:40:48.580 INFO:tasks.workunit.client.1.smithi116.stdout:6/763: dwrite d8/d10/d33/f46 [0,4194304] 0 2024-09-13T21:40:48.580 INFO:tasks.workunit.client.1.smithi116.stdout:9/515: dwrite d2/d43/f8e [0,4194304] 0 2024-09-13T21:40:48.582 INFO:tasks.workunit.client.1.smithi116.stdout:0/842: symlink d2/d5/d86/d8a/dd3/l114 0 2024-09-13T21:40:48.584 INFO:tasks.workunit.client.1.smithi116.stdout:0/843: dread d2/d5/f107 [0,4194304] 0 2024-09-13T21:40:48.587 INFO:tasks.workunit.client.1.smithi116.stdout:0/844: dread d2/dc/d12/d28/fe1 [0,4194304] 0 2024-09-13T21:40:48.587 INFO:tasks.workunit.client.1.smithi116.stdout:0/845: chown d2/dc/d47 1623884 1 2024-09-13T21:40:48.610 INFO:tasks.workunit.client.1.smithi116.stdout:0/846: dwrite d2/dc/d47/f4b [0,4194304] 0 2024-09-13T21:40:48.611 INFO:tasks.workunit.client.1.smithi116.stdout:6/764: dwrite d8/d15/d2e/d2f/f35 [0,4194304] 0 2024-09-13T21:40:48.616 INFO:tasks.workunit.client.1.smithi116.stdout:0/847: dread d2/d5/f39 [0,4194304] 0 2024-09-13T21:40:48.618 INFO:tasks.workunit.client.1.smithi116.stdout:0/848: creat d2/dc/d47/d63/d9f/f115 x:0 0 0 2024-09-13T21:40:48.618 INFO:tasks.workunit.client.1.smithi116.stdout:0/849: readlink d2/dc/d12/d28/d57/l8d 0 2024-09-13T21:40:48.622 INFO:tasks.workunit.client.1.smithi116.stdout:0/850: creat d2/d5b/db4/d101/f116 x:0 0 0 2024-09-13T21:40:48.630 INFO:tasks.workunit.client.1.smithi116.stdout:6/765: dwrite d8/f2c [0,4194304] 0 2024-09-13T21:40:48.630 INFO:tasks.workunit.client.1.smithi116.stdout:6/766: write d8/d15/f92 [1392978,72168] 0 2024-09-13T21:40:48.633 INFO:tasks.workunit.client.1.smithi116.stdout:0/851: write d2/dc/d12/d51/f98 [2793894,24183] 0 2024-09-13T21:40:48.633 INFO:tasks.workunit.client.1.smithi116.stdout:6/767: symlink d8/db5/l107 0 2024-09-13T21:40:48.633 INFO:tasks.workunit.client.1.smithi116.stdout:6/768: chown d8/d17/l25 7717263 1 2024-09-13T21:40:48.635 INFO:tasks.workunit.client.1.smithi116.stdout:6/769: rmdir d8/d10/d78 39 2024-09-13T21:40:48.640 INFO:tasks.workunit.client.1.smithi116.stdout:6/770: mknod d8/c108 0 2024-09-13T21:40:48.640 INFO:tasks.workunit.client.1.smithi116.stdout:6/771: read d8/d10/d24/f9d [51030,44368] 0 2024-09-13T21:40:48.642 INFO:tasks.workunit.client.1.smithi116.stdout:0/852: dread d2/fd1 [0,4194304] 0 2024-09-13T21:40:48.642 INFO:tasks.workunit.client.1.smithi116.stdout:0/853: write d2/d5b/db4/d101/f106 [8843875,101971] 0 2024-09-13T21:40:48.642 INFO:tasks.workunit.client.1.smithi116.stdout:0/854: getdents d2/d5/dbe/dc1 0 2024-09-13T21:40:48.642 INFO:tasks.workunit.client.1.smithi116.stdout:0/855: write d2/dc/d12/d51/d62/fa2 [510628,11814] 0 2024-09-13T21:40:48.644 INFO:tasks.workunit.client.1.smithi116.stdout:6/772: dread d8/f3c [0,4194304] 0 2024-09-13T21:40:48.654 INFO:tasks.workunit.client.1.smithi116.stdout:0/856: dread d2/d5/f58 [0,4194304] 0 2024-09-13T21:40:48.656 INFO:tasks.workunit.client.1.smithi116.stdout:0/857: unlink d2/dc/f2c 0 2024-09-13T21:40:48.657 INFO:tasks.workunit.client.1.smithi116.stdout:0/858: symlink d2/dc/d12/dfb/l117 0 2024-09-13T21:40:48.668 INFO:tasks.workunit.client.1.smithi116.stdout:6/773: dwrite d8/d15/d2e/d2f/d57/f6e [4194304,4194304] 0 2024-09-13T21:40:48.669 INFO:tasks.workunit.client.1.smithi116.stdout:6/774: chown d8/d17/da6/ld1 11828303 1 2024-09-13T21:40:48.672 INFO:tasks.workunit.client.1.smithi116.stdout:6/775: rename d8/d1e/fd2 to d8/d15/d2e/d2f/d57/f109 0 2024-09-13T21:40:48.675 INFO:tasks.workunit.client.1.smithi116.stdout:6/776: unlink d8/d1e/l61 0 2024-09-13T21:40:48.676 INFO:tasks.workunit.client.1.smithi116.stdout:6/777: link d8/db5/l107 d8/d15/l10a 0 2024-09-13T21:40:48.677 INFO:tasks.workunit.client.1.smithi116.stdout:6/778: creat d8/d15/d2e/d2f/d38/d9c/f10b x:0 0 0 2024-09-13T21:40:48.679 INFO:tasks.workunit.client.1.smithi116.stdout:6/779: mkdir d8/d10c 0 2024-09-13T21:40:48.679 INFO:tasks.workunit.client.1.smithi116.stdout:6/780: write d8/d15/d2e/f100 [1009015,103926] 0 2024-09-13T21:40:48.679 INFO:tasks.workunit.client.1.smithi116.stdout:6/781: write d8/d15/d2e/d2f/d38/f45 [169467,123108] 0 2024-09-13T21:40:48.680 INFO:tasks.workunit.client.1.smithi116.stdout:6/782: symlink d8/d17/da6/df8/l10d 0 2024-09-13T21:40:48.682 INFO:tasks.workunit.client.1.smithi116.stdout:6/783: mkdir d8/d15/d2e/d2f/d38/d9c/dcd/de5/d10e 0 2024-09-13T21:40:48.682 INFO:tasks.workunit.client.1.smithi116.stdout:6/784: read - d8/d15/d2e/d2f/d38/fde zero size 2024-09-13T21:40:48.682 INFO:tasks.workunit.client.1.smithi116.stdout:6/785: fsync d8/d10/d33/f3b 0 2024-09-13T21:40:48.682 INFO:tasks.workunit.client.1.smithi116.stdout:6/786: chown d8/d17/d70/f7c 73 1 2024-09-13T21:40:48.765 INFO:tasks.workunit.client.1.smithi116.stdout:5/860: sync 2024-09-13T21:40:48.765 INFO:tasks.workunit.client.1.smithi116.stdout:7/793: sync 2024-09-13T21:40:48.765 INFO:tasks.workunit.client.1.smithi116.stdout:2/596: sync 2024-09-13T21:40:48.765 INFO:tasks.workunit.client.1.smithi116.stdout:1/569: sync 2024-09-13T21:40:48.765 INFO:tasks.workunit.client.1.smithi116.stdout:3/821: sync 2024-09-13T21:40:48.765 INFO:tasks.workunit.client.1.smithi116.stdout:4/649: sync 2024-09-13T21:40:48.765 INFO:tasks.workunit.client.1.smithi116.stdout:1/570: chown d4/d14/d41/dab/lae 11 1 2024-09-13T21:40:48.765 INFO:tasks.workunit.client.1.smithi116.stdout:7/794: dread - d5/d9/d27/ded/d22/d24/f58 zero size 2024-09-13T21:40:48.766 INFO:tasks.workunit.client.1.smithi116.stdout:5/861: getdents d7/d1d/d64/d11e 0 2024-09-13T21:40:48.766 INFO:tasks.workunit.client.1.smithi116.stdout:1/571: symlink d4/d14/d2a/lcd 0 2024-09-13T21:40:48.767 INFO:tasks.workunit.client.1.smithi116.stdout:5/862: symlink d7/d1d/d46/d85/d96/dd6/dd8/l121 0 2024-09-13T21:40:48.767 INFO:tasks.workunit.client.1.smithi116.stdout:5/863: fdatasync d7/d40/d53/f6e 0 2024-09-13T21:40:48.768 INFO:tasks.workunit.client.1.smithi116.stdout:5/864: mknod d7/d1d/d46/dd4/d5e/d79/dcb/d120/c122 0 2024-09-13T21:40:48.777 INFO:tasks.workunit.client.1.smithi116.stdout:4/650: write d0/dd/f1b [3369804,91276] 0 2024-09-13T21:40:48.777 INFO:tasks.workunit.client.1.smithi116.stdout:4/651: write d0/fb [4396405,55033] 0 2024-09-13T21:40:48.782 INFO:tasks.workunit.client.1.smithi116.stdout:2/597: dread d0/d3a/f9b [0,4194304] 0 2024-09-13T21:40:48.782 INFO:tasks.workunit.client.1.smithi116.stdout:3/822: write d3/db/d10/d1d/d5f/fe1 [1557090,78589] 0 2024-09-13T21:40:48.783 INFO:tasks.workunit.client.1.smithi116.stdout:1/572: read d4/d74/f80 [277071,56278] 0 2024-09-13T21:40:48.783 INFO:tasks.workunit.client.1.smithi116.stdout:2/598: creat d0/d3a/d82/d62/d1f/d5d/fc2 x:0 0 0 2024-09-13T21:40:48.783 INFO:tasks.workunit.client.1.smithi116.stdout:4/652: dread d0/dd/f3f [0,4194304] 0 2024-09-13T21:40:48.784 INFO:tasks.workunit.client.1.smithi116.stdout:1/573: write f1 [488088,2633] 0 2024-09-13T21:40:48.784 INFO:tasks.workunit.client.1.smithi116.stdout:1/574: fdatasync d4/d14/d52/d2f/d5c/daf/fc2 0 2024-09-13T21:40:48.784 INFO:tasks.workunit.client.1.smithi116.stdout:1/575: chown d4/d14/d52/d2f/d5c/c7d 0 1 2024-09-13T21:40:48.784 INFO:tasks.workunit.client.1.smithi116.stdout:1/576: fsync d4/d74/fc9 0 2024-09-13T21:40:48.785 INFO:tasks.workunit.client.1.smithi116.stdout:3/823: rename d3/db/d10/d1c/d63/f64 to d3/df9/da2/f122 0 2024-09-13T21:40:48.786 INFO:tasks.workunit.client.1.smithi116.stdout:2/599: unlink d0/d7/d2b/l4c 0 2024-09-13T21:40:48.786 INFO:tasks.workunit.client.1.smithi116.stdout:2/600: write d0/d3a/d82/d62/d75/d77/f99 [1954410,95041] 0 2024-09-13T21:40:48.786 INFO:tasks.workunit.client.1.smithi116.stdout:2/601: fdatasync d0/d5/d2a/f57 0 2024-09-13T21:40:48.786 INFO:tasks.workunit.client.1.smithi116.stdout:2/602: stat d0/l4 0 2024-09-13T21:40:48.787 INFO:tasks.workunit.client.1.smithi116.stdout:3/824: symlink d3/db/l123 0 2024-09-13T21:40:48.787 INFO:tasks.workunit.client.1.smithi116.stdout:3/825: dread - d3/db/d10/d1d/d2f/d61/f114 zero size 2024-09-13T21:40:48.788 INFO:tasks.workunit.client.1.smithi116.stdout:7/795: dwrite d5/d9/d27/ded/d22/d24/d6b/d72/f8c [0,4194304] 0 2024-09-13T21:40:48.788 INFO:tasks.workunit.client.1.smithi116.stdout:7/796: readlink d5/d9/d27/ded/d22/d24/lcd 0 2024-09-13T21:40:48.788 INFO:tasks.workunit.client.1.smithi116.stdout:3/826: unlink d3/db/d10/d1c/d34/d55/d57/dda/ff4 0 2024-09-13T21:40:48.788 INFO:tasks.workunit.client.1.smithi116.stdout:3/827: readlink d3/db/d10/d1c/ldb 0 2024-09-13T21:40:48.788 INFO:tasks.workunit.client.1.smithi116.stdout:3/828: dread - d3/db/d10/d1d/d5f/d6f/d71/f11c zero size 2024-09-13T21:40:48.789 INFO:tasks.workunit.client.1.smithi116.stdout:3/829: chown d3/db/d10/d1d/d2f/d61/f114 127649693 1 2024-09-13T21:40:48.790 INFO:tasks.workunit.client.1.smithi116.stdout:2/603: dread d0/d7/d2b/f78 [0,4194304] 0 2024-09-13T21:40:48.790 INFO:tasks.workunit.client.1.smithi116.stdout:2/604: stat d0/d3a/d82/d62/d1f/d5d 0 2024-09-13T21:40:48.791 INFO:tasks.workunit.client.1.smithi116.stdout:5/865: dwrite d7/d1d/d46/d85/d96/da8/fac [0,4194304] 0 2024-09-13T21:40:48.791 INFO:tasks.workunit.client.1.smithi116.stdout:7/797: link d5/d9/d27/d31/d38/d48/f76 d5/d9/d27/ded/d22/d24/d5f/de5/f103 0 2024-09-13T21:40:48.793 INFO:tasks.workunit.client.1.smithi116.stdout:3/830: symlink d3/df9/l124 0 2024-09-13T21:40:48.794 INFO:tasks.workunit.client.1.smithi116.stdout:4/653: dread d0/dd/d48/f5c [4194304,4194304] 0 2024-09-13T21:40:48.795 INFO:tasks.workunit.client.1.smithi116.stdout:4/654: fsync d0/d56/fb5 0 2024-09-13T21:40:48.796 INFO:tasks.workunit.client.1.smithi116.stdout:3/831: read d3/db/d10/d1c/d34/d55/d57/f7a [402247,48575] 0 2024-09-13T21:40:48.796 INFO:tasks.workunit.client.1.smithi116.stdout:3/832: chown d3/db/d10/d1c/d34/d55/d57/db1/fb2 9757534 1 2024-09-13T21:40:48.796 INFO:tasks.workunit.client.1.smithi116.stdout:3/833: fsync d3/db/d20/d50/f8b 0 2024-09-13T21:40:48.796 INFO:tasks.workunit.client.1.smithi116.stdout:1/577: write d4/d23/d57/f97 [1945088,59460] 0 2024-09-13T21:40:48.798 INFO:tasks.workunit.client.1.smithi116.stdout:7/798: creat d5/d9/d27/ded/d22/d24/d3a/f104 x:0 0 0 2024-09-13T21:40:48.798 INFO:tasks.workunit.client.1.smithi116.stdout:7/799: truncate d5/d9/d27/d31/d38/d48/f75 1966761 0 2024-09-13T21:40:48.799 INFO:tasks.workunit.client.1.smithi116.stdout:4/655: mkdir d0/dd/d13/d5a/dc4 0 2024-09-13T21:40:48.799 INFO:tasks.workunit.client.1.smithi116.stdout:1/578: dread d4/d74/f80 [0,4194304] 0 2024-09-13T21:40:48.800 INFO:tasks.workunit.client.1.smithi116.stdout:5/866: dread d7/fc [0,4194304] 0 2024-09-13T21:40:48.800 INFO:tasks.workunit.client.1.smithi116.stdout:3/834: mknod d3/db/d121/c125 0 2024-09-13T21:40:48.800 INFO:tasks.workunit.client.1.smithi116.stdout:3/835: creat d3/db/d10/f126 x:0 0 0 2024-09-13T21:40:48.802 INFO:tasks.workunit.client.1.smithi116.stdout:4/656: mknod d0/dd/d13/d4e/cc5 0 2024-09-13T21:40:48.802 INFO:tasks.workunit.client.1.smithi116.stdout:4/657: readlink d0/dd/d7c/l9f 0 2024-09-13T21:40:48.803 INFO:tasks.workunit.client.1.smithi116.stdout:1/579: dread d4/d14/d52/d2f/f4b [0,4194304] 0 2024-09-13T21:40:48.803 INFO:tasks.workunit.client.1.smithi116.stdout:1/580: write d4/d14/d2a/f88 [1716748,129429] 0 2024-09-13T21:40:48.804 INFO:tasks.workunit.client.1.smithi116.stdout:5/867: mknod d7/d1d/d46/d85/d96/da8/db9/c123 0 2024-09-13T21:40:48.807 INFO:tasks.workunit.client.1.smithi116.stdout:7/800: dread d5/d9/d27/ded/d22/faa [0,4194304] 0 2024-09-13T21:40:48.807 INFO:tasks.workunit.client.1.smithi116.stdout:3/836: mkdir d3/df9/d127 0 2024-09-13T21:40:48.809 INFO:tasks.workunit.client.1.smithi116.stdout:4/658: creat d0/d56/d84/fc6 x:0 0 0 2024-09-13T21:40:48.811 INFO:tasks.workunit.client.1.smithi116.stdout:5/868: link d7/d1d/d46/l4d d7/d1d/d64/d110/d116/l124 0 2024-09-13T21:40:48.811 INFO:tasks.workunit.client.1.smithi116.stdout:5/869: chown d7/d1d/d46/dd4/d5e/d65/df9/c10d 58670 1 2024-09-13T21:40:48.812 INFO:tasks.workunit.client.1.smithi116.stdout:5/870: fsync d7/d1d/d64/d94/feb 0 2024-09-13T21:40:48.813 INFO:tasks.workunit.client.1.smithi116.stdout:7/801: mkdir d5/d9/d27/d31/d105 0 2024-09-13T21:40:48.813 INFO:tasks.workunit.client.1.smithi116.stdout:2/605: dwrite d0/d3a/d82/d62/d1f/d5d/d60/f95 [0,4194304] 0 2024-09-13T21:40:48.814 INFO:tasks.workunit.client.1.smithi116.stdout:2/606: write d0/d3a/d82/d62/d1f/d5d/fc2 [429014,82071] 0 2024-09-13T21:40:48.815 INFO:tasks.workunit.client.1.smithi116.stdout:3/837: creat d3/db/d3d/d110/f128 x:0 0 0 2024-09-13T21:40:48.816 INFO:tasks.workunit.client.1.smithi116.stdout:4/659: mkdir d0/dd/d6b/d92/d95/dc7 0 2024-09-13T21:40:48.818 INFO:tasks.workunit.client.1.smithi116.stdout:5/871: mkdir d7/d40/d80/d125 0 2024-09-13T21:40:48.818 INFO:tasks.workunit.client.1.smithi116.stdout:5/872: fsync d7/d1d/d64/d94/daa/fe2 0 2024-09-13T21:40:48.818 INFO:tasks.workunit.client.1.smithi116.stdout:7/802: rmdir d5/d9/d27/ded/d22/d24/d6b/d72/d74 39 2024-09-13T21:40:48.821 INFO:tasks.workunit.client.1.smithi116.stdout:3/838: mkdir d3/db/d10/d1c/d129 0 2024-09-13T21:40:48.823 INFO:tasks.workunit.client.1.smithi116.stdout:1/581: dwrite d4/d14/d52/f99 [0,4194304] 0 2024-09-13T21:40:48.823 INFO:tasks.workunit.client.1.smithi116.stdout:2/607: dread d0/f54 [0,4194304] 0 2024-09-13T21:40:48.823 INFO:tasks.workunit.client.1.smithi116.stdout:7/803: link d5/d9/db/d21/f3e d5/d9/d27/d31/d105/f106 0 2024-09-13T21:40:48.823 INFO:tasks.workunit.client.1.smithi116.stdout:3/839: getdents d3/df9/da2 0 2024-09-13T21:40:48.825 INFO:tasks.workunit.client.1.smithi116.stdout:2/608: mknod d0/d5/d8/cc3 0 2024-09-13T21:40:48.825 INFO:tasks.workunit.client.1.smithi116.stdout:2/609: fsync d0/d3a/d82/d62/d1f/d5d/d89/f9c 0 2024-09-13T21:40:48.825 INFO:tasks.workunit.client.1.smithi116.stdout:2/610: chown d0/d3a/d82/d62/d75/d77/cb7 186485 1 2024-09-13T21:40:48.825 INFO:tasks.workunit.client.1.smithi116.stdout:3/840: mkdir d3/db/d10/d1c/d63/d12a 0 2024-09-13T21:40:48.826 INFO:tasks.workunit.client.1.smithi116.stdout:3/841: read - d3/db/f10e zero size 2024-09-13T21:40:48.827 INFO:tasks.workunit.client.1.smithi116.stdout:2/611: creat d0/d5/d8/fc4 x:0 0 0 2024-09-13T21:40:48.827 INFO:tasks.workunit.client.1.smithi116.stdout:2/612: fsync d0/d3a/d82/d62/fb5 0 2024-09-13T21:40:48.830 INFO:tasks.workunit.client.1.smithi116.stdout:2/613: creat d0/d5/fc5 x:0 0 0 2024-09-13T21:40:48.833 INFO:tasks.workunit.client.1.smithi116.stdout:7/804: dread d5/d9/f14 [0,4194304] 0 2024-09-13T21:40:48.835 INFO:tasks.workunit.client.1.smithi116.stdout:1/582: dread d4/d14/f4f [0,4194304] 0 2024-09-13T21:40:48.835 INFO:tasks.workunit.client.1.smithi116.stdout:7/805: creat d5/d9/d27/ded/d22/d24/d5f/f107 x:0 0 0 2024-09-13T21:40:48.836 INFO:tasks.workunit.client.1.smithi116.stdout:1/583: unlink d4/ce 0 2024-09-13T21:40:48.837 INFO:tasks.workunit.client.1.smithi116.stdout:7/806: mknod d5/d9/d27/ded/c108 0 2024-09-13T21:40:48.837 INFO:tasks.workunit.client.1.smithi116.stdout:1/584: rmdir d4/d23/d56 39 2024-09-13T21:40:48.838 INFO:tasks.workunit.client.1.smithi116.stdout:7/807: symlink d5/d9/d27/ded/d22/d24/d6b/d72/d74/l109 0 2024-09-13T21:40:48.839 INFO:tasks.workunit.client.1.smithi116.stdout:1/585: symlink d4/d14/d41/lce 0 2024-09-13T21:40:48.840 INFO:tasks.workunit.client.1.smithi116.stdout:1/586: chown d4/d14/d52/d2f/d5c/c7d 6 1 2024-09-13T21:40:48.840 INFO:tasks.workunit.client.1.smithi116.stdout:1/587: read d4/d14/f1d [1928760,80685] 0 2024-09-13T21:40:48.842 INFO:tasks.workunit.client.1.smithi116.stdout:1/588: unlink d4/d14/db0/fb8 0 2024-09-13T21:40:48.842 INFO:tasks.workunit.client.1.smithi116.stdout:4/660: dwrite d0/dd/d48/f9d [0,4194304] 0 2024-09-13T21:40:48.843 INFO:tasks.workunit.client.1.smithi116.stdout:7/808: write d5/d9/f10 [3830333,69766] 0 2024-09-13T21:40:48.843 INFO:tasks.workunit.client.1.smithi116.stdout:5/873: dwrite d7/d1d/d46/dd4/f52 [0,4194304] 0 2024-09-13T21:40:48.844 INFO:tasks.workunit.client.1.smithi116.stdout:1/589: symlink d4/d14/d41/lcf 0 2024-09-13T21:40:48.850 INFO:tasks.workunit.client.1.smithi116.stdout:7/809: symlink d5/d9/db/da3/l10a 0 2024-09-13T21:40:48.852 INFO:tasks.workunit.client.1.smithi116.stdout:5/874: dread d7/d1d/d64/d87/f8a [0,4194304] 0 2024-09-13T21:40:48.852 INFO:tasks.workunit.client.1.smithi116.stdout:5/875: chown d7/d1d/d64/d87/f9c 961233908 1 2024-09-13T21:40:48.852 INFO:tasks.workunit.client.1.smithi116.stdout:5/876: chown d7/fc 40546580 1 2024-09-13T21:40:48.852 INFO:tasks.workunit.client.1.smithi116.stdout:1/590: creat d4/d23/d56/da3/fd0 x:0 0 0 2024-09-13T21:40:48.855 INFO:tasks.workunit.client.1.smithi116.stdout:7/810: creat d5/d9/d27/ded/d22/f10b x:0 0 0 2024-09-13T21:40:48.856 INFO:tasks.workunit.client.1.smithi116.stdout:5/877: creat d7/d1d/d46/d85/d96/da8/db9/f126 x:0 0 0 2024-09-13T21:40:48.858 INFO:tasks.workunit.client.1.smithi116.stdout:1/591: mknod d4/d14/d52/d2f/d5c/daf/cd1 0 2024-09-13T21:40:48.860 INFO:tasks.workunit.client.1.smithi116.stdout:2/614: dwrite d0/d3a/d82/d62/d1f/d5d/d89/f9c [0,4194304] 0 2024-09-13T21:40:48.860 INFO:tasks.workunit.client.1.smithi116.stdout:2/615: stat d0/d3a/d82/d62/d75/d77/f8d 0 2024-09-13T21:40:48.861 INFO:tasks.workunit.client.1.smithi116.stdout:1/592: rename d4/d23/f2b to d4/d14/d2a/fd2 0 2024-09-13T21:40:48.861 INFO:tasks.workunit.client.1.smithi116.stdout:4/661: dwrite d0/f43 [0,4194304] 0 2024-09-13T21:40:48.862 INFO:tasks.workunit.client.1.smithi116.stdout:7/811: link d5/d9/db/l20 d5/d9/d27/ded/d22/d24/l10c 0 2024-09-13T21:40:48.865 INFO:tasks.workunit.client.1.smithi116.stdout:1/593: dread d4/d14/d52/d2f/d5d/d90/f93 [0,4194304] 0 2024-09-13T21:40:48.866 INFO:tasks.workunit.client.1.smithi116.stdout:2/616: mknod d0/d3a/d82/d62/d1f/d5d/d72/daa/cc6 0 2024-09-13T21:40:48.870 INFO:tasks.workunit.client.1.smithi116.stdout:4/662: mkdir d0/dd/d13/d5a/dc4/dc8 0 2024-09-13T21:40:48.870 INFO:tasks.workunit.client.1.smithi116.stdout:4/663: read - d0/dd/faf zero size 2024-09-13T21:40:48.872 INFO:tasks.workunit.client.1.smithi116.stdout:7/812: symlink d5/d9/d27/ded/d22/d24/d3a/ddc/l10d 0 2024-09-13T21:40:48.872 INFO:tasks.workunit.client.1.smithi116.stdout:7/813: write d5/d9/d27/ded/d22/fdb [803768,110484] 0 2024-09-13T21:40:48.873 INFO:tasks.workunit.client.1.smithi116.stdout:5/878: dwrite d7/d40/d53/dc8/f11d [0,4194304] 0 2024-09-13T21:40:48.873 INFO:tasks.workunit.client.1.smithi116.stdout:5/879: fsync d7/d1d/f45 0 2024-09-13T21:40:48.874 INFO:tasks.workunit.client.1.smithi116.stdout:1/594: unlink d4/d74/d8d/f96 0 2024-09-13T21:40:48.874 INFO:tasks.workunit.client.1.smithi116.stdout:1/595: fsync d4/f83 0 2024-09-13T21:40:48.875 INFO:tasks.workunit.client.1.smithi116.stdout:2/617: symlink d0/d7/d49/lc7 0 2024-09-13T21:40:48.876 INFO:tasks.workunit.client.1.smithi116.stdout:4/664: mknod d0/d32/da3/cc9 0 2024-09-13T21:40:48.879 INFO:tasks.workunit.client.1.smithi116.stdout:5/880: creat d7/d1d/d46/dd4/d5e/d65/d6a/f127 x:0 0 0 2024-09-13T21:40:48.880 INFO:tasks.workunit.client.1.smithi116.stdout:5/881: truncate d7/d1d/d64/d94/daa/fae 151737 0 2024-09-13T21:40:48.881 INFO:tasks.workunit.client.1.smithi116.stdout:1/596: mkdir d4/d14/d2a/dd3 0 2024-09-13T21:40:48.883 INFO:tasks.workunit.client.1.smithi116.stdout:2/618: rename d0/d7/d2d/fc1 to d0/d3a/fc8 0 2024-09-13T21:40:48.883 INFO:tasks.workunit.client.1.smithi116.stdout:7/814: write d5/d9/d27/fb4 [2231442,6755] 0 2024-09-13T21:40:48.883 INFO:tasks.workunit.client.1.smithi116.stdout:7/815: creat d5/d9/d27/d31/d38/d42/f10e x:0 0 0 2024-09-13T21:40:48.884 INFO:tasks.workunit.client.1.smithi116.stdout:7/816: chown d5/d9/db/da3/l10a 9081970 1 2024-09-13T21:40:48.884 INFO:tasks.workunit.client.1.smithi116.stdout:5/882: stat d7/d1d/d46/dd4/d5e/d65/c66 0 2024-09-13T21:40:48.884 INFO:tasks.workunit.client.1.smithi116.stdout:5/883: dread - d7/d1d/d46/d85/d96/f10e zero size 2024-09-13T21:40:48.884 INFO:tasks.workunit.client.1.smithi116.stdout:5/884: write d7/d1d/dbb/fd3 [4529538,89440] 0 2024-09-13T21:40:48.886 INFO:tasks.workunit.client.1.smithi116.stdout:2/619: link d0/d5/d2a/fa7 d0/d5/d2a/fc9 0 2024-09-13T21:40:48.890 INFO:tasks.workunit.client.1.smithi116.stdout:7/817: symlink d5/d9/db/d21/l10f 0 2024-09-13T21:40:48.890 INFO:tasks.workunit.client.1.smithi116.stdout:1/597: dread d4/ff [0,4194304] 0 2024-09-13T21:40:48.890 INFO:tasks.workunit.client.1.smithi116.stdout:7/818: fsync d5/d9/f51 0 2024-09-13T21:40:48.893 INFO:tasks.workunit.client.1.smithi116.stdout:2/620: mknod d0/d7/d49/d93/cca 0 2024-09-13T21:40:48.896 INFO:tasks.workunit.client.1.smithi116.stdout:1/598: unlink d4/d14/d41/lcf 0 2024-09-13T21:40:48.897 INFO:tasks.workunit.client.1.smithi116.stdout:1/599: read d4/d14/d2a/f88 [636110,53050] 0 2024-09-13T21:40:48.898 INFO:tasks.workunit.client.1.smithi116.stdout:4/665: dread d0/f30 [0,4194304] 0 2024-09-13T21:40:48.899 INFO:tasks.workunit.client.1.smithi116.stdout:2/621: dread d0/d7/d2b/f3f [0,4194304] 0 2024-09-13T21:40:48.900 INFO:tasks.workunit.client.1.smithi116.stdout:1/600: mkdir d4/d74/d8d/d5f/dd4 0 2024-09-13T21:40:48.900 INFO:tasks.workunit.client.1.smithi116.stdout:1/601: write d4/f8 [507181,110400] 0 2024-09-13T21:40:48.900 INFO:tasks.workunit.client.1.smithi116.stdout:1/602: chown d4/d14/d52/d2f/d5d/dc7 321696 1 2024-09-13T21:40:48.900 INFO:tasks.workunit.client.1.smithi116.stdout:1/603: getdents d4/d74/d8d/d5f/dd4 0 2024-09-13T21:40:48.901 INFO:tasks.workunit.client.1.smithi116.stdout:1/604: creat d4/d14/d52/d2f/d5d/fd5 x:0 0 0 2024-09-13T21:40:48.902 INFO:tasks.workunit.client.1.smithi116.stdout:4/666: creat d0/d32/da3/fca x:0 0 0 2024-09-13T21:40:48.907 INFO:tasks.workunit.client.1.smithi116.stdout:1/605: creat d4/d14/d52/fd6 x:0 0 0 2024-09-13T21:40:48.907 INFO:tasks.workunit.client.1.smithi116.stdout:1/606: chown d4/d14/f1d 1213 1 2024-09-13T21:40:48.909 INFO:tasks.workunit.client.1.smithi116.stdout:4/667: rename d0/d32/f66 to d0/dd/fcb 0 2024-09-13T21:40:48.910 INFO:tasks.workunit.client.1.smithi116.stdout:4/668: mkdir d0/dd/d13/dcc 0 2024-09-13T21:40:48.911 INFO:tasks.workunit.client.1.smithi116.stdout:1/607: write d4/f10 [1564318,17041] 0 2024-09-13T21:40:48.911 INFO:tasks.workunit.client.1.smithi116.stdout:4/669: mknod d0/dd/d13/d4e/ccd 0 2024-09-13T21:40:48.913 INFO:tasks.workunit.client.1.smithi116.stdout:1/608: creat d4/d23/d57/fd7 x:0 0 0 2024-09-13T21:40:48.919 INFO:tasks.workunit.client.1.smithi116.stdout:4/670: dread d0/dd/f3f [0,4194304] 0 2024-09-13T21:40:48.922 INFO:tasks.workunit.client.1.smithi116.stdout:4/671: dread d0/dd/d6b/f93 [0,4194304] 0 2024-09-13T21:40:48.923 INFO:tasks.workunit.client.1.smithi116.stdout:4/672: symlink d0/dd/d13/d5a/d86/lce 0 2024-09-13T21:40:48.925 INFO:tasks.workunit.client.1.smithi116.stdout:5/885: dwrite d7/d1d/dbb/fd9 [0,4194304] 0 2024-09-13T21:40:48.925 INFO:tasks.workunit.client.1.smithi116.stdout:5/886: chown d7/d1d/d46/dd4/d5e/d65/f8c 170712987 1 2024-09-13T21:40:48.926 INFO:tasks.workunit.client.1.smithi116.stdout:2/622: dwrite d0/d7/d49/f80 [0,4194304] 0 2024-09-13T21:40:48.928 INFO:tasks.workunit.client.1.smithi116.stdout:7/819: dwrite d5/d9/db/f100 [0,4194304] 0 2024-09-13T21:40:48.928 INFO:tasks.workunit.client.1.smithi116.stdout:1/609: write d4/d14/d2a/fbf [2543227,41998] 0 2024-09-13T21:40:48.928 INFO:tasks.workunit.client.1.smithi116.stdout:7/820: write d5/d9/fea [1263654,65796] 0 2024-09-13T21:40:48.928 INFO:tasks.workunit.client.1.smithi116.stdout:7/821: write d5/db0/fe6 [911118,52597] 0 2024-09-13T21:40:48.928 INFO:tasks.workunit.client.1.smithi116.stdout:5/887: mkdir d7/d1d/d46/d85/d96/dd6/d128 0 2024-09-13T21:40:48.929 INFO:tasks.workunit.client.1.smithi116.stdout:2/623: mkdir d0/d3a/d82/d62/d75/dcb 0 2024-09-13T21:40:48.935 INFO:tasks.workunit.client.1.smithi116.stdout:2/624: creat d0/d3a/d82/d62/d1f/d5d/d72/daa/fcc x:0 0 0 2024-09-13T21:40:48.935 INFO:tasks.workunit.client.1.smithi116.stdout:7/822: dread d5/d9/d27/d31/d38/f6a [0,4194304] 0 2024-09-13T21:40:48.935 INFO:tasks.workunit.client.1.smithi116.stdout:7/823: read d5/d9/f10 [362543,125119] 0 2024-09-13T21:40:48.939 INFO:tasks.workunit.client.1.smithi116.stdout:4/673: dwrite d0/d56/d57/fa0 [0,4194304] 0 2024-09-13T21:40:48.942 INFO:tasks.workunit.client.1.smithi116.stdout:1/610: write d4/d23/d57/fa1 [1727628,8660] 0 2024-09-13T21:40:48.942 INFO:tasks.workunit.client.1.smithi116.stdout:1/611: readlink d4/d23/d56/da3/lba 0 2024-09-13T21:40:48.943 INFO:tasks.workunit.client.1.smithi116.stdout:4/674: mkdir d0/dd/dcf 0 2024-09-13T21:40:48.943 INFO:tasks.workunit.client.1.smithi116.stdout:5/888: write d7/d40/f9e [2338700,25883] 0 2024-09-13T21:40:48.943 INFO:tasks.workunit.client.1.smithi116.stdout:5/889: fdatasync d7/d40/d53/dc8/f11d 0 2024-09-13T21:40:48.944 INFO:tasks.workunit.client.1.smithi116.stdout:4/675: mknod d0/dad/cd0 0 2024-09-13T21:40:48.944 INFO:tasks.workunit.client.1.smithi116.stdout:4/676: fsync d0/f30 0 2024-09-13T21:40:48.951 INFO:tasks.workunit.client.1.smithi116.stdout:1/612: write d4/d74/d8d/f67 [120715,73289] 0 2024-09-13T21:40:48.956 INFO:tasks.workunit.client.1.smithi116.stdout:7/824: dread f2 [0,4194304] 0 2024-09-13T21:40:48.956 INFO:tasks.workunit.client.1.smithi116.stdout:7/825: write d5/d9/d27/d31/d38/d48/f101 [334269,32473] 0 2024-09-13T21:40:48.956 INFO:tasks.workunit.client.1.smithi116.stdout:7/826: read d5/d9/db/ff [3507603,119385] 0 2024-09-13T21:40:48.956 INFO:tasks.workunit.client.1.smithi116.stdout:5/890: truncate d7/d1d/dbb/fd9 3696783 0 2024-09-13T21:40:48.958 INFO:tasks.workunit.client.1.smithi116.stdout:7/827: symlink d5/d9/db/d21/l110 0 2024-09-13T21:40:48.958 INFO:tasks.workunit.client.1.smithi116.stdout:7/828: chown d5/d9/d27/f2b 5 1 2024-09-13T21:40:48.958 INFO:tasks.workunit.client.1.smithi116.stdout:7/829: fdatasync d5/d9/d27/ded/d37/f62 0 2024-09-13T21:40:48.958 INFO:tasks.workunit.client.1.smithi116.stdout:7/830: chown d5/d9/db/ffb 521 1 2024-09-13T21:40:48.960 INFO:tasks.workunit.client.1.smithi116.stdout:5/891: write d7/fc [1445680,91671] 0 2024-09-13T21:40:48.963 INFO:tasks.workunit.client.1.smithi116.stdout:8/711: sync 2024-09-13T21:40:48.963 INFO:tasks.workunit.client.1.smithi116.stdout:9/516: sync 2024-09-13T21:40:48.963 INFO:tasks.workunit.client.1.smithi116.stdout:9/517: fdatasync d2/d43/f8e 0 2024-09-13T21:40:48.963 INFO:tasks.workunit.client.1.smithi116.stdout:8/712: fdatasync d2/d10/d3e/da4/fa7 0 2024-09-13T21:40:48.964 INFO:tasks.workunit.client.1.smithi116.stdout:9/518: getdents d2/d10/d14/d38/d3a 0 2024-09-13T21:40:48.966 INFO:tasks.workunit.client.1.smithi116.stdout:9/519: mkdir d2/d10/d4c/d98 0 2024-09-13T21:40:48.966 INFO:tasks.workunit.client.1.smithi116.stdout:9/520: chown d2/f2b 42363960 1 2024-09-13T21:40:48.966 INFO:tasks.workunit.client.1.smithi116.stdout:9/521: chown d2/d5d/c85 3 1 2024-09-13T21:40:48.967 INFO:tasks.workunit.client.1.smithi116.stdout:5/892: dread d7/d1d/d46/dd4/d5e/f7a [0,4194304] 0 2024-09-13T21:40:48.967 INFO:tasks.workunit.client.1.smithi116.stdout:5/893: fsync d7/d1d/f20 0 2024-09-13T21:40:48.967 INFO:tasks.workunit.client.1.smithi116.stdout:2/625: dwrite d0/d3a/d82/d62/d1f/d5d/d60/f95 [0,4194304] 0 2024-09-13T21:40:48.968 INFO:tasks.workunit.client.1.smithi116.stdout:2/626: chown d0/d7/d49 1579 1 2024-09-13T21:40:48.969 INFO:tasks.workunit.client.1.smithi116.stdout:4/677: dwrite d0/d56/fb5 [0,4194304] 0 2024-09-13T21:40:48.970 INFO:tasks.workunit.client.1.smithi116.stdout:5/894: creat d7/d1d/d46/dc0/df3/f129 x:0 0 0 2024-09-13T21:40:48.974 INFO:tasks.workunit.client.1.smithi116.stdout:2/627: mknod d0/d7/d49/d93/ccd 0 2024-09-13T21:40:48.976 INFO:tasks.workunit.client.1.smithi116.stdout:4/678: symlink d0/dd/d7c/ld1 0 2024-09-13T21:40:48.978 INFO:tasks.workunit.client.1.smithi116.stdout:5/895: unlink d7/d1d/f20 0 2024-09-13T21:40:48.980 INFO:tasks.workunit.client.1.smithi116.stdout:2/628: mknod d0/d3a/d82/d68/cce 0 2024-09-13T21:40:48.980 INFO:tasks.workunit.client.1.smithi116.stdout:2/629: chown d0/d5/d8/c50 1912920 1 2024-09-13T21:40:48.981 INFO:tasks.workunit.client.1.smithi116.stdout:5/896: symlink d7/d1d/d46/dd4/d5e/l12a 0 2024-09-13T21:40:48.981 INFO:tasks.workunit.client.1.smithi116.stdout:5/897: stat d7/d40/f8e 0 2024-09-13T21:40:48.982 INFO:tasks.workunit.client.1.smithi116.stdout:2/630: rename d0/d3a/d82/d62/l2e to d0/d5/d8/lcf 0 2024-09-13T21:40:48.984 INFO:tasks.workunit.client.1.smithi116.stdout:2/631: getdents d0/d7 0 2024-09-13T21:40:48.984 INFO:tasks.workunit.client.1.smithi116.stdout:2/632: fsync d0/d3a/d82/d62/d1f/fbb 0 2024-09-13T21:40:48.997 INFO:tasks.workunit.client.1.smithi116.stdout:2/633: write d0/d5/d2a/f3b [3520358,84176] 0 2024-09-13T21:40:48.997 INFO:tasks.workunit.client.1.smithi116.stdout:2/634: write d0/d3a/d82/f42 [1950029,111249] 0 2024-09-13T21:40:48.998 INFO:tasks.workunit.client.1.smithi116.stdout:2/635: mknod d0/d3a/d82/d68/cd0 0 2024-09-13T21:40:49.009 INFO:tasks.workunit.client.1.smithi116.stdout:4/679: dwrite d0/d32/f3e [8388608,4194304] 0 2024-09-13T21:40:49.009 INFO:tasks.workunit.client.1.smithi116.stdout:4/680: fdatasync d0/d32/da3/fca 0 2024-09-13T21:40:49.010 INFO:tasks.workunit.client.1.smithi116.stdout:2/636: write d0/d3a/d82/d62/d1f/d5d/d89/f9c [27699,592] 0 2024-09-13T21:40:49.011 INFO:tasks.workunit.client.1.smithi116.stdout:8/713: dwrite d2/d10/d19/d21/d69/f9f [0,4194304] 0 2024-09-13T21:40:49.011 INFO:tasks.workunit.client.1.smithi116.stdout:7/831: dwrite d5/d9/d27/ded/d22/f10b [0,4194304] 0 2024-09-13T21:40:49.012 INFO:tasks.workunit.client.1.smithi116.stdout:8/714: readlink d2/d10/d19/d42/l54 0 2024-09-13T21:40:49.016 INFO:tasks.workunit.client.1.smithi116.stdout:4/681: dread d0/fb [0,4194304] 0 2024-09-13T21:40:49.016 INFO:tasks.workunit.client.1.smithi116.stdout:8/715: symlink d2/d10/d19/d21/d22/d5d/ld3 0 2024-09-13T21:40:49.018 INFO:tasks.workunit.client.1.smithi116.stdout:2/637: getdents d0/d5 0 2024-09-13T21:40:49.018 INFO:tasks.workunit.client.1.smithi116.stdout:2/638: dread - d0/fb0 zero size 2024-09-13T21:40:49.021 INFO:tasks.workunit.client.1.smithi116.stdout:8/716: rename d2/d10/d19/d42/l54 to d2/d10/d19/d21/d69/d90/da9/dbc/ld4 0 2024-09-13T21:40:49.021 INFO:tasks.workunit.client.1.smithi116.stdout:2/639: mkdir d0/d7/d86/dd1 0 2024-09-13T21:40:49.024 INFO:tasks.workunit.client.1.smithi116.stdout:8/717: symlink d2/d27/d62/ld5 0 2024-09-13T21:40:49.028 INFO:tasks.workunit.client.1.smithi116.stdout:8/718: rename d2/d10/d19/d21/d69/d90/da9/db5 to d2/d10/d37/d64/dd6 0 2024-09-13T21:40:49.032 INFO:tasks.workunit.client.1.smithi116.stdout:8/719: symlink d2/d10/d4b/d6e/ld7 0 2024-09-13T21:40:49.036 INFO:tasks.workunit.client.1.smithi116.stdout:8/720: creat d2/d10/d19/d21/fd8 x:0 0 0 2024-09-13T21:40:49.036 INFO:tasks.workunit.client.1.smithi116.stdout:8/721: write d2/d27/d62/f7b [4416667,19381] 0 2024-09-13T21:40:49.036 INFO:tasks.workunit.client.1.smithi116.stdout:8/722: read - d2/d10/d3e/da4/fa7 zero size 2024-09-13T21:40:49.036 INFO:tasks.workunit.client.1.smithi116.stdout:8/723: readlink d2/d27/d66/d7c/l9a 0 2024-09-13T21:40:49.037 INFO:tasks.workunit.client.1.smithi116.stdout:8/724: symlink d2/d10/d75/ld9 0 2024-09-13T21:40:49.038 INFO:tasks.workunit.client.1.smithi116.stdout:8/725: fsync d2/d10/f31 0 2024-09-13T21:40:49.042 INFO:tasks.workunit.client.1.smithi116.stdout:7/832: dwrite d5/d9/db/d21/f53 [0,4194304] 0 2024-09-13T21:40:49.043 INFO:tasks.workunit.client.1.smithi116.stdout:7/833: mkdir d5/d9/d27/d31/d38/d111 0 2024-09-13T21:40:49.044 INFO:tasks.workunit.client.1.smithi116.stdout:7/834: mkdir d5/d9/d27/ded/d22/d24/d3a/d112 0 2024-09-13T21:40:49.045 INFO:tasks.workunit.client.1.smithi116.stdout:4/682: dwrite d0/dd/d48/f94 [0,4194304] 0 2024-09-13T21:40:49.046 INFO:tasks.workunit.client.1.smithi116.stdout:7/835: link d5/db0/fe6 d5/d9/d27/ded/d22/d24/d6b/d72/d74/d93/f113 0 2024-09-13T21:40:49.046 INFO:tasks.workunit.client.1.smithi116.stdout:2/640: dwrite d0/fb0 [0,4194304] 0 2024-09-13T21:40:49.046 INFO:tasks.workunit.client.1.smithi116.stdout:7/836: creat d5/d9/d27/ded/d22/d24/d5f/dfc/f114 x:0 0 0 2024-09-13T21:40:49.053 INFO:tasks.workunit.client.1.smithi116.stdout:4/683: write d0/f3a [1001542,86133] 0 2024-09-13T21:40:49.057 INFO:tasks.workunit.client.1.smithi116.stdout:2/641: read d0/d3a/f9b [112145,8232] 0 2024-09-13T21:40:49.057 INFO:tasks.workunit.client.1.smithi116.stdout:2/642: truncate d0/d7/f84 455205 0 2024-09-13T21:40:49.057 INFO:tasks.workunit.client.1.smithi116.stdout:4/684: mknod d0/dd/d6b/d92/d99/cd2 0 2024-09-13T21:40:49.058 INFO:tasks.workunit.client.1.smithi116.stdout:8/726: dread d2/d27/d62/f7b [0,4194304] 0 2024-09-13T21:40:49.059 INFO:tasks.workunit.client.1.smithi116.stdout:8/727: symlink d2/d10/d19/d3a/d4c/lda 0 2024-09-13T21:40:49.061 INFO:tasks.workunit.client.1.smithi116.stdout:8/728: rmdir d2/d10/d37/d64/dd6 0 2024-09-13T21:40:49.061 INFO:tasks.workunit.client.1.smithi116.stdout:8/729: dread - d2/d5c/f85 zero size 2024-09-13T21:40:49.063 INFO:tasks.workunit.client.1.smithi116.stdout:6/787: sync 2024-09-13T21:40:49.063 INFO:tasks.workunit.client.1.smithi116.stdout:0/859: sync 2024-09-13T21:40:49.063 INFO:tasks.workunit.client.1.smithi116.stdout:6/788: rename d8 to d8/d17/d70/da0/d10f 22 2024-09-13T21:40:49.064 INFO:tasks.workunit.client.1.smithi116.stdout:0/860: unlink d2/dc/d12/l8f 0 2024-09-13T21:40:49.064 INFO:tasks.workunit.client.1.smithi116.stdout:0/861: write d2/dc/d12/f49 [537113,6519] 0 2024-09-13T21:40:49.066 INFO:tasks.workunit.client.1.smithi116.stdout:6/789: rename d8/d10/d78 to d8/d10/d24/d110 0 2024-09-13T21:40:49.068 INFO:tasks.workunit.client.1.smithi116.stdout:2/643: dread d0/d7/f12 [4194304,4194304] 0 2024-09-13T21:40:49.068 INFO:tasks.workunit.client.1.smithi116.stdout:8/730: getdents d2/d10/d37/d64 0 2024-09-13T21:40:49.069 INFO:tasks.workunit.client.1.smithi116.stdout:8/731: fsync d2/f2f 0 2024-09-13T21:40:49.070 INFO:tasks.workunit.client.1.smithi116.stdout:6/790: mknod d8/d17/d70/c111 0 2024-09-13T21:40:49.071 INFO:tasks.workunit.client.1.smithi116.stdout:2/644: mkdir d0/d5/d8/dd2 0 2024-09-13T21:40:49.071 INFO:tasks.workunit.client.1.smithi116.stdout:2/645: fsync d0/d3a/d82/d62/d1f/fa3 0 2024-09-13T21:40:49.073 INFO:tasks.workunit.client.1.smithi116.stdout:6/791: rename d8/dca to d8/d15/d2e/d2f/d38/d112 0 2024-09-13T21:40:49.073 INFO:tasks.workunit.client.1.smithi116.stdout:6/792: read - d8/d17/de0/fed zero size 2024-09-13T21:40:49.074 INFO:tasks.workunit.client.1.smithi116.stdout:0/862: dread d2/dc/d47/f70 [0,4194304] 0 2024-09-13T21:40:49.074 INFO:tasks.workunit.client.1.smithi116.stdout:4/685: dwrite d0/dd/d13/f3c [4194304,4194304] 0 2024-09-13T21:40:49.074 INFO:tasks.workunit.client.1.smithi116.stdout:4/686: fdatasync d0/f10 0 2024-09-13T21:40:49.075 INFO:tasks.workunit.client.1.smithi116.stdout:6/793: rename d8/d15/d2e/d2f/d57 to d8/d17/d70/da0/daf/d113 0 2024-09-13T21:40:49.075 INFO:tasks.workunit.client.1.smithi116.stdout:6/794: fsync d8/d17/d70/da0/daf/fc1 0 2024-09-13T21:40:49.078 INFO:tasks.workunit.client.1.smithi116.stdout:4/687: mknod d0/dd/d13/d5a/dc4/dc8/cd3 0 2024-09-13T21:40:49.080 INFO:tasks.workunit.client.1.smithi116.stdout:6/795: rmdir d8/d15/d2e/d2f/d38/d112/df4/dfc 0 2024-09-13T21:40:49.082 INFO:tasks.workunit.client.1.smithi116.stdout:0/863: link d2/dc/dcf/lec d2/d5/d61/l118 0 2024-09-13T21:40:49.083 INFO:tasks.workunit.client.1.smithi116.stdout:8/732: write d2/d10/f31 [2342986,97590] 0 2024-09-13T21:40:49.083 INFO:tasks.workunit.client.1.smithi116.stdout:8/733: truncate d2/d10/f18 4679998 0 2024-09-13T21:40:49.083 INFO:tasks.workunit.client.1.smithi116.stdout:8/734: chown d2/d10/d19/d42/d45/c8d 0 1 2024-09-13T21:40:49.083 INFO:tasks.workunit.client.1.smithi116.stdout:4/688: getdents d0/dd/d6b/d71 0 2024-09-13T21:40:49.085 INFO:tasks.workunit.client.1.smithi116.stdout:0/864: link d2/dc/d12/f49 d2/dc/d12/d51/d62/f119 0 2024-09-13T21:40:49.086 INFO:tasks.workunit.client.1.smithi116.stdout:8/735: getdents d2/d27 0 2024-09-13T21:40:49.088 INFO:tasks.workunit.client.1.smithi116.stdout:4/689: mkdir d0/dad/dd4 0 2024-09-13T21:40:49.091 INFO:tasks.workunit.client.1.smithi116.stdout:2/646: dwrite d0/d3a/d82/d62/d1f/d5d/d72/daa/fcc [0,4194304] 0 2024-09-13T21:40:49.092 INFO:tasks.workunit.client.1.smithi116.stdout:0/865: symlink d2/dc/d12/d28/d57/de3/l11a 0 2024-09-13T21:40:49.092 INFO:tasks.workunit.client.1.smithi116.stdout:0/866: chown d2/dc/f31 22067 1 2024-09-13T21:40:49.093 INFO:tasks.workunit.client.1.smithi116.stdout:6/796: dread d8/f87 [0,4194304] 0 2024-09-13T21:40:49.094 INFO:tasks.workunit.client.1.smithi116.stdout:4/690: mkdir d0/dd/d13/d5a/d86/dd5 0 2024-09-13T21:40:49.094 INFO:tasks.workunit.client.1.smithi116.stdout:4/691: chown d0/dad/cd0 4553 1 2024-09-13T21:40:49.094 INFO:tasks.workunit.client.1.smithi116.stdout:4/692: read - d0/d32/d5f/f82 zero size 2024-09-13T21:40:49.096 INFO:tasks.workunit.client.1.smithi116.stdout:2/647: mknod d0/d3a/d82/d62/d1f/d5d/cd3 0 2024-09-13T21:40:49.096 INFO:tasks.workunit.client.1.smithi116.stdout:0/867: symlink d2/dc/d12/d28/l11b 0 2024-09-13T21:40:49.097 INFO:tasks.workunit.client.1.smithi116.stdout:0/868: chown d2/dc/d12/d28/f74 1778 1 2024-09-13T21:40:49.097 INFO:tasks.workunit.client.1.smithi116.stdout:6/797: creat d8/d15/d2e/d2f/d38/d112/f114 x:0 0 0 2024-09-13T21:40:49.098 INFO:tasks.workunit.client.1.smithi116.stdout:4/693: creat d0/dad/fd6 x:0 0 0 2024-09-13T21:40:49.100 INFO:tasks.workunit.client.1.smithi116.stdout:2/648: mknod d0/d7/d2b/db6/cd4 0 2024-09-13T21:40:49.100 INFO:tasks.workunit.client.1.smithi116.stdout:2/649: read - d0/d3a/d82/d62/f9d zero size 2024-09-13T21:40:49.102 INFO:tasks.workunit.client.1.smithi116.stdout:6/798: truncate d8/d15/f92 433975 0 2024-09-13T21:40:49.102 INFO:tasks.workunit.client.1.smithi116.stdout:6/799: truncate d8/d17/d70/ffe 447173 0 2024-09-13T21:40:49.102 INFO:tasks.workunit.client.1.smithi116.stdout:6/800: fsync d8/f99 0 2024-09-13T21:40:49.102 INFO:tasks.workunit.client.1.smithi116.stdout:6/801: truncate d8/db5/fec 844162 0 2024-09-13T21:40:49.104 INFO:tasks.workunit.client.1.smithi116.stdout:4/694: unlink d0/dd/cb8 0 2024-09-13T21:40:49.104 INFO:tasks.workunit.client.1.smithi116.stdout:4/695: chown d0/c33 316 1 2024-09-13T21:40:49.106 INFO:tasks.workunit.client.1.smithi116.stdout:8/736: dwrite d2/d10/d19/d97/fb3 [0,4194304] 0 2024-09-13T21:40:49.106 INFO:tasks.workunit.client.1.smithi116.stdout:8/737: write d2/d27/d66/d7c/fc2 [94750,96183] 0 2024-09-13T21:40:49.108 INFO:tasks.workunit.client.1.smithi116.stdout:6/802: mkdir d8/d10c/d115 0 2024-09-13T21:40:49.108 INFO:tasks.workunit.client.1.smithi116.stdout:6/803: readlink d8/d15/d2e/d2f/d38/d112/lcb 0 2024-09-13T21:40:49.110 INFO:tasks.workunit.client.1.smithi116.stdout:4/696: rename d0/d32/l44 to d0/d32/da3/db7/ld7 0 2024-09-13T21:40:49.114 INFO:tasks.workunit.client.1.smithi116.stdout:6/804: unlink d8/d17/fd8 0 2024-09-13T21:40:49.114 INFO:tasks.workunit.client.1.smithi116.stdout:6/805: readlink d8/d15/d2e/d2f/l4b 0 2024-09-13T21:40:49.118 INFO:tasks.workunit.client.1.smithi116.stdout:4/697: creat d0/dd/d13/d5a/d86/dd5/fd8 x:0 0 0 2024-09-13T21:40:49.119 INFO:tasks.workunit.client.1.smithi116.stdout:6/806: rename d8/d15/d2e/d2f/d38/ce3 to d8/d10/d33/c116 0 2024-09-13T21:40:49.122 INFO:tasks.workunit.client.1.smithi116.stdout:6/807: rename d8/d17/f82 to d8/d15/d2e/f117 0 2024-09-13T21:40:49.123 INFO:tasks.workunit.client.1.smithi116.stdout:0/869: dwrite d2/d5/f7e [0,4194304] 0 2024-09-13T21:40:49.123 INFO:tasks.workunit.client.1.smithi116.stdout:2/650: dwrite d0/d5/d8/fc4 [0,4194304] 0 2024-09-13T21:40:49.132 INFO:tasks.workunit.client.1.smithi116.stdout:4/698: dread d0/dd/f60 [0,4194304] 0 2024-09-13T21:40:49.133 INFO:tasks.workunit.client.1.smithi116.stdout:0/870: write d2/d5/f7e [2273624,38517] 0 2024-09-13T21:40:49.134 INFO:tasks.workunit.client.1.smithi116.stdout:2/651: link d0/d5/d2a/c40 d0/d5/d8/cd5 0 2024-09-13T21:40:49.134 INFO:tasks.workunit.client.1.smithi116.stdout:2/652: read - d0/d5/d8/f39 zero size 2024-09-13T21:40:49.135 INFO:tasks.workunit.client.1.smithi116.stdout:4/699: creat d0/dd/d7c/fd9 x:0 0 0 2024-09-13T21:40:49.137 INFO:tasks.workunit.client.1.smithi116.stdout:2/653: getdents d0/d5/d2a 0 2024-09-13T21:40:49.140 INFO:tasks.workunit.client.1.smithi116.stdout:6/808: dwrite d8/d15/d2e/d2f/d38/f45 [0,4194304] 0 2024-09-13T21:40:49.169 INFO:tasks.workunit.client.1.smithi116.stdout:4/700: dwrite d0/dd/d6b/d92/fa2 [0,4194304] 0 2024-09-13T21:40:49.169 INFO:tasks.workunit.client.1.smithi116.stdout:0/871: dwrite d2/d5/f34 [0,4194304] 0 2024-09-13T21:40:49.169 INFO:tasks.workunit.client.1.smithi116.stdout:2/654: dwrite d0/d7/f6e [0,4194304] 0 2024-09-13T21:40:49.169 INFO:tasks.workunit.client.1.smithi116.stdout:6/809: dwrite d8/d1e/ff3 [0,4194304] 0 2024-09-13T21:40:49.171 INFO:tasks.workunit.client.1.smithi116.stdout:4/701: creat d0/d32/d5d/d85/fda x:0 0 0 2024-09-13T21:40:49.171 INFO:tasks.workunit.client.1.smithi116.stdout:4/702: read d0/f3a [2065267,127428] 0 2024-09-13T21:40:49.171 INFO:tasks.workunit.client.1.smithi116.stdout:0/872: rmdir d2/dc/d47/d63/d9f/dad 39 2024-09-13T21:40:49.173 INFO:tasks.workunit.client.1.smithi116.stdout:2/655: symlink d0/d3a/d82/d62/d75/dcb/ld6 0 2024-09-13T21:40:49.176 INFO:tasks.workunit.client.1.smithi116.stdout:2/656: creat d0/d3a/d82/d62/d1f/d5d/d89/fd7 x:0 0 0 2024-09-13T21:40:49.180 INFO:tasks.workunit.client.1.smithi116.stdout:2/657: write d0/d7/f1e [746005,31216] 0 2024-09-13T21:40:49.182 INFO:tasks.workunit.client.1.smithi116.stdout:2/658: creat d0/d7/d86/dd1/fd8 x:0 0 0 2024-09-13T21:40:49.182 INFO:tasks.workunit.client.1.smithi116.stdout:2/659: readlink d0/d5/d8/l18 0 2024-09-13T21:40:49.182 INFO:tasks.workunit.client.1.smithi116.stdout:4/703: dread d0/fa1 [0,4194304] 0 2024-09-13T21:40:49.182 INFO:tasks.workunit.client.1.smithi116.stdout:2/660: write d0/d7/d2d/faf [454493,105220] 0 2024-09-13T21:40:49.182 INFO:tasks.workunit.client.1.smithi116.stdout:4/704: creat d0/dd/d48/fdb x:0 0 0 2024-09-13T21:40:49.183 INFO:tasks.workunit.client.1.smithi116.stdout:4/705: write d0/dd/d48/f94 [4932070,88449] 0 2024-09-13T21:40:49.183 INFO:tasks.workunit.client.1.smithi116.stdout:2/661: mknod d0/d3a/d82/d62/d1f/d5d/d72/cd9 0 2024-09-13T21:40:49.185 INFO:tasks.workunit.client.1.smithi116.stdout:2/662: symlink d0/d5/d8/lda 0 2024-09-13T21:40:49.186 INFO:tasks.workunit.client.1.smithi116.stdout:6/810: dwrite d8/d15/f86 [0,4194304] 0 2024-09-13T21:40:49.187 INFO:tasks.workunit.client.1.smithi116.stdout:4/706: dread d0/dd/f60 [0,4194304] 0 2024-09-13T21:40:49.187 INFO:tasks.workunit.client.1.smithi116.stdout:6/811: creat d8/d10/d24/d110/de2/f118 x:0 0 0 2024-09-13T21:40:49.189 INFO:tasks.workunit.client.1.smithi116.stdout:6/812: symlink d8/d15/d2e/d2f/d38/d112/l119 0 2024-09-13T21:40:49.189 INFO:tasks.workunit.client.1.smithi116.stdout:6/813: write d8/d15/d2e/ff2 [219064,100619] 0 2024-09-13T21:40:49.189 INFO:tasks.workunit.client.1.smithi116.stdout:6/814: chown d8/d15/d2e/d2f/d38 13182107 1 2024-09-13T21:40:49.189 INFO:tasks.workunit.client.1.smithi116.stdout:2/663: dread d0/d3a/d82/d62/d75/d77/f99 [0,4194304] 0 2024-09-13T21:40:49.190 INFO:tasks.workunit.client.1.smithi116.stdout:4/707: getdents d0/dd/d7c 0 2024-09-13T21:40:49.192 INFO:tasks.workunit.client.1.smithi116.stdout:2/664: dread d0/fae [0,4194304] 0 2024-09-13T21:40:49.193 INFO:tasks.workunit.client.1.smithi116.stdout:2/665: write d0/d5/d8/d7a/fbc [999368,118433] 0 2024-09-13T21:40:49.193 INFO:tasks.workunit.client.1.smithi116.stdout:2/666: chown d0/d5/d8/c19 874361862 1 2024-09-13T21:40:49.193 INFO:tasks.workunit.client.1.smithi116.stdout:4/708: dread d0/fa1 [0,4194304] 0 2024-09-13T21:40:49.193 INFO:tasks.workunit.client.1.smithi116.stdout:2/667: mkdir d0/d3a/d82/ddb 0 2024-09-13T21:40:49.193 INFO:tasks.workunit.client.1.smithi116.stdout:4/709: fdatasync d0/d56/d57/fa0 0 2024-09-13T21:40:49.194 INFO:tasks.workunit.client.1.smithi116.stdout:2/668: rmdir d0/d7/d2b 39 2024-09-13T21:40:49.197 INFO:tasks.workunit.client.1.smithi116.stdout:2/669: mkdir d0/d3a/d82/d62/d1f/d5d/d89/ddc 0 2024-09-13T21:40:49.197 INFO:tasks.workunit.client.1.smithi116.stdout:2/670: read d0/d7/f24 [1462485,108574] 0 2024-09-13T21:40:49.198 INFO:tasks.workunit.client.1.smithi116.stdout:6/815: dread d8/d10/d33/f4a [0,4194304] 0 2024-09-13T21:40:49.200 INFO:tasks.workunit.client.1.smithi116.stdout:6/816: mknod d8/d10/d24/d110/c11a 0 2024-09-13T21:40:49.200 INFO:tasks.workunit.client.1.smithi116.stdout:6/817: write d8/d17/d70/f7c [6479132,19359] 0 2024-09-13T21:40:49.203 INFO:tasks.workunit.client.1.smithi116.stdout:6/818: getdents d8/d17/d70 0 2024-09-13T21:40:49.205 INFO:tasks.workunit.client.1.smithi116.stdout:6/819: creat d8/d15/d2e/d2f/d38/d112/df4/f11b x:0 0 0 2024-09-13T21:40:49.226 INFO:tasks.workunit.client.1.smithi116.stdout:6/820: dwrite d8/d15/fa2 [0,4194304] 0 2024-09-13T21:40:49.226 INFO:tasks.workunit.client.1.smithi116.stdout:2/671: dwrite d0/d7/f1e [4194304,4194304] 0 2024-09-13T21:40:49.226 INFO:tasks.workunit.client.1.smithi116.stdout:2/672: stat d0/d3a/d82/d62/d1f 0 2024-09-13T21:40:49.228 INFO:tasks.workunit.client.1.smithi116.stdout:6/821: dread d8/d17/d70/da0/daf/d113/f72 [4194304,4194304] 0 2024-09-13T21:40:49.228 INFO:tasks.workunit.client.1.smithi116.stdout:2/673: rmdir d0/d7/d2b/db6 39 2024-09-13T21:40:49.229 INFO:tasks.workunit.client.1.smithi116.stdout:2/674: write d0/d7/d49/f90 [784261,71048] 0 2024-09-13T21:40:49.230 INFO:tasks.workunit.client.1.smithi116.stdout:6/822: unlink d8/d1e/lda 0 2024-09-13T21:40:49.231 INFO:tasks.workunit.client.1.smithi116.stdout:2/675: symlink d0/d3a/d82/d62/d1f/d5d/d89/ddc/ldd 0 2024-09-13T21:40:49.233 INFO:tasks.workunit.client.1.smithi116.stdout:2/676: rename d0/d7/d2d/f56 to d0/d7/d2d/fde 0 2024-09-13T21:40:49.233 INFO:tasks.workunit.client.1.smithi116.stdout:6/823: dread d8/d10/d33/f3b [0,4194304] 0 2024-09-13T21:40:49.237 INFO:tasks.workunit.client.1.smithi116.stdout:3/842: sync 2024-09-13T21:40:49.237 INFO:tasks.workunit.client.1.smithi116.stdout:1/613: sync 2024-09-13T21:40:49.238 INFO:tasks.workunit.client.1.smithi116.stdout:2/677: dread d0/d3a/d82/d62/d1f/d5d/d89/f9c [0,4194304] 0 2024-09-13T21:40:49.239 INFO:tasks.workunit.client.1.smithi116.stdout:1/614: unlink d4/f10 0 2024-09-13T21:40:49.241 INFO:tasks.workunit.client.1.smithi116.stdout:3/843: rename d3/c7 to d3/db/d10/d1d/d2f/c12b 0 2024-09-13T21:40:49.243 INFO:tasks.workunit.client.1.smithi116.stdout:6/824: write d8/d15/d2e/d2f/d38/f89 [3831506,746] 0 2024-09-13T21:40:49.243 INFO:tasks.workunit.client.1.smithi116.stdout:1/615: creat d4/d14/d52/d2f/d5c/fd8 x:0 0 0 2024-09-13T21:40:49.244 INFO:tasks.workunit.client.1.smithi116.stdout:3/844: mknod d3/db/d20/d86/c12c 0 2024-09-13T21:40:49.244 INFO:tasks.workunit.client.1.smithi116.stdout:3/845: chown d3/db/d10/d1c/d34/d47 1874957 1 2024-09-13T21:40:49.244 INFO:tasks.workunit.client.1.smithi116.stdout:2/678: dread d0/d7/d2b/f3e [0,4194304] 0 2024-09-13T21:40:49.244 INFO:tasks.workunit.client.1.smithi116.stdout:2/679: truncate d0/d5/d8/d7a/f7f 1083492 0 2024-09-13T21:40:49.245 INFO:tasks.workunit.client.1.smithi116.stdout:1/616: rename d4/d23/d57/ca8 to d4/d14/d52/d2f/d5c/daf/dc3/cd9 0 2024-09-13T21:40:49.245 INFO:tasks.workunit.client.1.smithi116.stdout:3/846: mknod d3/df9/d127/c12d 0 2024-09-13T21:40:49.246 INFO:tasks.workunit.client.1.smithi116.stdout:6/825: mkdir d8/d11c 0 2024-09-13T21:40:49.247 INFO:tasks.workunit.client.1.smithi116.stdout:1/617: unlink d4/d74/d8d/l84 0 2024-09-13T21:40:49.249 INFO:tasks.workunit.client.1.smithi116.stdout:6/826: mknod d8/d15/c11d 0 2024-09-13T21:40:49.250 INFO:tasks.workunit.client.1.smithi116.stdout:1/618: mknod d4/d23/d56/da3/dc4/cda 0 2024-09-13T21:40:49.250 INFO:tasks.workunit.client.1.smithi116.stdout:2/680: dread d0/d3a/f9b [0,4194304] 0 2024-09-13T21:40:49.251 INFO:tasks.workunit.client.1.smithi116.stdout:3/847: mkdir d3/db/d10/d1d/d2f/d61/d12e 0 2024-09-13T21:40:49.251 INFO:tasks.workunit.client.1.smithi116.stdout:3/848: creat d3/db/d10/f12f x:0 0 0 2024-09-13T21:40:49.251 INFO:tasks.workunit.client.1.smithi116.stdout:3/849: readlink d3/db/d10/d1c/l8c 0 2024-09-13T21:40:49.251 INFO:tasks.workunit.client.1.smithi116.stdout:6/827: creat d8/d17/da6/df8/f11e x:0 0 0 2024-09-13T21:40:49.252 INFO:tasks.workunit.client.1.smithi116.stdout:2/681: dread d0/d5/d8/d7a/f7f [0,4194304] 0 2024-09-13T21:40:49.253 INFO:tasks.workunit.client.1.smithi116.stdout:3/850: creat d3/db/d10/d1d/d5f/d6f/f130 x:0 0 0 2024-09-13T21:40:49.253 INFO:tasks.workunit.client.1.smithi116.stdout:3/851: readlink d3/db/d10/d1d/d5f/d6f/l7b 0 2024-09-13T21:40:49.253 INFO:tasks.workunit.client.1.smithi116.stdout:3/852: truncate d3/db/d10/d1d/d5f/d6f/f80 1777508 0 2024-09-13T21:40:49.253 INFO:tasks.workunit.client.1.smithi116.stdout:6/828: creat d8/f11f x:0 0 0 2024-09-13T21:40:49.253 INFO:tasks.workunit.client.1.smithi116.stdout:6/829: chown d8/d15/d2e/d2f/fc8 259656687 1 2024-09-13T21:40:49.254 INFO:tasks.workunit.client.1.smithi116.stdout:2/682: mkdir d0/d3a/d82/d62/ddf 0 2024-09-13T21:40:49.255 INFO:tasks.workunit.client.1.smithi116.stdout:3/853: mknod d3/db/d10/d29/c131 0 2024-09-13T21:40:49.255 INFO:tasks.workunit.client.1.smithi116.stdout:2/683: symlink d0/d7/d2d/le0 0 2024-09-13T21:40:49.263 INFO:tasks.workunit.client.1.smithi116.stdout:6/830: dread d8/f2c [0,4194304] 0 2024-09-13T21:40:49.263 INFO:tasks.workunit.client.1.smithi116.stdout:6/831: write d8/d15/d2e/d2f/d38/f45 [4869150,54903] 0 2024-09-13T21:40:49.265 INFO:tasks.workunit.client.1.smithi116.stdout:6/832: symlink d8/d15/d2e/d9e/de9/l120 0 2024-09-13T21:40:49.265 INFO:tasks.workunit.client.1.smithi116.stdout:6/833: stat d8/d15/d2e/f100 0 2024-09-13T21:40:49.266 INFO:tasks.workunit.client.1.smithi116.stdout:6/834: write d8/d10/d24/d110/ffb [425670,84498] 0 2024-09-13T21:40:49.266 INFO:tasks.workunit.client.1.smithi116.stdout:6/835: rmdir d8/d15/d2e/d2f/d38/d112/df4 39 2024-09-13T21:40:49.267 INFO:tasks.workunit.client.1.smithi116.stdout:6/836: symlink d8/d10/d24/d110/l121 0 2024-09-13T21:40:49.267 INFO:tasks.workunit.client.1.smithi116.stdout:6/837: read d8/d10/d33/fba [116468,29512] 0 2024-09-13T21:40:49.268 INFO:tasks.workunit.client.1.smithi116.stdout:6/838: symlink d8/d17/d70/da0/l122 0 2024-09-13T21:40:49.268 INFO:tasks.workunit.client.1.smithi116.stdout:6/839: truncate d8/d15/d2e/d2f/d38/f89 4601280 0 2024-09-13T21:40:49.268 INFO:tasks.workunit.client.1.smithi116.stdout:6/840: chown d8/d15/d2e/d2f/d38/d112/lcb 478 1 2024-09-13T21:40:49.268 INFO:tasks.workunit.client.1.smithi116.stdout:6/841: readlink d8/d15/d2e/d2f/d38/d112/ldb 0 2024-09-13T21:40:49.268 INFO:tasks.workunit.client.1.smithi116.stdout:6/842: creat d8/d1e/dbb/f123 x:0 0 0 2024-09-13T21:40:49.271 INFO:tasks.workunit.client.1.smithi116.stdout:1/619: dwrite d4/d23/f27 [0,4194304] 0 2024-09-13T21:40:49.273 INFO:tasks.workunit.client.1.smithi116.stdout:2/684: dwrite d0/d7/d2b/f3e [0,4194304] 0 2024-09-13T21:40:49.274 INFO:tasks.workunit.client.1.smithi116.stdout:1/620: link d4/d14/d52/d2f/f4b d4/d14/d52/d2f/d5c/daf/fdb 0 2024-09-13T21:40:49.293 INFO:tasks.workunit.client.1.smithi116.stdout:6/843: dwrite d8/d15/f1f [4194304,4194304] 0 2024-09-13T21:40:49.293 INFO:tasks.workunit.client.1.smithi116.stdout:1/621: dwrite d4/d14/f1d [0,4194304] 0 2024-09-13T21:40:49.294 INFO:tasks.workunit.client.1.smithi116.stdout:6/844: creat d8/d17/d70/da0/f124 x:0 0 0 2024-09-13T21:40:49.295 INFO:tasks.workunit.client.1.smithi116.stdout:1/622: symlink d4/d14/ldc 0 2024-09-13T21:40:49.295 INFO:tasks.workunit.client.1.smithi116.stdout:1/623: fdatasync d4/d14/db0/fbb 0 2024-09-13T21:40:49.296 INFO:tasks.workunit.client.1.smithi116.stdout:6/845: unlink d8/d10/d33/f3b 0 2024-09-13T21:40:49.296 INFO:tasks.workunit.client.1.smithi116.stdout:6/846: getdents d8/d17/d70/d105 0 2024-09-13T21:40:49.296 INFO:tasks.workunit.client.1.smithi116.stdout:6/847: dread - d8/d1e/fdf zero size 2024-09-13T21:40:49.297 INFO:tasks.workunit.client.1.smithi116.stdout:1/624: symlink d4/d14/d2a/ldd 0 2024-09-13T21:40:49.297 INFO:tasks.workunit.client.1.smithi116.stdout:6/848: creat d8/d10/f125 x:0 0 0 2024-09-13T21:40:49.298 INFO:tasks.workunit.client.1.smithi116.stdout:6/849: mknod d8/d17/da6/df8/c126 0 2024-09-13T21:40:49.321 INFO:tasks.workunit.client.1.smithi116.stdout:6/850: dwrite d8/d15/d2e/f117 [0,4194304] 0 2024-09-13T21:40:49.322 INFO:tasks.workunit.client.1.smithi116.stdout:1/625: dwrite d4/d74/d8d/f55 [0,4194304] 0 2024-09-13T21:40:49.330 INFO:tasks.workunit.client.1.smithi116.stdout:6/851: dread d8/d15/f86 [0,4194304] 0 2024-09-13T21:40:49.332 INFO:tasks.workunit.client.1.smithi116.stdout:6/852: getdents d8/d10/d33 0 2024-09-13T21:40:49.333 INFO:tasks.workunit.client.1.smithi116.stdout:6/853: truncate d8/d17/d70/fb2 5122251 0 2024-09-13T21:40:49.333 INFO:tasks.workunit.client.1.smithi116.stdout:6/854: truncate d8/d15/d2e/f7e 451349 0 2024-09-13T21:40:49.333 INFO:tasks.workunit.client.1.smithi116.stdout:6/855: write d8/d15/d2e/d2f/d38/d9c/ff7 [288116,20958] 0 2024-09-13T21:40:49.334 INFO:tasks.workunit.client.1.smithi116.stdout:6/856: read d8/d15/d2e/fa5 [91207,97221] 0 2024-09-13T21:40:49.334 INFO:tasks.workunit.client.1.smithi116.stdout:6/857: symlink d8/d17/d70/da0/daf/ddd/l127 0 2024-09-13T21:40:49.335 INFO:tasks.workunit.client.1.smithi116.stdout:9/522: sync 2024-09-13T21:40:49.335 INFO:tasks.workunit.client.1.smithi116.stdout:7/837: sync 2024-09-13T21:40:49.335 INFO:tasks.workunit.client.1.smithi116.stdout:5/898: sync 2024-09-13T21:40:49.335 INFO:tasks.workunit.client.1.smithi116.stdout:9/523: chown d2/d10/d14/d38/f4f 59194995 1 2024-09-13T21:40:49.335 INFO:tasks.workunit.client.1.smithi116.stdout:5/899: chown d7/fc 0 1 2024-09-13T21:40:49.336 INFO:tasks.workunit.client.1.smithi116.stdout:9/524: truncate d2/d10/d4c/f51 1038456 0 2024-09-13T21:40:49.336 INFO:tasks.workunit.client.1.smithi116.stdout:5/900: fdatasync d7/d1d/d64/d94/feb 0 2024-09-13T21:40:49.336 INFO:tasks.workunit.client.1.smithi116.stdout:7/838: rename d5/d9/db/d21/d6e/d6f/faf to d5/d9/d27/ded/d22/d24/d6b/d72/d74/f115 0 2024-09-13T21:40:49.340 INFO:tasks.workunit.client.1.smithi116.stdout:5/901: unlink d7/d1d/d64/lff 0 2024-09-13T21:40:49.344 INFO:tasks.workunit.client.1.smithi116.stdout:6/858: dread d8/d15/fa2 [0,4194304] 0 2024-09-13T21:40:49.344 INFO:tasks.workunit.client.1.smithi116.stdout:6/859: creat d8/d15/d2e/d2f/d38/d9c/f128 x:0 0 0 2024-09-13T21:40:49.345 INFO:tasks.workunit.client.1.smithi116.stdout:6/860: mkdir d8/d10c/d115/d129 0 2024-09-13T21:40:49.372 INFO:tasks.workunit.client.1.smithi116.stdout:7/839: dwrite d5/d9/d27/d31/d38/d48/f77 [0,4194304] 0 2024-09-13T21:40:49.373 INFO:tasks.workunit.client.1.smithi116.stdout:7/840: mknod d5/d9/d27/d31/d38/d42/c116 0 2024-09-13T21:40:49.373 INFO:tasks.workunit.client.1.smithi116.stdout:7/841: chown d5/d9/d27/c73 3012 1 2024-09-13T21:40:49.374 INFO:tasks.workunit.client.1.smithi116.stdout:7/842: getdents d5/d9/d27/ded/d22/d24/d3a 0 2024-09-13T21:40:49.376 INFO:tasks.workunit.client.1.smithi116.stdout:7/843: mkdir d5/d9/db/d21/d6e/d6f/d70/d117 0 2024-09-13T21:40:49.376 INFO:tasks.workunit.client.1.smithi116.stdout:9/525: dwrite d2/d10/d14/d38/f6b [0,4194304] 0 2024-09-13T21:40:49.377 INFO:tasks.workunit.client.1.smithi116.stdout:7/844: mknod d5/d9/db/d21/c118 0 2024-09-13T21:40:49.377 INFO:tasks.workunit.client.1.smithi116.stdout:7/845: chown d5/d9/f51 1507 1 2024-09-13T21:40:49.377 INFO:tasks.workunit.client.1.smithi116.stdout:5/902: dwrite d7/f2f [0,4194304] 0 2024-09-13T21:40:49.378 INFO:tasks.workunit.client.1.smithi116.stdout:9/526: link d2/d5d/d69/d47/f7b d2/d10/d4c/f99 0 2024-09-13T21:40:49.378 INFO:tasks.workunit.client.1.smithi116.stdout:9/527: dread - d2/d10/f52 zero size 2024-09-13T21:40:49.379 INFO:tasks.workunit.client.1.smithi116.stdout:7/846: truncate d5/f5e 47297 0 2024-09-13T21:40:49.379 INFO:tasks.workunit.client.1.smithi116.stdout:7/847: fdatasync d5/d9/d27/ded/d22/d24/d5f/f107 0 2024-09-13T21:40:49.382 INFO:tasks.workunit.client.1.smithi116.stdout:5/903: mknod d7/d9a/c12b 0 2024-09-13T21:40:49.384 INFO:tasks.workunit.client.1.smithi116.stdout:7/848: rename d5/d9/d27/d31/d38/d42/l85 to d5/d9/d27/ded/d37/l119 0 2024-09-13T21:40:49.384 INFO:tasks.workunit.client.1.smithi116.stdout:7/849: dread - d5/d9/d27/ded/d22/d24/d5f/fc6 zero size 2024-09-13T21:40:49.384 INFO:tasks.workunit.client.1.smithi116.stdout:5/904: chown d7/d1d/d46/d85/d96 1772664 1 2024-09-13T21:40:49.385 INFO:tasks.workunit.client.1.smithi116.stdout:5/905: creat d7/d1d/d64/d87/f12c x:0 0 0 2024-09-13T21:40:49.386 INFO:tasks.workunit.client.1.smithi116.stdout:7/850: creat d5/d9/d27/d31/d105/f11a x:0 0 0 2024-09-13T21:40:49.391 INFO:tasks.workunit.client.1.smithi116.stdout:7/851: dread d5/d9/db/d21/d6e/d6f/d70/f84 [0,4194304] 0 2024-09-13T21:40:49.391 INFO:tasks.workunit.client.1.smithi116.stdout:7/852: chown d5/d9/db/da3/fe8 3040545 1 2024-09-13T21:40:49.391 INFO:tasks.workunit.client.1.smithi116.stdout:7/853: write d5/d9/d27/ded/d22/fda [412004,42259] 0 2024-09-13T21:40:49.392 INFO:tasks.workunit.client.1.smithi116.stdout:7/854: mkdir d5/d9/d27/ded/d22/d24/d6b/d72/d74/d93/d11b 0 2024-09-13T21:40:49.392 INFO:tasks.workunit.client.1.smithi116.stdout:7/855: creat d5/d9/d27/ded/d2e/d52/f11c x:0 0 0 2024-09-13T21:40:49.392 INFO:tasks.workunit.client.1.smithi116.stdout:5/906: dread d7/f3f [0,4194304] 0 2024-09-13T21:40:49.392 INFO:tasks.workunit.client.1.smithi116.stdout:5/907: getdents d7/d1d/d46/d85/d96/dd6/d128 0 2024-09-13T21:40:49.393 INFO:tasks.workunit.client.1.smithi116.stdout:7/856: getdents d5/d9/d27/ded/d22/d24/d6b 0 2024-09-13T21:40:49.394 INFO:tasks.workunit.client.1.smithi116.stdout:5/908: creat d7/d1d/d46/d85/d96/da8/df0/f12d x:0 0 0 2024-09-13T21:40:49.395 INFO:tasks.workunit.client.1.smithi116.stdout:7/857: mkdir d5/d9/d27/ded/d2e/d11d 0 2024-09-13T21:40:49.396 INFO:tasks.workunit.client.1.smithi116.stdout:5/909: creat d7/d1d/d46/d85/d96/dd6/dd8/f12e x:0 0 0 2024-09-13T21:40:49.397 INFO:tasks.workunit.client.1.smithi116.stdout:7/858: symlink d5/d9/d27/l11e 0 2024-09-13T21:40:49.398 INFO:tasks.workunit.client.1.smithi116.stdout:7/859: dread d5/d9/d27/ded/d22/d24/d6b/d72/fa5 [0,4194304] 0 2024-09-13T21:40:49.399 INFO:tasks.workunit.client.1.smithi116.stdout:7/860: symlink d5/d9/db/d21/d6e/d6f/d70/d80/db1/l11f 0 2024-09-13T21:40:49.399 INFO:tasks.workunit.client.1.smithi116.stdout:7/861: creat d5/d9/d27/ded/d22/d24/d5f/f120 x:0 0 0 2024-09-13T21:40:49.399 INFO:tasks.workunit.client.1.smithi116.stdout:7/862: readlink d5/d9/d27/d31/lbd 0 2024-09-13T21:40:49.403 INFO:tasks.workunit.client.1.smithi116.stdout:7/863: dread d5/db0/fce [0,4194304] 0 2024-09-13T21:40:49.403 INFO:tasks.workunit.client.1.smithi116.stdout:7/864: truncate d5/d9/db/d21/d6e/d6f/d70/f84 4994351 0 2024-09-13T21:40:49.403 INFO:tasks.workunit.client.1.smithi116.stdout:7/865: rmdir d5/d9/d27/ded/d22/d24 39 2024-09-13T21:40:49.404 INFO:tasks.workunit.client.1.smithi116.stdout:7/866: creat d5/d9/d27/ded/d22/d24/d6b/d72/d74/f121 x:0 0 0 2024-09-13T21:40:49.408 INFO:tasks.workunit.client.1.smithi116.stdout:7/867: fsync d5/d9/d27/ded/d22/d24/d6b/d72/d74/f121 0 2024-09-13T21:40:49.409 INFO:tasks.workunit.client.1.smithi116.stdout:7/868: write d5/d9/f17 [532974,41588] 0 2024-09-13T21:40:49.410 INFO:tasks.workunit.client.1.smithi116.stdout:7/869: fsync d5/d9/d27/ded/d22/dae/fba 0 2024-09-13T21:40:49.410 INFO:tasks.workunit.client.1.smithi116.stdout:7/870: dread - d5/d9/d27/f8e zero size 2024-09-13T21:40:49.411 INFO:tasks.workunit.client.1.smithi116.stdout:7/871: mknod d5/d9/d27/ded/d22/d24/d6b/c122 0 2024-09-13T21:40:49.411 INFO:tasks.workunit.client.1.smithi116.stdout:7/872: dread - d5/d9/db/da3/fe8 zero size 2024-09-13T21:40:49.414 INFO:tasks.workunit.client.1.smithi116.stdout:7/873: truncate d5/d9/d27/d31/d38/d48/f94 115249 0 2024-09-13T21:40:49.431 INFO:tasks.workunit.client.1.smithi116.stdout:7/874: dwrite d5/d9/db/f100 [4194304,4194304] 0 2024-09-13T21:40:49.433 INFO:tasks.workunit.client.1.smithi116.stdout:7/875: mkdir d5/db0/d123 0 2024-09-13T21:40:49.433 INFO:tasks.workunit.client.1.smithi116.stdout:7/876: write d5/d9/f17 [1455738,64077] 0 2024-09-13T21:40:49.439 INFO:tasks.workunit.client.1.smithi116.stdout:7/877: dread d5/d9/d27/ded/d22/dae/fba [0,4194304] 0 2024-09-13T21:40:49.439 INFO:tasks.workunit.client.1.smithi116.stdout:7/878: creat d5/f124 x:0 0 0 2024-09-13T21:40:49.440 INFO:tasks.workunit.client.1.smithi116.stdout:7/879: stat d5/db0/fd1 0 2024-09-13T21:40:49.480 INFO:tasks.workunit.client.1.smithi116.stdout:8/738: sync 2024-09-13T21:40:49.480 INFO:tasks.workunit.client.1.smithi116.stdout:8/739: chown d2/d10/cd2 26839 1 2024-09-13T21:40:49.481 INFO:tasks.workunit.client.1.smithi116.stdout:8/740: creat d2/d10/d19/d21/fdb x:0 0 0 2024-09-13T21:40:49.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:49 smithi088 ceph-mon[27963]: pgmap v264: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 122 MiB/s rd, 144 MiB/s wr, 348 op/s 2024-09-13T21:40:49.487 INFO:tasks.workunit.client.1.smithi116.stdout:8/741: dread d2/d10/d19/d3a/f5f [0,4194304] 0 2024-09-13T21:40:49.488 INFO:tasks.workunit.client.1.smithi116.stdout:8/742: symlink d2/d10/d19/d3a/ldc 0 2024-09-13T21:40:49.488 INFO:tasks.workunit.client.1.smithi116.stdout:8/743: chown d2/d10/d19/d21/c2b 1011 1 2024-09-13T21:40:49.506 INFO:tasks.workunit.client.1.smithi116.stdout:8/744: dwrite d2/d27/d66/d7c/fc2 [0,4194304] 0 2024-09-13T21:40:49.507 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:49 smithi116 ceph-mon[33391]: pgmap v264: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 122 MiB/s rd, 144 MiB/s wr, 348 op/s 2024-09-13T21:40:49.516 INFO:tasks.workunit.client.1.smithi116.stdout:8/745: write d2/d10/d19/d21/d69/d9e/fd0 [3863086,9125] 0 2024-09-13T21:40:49.516 INFO:tasks.workunit.client.1.smithi116.stdout:8/746: readlink d2/d10/d37/l2a 0 2024-09-13T21:40:49.516 INFO:tasks.workunit.client.1.smithi116.stdout:8/747: fdatasync d2/d27/d66/d7c/fc2 0 2024-09-13T21:40:49.531 INFO:tasks.workunit.client.1.smithi116.stdout:8/748: dwrite d2/d5c/fc5 [0,4194304] 0 2024-09-13T21:40:49.533 INFO:tasks.workunit.client.1.smithi116.stdout:8/749: mknod d2/d27/d66/dcc/cdd 0 2024-09-13T21:40:49.534 INFO:tasks.workunit.client.1.smithi116.stdout:8/750: rename d2/d10/cd2 to d2/d10/d19/d21/d22/cde 0 2024-09-13T21:40:49.535 INFO:tasks.workunit.client.1.smithi116.stdout:8/751: creat d2/d10/d19/d42/d45/fdf x:0 0 0 2024-09-13T21:40:49.535 INFO:tasks.workunit.client.1.smithi116.stdout:8/752: write d2/d10/d19/d21/d22/d5d/d46/f4f [782975,23380] 0 2024-09-13T21:40:49.542 INFO:tasks.workunit.client.1.smithi116.stdout:8/753: write d2/d10/d19/d21/d22/d5d/f52 [174487,12039] 0 2024-09-13T21:40:49.542 INFO:tasks.workunit.client.1.smithi116.stdout:8/754: readlink d2/d10/d19/d21/l28 0 2024-09-13T21:40:49.544 INFO:tasks.workunit.client.1.smithi116.stdout:8/755: link d2/d5c/fc5 d2/d10/d19/d3a/d4c/fe0 0 2024-09-13T21:40:49.544 INFO:tasks.workunit.client.1.smithi116.stdout:8/756: creat d2/d10/fe1 x:0 0 0 2024-09-13T21:40:49.544 INFO:tasks.workunit.client.1.smithi116.stdout:8/757: chown d2/f6d 18 1 2024-09-13T21:40:49.545 INFO:tasks.workunit.client.1.smithi116.stdout:8/758: symlink d2/d10/d3e/le2 0 2024-09-13T21:40:49.566 INFO:tasks.workunit.client.1.smithi116.stdout:8/759: dwrite d2/d10/f18 [4194304,4194304] 0 2024-09-13T21:40:49.582 INFO:tasks.workunit.client.1.smithi116.stdout:8/760: dwrite d2/d10/d19/d21/d22/d5d/d46/f4f [0,4194304] 0 2024-09-13T21:40:49.584 INFO:tasks.workunit.client.1.smithi116.stdout:8/761: link d2/d10/d19/d21/l2e d2/d10/d3e/le3 0 2024-09-13T21:40:49.597 INFO:tasks.workunit.client.1.smithi116.stdout:8/762: dwrite d2/d10/d19/d3a/f3b [4194304,4194304] 0 2024-09-13T21:40:49.598 INFO:tasks.workunit.client.1.smithi116.stdout:8/763: rename d2/d10/d19/d21/d69/f9f to d2/d10/d37/d64/fe4 0 2024-09-13T21:40:49.610 INFO:tasks.workunit.client.1.smithi116.stdout:8/764: dwrite d2/d27/d66/d7c/fcb [0,4194304] 0 2024-09-13T21:40:49.610 INFO:tasks.workunit.client.1.smithi116.stdout:8/765: stat d2/d27/d66/d7c/fcb 0 2024-09-13T21:40:49.610 INFO:tasks.workunit.client.1.smithi116.stdout:8/766: write d2/d10/d19/f84 [2900912,13512] 0 2024-09-13T21:40:49.610 INFO:tasks.workunit.client.1.smithi116.stdout:8/767: truncate d2/d10/d4b/f51 4354637 0 2024-09-13T21:40:49.618 INFO:tasks.workunit.client.1.smithi116.stdout:8/768: write d2/d10/d19/d97/fb3 [3332152,66039] 0 2024-09-13T21:40:49.619 INFO:tasks.workunit.client.1.smithi116.stdout:8/769: getdents d2/d10/d19/d42/d45/d87 0 2024-09-13T21:40:49.624 INFO:tasks.workunit.client.1.smithi116.stdout:0/873: sync 2024-09-13T21:40:49.627 INFO:tasks.workunit.client.1.smithi116.stdout:8/770: dread d2/d10/d19/d21/f2d [0,4194304] 0 2024-09-13T21:40:49.628 INFO:tasks.workunit.client.1.smithi116.stdout:8/771: mknod d2/d10/d19/d42/d45/ce5 0 2024-09-13T21:40:49.640 INFO:tasks.workunit.client.1.smithi116.stdout:8/772: write d2/d10/f18 [1196608,127568] 0 2024-09-13T21:40:49.644 INFO:tasks.workunit.client.1.smithi116.stdout:0/874: dwrite d2/dc/d47/d63/d9f/dad/ff5 [0,4194304] 0 2024-09-13T21:40:49.651 INFO:tasks.workunit.client.1.smithi116.stdout:0/875: rmdir d2/dc/dcc/d10e 0 2024-09-13T21:40:49.651 INFO:tasks.workunit.client.1.smithi116.stdout:0/876: chown d2/dc/d12/d28/fc3 1354 1 2024-09-13T21:40:49.651 INFO:tasks.workunit.client.1.smithi116.stdout:8/773: dread d2/d10/d19/d3a/d4c/fe0 [0,4194304] 0 2024-09-13T21:40:49.652 INFO:tasks.workunit.client.1.smithi116.stdout:8/774: fdatasync d2/d10/d19/d3a/d4c/d7a/fc0 0 2024-09-13T21:40:49.674 INFO:tasks.workunit.client.1.smithi116.stdout:0/877: dwrite d2/dc/d12/d28/f108 [8388608,4194304] 0 2024-09-13T21:40:49.675 INFO:tasks.workunit.client.1.smithi116.stdout:8/775: dwrite d2/d10/d19/d21/d22/d5d/d46/f7d [0,4194304] 0 2024-09-13T21:40:49.675 INFO:tasks.workunit.client.1.smithi116.stdout:8/776: fsync d2/d10/d19/d3a/f3b 0 2024-09-13T21:40:49.687 INFO:tasks.workunit.client.1.smithi116.stdout:8/777: write d2/f2f [2577705,60449] 0 2024-09-13T21:40:49.688 INFO:tasks.workunit.client.1.smithi116.stdout:0/878: write d2/dc/d47/d63/fed [3941939,110235] 0 2024-09-13T21:40:49.688 INFO:tasks.workunit.client.1.smithi116.stdout:8/778: symlink d2/d27/d62/le6 0 2024-09-13T21:40:49.690 INFO:tasks.workunit.client.1.smithi116.stdout:0/879: creat d2/dc/d12/d28/d57/de3/f11c x:0 0 0 2024-09-13T21:40:49.697 INFO:tasks.workunit.client.1.smithi116.stdout:8/779: mkdir d2/d10/d4b/de7 0 2024-09-13T21:40:49.697 INFO:tasks.workunit.client.1.smithi116.stdout:8/780: truncate d2/d10/d19/d42/d45/d87/fa0 434209 0 2024-09-13T21:40:49.699 INFO:tasks.workunit.client.1.smithi116.stdout:8/781: mkdir d2/d10/d19/d21/d22/d5d/de8 0 2024-09-13T21:40:49.700 INFO:tasks.workunit.client.1.smithi116.stdout:0/880: write d2/dc/d12/d28/f9c [3418653,66858] 0 2024-09-13T21:40:49.701 INFO:tasks.workunit.client.1.smithi116.stdout:8/782: link d2/d10/d19/d3a/c71 d2/d10/d19/d3a/ce9 0 2024-09-13T21:40:49.704 INFO:tasks.workunit.client.1.smithi116.stdout:8/783: mkdir d2/d10/d19/dea 0 2024-09-13T21:40:49.716 INFO:tasks.workunit.client.1.smithi116.stdout:8/784: dread d2/d10/d19/d21/d22/f78 [0,4194304] 0 2024-09-13T21:40:49.716 INFO:tasks.workunit.client.1.smithi116.stdout:8/785: fdatasync d2/d10/d19/d21/d69/d9e/fd0 0 2024-09-13T21:40:49.716 INFO:tasks.workunit.client.1.smithi116.stdout:8/786: write d2/f8 [1319538,30435] 0 2024-09-13T21:40:49.717 INFO:tasks.workunit.client.1.smithi116.stdout:8/787: write d2/d10/d19/d21/f2d [3157236,56903] 0 2024-09-13T21:40:49.717 INFO:tasks.workunit.client.1.smithi116.stdout:8/788: truncate d2/d10/d19/d21/d69/d9e/faf 417693 0 2024-09-13T21:40:49.717 INFO:tasks.workunit.client.1.smithi116.stdout:8/789: chown d2/d10/d4b/f51 15 1 2024-09-13T21:40:49.754 INFO:tasks.workunit.client.1.smithi116.stdout:4/710: sync 2024-09-13T21:40:49.756 INFO:tasks.workunit.client.1.smithi116.stdout:4/711: mknod d0/cdc 0 2024-09-13T21:40:49.758 INFO:tasks.workunit.client.1.smithi116.stdout:4/712: mkdir d0/dd/d6b/d92/d95/ddd 0 2024-09-13T21:40:49.759 INFO:tasks.workunit.client.1.smithi116.stdout:4/713: link d0/dd/cbe d0/dd/d6b/cde 0 2024-09-13T21:40:49.762 INFO:tasks.workunit.client.1.smithi116.stdout:4/714: rmdir d0/dad/dd4 0 2024-09-13T21:40:49.780 INFO:tasks.workunit.client.1.smithi116.stdout:4/715: dwrite d0/d32/d5f/f82 [0,4194304] 0 2024-09-13T21:40:49.782 INFO:tasks.workunit.client.1.smithi116.stdout:4/716: mkdir d0/dd/d7c/ddf 0 2024-09-13T21:40:49.782 INFO:tasks.workunit.client.1.smithi116.stdout:4/717: rmdir d0/dd/d6b/d92 39 2024-09-13T21:40:49.783 INFO:tasks.workunit.client.1.smithi116.stdout:4/718: mkdir d0/dad/de0 0 2024-09-13T21:40:49.784 INFO:tasks.workunit.client.1.smithi116.stdout:4/719: mknod d0/d56/d84/db1/ce1 0 2024-09-13T21:40:49.784 INFO:tasks.workunit.client.1.smithi116.stdout:4/720: truncate d0/dd/d48/fdb 208136 0 2024-09-13T21:40:49.785 INFO:tasks.workunit.client.1.smithi116.stdout:4/721: mkdir d0/dd/d13/d5a/dc4/dc8/de2 0 2024-09-13T21:40:49.785 INFO:tasks.workunit.client.1.smithi116.stdout:4/722: truncate d0/d56/d84/fc6 409317 0 2024-09-13T21:40:49.785 INFO:tasks.workunit.client.1.smithi116.stdout:4/723: creat d0/dd/d13/d5a/dc4/dc8/de2/fe3 x:0 0 0 2024-09-13T21:40:49.790 INFO:tasks.workunit.client.1.smithi116.stdout:4/724: write d0/dd/d13/f3c [3750167,62101] 0 2024-09-13T21:40:49.791 INFO:tasks.workunit.client.1.smithi116.stdout:4/725: rename d0/dd/d48/f94 to d0/dd/d7c/ddf/fe4 0 2024-09-13T21:40:49.793 INFO:tasks.workunit.client.1.smithi116.stdout:4/726: creat d0/d32/fe5 x:0 0 0 2024-09-13T21:40:49.793 INFO:tasks.workunit.client.1.smithi116.stdout:4/727: dread - d0/d32/da3/fca zero size 2024-09-13T21:40:49.793 INFO:tasks.workunit.client.1.smithi116.stdout:4/728: chown d0/f31 174993851 1 2024-09-13T21:40:49.801 INFO:tasks.workunit.client.1.smithi116.stdout:4/729: dread d0/d32/f49 [0,4194304] 0 2024-09-13T21:40:49.809 INFO:tasks.workunit.client.1.smithi116.stdout:4/730: write d0/dd/d13/f4c [520517,16294] 0 2024-09-13T21:40:49.810 INFO:tasks.workunit.client.1.smithi116.stdout:4/731: creat d0/d32/da3/db7/fe6 x:0 0 0 2024-09-13T21:40:49.811 INFO:tasks.workunit.client.1.smithi116.stdout:4/732: symlink d0/dd/d6b/d92/d95/le7 0 2024-09-13T21:40:49.812 INFO:tasks.workunit.client.1.smithi116.stdout:4/733: rename d0/dd/l54 to d0/dd/d6b/le8 0 2024-09-13T21:40:49.813 INFO:tasks.workunit.client.1.smithi116.stdout:4/734: chown d0/dd/d6b/d92/fa2 1345648 1 2024-09-13T21:40:49.862 INFO:tasks.workunit.client.1.smithi116.stdout:2/685: sync 2024-09-13T21:40:49.862 INFO:tasks.workunit.client.1.smithi116.stdout:1/626: sync 2024-09-13T21:40:49.863 INFO:tasks.workunit.client.1.smithi116.stdout:3/854: sync 2024-09-13T21:40:49.863 INFO:tasks.workunit.client.1.smithi116.stdout:1/627: chown d4/d23/d56/da3/lba 0 1 2024-09-13T21:40:49.863 INFO:tasks.workunit.client.1.smithi116.stdout:2/686: write d0/d3a/d82/f52 [36164,29942] 0 2024-09-13T21:40:49.863 INFO:tasks.workunit.client.1.smithi116.stdout:2/687: stat d0/d5/d2a/l97 0 2024-09-13T21:40:49.864 INFO:tasks.workunit.client.1.smithi116.stdout:1/628: mknod d4/d14/d2a/cde 0 2024-09-13T21:40:49.864 INFO:tasks.workunit.client.1.smithi116.stdout:1/629: creat d4/d14/d52/d2f/d91/dac/fdf x:0 0 0 2024-09-13T21:40:49.864 INFO:tasks.workunit.client.1.smithi116.stdout:1/630: truncate d4/d14/d52/d2f/d91/f94 245164 0 2024-09-13T21:40:49.864 INFO:tasks.workunit.client.1.smithi116.stdout:2/688: creat d0/d5/d8/dd2/fe1 x:0 0 0 2024-09-13T21:40:49.864 INFO:tasks.workunit.client.1.smithi116.stdout:2/689: write d0/d3a/d82/d62/f46 [1011795,43600] 0 2024-09-13T21:40:49.864 INFO:tasks.workunit.client.1.smithi116.stdout:2/690: creat d0/d7/d86/dd1/fe2 x:0 0 0 2024-09-13T21:40:49.866 INFO:tasks.workunit.client.1.smithi116.stdout:1/631: unlink d4/d23/c70 0 2024-09-13T21:40:49.867 INFO:tasks.workunit.client.1.smithi116.stdout:2/691: rename d0/d3a/d82/d62/d75/dcb to d0/d5/de3 0 2024-09-13T21:40:49.867 INFO:tasks.workunit.client.1.smithi116.stdout:1/632: mknod d4/d23/d57/ce0 0 2024-09-13T21:40:49.867 INFO:tasks.workunit.client.1.smithi116.stdout:1/633: getdents d4/d74/d8d/d5f/dd4 0 2024-09-13T21:40:49.869 INFO:tasks.workunit.client.1.smithi116.stdout:1/634: dread d4/d74/d8d/d5f/f78 [0,4194304] 0 2024-09-13T21:40:49.869 INFO:tasks.workunit.client.1.smithi116.stdout:1/635: write d4/d14/f9c [4565077,74234] 0 2024-09-13T21:40:49.869 INFO:tasks.workunit.client.1.smithi116.stdout:2/692: unlink d0/d5/d8/cc3 0 2024-09-13T21:40:49.873 INFO:tasks.workunit.client.1.smithi116.stdout:1/636: creat d4/d14/d52/d2f/d5c/daf/db9/fe1 x:0 0 0 2024-09-13T21:40:49.875 INFO:tasks.workunit.client.1.smithi116.stdout:1/637: dread d4/d14/d52/d2f/f4b [0,4194304] 0 2024-09-13T21:40:49.886 INFO:tasks.workunit.client.1.smithi116.stdout:1/638: dread d4/d14/d41/f49 [0,4194304] 0 2024-09-13T21:40:49.888 INFO:tasks.workunit.client.1.smithi116.stdout:1/639: symlink d4/le2 0 2024-09-13T21:40:49.889 INFO:tasks.workunit.client.1.smithi116.stdout:1/640: rename d4/d23/d57/d92/fc1 to d4/d14/d52/d2f/d91/fe3 0 2024-09-13T21:40:49.889 INFO:tasks.workunit.client.1.smithi116.stdout:1/641: write d4/d74/f80 [1524160,81013] 0 2024-09-13T21:40:49.890 INFO:tasks.workunit.client.1.smithi116.stdout:1/642: mkdir d4/d23/d56/de4 0 2024-09-13T21:40:49.891 INFO:tasks.workunit.client.1.smithi116.stdout:1/643: symlink d4/d23/d57/le5 0 2024-09-13T21:40:49.892 INFO:tasks.workunit.client.1.smithi116.stdout:1/644: creat d4/d14/d52/d2f/d5c/daf/fe6 x:0 0 0 2024-09-13T21:40:49.893 INFO:tasks.workunit.client.1.smithi116.stdout:1/645: mknod d4/d14/d52/ce7 0 2024-09-13T21:40:49.896 INFO:tasks.workunit.client.1.smithi116.stdout:3/855: dwrite d3/db/d20/d50/f8b [0,4194304] 0 2024-09-13T21:40:49.896 INFO:tasks.workunit.client.1.smithi116.stdout:3/856: creat d3/db/d10/d99/f132 x:0 0 0 2024-09-13T21:40:49.896 INFO:tasks.workunit.client.1.smithi116.stdout:3/857: chown d3/df9/da2/cf0 140432 1 2024-09-13T21:40:49.896 INFO:tasks.workunit.client.1.smithi116.stdout:3/858: chown d3/db/d10/d1c/d34/d55/d96/fb6 211 1 2024-09-13T21:40:49.896 INFO:tasks.workunit.client.1.smithi116.stdout:2/693: dwrite d0/d3a/d82/d62/d1f/d5d/d60/f95 [0,4194304] 0 2024-09-13T21:40:49.896 INFO:tasks.workunit.client.1.smithi116.stdout:2/694: chown d0/d7/d2d/fde 4 1 2024-09-13T21:40:49.900 INFO:tasks.workunit.client.1.smithi116.stdout:3/859: link d3/db/d10/d29/fd1 d3/db/d10/d1d/d5f/d115/f133 0 2024-09-13T21:40:49.900 INFO:tasks.workunit.client.1.smithi116.stdout:3/860: chown d3/db/d10/d1d/d5f/fa7 12844445 1 2024-09-13T21:40:49.904 INFO:tasks.workunit.client.1.smithi116.stdout:3/861: mknod d3/db/d10/d1d/c134 0 2024-09-13T21:40:49.904 INFO:tasks.workunit.client.1.smithi116.stdout:3/862: fsync d3/db/d10/d99/ffa 0 2024-09-13T21:40:49.904 INFO:tasks.workunit.client.1.smithi116.stdout:3/863: mknod d3/db/d10/d1c/d34/d55/d96/c135 0 2024-09-13T21:40:49.905 INFO:tasks.workunit.client.1.smithi116.stdout:3/864: creat d3/db/d10/d1c/d34/d55/d96/dee/d108/f136 x:0 0 0 2024-09-13T21:40:49.911 INFO:tasks.workunit.client.1.smithi116.stdout:2/695: dwrite d0/d5/d2a/f6d [0,4194304] 0 2024-09-13T21:40:49.918 INFO:tasks.workunit.client.1.smithi116.stdout:3/865: write d3/db/d3d/f91 [2714800,9453] 0 2024-09-13T21:40:49.930 INFO:tasks.workunit.client.1.smithi116.stdout:2/696: dwrite d0/d5/d2a/f57 [0,4194304] 0 2024-09-13T21:40:49.932 INFO:tasks.workunit.client.1.smithi116.stdout:2/697: truncate d0/d3a/d82/d62/f7b 1681862 0 2024-09-13T21:40:49.932 INFO:tasks.workunit.client.1.smithi116.stdout:2/698: chown d0/fb0 1 1 2024-09-13T21:40:49.933 INFO:tasks.workunit.client.1.smithi116.stdout:3/866: dread d3/db/d20/d86/fbc [0,4194304] 0 2024-09-13T21:40:49.933 INFO:tasks.workunit.client.1.smithi116.stdout:3/867: creat d3/db/d10/d1c/d34/d55/d96/dee/f137 x:0 0 0 2024-09-13T21:40:49.934 INFO:tasks.workunit.client.1.smithi116.stdout:2/699: rename d0/d5/d8/f39 to d0/d3a/d82/d62/ddf/fe4 0 2024-09-13T21:40:49.937 INFO:tasks.workunit.client.1.smithi116.stdout:2/700: creat d0/d3a/fe5 x:0 0 0 2024-09-13T21:40:49.937 INFO:tasks.workunit.client.1.smithi116.stdout:2/701: fdatasync d0/d5/d2a/f57 0 2024-09-13T21:40:49.937 INFO:tasks.workunit.client.1.smithi116.stdout:2/702: truncate d0/d3a/d82/d62/d1f/d5d/fc2 1511184 0 2024-09-13T21:40:49.938 INFO:tasks.workunit.client.1.smithi116.stdout:2/703: rename d0/d7/d86/dd1/fd8 to d0/d3a/d82/d62/d75/d77/fe6 0 2024-09-13T21:40:49.939 INFO:tasks.workunit.client.1.smithi116.stdout:2/704: mknod d0/d3a/d82/d62/d75/ce7 0 2024-09-13T21:40:49.957 INFO:tasks.workunit.client.1.smithi116.stdout:3/868: dwrite d3/fc1 [0,4194304] 0 2024-09-13T21:40:49.960 INFO:tasks.workunit.client.1.smithi116.stdout:3/869: creat d3/db/d10/d1c/d34/d55/d96/f138 x:0 0 0 2024-09-13T21:40:49.960 INFO:tasks.workunit.client.1.smithi116.stdout:3/870: stat d3/db/d10/d1c/d34/d55 0 2024-09-13T21:40:49.960 INFO:tasks.workunit.client.1.smithi116.stdout:3/871: read d3/db/d10/d1c/d34/d55/d57/f58 [1281825,13437] 0 2024-09-13T21:40:49.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/705: dwrite d0/d3a/d82/d62/d75/d77/f8b [0,4194304] 0 2024-09-13T21:40:49.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/706: dread - d0/d3a/d82/d62/d1f/d5d/d89/fa1 zero size 2024-09-13T21:40:49.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/707: fdatasync d0/d5/d8/f16 0 2024-09-13T21:40:49.961 INFO:tasks.workunit.client.1.smithi116.stdout:2/708: chown d0/d3a/d82/d62/d75/d77/fe6 1167435 1 2024-09-13T21:40:49.963 INFO:tasks.workunit.client.1.smithi116.stdout:2/709: unlink d0/d7/d49/d93/ccd 0 2024-09-13T21:40:49.963 INFO:tasks.workunit.client.1.smithi116.stdout:2/710: truncate d0/d3a/d82/d62/d1f/d5d/d89/fa1 760029 0 2024-09-13T21:40:49.982 INFO:tasks.workunit.client.1.smithi116.stdout:3/872: dwrite d3/db/d10/d1d/d5f/fa7 [0,4194304] 0 2024-09-13T21:40:49.983 INFO:tasks.workunit.client.1.smithi116.stdout:3/873: truncate d3/db/d20/d86/fbc 3225682 0 2024-09-13T21:40:49.984 INFO:tasks.workunit.client.1.smithi116.stdout:3/874: write d3/db/d10/d1c/d34/d55/f10d [797521,53434] 0 2024-09-13T21:40:49.984 INFO:tasks.workunit.client.1.smithi116.stdout:3/875: chown d3/db/d10/d29 224004 1 2024-09-13T21:40:49.984 INFO:tasks.workunit.client.1.smithi116.stdout:3/876: symlink d3/db/d10/d1c/d34/d55/d57/l139 0 2024-09-13T21:40:49.986 INFO:tasks.workunit.client.1.smithi116.stdout:3/877: link d3/db/d10/d1d/fce d3/db/d3d/f13a 0 2024-09-13T21:40:49.989 INFO:tasks.workunit.client.1.smithi116.stdout:2/711: dwrite d0/d7/f12 [4194304,4194304] 0 2024-09-13T21:40:49.991 INFO:tasks.workunit.client.1.smithi116.stdout:2/712: link d0/d7/d2d/f6a d0/d3a/d82/fe8 0 2024-09-13T21:40:49.995 INFO:tasks.workunit.client.1.smithi116.stdout:2/713: truncate d0/d5/d2a/f3b 1543928 0 2024-09-13T21:40:49.997 INFO:tasks.workunit.client.1.smithi116.stdout:2/714: getdents d0/d7/d86/dd1 0 2024-09-13T21:40:49.997 INFO:tasks.workunit.client.1.smithi116.stdout:2/715: chown d0/d3a/d82/d62/d1f/d5d/c5e 217115 1 2024-09-13T21:40:49.999 INFO:tasks.workunit.client.1.smithi116.stdout:3/878: dread d3/df9/da2/f122 [0,4194304] 0 2024-09-13T21:40:50.000 INFO:tasks.workunit.client.1.smithi116.stdout:3/879: mknod d3/db/d10/d1c/c13b 0 2024-09-13T21:40:50.001 INFO:tasks.workunit.client.1.smithi116.stdout:3/880: fdatasync d3/db/f30 0 2024-09-13T21:40:50.002 INFO:tasks.workunit.client.1.smithi116.stdout:3/881: creat d3/db/d10/d1d/d5f/f13c x:0 0 0 2024-09-13T21:40:50.002 INFO:tasks.workunit.client.1.smithi116.stdout:3/882: write d3/db/d10/d1c/d34/d55/d96/dee/f137 [654371,30372] 0 2024-09-13T21:40:50.003 INFO:tasks.workunit.client.1.smithi116.stdout:3/883: write d3/db/d26/fa0 [60895,20477] 0 2024-09-13T21:40:50.004 INFO:tasks.workunit.client.1.smithi116.stdout:3/884: creat d3/db/d10/d1c/d34/f13d x:0 0 0 2024-09-13T21:40:50.004 INFO:tasks.workunit.client.1.smithi116.stdout:2/716: dread d0/d3a/d82/d62/d1f/d5d/d60/f8a [0,4194304] 0 2024-09-13T21:40:50.005 INFO:tasks.workunit.client.1.smithi116.stdout:3/885: getdents d3/db/d10/d1d/d5f/d7f 0 2024-09-13T21:40:50.005 INFO:tasks.workunit.client.1.smithi116.stdout:3/886: read d3/db/d10/d1c/d34/fc4 [110373,45582] 0 2024-09-13T21:40:50.005 INFO:tasks.workunit.client.1.smithi116.stdout:3/887: write d3/db/d10/d1d/d5f/d6f/d71/f11c [807395,22795] 0 2024-09-13T21:40:50.007 INFO:tasks.workunit.client.1.smithi116.stdout:2/717: mkdir d0/de9 0 2024-09-13T21:40:50.021 INFO:tasks.workunit.client.1.smithi116.stdout:3/888: dwrite d3/db/d26/f78 [0,4194304] 0 2024-09-13T21:40:50.023 INFO:tasks.workunit.client.1.smithi116.stdout:3/889: symlink d3/db/d10/d1c/d34/d55/d57/db1/l13e 0 2024-09-13T21:40:50.023 INFO:tasks.workunit.client.1.smithi116.stdout:3/890: creat d3/db/d3d/d110/f13f x:0 0 0 2024-09-13T21:40:50.032 INFO:tasks.workunit.client.1.smithi116.stdout:3/891: write d3/db/d10/fba [1447894,65936] 0 2024-09-13T21:40:50.032 INFO:tasks.workunit.client.1.smithi116.stdout:3/892: fsync d3/db/d10/d1c/d34/d55/d57/f58 0 2024-09-13T21:40:50.032 INFO:tasks.workunit.client.1.smithi116.stdout:3/893: write d3/db/f10e [713081,21784] 0 2024-09-13T21:40:50.034 INFO:tasks.workunit.client.1.smithi116.stdout:3/894: rename d3/l6 to d3/db/d10/d1c/d34/d55/d57/db1/l140 0 2024-09-13T21:40:50.041 INFO:tasks.workunit.client.1.smithi116.stdout:3/895: write d3/db/d10/d1c/d34/d55/f11d [3229104,48392] 0 2024-09-13T21:40:50.043 INFO:tasks.workunit.client.1.smithi116.stdout:3/896: rmdir d3/db/d10/d1c/d34/d55/d57/dc6 39 2024-09-13T21:40:50.056 INFO:tasks.workunit.client.1.smithi116.stdout:3/897: dwrite d3/db/d10/d1d/d5f/ff5 [4194304,4194304] 0 2024-09-13T21:40:50.058 INFO:tasks.workunit.client.1.smithi116.stdout:3/898: rename d3/db/d10/d1c/d34/d55/d57/db1/fef to d3/db/d10/d1c/d34/d55/d96/f141 0 2024-09-13T21:40:50.060 INFO:tasks.workunit.client.1.smithi116.stdout:3/899: rename d3/db/d10/d29/l35 to d3/db/d10/d1c/d34/l142 0 2024-09-13T21:40:50.060 INFO:tasks.workunit.client.1.smithi116.stdout:3/900: chown d3/db/d10/d1d/d5f/d6f/d71 26847028 1 2024-09-13T21:40:50.061 INFO:tasks.workunit.client.1.smithi116.stdout:3/901: truncate d3/db/d10/d1c/d34/d55/d57/f58 2724059 0 2024-09-13T21:40:50.075 INFO:tasks.workunit.client.1.smithi116.stdout:3/902: dwrite d3/db/d10/d1c/d63/fe4 [0,4194304] 0 2024-09-13T21:40:50.075 INFO:tasks.workunit.client.1.smithi116.stdout:3/903: readlink d3/db/d20/d50/le2 0 2024-09-13T21:40:50.077 INFO:tasks.workunit.client.1.smithi116.stdout:3/904: mkdir d3/db/d10/d1c/d34/d55/d96/dee/d143 0 2024-09-13T21:40:50.078 INFO:tasks.workunit.client.1.smithi116.stdout:3/905: link d3/db/d10/d1d/d5f/d6f/d71/f7d d3/db/d10/d1c/d34/d55/d57/f144 0 2024-09-13T21:40:50.080 INFO:tasks.workunit.client.1.smithi116.stdout:3/906: symlink d3/db/d10/d1c/d34/d55/d96/dee/d143/l145 0 2024-09-13T21:40:50.082 INFO:tasks.workunit.client.1.smithi116.stdout:3/907: unlink d3/db/d10/d1c/d34/d55/d57/dc6/cdd 0 2024-09-13T21:40:50.095 INFO:tasks.workunit.client.1.smithi116.stdout:3/908: dwrite d3/db/f43 [0,4194304] 0 2024-09-13T21:40:50.096 INFO:tasks.workunit.client.1.smithi116.stdout:3/909: mknod d3/db/d10/d1c/c146 0 2024-09-13T21:40:50.097 INFO:tasks.workunit.client.1.smithi116.stdout:3/910: write d3/db/d10/d1d/d5f/d115/f133 [1163556,90887] 0 2024-09-13T21:40:50.097 INFO:tasks.workunit.client.1.smithi116.stdout:3/911: mkdir d3/dd3/d147 0 2024-09-13T21:40:50.098 INFO:tasks.workunit.client.1.smithi116.stdout:3/912: readlink d3/db/d10/d1d/d5f/l119 0 2024-09-13T21:40:50.103 INFO:tasks.workunit.client.1.smithi116.stdout:3/913: dread d3/db/d10/d29/fd1 [0,4194304] 0 2024-09-13T21:40:50.104 INFO:tasks.workunit.client.1.smithi116.stdout:3/914: creat d3/db/d121/f148 x:0 0 0 2024-09-13T21:40:50.105 INFO:tasks.workunit.client.1.smithi116.stdout:3/915: chown d3/db/d20/fc0 3057891 1 2024-09-13T21:40:50.105 INFO:tasks.workunit.client.1.smithi116.stdout:3/916: creat d3/db/d10/d1c/d34/d55/d57/db1/f149 x:0 0 0 2024-09-13T21:40:50.120 INFO:tasks.workunit.client.1.smithi116.stdout:3/917: dwrite d3/db/d10/d1d/d5f/d6f/fb3 [0,4194304] 0 2024-09-13T21:40:50.122 INFO:tasks.workunit.client.1.smithi116.stdout:3/918: symlink d3/db/d10/d1d/l14a 0 2024-09-13T21:40:50.123 INFO:tasks.workunit.client.1.smithi116.stdout:3/919: link d3/db/d10/d1c/d63/l10c d3/db/d10/d1d/d5f/d7f/l14b 0 2024-09-13T21:40:50.124 INFO:tasks.workunit.client.1.smithi116.stdout:6/861: sync 2024-09-13T21:40:50.124 INFO:tasks.workunit.client.1.smithi116.stdout:9/528: sync 2024-09-13T21:40:50.124 INFO:tasks.workunit.client.1.smithi116.stdout:5/910: sync 2024-09-13T21:40:50.124 INFO:tasks.workunit.client.1.smithi116.stdout:5/911: readlink d7/d1d/d46/dd4/d5e/l60 0 2024-09-13T21:40:50.125 INFO:tasks.workunit.client.1.smithi116.stdout:9/529: creat d2/d10/d4c/f9a x:0 0 0 2024-09-13T21:40:50.128 INFO:tasks.workunit.client.1.smithi116.stdout:5/912: symlink d7/d1d/d46/dd4/d5e/d79/dcb/d120/l12f 0 2024-09-13T21:40:50.129 INFO:tasks.workunit.client.1.smithi116.stdout:9/530: creat d2/d8/d3e/f9b x:0 0 0 2024-09-13T21:40:50.130 INFO:tasks.workunit.client.1.smithi116.stdout:9/531: symlink d2/d8/l9c 0 2024-09-13T21:40:50.131 INFO:tasks.workunit.client.1.smithi116.stdout:9/532: mknod d2/d72/c9d 0 2024-09-13T21:40:50.149 INFO:tasks.workunit.client.1.smithi116.stdout:3/920: dwrite d3/db/d10/d1d/d5f/d6f/fb9 [4194304,4194304] 0 2024-09-13T21:40:50.150 INFO:tasks.workunit.client.1.smithi116.stdout:9/533: dwrite d2/d5d/f89 [0,4194304] 0 2024-09-13T21:40:50.150 INFO:tasks.workunit.client.1.smithi116.stdout:9/534: chown d2/d10/d4c/c7e 1593932 1 2024-09-13T21:40:50.150 INFO:tasks.workunit.client.1.smithi116.stdout:9/535: truncate d2/d10/d4c/f99 431925 0 2024-09-13T21:40:50.151 INFO:tasks.workunit.client.1.smithi116.stdout:3/921: mkdir d3/db/d3d/d14c 0 2024-09-13T21:40:50.151 INFO:tasks.workunit.client.1.smithi116.stdout:3/922: fsync d3/db/d10/d1d/d2f/d61/f114 0 2024-09-13T21:40:50.153 INFO:tasks.workunit.client.1.smithi116.stdout:3/923: unlink d3/db/d10/d1d/d5f/fa7 0 2024-09-13T21:40:50.153 INFO:tasks.workunit.client.1.smithi116.stdout:3/924: stat d3/db/d10/f12f 0 2024-09-13T21:40:50.153 INFO:tasks.workunit.client.1.smithi116.stdout:3/925: fsync d3/db/d10/d1d/f112 0 2024-09-13T21:40:50.155 INFO:tasks.workunit.client.1.smithi116.stdout:9/536: dread d2/f2d [0,4194304] 0 2024-09-13T21:40:50.157 INFO:tasks.workunit.client.1.smithi116.stdout:9/537: rename d2/d10/d14/f59 to d2/d8/f9e 0 2024-09-13T21:40:50.158 INFO:tasks.workunit.client.1.smithi116.stdout:9/538: creat d2/d5d/d69/d7d/f9f x:0 0 0 2024-09-13T21:40:50.160 INFO:tasks.workunit.client.1.smithi116.stdout:3/926: read d3/f9 [3855006,49390] 0 2024-09-13T21:40:50.160 INFO:tasks.workunit.client.1.smithi116.stdout:3/927: chown d3/db/d20/d86/cd7 2 1 2024-09-13T21:40:50.164 INFO:tasks.workunit.client.1.smithi116.stdout:9/539: mkdir d2/d8/d93/da0 0 2024-09-13T21:40:50.166 INFO:tasks.workunit.client.1.smithi116.stdout:3/928: symlink d3/db/d10/d1c/d34/d55/d57/dc6/l14d 0 2024-09-13T21:40:50.166 INFO:tasks.workunit.client.1.smithi116.stdout:3/929: fdatasync d3/f82 0 2024-09-13T21:40:50.166 INFO:tasks.workunit.client.1.smithi116.stdout:3/930: truncate d3/db/d10/d1d/d5f/d6f/d71/fed 816159 0 2024-09-13T21:40:50.166 INFO:tasks.workunit.client.1.smithi116.stdout:3/931: write d3/db/d10/f7e [490082,118545] 0 2024-09-13T21:40:50.167 INFO:tasks.workunit.client.1.smithi116.stdout:3/932: write d3/db/d10/d99/f105 [688060,115155] 0 2024-09-13T21:40:50.167 INFO:tasks.workunit.client.1.smithi116.stdout:3/933: creat d3/db/d10/d1d/d5f/f14e x:0 0 0 2024-09-13T21:40:50.168 INFO:tasks.workunit.client.1.smithi116.stdout:3/934: mkdir d3/db/d10/d99/d14f 0 2024-09-13T21:40:50.171 INFO:tasks.workunit.client.1.smithi116.stdout:9/540: dread d2/d10/d14/f21 [0,4194304] 0 2024-09-13T21:40:50.197 INFO:tasks.workunit.client.1.smithi116.stdout:9/541: dwrite d2/d43/f8e [0,4194304] 0 2024-09-13T21:40:50.200 INFO:tasks.workunit.client.1.smithi116.stdout:3/935: dwrite d3/db/d10/f7e [0,4194304] 0 2024-09-13T21:40:50.209 INFO:tasks.workunit.client.1.smithi116.stdout:3/936: dread d3/df9/f69 [0,4194304] 0 2024-09-13T21:40:50.209 INFO:tasks.workunit.client.1.smithi116.stdout:3/937: fdatasync d3/db/d3d/d110/fe0 0 2024-09-13T21:40:50.209 INFO:tasks.workunit.client.1.smithi116.stdout:3/938: dread - d3/db/d10/d1c/d34/d55/d96/dee/f11b zero size 2024-09-13T21:40:50.210 INFO:tasks.workunit.client.1.smithi116.stdout:3/939: creat d3/df9/d127/f150 x:0 0 0 2024-09-13T21:40:50.212 INFO:tasks.workunit.client.1.smithi116.stdout:9/542: dwrite d2/d43/f68 [0,4194304] 0 2024-09-13T21:40:50.212 INFO:tasks.workunit.client.1.smithi116.stdout:9/543: chown d2/d10/f12 7876 1 2024-09-13T21:40:50.214 INFO:tasks.workunit.client.1.smithi116.stdout:9/544: creat d2/d10/d14/fa1 x:0 0 0 2024-09-13T21:40:50.214 INFO:tasks.workunit.client.1.smithi116.stdout:9/545: write d2/d5d/d69/f4b [892494,123199] 0 2024-09-13T21:40:50.228 INFO:tasks.workunit.client.1.smithi116.stdout:3/940: dwrite d3/db/d10/d1d/d2f/f38 [4194304,4194304] 0 2024-09-13T21:40:50.228 INFO:tasks.workunit.client.1.smithi116.stdout:3/941: dread - d3/db/d10/d1d/d5f/d6f/f130 zero size 2024-09-13T21:40:50.228 INFO:tasks.workunit.client.1.smithi116.stdout:3/942: stat d3/db/d10/d1c/d34/d55/d96/fd4 0 2024-09-13T21:40:50.242 INFO:tasks.workunit.client.1.smithi116.stdout:3/943: dwrite d3/db/d10/d1c/d34/d55/d96/dee/d108/f117 [0,4194304] 0 2024-09-13T21:40:50.242 INFO:tasks.workunit.client.1.smithi116.stdout:3/944: chown d3/db/d10/d1c/d34/d55/fa4 0 1 2024-09-13T21:40:50.242 INFO:tasks.workunit.client.1.smithi116.stdout:3/945: truncate d3/db/d10/d1d/fa9 440752 0 2024-09-13T21:40:50.242 INFO:tasks.workunit.client.1.smithi116.stdout:3/946: fsync d3/db/d10/d1d/d2f/d61/f114 0 2024-09-13T21:40:50.244 INFO:tasks.workunit.client.1.smithi116.stdout:3/947: mkdir d3/db/d10/d1c/d34/d55/d57/db1/d151 0 2024-09-13T21:40:50.244 INFO:tasks.workunit.client.1.smithi116.stdout:3/948: rmdir d3/db/d10/d1c/d34/d47 39 2024-09-13T21:40:50.244 INFO:tasks.workunit.client.1.smithi116.stdout:3/949: symlink d3/db/d10/d1d/l152 0 2024-09-13T21:40:50.253 INFO:tasks.workunit.client.1.smithi116.stdout:0/881: sync 2024-09-13T21:40:50.253 INFO:tasks.workunit.client.1.smithi116.stdout:7/880: sync 2024-09-13T21:40:50.253 INFO:tasks.workunit.client.1.smithi116.stdout:0/882: write d2/dc/fdf [686079,121743] 0 2024-09-13T21:40:50.255 INFO:tasks.workunit.client.1.smithi116.stdout:7/881: symlink d5/d9/d27/ded/d22/d24/d5f/dfc/l125 0 2024-09-13T21:40:50.256 INFO:tasks.workunit.client.1.smithi116.stdout:7/882: creat d5/d9/db/d21/d6e/d6f/f126 x:0 0 0 2024-09-13T21:40:50.257 INFO:tasks.workunit.client.1.smithi116.stdout:7/883: truncate d5/d9/f10 355243 0 2024-09-13T21:40:50.257 INFO:tasks.workunit.client.1.smithi116.stdout:7/884: chown d5/d9/db/f99 99368 1 2024-09-13T21:40:50.262 INFO:tasks.workunit.client.1.smithi116.stdout:0/883: write d2/dc/d47/d63/d9f/dad/ff5 [2115489,112858] 0 2024-09-13T21:40:50.264 INFO:tasks.workunit.client.1.smithi116.stdout:0/884: mkdir d2/d11d 0 2024-09-13T21:40:50.264 INFO:tasks.workunit.client.1.smithi116.stdout:0/885: chown d2/d5/d61/l118 730482 1 2024-09-13T21:40:50.265 INFO:tasks.workunit.client.1.smithi116.stdout:0/886: chown d2/d5/dbe/lc4 1115223 1 2024-09-13T21:40:50.265 INFO:tasks.workunit.client.1.smithi116.stdout:0/887: fdatasync d2/dc/d47/d63/fed 0 2024-09-13T21:40:50.267 INFO:tasks.workunit.client.1.smithi116.stdout:0/888: symlink d2/d5/d86/l11e 0 2024-09-13T21:40:50.274 INFO:tasks.workunit.client.1.smithi116.stdout:0/889: dread d2/dc/d47/f9b [0,4194304] 0 2024-09-13T21:40:50.274 INFO:tasks.workunit.client.1.smithi116.stdout:0/890: readlink d2/dc/d12/d28/d57/de3/l11a 0 2024-09-13T21:40:50.274 INFO:tasks.workunit.client.1.smithi116.stdout:0/891: write d2/dc/d12/d28/d57/de3/f11c [817791,112941] 0 2024-09-13T21:40:50.275 INFO:tasks.workunit.client.1.smithi116.stdout:0/892: rmdir d2/dc/d12/d28/d57 39 2024-09-13T21:40:50.282 INFO:tasks.workunit.client.1.smithi116.stdout:7/885: dwrite d5/d9/d27/ded/d22/d24/d5f/f120 [0,4194304] 0 2024-09-13T21:40:50.282 INFO:tasks.workunit.client.1.smithi116.stdout:7/886: read d5/d9/db/d21/d6e/d6f/fd0 [3666719,46007] 0 2024-09-13T21:40:50.289 INFO:tasks.workunit.client.1.smithi116.stdout:0/893: dread d2/f73 [0,4194304] 0 2024-09-13T21:40:50.290 INFO:tasks.workunit.client.1.smithi116.stdout:0/894: creat d2/dc/dce/f11f x:0 0 0 2024-09-13T21:40:50.290 INFO:tasks.workunit.client.1.smithi116.stdout:0/895: write d2/dc/d12/d28/d57/d65/ff7 [196721,38666] 0 2024-09-13T21:40:50.290 INFO:tasks.workunit.client.1.smithi116.stdout:0/896: truncate d2/d5/d61/f77 4237851 0 2024-09-13T21:40:50.291 INFO:tasks.workunit.client.1.smithi116.stdout:0/897: fdatasync d2/dc/d12/d51/d62/dfc/f10d 0 2024-09-13T21:40:50.296 INFO:tasks.workunit.client.1.smithi116.stdout:0/898: write d2/d5/f34 [8774806,31622] 0 2024-09-13T21:40:50.297 INFO:tasks.workunit.client.1.smithi116.stdout:0/899: readlink d2/d5/la9 0 2024-09-13T21:40:50.302 INFO:tasks.workunit.client.1.smithi116.stdout:0/900: dread d2/dc/d47/d63/fed [0,4194304] 0 2024-09-13T21:40:50.304 INFO:tasks.workunit.client.1.smithi116.stdout:0/901: rename d2/d5/dbe/dc1 to d2/dc/d12/d28/d57/de3/d120 0 2024-09-13T21:40:50.305 INFO:tasks.workunit.client.1.smithi116.stdout:0/902: rename d2/dc/d47/d63/d9f/dad to d2/dc/d47/d121 0 2024-09-13T21:40:50.306 INFO:tasks.workunit.client.1.smithi116.stdout:0/903: symlink d2/dc/d12/d28/d57/d110/d103/l122 0 2024-09-13T21:40:50.308 INFO:tasks.workunit.client.1.smithi116.stdout:0/904: rename d2/dc/d12/d51/d62/l56 to d2/dc/d12/d28/d57/d110/l123 0 2024-09-13T21:40:50.308 INFO:tasks.workunit.client.1.smithi116.stdout:0/905: dread - d2/d5/d86/d8a/db1/fe7 zero size 2024-09-13T21:40:50.309 INFO:tasks.workunit.client.1.smithi116.stdout:0/906: creat d2/dc/d47/d121/f124 x:0 0 0 2024-09-13T21:40:50.310 INFO:tasks.workunit.client.1.smithi116.stdout:0/907: rmdir d2/dc/d47/d63/d9f/db6 39 2024-09-13T21:40:50.310 INFO:tasks.workunit.client.1.smithi116.stdout:0/908: getdents d2/dc/d47/d63/d9f/db6 0 2024-09-13T21:40:50.312 INFO:tasks.workunit.client.1.smithi116.stdout:0/909: mknod d2/dc/d12/d28/c125 0 2024-09-13T21:40:50.312 INFO:tasks.workunit.client.1.smithi116.stdout:0/910: fsync d2/dc/d12/d28/f9c 0 2024-09-13T21:40:50.312 INFO:tasks.workunit.client.1.smithi116.stdout:0/911: chown d2/dc/d12/d28/d57/d65/fc6 81 1 2024-09-13T21:40:50.312 INFO:tasks.workunit.client.1.smithi116.stdout:0/912: mkdir d2/d11d/d126 0 2024-09-13T21:40:50.314 INFO:tasks.workunit.client.1.smithi116.stdout:0/913: rename d2/d5/f50 to d2/dc/f127 0 2024-09-13T21:40:50.315 INFO:tasks.workunit.client.1.smithi116.stdout:0/914: unlink d2/dc/d12/c1c 0 2024-09-13T21:40:50.333 INFO:tasks.workunit.client.1.smithi116.stdout:0/915: dwrite d2/dc/d47/d63/d9f/db6/fc8 [0,4194304] 0 2024-09-13T21:40:50.335 INFO:tasks.workunit.client.1.smithi116.stdout:0/916: symlink d2/dc/d47/d63/l128 0 2024-09-13T21:40:50.336 INFO:tasks.workunit.client.1.smithi116.stdout:0/917: write d2/d5/f58 [2086254,121146] 0 2024-09-13T21:40:50.338 INFO:tasks.workunit.client.1.smithi116.stdout:0/918: rename d2/dc/d12/dfb to d2/dc/dcc/d129 0 2024-09-13T21:40:50.343 INFO:tasks.workunit.client.1.smithi116.stdout:8/790: sync 2024-09-13T21:40:50.343 INFO:tasks.workunit.client.1.smithi116.stdout:8/791: chown d2/d10/d19/d42/d45/c9d 96698033 1 2024-09-13T21:40:50.345 INFO:tasks.workunit.client.1.smithi116.stdout:8/792: link d2/d10/d19/fb1 d2/d10/d19/feb 0 2024-09-13T21:40:50.345 INFO:tasks.workunit.client.1.smithi116.stdout:8/793: write d2/d10/d19/d21/fdb [617139,114360] 0 2024-09-13T21:40:50.350 INFO:tasks.workunit.client.1.smithi116.stdout:0/919: dread d2/dc/d12/d28/fe5 [0,4194304] 0 2024-09-13T21:40:50.352 INFO:tasks.workunit.client.1.smithi116.stdout:0/920: creat d2/f12a x:0 0 0 2024-09-13T21:40:50.353 INFO:tasks.workunit.client.1.smithi116.stdout:0/921: rmdir d2/dc/d12/d28 39 2024-09-13T21:40:50.356 INFO:tasks.workunit.client.1.smithi116.stdout:0/922: creat d2/d5/d86/d8a/db1/f12b x:0 0 0 2024-09-13T21:40:50.363 INFO:tasks.workunit.client.1.smithi116.stdout:8/794: dwrite d2/d10/d19/d21/d69/f8b [0,4194304] 0 2024-09-13T21:40:50.363 INFO:tasks.workunit.client.1.smithi116.stdout:8/795: chown d2/d10/d19/d21/f2d 0 1 2024-09-13T21:40:50.365 INFO:tasks.workunit.client.1.smithi116.stdout:0/923: dread d2/fd1 [0,4194304] 0 2024-09-13T21:40:50.365 INFO:tasks.workunit.client.1.smithi116.stdout:0/924: write d2/dc/d47/d63/fed [2613417,122385] 0 2024-09-13T21:40:50.366 INFO:tasks.workunit.client.1.smithi116.stdout:0/925: mkdir d2/dc/d12/d12c 0 2024-09-13T21:40:50.366 INFO:tasks.workunit.client.1.smithi116.stdout:0/926: fdatasync d2/dc/d12/d28/d57/de3/f11c 0 2024-09-13T21:40:50.368 INFO:tasks.workunit.client.1.smithi116.stdout:0/927: dread d2/dc/f31 [0,4194304] 0 2024-09-13T21:40:50.368 INFO:tasks.workunit.client.1.smithi116.stdout:0/928: write d2/d5/d86/d8a/dd3/fd9 [695185,116826] 0 2024-09-13T21:40:50.373 INFO:tasks.workunit.client.1.smithi116.stdout:0/929: dread d2/fd1 [0,4194304] 0 2024-09-13T21:40:50.400 INFO:tasks.workunit.client.1.smithi116.stdout:0/930: dwrite d2/d5/f16 [0,4194304] 0 2024-09-13T21:40:50.402 INFO:tasks.workunit.client.1.smithi116.stdout:0/931: dread d2/dc/d47/d63/f7f [0,4194304] 0 2024-09-13T21:40:50.402 INFO:tasks.workunit.client.1.smithi116.stdout:0/932: stat d2/dc/d12/d51/d62/c5e 0 2024-09-13T21:40:50.414 INFO:tasks.workunit.client.1.smithi116.stdout:0/933: dread d2/dc/f127 [0,4194304] 0 2024-09-13T21:40:50.414 INFO:tasks.workunit.client.1.smithi116.stdout:0/934: chown d2/d5/fcb 21587 1 2024-09-13T21:40:50.415 INFO:tasks.workunit.client.1.smithi116.stdout:0/935: mknod d2/dc/d47/d63/d9f/c12d 0 2024-09-13T21:40:50.543 INFO:tasks.workunit.client.1.smithi116.stdout:1/646: sync 2024-09-13T21:40:50.543 INFO:tasks.workunit.client.1.smithi116.stdout:4/735: sync 2024-09-13T21:40:50.543 INFO:tasks.workunit.client.1.smithi116.stdout:2/718: sync 2024-09-13T21:40:50.543 INFO:tasks.workunit.client.1.smithi116.stdout:2/719: write d0/d5/d8/dd2/fe1 [705060,97641] 0 2024-09-13T21:40:50.544 INFO:tasks.workunit.client.1.smithi116.stdout:1/647: mkdir d4/d23/de8 0 2024-09-13T21:40:50.545 INFO:tasks.workunit.client.1.smithi116.stdout:1/648: symlink d4/d14/d52/d2f/d5c/daf/db9/le9 0 2024-09-13T21:40:50.545 INFO:tasks.workunit.client.1.smithi116.stdout:1/649: creat d4/d74/fea x:0 0 0 2024-09-13T21:40:50.545 INFO:tasks.workunit.client.1.smithi116.stdout:1/650: getdents d4/d14/db0/dc0 0 2024-09-13T21:40:50.545 INFO:tasks.workunit.client.1.smithi116.stdout:1/651: fdatasync d4/d14/d52/d2f/d5d/f9f 0 2024-09-13T21:40:50.546 INFO:tasks.workunit.client.1.smithi116.stdout:1/652: mknod d4/d14/d2a/ceb 0 2024-09-13T21:40:50.546 INFO:tasks.workunit.client.1.smithi116.stdout:4/736: dread d0/dd/f3b [0,4194304] 0 2024-09-13T21:40:50.546 INFO:tasks.workunit.client.1.smithi116.stdout:4/737: dread - d0/d32/d5d/d85/fda zero size 2024-09-13T21:40:50.547 INFO:tasks.workunit.client.1.smithi116.stdout:1/653: creat d4/d23/fec x:0 0 0 2024-09-13T21:40:50.547 INFO:tasks.workunit.client.1.smithi116.stdout:1/654: stat d4/l47 0 2024-09-13T21:40:50.548 INFO:tasks.workunit.client.1.smithi116.stdout:4/738: symlink d0/dd/d7c/ddf/le9 0 2024-09-13T21:40:50.549 INFO:tasks.workunit.client.1.smithi116.stdout:4/739: mknod d0/d32/cea 0 2024-09-13T21:40:50.551 INFO:tasks.workunit.client.1.smithi116.stdout:4/740: mknod d0/dd/d13/d5a/d86/ceb 0 2024-09-13T21:40:50.552 INFO:tasks.workunit.client.1.smithi116.stdout:4/741: mkdir d0/d32/d5d/d85/dec 0 2024-09-13T21:40:50.552 INFO:tasks.workunit.client.1.smithi116.stdout:4/742: write d0/d56/d84/fa4 [1495573,127592] 0 2024-09-13T21:40:50.554 INFO:tasks.workunit.client.1.smithi116.stdout:4/743: creat d0/dd/d13/fed x:0 0 0 2024-09-13T21:40:50.554 INFO:tasks.workunit.client.1.smithi116.stdout:4/744: chown d0/fb6 592798242 1 2024-09-13T21:40:50.554 INFO:tasks.workunit.client.1.smithi116.stdout:4/745: truncate d0/dd/fcb 356421 0 2024-09-13T21:40:50.565 INFO:tasks.workunit.client.1.smithi116.stdout:2/720: dwrite d0/d3a/d82/d62/d1f/d5d/fc2 [0,4194304] 0 2024-09-13T21:40:50.565 INFO:tasks.workunit.client.1.smithi116.stdout:1/655: dwrite d4/d23/fbc [4194304,4194304] 0 2024-09-13T21:40:50.568 INFO:tasks.workunit.client.1.smithi116.stdout:2/721: mknod d0/d5/cea 0 2024-09-13T21:40:50.569 INFO:tasks.workunit.client.1.smithi116.stdout:2/722: dread - d0/d3a/fe5 zero size 2024-09-13T21:40:50.570 INFO:tasks.workunit.client.1.smithi116.stdout:1/656: mknod d4/d14/d52/d2f/d5c/daf/dc3/ced 0 2024-09-13T21:40:50.572 INFO:tasks.workunit.client.1.smithi116.stdout:4/746: rename d0/dd/d13/d5a/d86 to d0/dd/d6b/dee 0 2024-09-13T21:40:50.575 INFO:tasks.workunit.client.1.smithi116.stdout:4/747: rmdir d0/dd/d13/dcc 0 2024-09-13T21:40:50.575 INFO:tasks.workunit.client.1.smithi116.stdout:4/748: write d0/dd/f3f [4158930,128160] 0 2024-09-13T21:40:50.577 INFO:tasks.workunit.client.1.smithi116.stdout:2/723: dread d0/d5/d2a/f57 [0,4194304] 0 2024-09-13T21:40:50.577 INFO:tasks.workunit.client.1.smithi116.stdout:2/724: chown d0/d3a/d82/d62/lc 6355902 1 2024-09-13T21:40:50.577 INFO:tasks.workunit.client.1.smithi116.stdout:2/725: creat d0/d5/d8/d7a/feb x:0 0 0 2024-09-13T21:40:50.577 INFO:tasks.workunit.client.1.smithi116.stdout:2/726: truncate d0/d3a/d82/d62/f9d 358562 0 2024-09-13T21:40:50.578 INFO:tasks.workunit.client.1.smithi116.stdout:2/727: creat d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/fec x:0 0 0 2024-09-13T21:40:50.580 INFO:tasks.workunit.client.1.smithi116.stdout:2/728: mknod d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/ced 0 2024-09-13T21:40:50.581 INFO:tasks.workunit.client.1.smithi116.stdout:2/729: mknod d0/d3a/d82/d62/d1f/d5d/d72/daa/cee 0 2024-09-13T21:40:50.585 INFO:tasks.workunit.client.1.smithi116.stdout:4/749: write d0/dd/d48/f9d [2716100,96811] 0 2024-09-13T21:40:50.588 INFO:tasks.workunit.client.1.smithi116.stdout:1/657: dwrite d4/d14/db0/fb7 [0,4194304] 0 2024-09-13T21:40:50.591 INFO:tasks.workunit.client.1.smithi116.stdout:1/658: rename d4/d23/d57/d92/lc5 to d4/d14/d52/d2f/d5d/dc7/lee 0 2024-09-13T21:40:50.591 INFO:tasks.workunit.client.1.smithi116.stdout:1/659: fsync d4/d14/d52/d2f/d91/dac/fdf 0 2024-09-13T21:40:50.595 INFO:tasks.workunit.client.1.smithi116.stdout:1/660: rmdir d4/d14/d41 39 2024-09-13T21:40:50.596 INFO:tasks.workunit.client.1.smithi116.stdout:1/661: readlink d4/d74/lc6 0 2024-09-13T21:40:50.597 INFO:tasks.workunit.client.1.smithi116.stdout:1/662: dread d4/d14/fa4 [0,4194304] 0 2024-09-13T21:40:50.598 INFO:tasks.workunit.client.1.smithi116.stdout:1/663: link d4/c11 d4/d23/d56/cef 0 2024-09-13T21:40:50.604 INFO:tasks.workunit.client.1.smithi116.stdout:2/730: dwrite d0/d5/d8/d7a/feb [0,4194304] 0 2024-09-13T21:40:50.604 INFO:tasks.workunit.client.1.smithi116.stdout:2/731: dread d0/d7/f84 [0,4194304] 0 2024-09-13T21:40:50.606 INFO:tasks.workunit.client.1.smithi116.stdout:4/750: dwrite d0/d32/da3/db7/fe6 [0,4194304] 0 2024-09-13T21:40:50.609 INFO:tasks.workunit.client.1.smithi116.stdout:1/664: dread d4/d14/d52/f99 [0,4194304] 0 2024-09-13T21:40:50.613 INFO:tasks.workunit.client.1.smithi116.stdout:2/732: dread d0/d5/d8/d7a/feb [0,4194304] 0 2024-09-13T21:40:50.613 INFO:tasks.workunit.client.1.smithi116.stdout:2/733: write d0/d3a/d82/d62/d75/d77/fe6 [786630,37436] 0 2024-09-13T21:40:50.614 INFO:tasks.workunit.client.1.smithi116.stdout:2/734: symlink d0/d7/d49/d93/lef 0 2024-09-13T21:40:50.614 INFO:tasks.workunit.client.1.smithi116.stdout:2/735: write d0/d5/d2a/fa7 [304916,107445] 0 2024-09-13T21:40:50.617 INFO:tasks.workunit.client.1.smithi116.stdout:2/736: truncate d0/d3a/d82/d62/f46 557288 0 2024-09-13T21:40:50.617 INFO:tasks.workunit.client.1.smithi116.stdout:2/737: fdatasync d0/d7/d49/f90 0 2024-09-13T21:40:50.620 INFO:tasks.workunit.client.1.smithi116.stdout:2/738: rmdir d0/d3a/d82/d62/d1f/d5d/d72/daa 39 2024-09-13T21:40:50.622 INFO:tasks.workunit.client.1.smithi116.stdout:2/739: mkdir d0/d7/d86/dd1/df0 0 2024-09-13T21:40:50.623 INFO:tasks.workunit.client.1.smithi116.stdout:2/740: mknod d0/d3a/d82/d62/d1f/d5d/d72/daa/cf1 0 2024-09-13T21:40:50.623 INFO:tasks.workunit.client.1.smithi116.stdout:2/741: truncate d0/d3a/d82/d62/f98 149191 0 2024-09-13T21:40:50.625 INFO:tasks.workunit.client.1.smithi116.stdout:2/742: symlink d0/d7/d2b/db6/lf2 0 2024-09-13T21:40:50.625 INFO:tasks.workunit.client.1.smithi116.stdout:2/743: creat d0/d3a/d82/d62/d1f/d5d/d60/ff3 x:0 0 0 2024-09-13T21:40:50.625 INFO:tasks.workunit.client.1.smithi116.stdout:2/744: chown d0/d5/d8/d7a/f91 9 1 2024-09-13T21:40:50.625 INFO:tasks.workunit.client.1.smithi116.stdout:2/745: truncate d0/d3a/d82/d62/d1f/d5d/d60/fbe 140232 0 2024-09-13T21:40:50.626 INFO:tasks.workunit.client.1.smithi116.stdout:1/665: dwrite d4/d74/fcb [0,4194304] 0 2024-09-13T21:40:50.626 INFO:tasks.workunit.client.1.smithi116.stdout:2/746: mkdir d0/d7/d86/df4 0 2024-09-13T21:40:50.626 INFO:tasks.workunit.client.1.smithi116.stdout:2/747: chown d0/l2f 3322692 1 2024-09-13T21:40:50.631 INFO:tasks.workunit.client.1.smithi116.stdout:2/748: rmdir d0/d3a/d82/d62/d1f/d5d/d72 39 2024-09-13T21:40:50.634 INFO:tasks.workunit.client.1.smithi116.stdout:2/749: creat d0/d7/d86/dd1/df0/ff5 x:0 0 0 2024-09-13T21:40:50.635 INFO:tasks.workunit.client.1.smithi116.stdout:1/666: rename d4/d14/db0 to d4/d14/d52/d2f/d91/dac/df0 0 2024-09-13T21:40:50.636 INFO:tasks.workunit.client.1.smithi116.stdout:2/750: creat d0/d3a/d82/d62/d1f/d5d/d89/ddc/ff6 x:0 0 0 2024-09-13T21:40:50.637 INFO:tasks.workunit.client.1.smithi116.stdout:1/667: symlink d4/d14/d52/d2f/d5d/dc7/lf1 0 2024-09-13T21:40:50.663 INFO:tasks.workunit.client.1.smithi116.stdout:2/751: dwrite d0/d5/d8/d7a/fbc [0,4194304] 0 2024-09-13T21:40:50.663 INFO:tasks.workunit.client.1.smithi116.stdout:1/668: dwrite d4/d14/d52/d2f/d91/dac/fdf [0,4194304] 0 2024-09-13T21:40:50.665 INFO:tasks.workunit.client.1.smithi116.stdout:2/752: unlink d0/d3a/d82/d68/l9f 0 2024-09-13T21:40:50.665 INFO:tasks.workunit.client.1.smithi116.stdout:2/753: creat d0/d5/d8/d7a/ff7 x:0 0 0 2024-09-13T21:40:50.665 INFO:tasks.workunit.client.1.smithi116.stdout:2/754: readlink d0/d7/d2b/d61/l67 0 2024-09-13T21:40:50.687 INFO:tasks.workunit.client.1.smithi116.stdout:1/669: dwrite d4/d74/d8d/f76 [0,4194304] 0 2024-09-13T21:40:50.687 INFO:tasks.workunit.client.1.smithi116.stdout:2/755: dwrite d0/d7/d2d/faf [0,4194304] 0 2024-09-13T21:40:50.690 INFO:tasks.workunit.client.1.smithi116.stdout:1/670: mkdir d4/d14/d2a/df2 0 2024-09-13T21:40:50.690 INFO:tasks.workunit.client.1.smithi116.stdout:1/671: mkdir d4/d14/d2a/df2/df3 0 2024-09-13T21:40:50.691 INFO:tasks.workunit.client.1.smithi116.stdout:1/672: creat d4/d14/d52/d2f/ff4 x:0 0 0 2024-09-13T21:40:50.692 INFO:tasks.workunit.client.1.smithi116.stdout:3/950: sync 2024-09-13T21:40:50.692 INFO:tasks.workunit.client.1.smithi116.stdout:9/546: sync 2024-09-13T21:40:50.693 INFO:tasks.workunit.client.1.smithi116.stdout:6/862: sync 2024-09-13T21:40:50.693 INFO:tasks.workunit.client.1.smithi116.stdout:5/913: sync 2024-09-13T21:40:50.693 INFO:tasks.workunit.client.1.smithi116.stdout:6/863: chown d8/d17/f19 724109 1 2024-09-13T21:40:50.693 INFO:tasks.workunit.client.1.smithi116.stdout:6/864: chown d8/d15/l66 2864 1 2024-09-13T21:40:50.693 INFO:tasks.workunit.client.1.smithi116.stdout:5/914: write d7/d1d/d64/d87/f9c [249718,22315] 0 2024-09-13T21:40:50.694 INFO:tasks.workunit.client.1.smithi116.stdout:3/951: mkdir d3/db/d10/d153 0 2024-09-13T21:40:50.694 INFO:tasks.workunit.client.1.smithi116.stdout:3/952: readlink d3/l1a 0 2024-09-13T21:40:50.694 INFO:tasks.workunit.client.1.smithi116.stdout:3/953: chown d3/db/d10/d99/ffa 45 1 2024-09-13T21:40:50.694 INFO:tasks.workunit.client.1.smithi116.stdout:3/954: truncate d3/db/d10/d99/f109 871981 0 2024-09-13T21:40:50.694 INFO:tasks.workunit.client.1.smithi116.stdout:3/955: write d3/db/d10/d1d/d5f/d6f/d71/f7d [2664529,125938] 0 2024-09-13T21:40:50.696 INFO:tasks.workunit.client.1.smithi116.stdout:3/956: mkdir d3/dd3/d147/d154 0 2024-09-13T21:40:50.701 INFO:tasks.workunit.client.1.smithi116.stdout:6/865: rename d8/d17/da6 to d8/d10/d24/d110/de2/d12a 0 2024-09-13T21:40:50.702 INFO:tasks.workunit.client.1.smithi116.stdout:2/756: dread d0/d7/d2d/faf [0,4194304] 0 2024-09-13T21:40:50.702 INFO:tasks.workunit.client.1.smithi116.stdout:2/757: fsync d0/d3a/d82/d62/d1f/f27 0 2024-09-13T21:40:50.703 INFO:tasks.workunit.client.1.smithi116.stdout:3/957: link d3/db/d3d/f13a d3/db/d121/f155 0 2024-09-13T21:40:50.706 INFO:tasks.workunit.client.1.smithi116.stdout:6/866: symlink d8/d10/d33/l12b 0 2024-09-13T21:40:50.709 INFO:tasks.workunit.client.1.smithi116.stdout:2/758: mknod d0/d3a/d82/d62/d1f/cf8 0 2024-09-13T21:40:50.709 INFO:tasks.workunit.client.1.smithi116.stdout:2/759: dread - d0/d3a/d82/d62/d1f/d5d/d89/fd7 zero size 2024-09-13T21:40:50.711 INFO:tasks.workunit.client.1.smithi116.stdout:6/867: unlink d8/d15/l56 0 2024-09-13T21:40:50.711 INFO:tasks.workunit.client.1.smithi116.stdout:6/868: fdatasync d8/d1e/f63 0 2024-09-13T21:40:50.713 INFO:tasks.workunit.client.1.smithi116.stdout:3/958: rmdir d3/db/d10/d29 39 2024-09-13T21:40:50.715 INFO:tasks.workunit.client.1.smithi116.stdout:2/760: dread d0/d3a/d82/f52 [0,4194304] 0 2024-09-13T21:40:50.715 INFO:tasks.workunit.client.1.smithi116.stdout:6/869: link d8/cc d8/d15/d2e/d2f/d38/d112/df4/c12c 0 2024-09-13T21:40:50.716 INFO:tasks.workunit.client.1.smithi116.stdout:3/959: mkdir d3/db/d10/d1d/d5f/d6f/d71/d156 0 2024-09-13T21:40:50.716 INFO:tasks.workunit.client.1.smithi116.stdout:3/960: dread - d3/db/d3d/f13a zero size 2024-09-13T21:40:50.717 INFO:tasks.workunit.client.1.smithi116.stdout:2/761: link d0/d3a/cb2 d0/d7/d2b/d61/cf9 0 2024-09-13T21:40:50.719 INFO:tasks.workunit.client.1.smithi116.stdout:2/762: unlink d0/d3a/d82/c15 0 2024-09-13T21:40:50.719 INFO:tasks.workunit.client.1.smithi116.stdout:2/763: read d0/d3a/d82/f52 [103886,53290] 0 2024-09-13T21:40:50.720 INFO:tasks.workunit.client.1.smithi116.stdout:6/870: rmdir d8/d1e 39 2024-09-13T21:40:50.721 INFO:tasks.workunit.client.1.smithi116.stdout:6/871: link d8/d15/d2e/d2f/d38/d112/df4/f11b d8/d10/d24/d110/f12d 0 2024-09-13T21:40:50.722 INFO:tasks.workunit.client.1.smithi116.stdout:6/872: symlink d8/d15/d2e/d2f/d38/l12e 0 2024-09-13T21:40:50.727 INFO:tasks.workunit.client.1.smithi116.stdout:5/915: dwrite d7/f5d [0,4194304] 0 2024-09-13T21:40:50.727 INFO:tasks.workunit.client.1.smithi116.stdout:9/547: dwrite d2/f6d [0,4194304] 0 2024-09-13T21:40:50.727 INFO:tasks.workunit.client.1.smithi116.stdout:9/548: truncate d2/d10/d14/fa1 785569 0 2024-09-13T21:40:50.727 INFO:tasks.workunit.client.1.smithi116.stdout:9/549: readlink d2/d10/d14/d38/d3a/l3c 0 2024-09-13T21:40:50.727 INFO:tasks.workunit.client.1.smithi116.stdout:9/550: readlink d2/d10/d14/d38/d3a/l78 0 2024-09-13T21:40:50.727 INFO:tasks.workunit.client.1.smithi116.stdout:9/551: fsync d2/f6d 0 2024-09-13T21:40:50.731 INFO:tasks.workunit.client.1.smithi116.stdout:9/552: link d2/f2d d2/d43/fa2 0 2024-09-13T21:40:50.732 INFO:tasks.workunit.client.1.smithi116.stdout:3/961: dread d3/db/d26/f78 [0,4194304] 0 2024-09-13T21:40:50.732 INFO:tasks.workunit.client.1.smithi116.stdout:3/962: truncate d3/db/f31 363316 0 2024-09-13T21:40:50.733 INFO:tasks.workunit.client.1.smithi116.stdout:1/673: dwrite d4/d74/d8d/f55 [0,4194304] 0 2024-09-13T21:40:50.733 INFO:tasks.workunit.client.1.smithi116.stdout:1/674: fsync d4/d23/d57/f65 0 2024-09-13T21:40:50.734 INFO:tasks.workunit.client.1.smithi116.stdout:1/675: write d4/d14/d52/d2f/d91/f94 [182926,67537] 0 2024-09-13T21:40:50.734 INFO:tasks.workunit.client.1.smithi116.stdout:1/676: stat d4/d14/d2a/lcd 0 2024-09-13T21:40:50.736 INFO:tasks.workunit.client.1.smithi116.stdout:9/553: mknod d2/d5d/d69/d7d/ca3 0 2024-09-13T21:40:50.739 INFO:tasks.workunit.client.1.smithi116.stdout:3/963: link d3/db/d10/d1d/c104 d3/db/d10/d1c/d63/c157 0 2024-09-13T21:40:50.740 INFO:tasks.workunit.client.1.smithi116.stdout:3/964: readlink d3/db/l4d 0 2024-09-13T21:40:50.740 INFO:tasks.workunit.client.1.smithi116.stdout:3/965: chown d3/db/d3d/d110 509273 1 2024-09-13T21:40:50.741 INFO:tasks.workunit.client.1.smithi116.stdout:9/554: symlink d2/d10/d14/d38/d3a/la4 0 2024-09-13T21:40:50.744 INFO:tasks.workunit.client.1.smithi116.stdout:1/677: getdents d4/d14/d52/d2f/d5c/daf 0 2024-09-13T21:40:50.744 INFO:tasks.workunit.client.1.smithi116.stdout:1/678: stat d4/d23/d56/c9e 0 2024-09-13T21:40:50.745 INFO:tasks.workunit.client.1.smithi116.stdout:1/679: creat d4/d14/d52/d2f/d91/dac/ff5 x:0 0 0 2024-09-13T21:40:50.745 INFO:tasks.workunit.client.1.smithi116.stdout:1/680: fdatasync d4/d14/f9c 0 2024-09-13T21:40:50.745 INFO:tasks.workunit.client.1.smithi116.stdout:1/681: chown d4/d23/d56/da3/dc4 129 1 2024-09-13T21:40:50.748 INFO:tasks.workunit.client.1.smithi116.stdout:1/682: mknod d4/d14/d41/cf6 0 2024-09-13T21:40:50.748 INFO:tasks.workunit.client.1.smithi116.stdout:1/683: write d4/d14/d2a/fbf [645420,110268] 0 2024-09-13T21:40:50.757 INFO:tasks.workunit.client.1.smithi116.stdout:1/684: dread d4/d14/d52/d2f/d91/dac/df0/fb7 [0,4194304] 0 2024-09-13T21:40:50.759 INFO:tasks.workunit.client.1.smithi116.stdout:1/685: mknod d4/d74/d8d/d5f/cf7 0 2024-09-13T21:40:50.759 INFO:tasks.workunit.client.1.smithi116.stdout:1/686: readlink d4/d74/d8d/l46 0 2024-09-13T21:40:50.759 INFO:tasks.workunit.client.1.smithi116.stdout:1/687: readlink d4/d14/d41/dab/lae 0 2024-09-13T21:40:50.759 INFO:tasks.workunit.client.1.smithi116.stdout:1/688: creat d4/d14/d52/d2f/d91/ff8 x:0 0 0 2024-09-13T21:40:50.762 INFO:tasks.workunit.client.1.smithi116.stdout:2/764: dwrite d0/d7/d2d/f6a [0,4194304] 0 2024-09-13T21:40:50.764 INFO:tasks.workunit.client.1.smithi116.stdout:5/916: dwrite d7/d1d/d64/d87/fc7 [0,4194304] 0 2024-09-13T21:40:50.764 INFO:tasks.workunit.client.1.smithi116.stdout:6/873: dwrite d8/d17/d70/ffe [0,4194304] 0 2024-09-13T21:40:50.765 INFO:tasks.workunit.client.1.smithi116.stdout:6/874: fdatasync d8/fa 0 2024-09-13T21:40:50.767 INFO:tasks.workunit.client.1.smithi116.stdout:1/689: fdatasync d4/d14/d2a/fbf 0 2024-09-13T21:40:50.767 INFO:tasks.workunit.client.1.smithi116.stdout:5/917: symlink d7/d1d/d46/d5c/dcc/l130 0 2024-09-13T21:40:50.775 INFO:tasks.workunit.client.1.smithi116.stdout:9/555: getdents d2/d10/d14/d38/d3a 0 2024-09-13T21:40:50.782 INFO:tasks.workunit.client.1.smithi116.stdout:1/690: unlink d4/d14/d2a/l2d 0 2024-09-13T21:40:50.782 INFO:tasks.workunit.client.1.smithi116.stdout:1/691: creat d4/d14/d52/d2f/ff9 x:0 0 0 2024-09-13T21:40:50.784 INFO:tasks.workunit.client.1.smithi116.stdout:5/918: unlink d7/d1d/l7c 0 2024-09-13T21:40:50.792 INFO:tasks.workunit.client.1.smithi116.stdout:9/556: write d2/d10/d14/d38/d3a/f6c [3223593,33728] 0 2024-09-13T21:40:50.795 INFO:tasks.workunit.client.1.smithi116.stdout:7/887: sync 2024-09-13T21:40:50.796 INFO:tasks.workunit.client.1.smithi116.stdout:6/875: dwrite d8/d17/d70/da0/daf/d113/f68 [0,4194304] 0 2024-09-13T21:40:50.802 INFO:tasks.workunit.client.1.smithi116.stdout:7/888: rename d5/d9/db/d21/l110 to d5/d9/db/l127 0 2024-09-13T21:40:50.805 INFO:tasks.workunit.client.1.smithi116.stdout:7/889: unlink d5/d9/d27/ded/d2e/d52/f11c 0 2024-09-13T21:40:50.806 INFO:tasks.workunit.client.1.smithi116.stdout:7/890: write d5/d9/d27/ded/d22/d24/d6b/d72/fe1 [1053076,43137] 0 2024-09-13T21:40:50.806 INFO:tasks.workunit.client.1.smithi116.stdout:6/876: dread d8/d10/d33/f8a [0,4194304] 0 2024-09-13T21:40:50.807 INFO:tasks.workunit.client.1.smithi116.stdout:7/891: mknod d5/db0/c128 0 2024-09-13T21:40:50.807 INFO:tasks.workunit.client.1.smithi116.stdout:7/892: write d5/d9/fea [1627454,99498] 0 2024-09-13T21:40:50.807 INFO:tasks.workunit.client.1.smithi116.stdout:9/557: dread d2/d43/f8e [0,4194304] 0 2024-09-13T21:40:50.808 INFO:tasks.workunit.client.1.smithi116.stdout:6/877: creat d8/d17/d70/da0/daf/f12f x:0 0 0 2024-09-13T21:40:50.808 INFO:tasks.workunit.client.1.smithi116.stdout:6/878: readlink d8/d1e/l84 0 2024-09-13T21:40:50.808 INFO:tasks.workunit.client.1.smithi116.stdout:6/879: truncate d8/d17/d70/da0/daf/d113/f109 312097 0 2024-09-13T21:40:50.808 INFO:tasks.workunit.client.1.smithi116.stdout:6/880: fdatasync d8/d15/d2e/d2f/d38/f45 0 2024-09-13T21:40:50.809 INFO:tasks.workunit.client.1.smithi116.stdout:7/893: stat d5/d9/d27/ded/d22/d24/l10c 0 2024-09-13T21:40:50.809 INFO:tasks.workunit.client.1.smithi116.stdout:7/894: creat d5/d9/f129 x:0 0 0 2024-09-13T21:40:50.809 INFO:tasks.workunit.client.1.smithi116.stdout:7/895: dread - d5/d9/d27/d31/d38/fd3 zero size 2024-09-13T21:40:50.809 INFO:tasks.workunit.client.1.smithi116.stdout:9/558: mknod d2/d10/d6e/ca5 0 2024-09-13T21:40:50.810 INFO:tasks.workunit.client.1.smithi116.stdout:9/559: write d2/d8/fd [22072,87079] 0 2024-09-13T21:40:50.812 INFO:tasks.workunit.client.1.smithi116.stdout:5/919: dwrite d7/f25 [0,4194304] 0 2024-09-13T21:40:50.812 INFO:tasks.workunit.client.1.smithi116.stdout:7/896: link d5/d9/d27/d31/d38/fd3 d5/d9/d27/ded/d22/d24/d3a/ddc/f12a 0 2024-09-13T21:40:50.813 INFO:tasks.workunit.client.1.smithi116.stdout:9/560: symlink d2/d10/la6 0 2024-09-13T21:40:50.817 INFO:tasks.workunit.client.1.smithi116.stdout:5/920: creat d7/d1d/d46/dd4/d5e/d65/f131 x:0 0 0 2024-09-13T21:40:50.817 INFO:tasks.workunit.client.1.smithi116.stdout:5/921: chown d7/d9a 12840 1 2024-09-13T21:40:50.817 INFO:tasks.workunit.client.1.smithi116.stdout:5/922: fdatasync d7/d40/d90/fc5 0 2024-09-13T21:40:50.818 INFO:tasks.workunit.client.1.smithi116.stdout:7/897: mkdir d5/d9/d27/ded/d22/d24/d3a/d112/d12b 0 2024-09-13T21:40:50.820 INFO:tasks.workunit.client.1.smithi116.stdout:6/881: dread d8/d1e/f28 [0,4194304] 0 2024-09-13T21:40:50.820 INFO:tasks.workunit.client.1.smithi116.stdout:1/692: dwrite d4/d14/d52/d2f/d5c/daf/fe6 [0,4194304] 0 2024-09-13T21:40:50.820 INFO:tasks.workunit.client.1.smithi116.stdout:6/882: fsync d8/d10/fd9 0 2024-09-13T21:40:50.821 INFO:tasks.workunit.client.1.smithi116.stdout:7/898: mknod d5/d9/d27/ded/d22/d24/d6b/d72/d74/d93/d11b/c12c 0 2024-09-13T21:40:50.825 INFO:tasks.workunit.client.1.smithi116.stdout:7/899: dread d5/fd5 [0,4194304] 0 2024-09-13T21:40:50.825 INFO:tasks.workunit.client.1.smithi116.stdout:7/900: write d5/d9/d27/ded/d2e/d52/ffe [4191375,112864] 0 2024-09-13T21:40:50.825 INFO:tasks.workunit.client.1.smithi116.stdout:7/901: creat d5/d9/d27/d31/d38/f12d x:0 0 0 2024-09-13T21:40:50.831 INFO:tasks.workunit.client.1.smithi116.stdout:6/883: dread d8/d15/f1f [4194304,4194304] 0 2024-09-13T21:40:50.834 INFO:tasks.workunit.client.1.smithi116.stdout:7/902: link d5/d9/d27/ded/d22/d24/d3a/ddc/l10d d5/d9/d27/ded/l12e 0 2024-09-13T21:40:50.835 INFO:tasks.workunit.client.1.smithi116.stdout:1/693: dread d4/d14/d52/d2f/d5c/daf/fe6 [0,4194304] 0 2024-09-13T21:40:50.835 INFO:tasks.workunit.client.1.smithi116.stdout:5/923: dwrite d7/d1d/d46/d85/d96/da8/df0/f12d [0,4194304] 0 2024-09-13T21:40:50.835 INFO:tasks.workunit.client.1.smithi116.stdout:5/924: readlink d7/d1d/d46/dd4/d5e/d65/d6a/l74 0 2024-09-13T21:40:50.835 INFO:tasks.workunit.client.1.smithi116.stdout:5/925: truncate d7/d40/d53/f61 2447070 0 2024-09-13T21:40:50.836 INFO:tasks.workunit.client.1.smithi116.stdout:5/926: read - d7/d1d/d46/dd4/d5e/d79/dcb/fcd zero size 2024-09-13T21:40:50.836 INFO:tasks.workunit.client.1.smithi116.stdout:5/927: write d7/d1d/d46/dd4/d5e/d65/d6a/ff5 [1795775,27032] 0 2024-09-13T21:40:50.836 INFO:tasks.workunit.client.1.smithi116.stdout:5/928: dread - d7/d1d/d46/d5c/dcc/f11b zero size 2024-09-13T21:40:50.836 INFO:tasks.workunit.client.1.smithi116.stdout:6/884: rename d8/d15/d2e/d9e/lb3 to d8/d15/d2e/d2f/d38/d9c/l130 0 2024-09-13T21:40:50.839 INFO:tasks.workunit.client.1.smithi116.stdout:7/903: unlink d5/d9/db/d21/d6e/d6f/d70/cac 0 2024-09-13T21:40:50.840 INFO:tasks.workunit.client.1.smithi116.stdout:7/904: write d5/d9/d27/d31/d38/f12d [540648,63444] 0 2024-09-13T21:40:50.845 INFO:tasks.workunit.client.1.smithi116.stdout:6/885: rename d8/l60 to d8/d11c/l131 0 2024-09-13T21:40:50.848 INFO:tasks.workunit.client.1.smithi116.stdout:6/886: rename d8/d10/d24/c96 to d8/db5/c132 0 2024-09-13T21:40:50.860 INFO:tasks.workunit.client.1.smithi116.stdout:1/694: dwrite d4/d74/d8d/d5f/f78 [0,4194304] 0 2024-09-13T21:40:50.860 INFO:tasks.workunit.client.1.smithi116.stdout:1/695: write d4/d23/d57/f65 [4426212,51277] 0 2024-09-13T21:40:50.860 INFO:tasks.workunit.client.1.smithi116.stdout:1/696: fsync d4/d14/f48 0 2024-09-13T21:40:50.862 INFO:tasks.workunit.client.1.smithi116.stdout:1/697: symlink d4/d14/d52/d2f/d5d/dc7/lfa 0 2024-09-13T21:40:50.863 INFO:tasks.workunit.client.1.smithi116.stdout:1/698: truncate d4/d14/d52/d2f/d91/ff8 1032060 0 2024-09-13T21:40:50.863 INFO:tasks.workunit.client.1.smithi116.stdout:1/699: mknod d4/d74/d8d/d5f/cfb 0 2024-09-13T21:40:50.863 INFO:tasks.workunit.client.1.smithi116.stdout:1/700: creat d4/d14/d52/d2f/d5c/ffc x:0 0 0 2024-09-13T21:40:50.865 INFO:tasks.workunit.client.1.smithi116.stdout:1/701: symlink d4/d14/d52/lfd 0 2024-09-13T21:40:50.865 INFO:tasks.workunit.client.1.smithi116.stdout:1/702: stat d4/d14/l9b 0 2024-09-13T21:40:50.866 INFO:tasks.workunit.client.1.smithi116.stdout:1/703: mknod d4/d14/d2a/cfe 0 2024-09-13T21:40:50.872 INFO:tasks.workunit.client.1.smithi116.stdout:5/929: dwrite d7/f114 [0,4194304] 0 2024-09-13T21:40:50.872 INFO:tasks.workunit.client.1.smithi116.stdout:5/930: creat d7/d1d/d46/d5c/dcc/f132 x:0 0 0 2024-09-13T21:40:50.872 INFO:tasks.workunit.client.1.smithi116.stdout:5/931: getdents d7/d1d/d64/d11e 0 2024-09-13T21:40:50.872 INFO:tasks.workunit.client.1.smithi116.stdout:5/932: dread - d7/d1d/d46/dd4/d5e/d65/d6a/f127 zero size 2024-09-13T21:40:50.873 INFO:tasks.workunit.client.1.smithi116.stdout:7/905: dwrite d5/d9/d27/ded/d22/d24/d6b/d72/d74/d93/fc4 [0,4194304] 0 2024-09-13T21:40:50.873 INFO:tasks.workunit.client.1.smithi116.stdout:7/906: chown d5/d9/db/f3c 55147 1 2024-09-13T21:40:50.874 INFO:tasks.workunit.client.1.smithi116.stdout:7/907: fdatasync d5/d9/d27/d31/d38/d48/f101 0 2024-09-13T21:40:50.875 INFO:tasks.workunit.client.1.smithi116.stdout:5/933: creat d7/d1d/d46/dd4/d5e/d65/da5/f133 x:0 0 0 2024-09-13T21:40:50.880 INFO:tasks.workunit.client.1.smithi116.stdout:1/704: write d4/d14/d52/d2f/d91/dac/fdf [2418042,81158] 0 2024-09-13T21:40:50.881 INFO:tasks.workunit.client.1.smithi116.stdout:1/705: chown d4/l75 91287 1 2024-09-13T21:40:50.884 INFO:tasks.workunit.client.1.smithi116.stdout:7/908: symlink d5/d9/d27/ded/d2e/d52/l12f 0 2024-09-13T21:40:50.886 INFO:tasks.workunit.client.1.smithi116.stdout:5/934: link d7/d1d/dbb/fd3 d7/d40/d80/d125/f134 0 2024-09-13T21:40:50.889 INFO:tasks.workunit.client.1.smithi116.stdout:1/706: mkdir d4/d14/d52/d2f/d5c/dff 0 2024-09-13T21:40:50.889 INFO:tasks.workunit.client.1.smithi116.stdout:1/707: write d4/d14/d52/d2f/d5d/f9f [1462776,62286] 0 2024-09-13T21:40:50.889 INFO:tasks.workunit.client.1.smithi116.stdout:1/708: write d4/d14/d52/d2f/d91/dac/fdf [2634984,23620] 0 2024-09-13T21:40:50.890 INFO:tasks.workunit.client.1.smithi116.stdout:1/709: chown d4/c21 105522676 1 2024-09-13T21:40:50.893 INFO:tasks.workunit.client.1.smithi116.stdout:7/909: rename d5/f8 to d5/d9/db/d21/d6e/d6f/d70/d80/db1/f130 0 2024-09-13T21:40:50.894 INFO:tasks.workunit.client.1.smithi116.stdout:5/935: creat d7/d1d/d46/d85/d96/dd6/f135 x:0 0 0 2024-09-13T21:40:50.894 INFO:tasks.workunit.client.1.smithi116.stdout:5/936: dread - d7/d1d/d46/d85/d96/da8/ff8 zero size 2024-09-13T21:40:50.894 INFO:tasks.workunit.client.1.smithi116.stdout:5/937: dread - d7/d1d/d46/d85/d96/dd6/dd8/f12e zero size 2024-09-13T21:40:50.894 INFO:tasks.workunit.client.1.smithi116.stdout:5/938: chown d7/d1d/d64/d87/f115 42514772 1 2024-09-13T21:40:50.895 INFO:tasks.workunit.client.1.smithi116.stdout:1/710: mkdir d4/d14/d2a/dd3/d100 0 2024-09-13T21:40:50.896 INFO:tasks.workunit.client.1.smithi116.stdout:7/910: mknod d5/d9/db/d21/d6e/d6f/d70/d80/db1/c131 0 2024-09-13T21:40:50.897 INFO:tasks.workunit.client.1.smithi116.stdout:7/911: stat d5/d9/d27/ded/d22 0 2024-09-13T21:40:50.898 INFO:tasks.workunit.client.1.smithi116.stdout:5/939: mkdir d7/d1d/d46/d85/d96/dd6/d128/d136 0 2024-09-13T21:40:50.898 INFO:tasks.workunit.client.1.smithi116.stdout:5/940: readlink d7/d40/d53/l62 0 2024-09-13T21:40:50.898 INFO:tasks.workunit.client.1.smithi116.stdout:5/941: write d7/d1d/de3/fee [732122,111139] 0 2024-09-13T21:40:50.899 INFO:tasks.workunit.client.1.smithi116.stdout:1/711: mkdir d4/d23/d57/d101 0 2024-09-13T21:40:50.899 INFO:tasks.workunit.client.1.smithi116.stdout:1/712: chown d4/d23/d56/da3/cb4 126 1 2024-09-13T21:40:50.901 INFO:tasks.workunit.client.1.smithi116.stdout:5/942: link d7/d1d/d46/d5c/dcc/l130 d7/d1d/d46/dd4/d5e/d65/d6f/dd5/l137 0 2024-09-13T21:40:50.901 INFO:tasks.workunit.client.1.smithi116.stdout:5/943: readlink d7/d1d/l1e 0 2024-09-13T21:40:50.903 INFO:tasks.workunit.client.1.smithi116.stdout:1/713: creat d4/d14/d52/d2f/d5c/dff/f102 x:0 0 0 2024-09-13T21:40:50.904 INFO:tasks.workunit.client.1.smithi116.stdout:8/796: sync 2024-09-13T21:40:50.904 INFO:tasks.workunit.client.1.smithi116.stdout:4/751: sync 2024-09-13T21:40:50.905 INFO:tasks.workunit.client.1.smithi116.stdout:0/936: sync 2024-09-13T21:40:50.905 INFO:tasks.workunit.client.1.smithi116.stdout:1/714: creat d4/d23/d57/d101/f103 x:0 0 0 2024-09-13T21:40:50.908 INFO:tasks.workunit.client.1.smithi116.stdout:4/752: rename d0/dd/faf to d0/dd/d6b/d92/d95/ddd/fef 0 2024-09-13T21:40:50.910 INFO:tasks.workunit.client.1.smithi116.stdout:1/715: creat d4/d23/d56/da3/dc4/f104 x:0 0 0 2024-09-13T21:40:50.910 INFO:tasks.workunit.client.1.smithi116.stdout:1/716: fdatasync d4/f8b 0 2024-09-13T21:40:50.910 INFO:tasks.workunit.client.1.smithi116.stdout:1/717: fdatasync d4/d74/d8d/f76 0 2024-09-13T21:40:50.913 INFO:tasks.workunit.client.1.smithi116.stdout:7/912: read d5/d9/db/d21/f3e [411027,75132] 0 2024-09-13T21:40:50.913 INFO:tasks.workunit.client.1.smithi116.stdout:1/718: mknod d4/d74/c105 0 2024-09-13T21:40:50.913 INFO:tasks.workunit.client.1.smithi116.stdout:1/719: fsync d4/d23/f27 0 2024-09-13T21:40:50.913 INFO:tasks.workunit.client.1.smithi116.stdout:7/913: chown d5/d9/d27/ded/d2e/d52/f102 7 1 2024-09-13T21:40:50.918 INFO:tasks.workunit.client.1.smithi116.stdout:8/797: dread d2/d10/d19/d21/f47 [0,4194304] 0 2024-09-13T21:40:50.923 INFO:tasks.workunit.client.1.smithi116.stdout:7/914: dread d5/d9/d27/ded/d22/d24/d3a/fb6 [0,4194304] 0 2024-09-13T21:40:50.923 INFO:tasks.workunit.client.1.smithi116.stdout:7/915: chown d5/d9/d27/d31/d105/f106 20 1 2024-09-13T21:40:50.923 INFO:tasks.workunit.client.1.smithi116.stdout:0/937: dwrite d2/dc/d47/d121/fdd [0,4194304] 0 2024-09-13T21:40:50.924 INFO:tasks.workunit.client.1.smithi116.stdout:0/938: chown d2/dc/d12/fda 1472748 1 2024-09-13T21:40:50.924 INFO:tasks.workunit.client.1.smithi116.stdout:7/916: creat d5/d9/db/d21/f132 x:0 0 0 2024-09-13T21:40:50.928 INFO:tasks.workunit.client.1.smithi116.stdout:0/939: mknod d2/d11d/c12e 0 2024-09-13T21:40:50.928 INFO:tasks.workunit.client.1.smithi116.stdout:0/940: readlink d2/dc/l5f 0 2024-09-13T21:40:50.930 INFO:tasks.workunit.client.1.smithi116.stdout:7/917: mkdir d5/d9/d27/ded/d22/dae/d133 0 2024-09-13T21:40:50.930 INFO:tasks.workunit.client.1.smithi116.stdout:4/753: dwrite d0/dd/f70 [0,4194304] 0 2024-09-13T21:40:50.930 INFO:tasks.workunit.client.1.smithi116.stdout:4/754: readlink d0/d32/d5d/d85/laa 0 2024-09-13T21:40:50.930 INFO:tasks.workunit.client.1.smithi116.stdout:4/755: readlink d0/dd/d13/l14 0 2024-09-13T21:40:50.931 INFO:tasks.workunit.client.1.smithi116.stdout:0/941: creat d2/d5b/f12f x:0 0 0 2024-09-13T21:40:50.933 INFO:tasks.workunit.client.1.smithi116.stdout:7/918: mkdir d5/d9/d27/ded/d22/d24/d134 0 2024-09-13T21:40:50.936 INFO:tasks.workunit.client.1.smithi116.stdout:0/942: symlink d2/dc/dcf/dd7/l130 0 2024-09-13T21:40:50.936 INFO:tasks.workunit.client.1.smithi116.stdout:0/943: write d2/dc/d12/d28/d57/d65/fe4 [217662,71426] 0 2024-09-13T21:40:50.948 INFO:tasks.workunit.client.1.smithi116.stdout:8/798: dwrite d2/d10/d4b/f51 [0,4194304] 0 2024-09-13T21:40:50.948 INFO:tasks.workunit.client.1.smithi116.stdout:8/799: write d2/d27/d66/fc4 [240466,31893] 0 2024-09-13T21:40:50.950 INFO:tasks.workunit.client.1.smithi116.stdout:0/944: write d2/dc/d12/d28/d57/f90 [2859440,84708] 0 2024-09-13T21:40:50.950 INFO:tasks.workunit.client.1.smithi116.stdout:0/945: chown d2/d5/dbe/ldb 63724 1 2024-09-13T21:40:50.955 INFO:tasks.workunit.client.1.smithi116.stdout:0/946: write d2/dc/d12/d28/fe5 [1552289,108302] 0 2024-09-13T21:40:50.956 INFO:tasks.workunit.client.1.smithi116.stdout:0/947: link d2/dc/d12/d28/c125 d2/dc/d47/d63/c131 0 2024-09-13T21:40:50.956 INFO:tasks.workunit.client.1.smithi116.stdout:0/948: stat d2/dc/d47/d63/d9f/db6 0 2024-09-13T21:40:50.959 INFO:tasks.workunit.client.1.smithi116.stdout:0/949: rename d2/dc/f22 to d2/d5/dbe/f132 0 2024-09-13T21:40:50.961 INFO:tasks.workunit.client.1.smithi116.stdout:7/919: dwrite d5/d9/f10 [0,4194304] 0 2024-09-13T21:40:50.961 INFO:tasks.workunit.client.1.smithi116.stdout:7/920: fsync d5/db0/fce 0 2024-09-13T21:40:50.961 INFO:tasks.workunit.client.1.smithi116.stdout:7/921: stat d5/d9/d27/ded/d2e/l68 0 2024-09-13T21:40:50.963 INFO:tasks.workunit.client.1.smithi116.stdout:8/800: dread d2/d27/d62/fab [0,4194304] 0 2024-09-13T21:40:50.965 INFO:tasks.workunit.client.1.smithi116.stdout:8/801: mkdir d2/d27/d66/dcc/dec 0 2024-09-13T21:40:50.966 INFO:tasks.workunit.client.1.smithi116.stdout:8/802: write d2/d10/d19/fb1 [2621914,75067] 0 2024-09-13T21:40:50.966 INFO:tasks.workunit.client.1.smithi116.stdout:8/803: truncate d2/d5c/f85 904462 0 2024-09-13T21:40:50.966 INFO:tasks.workunit.client.1.smithi116.stdout:8/804: creat d2/d10/fed x:0 0 0 2024-09-13T21:40:50.969 INFO:tasks.workunit.client.1.smithi116.stdout:8/805: symlink d2/d10/d19/d97/dc9/lee 0 2024-09-13T21:40:50.969 INFO:tasks.workunit.client.1.smithi116.stdout:8/806: chown d2/d10/d3e/le2 427 1 2024-09-13T21:40:50.969 INFO:tasks.workunit.client.1.smithi116.stdout:8/807: write d2/d10/d19/d3a/d4c/d7a/fc0 [1190318,15159] 0 2024-09-13T21:40:50.973 INFO:tasks.workunit.client.1.smithi116.stdout:0/950: write d2/d5b/fb5 [990058,48230] 0 2024-09-13T21:40:50.973 INFO:tasks.workunit.client.1.smithi116.stdout:0/951: fsync d2/dc/f127 0 2024-09-13T21:40:50.976 INFO:tasks.workunit.client.1.smithi116.stdout:0/952: creat d2/dc/d12/d28/d57/f133 x:0 0 0 2024-09-13T21:40:50.976 INFO:tasks.workunit.client.1.smithi116.stdout:0/953: stat d2/dc/d12/d28/d57/d65/fe4 0 2024-09-13T21:40:50.993 INFO:tasks.workunit.client.1.smithi116.stdout:7/922: dwrite d5/d9/d27/ded/d22/fdb [0,4194304] 0 2024-09-13T21:40:50.993 INFO:tasks.workunit.client.1.smithi116.stdout:8/808: dwrite d2/f6d [0,4194304] 0 2024-09-13T21:40:50.996 INFO:tasks.workunit.client.1.smithi116.stdout:0/954: dwrite d2/dc/d12/d51/d62/fa6 [0,4194304] 0 2024-09-13T21:40:50.997 INFO:tasks.workunit.client.1.smithi116.stdout:7/923: link d5/d9/db/d21/d6e/d6f/f88 d5/d9/d27/ded/d22/dae/d133/f135 0 2024-09-13T21:40:51.001 INFO:tasks.workunit.client.1.smithi116.stdout:7/924: link d5/d9/d27/fb4 d5/d9/d27/ded/d22/d24/f136 0 2024-09-13T21:40:51.013 INFO:tasks.workunit.client.1.smithi116.stdout:0/955: dwrite d2/dc/fe [0,4194304] 0 2024-09-13T21:40:51.016 INFO:tasks.workunit.client.1.smithi116.stdout:8/809: rmdir d2 39 2024-09-13T21:40:51.016 INFO:tasks.workunit.client.1.smithi116.stdout:7/925: rmdir d5/d9/d27/ded/d22/d24/d6b/d72/d74/d93 39 2024-09-13T21:40:51.018 INFO:tasks.workunit.client.1.smithi116.stdout:7/926: creat d5/d9/d27/ded/d22/d24/d5f/de5/f137 x:0 0 0 2024-09-13T21:40:51.025 INFO:tasks.workunit.client.1.smithi116.stdout:8/810: dread d2/d27/d66/fc4 [0,4194304] 0 2024-09-13T21:40:51.025 INFO:tasks.workunit.client.1.smithi116.stdout:8/811: readlink d2/d27/d66/d7c/l8f 0 2024-09-13T21:40:51.026 INFO:tasks.workunit.client.1.smithi116.stdout:0/956: dwrite d2/d5/f7e [4194304,4194304] 0 2024-09-13T21:40:51.028 INFO:tasks.workunit.client.1.smithi116.stdout:0/957: mkdir d2/dc/d12/d51/d62/d134 0 2024-09-13T21:40:51.029 INFO:tasks.workunit.client.1.smithi116.stdout:0/958: mknod d2/dc/dcf/dd7/c135 0 2024-09-13T21:40:51.030 INFO:tasks.workunit.client.1.smithi116.stdout:0/959: rmdir d2/d5/d86/d8a/db1 39 2024-09-13T21:40:51.032 INFO:tasks.workunit.client.1.smithi116.stdout:0/960: rename d2/d5b/f6f to d2/dc/d47/d121/f136 0 2024-09-13T21:40:51.032 INFO:tasks.workunit.client.1.smithi116.stdout:0/961: read d2/dc/d12/d51/f91 [2874327,5395] 0 2024-09-13T21:40:51.032 INFO:tasks.workunit.client.1.smithi116.stdout:0/962: chown d2/dc/d12/c80 150 1 2024-09-13T21:40:51.032 INFO:tasks.workunit.client.1.smithi116.stdout:0/963: truncate d2/d5/d86/d8a/db1/fe7 409529 0 2024-09-13T21:40:51.033 INFO:tasks.workunit.client.1.smithi116.stdout:0/964: creat d2/d5/f137 x:0 0 0 2024-09-13T21:40:51.034 INFO:tasks.workunit.client.1.smithi116.stdout:0/965: truncate d2/dc/d12/d51/f98 4411763 0 2024-09-13T21:40:51.035 INFO:tasks.workunit.client.1.smithi116.stdout:7/927: dwrite d5/fd7 [0,4194304] 0 2024-09-13T21:40:51.037 INFO:tasks.workunit.client.1.smithi116.stdout:7/928: rename d5/d9/d27/ded/d22/d24/d5f/f64 to d5/d9/db/d21/f138 0 2024-09-13T21:40:51.037 INFO:tasks.workunit.client.1.smithi116.stdout:8/812: dread d2/d10/d19/d3a/f5f [0,4194304] 0 2024-09-13T21:40:51.037 INFO:tasks.workunit.client.1.smithi116.stdout:7/929: fdatasync d5/d9/d27/ded/d2e/f96 0 2024-09-13T21:40:51.042 INFO:tasks.workunit.client.1.smithi116.stdout:8/813: creat d2/d27/d66/dcc/dec/fef x:0 0 0 2024-09-13T21:40:51.044 INFO:tasks.workunit.client.1.smithi116.stdout:7/930: mkdir d5/d9/d27/ded/d22/d24/d139 0 2024-09-13T21:40:51.049 INFO:tasks.workunit.client.1.smithi116.stdout:8/814: rmdir d2/d10/d19/d3a 39 2024-09-13T21:40:51.050 INFO:tasks.workunit.client.1.smithi116.stdout:7/931: mkdir d5/d9/d27/d31/d38/d13a 0 2024-09-13T21:40:51.050 INFO:tasks.workunit.client.1.smithi116.stdout:7/932: write d5/d9/db/d21/d6e/d6f/d70/f84 [335195,62254] 0 2024-09-13T21:40:51.052 INFO:tasks.workunit.client.1.smithi116.stdout:8/815: creat d2/d10/d19/d3a/d4c/d7a/ff0 x:0 0 0 2024-09-13T21:40:51.052 INFO:tasks.workunit.client.1.smithi116.stdout:8/816: chown d2/d10/d19/d97 22 1 2024-09-13T21:40:51.054 INFO:tasks.workunit.client.1.smithi116.stdout:7/933: unlink d5/d9/db/f3c 0 2024-09-13T21:40:51.055 INFO:tasks.workunit.client.1.smithi116.stdout:8/817: rename d2/d10/d19/d21/d22/d5d/c7f to d2/d10/d3e/da4/cf1 0 2024-09-13T21:40:51.056 INFO:tasks.workunit.client.1.smithi116.stdout:7/934: creat d5/d9/d27/ded/d22/d24/d6b/d72/d74/d93/d11b/f13b x:0 0 0 2024-09-13T21:40:51.057 INFO:tasks.workunit.client.1.smithi116.stdout:8/818: symlink d2/d10/d4b/d6e/lf2 0 2024-09-13T21:40:51.059 INFO:tasks.workunit.client.1.smithi116.stdout:8/819: mkdir d2/d10/d19/d42/df3 0 2024-09-13T21:40:51.061 INFO:tasks.workunit.client.1.smithi116.stdout:8/820: rename d2/d10/d19/d21/d69/d90/fac to d2/d10/d19/d21/ff4 0 2024-09-13T21:40:51.061 INFO:tasks.workunit.client.1.smithi116.stdout:8/821: write d2/d10/f31 [4872704,33053] 0 2024-09-13T21:40:51.078 INFO:tasks.workunit.client.1.smithi116.stdout:7/935: dwrite d5/d9/f33 [0,4194304] 0 2024-09-13T21:40:51.078 INFO:tasks.workunit.client.1.smithi116.stdout:8/822: dwrite d2/d10/d19/d21/d22/d5d/d46/f5b [4194304,4194304] 0 2024-09-13T21:40:51.078 INFO:tasks.workunit.client.1.smithi116.stdout:8/823: read - d2/d10/d75/fc6 zero size 2024-09-13T21:40:51.079 INFO:tasks.workunit.client.1.smithi116.stdout:7/936: unlink d5/d9/db/d21/d6e/d6f/f83 0 2024-09-13T21:40:51.080 INFO:tasks.workunit.client.1.smithi116.stdout:8/824: creat d2/d10/d19/d21/d69/ff5 x:0 0 0 2024-09-13T21:40:51.081 INFO:tasks.workunit.client.1.smithi116.stdout:8/825: dread - d2/d10/d19/d21/fd8 zero size 2024-09-13T21:40:51.087 INFO:tasks.workunit.client.1.smithi116.stdout:8/826: mknod d2/d10/d19/d42/d45/d87/dc1/cf6 0 2024-09-13T21:40:51.087 INFO:tasks.workunit.client.1.smithi116.stdout:8/827: symlink d2/d10/d19/d42/d45/d87/lf7 0 2024-09-13T21:40:51.087 INFO:tasks.workunit.client.1.smithi116.stdout:8/828: creat d2/d10/d19/ff8 x:0 0 0 2024-09-13T21:40:51.087 INFO:tasks.workunit.client.1.smithi116.stdout:8/829: creat d2/d10/d19/d21/d22/d5d/ff9 x:0 0 0 2024-09-13T21:40:51.101 INFO:tasks.workunit.client.1.smithi116.stdout:7/937: dwrite d5/d9/db/d21/f53 [0,4194304] 0 2024-09-13T21:40:51.102 INFO:tasks.workunit.client.1.smithi116.stdout:7/938: rmdir d5/d9/d27 39 2024-09-13T21:40:51.106 INFO:tasks.workunit.client.1.smithi116.stdout:8/830: dwrite d2/d10/d19/d97/fb3 [0,4194304] 0 2024-09-13T21:40:51.108 INFO:tasks.workunit.client.1.smithi116.stdout:8/831: link d2/d10/d19/d3a/f3b d2/d10/d3e/ffa 0 2024-09-13T21:40:51.108 INFO:tasks.workunit.client.1.smithi116.stdout:8/832: read - d2/d10/d19/d21/d22/d5d/d46/f77 zero size 2024-09-13T21:40:51.109 INFO:tasks.workunit.client.1.smithi116.stdout:8/833: chown d2/d10/d19/d21/d22 378 1 2024-09-13T21:40:51.109 INFO:tasks.workunit.client.1.smithi116.stdout:8/834: creat d2/d10/d19/d21/d22/d5d/d46/ffb x:0 0 0 2024-09-13T21:40:51.110 INFO:tasks.workunit.client.1.smithi116.stdout:8/835: truncate d2/d10/d19/d3a/f3b 7693752 0 2024-09-13T21:40:51.112 INFO:tasks.workunit.client.1.smithi116.stdout:2/765: sync 2024-09-13T21:40:51.112 INFO:tasks.workunit.client.1.smithi116.stdout:3/966: sync 2024-09-13T21:40:51.114 INFO:tasks.workunit.client.1.smithi116.stdout:3/967: rename d3/db/d3d/f91 to d3/db/d10/d1c/d34/d55/d57/db1/d151/f158 0 2024-09-13T21:40:51.114 INFO:tasks.workunit.client.1.smithi116.stdout:2/766: dread d0/d7/d2b/f78 [0,4194304] 0 2024-09-13T21:40:51.114 INFO:tasks.workunit.client.1.smithi116.stdout:3/968: mknod d3/db/d10/d29/c159 0 2024-09-13T21:40:51.115 INFO:tasks.workunit.client.1.smithi116.stdout:3/969: stat d3/db/d10/d1c/d34/d55/cb5 0 2024-09-13T21:40:51.118 INFO:tasks.workunit.client.1.smithi116.stdout:8/836: dread d2/d10/d19/f84 [0,4194304] 0 2024-09-13T21:40:51.120 INFO:tasks.workunit.client.1.smithi116.stdout:8/837: mknod d2/d10/d3e/cfc 0 2024-09-13T21:40:51.120 INFO:tasks.workunit.client.1.smithi116.stdout:8/838: write d2/d10/d19/d3a/d4c/fad [850628,83163] 0 2024-09-13T21:40:51.129 INFO:tasks.workunit.client.1.smithi116.stdout:2/767: read d0/d5/f4b [3630264,32667] 0 2024-09-13T21:40:51.129 INFO:tasks.workunit.client.1.smithi116.stdout:3/970: dread d3/db/d10/d1d/d5f/fe1 [0,4194304] 0 2024-09-13T21:40:51.129 INFO:tasks.workunit.client.1.smithi116.stdout:2/768: symlink d0/d7/d49/lfa 0 2024-09-13T21:40:51.130 INFO:tasks.workunit.client.1.smithi116.stdout:2/769: creat d0/d3a/d82/d62/d1f/d5d/d72/ffb x:0 0 0 2024-09-13T21:40:51.132 INFO:tasks.workunit.client.1.smithi116.stdout:2/770: rename d0/d3a/fe5 to d0/d5/d8/dd2/ffc 0 2024-09-13T21:40:51.133 INFO:tasks.workunit.client.1.smithi116.stdout:2/771: symlink d0/d5/d8/dd2/lfd 0 2024-09-13T21:40:51.133 INFO:tasks.workunit.client.1.smithi116.stdout:2/772: truncate d0/d7/f1e 8259151 0 2024-09-13T21:40:51.135 INFO:tasks.workunit.client.1.smithi116.stdout:2/773: mknod d0/d7/d49/cfe 0 2024-09-13T21:40:51.138 INFO:tasks.workunit.client.1.smithi116.stdout:3/971: write d3/db/f3e [241457,115995] 0 2024-09-13T21:40:51.138 INFO:tasks.workunit.client.1.smithi116.stdout:2/774: rmdir d0/d7/d86/dd1/df0 39 2024-09-13T21:40:51.139 INFO:tasks.workunit.client.1.smithi116.stdout:2/775: dread d0/d7/d2d/fde [0,4194304] 0 2024-09-13T21:40:51.139 INFO:tasks.workunit.client.1.smithi116.stdout:2/776: creat d0/d3a/d82/d62/d1f/d5d/d72/fff x:0 0 0 2024-09-13T21:40:51.140 INFO:tasks.workunit.client.1.smithi116.stdout:3/972: symlink d3/db/d20/d86/da6/l15a 0 2024-09-13T21:40:51.140 INFO:tasks.workunit.client.1.smithi116.stdout:3/973: write d3/db/f68 [330241,38799] 0 2024-09-13T21:40:51.140 INFO:tasks.workunit.client.1.smithi116.stdout:3/974: readlink d3/l54 0 2024-09-13T21:40:51.143 INFO:tasks.workunit.client.1.smithi116.stdout:2/777: rename d0/d3a/cb8 to d0/de9/c100 0 2024-09-13T21:40:51.145 INFO:tasks.workunit.client.1.smithi116.stdout:2/778: creat d0/d5/f101 x:0 0 0 2024-09-13T21:40:51.146 INFO:tasks.workunit.client.1.smithi116.stdout:2/779: mknod d0/d7/d49/c102 0 2024-09-13T21:40:51.150 INFO:tasks.workunit.client.1.smithi116.stdout:3/975: write d3/db/d10/d1d/d5f/ff5 [4066866,5673] 0 2024-09-13T21:40:51.155 INFO:tasks.workunit.client.1.smithi116.stdout:2/780: dread d0/d7/d2b/f3e [0,4194304] 0 2024-09-13T21:40:51.155 INFO:tasks.workunit.client.1.smithi116.stdout:2/781: write d0/f63 [1275755,102217] 0 2024-09-13T21:40:51.156 INFO:tasks.workunit.client.1.smithi116.stdout:2/782: stat d0/d7/l13 0 2024-09-13T21:40:51.157 INFO:tasks.workunit.client.1.smithi116.stdout:2/783: mknod d0/d7/d49/c103 0 2024-09-13T21:40:51.168 INFO:tasks.workunit.client.1.smithi116.stdout:3/976: dwrite d3/db/d10/d1d/d5f/d6f/d71/f7d [0,4194304] 0 2024-09-13T21:40:51.168 INFO:tasks.workunit.client.1.smithi116.stdout:3/977: creat d3/db/d10/f15b x:0 0 0 2024-09-13T21:40:51.191 INFO:tasks.workunit.client.1.smithi116.stdout:2/784: dwrite d0/d3a/d82/d62/d1f/d5d/fa6 [0,4194304] 0 2024-09-13T21:40:51.191 INFO:tasks.workunit.client.1.smithi116.stdout:3/978: dwrite d3/db/d10/d1c/d34/d55/fa4 [0,4194304] 0 2024-09-13T21:40:51.191 INFO:tasks.workunit.client.1.smithi116.stdout:3/979: write d3/db/d10/d1c/d34/d55/d96/dee/f137 [984241,79319] 0 2024-09-13T21:40:51.191 INFO:tasks.workunit.client.1.smithi116.stdout:3/980: dread - d3/db/d10/d1c/d63/f11f zero size 2024-09-13T21:40:51.193 INFO:tasks.workunit.client.1.smithi116.stdout:2/785: rename d0/d7/d49/f80 to d0/d5/de3/f104 0 2024-09-13T21:40:51.196 INFO:tasks.workunit.client.1.smithi116.stdout:3/981: symlink d3/db/d10/d1d/d5f/l15c 0 2024-09-13T21:40:51.196 INFO:tasks.workunit.client.1.smithi116.stdout:3/982: chown d3/db/d10/d1c/d34/d55/d57/lcd 95026521 1 2024-09-13T21:40:51.197 INFO:tasks.workunit.client.1.smithi116.stdout:2/786: mkdir d0/d7/d2d/d105 0 2024-09-13T21:40:51.199 INFO:tasks.workunit.client.1.smithi116.stdout:2/787: getdents d0/d3a/d82/d62/d1f/d5d 0 2024-09-13T21:40:51.202 INFO:tasks.workunit.client.1.smithi116.stdout:2/788: truncate d0/d3a/d82/d62/d75/d77/f99 1019994 0 2024-09-13T21:40:51.202 INFO:tasks.workunit.client.1.smithi116.stdout:2/789: stat d0/d7/d2b/f3e 0 2024-09-13T21:40:51.203 INFO:tasks.workunit.client.1.smithi116.stdout:2/790: symlink d0/de9/l106 0 2024-09-13T21:40:51.211 INFO:tasks.workunit.client.1.smithi116.stdout:3/983: dwrite d3/db/d121/f148 [0,4194304] 0 2024-09-13T21:40:51.211 INFO:tasks.workunit.client.1.smithi116.stdout:3/984: write d3/db/d10/d1c/d34/f13d [1005548,19114] 0 2024-09-13T21:40:51.211 INFO:tasks.workunit.client.1.smithi116.stdout:3/985: chown d3/db/d10/d1d/d5f/d6f/fb9 190 1 2024-09-13T21:40:51.211 INFO:tasks.workunit.client.1.smithi116.stdout:3/986: fsync d3/db/d10/d29/ffc 0 2024-09-13T21:40:51.215 INFO:tasks.workunit.client.1.smithi116.stdout:3/987: rename d3/db/d10/d29/c131 to d3/df9/da2/c15d 0 2024-09-13T21:40:51.215 INFO:tasks.workunit.client.1.smithi116.stdout:3/988: readlink d3/db/d20/d50/l98 0 2024-09-13T21:40:51.215 INFO:tasks.workunit.client.1.smithi116.stdout:3/989: chown d3/db/d10/d1d/d2f/d61/f114 210 1 2024-09-13T21:40:51.221 INFO:tasks.workunit.client.1.smithi116.stdout:2/791: dwrite d0/d5/d8/fc4 [0,4194304] 0 2024-09-13T21:40:51.221 INFO:tasks.workunit.client.1.smithi116.stdout:2/792: fsync d0/d3a/d82/d62/d1f/d5d/d60/fbe 0 2024-09-13T21:40:51.222 INFO:tasks.workunit.client.1.smithi116.stdout:2/793: read - d0/d5/f101 zero size 2024-09-13T21:40:51.222 INFO:tasks.workunit.client.1.smithi116.stdout:2/794: creat d0/d3a/d82/d62/d1f/d5d/d89/f107 x:0 0 0 2024-09-13T21:40:51.228 INFO:tasks.workunit.client.1.smithi116.stdout:3/990: dread d3/db/f3f [0,4194304] 0 2024-09-13T21:40:51.229 INFO:tasks.workunit.client.1.smithi116.stdout:3/991: mknod d3/db/d10/d1c/d34/d55/d57/dc6/c15e 0 2024-09-13T21:40:51.229 INFO:tasks.workunit.client.1.smithi116.stdout:3/992: chown d3/db/d10/d1d/d5f/l119 8157 1 2024-09-13T21:40:51.231 INFO:tasks.workunit.client.1.smithi116.stdout:3/993: creat d3/db/d10/d1c/d34/d55/d57/dc6/f15f x:0 0 0 2024-09-13T21:40:51.231 INFO:tasks.workunit.client.1.smithi116.stdout:2/795: write d0/d7/d2d/faf [1158080,60952] 0 2024-09-13T21:40:51.234 INFO:tasks.workunit.client.1.smithi116.stdout:2/796: creat d0/d3a/d82/d62/d75/f108 x:0 0 0 2024-09-13T21:40:51.235 INFO:tasks.workunit.client.1.smithi116.stdout:3/994: rmdir d3/db/d10/d1d/d2f/d61 39 2024-09-13T21:40:51.238 INFO:tasks.workunit.client.1.smithi116.stdout:3/995: rename d3/db/d10/d99/fa8 to d3/db/d10/d1c/d63/f160 0 2024-09-13T21:40:51.238 INFO:tasks.workunit.client.1.smithi116.stdout:3/996: chown d3/db/d20/d86 3107670 1 2024-09-13T21:40:51.238 INFO:tasks.workunit.client.1.smithi116.stdout:3/997: chown d3/db/d20/d50/c95 88 1 2024-09-13T21:40:51.239 INFO:tasks.workunit.client.1.smithi116.stdout:3/998: fdatasync d3/db/d20/d50/ffb 0 2024-09-13T21:40:51.244 INFO:tasks.workunit.client.1.smithi116.stdout:3/999: write d3/db/d20/d86/fbc [2071011,18410] 0 2024-09-13T21:40:51.292 INFO:tasks.workunit.client.1.smithi116.stdout:9/561: sync 2024-09-13T21:40:51.292 INFO:tasks.workunit.client.1.smithi116.stdout:6/887: sync 2024-09-13T21:40:51.292 INFO:tasks.workunit.client.1.smithi116.stdout:5/944: sync 2024-09-13T21:40:51.292 INFO:tasks.workunit.client.1.smithi116.stdout:1/720: sync 2024-09-13T21:40:51.293 INFO:tasks.workunit.client.1.smithi116.stdout:9/562: truncate d2/d10/f12 5522702 0 2024-09-13T21:40:51.293 INFO:tasks.workunit.client.1.smithi116.stdout:1/721: dread d4/d14/d52/d2f/f6d [0,4194304] 0 2024-09-13T21:40:51.293 INFO:tasks.workunit.client.1.smithi116.stdout:6/888: creat d8/d17/d70/f133 x:0 0 0 2024-09-13T21:40:51.293 INFO:tasks.workunit.client.1.smithi116.stdout:9/563: symlink d2/la7 0 2024-09-13T21:40:51.294 INFO:tasks.workunit.client.1.smithi116.stdout:1/722: truncate d4/d74/d8d/f55 2167291 0 2024-09-13T21:40:51.304 INFO:tasks.workunit.client.1.smithi116.stdout:5/945: dread d7/d1d/d46/d85/d96/da8/df0/f12d [0,4194304] 0 2024-09-13T21:40:51.308 INFO:tasks.workunit.client.1.smithi116.stdout:9/564: dread d2/d5d/d69/f75 [0,4194304] 0 2024-09-13T21:40:51.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/565: write d2/f13 [113069,123984] 0 2024-09-13T21:40:51.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/566: truncate d2/d10/f12 6139608 0 2024-09-13T21:40:51.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/567: fdatasync d2/d8/d3e/f56 0 2024-09-13T21:40:51.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/568: write d2/d8/fd [3597233,57942] 0 2024-09-13T21:40:51.311 INFO:tasks.workunit.client.1.smithi116.stdout:9/569: rename d2/d43/f68 to d2/d8/d3e/fa8 0 2024-09-13T21:40:51.312 INFO:tasks.workunit.client.1.smithi116.stdout:1/723: dread d4/d74/d8d/d5f/f78 [0,4194304] 0 2024-09-13T21:40:51.313 INFO:tasks.workunit.client.1.smithi116.stdout:1/724: mknod d4/d14/d52/c106 0 2024-09-13T21:40:51.313 INFO:tasks.workunit.client.1.smithi116.stdout:1/725: stat d4/d74/c105 0 2024-09-13T21:40:51.314 INFO:tasks.workunit.client.1.smithi116.stdout:1/726: link d4/d14/l22 d4/d14/d52/d2f/d5c/daf/dc3/l107 0 2024-09-13T21:40:51.315 INFO:tasks.workunit.client.1.smithi116.stdout:1/727: mknod d4/d14/d2a/dd3/d100/c108 0 2024-09-13T21:40:51.315 INFO:tasks.workunit.client.1.smithi116.stdout:1/728: write d4/d14/d2a/f88 [952226,53958] 0 2024-09-13T21:40:51.316 INFO:tasks.workunit.client.1.smithi116.stdout:1/729: creat d4/d74/d8d/f109 x:0 0 0 2024-09-13T21:40:51.317 INFO:tasks.workunit.client.1.smithi116.stdout:1/730: chown d4/d23/d57/la2 209377 1 2024-09-13T21:40:51.320 INFO:tasks.workunit.client.1.smithi116.stdout:9/570: dread d2/d10/f12 [0,4194304] 0 2024-09-13T21:40:51.322 INFO:tasks.workunit.client.1.smithi116.stdout:9/571: rename d2/d43/f63 to d2/d5d/d69/fa9 0 2024-09-13T21:40:51.329 INFO:tasks.workunit.client.1.smithi116.stdout:1/731: dread d4/d74/d8d/f76 [0,4194304] 0 2024-09-13T21:40:51.329 INFO:tasks.workunit.client.1.smithi116.stdout:5/946: dwrite d7/d1d/d46/dd4/d5e/d65/f8c [0,4194304] 0 2024-09-13T21:40:51.331 INFO:tasks.workunit.client.1.smithi116.stdout:6/889: dwrite f3 [0,4194304] 0 2024-09-13T21:40:51.333 INFO:tasks.workunit.client.1.smithi116.stdout:5/947: dread d7/d1d/d46/d85/d96/da8/db9/ff2 [0,4194304] 0 2024-09-13T21:40:51.333 INFO:tasks.workunit.client.1.smithi116.stdout:6/890: dread d8/d15/d2e/d2f/d38/f75 [0,4194304] 0 2024-09-13T21:40:51.334 INFO:tasks.workunit.client.1.smithi116.stdout:6/891: read d8/d15/d2e/fa5 [27069,77360] 0 2024-09-13T21:40:51.338 INFO:tasks.workunit.client.1.smithi116.stdout:9/572: dwrite d2/d5d/d69/f4b [0,4194304] 0 2024-09-13T21:40:51.345 INFO:tasks.workunit.client.1.smithi116.stdout:9/573: creat d2/d10/faa x:0 0 0 2024-09-13T21:40:51.345 INFO:tasks.workunit.client.1.smithi116.stdout:9/574: stat d2/d10/d14/d38/d3a 0 2024-09-13T21:40:51.352 INFO:tasks.workunit.client.1.smithi116.stdout:6/892: dwrite d8/d15/d2e/ff2 [0,4194304] 0 2024-09-13T21:40:51.355 INFO:tasks.workunit.client.1.smithi116.stdout:6/893: unlink d8/d17/d70/da0/daf/d113/f68 0 2024-09-13T21:40:51.356 INFO:tasks.workunit.client.1.smithi116.stdout:6/894: truncate d8/d10/f55 1875755 0 2024-09-13T21:40:51.357 INFO:tasks.workunit.client.1.smithi116.stdout:9/575: read d2/d10/d14/d38/f6b [1875094,118134] 0 2024-09-13T21:40:51.357 INFO:tasks.workunit.client.1.smithi116.stdout:9/576: chown d2/d10/d4c/f7a 0 1 2024-09-13T21:40:51.357 INFO:tasks.workunit.client.1.smithi116.stdout:6/895: creat d8/f134 x:0 0 0 2024-09-13T21:40:51.358 INFO:tasks.workunit.client.1.smithi116.stdout:9/577: symlink d2/d8/d3e/lab 0 2024-09-13T21:40:51.358 INFO:tasks.workunit.client.1.smithi116.stdout:9/578: write d2/d8/d93/f94 [149116,23061] 0 2024-09-13T21:40:51.358 INFO:tasks.workunit.client.1.smithi116.stdout:6/896: link d8/d10/d24/d110/de2/d12a/leb d8/d17/d70/l135 0 2024-09-13T21:40:51.359 INFO:tasks.workunit.client.1.smithi116.stdout:6/897: truncate d8/d17/f19 190010 0 2024-09-13T21:40:51.359 INFO:tasks.workunit.client.1.smithi116.stdout:6/898: truncate d8/d10/d65/f8e 1338047 0 2024-09-13T21:40:51.366 INFO:tasks.workunit.client.1.smithi116.stdout:6/899: write d8/d15/d2e/f7e [594936,66271] 0 2024-09-13T21:40:51.367 INFO:tasks.workunit.client.1.smithi116.stdout:6/900: fsync d8/f2c 0 2024-09-13T21:40:51.367 INFO:tasks.workunit.client.1.smithi116.stdout:6/901: chown d8/d10/d33/f4a 336746774 1 2024-09-13T21:40:51.367 INFO:tasks.workunit.client.1.smithi116.stdout:6/902: stat d8/d17/la3 0 2024-09-13T21:40:51.372 INFO:tasks.workunit.client.1.smithi116.stdout:6/903: write d8/d1e/f28 [3204522,28653] 0 2024-09-13T21:40:51.386 INFO:tasks.workunit.client.1.smithi116.stdout:6/904: dwrite d8/d15/d2e/d2f/d38/d9c/f10b [0,4194304] 0 2024-09-13T21:40:51.388 INFO:tasks.workunit.client.1.smithi116.stdout:6/905: mknod d8/d1e/dbb/c136 0 2024-09-13T21:40:51.389 INFO:tasks.workunit.client.1.smithi116.stdout:6/906: mkdir d8/d1e/dbb/d137 0 2024-09-13T21:40:51.389 INFO:tasks.workunit.client.1.smithi116.stdout:6/907: chown d8/d15/d2e/d2f 24089 1 2024-09-13T21:40:51.389 INFO:tasks.workunit.client.1.smithi116.stdout:6/908: mkdir d8/d1e/dbb/d137/d138 0 2024-09-13T21:40:51.391 INFO:tasks.workunit.client.1.smithi116.stdout:6/909: creat d8/d15/d2e/d2f/d38/d9c/dcd/de5/f139 x:0 0 0 2024-09-13T21:40:51.392 INFO:tasks.workunit.client.1.smithi116.stdout:6/910: rename d8/d10/c11 to d8/d15/d2e/c13a 0 2024-09-13T21:40:51.393 INFO:tasks.workunit.client.1.smithi116.stdout:6/911: rmdir d8/d15/d2e/d9e 39 2024-09-13T21:40:51.393 INFO:tasks.workunit.client.1.smithi116.stdout:6/912: fsync d8/d10/d24/f29 0 2024-09-13T21:40:51.413 INFO:tasks.workunit.client.1.smithi116.stdout:6/913: dwrite d8/d10/faa [0,4194304] 0 2024-09-13T21:40:51.422 INFO:tasks.workunit.client.1.smithi116.stdout:6/914: dread d8/d15/d2e/ff2 [0,4194304] 0 2024-09-13T21:40:51.422 INFO:tasks.workunit.client.1.smithi116.stdout:6/915: truncate d8/d15/d2e/d2f/d38/f75 408091 0 2024-09-13T21:40:51.422 INFO:tasks.workunit.client.1.smithi116.stdout:6/916: stat d8/d15/d2e/d2f/fa8 0 2024-09-13T21:40:51.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:51 smithi088 ceph-mon[27963]: pgmap v265: 65 pgs: 65 active+clean; 1.7 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 179 MiB/s rd, 208 MiB/s wr, 472 op/s 2024-09-13T21:40:51.483 INFO:tasks.workunit.client.1.smithi116.stdout:7/939: sync 2024-09-13T21:40:51.483 INFO:tasks.workunit.client.1.smithi116.stdout:4/756: sync 2024-09-13T21:40:51.483 INFO:tasks.workunit.client.1.smithi116.stdout:0/966: sync 2024-09-13T21:40:51.484 INFO:tasks.workunit.client.1.smithi116.stdout:0/967: read d2/dc/d47/d63/d9f/db6/fc2 [4046459,3237] 0 2024-09-13T21:40:51.484 INFO:tasks.workunit.client.1.smithi116.stdout:7/940: mknod d5/d9/d27/ded/d22/d24/d6b/d72/dd4/c13c 0 2024-09-13T21:40:51.485 INFO:tasks.workunit.client.1.smithi116.stdout:0/968: rename d2/d5/d61/fbc to d2/dc/d47/d63/d9f/f138 0 2024-09-13T21:40:51.487 INFO:tasks.workunit.client.1.smithi116.stdout:7/941: unlink d5/d9/db/c19 0 2024-09-13T21:40:51.487 INFO:tasks.workunit.client.1.smithi116.stdout:7/942: truncate d5/d9/d27/fa9 352057 0 2024-09-13T21:40:51.488 INFO:tasks.workunit.client.1.smithi116.stdout:7/943: mknod d5/d9/d27/ded/d2e/d11d/c13d 0 2024-09-13T21:40:51.490 INFO:tasks.workunit.client.1.smithi116.stdout:7/944: mknod d5/d9/d27/ded/d2e/c13e 0 2024-09-13T21:40:51.492 INFO:tasks.workunit.client.1.smithi116.stdout:7/945: creat d5/d9/db/d21/d6e/f13f x:0 0 0 2024-09-13T21:40:51.506 INFO:tasks.workunit.client.1.smithi116.stdout:7/946: dread d5/fd7 [0,4194304] 0 2024-09-13T21:40:51.506 INFO:tasks.workunit.client.1.smithi116.stdout:7/947: write d5/d9/d27/ded/d22/fc2 [437432,90937] 0 2024-09-13T21:40:51.506 INFO:tasks.workunit.client.1.smithi116.stdout:4/757: dwrite d0/dd/d13/f3c [0,4194304] 0 2024-09-13T21:40:51.507 INFO:tasks.workunit.client.1.smithi116.stdout:0/969: dwrite d2/dc/d12/d28/d57/f82 [0,4194304] 0 2024-09-13T21:40:51.507 INFO:tasks.workunit.client.1.smithi116.stdout:0/970: truncate d2/dc/d47/d63/d9f/f115 715108 0 2024-09-13T21:40:51.507 INFO:tasks.workunit.client.1.smithi116.stdout:7/948: symlink d5/d9/db/d21/d6e/l140 0 2024-09-13T21:40:51.507 INFO:tasks.workunit.client.1.smithi116.stdout:4/758: rmdir d0/dd/d6b/dee/dd5 39 2024-09-13T21:40:51.509 INFO:tasks.workunit.client.1.smithi116.stdout:7/949: getdents d5/d9/db/da3 0 2024-09-13T21:40:51.509 INFO:tasks.workunit.client.1.smithi116.stdout:7/950: write d5/d9/db/f99 [685471,57932] 0 2024-09-13T21:40:51.509 INFO:tasks.workunit.client.1.smithi116.stdout:7/951: getdents d5/d9/d27/d31/d38/d111 0 2024-09-13T21:40:51.509 INFO:tasks.workunit.client.1.smithi116.stdout:7/952: creat d5/d9/d27/ded/d22/d24/d6b/d72/d74/f141 x:0 0 0 2024-09-13T21:40:51.510 INFO:tasks.workunit.client.1.smithi116.stdout:4/759: mkdir d0/dd/d7c/df0 0 2024-09-13T21:40:51.512 INFO:tasks.workunit.client.1.smithi116.stdout:7/953: symlink d5/d9/d27/ded/l142 0 2024-09-13T21:40:51.514 INFO:tasks.workunit.client.1.smithi116.stdout:4/760: symlink d0/dd/d6b/d92/d95/ddd/lf1 0 2024-09-13T21:40:51.514 INFO:tasks.workunit.client.1.smithi116.stdout:4/761: chown d0/dd/l29 126899688 1 2024-09-13T21:40:51.515 INFO:tasks.workunit.client.1.smithi116.stdout:4/762: chown d0/dd/d6b/d92/d95/le7 746972 1 2024-09-13T21:40:51.516 INFO:tasks.workunit.client.1.smithi116.stdout:4/763: rename d0/dd/d13/d4e/c90 to d0/d32/cf2 0 2024-09-13T21:40:51.524 INFO:tasks.workunit.client.1.smithi116.stdout:0/971: dwrite d2/dc/d12/d28/d57/d65/ff7 [0,4194304] 0 2024-09-13T21:40:51.524 INFO:tasks.workunit.client.1.smithi116.stdout:0/972: chown d2/dc/d12/d51/d62/fa2 3488674 1 2024-09-13T21:40:51.524 INFO:tasks.workunit.client.1.smithi116.stdout:0/973: write d2/dc/d12/d28/d57/f90 [1762875,108795] 0 2024-09-13T21:40:51.528 INFO:tasks.workunit.client.1.smithi116.stdout:0/974: rename d2/d5/d86/d8a/fca to d2/d5/d86/f139 0 2024-09-13T21:40:51.528 INFO:tasks.workunit.client.1.smithi116.stdout:0/975: truncate d2/d5b/fc9 399328 0 2024-09-13T21:40:51.544 INFO:tasks.workunit.client.1.smithi116.stdout:7/954: dwrite d5/d9/d27/f2b [0,4194304] 0 2024-09-13T21:40:51.544 INFO:tasks.workunit.client.1.smithi116.stdout:0/976: dread d2/dc/d47/d121/ff5 [0,4194304] 0 2024-09-13T21:40:51.544 INFO:tasks.workunit.client.1.smithi116.stdout:7/955: read - d5/d9/db/d21/f49 zero size 2024-09-13T21:40:51.545 INFO:tasks.workunit.client.1.smithi116.stdout:0/977: stat d2/d5/dbe/lc4 0 2024-09-13T21:40:51.545 INFO:tasks.workunit.client.1.smithi116.stdout:0/978: fdatasync d2/dc/d12/d28/f74 0 2024-09-13T21:40:51.545 INFO:tasks.workunit.client.1.smithi116.stdout:4/764: dwrite d0/dad/fd6 [0,4194304] 0 2024-09-13T21:40:51.545 INFO:tasks.workunit.client.1.smithi116.stdout:7/956: symlink d5/d9/d27/ded/l143 0 2024-09-13T21:40:51.547 INFO:tasks.workunit.client.1.smithi116.stdout:0/979: truncate d2/dc/f29 3513065 0 2024-09-13T21:40:51.551 INFO:tasks.workunit.client.1.smithi116.stdout:4/765: creat d0/dd/d6b/d92/d99/dbc/ff3 x:0 0 0 2024-09-13T21:40:51.553 INFO:tasks.workunit.client.1.smithi116.stdout:0/980: link d2/dc/d12/c80 d2/d5b/db4/d101/c13a 0 2024-09-13T21:40:51.553 INFO:tasks.workunit.client.1.smithi116.stdout:0/981: readlink d2/dc/d12/d28/l30 0 2024-09-13T21:40:51.554 INFO:tasks.workunit.client.1.smithi116.stdout:4/766: rmdir d0/dd/d6b/d92/d99 39 2024-09-13T21:40:51.554 INFO:tasks.workunit.client.1.smithi116.stdout:4/767: chown d0/dd/d13/d5a/f65 55086 1 2024-09-13T21:40:51.554 INFO:tasks.workunit.client.1.smithi116.stdout:4/768: creat d0/d56/d57/ff4 x:0 0 0 2024-09-13T21:40:51.557 INFO:tasks.workunit.client.1.smithi116.stdout:0/982: fdatasync d2/d5/fb7 0 2024-09-13T21:40:51.561 INFO:tasks.workunit.client.1.smithi116.stdout:0/983: truncate d2/fd1 1130165 0 2024-09-13T21:40:51.562 INFO:tasks.workunit.client.1.smithi116.stdout:0/984: getdents d2/d5/d86 0 2024-09-13T21:40:51.563 INFO:tasks.workunit.client.1.smithi116.stdout:0/985: dread d2/d5/d86/d8a/db1/fe7 [0,4194304] 0 2024-09-13T21:40:51.563 INFO:tasks.workunit.client.1.smithi116.stdout:0/986: stat d2/dc/d12/d28/d57/d65/f113 0 2024-09-13T21:40:51.564 INFO:tasks.workunit.client.1.smithi116.stdout:0/987: dread d2/d5/fb0 [0,4194304] 0 2024-09-13T21:40:51.570 INFO:tasks.workunit.client.1.smithi116.stdout:7/957: dwrite d5/d9/f129 [0,4194304] 0 2024-09-13T21:40:51.570 INFO:tasks.workunit.client.1.smithi116.stdout:7/958: fdatasync d5/d9/d27/f8e 0 2024-09-13T21:40:51.573 INFO:tasks.workunit.client.1.smithi116.stdout:4/769: rename d0/f31 to d0/dd/d13/d5a/d7a/ff5 0 2024-09-13T21:40:51.574 INFO:tasks.workunit.client.1.smithi116.stdout:7/959: truncate d5/d9/f51 678912 0 2024-09-13T21:40:51.574 INFO:tasks.workunit.client.1.smithi116.stdout:7/960: creat d5/db0/f144 x:0 0 0 2024-09-13T21:40:51.574 INFO:tasks.workunit.client.1.smithi116.stdout:7/961: stat d5/d9/d27/ded/d2e/c13e 0 2024-09-13T21:40:51.575 INFO:tasks.workunit.client.1.smithi116.stdout:7/962: chown d5/d9/db/d21/d6e/d6f/fee 0 1 2024-09-13T21:40:51.575 INFO:tasks.workunit.client.1.smithi116.stdout:4/770: link d0/dd/d13/c1d d0/d32/da3/db7/cf6 0 2024-09-13T21:40:51.577 INFO:tasks.workunit.client.1.smithi116.stdout:4/771: stat d0/dd/cbe 0 2024-09-13T21:40:51.580 INFO:tasks.workunit.client.1.smithi116.stdout:4/772: getdents d0/d32 0 2024-09-13T21:40:51.580 INFO:tasks.workunit.client.1.smithi116.stdout:4/773: creat d0/dd/d48/ff7 x:0 0 0 2024-09-13T21:40:51.580 INFO:tasks.workunit.client.1.smithi116.stdout:4/774: readlink d0/dd/d6b/d71/la6 0 2024-09-13T21:40:51.581 INFO:tasks.workunit.client.1.smithi116.stdout:0/988: dwrite d2/d5/d86/d8a/fcd [0,4194304] 0 2024-09-13T21:40:51.581 INFO:tasks.workunit.client.1.smithi116.stdout:0/989: fsync d2/dc/fe 0 2024-09-13T21:40:51.581 INFO:tasks.workunit.client.1.smithi116.stdout:0/990: chown d2/dc/d47/d63/l72 1188 1 2024-09-13T21:40:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:51 smithi116 ceph-mon[33391]: pgmap v265: 65 pgs: 65 active+clean; 1.7 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 179 MiB/s rd, 208 MiB/s wr, 472 op/s 2024-09-13T21:40:51.614 INFO:tasks.workunit.client.1.smithi116.stdout:4/775: dwrite d0/dd/d13/d4e/f73 [0,4194304] 0 2024-09-13T21:40:51.615 INFO:tasks.workunit.client.1.smithi116.stdout:7/963: dwrite d5/d9/d27/ded/d22/d24/d6b/d72/f8c [0,4194304] 0 2024-09-13T21:40:51.615 INFO:tasks.workunit.client.1.smithi116.stdout:0/991: dwrite d2/d5b/f5c [4194304,4194304] 0 2024-09-13T21:40:51.617 INFO:tasks.workunit.client.1.smithi116.stdout:7/964: mkdir d5/d9/d27/ded/d2e/d52/d145 0 2024-09-13T21:40:51.617 INFO:tasks.workunit.client.1.smithi116.stdout:7/965: truncate d5/d9/db/d21/f132 227968 0 2024-09-13T21:40:51.617 INFO:tasks.workunit.client.1.smithi116.stdout:7/966: fdatasync d5/d9/f3d 0 2024-09-13T21:40:51.619 INFO:tasks.workunit.client.1.smithi116.stdout:7/967: symlink d5/d9/d27/ded/d22/d24/d139/l146 0 2024-09-13T21:40:51.619 INFO:tasks.workunit.client.1.smithi116.stdout:7/968: creat d5/d9/d27/ded/d2e/d52/f147 x:0 0 0 2024-09-13T21:40:51.619 INFO:tasks.workunit.client.1.smithi116.stdout:0/992: getdents d2/dc/d12/d28/d57 0 2024-09-13T21:40:51.623 INFO:tasks.workunit.client.1.smithi116.stdout:7/969: unlink d5/d9/d27/d31/la0 0 2024-09-13T21:40:51.623 INFO:tasks.workunit.client.1.smithi116.stdout:7/970: read d5/d9/d27/ded/d22/fc2 [439469,70472] 0 2024-09-13T21:40:51.625 INFO:tasks.workunit.client.1.smithi116.stdout:7/971: mkdir d5/d9/d27/d31/d38/d111/d148 0 2024-09-13T21:40:51.625 INFO:tasks.workunit.client.1.smithi116.stdout:7/972: truncate d5/d9/d27/d31/d38/d48/f76 1609513 0 2024-09-13T21:40:51.642 INFO:tasks.workunit.client.1.smithi116.stdout:0/993: dwrite d2/d5/d86/d8a/fcd [0,4194304] 0 2024-09-13T21:40:51.643 INFO:tasks.workunit.client.1.smithi116.stdout:0/994: fsync d2/dc/d12/f36 0 2024-09-13T21:40:51.655 INFO:tasks.workunit.client.1.smithi116.stdout:4/776: dwrite d0/dd/d13/fed [0,4194304] 0 2024-09-13T21:40:51.656 INFO:tasks.workunit.client.1.smithi116.stdout:7/973: dwrite d5/f5e [0,4194304] 0 2024-09-13T21:40:51.658 INFO:tasks.workunit.client.1.smithi116.stdout:4/777: rename d0/dd/d6b/dee/dd5/fd8 to d0/d32/d5d/ff8 0 2024-09-13T21:40:51.658 INFO:tasks.workunit.client.1.smithi116.stdout:4/778: truncate d0/dd/d13/d5a/dc4/dc8/de2/fe3 954503 0 2024-09-13T21:40:51.661 INFO:tasks.workunit.client.1.smithi116.stdout:7/974: rename d5/d9/d27/ded/d22/d24/d5f/f120 to d5/d9/d27/ded/d22/d24/d5f/dfc/f149 0 2024-09-13T21:40:51.661 INFO:tasks.workunit.client.1.smithi116.stdout:7/975: truncate d5/d9/d27/ded/d22/d24/d5f/fe3 4842035 0 2024-09-13T21:40:51.661 INFO:tasks.workunit.client.1.smithi116.stdout:0/995: dwrite d2/dc/d12/d28/fe5 [0,4194304] 0 2024-09-13T21:40:51.662 INFO:tasks.workunit.client.1.smithi116.stdout:4/779: truncate d0/f10 829232 0 2024-09-13T21:40:51.662 INFO:tasks.workunit.client.1.smithi116.stdout:7/976: mknod d5/d9/d27/ded/d22/d24/d3a/c14a 0 2024-09-13T21:40:51.670 INFO:tasks.workunit.client.1.smithi116.stdout:4/780: rmdir d0/dd/d7c 39 2024-09-13T21:40:51.671 INFO:tasks.workunit.client.1.smithi116.stdout:4/781: symlink d0/dd/d13/d5a/d7a/lf9 0 2024-09-13T21:40:51.673 INFO:tasks.workunit.client.1.smithi116.stdout:4/782: mkdir d0/d56/d84/dfa 0 2024-09-13T21:40:51.674 INFO:tasks.workunit.client.1.smithi116.stdout:4/783: getdents d0/dd/d6b/dee/dd5 0 2024-09-13T21:40:51.676 INFO:tasks.workunit.client.1.smithi116.stdout:4/784: creat d0/dd/d6b/d92/d99/ffb x:0 0 0 2024-09-13T21:40:51.676 INFO:tasks.workunit.client.1.smithi116.stdout:7/977: write d5/d9/d27/ded/d37/f62 [2050394,56005] 0 2024-09-13T21:40:51.677 INFO:tasks.workunit.client.1.smithi116.stdout:7/978: mkdir d5/d9/d27/ded/d22/d24/d3a/d112/d12b/d14b 0 2024-09-13T21:40:51.694 INFO:tasks.workunit.client.1.smithi116.stdout:0/996: dwrite d2/dc/dcf/dd7/ff4 [0,4194304] 0 2024-09-13T21:40:51.695 INFO:tasks.workunit.client.1.smithi116.stdout:8/839: sync 2024-09-13T21:40:51.696 INFO:tasks.workunit.client.1.smithi116.stdout:2/797: sync 2024-09-13T21:40:51.696 INFO:tasks.workunit.client.1.smithi116.stdout:2/798: write d0/d5/fa4 [333010,70935] 0 2024-09-13T21:40:51.696 INFO:tasks.workunit.client.1.smithi116.stdout:0/997: rmdir d2/dc/d12/d28/d57/d110 39 2024-09-13T21:40:51.697 INFO:tasks.workunit.client.1.smithi116.stdout:8/840: dread d2/d10/d19/d42/d45/d87/fa0 [0,4194304] 0 2024-09-13T21:40:51.698 INFO:tasks.workunit.client.1.smithi116.stdout:0/998: rename d2/c76 to d2/dc/c13b 0 2024-09-13T21:40:51.699 INFO:tasks.workunit.client.1.smithi116.stdout:8/841: link d2/d10/d19/d21/d69/c99 d2/d10/d19/d21/d69/cfd 0 2024-09-13T21:40:51.700 INFO:tasks.workunit.client.1.smithi116.stdout:8/842: creat d2/d10/d19/dea/ffe x:0 0 0 2024-09-13T21:40:51.701 INFO:tasks.workunit.client.1.smithi116.stdout:8/843: truncate d2/d27/d62/f7b 4769838 0 2024-09-13T21:40:51.701 INFO:tasks.workunit.client.1.smithi116.stdout:8/844: write d2/d10/d19/d21/f2d [2865618,41140] 0 2024-09-13T21:40:51.701 INFO:tasks.workunit.client.1.smithi116.stdout:8/845: chown d2/d10/l32 105 1 2024-09-13T21:40:51.701 INFO:tasks.workunit.client.1.smithi116.stdout:4/785: dwrite d0/d56/d57/fa0 [0,4194304] 0 2024-09-13T21:40:51.702 INFO:tasks.workunit.client.1.smithi116.stdout:7/979: dwrite d5/d9/db/d21/d6e/d6f/fee [0,4194304] 0 2024-09-13T21:40:51.702 INFO:tasks.workunit.client.1.smithi116.stdout:7/980: truncate d5/d9/d27/d31/d38/d48/f94 1378359 0 2024-09-13T21:40:51.705 INFO:tasks.workunit.client.1.smithi116.stdout:4/786: dread d0/dd/f3b [0,4194304] 0 2024-09-13T21:40:51.709 INFO:tasks.workunit.client.1.smithi116.stdout:4/787: mkdir d0/dd/d7c/dfc 0 2024-09-13T21:40:51.709 INFO:tasks.workunit.client.1.smithi116.stdout:4/788: chown d0/dd/d13/c1d 503936 1 2024-09-13T21:40:51.711 INFO:tasks.workunit.client.1.smithi116.stdout:0/999: dread d2/dc/d12/d28/f88 [0,4194304] 0 2024-09-13T21:40:51.715 INFO:tasks.workunit.client.1.smithi116.stdout:2/799: dwrite d0/d5/fc5 [0,4194304] 0 2024-09-13T21:40:51.716 INFO:tasks.workunit.client.1.smithi116.stdout:8/846: dread d2/d10/d19/d3a/d4c/d7a/f89 [0,4194304] 0 2024-09-13T21:40:51.717 INFO:tasks.workunit.client.1.smithi116.stdout:8/847: readlink d2/d10/d19/d42/d45/d87/lf7 0 2024-09-13T21:40:51.719 INFO:tasks.workunit.client.1.smithi116.stdout:2/800: mknod d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/c109 0 2024-09-13T21:40:51.720 INFO:tasks.workunit.client.1.smithi116.stdout:4/789: dread d0/dd/d13/f46 [0,4194304] 0 2024-09-13T21:40:51.721 INFO:tasks.workunit.client.1.smithi116.stdout:8/848: creat d2/d10/d19/d3a/d4c/fff x:0 0 0 2024-09-13T21:40:51.723 INFO:tasks.workunit.client.1.smithi116.stdout:7/981: dwrite d5/d9/d27/f90 [0,4194304] 0 2024-09-13T21:40:51.724 INFO:tasks.workunit.client.1.smithi116.stdout:7/982: write d5/d9/d27/ded/d22/d24/d6b/d72/d74/f121 [521673,29800] 0 2024-09-13T21:40:51.724 INFO:tasks.workunit.client.1.smithi116.stdout:7/983: readlink d5/db0/def/lf4 0 2024-09-13T21:40:51.724 INFO:tasks.workunit.client.1.smithi116.stdout:7/984: fdatasync d5/d9/d27/ded/d22/d24/f136 0 2024-09-13T21:40:51.724 INFO:tasks.workunit.client.1.smithi116.stdout:2/801: symlink d0/d3a/d82/d62/d1f/l10a 0 2024-09-13T21:40:51.725 INFO:tasks.workunit.client.1.smithi116.stdout:4/790: symlink d0/d32/d5f/lfd 0 2024-09-13T21:40:51.725 INFO:tasks.workunit.client.1.smithi116.stdout:4/791: rename d0/dd/dcf to d0/dd/dcf/dfe 22 2024-09-13T21:40:51.726 INFO:tasks.workunit.client.1.smithi116.stdout:2/802: mkdir d0/d3a/d82/d62/d1f/d5d/d89/d10b 0 2024-09-13T21:40:51.726 INFO:tasks.workunit.client.1.smithi116.stdout:2/803: chown d0/d5/d2a/c83 444 1 2024-09-13T21:40:51.729 INFO:tasks.workunit.client.1.smithi116.stdout:2/804: getdents d0/d3a/d82 0 2024-09-13T21:40:51.731 INFO:tasks.workunit.client.1.smithi116.stdout:2/805: symlink d0/d3a/d82/d62/l10c 0 2024-09-13T21:40:51.731 INFO:tasks.workunit.client.1.smithi116.stdout:2/806: chown d0/d7/d86/df4 213 1 2024-09-13T21:40:51.731 INFO:tasks.workunit.client.1.smithi116.stdout:2/807: dread - d0/d7/d86/dd1/fe2 zero size 2024-09-13T21:40:51.731 INFO:tasks.workunit.client.1.smithi116.stdout:2/808: write d0/d7/d2b/d61/fba [334716,84563] 0 2024-09-13T21:40:51.731 INFO:tasks.workunit.client.1.smithi116.stdout:2/809: mkdir d0/d7/d2b/db6/d10d 0 2024-09-13T21:40:51.732 INFO:tasks.workunit.client.1.smithi116.stdout:2/810: chown d0/d3a/d82/d62/d1f/d5d/d72/daa/l7e 471524 1 2024-09-13T21:40:51.733 INFO:tasks.workunit.client.1.smithi116.stdout:2/811: truncate d0/d5/f10 1106535 0 2024-09-13T21:40:51.733 INFO:tasks.workunit.client.1.smithi116.stdout:2/812: chown d0/d3a/d82/d68/cd0 1883893 1 2024-09-13T21:40:51.733 INFO:tasks.workunit.client.1.smithi116.stdout:2/813: chown d0/d3a/d82/d62/d1f/d5d/c94 659 1 2024-09-13T21:40:51.733 INFO:tasks.workunit.client.1.smithi116.stdout:2/814: creat d0/d7/d2b/d61/f10e x:0 0 0 2024-09-13T21:40:51.734 INFO:tasks.workunit.client.1.smithi116.stdout:2/815: mkdir d0/d3a/d82/d10f 0 2024-09-13T21:40:51.734 INFO:tasks.workunit.client.1.smithi116.stdout:2/816: fdatasync d0/d3a/d82/d62/d1f/d5d/d89/fd7 0 2024-09-13T21:40:51.735 INFO:tasks.workunit.client.1.smithi116.stdout:2/817: creat d0/d3a/d82/d62/d1f/d5d/f110 x:0 0 0 2024-09-13T21:40:51.735 INFO:tasks.workunit.client.1.smithi116.stdout:2/818: symlink d0/d7/d49/l111 0 2024-09-13T21:40:51.736 INFO:tasks.workunit.client.1.smithi116.stdout:2/819: symlink d0/d3a/d82/d62/d75/d77/l112 0 2024-09-13T21:40:51.737 INFO:tasks.workunit.client.1.smithi116.stdout:2/820: creat d0/d7/d49/f113 x:0 0 0 2024-09-13T21:40:51.738 INFO:tasks.workunit.client.1.smithi116.stdout:9/579: sync 2024-09-13T21:40:51.738 INFO:tasks.workunit.client.1.smithi116.stdout:5/948: sync 2024-09-13T21:40:51.738 INFO:tasks.workunit.client.1.smithi116.stdout:1/732: sync 2024-09-13T21:40:51.738 INFO:tasks.workunit.client.1.smithi116.stdout:6/917: sync 2024-09-13T21:40:51.738 INFO:tasks.workunit.client.1.smithi116.stdout:9/580: write d2/f6d [4405146,29559] 0 2024-09-13T21:40:51.740 INFO:tasks.workunit.client.1.smithi116.stdout:1/733: link d4/d14/d2a/ceb d4/d23/c10a 0 2024-09-13T21:40:51.740 INFO:tasks.workunit.client.1.smithi116.stdout:5/949: link d7/d1d/d46/d85/d96/dd6/l101 d7/d1d/l138 0 2024-09-13T21:40:51.742 INFO:tasks.workunit.client.1.smithi116.stdout:9/581: unlink d2/d10/d4c/c65 0 2024-09-13T21:40:51.743 INFO:tasks.workunit.client.1.smithi116.stdout:5/950: creat d7/d1d/f139 x:0 0 0 2024-09-13T21:40:51.749 INFO:tasks.workunit.client.1.smithi116.stdout:9/582: rename d2/d10/l71 to d2/d10/d6e/lac 0 2024-09-13T21:40:51.749 INFO:tasks.workunit.client.1.smithi116.stdout:9/583: fdatasync d2/f13 0 2024-09-13T21:40:51.751 INFO:tasks.workunit.client.1.smithi116.stdout:5/951: rename d7/d1d/d46/dd4/d5e/d65/l6b to d7/d1d/de3/l13a 0 2024-09-13T21:40:51.751 INFO:tasks.workunit.client.1.smithi116.stdout:5/952: dread - d7/d1d/d46/d5c/dcc/f11b zero size 2024-09-13T21:40:51.752 INFO:tasks.workunit.client.1.smithi116.stdout:6/918: dread d8/d10/d33/f46 [0,4194304] 0 2024-09-13T21:40:51.752 INFO:tasks.workunit.client.1.smithi116.stdout:2/821: dread d0/d5/de3/f104 [0,4194304] 0 2024-09-13T21:40:51.753 INFO:tasks.workunit.client.1.smithi116.stdout:5/953: unlink d7/d1d/d46/l108 0 2024-09-13T21:40:51.755 INFO:tasks.workunit.client.1.smithi116.stdout:6/919: link d8/d10/d65/f8e d8/d17/d70/f13b 0 2024-09-13T21:40:51.756 INFO:tasks.workunit.client.1.smithi116.stdout:2/822: creat d0/de9/f114 x:0 0 0 2024-09-13T21:40:51.757 INFO:tasks.workunit.client.1.smithi116.stdout:2/823: fdatasync d0/d3a/d82/d62/d1f/d5d/d89/f107 0 2024-09-13T21:40:51.757 INFO:tasks.workunit.client.1.smithi116.stdout:2/824: stat d0/d3a/d82/d62/f74 0 2024-09-13T21:40:51.758 INFO:tasks.workunit.client.1.smithi116.stdout:6/920: mknod d8/d15/c13c 0 2024-09-13T21:40:51.758 INFO:tasks.workunit.client.1.smithi116.stdout:6/921: truncate d8/d17/d70/da0/daf/d113/f109 509422 0 2024-09-13T21:40:51.758 INFO:tasks.workunit.client.1.smithi116.stdout:1/734: dwrite d4/d14/d52/d2f/d91/fa9 [0,4194304] 0 2024-09-13T21:40:51.758 INFO:tasks.workunit.client.1.smithi116.stdout:1/735: stat d4/d14/c30 0 2024-09-13T21:40:51.759 INFO:tasks.workunit.client.1.smithi116.stdout:2/825: creat d0/d5/de3/f115 x:0 0 0 2024-09-13T21:40:51.759 INFO:tasks.workunit.client.1.smithi116.stdout:2/826: fsync d0/d3a/d82/d62/f74 0 2024-09-13T21:40:51.760 INFO:tasks.workunit.client.1.smithi116.stdout:6/922: symlink d8/d15/d2e/d2f/d38/d112/df4/l13d 0 2024-09-13T21:40:51.760 INFO:tasks.workunit.client.1.smithi116.stdout:6/923: chown d8/d10/d65/c74 12769 1 2024-09-13T21:40:51.761 INFO:tasks.workunit.client.1.smithi116.stdout:6/924: write d8/d15/d2e/fcf [231434,78674] 0 2024-09-13T21:40:51.762 INFO:tasks.workunit.client.1.smithi116.stdout:6/925: rename d8/d17/d70/da0/l122 to d8/d17/d70/da0/l13e 0 2024-09-13T21:40:51.772 INFO:tasks.workunit.client.1.smithi116.stdout:6/926: dread d8/d10/f55 [0,4194304] 0 2024-09-13T21:40:51.774 INFO:tasks.workunit.client.1.smithi116.stdout:6/927: rename d8/d17/d70/fcc to d8/db5/f13f 0 2024-09-13T21:40:51.774 INFO:tasks.workunit.client.1.smithi116.stdout:6/928: dread - d8/d15/d2e/d2f/d38/d9c/f128 zero size 2024-09-13T21:40:51.774 INFO:tasks.workunit.client.1.smithi116.stdout:6/929: readlink d8/d17/d70/l135 0 2024-09-13T21:40:51.775 INFO:tasks.workunit.client.1.smithi116.stdout:1/736: dread d4/d74/fcb [0,4194304] 0 2024-09-13T21:40:51.775 INFO:tasks.workunit.client.1.smithi116.stdout:1/737: write d4/d23/f7c [4224360,118078] 0 2024-09-13T21:40:51.777 INFO:tasks.workunit.client.1.smithi116.stdout:2/827: write d0/d7/f12 [6763047,44301] 0 2024-09-13T21:40:51.777 INFO:tasks.workunit.client.1.smithi116.stdout:2/828: creat d0/d5/d8/dd2/f116 x:0 0 0 2024-09-13T21:40:51.778 INFO:tasks.workunit.client.1.smithi116.stdout:1/738: mknod d4/d14/d52/d2f/c10b 0 2024-09-13T21:40:51.782 INFO:tasks.workunit.client.1.smithi116.stdout:1/739: unlink d4/d14/d52/ce7 0 2024-09-13T21:40:51.784 INFO:tasks.workunit.client.1.smithi116.stdout:1/740: creat d4/d14/d52/d2f/d5d/d90/f10c x:0 0 0 2024-09-13T21:40:51.786 INFO:tasks.workunit.client.1.smithi116.stdout:2/829: write d0/d7/d2d/f6a [2065084,35885] 0 2024-09-13T21:40:51.788 INFO:tasks.workunit.client.1.smithi116.stdout:2/830: dread d0/d3a/d82/d62/d75/d77/fe6 [0,4194304] 0 2024-09-13T21:40:51.806 INFO:tasks.workunit.client.1.smithi116.stdout:5/954: dread d7/d1d/d46/dd4/d5e/d65/d6a/ff5 [0,4194304] 0 2024-09-13T21:40:51.810 INFO:tasks.workunit.client.1.smithi116.stdout:7/985: dwrite d5/f59 [8388608,4194304] 0 2024-09-13T21:40:51.812 INFO:tasks.workunit.client.1.smithi116.stdout:7/986: getdents d5/d9 0 2024-09-13T21:40:51.814 INFO:tasks.workunit.client.1.smithi116.stdout:7/987: rename d5/d9/d27/d31/d38/d48/f75 to d5/d9/db/da3/f14c 0 2024-09-13T21:40:51.816 INFO:tasks.workunit.client.1.smithi116.stdout:7/988: truncate d5/d9/d27/ded/d22/d24/d6b/d72/d74/f115 3089391 0 2024-09-13T21:40:51.816 INFO:tasks.workunit.client.1.smithi116.stdout:7/989: readlink d5/d9/l1b 0 2024-09-13T21:40:51.817 INFO:tasks.workunit.client.1.smithi116.stdout:7/990: symlink d5/d9/db/d21/l14d 0 2024-09-13T21:40:51.818 INFO:tasks.workunit.client.1.smithi116.stdout:7/991: creat d5/d9/db/d21/d6e/d6f/d70/d117/f14e x:0 0 0 2024-09-13T21:40:51.819 INFO:tasks.workunit.client.1.smithi116.stdout:2/831: dwrite d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/fab [0,4194304] 0 2024-09-13T21:40:51.823 INFO:tasks.workunit.client.1.smithi116.stdout:2/832: mknod d0/d3a/d82/d62/d1f/d5d/d89/ddc/c117 0 2024-09-13T21:40:51.825 INFO:tasks.workunit.client.1.smithi116.stdout:2/833: symlink d0/l118 0 2024-09-13T21:40:51.828 INFO:tasks.workunit.client.1.smithi116.stdout:9/584: dwrite d2/d8/d3e/f56 [0,4194304] 0 2024-09-13T21:40:51.829 INFO:tasks.workunit.client.1.smithi116.stdout:6/930: dwrite d8/d15/f92 [0,4194304] 0 2024-09-13T21:40:51.830 INFO:tasks.workunit.client.1.smithi116.stdout:2/834: unlink d0/d5/f101 0 2024-09-13T21:40:51.831 INFO:tasks.workunit.client.1.smithi116.stdout:5/955: dwrite d7/d1d/f139 [0,4194304] 0 2024-09-13T21:40:51.837 INFO:tasks.workunit.client.1.smithi116.stdout:2/835: link d0/d5/d8/d7a/fbc d0/d3a/d82/d62/d1f/d5d/d72/f119 0 2024-09-13T21:40:51.837 INFO:tasks.workunit.client.1.smithi116.stdout:2/836: chown d0/d7/d2b/db6/d10d 45207270 1 2024-09-13T21:40:51.838 INFO:tasks.workunit.client.1.smithi116.stdout:9/585: dread d2/d10/f2a [0,4194304] 0 2024-09-13T21:40:51.840 INFO:tasks.workunit.client.1.smithi116.stdout:5/956: mknod d7/d1d/d46/dd4/d5e/d65/d6f/dd5/c13b 0 2024-09-13T21:40:51.842 INFO:tasks.workunit.client.1.smithi116.stdout:2/837: symlink d0/d5/d8/dd2/l11a 0 2024-09-13T21:40:51.843 INFO:tasks.workunit.client.1.smithi116.stdout:7/992: dwrite d5/d9/db/d21/d6e/d6f/d70/d117/f14e [0,4194304] 0 2024-09-13T21:40:51.845 INFO:tasks.workunit.client.1.smithi116.stdout:9/586: mkdir d2/d10/d4c/d98/dad 0 2024-09-13T21:40:51.846 INFO:tasks.workunit.client.1.smithi116.stdout:6/931: rmdir d8/d17/d70/d105 0 2024-09-13T21:40:51.848 INFO:tasks.workunit.client.1.smithi116.stdout:1/741: dwrite d4/d23/d57/fa1 [0,4194304] 0 2024-09-13T21:40:51.848 INFO:tasks.workunit.client.1.smithi116.stdout:2/838: rename d0/d7/d2b/d61/f10e to d0/de9/f11b 0 2024-09-13T21:40:51.849 INFO:tasks.workunit.client.1.smithi116.stdout:2/839: chown d0/l4 3850455 1 2024-09-13T21:40:51.851 INFO:tasks.workunit.client.1.smithi116.stdout:7/993: link d5/db0/def/lf4 d5/d9/d27/ded/d22/d24/d5f/de5/l14f 0 2024-09-13T21:40:51.853 INFO:tasks.workunit.client.1.smithi116.stdout:6/932: mkdir d8/d10/d24/d110/de2/d12a/d140 0 2024-09-13T21:40:51.853 INFO:tasks.workunit.client.1.smithi116.stdout:6/933: chown d8/d15/d2e/d2f/d38/f89 386 1 2024-09-13T21:40:51.856 INFO:tasks.workunit.client.1.smithi116.stdout:1/742: symlink d4/d14/d52/d2f/d91/dac/df0/dc0/l10d 0 2024-09-13T21:40:51.856 INFO:tasks.workunit.client.1.smithi116.stdout:9/587: dread d2/f6d [0,4194304] 0 2024-09-13T21:40:51.856 INFO:tasks.workunit.client.1.smithi116.stdout:1/743: chown d4/d14/d52/d2f/d5c/daf/fe6 82640955 1 2024-09-13T21:40:51.856 INFO:tasks.workunit.client.1.smithi116.stdout:1/744: truncate d4/d14/d2a/fd2 1676530 0 2024-09-13T21:40:51.862 INFO:tasks.workunit.client.1.smithi116.stdout:7/994: mknod d5/d9/db/d21/c150 0 2024-09-13T21:40:51.863 INFO:tasks.workunit.client.1.smithi116.stdout:6/934: mkdir d8/d15/d2e/d2f/d38/d9c/dcd/d141 0 2024-09-13T21:40:51.863 INFO:tasks.workunit.client.1.smithi116.stdout:6/935: chown d8/cb 0 1 2024-09-13T21:40:51.863 INFO:tasks.workunit.client.1.smithi116.stdout:1/745: dread d4/d23/f27 [0,4194304] 0 2024-09-13T21:40:51.864 INFO:tasks.workunit.client.1.smithi116.stdout:9/588: mkdir d2/d8/d3e/dae 0 2024-09-13T21:40:51.864 INFO:tasks.workunit.client.1.smithi116.stdout:9/589: write d2/d10/d4c/f5a [1182937,59912] 0 2024-09-13T21:40:51.866 INFO:tasks.workunit.client.1.smithi116.stdout:2/840: symlink d0/d7/d86/l11c 0 2024-09-13T21:40:51.867 INFO:tasks.workunit.client.1.smithi116.stdout:7/995: mknod d5/d9/db/da3/c151 0 2024-09-13T21:40:51.867 INFO:tasks.workunit.client.1.smithi116.stdout:6/936: creat d8/f142 x:0 0 0 2024-09-13T21:40:51.867 INFO:tasks.workunit.client.1.smithi116.stdout:6/937: fdatasync d8/fa 0 2024-09-13T21:40:51.868 INFO:tasks.workunit.client.1.smithi116.stdout:6/938: dread - d8/d17/d70/f133 zero size 2024-09-13T21:40:51.868 INFO:tasks.workunit.client.1.smithi116.stdout:6/939: chown d8/d10/d24/d110/de2/d12a/fac 4785 1 2024-09-13T21:40:51.868 INFO:tasks.workunit.client.1.smithi116.stdout:6/940: read d8/d15/d2e/d2f/d38/f73 [121581,98191] 0 2024-09-13T21:40:51.868 INFO:tasks.workunit.client.1.smithi116.stdout:6/941: write d8/f2c [4879909,81008] 0 2024-09-13T21:40:51.869 INFO:tasks.workunit.client.1.smithi116.stdout:9/590: creat d2/d8/faf x:0 0 0 2024-09-13T21:40:51.872 INFO:tasks.workunit.client.1.smithi116.stdout:7/996: creat d5/d9/d27/ded/d2e/d52/d145/f152 x:0 0 0 2024-09-13T21:40:51.873 INFO:tasks.workunit.client.1.smithi116.stdout:7/997: read - d5/d9/d27/ded/d22/d24/d5f/dfc/fff zero size 2024-09-13T21:40:51.873 INFO:tasks.workunit.client.1.smithi116.stdout:7/998: getdents d5/d9/d27/d31/d38/d111/d148 0 2024-09-13T21:40:51.873 INFO:tasks.workunit.client.1.smithi116.stdout:6/942: mkdir d8/d15/d2e/d143 0 2024-09-13T21:40:51.873 INFO:tasks.workunit.client.1.smithi116.stdout:7/999: stat d5/d9/db/d21/d6e/d6f/d70/d80/db1/f130 0 2024-09-13T21:40:51.884 INFO:tasks.workunit.client.1.smithi116.stdout:6/943: write d8/d10/d24/f29 [3627582,34185] 0 2024-09-13T21:40:51.885 INFO:tasks.workunit.client.1.smithi116.stdout:6/944: getdents d8/d10/d65 0 2024-09-13T21:40:51.886 INFO:tasks.workunit.client.1.smithi116.stdout:6/945: chown d8/d17/d70/f13b 29048591 1 2024-09-13T21:40:51.886 INFO:tasks.workunit.client.1.smithi116.stdout:6/946: unlink d8/d15/fa2 0 2024-09-13T21:40:51.909 INFO:tasks.workunit.client.1.smithi116.stdout:1/746: dwrite d4/d14/d52/d2f/d5c/dff/f102 [0,4194304] 0 2024-09-13T21:40:51.911 INFO:tasks.workunit.client.1.smithi116.stdout:1/747: rename d4/d74/d8d/lad to d4/d14/d52/l10e 0 2024-09-13T21:40:51.911 INFO:tasks.workunit.client.1.smithi116.stdout:1/748: stat d4/d23/d57/d101 0 2024-09-13T21:40:51.912 INFO:tasks.workunit.client.1.smithi116.stdout:1/749: creat d4/f10f x:0 0 0 2024-09-13T21:40:51.913 INFO:tasks.workunit.client.1.smithi116.stdout:1/750: symlink d4/d23/d56/da3/l110 0 2024-09-13T21:40:51.914 INFO:tasks.workunit.client.1.smithi116.stdout:1/751: dread d4/d14/d52/d2f/d91/f94 [0,4194304] 0 2024-09-13T21:40:51.921 INFO:tasks.workunit.client.1.smithi116.stdout:9/591: dwrite d2/d43/f91 [0,4194304] 0 2024-09-13T21:40:51.922 INFO:tasks.workunit.client.1.smithi116.stdout:6/947: dwrite d8/d15/d2e/d2f/fc8 [0,4194304] 0 2024-09-13T21:40:51.927 INFO:tasks.workunit.client.1.smithi116.stdout:1/752: write d4/ff [3770201,52869] 0 2024-09-13T21:40:51.927 INFO:tasks.workunit.client.1.smithi116.stdout:2/841: dwrite d0/d3a/d82/d62/d1f/d5d/d72/daa/fcc [0,4194304] 0 2024-09-13T21:40:51.929 INFO:tasks.workunit.client.1.smithi116.stdout:6/948: mkdir d8/d1e/dbb/d144 0 2024-09-13T21:40:51.947 INFO:tasks.workunit.client.1.smithi116.stdout:9/592: dwrite d2/d10/d14/d38/f6b [0,4194304] 0 2024-09-13T21:40:51.948 INFO:tasks.workunit.client.1.smithi116.stdout:1/753: rmdir d4 39 2024-09-13T21:40:51.951 INFO:tasks.workunit.client.1.smithi116.stdout:2/842: getdents d0/d5/de3 0 2024-09-13T21:40:51.951 INFO:tasks.workunit.client.1.smithi116.stdout:2/843: write d0/f79 [658316,38369] 0 2024-09-13T21:40:51.955 INFO:tasks.workunit.client.1.smithi116.stdout:9/593: creat d2/d43/fb0 x:0 0 0 2024-09-13T21:40:51.955 INFO:tasks.workunit.client.1.smithi116.stdout:9/594: readlink d2/d8/l73 0 2024-09-13T21:40:51.955 INFO:tasks.workunit.client.1.smithi116.stdout:9/595: write d2/f3 [4879708,121032] 0 2024-09-13T21:40:51.955 INFO:tasks.workunit.client.1.smithi116.stdout:9/596: dread - d2/d10/d14/d38/d3a/f7c zero size 2024-09-13T21:40:51.955 INFO:tasks.workunit.client.1.smithi116.stdout:9/597: stat d2/d43/f8e 0 2024-09-13T21:40:51.955 INFO:tasks.workunit.client.1.smithi116.stdout:9/598: truncate d2/d43/fb0 887362 0 2024-09-13T21:40:51.955 INFO:tasks.workunit.client.1.smithi116.stdout:9/599: chown d2/f2b 1 1 2024-09-13T21:40:51.956 INFO:tasks.workunit.client.1.smithi116.stdout:1/754: creat d4/d14/d52/d2f/d5c/daf/db9/f111 x:0 0 0 2024-09-13T21:40:51.958 INFO:tasks.workunit.client.1.smithi116.stdout:2/844: unlink d0/d3a/d82/d62/d1f/d5d/c5e 0 2024-09-13T21:40:51.959 INFO:tasks.workunit.client.1.smithi116.stdout:9/600: rmdir d2/d10/d14/d38 39 2024-09-13T21:40:51.959 INFO:tasks.workunit.client.1.smithi116.stdout:9/601: write d2/f13 [467722,79810] 0 2024-09-13T21:40:51.961 INFO:tasks.workunit.client.1.smithi116.stdout:1/755: mknod d4/d14/d52/d2f/d91/dac/df0/dc0/c112 0 2024-09-13T21:40:51.965 INFO:tasks.workunit.client.1.smithi116.stdout:9/602: rename d2/d10/d14/l82 to d2/d43/lb1 0 2024-09-13T21:40:51.965 INFO:tasks.workunit.client.1.smithi116.stdout:9/603: truncate d2/d8/f33 1194222 0 2024-09-13T21:40:51.966 INFO:tasks.workunit.client.1.smithi116.stdout:2/845: rmdir d0/d3a/d82/d62/d1f/d5d/d72 39 2024-09-13T21:40:51.967 INFO:tasks.workunit.client.1.smithi116.stdout:2/846: readlink d0/d3a/d82/d68/l6f 0 2024-09-13T21:40:51.977 INFO:tasks.workunit.client.1.smithi116.stdout:2/847: dread d0/d5/d2a/f6d [0,4194304] 0 2024-09-13T21:40:51.978 INFO:tasks.workunit.client.1.smithi116.stdout:2/848: symlink d0/d7/d49/l11d 0 2024-09-13T21:40:51.980 INFO:tasks.workunit.client.1.smithi116.stdout:9/604: write d2/f4 [2127094,92373] 0 2024-09-13T21:40:51.980 INFO:tasks.workunit.client.1.smithi116.stdout:9/605: write d2/d8/fd [4467396,121551] 0 2024-09-13T21:40:51.980 INFO:tasks.workunit.client.1.smithi116.stdout:9/606: chown d2/d10/d4c/f51 0 1 2024-09-13T21:40:51.993 INFO:tasks.workunit.client.1.smithi116.stdout:6/949: dwrite d8/d17/d70/f13b [0,4194304] 0 2024-09-13T21:40:51.994 INFO:tasks.workunit.client.1.smithi116.stdout:9/607: write d2/d43/f8e [758716,27814] 0 2024-09-13T21:40:51.994 INFO:tasks.workunit.client.1.smithi116.stdout:1/756: dwrite d4/d23/d57/f97 [0,4194304] 0 2024-09-13T21:40:51.994 INFO:tasks.workunit.client.1.smithi116.stdout:9/608: fsync d2/f6d 0 2024-09-13T21:40:51.996 INFO:tasks.workunit.client.1.smithi116.stdout:6/950: creat d8/d10/d24/d110/de2/d12a/d140/f145 x:0 0 0 2024-09-13T21:40:51.997 INFO:tasks.workunit.client.1.smithi116.stdout:9/609: creat d2/d10/d14/d38/fb2 x:0 0 0 2024-09-13T21:40:51.997 INFO:tasks.workunit.client.1.smithi116.stdout:1/757: symlink d4/d14/d2a/dd3/l113 0 2024-09-13T21:40:51.998 INFO:tasks.workunit.client.1.smithi116.stdout:1/758: dread - d4/d23/d56/da3/fd0 zero size 2024-09-13T21:40:51.999 INFO:tasks.workunit.client.1.smithi116.stdout:6/951: unlink d8/d15/d2e/d9e/de9/l120 0 2024-09-13T21:40:51.999 INFO:tasks.workunit.client.1.smithi116.stdout:6/952: chown d8/d10/d24/d110/de2/d12a/df8/f11e 1072943 1 2024-09-13T21:40:51.999 INFO:tasks.workunit.client.1.smithi116.stdout:9/610: stat d2/d5d/d69/c95 0 2024-09-13T21:40:51.999 INFO:tasks.workunit.client.1.smithi116.stdout:9/611: truncate d2/d10/d14/d38/d3a/f6c 9291337 0 2024-09-13T21:40:51.999 INFO:tasks.workunit.client.1.smithi116.stdout:9/612: stat d2/f2d 0 2024-09-13T21:40:52.000 INFO:tasks.workunit.client.1.smithi116.stdout:1/759: truncate d4/d14/d52/d2f/d5c/daf/fc2 2109622 0 2024-09-13T21:40:52.000 INFO:tasks.workunit.client.1.smithi116.stdout:9/613: dread d2/d10/d14/f45 [0,4194304] 0 2024-09-13T21:40:52.000 INFO:tasks.workunit.client.1.smithi116.stdout:9/614: creat d2/d10/fb3 x:0 0 0 2024-09-13T21:40:52.001 INFO:tasks.workunit.client.1.smithi116.stdout:1/760: truncate d4/d23/d57/fa1 351591 0 2024-09-13T21:40:52.003 INFO:tasks.workunit.client.1.smithi116.stdout:9/615: unlink d2/d8/d3e/lab 0 2024-09-13T21:40:52.005 INFO:tasks.workunit.client.1.smithi116.stdout:1/761: creat d4/d14/f114 x:0 0 0 2024-09-13T21:40:52.007 INFO:tasks.workunit.client.1.smithi116.stdout:9/616: unlink d2/d10/l1f 0 2024-09-13T21:40:52.008 INFO:tasks.workunit.client.1.smithi116.stdout:1/762: creat d4/f115 x:0 0 0 2024-09-13T21:40:52.008 INFO:tasks.workunit.client.1.smithi116.stdout:1/763: stat d4/d14/d52/d2f/d91/dac/df0/dc0 0 2024-09-13T21:40:52.008 INFO:tasks.workunit.client.1.smithi116.stdout:2/849: dwrite d0/d3a/d82/d62/d75/d77/f99 [0,4194304] 0 2024-09-13T21:40:52.009 INFO:tasks.workunit.client.1.smithi116.stdout:9/617: mkdir d2/d5d/d8f/db4 0 2024-09-13T21:40:52.009 INFO:tasks.workunit.client.1.smithi116.stdout:9/618: getdents d2/d8/d93/da0 0 2024-09-13T21:40:52.012 INFO:tasks.workunit.client.1.smithi116.stdout:2/850: symlink d0/d3a/l11e 0 2024-09-13T21:40:52.013 INFO:tasks.workunit.client.1.smithi116.stdout:2/851: mkdir d0/d7/d86/df4/d11f 0 2024-09-13T21:40:52.013 INFO:tasks.workunit.client.1.smithi116.stdout:2/852: chown d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/ced 30165 1 2024-09-13T21:40:52.013 INFO:tasks.workunit.client.1.smithi116.stdout:2/853: fsync d0/d7/f6e 0 2024-09-13T21:40:52.015 INFO:tasks.workunit.client.1.smithi116.stdout:2/854: dread d0/d7/d2b/f78 [0,4194304] 0 2024-09-13T21:40:52.015 INFO:tasks.workunit.client.1.smithi116.stdout:2/855: truncate d0/d7/d2b/f78 1049261 0 2024-09-13T21:40:52.018 INFO:tasks.workunit.client.1.smithi116.stdout:2/856: link d0/d3a/l11e d0/d3a/d82/d62/d1f/d5d/d60/l120 0 2024-09-13T21:40:52.029 INFO:tasks.workunit.client.1.smithi116.stdout:2/857: dread d0/d5/d8/d7a/f91 [0,4194304] 0 2024-09-13T21:40:52.031 INFO:tasks.workunit.client.1.smithi116.stdout:2/858: creat d0/d3a/d82/d62/d1f/d5d/d72/daa/f121 x:0 0 0 2024-09-13T21:40:52.034 INFO:tasks.workunit.client.1.smithi116.stdout:6/953: dwrite d8/d17/d70/da0/fa4 [0,4194304] 0 2024-09-13T21:40:52.034 INFO:tasks.workunit.client.1.smithi116.stdout:6/954: fsync d8/d1e/f63 0 2024-09-13T21:40:52.035 INFO:tasks.workunit.client.1.smithi116.stdout:2/859: read d0/d5/d8/d7a/feb [1178514,109873] 0 2024-09-13T21:40:52.035 INFO:tasks.workunit.client.1.smithi116.stdout:2/860: creat d0/d5/d8/dd2/f122 x:0 0 0 2024-09-13T21:40:52.037 INFO:tasks.workunit.client.1.smithi116.stdout:1/764: dwrite d4/d23/d57/d92/fa6 [0,4194304] 0 2024-09-13T21:40:52.040 INFO:tasks.workunit.client.1.smithi116.stdout:2/861: creat d0/d7/d86/dd1/df0/f123 x:0 0 0 2024-09-13T21:40:52.040 INFO:tasks.workunit.client.1.smithi116.stdout:2/862: creat d0/d3a/d82/d62/d75/f124 x:0 0 0 2024-09-13T21:40:52.054 INFO:tasks.workunit.client.1.smithi116.stdout:8/849: sync 2024-09-13T21:40:52.054 INFO:tasks.workunit.client.1.smithi116.stdout:4/792: sync 2024-09-13T21:40:52.056 INFO:tasks.workunit.client.1.smithi116.stdout:4/793: rename d0/dd/f1b to d0/d56/d84/db1/fff 0 2024-09-13T21:40:52.056 INFO:tasks.workunit.client.1.smithi116.stdout:4/794: stat d0/d56/d57/db9 0 2024-09-13T21:40:52.058 INFO:tasks.workunit.client.1.smithi116.stdout:8/850: mkdir d2/d27/d66/d100 0 2024-09-13T21:40:52.059 INFO:tasks.workunit.client.1.smithi116.stdout:6/955: dwrite d8/d10/d33/f50 [0,4194304] 0 2024-09-13T21:40:52.059 INFO:tasks.workunit.client.1.smithi116.stdout:6/956: truncate d8/d17/d70/da0/ff9 934594 0 2024-09-13T21:40:52.059 INFO:tasks.workunit.client.1.smithi116.stdout:6/957: fdatasync d8/d15/d2e/ff2 0 2024-09-13T21:40:52.059 INFO:tasks.workunit.client.1.smithi116.stdout:8/851: link d2/d10/d19/d3a/ldc d2/d10/d19/d42/l101 0 2024-09-13T21:40:52.063 INFO:tasks.workunit.client.1.smithi116.stdout:2/863: dwrite d0/d3a/d82/d62/f46 [0,4194304] 0 2024-09-13T21:40:52.065 INFO:tasks.workunit.client.1.smithi116.stdout:2/864: link d0/d7/d49/lbd d0/de9/l125 0 2024-09-13T21:40:52.065 INFO:tasks.workunit.client.1.smithi116.stdout:2/865: mknod d0/d7/d86/df4/c126 0 2024-09-13T21:40:52.067 INFO:tasks.workunit.client.1.smithi116.stdout:2/866: creat d0/d3a/d82/d62/d75/d77/f127 x:0 0 0 2024-09-13T21:40:52.069 INFO:tasks.workunit.client.1.smithi116.stdout:2/867: rename d0/d5/d8/d7a/f91 to d0/d7/d2d/f128 0 2024-09-13T21:40:52.070 INFO:tasks.workunit.client.1.smithi116.stdout:2/868: mknod d0/d3a/c129 0 2024-09-13T21:40:52.070 INFO:tasks.workunit.client.1.smithi116.stdout:2/869: readlink d0/d7/d49/lfa 0 2024-09-13T21:40:52.085 INFO:tasks.workunit.client.1.smithi116.stdout:2/870: write d0/d3a/d82/d62/d1f/d5d/d60/f8a [3832269,86842] 0 2024-09-13T21:40:52.085 INFO:tasks.workunit.client.1.smithi116.stdout:2/871: chown d0/d3a/d82/d62/d1f/d5d/d60/f95 264810085 1 2024-09-13T21:40:52.086 INFO:tasks.workunit.client.1.smithi116.stdout:2/872: mkdir d0/d5/d8/d7a/d12a 0 2024-09-13T21:40:52.086 INFO:tasks.workunit.client.1.smithi116.stdout:2/873: creat d0/d3a/d82/d62/d75/d77/f12b x:0 0 0 2024-09-13T21:40:52.086 INFO:tasks.workunit.client.1.smithi116.stdout:2/874: write d0/d7/d2b/f3f [590530,127813] 0 2024-09-13T21:40:52.087 INFO:tasks.workunit.client.1.smithi116.stdout:4/795: dwrite d0/dd/d7c/fd9 [0,4194304] 0 2024-09-13T21:40:52.088 INFO:tasks.workunit.client.1.smithi116.stdout:4/796: write d0/f10 [1767952,92740] 0 2024-09-13T21:40:52.088 INFO:tasks.workunit.client.1.smithi116.stdout:4/797: readlink d0/dd/d13/l2a 0 2024-09-13T21:40:52.088 INFO:tasks.workunit.client.1.smithi116.stdout:4/798: chown d0/dd/d6b/dee 0 1 2024-09-13T21:40:52.088 INFO:tasks.workunit.client.1.smithi116.stdout:8/852: dwrite d2/d10/d19/d3a/d4c/fe0 [0,4194304] 0 2024-09-13T21:40:52.088 INFO:tasks.workunit.client.1.smithi116.stdout:8/853: dread - d2/d10/d19/d42/d45/fdf zero size 2024-09-13T21:40:52.088 INFO:tasks.workunit.client.1.smithi116.stdout:8/854: creat d2/d10/d19/d3a/d4c/d7a/f102 x:0 0 0 2024-09-13T21:40:52.088 INFO:tasks.workunit.client.1.smithi116.stdout:2/875: creat d0/d3a/d82/ddb/f12c x:0 0 0 2024-09-13T21:40:52.089 INFO:tasks.workunit.client.1.smithi116.stdout:4/799: symlink d0/dd/d6b/dee/l100 0 2024-09-13T21:40:52.091 INFO:tasks.workunit.client.1.smithi116.stdout:2/876: unlink d0/d3a/d82/d62/d1f/d5d/d72/daa/cf1 0 2024-09-13T21:40:52.092 INFO:tasks.workunit.client.1.smithi116.stdout:4/800: link d0/d56/d57/f89 d0/dd/d6b/d92/f101 0 2024-09-13T21:40:52.093 INFO:tasks.workunit.client.1.smithi116.stdout:2/877: dread d0/d5/d8/dd2/fe1 [0,4194304] 0 2024-09-13T21:40:52.098 INFO:tasks.workunit.client.1.smithi116.stdout:2/878: mkdir d0/d7/d2d/d105/d12d 0 2024-09-13T21:40:52.100 INFO:tasks.workunit.client.1.smithi116.stdout:4/801: rmdir d0/d32/da3 39 2024-09-13T21:40:52.100 INFO:tasks.workunit.client.1.smithi116.stdout:4/802: stat d0/d56/d57/db9/cbf 0 2024-09-13T21:40:52.101 INFO:tasks.workunit.client.1.smithi116.stdout:4/803: creat d0/dd/d6b/d71/f102 x:0 0 0 2024-09-13T21:40:52.126 INFO:tasks.workunit.client.1.smithi116.stdout:2/879: dwrite d0/d5/d8/dd2/f122 [0,4194304] 0 2024-09-13T21:40:52.126 INFO:tasks.workunit.client.1.smithi116.stdout:2/880: stat d0/d3a/d82/d62/f7b 0 2024-09-13T21:40:52.964 INFO:tasks.workunit.client.1.smithi116.stdout:8/855: sync 2024-09-13T21:40:52.964 INFO:tasks.workunit.client.1.smithi116.stdout:6/958: sync 2024-09-13T21:40:52.965 INFO:tasks.workunit.client.1.smithi116.stdout:4/804: sync 2024-09-13T21:40:52.965 INFO:tasks.workunit.client.1.smithi116.stdout:9/619: sync 2024-09-13T21:40:52.965 INFO:tasks.workunit.client.1.smithi116.stdout:8/856: fsync d2/d10/d19/fb1 0 2024-09-13T21:40:52.965 INFO:tasks.workunit.client.1.smithi116.stdout:4/805: chown d0/dd/d6b/le8 2084243 1 2024-09-13T21:40:52.965 INFO:tasks.workunit.client.1.smithi116.stdout:9/620: truncate d2/d8/faf 231193 0 2024-09-13T21:40:52.965 INFO:tasks.workunit.client.1.smithi116.stdout:8/857: fdatasync d2/d10/f11 0 2024-09-13T21:40:52.965 INFO:tasks.workunit.client.1.smithi116.stdout:5/957: sync 2024-09-13T21:40:52.965 INFO:tasks.workunit.client.1.smithi116.stdout:1/765: sync 2024-09-13T21:40:52.965 INFO:tasks.workunit.client.1.smithi116.stdout:2/881: sync 2024-09-13T21:40:52.966 INFO:tasks.workunit.client.1.smithi116.stdout:6/959: getdents d8/d10c 0 2024-09-13T21:40:52.966 INFO:tasks.workunit.client.1.smithi116.stdout:9/621: chown d2/d10/d14/d38/d3a/f7c 16077 1 2024-09-13T21:40:52.966 INFO:tasks.workunit.client.1.smithi116.stdout:9/622: chown d2/d10/d14/d38/c64 52 1 2024-09-13T21:40:52.967 INFO:tasks.workunit.client.1.smithi116.stdout:4/806: rename d0/dd/d6b/d92/d99/cd2 to d0/dd/d13/c103 0 2024-09-13T21:40:52.969 INFO:tasks.workunit.client.1.smithi116.stdout:8/858: mknod d2/d10/d19/d21/d22/d5d/d46/c103 0 2024-09-13T21:40:52.970 INFO:tasks.workunit.client.1.smithi116.stdout:8/859: fdatasync d2/d10/d19/fb1 0 2024-09-13T21:40:52.971 INFO:tasks.workunit.client.1.smithi116.stdout:1/766: truncate d4/d14/d52/d2f/d5c/f8c 345634 0 2024-09-13T21:40:52.972 INFO:tasks.workunit.client.1.smithi116.stdout:8/860: dread d2/d10/d19/d21/fdb [0,4194304] 0 2024-09-13T21:40:52.974 INFO:tasks.workunit.client.1.smithi116.stdout:5/958: creat d7/d1d/d46/dd4/d5e/d79/f13c x:0 0 0 2024-09-13T21:40:52.975 INFO:tasks.workunit.client.1.smithi116.stdout:4/807: link d0/dad/cd0 d0/dd/d13/d5a/dc4/c104 0 2024-09-13T21:40:52.976 INFO:tasks.workunit.client.1.smithi116.stdout:5/959: symlink d7/d1d/l13d 0 2024-09-13T21:40:52.976 INFO:tasks.workunit.client.1.smithi116.stdout:5/960: dread - d7/d1d/d46/d85/d96/f10e zero size 2024-09-13T21:40:52.976 INFO:tasks.workunit.client.1.smithi116.stdout:9/623: dread d2/d43/f8e [0,4194304] 0 2024-09-13T21:40:52.978 INFO:tasks.workunit.client.1.smithi116.stdout:9/624: symlink d2/d5d/d8f/lb5 0 2024-09-13T21:40:52.980 INFO:tasks.workunit.client.1.smithi116.stdout:9/625: creat d2/d10/fb6 x:0 0 0 2024-09-13T21:40:52.983 INFO:tasks.workunit.client.1.smithi116.stdout:9/626: symlink d2/d10/d4c/d98/dad/lb7 0 2024-09-13T21:40:52.987 INFO:tasks.workunit.client.1.smithi116.stdout:2/882: dwrite d0/d5/d8/d7a/ff7 [0,4194304] 0 2024-09-13T21:40:52.991 INFO:tasks.workunit.client.1.smithi116.stdout:5/961: dread d7/d1d/d46/d85/d96/fe9 [0,4194304] 0 2024-09-13T21:40:52.992 INFO:tasks.workunit.client.1.smithi116.stdout:2/883: truncate d0/d5/f4b 1560161 0 2024-09-13T21:40:52.992 INFO:tasks.workunit.client.1.smithi116.stdout:2/884: fdatasync d0/d3a/d82/d62/d1f/d5d/f110 0 2024-09-13T21:40:52.992 INFO:tasks.workunit.client.1.smithi116.stdout:2/885: stat d0/d3a/d82/d62/f4a 0 2024-09-13T21:40:52.992 INFO:tasks.workunit.client.1.smithi116.stdout:2/886: dread - d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/fec zero size 2024-09-13T21:40:52.993 INFO:tasks.workunit.client.1.smithi116.stdout:5/962: truncate d7/d40/f9e 259932 0 2024-09-13T21:40:52.994 INFO:tasks.workunit.client.1.smithi116.stdout:2/887: mknod d0/d5/d8/dd2/c12e 0 2024-09-13T21:40:52.996 INFO:tasks.workunit.client.1.smithi116.stdout:5/963: getdents d7/d40 0 2024-09-13T21:40:52.996 INFO:tasks.workunit.client.1.smithi116.stdout:5/964: truncate d7/d40/d90/fe8 382810 0 2024-09-13T21:40:52.996 INFO:tasks.workunit.client.1.smithi116.stdout:5/965: chown d7/d1d/d46/dd4/d5e/d79/lc9 2 1 2024-09-13T21:40:53.001 INFO:tasks.workunit.client.1.smithi116.stdout:2/888: dread d0/d5/d2a/f57 [0,4194304] 0 2024-09-13T21:40:53.002 INFO:tasks.workunit.client.1.smithi116.stdout:2/889: mkdir d0/d3a/d82/d10f/d12f 0 2024-09-13T21:40:53.010 INFO:tasks.workunit.client.1.smithi116.stdout:5/966: dread d7/d1d/d46/d5c/f63 [0,4194304] 0 2024-09-13T21:40:53.011 INFO:tasks.workunit.client.1.smithi116.stdout:5/967: rmdir d7/d1d/d46/dd4/d5e/d65/d6f/dd5 39 2024-09-13T21:40:53.012 INFO:tasks.workunit.client.1.smithi116.stdout:1/767: dwrite d4/d14/d52/d2f/d91/dac/ff5 [0,4194304] 0 2024-09-13T21:40:53.012 INFO:tasks.workunit.client.1.smithi116.stdout:1/768: write d4/d23/fbc [2046613,86027] 0 2024-09-13T21:40:53.012 INFO:tasks.workunit.client.1.smithi116.stdout:1/769: read - d4/d23/d56/da3/dc4/f104 zero size 2024-09-13T21:40:53.013 INFO:tasks.workunit.client.1.smithi116.stdout:5/968: link d7/d1d/d64/d94/lad d7/d1d/d46/dc0/l13e 0 2024-09-13T21:40:53.013 INFO:tasks.workunit.client.1.smithi116.stdout:5/969: fsync d7/d1d/d64/d110/f111 0 2024-09-13T21:40:53.013 INFO:tasks.workunit.client.1.smithi116.stdout:5/970: creat d7/d1d/d46/dd4/d5e/d65/d6a/f13f x:0 0 0 2024-09-13T21:40:53.015 INFO:tasks.workunit.client.1.smithi116.stdout:5/971: symlink d7/d1d/d64/d11e/l140 0 2024-09-13T21:40:53.021 INFO:tasks.workunit.client.1.smithi116.stdout:4/808: dwrite d0/dd/d48/f5c [0,4194304] 0 2024-09-13T21:40:53.021 INFO:tasks.workunit.client.1.smithi116.stdout:4/809: chown d0/d32/d5d 6705744 1 2024-09-13T21:40:53.022 INFO:tasks.workunit.client.1.smithi116.stdout:4/810: creat d0/d56/d57/f105 x:0 0 0 2024-09-13T21:40:53.022 INFO:tasks.workunit.client.1.smithi116.stdout:8/861: dwrite d2/d10/d19/d3a/f5f [0,4194304] 0 2024-09-13T21:40:53.022 INFO:tasks.workunit.client.1.smithi116.stdout:9/627: dwrite d2/d8/faf [0,4194304] 0 2024-09-13T21:40:53.022 INFO:tasks.workunit.client.1.smithi116.stdout:9/628: dread - d2/d10/d14/d38/d3a/f7c zero size 2024-09-13T21:40:53.024 INFO:tasks.workunit.client.1.smithi116.stdout:4/811: write d0/f10 [1105746,57595] 0 2024-09-13T21:40:53.025 INFO:tasks.workunit.client.1.smithi116.stdout:8/862: rmdir d2/d10/d19/d21/d69/d90/da9/dbc 39 2024-09-13T21:40:53.029 INFO:tasks.workunit.client.1.smithi116.stdout:4/812: mkdir d0/dd/d6b/d92/d99/dbc/d106 0 2024-09-13T21:40:53.030 INFO:tasks.workunit.client.1.smithi116.stdout:4/813: mkdir d0/dad/de0/d107 0 2024-09-13T21:40:53.030 INFO:tasks.workunit.client.1.smithi116.stdout:4/814: fdatasync d0/dd/d48/f5c 0 2024-09-13T21:40:53.030 INFO:tasks.workunit.client.1.smithi116.stdout:2/890: dwrite d0/d5/de3/f115 [0,4194304] 0 2024-09-13T21:40:53.036 INFO:tasks.workunit.client.1.smithi116.stdout:4/815: creat d0/d56/d84/db1/f108 x:0 0 0 2024-09-13T21:40:53.036 INFO:tasks.workunit.client.1.smithi116.stdout:2/891: unlink d0/d3a/d82/d62/d75/d77/f99 0 2024-09-13T21:40:53.037 INFO:tasks.workunit.client.1.smithi116.stdout:2/892: dread - d0/d3a/fc8 zero size 2024-09-13T21:40:53.038 INFO:tasks.workunit.client.1.smithi116.stdout:9/629: write d2/d5d/d69/f92 [1392883,125648] 0 2024-09-13T21:40:53.038 INFO:tasks.workunit.client.1.smithi116.stdout:2/893: getdents d0/d5/d8/dd2 0 2024-09-13T21:40:53.038 INFO:tasks.workunit.client.1.smithi116.stdout:2/894: creat d0/d5/d8/d7a/f130 x:0 0 0 2024-09-13T21:40:53.038 INFO:tasks.workunit.client.1.smithi116.stdout:9/630: creat d2/d72/fb8 x:0 0 0 2024-09-13T21:40:53.039 INFO:tasks.workunit.client.1.smithi116.stdout:9/631: creat d2/d10/d4c/d98/fb9 x:0 0 0 2024-09-13T21:40:53.040 INFO:tasks.workunit.client.1.smithi116.stdout:9/632: rename d2/f6d to d2/d10/d14/fba 0 2024-09-13T21:40:53.046 INFO:tasks.workunit.client.1.smithi116.stdout:9/633: dread d2/d10/d14/d38/f4f [0,4194304] 0 2024-09-13T21:40:53.046 INFO:tasks.workunit.client.1.smithi116.stdout:2/895: dread d0/d5/d2a/f3b [0,4194304] 0 2024-09-13T21:40:53.047 INFO:tasks.workunit.client.1.smithi116.stdout:2/896: creat d0/d5/d8/f131 x:0 0 0 2024-09-13T21:40:53.048 INFO:tasks.workunit.client.1.smithi116.stdout:2/897: creat d0/d7/d2b/db6/d10d/f132 x:0 0 0 2024-09-13T21:40:53.050 INFO:tasks.workunit.client.1.smithi116.stdout:2/898: creat d0/d3a/d82/d62/d1f/d5d/d89/d10b/f133 x:0 0 0 2024-09-13T21:40:53.050 INFO:tasks.workunit.client.1.smithi116.stdout:2/899: fdatasync d0/d3a/d82/fe8 0 2024-09-13T21:40:53.076 INFO:tasks.workunit.client.1.smithi116.stdout:1/770: dwrite d4/d14/d52/d2f/d5d/d90/f93 [0,4194304] 0 2024-09-13T21:40:53.076 INFO:tasks.workunit.client.1.smithi116.stdout:4/816: dwrite d0/dd/f70 [4194304,4194304] 0 2024-09-13T21:40:53.076 INFO:tasks.workunit.client.1.smithi116.stdout:5/972: dwrite d7/d1d/d46/d85/d96/da8/db9/ff2 [0,4194304] 0 2024-09-13T21:40:53.076 INFO:tasks.workunit.client.1.smithi116.stdout:5/973: write d7/d1d/d46/dd4/f100 [845844,40177] 0 2024-09-13T21:40:53.076 INFO:tasks.workunit.client.1.smithi116.stdout:2/900: dwrite d0/f79 [0,4194304] 0 2024-09-13T21:40:53.082 INFO:tasks.workunit.client.1.smithi116.stdout:1/771: mkdir d4/d14/d52/d2f/d5c/daf/db9/d116 0 2024-09-13T21:40:53.085 INFO:tasks.workunit.client.1.smithi116.stdout:5/974: symlink d7/d1d/d46/dd4/d5e/d65/df9/l141 0 2024-09-13T21:40:53.085 INFO:tasks.workunit.client.1.smithi116.stdout:5/975: readlink d7/d1d/d64/d87/l8d 0 2024-09-13T21:40:53.085 INFO:tasks.workunit.client.1.smithi116.stdout:2/901: getdents d0/d3a/d82/d10f 0 2024-09-13T21:40:53.087 INFO:tasks.workunit.client.1.smithi116.stdout:1/772: creat d4/d14/d52/d2f/d91/f117 x:0 0 0 2024-09-13T21:40:53.087 INFO:tasks.workunit.client.1.smithi116.stdout:1/773: stat d4/d23/d57/la2 0 2024-09-13T21:40:53.088 INFO:tasks.workunit.client.1.smithi116.stdout:5/976: creat d7/d40/d53/dc8/f142 x:0 0 0 2024-09-13T21:40:53.088 INFO:tasks.workunit.client.1.smithi116.stdout:5/977: chown d7/d1d/d46/dd4/d5e/d65/df9/l117 393236238 1 2024-09-13T21:40:53.089 INFO:tasks.workunit.client.1.smithi116.stdout:2/902: mkdir d0/d7/d86/dd1/df0/d134 0 2024-09-13T21:40:53.090 INFO:tasks.workunit.client.1.smithi116.stdout:1/774: creat d4/d14/d2a/f118 x:0 0 0 2024-09-13T21:40:53.091 INFO:tasks.workunit.client.1.smithi116.stdout:5/978: creat d7/d1d/d64/f143 x:0 0 0 2024-09-13T21:40:53.092 INFO:tasks.workunit.client.1.smithi116.stdout:5/979: write d7/d1d/d46/dc0/df3/f129 [774045,2137] 0 2024-09-13T21:40:53.092 INFO:tasks.workunit.client.1.smithi116.stdout:2/903: creat d0/d3a/d82/d62/d1f/d5d/f135 x:0 0 0 2024-09-13T21:40:53.092 INFO:tasks.workunit.client.1.smithi116.stdout:2/904: readlink d0/d7/d49/lfa 0 2024-09-13T21:40:53.094 INFO:tasks.workunit.client.1.smithi116.stdout:1/775: unlink d4/d14/d52/d2f/ff9 0 2024-09-13T21:40:53.094 INFO:tasks.workunit.client.1.smithi116.stdout:1/776: chown d4/d23/d57/fd7 30880 1 2024-09-13T21:40:53.094 INFO:tasks.workunit.client.1.smithi116.stdout:1/777: fsync d4/d14/d52/d2f/d5c/f8c 0 2024-09-13T21:40:53.094 INFO:tasks.workunit.client.1.smithi116.stdout:1/778: fsync d4/d14/fa0 0 2024-09-13T21:40:53.095 INFO:tasks.workunit.client.1.smithi116.stdout:2/905: rmdir d0/d7/d86/df4 39 2024-09-13T21:40:53.097 INFO:tasks.workunit.client.1.smithi116.stdout:5/980: rename d7/c4c to d7/d1d/d64/d94/daa/c144 0 2024-09-13T21:40:53.097 INFO:tasks.workunit.client.1.smithi116.stdout:5/981: stat d7/d1d 0 2024-09-13T21:40:53.099 INFO:tasks.workunit.client.1.smithi116.stdout:5/982: read d7/d40/d80/fbd [137417,92590] 0 2024-09-13T21:40:53.111 INFO:tasks.workunit.client.1.smithi116.stdout:2/906: dwrite d0/d7/f12 [0,4194304] 0 2024-09-13T21:40:53.112 INFO:tasks.workunit.client.1.smithi116.stdout:5/983: dread d7/d1d/d46/dd4/f27 [0,4194304] 0 2024-09-13T21:40:53.112 INFO:tasks.workunit.client.1.smithi116.stdout:2/907: getdents d0 0 2024-09-13T21:40:53.113 INFO:tasks.workunit.client.1.smithi116.stdout:5/984: write d7/d40/fcf [2261288,73310] 0 2024-09-13T21:40:53.113 INFO:tasks.workunit.client.1.smithi116.stdout:5/985: truncate d7/f2f 557588 0 2024-09-13T21:40:53.119 INFO:tasks.workunit.client.1.smithi116.stdout:5/986: dread d7/d40/d53/f61 [0,4194304] 0 2024-09-13T21:40:53.119 INFO:tasks.workunit.client.1.smithi116.stdout:5/987: fsync d7/d1d/d46/dd4/f100 0 2024-09-13T21:40:53.120 INFO:tasks.workunit.client.1.smithi116.stdout:5/988: rmdir d7/d1d/d46/dd4/d5e/d65/d6f/dd5 39 2024-09-13T21:40:53.122 INFO:tasks.workunit.client.1.smithi116.stdout:5/989: getdents d7/d1d/d46/dc0/df3 0 2024-09-13T21:40:53.123 INFO:tasks.workunit.client.1.smithi116.stdout:5/990: rmdir d7/d1d/d46/d85/d96/da8 39 2024-09-13T21:40:53.123 INFO:tasks.workunit.client.1.smithi116.stdout:5/991: fdatasync d7/d1d/d46/d5c/dcc/f132 0 2024-09-13T21:40:53.147 INFO:tasks.workunit.client.1.smithi116.stdout:2/908: dwrite d0/f79 [4194304,4194304] 0 2024-09-13T21:40:53.147 INFO:tasks.workunit.client.1.smithi116.stdout:5/992: dwrite d7/d1d/d46/dd4/d5e/d65/d6a/fb1 [0,4194304] 0 2024-09-13T21:40:53.147 INFO:tasks.workunit.client.1.smithi116.stdout:2/909: symlink d0/d3a/d82/d62/d75/d77/l136 0 2024-09-13T21:40:53.149 INFO:tasks.workunit.client.1.smithi116.stdout:5/993: creat d7/d1d/d46/d85/f145 x:0 0 0 2024-09-13T21:40:53.149 INFO:tasks.workunit.client.1.smithi116.stdout:2/910: mkdir d0/d7/d2b/db6/d10d/d137 0 2024-09-13T21:40:53.162 INFO:tasks.workunit.client.1.smithi116.stdout:5/994: write d7/d1d/d46/d5c/f78 [2327357,50985] 0 2024-09-13T21:40:53.164 INFO:tasks.workunit.client.1.smithi116.stdout:5/995: mknod d7/d1d/d46/d85/c146 0 2024-09-13T21:40:53.165 INFO:tasks.workunit.client.1.smithi116.stdout:5/996: mknod d7/d1d/dbb/c147 0 2024-09-13T21:40:53.165 INFO:tasks.workunit.client.1.smithi116.stdout:2/911: dwrite d0/f54 [0,4194304] 0 2024-09-13T21:40:53.166 INFO:tasks.workunit.client.1.smithi116.stdout:5/997: mkdir d7/d40/d80/d148 0 2024-09-13T21:40:53.166 INFO:tasks.workunit.client.1.smithi116.stdout:5/998: read - d7/d1d/d64/d87/f115 zero size 2024-09-13T21:40:53.166 INFO:tasks.workunit.client.1.smithi116.stdout:5/999: mknod d7/d1d/d46/dd4/d5e/d79/c149 0 2024-09-13T21:40:53.173 INFO:tasks.workunit.client.1.smithi116.stdout:2/912: read d0/d5/de3/f104 [3367661,123940] 0 2024-09-13T21:40:53.174 INFO:tasks.workunit.client.1.smithi116.stdout:2/913: readlink d0/d7/d86/la8 0 2024-09-13T21:40:53.174 INFO:tasks.workunit.client.1.smithi116.stdout:2/914: dread - d0/d3a/d82/d62/d75/d77/f12b zero size 2024-09-13T21:40:53.174 INFO:tasks.workunit.client.1.smithi116.stdout:2/915: mkdir d0/d3a/d82/ddb/d138 0 2024-09-13T21:40:53.183 INFO:tasks.workunit.client.1.smithi116.stdout:2/916: dread d0/d5/d8/d7a/fbc [0,4194304] 0 2024-09-13T21:40:53.197 INFO:tasks.workunit.client.1.smithi116.stdout:2/917: dwrite d0/d5/d8/f16 [0,4194304] 0 2024-09-13T21:40:53.209 INFO:tasks.workunit.client.1.smithi116.stdout:2/918: dread d0/d3a/d82/f71 [0,4194304] 0 2024-09-13T21:40:53.209 INFO:tasks.workunit.client.1.smithi116.stdout:2/919: write d0/de9/f11b [803810,89262] 0 2024-09-13T21:40:53.210 INFO:tasks.workunit.client.1.smithi116.stdout:2/920: stat d0/d7/d86/c9e 0 2024-09-13T21:40:53.210 INFO:tasks.workunit.client.1.smithi116.stdout:2/921: fdatasync d0/d5/d2a/f6d 0 2024-09-13T21:40:53.210 INFO:tasks.workunit.client.1.smithi116.stdout:2/922: symlink d0/d3a/d82/ddb/l139 0 2024-09-13T21:40:53.210 INFO:tasks.workunit.client.1.smithi116.stdout:2/923: chown d0/d3a/d82/d62/d75/d77/f127 46 1 2024-09-13T21:40:53.214 INFO:tasks.workunit.client.1.smithi116.stdout:2/924: rename d0/d7 to d0/de9/d13a 0 2024-09-13T21:40:53.215 INFO:tasks.workunit.client.1.smithi116.stdout:2/925: chown d0/d3a/d82/d62/d75 1754 1 2024-09-13T21:40:53.221 INFO:tasks.workunit.client.1.smithi116.stdout:2/926: dread d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/fab [0,4194304] 0 2024-09-13T21:40:53.222 INFO:tasks.workunit.client.1.smithi116.stdout:2/927: mknod d0/d5/d2a/c13b 0 2024-09-13T21:40:53.229 INFO:tasks.workunit.client.1.smithi116.stdout:2/928: dread d0/d5/f4b [0,4194304] 0 2024-09-13T21:40:53.229 INFO:tasks.workunit.client.1.smithi116.stdout:2/929: chown d0/d3a/l4e 0 1 2024-09-13T21:40:53.230 INFO:tasks.workunit.client.1.smithi116.stdout:2/930: rename d0/de9/d13a/d49/cfe to d0/de9/d13a/d2d/c13c 0 2024-09-13T21:40:53.230 INFO:tasks.workunit.client.1.smithi116.stdout:2/931: read - d0/d3a/d82/d62/d1f/d5d/d89/ddc/ff6 zero size 2024-09-13T21:40:53.245 INFO:tasks.workunit.client.1.smithi116.stdout:2/932: dwrite d0/d3a/d82/d62/d1f/fa3 [0,4194304] 0 2024-09-13T21:40:53.245 INFO:tasks.workunit.client.1.smithi116.stdout:2/933: write d0/d3a/d82/d62/d1f/d5d/d72/daa/f121 [524687,66842] 0 2024-09-13T21:40:53.245 INFO:tasks.workunit.client.1.smithi116.stdout:2/934: fsync d0/de9/d13a/f1e 0 2024-09-13T21:40:53.247 INFO:tasks.workunit.client.1.smithi116.stdout:2/935: mkdir d0/d3a/d82/ddb/d13d 0 2024-09-13T21:40:53.248 INFO:tasks.workunit.client.1.smithi116.stdout:2/936: creat d0/de9/d13a/d2b/db6/d10d/f13e x:0 0 0 2024-09-13T21:40:53.249 INFO:tasks.workunit.client.1.smithi116.stdout:2/937: link d0/d3a/d82/d62/d75/f108 d0/de9/d13a/d86/df4/f13f 0 2024-09-13T21:40:53.249 INFO:tasks.workunit.client.1.smithi116.stdout:2/938: fdatasync d0/d3a/d82/d62/d1f/d5d/d60/f8a 0 2024-09-13T21:40:53.250 INFO:tasks.workunit.client.1.smithi116.stdout:2/939: rmdir d0/d5 39 2024-09-13T21:40:53.258 INFO:tasks.workunit.client.1.smithi116.stdout:2/940: dread d0/d3a/d82/d62/d1f/d5d/d60/f95 [0,4194304] 0 2024-09-13T21:40:53.260 INFO:tasks.workunit.client.1.smithi116.stdout:2/941: mkdir d0/d3a/d82/d62/d1f/d5d/d140 0 2024-09-13T21:40:53.260 INFO:tasks.workunit.client.1.smithi116.stdout:2/942: creat d0/d3a/d82/d62/d1f/d5d/d60/f141 x:0 0 0 2024-09-13T21:40:53.260 INFO:tasks.workunit.client.1.smithi116.stdout:2/943: write d0/de9/d13a/d2b/d61/fba [783415,130847] 0 2024-09-13T21:40:53.261 INFO:tasks.workunit.client.1.smithi116.stdout:2/944: mknod d0/de9/d13a/d2d/d105/d12d/c142 0 2024-09-13T21:40:53.261 INFO:tasks.workunit.client.1.smithi116.stdout:2/945: read - d0/de9/d13a/d2b/db6/d10d/f132 zero size 2024-09-13T21:40:53.279 INFO:tasks.workunit.client.1.smithi116.stdout:2/946: dwrite d0/de9/d13a/d2b/db6/d10d/f13e [0,4194304] 0 2024-09-13T21:40:53.281 INFO:tasks.workunit.client.1.smithi116.stdout:2/947: getdents d0/d5/d8/d7a 0 2024-09-13T21:40:53.285 INFO:tasks.workunit.client.1.smithi116.stdout:2/948: dread d0/de9/d13a/d2d/f6a [0,4194304] 0 2024-09-13T21:40:53.285 INFO:tasks.workunit.client.1.smithi116.stdout:2/949: readlink d0/d3a/d82/d62/d1f/d5d/d72/daa/l7e 0 2024-09-13T21:40:53.285 INFO:tasks.workunit.client.1.smithi116.stdout:2/950: creat d0/d3a/d82/d62/d75/d77/f143 x:0 0 0 2024-09-13T21:40:53.286 INFO:tasks.workunit.client.1.smithi116.stdout:2/951: mkdir d0/de9/d13a/d49/d93/d144 0 2024-09-13T21:40:53.287 INFO:tasks.workunit.client.1.smithi116.stdout:2/952: rmdir d0/d3a/d82/d68 39 2024-09-13T21:40:53.287 INFO:tasks.workunit.client.1.smithi116.stdout:2/953: fsync d0/fae 0 2024-09-13T21:40:53.288 INFO:tasks.workunit.client.1.smithi116.stdout:2/954: fdatasync d0/de9/d13a/f24 0 2024-09-13T21:40:53.288 INFO:tasks.workunit.client.1.smithi116.stdout:2/955: chown d0/d3a/d82/d62/d1f/fa3 186 1 2024-09-13T21:40:53.288 INFO:tasks.workunit.client.1.smithi116.stdout:2/956: rmdir d0/d3a/d82/d62/d1f/d5d/d72/daa/da9 39 2024-09-13T21:40:53.288 INFO:tasks.workunit.client.1.smithi116.stdout:2/957: mkdir d0/de9/d13a/d86/df4/d145 0 2024-09-13T21:40:53.290 INFO:tasks.workunit.client.1.smithi116.stdout:2/958: rename d0/d5/d2a/f3b to d0/d3a/d82/d62/d1f/f146 0 2024-09-13T21:40:53.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:53 smithi088 ceph-mon[27963]: pgmap v266: 65 pgs: 65 active+clean; 1.8 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 169 MiB/s rd, 185 MiB/s wr, 386 op/s 2024-09-13T21:40:53.513 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:53 smithi116 ceph-mon[33391]: pgmap v266: 65 pgs: 65 active+clean; 1.8 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 169 MiB/s rd, 185 MiB/s wr, 386 op/s 2024-09-13T21:40:53.974 INFO:tasks.workunit.client.1.smithi116.stdout:6/960: sync 2024-09-13T21:40:53.974 INFO:tasks.workunit.client.1.smithi116.stdout:6/961: dread - d8/d15/d2e/d2f/d38/fde zero size 2024-09-13T21:40:53.976 INFO:tasks.workunit.client.1.smithi116.stdout:6/962: getdents d8/d17/d70/da0/daf 0 2024-09-13T21:40:53.976 INFO:tasks.workunit.client.1.smithi116.stdout:6/963: fdatasync d8/d17/fb6 0 2024-09-13T21:40:53.977 INFO:tasks.workunit.client.1.smithi116.stdout:6/964: truncate d8/d15/f92 4471762 0 2024-09-13T21:40:53.988 INFO:tasks.workunit.client.1.smithi116.stdout:6/965: dread d8/d17/d70/f13b [0,4194304] 0 2024-09-13T21:40:53.991 INFO:tasks.workunit.client.1.smithi116.stdout:6/966: creat d8/d10c/f146 x:0 0 0 2024-09-13T21:40:53.992 INFO:tasks.workunit.client.1.smithi116.stdout:6/967: getdents d8/d10/d24/d110/de2/d12a 0 2024-09-13T21:40:53.995 INFO:tasks.workunit.client.1.smithi116.stdout:6/968: mknod d8/d15/d2e/d2f/d38/d9c/dcd/c147 0 2024-09-13T21:40:53.995 INFO:tasks.workunit.client.1.smithi116.stdout:6/969: dread - d8/d1e/dbb/f123 zero size 2024-09-13T21:40:53.995 INFO:tasks.workunit.client.1.smithi116.stdout:6/970: write d8/d17/f19 [785931,101338] 0 2024-09-13T21:40:53.996 INFO:tasks.workunit.client.1.smithi116.stdout:6/971: dread d8/d15/d2e/fa5 [0,4194304] 0 2024-09-13T21:40:54.009 INFO:tasks.workunit.client.1.smithi116.stdout:6/972: write d8/d15/d2e/d2f/d38/f45 [3183680,58107] 0 2024-09-13T21:40:54.011 INFO:tasks.workunit.client.1.smithi116.stdout:6/973: symlink d8/d15/d2e/d2f/d38/d9c/dcd/d141/l148 0 2024-09-13T21:40:54.012 INFO:tasks.workunit.client.1.smithi116.stdout:6/974: chown d8/d15/d2e/d2f/d38/d9c/dcd/de5/f139 319228732 1 2024-09-13T21:40:54.028 INFO:tasks.workunit.client.1.smithi116.stdout:8/863: sync 2024-09-13T21:40:54.028 INFO:tasks.workunit.client.1.smithi116.stdout:8/864: dread - d2/d10/d19/d21/fd8 zero size 2024-09-13T21:40:54.030 INFO:tasks.workunit.client.1.smithi116.stdout:8/865: creat d2/d27/d62/f104 x:0 0 0 2024-09-13T21:40:54.031 INFO:tasks.workunit.client.1.smithi116.stdout:8/866: rmdir d2/d10/d19/d97/dc9 39 2024-09-13T21:40:54.033 INFO:tasks.workunit.client.1.smithi116.stdout:8/867: symlink d2/d10/d19/d21/d69/d90/da9/dbc/l105 0 2024-09-13T21:40:54.034 INFO:tasks.workunit.client.1.smithi116.stdout:6/975: dwrite d8/d15/f22 [8388608,4194304] 0 2024-09-13T21:40:54.035 INFO:tasks.workunit.client.1.smithi116.stdout:8/868: unlink d2/d10/d19/d21/ff4 0 2024-09-13T21:40:54.037 INFO:tasks.workunit.client.1.smithi116.stdout:8/869: creat d2/d27/d66/d100/f106 x:0 0 0 2024-09-13T21:40:54.039 INFO:tasks.workunit.client.1.smithi116.stdout:8/870: creat d2/d10/d19/d42/d45/d87/dc1/f107 x:0 0 0 2024-09-13T21:40:54.039 INFO:tasks.workunit.client.1.smithi116.stdout:8/871: chown d2/f6d 798869790 1 2024-09-13T21:40:54.039 INFO:tasks.workunit.client.1.smithi116.stdout:8/872: chown d2/d10/d19/d21/d22/fcf 47497 1 2024-09-13T21:40:54.041 INFO:tasks.workunit.client.1.smithi116.stdout:8/873: creat d2/d27/d66/dcc/f108 x:0 0 0 2024-09-13T21:40:54.041 INFO:tasks.workunit.client.1.smithi116.stdout:8/874: chown d2/d10/d37/l2a 241727054 1 2024-09-13T21:40:54.041 INFO:tasks.workunit.client.1.smithi116.stdout:8/875: fdatasync d2/d10/d3e/ffa 0 2024-09-13T21:40:54.043 INFO:tasks.workunit.client.1.smithi116.stdout:8/876: unlink d2/d10/fe1 0 2024-09-13T21:40:54.070 INFO:tasks.workunit.client.1.smithi116.stdout:6/976: dwrite d8/f9a [0,4194304] 0 2024-09-13T21:40:54.070 INFO:tasks.workunit.client.1.smithi116.stdout:6/977: write d8/d10/d33/f8a [2874798,24693] 0 2024-09-13T21:40:54.070 INFO:tasks.workunit.client.1.smithi116.stdout:6/978: chown d8/d15/d2e/d9e/la1 2188668 1 2024-09-13T21:40:54.070 INFO:tasks.workunit.client.1.smithi116.stdout:6/979: fsync d8/d15/d2e/f69 0 2024-09-13T21:40:54.070 INFO:tasks.workunit.client.1.smithi116.stdout:8/877: dwrite d2/d10/f31 [4194304,4194304] 0 2024-09-13T21:40:54.072 INFO:tasks.workunit.client.1.smithi116.stdout:6/980: rename d8/l58 to d8/d15/d2e/d9e/l149 0 2024-09-13T21:40:54.072 INFO:tasks.workunit.client.1.smithi116.stdout:6/981: fdatasync d8/d1e/dbb/f123 0 2024-09-13T21:40:54.072 INFO:tasks.workunit.client.1.smithi116.stdout:6/982: dread - d8/d10c/f146 zero size 2024-09-13T21:40:54.072 INFO:tasks.workunit.client.1.smithi116.stdout:8/878: mknod d2/d10/d19/d21/d69/d90/da9/dbc/c109 0 2024-09-13T21:40:54.073 INFO:tasks.workunit.client.1.smithi116.stdout:6/983: symlink d8/d15/d2e/d2f/d38/d9c/dcd/l14a 0 2024-09-13T21:40:54.075 INFO:tasks.workunit.client.1.smithi116.stdout:6/984: creat d8/d17/d70/da0/daf/d113/f14b x:0 0 0 2024-09-13T21:40:54.077 INFO:tasks.workunit.client.1.smithi116.stdout:6/985: creat d8/d10c/d115/d129/f14c x:0 0 0 2024-09-13T21:40:54.077 INFO:tasks.workunit.client.1.smithi116.stdout:6/986: truncate d8/fa 557673 0 2024-09-13T21:40:54.077 INFO:tasks.workunit.client.1.smithi116.stdout:6/987: fsync d8/f91 0 2024-09-13T21:40:54.077 INFO:tasks.workunit.client.1.smithi116.stdout:6/988: chown d8/d1e/l7a 7451 1 2024-09-13T21:40:54.080 INFO:tasks.workunit.client.1.smithi116.stdout:9/634: sync 2024-09-13T21:40:54.080 INFO:tasks.workunit.client.1.smithi116.stdout:4/817: sync 2024-09-13T21:40:54.080 INFO:tasks.workunit.client.1.smithi116.stdout:1/779: sync 2024-09-13T21:40:54.080 INFO:tasks.workunit.client.1.smithi116.stdout:9/635: dread - d2/d10/fb3 zero size 2024-09-13T21:40:54.080 INFO:tasks.workunit.client.1.smithi116.stdout:2/959: sync 2024-09-13T21:40:54.080 INFO:tasks.workunit.client.1.smithi116.stdout:2/960: stat d0/d5/de3 0 2024-09-13T21:40:54.081 INFO:tasks.workunit.client.1.smithi116.stdout:9/636: truncate d2/f2b 3315111 0 2024-09-13T21:40:54.083 INFO:tasks.workunit.client.1.smithi116.stdout:1/780: creat d4/d74/d8d/d5f/f119 x:0 0 0 2024-09-13T21:40:54.085 INFO:tasks.workunit.client.1.smithi116.stdout:9/637: link d2/d10/f2a d2/d72/fbb 0 2024-09-13T21:40:54.085 INFO:tasks.workunit.client.1.smithi116.stdout:9/638: dread - d2/d5d/f62 zero size 2024-09-13T21:40:54.085 INFO:tasks.workunit.client.1.smithi116.stdout:9/639: chown d2/d5d/d8f/lb5 796951 1 2024-09-13T21:40:54.086 INFO:tasks.workunit.client.1.smithi116.stdout:1/781: truncate d4/d74/f80 41215 0 2024-09-13T21:40:54.099 INFO:tasks.workunit.client.1.smithi116.stdout:9/640: dread d2/d10/d4c/f7a [0,4194304] 0 2024-09-13T21:40:54.099 INFO:tasks.workunit.client.1.smithi116.stdout:9/641: fdatasync d2/f3 0 2024-09-13T21:40:54.099 INFO:tasks.workunit.client.1.smithi116.stdout:9/642: chown d2/d10/d14/f21 2 1 2024-09-13T21:40:54.102 INFO:tasks.workunit.client.1.smithi116.stdout:9/643: dread d2/d10/d4c/f7a [0,4194304] 0 2024-09-13T21:40:54.103 INFO:tasks.workunit.client.1.smithi116.stdout:9/644: dread d2/d5d/d69/d47/f7b [0,4194304] 0 2024-09-13T21:40:54.104 INFO:tasks.workunit.client.1.smithi116.stdout:2/961: dread d0/d3a/d82/d62/d1f/d5d/fa6 [0,4194304] 0 2024-09-13T21:40:54.104 INFO:tasks.workunit.client.1.smithi116.stdout:2/962: write d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/fec [953954,98023] 0 2024-09-13T21:40:54.105 INFO:tasks.workunit.client.1.smithi116.stdout:9/645: rename d2/la7 to d2/d5d/d69/d47/lbc 0 2024-09-13T21:40:54.105 INFO:tasks.workunit.client.1.smithi116.stdout:9/646: chown d2/f2d 2714 1 2024-09-13T21:40:54.106 INFO:tasks.workunit.client.1.smithi116.stdout:2/963: link d0/d5/l38 d0/de9/d13a/d2b/db6/l147 0 2024-09-13T21:40:54.106 INFO:tasks.workunit.client.1.smithi116.stdout:9/647: mkdir d2/d10/d6e/dbd 0 2024-09-13T21:40:54.106 INFO:tasks.workunit.client.1.smithi116.stdout:9/648: truncate d2/d10/d4c/f9a 797903 0 2024-09-13T21:40:54.107 INFO:tasks.workunit.client.1.smithi116.stdout:2/964: rmdir d0/de9/d13a/d2b/d61 39 2024-09-13T21:40:54.108 INFO:tasks.workunit.client.1.smithi116.stdout:9/649: creat d2/d8/d93/da0/fbe x:0 0 0 2024-09-13T21:40:54.110 INFO:tasks.workunit.client.1.smithi116.stdout:9/650: dread d2/d8/f33 [0,4194304] 0 2024-09-13T21:40:54.111 INFO:tasks.workunit.client.1.smithi116.stdout:9/651: unlink d2/d10/d14/f45 0 2024-09-13T21:40:54.113 INFO:tasks.workunit.client.1.smithi116.stdout:9/652: symlink d2/d8/d93/lbf 0 2024-09-13T21:40:54.113 INFO:tasks.workunit.client.1.smithi116.stdout:9/653: stat d2/d8/c6a 0 2024-09-13T21:40:54.113 INFO:tasks.workunit.client.1.smithi116.stdout:8/879: dwrite d2/d10/d19/d21/d69/f8b [0,4194304] 0 2024-09-13T21:40:54.114 INFO:tasks.workunit.client.1.smithi116.stdout:9/654: rmdir d2/d5d 39 2024-09-13T21:40:54.114 INFO:tasks.workunit.client.1.smithi116.stdout:9/655: write d2/d10/f2a [2815233,99786] 0 2024-09-13T21:40:54.114 INFO:tasks.workunit.client.1.smithi116.stdout:9/656: write d2/d5d/f62 [191219,113936] 0 2024-09-13T21:40:54.114 INFO:tasks.workunit.client.1.smithi116.stdout:9/657: write d2/d5d/d69/d7d/f9f [732077,125381] 0 2024-09-13T21:40:54.114 INFO:tasks.workunit.client.1.smithi116.stdout:9/658: fsync d2/d10/f52 0 2024-09-13T21:40:54.114 INFO:tasks.workunit.client.1.smithi116.stdout:9/659: read - d2/d10/faa zero size 2024-09-13T21:40:54.116 INFO:tasks.workunit.client.1.smithi116.stdout:8/880: mknod d2/d10/d19/d97/dc9/c10a 0 2024-09-13T21:40:54.116 INFO:tasks.workunit.client.1.smithi116.stdout:9/660: dread d2/d10/f12 [4194304,4194304] 0 2024-09-13T21:40:54.117 INFO:tasks.workunit.client.1.smithi116.stdout:8/881: mkdir d2/d10/d37/d10b 0 2024-09-13T21:40:54.118 INFO:tasks.workunit.client.1.smithi116.stdout:8/882: read d2/d10/f11 [4314756,90827] 0 2024-09-13T21:40:54.118 INFO:tasks.workunit.client.1.smithi116.stdout:8/883: chown d2/d10/d19/d21/d22/d5d/d46/f7d 428 1 2024-09-13T21:40:54.118 INFO:tasks.workunit.client.1.smithi116.stdout:8/884: write d2/d5c/f85 [800255,86006] 0 2024-09-13T21:40:54.119 INFO:tasks.workunit.client.1.smithi116.stdout:4/818: dwrite d0/dd/d13/f4d [0,4194304] 0 2024-09-13T21:40:54.119 INFO:tasks.workunit.client.1.smithi116.stdout:4/819: chown d0/dd/d6b/d92/d95/ddd 147 1 2024-09-13T21:40:54.119 INFO:tasks.workunit.client.1.smithi116.stdout:4/820: chown d0/dd/d6b/d71/f102 329752997 1 2024-09-13T21:40:54.119 INFO:tasks.workunit.client.1.smithi116.stdout:4/821: chown d0/d56/d84/db1 8113816 1 2024-09-13T21:40:54.119 INFO:tasks.workunit.client.1.smithi116.stdout:4/822: readlink d0/dd/d13/lba 0 2024-09-13T21:40:54.119 INFO:tasks.workunit.client.1.smithi116.stdout:9/661: symlink d2/d8/d3e/dae/lc0 0 2024-09-13T21:40:54.120 INFO:tasks.workunit.client.1.smithi116.stdout:9/662: dread - d2/d10/fb6 zero size 2024-09-13T21:40:54.120 INFO:tasks.workunit.client.1.smithi116.stdout:1/782: dwrite d4/d74/d8d/d5f/f78 [0,4194304] 0 2024-09-13T21:40:54.120 INFO:tasks.workunit.client.1.smithi116.stdout:6/989: dwrite d8/d17/d70/da0/daf/fc1 [0,4194304] 0 2024-09-13T21:40:54.120 INFO:tasks.workunit.client.1.smithi116.stdout:6/990: creat d8/d15/d2e/d2f/d38/d9c/dcd/de5/f14d x:0 0 0 2024-09-13T21:40:54.122 INFO:tasks.workunit.client.1.smithi116.stdout:4/823: mknod d0/dd/d6b/dee/c109 0 2024-09-13T21:40:54.124 INFO:tasks.workunit.client.1.smithi116.stdout:9/663: creat d2/d10/d6e/fc1 x:0 0 0 2024-09-13T21:40:54.124 INFO:tasks.workunit.client.1.smithi116.stdout:9/664: chown d2/f2b 19724 1 2024-09-13T21:40:54.127 INFO:tasks.workunit.client.1.smithi116.stdout:1/783: link d4/d14/d52/d2f/d5c/daf/fc2 d4/d14/d52/d2f/d5d/f11a 0 2024-09-13T21:40:54.127 INFO:tasks.workunit.client.1.smithi116.stdout:1/784: creat d4/d74/d8d/d5f/f11b x:0 0 0 2024-09-13T21:40:54.127 INFO:tasks.workunit.client.1.smithi116.stdout:1/785: write d4/d14/d2a/f88 [1956148,110466] 0 2024-09-13T21:40:54.129 INFO:tasks.workunit.client.1.smithi116.stdout:2/965: dwrite d0/d3a/d82/ddb/f12c [0,4194304] 0 2024-09-13T21:40:54.129 INFO:tasks.workunit.client.1.smithi116.stdout:2/966: write d0/de9/f11b [1938897,63702] 0 2024-09-13T21:40:54.130 INFO:tasks.workunit.client.1.smithi116.stdout:2/967: read - d0/de9/f114 zero size 2024-09-13T21:40:54.130 INFO:tasks.workunit.client.1.smithi116.stdout:2/968: write d0/d3a/d82/d62/d1f/d5d/fa6 [4346513,117493] 0 2024-09-13T21:40:54.130 INFO:tasks.workunit.client.1.smithi116.stdout:2/969: write d0/d3a/d82/d62/f7b [2257437,126188] 0 2024-09-13T21:40:54.130 INFO:tasks.workunit.client.1.smithi116.stdout:6/991: symlink d8/d17/d70/da0/daf/l14e 0 2024-09-13T21:40:54.135 INFO:tasks.workunit.client.1.smithi116.stdout:1/786: getdents d4/d14/d2a/df2 0 2024-09-13T21:40:54.136 INFO:tasks.workunit.client.1.smithi116.stdout:1/787: dread - d4/d23/fec zero size 2024-09-13T21:40:54.136 INFO:tasks.workunit.client.1.smithi116.stdout:1/788: dread d4/d14/d52/faa [0,4194304] 0 2024-09-13T21:40:54.140 INFO:tasks.workunit.client.1.smithi116.stdout:2/970: mkdir d0/de9/d13a/d49/d148 0 2024-09-13T21:40:54.140 INFO:tasks.workunit.client.1.smithi116.stdout:2/971: dread - d0/d3a/d82/d62/ddf/fe4 zero size 2024-09-13T21:40:54.142 INFO:tasks.workunit.client.1.smithi116.stdout:6/992: creat d8/d10/d24/dab/f14f x:0 0 0 2024-09-13T21:40:54.142 INFO:tasks.workunit.client.1.smithi116.stdout:1/789: dread d4/d14/f4f [4194304,4194304] 0 2024-09-13T21:40:54.144 INFO:tasks.workunit.client.1.smithi116.stdout:2/972: symlink d0/d3a/d82/d62/d1f/d5d/d89/l149 0 2024-09-13T21:40:54.144 INFO:tasks.workunit.client.1.smithi116.stdout:1/790: truncate d4/ff 2808619 0 2024-09-13T21:40:54.145 INFO:tasks.workunit.client.1.smithi116.stdout:1/791: dread d4/d14/d52/d2f/d91/ff8 [0,4194304] 0 2024-09-13T21:40:54.147 INFO:tasks.workunit.client.1.smithi116.stdout:2/973: creat d0/de9/d13a/d86/dd1/df0/d134/f14a x:0 0 0 2024-09-13T21:40:54.148 INFO:tasks.workunit.client.1.smithi116.stdout:1/792: creat d4/d74/f11c x:0 0 0 2024-09-13T21:40:54.154 INFO:tasks.workunit.client.1.smithi116.stdout:8/885: dwrite d2/d10/d19/d21/d22/d5d/d46/f7d [0,4194304] 0 2024-09-13T21:40:54.154 INFO:tasks.workunit.client.1.smithi116.stdout:8/886: chown d2/d10/d19/d42/f8e 3360502 1 2024-09-13T21:40:54.155 INFO:tasks.workunit.client.1.smithi116.stdout:9/665: dwrite d2/f53 [0,4194304] 0 2024-09-13T21:40:54.156 INFO:tasks.workunit.client.1.smithi116.stdout:6/993: write d8/d15/d2e/d2f/fc8 [2709087,66914] 0 2024-09-13T21:40:54.158 INFO:tasks.workunit.client.1.smithi116.stdout:8/887: creat d2/d10/d19/d42/f10c x:0 0 0 2024-09-13T21:40:54.158 INFO:tasks.workunit.client.1.smithi116.stdout:8/888: creat d2/d10/d19/dea/f10d x:0 0 0 2024-09-13T21:40:54.162 INFO:tasks.workunit.client.1.smithi116.stdout:1/793: dread d4/d74/fcb [0,4194304] 0 2024-09-13T21:40:54.162 INFO:tasks.workunit.client.1.smithi116.stdout:1/794: read - d4/d14/d52/fd6 zero size 2024-09-13T21:40:54.163 INFO:tasks.workunit.client.1.smithi116.stdout:9/666: dread d2/f13 [0,4194304] 0 2024-09-13T21:40:54.166 INFO:tasks.workunit.client.1.smithi116.stdout:4/824: dread d0/f30 [0,4194304] 0 2024-09-13T21:40:54.167 INFO:tasks.workunit.client.1.smithi116.stdout:6/994: link d8/d10/f44 d8/d15/d2e/d9e/f150 0 2024-09-13T21:40:54.170 INFO:tasks.workunit.client.1.smithi116.stdout:4/825: rmdir d0/dad/de0 39 2024-09-13T21:40:54.170 INFO:tasks.workunit.client.1.smithi116.stdout:4/826: dread - d0/dd/d6b/d92/d99/ffb zero size 2024-09-13T21:40:54.172 INFO:tasks.workunit.client.1.smithi116.stdout:2/974: dwrite d0/d3a/d82/d62/d75/d77/f8b [0,4194304] 0 2024-09-13T21:40:54.173 INFO:tasks.workunit.client.1.smithi116.stdout:2/975: read d0/de9/d13a/d49/f90 [119568,50104] 0 2024-09-13T21:40:54.173 INFO:tasks.workunit.client.1.smithi116.stdout:6/995: link d8/d11c/l131 d8/d1e/dbb/l151 0 2024-09-13T21:40:54.180 INFO:tasks.workunit.client.1.smithi116.stdout:2/976: getdents d0/d3a/d82/d62/d75 0 2024-09-13T21:40:54.180 INFO:tasks.workunit.client.1.smithi116.stdout:6/996: mknod d8/d10c/c152 0 2024-09-13T21:40:54.180 INFO:tasks.workunit.client.1.smithi116.stdout:6/997: truncate d8/d15/d2e/d2f/d38/f75 631067 0 2024-09-13T21:40:54.180 INFO:tasks.workunit.client.1.smithi116.stdout:2/977: write d0/d5/f10 [1125343,20909] 0 2024-09-13T21:40:54.180 INFO:tasks.workunit.client.1.smithi116.stdout:2/978: read - d0/d3a/d82/d62/d1f/d5d/f110 zero size 2024-09-13T21:40:54.181 INFO:tasks.workunit.client.1.smithi116.stdout:2/979: readlink d0/l2f 0 2024-09-13T21:40:54.182 INFO:tasks.workunit.client.1.smithi116.stdout:4/827: dread d0/d56/d57/f6e [0,4194304] 0 2024-09-13T21:40:54.183 INFO:tasks.workunit.client.1.smithi116.stdout:2/980: creat d0/de9/d13a/d86/dd1/df0/f14b x:0 0 0 2024-09-13T21:40:54.183 INFO:tasks.workunit.client.1.smithi116.stdout:2/981: fsync d0/d3a/d82/d62/d1f/d5d/d60/f8a 0 2024-09-13T21:40:54.192 INFO:tasks.workunit.client.1.smithi116.stdout:6/998: write d8/d17/fc4 [11286979,89796] 0 2024-09-13T21:40:54.193 INFO:tasks.workunit.client.1.smithi116.stdout:6/999: getdents d8/d17/d70/da0/daf 0 2024-09-13T21:40:54.194 INFO:tasks.workunit.client.1.smithi116.stdout:4/828: dread d0/dd/f2e [0,4194304] 0 2024-09-13T21:40:54.195 INFO:tasks.workunit.client.1.smithi116.stdout:4/829: truncate d0/d32/d5d/d85/fa8 307485 0 2024-09-13T21:40:54.196 INFO:tasks.workunit.client.1.smithi116.stdout:4/830: truncate d0/d56/d84/db1/fff 1792967 0 2024-09-13T21:40:54.196 INFO:tasks.workunit.client.1.smithi116.stdout:4/831: truncate d0/d32/d5d/d85/fa8 434767 0 2024-09-13T21:40:54.196 INFO:tasks.workunit.client.1.smithi116.stdout:2/982: read d0/d5/d8/f16 [655110,100770] 0 2024-09-13T21:40:54.197 INFO:tasks.workunit.client.1.smithi116.stdout:8/889: dwrite d2/d10/d19/d42/d45/fdf [0,4194304] 0 2024-09-13T21:40:54.198 INFO:tasks.workunit.client.1.smithi116.stdout:2/983: creat d0/d3a/d82/d62/d1f/d5d/d72/f14c x:0 0 0 2024-09-13T21:40:54.198 INFO:tasks.workunit.client.1.smithi116.stdout:2/984: fdatasync d0/de9/d13a/d86/dd1/fe2 0 2024-09-13T21:40:54.198 INFO:tasks.workunit.client.1.smithi116.stdout:2/985: fdatasync d0/d3a/d82/d62/d1f/d5d/d72/daa/f121 0 2024-09-13T21:40:54.198 INFO:tasks.workunit.client.1.smithi116.stdout:2/986: stat d0/d3a/d82/d62/d75/d77/l112 0 2024-09-13T21:40:54.198 INFO:tasks.workunit.client.1.smithi116.stdout:2/987: fdatasync d0/d3a/d82/d62/d1f/d5d/d72/f14c 0 2024-09-13T21:40:54.198 INFO:tasks.workunit.client.1.smithi116.stdout:1/795: dwrite d4/f6f [0,4194304] 0 2024-09-13T21:40:54.198 INFO:tasks.workunit.client.1.smithi116.stdout:9/667: dwrite d2/d8/d93/f94 [0,4194304] 0 2024-09-13T21:40:54.200 INFO:tasks.workunit.client.1.smithi116.stdout:8/890: unlink d2/d10/d19/d21/d69/cfd 0 2024-09-13T21:40:54.200 INFO:tasks.workunit.client.1.smithi116.stdout:8/891: write d2/d10/d19/d21/d22/d5d/d46/f77 [399252,101808] 0 2024-09-13T21:40:54.201 INFO:tasks.workunit.client.1.smithi116.stdout:2/988: mknod d0/de9/d13a/d86/dd1/df0/c14d 0 2024-09-13T21:40:54.203 INFO:tasks.workunit.client.1.smithi116.stdout:1/796: getdents d4/d14/d52/d2f/d91/dac 0 2024-09-13T21:40:54.208 INFO:tasks.workunit.client.1.smithi116.stdout:9/668: rename d2/d10/f2a to d2/fc2 0 2024-09-13T21:40:54.209 INFO:tasks.workunit.client.1.smithi116.stdout:8/892: mknod d2/d10/d75/dc7/c10e 0 2024-09-13T21:40:54.211 INFO:tasks.workunit.client.1.smithi116.stdout:2/989: mknod d0/d3a/d82/d62/d1f/d5d/c14e 0 2024-09-13T21:40:54.212 INFO:tasks.workunit.client.1.smithi116.stdout:1/797: rmdir d4/d14/d2a/dd3/d100 39 2024-09-13T21:40:54.214 INFO:tasks.workunit.client.1.smithi116.stdout:9/669: mkdir d2/d10/d4c/d98/dad/dc3 0 2024-09-13T21:40:54.214 INFO:tasks.workunit.client.1.smithi116.stdout:4/832: dwrite d0/dad/fd6 [0,4194304] 0 2024-09-13T21:40:54.215 INFO:tasks.workunit.client.1.smithi116.stdout:8/893: creat d2/f10f x:0 0 0 2024-09-13T21:40:54.217 INFO:tasks.workunit.client.1.smithi116.stdout:9/670: mknod d2/d5d/d8f/db4/cc4 0 2024-09-13T21:40:54.217 INFO:tasks.workunit.client.1.smithi116.stdout:9/671: fsync d2/fc 0 2024-09-13T21:40:54.219 INFO:tasks.workunit.client.1.smithi116.stdout:4/833: write d0/fa1 [695103,6539] 0 2024-09-13T21:40:54.220 INFO:tasks.workunit.client.1.smithi116.stdout:4/834: read d0/d32/d5d/f6f [279119,16803] 0 2024-09-13T21:40:54.220 INFO:tasks.workunit.client.1.smithi116.stdout:9/672: dread d2/f13 [0,4194304] 0 2024-09-13T21:40:54.221 INFO:tasks.workunit.client.1.smithi116.stdout:8/894: creat d2/d10/d4b/de7/f110 x:0 0 0 2024-09-13T21:40:54.225 INFO:tasks.workunit.client.1.smithi116.stdout:4/835: truncate d0/dd/d13/f46 3868672 0 2024-09-13T21:40:54.225 INFO:tasks.workunit.client.1.smithi116.stdout:4/836: read - d0/d32/fe5 zero size 2024-09-13T21:40:54.236 INFO:tasks.workunit.client.1.smithi116.stdout:9/673: write d2/d72/f79 [421387,115765] 0 2024-09-13T21:40:54.237 INFO:tasks.workunit.client.1.smithi116.stdout:2/990: dwrite d0/de9/d13a/f12 [4194304,4194304] 0 2024-09-13T21:40:54.237 INFO:tasks.workunit.client.1.smithi116.stdout:2/991: write d0/d5/d8/dd2/f116 [848901,89613] 0 2024-09-13T21:40:54.239 INFO:tasks.workunit.client.1.smithi116.stdout:2/992: symlink d0/d5/d8/d7a/d12a/l14f 0 2024-09-13T21:40:54.239 INFO:tasks.workunit.client.1.smithi116.stdout:1/798: dwrite d4/d14/d52/d2f/d5d/fd5 [0,4194304] 0 2024-09-13T21:40:54.240 INFO:tasks.workunit.client.1.smithi116.stdout:2/993: rename d0/l2f to d0/d3a/d82/d62/d75/d77/l150 0 2024-09-13T21:40:54.243 INFO:tasks.workunit.client.1.smithi116.stdout:9/674: dread d2/f2d [0,4194304] 0 2024-09-13T21:40:54.243 INFO:tasks.workunit.client.1.smithi116.stdout:1/799: rename d4/d14/d52/d2f/d5c/fd8 to d4/d14/d2a/df2/f11d 0 2024-09-13T21:40:54.245 INFO:tasks.workunit.client.1.smithi116.stdout:2/994: rename d0/d3a/d82/d62/f4a to d0/d3a/d82/d68/f151 0 2024-09-13T21:40:54.245 INFO:tasks.workunit.client.1.smithi116.stdout:2/995: creat d0/de9/d13a/d86/dd1/df0/f152 x:0 0 0 2024-09-13T21:40:54.245 INFO:tasks.workunit.client.1.smithi116.stdout:2/996: readlink d0/d3a/d82/d62/d1f/d5d/d72/daa/da9/lb1 0 2024-09-13T21:40:54.246 INFO:tasks.workunit.client.1.smithi116.stdout:1/800: mknod d4/d14/d52/c11e 0 2024-09-13T21:40:54.246 INFO:tasks.workunit.client.1.smithi116.stdout:1/801: chown d4/d14/d52/l10e 2064 1 2024-09-13T21:40:54.246 INFO:tasks.workunit.client.1.smithi116.stdout:1/802: creat d4/d14/d2a/f11f x:0 0 0 2024-09-13T21:40:54.246 INFO:tasks.workunit.client.1.smithi116.stdout:1/803: chown d4/d23/d56/da3/cb4 625261262 1 2024-09-13T21:40:54.248 INFO:tasks.workunit.client.1.smithi116.stdout:2/997: rename d0/f79 to d0/de9/d13a/d49/d148/f153 0 2024-09-13T21:40:54.250 INFO:tasks.workunit.client.1.smithi116.stdout:1/804: creat d4/d14/d52/d2f/d5d/f120 x:0 0 0 2024-09-13T21:40:54.252 INFO:tasks.workunit.client.1.smithi116.stdout:2/998: creat d0/de9/d13a/d49/d93/d144/f154 x:0 0 0 2024-09-13T21:40:54.252 INFO:tasks.workunit.client.1.smithi116.stdout:2/999: write d0/de9/d13a/d86/dd1/df0/f123 [531491,46644] 0 2024-09-13T21:40:54.253 INFO:tasks.workunit.client.1.smithi116.stdout:1/805: rename d4/d74/d8d/l46 to d4/d74/d8d/d5f/dd4/l121 0 2024-09-13T21:40:54.254 INFO:tasks.workunit.client.1.smithi116.stdout:8/895: dwrite d2/d10/d19/dea/ffe [0,4194304] 0 2024-09-13T21:40:54.255 INFO:tasks.workunit.client.1.smithi116.stdout:9/675: read d2/d8/faf [3876849,16106] 0 2024-09-13T21:40:54.255 INFO:tasks.workunit.client.1.smithi116.stdout:4/837: dwrite d0/dd/d48/f5c [8388608,4194304] 0 2024-09-13T21:40:54.255 INFO:tasks.workunit.client.1.smithi116.stdout:4/838: readlink d0/d32/d5f/lac 0 2024-09-13T21:40:54.255 INFO:tasks.workunit.client.1.smithi116.stdout:4/839: truncate d0/dd/d6b/d92/d95/ddd/fef 190639 0 2024-09-13T21:40:54.255 INFO:tasks.workunit.client.1.smithi116.stdout:1/806: rename d4/d14/d52/d2f/d5d/fd5 to d4/d14/d2a/f122 0 2024-09-13T21:40:54.258 INFO:tasks.workunit.client.1.smithi116.stdout:8/896: creat d2/d10/d19/d3a/d4c/f111 x:0 0 0 2024-09-13T21:40:54.260 INFO:tasks.workunit.client.1.smithi116.stdout:9/676: creat d2/d10/d14/d38/d3a/fc5 x:0 0 0 2024-09-13T21:40:54.260 INFO:tasks.workunit.client.1.smithi116.stdout:9/677: readlink d2/d10/d4c/l66 0 2024-09-13T21:40:54.261 INFO:tasks.workunit.client.1.smithi116.stdout:4/840: rename d0/d56/d84/fa4 to d0/dd/d6b/d71/f10a 0 2024-09-13T21:40:54.262 INFO:tasks.workunit.client.1.smithi116.stdout:1/807: getdents d4/d23/d56/da3/dc4 0 2024-09-13T21:40:54.263 INFO:tasks.workunit.client.1.smithi116.stdout:1/808: chown d4/d14/d52/d2f/d5c/c86 0 1 2024-09-13T21:40:54.263 INFO:tasks.workunit.client.1.smithi116.stdout:1/809: creat d4/d14/d52/d2f/d5c/daf/db9/f123 x:0 0 0 2024-09-13T21:40:54.263 INFO:tasks.workunit.client.1.smithi116.stdout:1/810: truncate d4/d23/f7c 1024041 0 2024-09-13T21:40:54.264 INFO:tasks.workunit.client.1.smithi116.stdout:8/897: truncate d2/d27/d66/d7c/fc2 2098548 0 2024-09-13T21:40:54.265 INFO:tasks.workunit.client.1.smithi116.stdout:9/678: fsync d2/d10/d14/d38/d3a/f6c 0 2024-09-13T21:40:54.269 INFO:tasks.workunit.client.1.smithi116.stdout:1/811: mknod d4/d14/d52/d2f/d5c/dff/c124 0 2024-09-13T21:40:54.269 INFO:tasks.workunit.client.1.smithi116.stdout:4/841: read d0/dd/d13/d4e/f73 [576242,62225] 0 2024-09-13T21:40:54.269 INFO:tasks.workunit.client.1.smithi116.stdout:8/898: creat d2/d10/d4b/f112 x:0 0 0 2024-09-13T21:40:54.271 INFO:tasks.workunit.client.1.smithi116.stdout:9/679: creat d2/d10/d4c/d98/dad/dc3/fc6 x:0 0 0 2024-09-13T21:40:54.273 INFO:tasks.workunit.client.1.smithi116.stdout:1/812: symlink d4/d23/d57/d92/l125 0 2024-09-13T21:40:54.275 INFO:tasks.workunit.client.1.smithi116.stdout:1/813: unlink d4/d14/d52/c60 0 2024-09-13T21:40:54.276 INFO:tasks.workunit.client.1.smithi116.stdout:8/899: dread d2/d10/d19/d21/d69/f8b [0,4194304] 0 2024-09-13T21:40:54.279 INFO:tasks.workunit.client.1.smithi116.stdout:1/814: creat d4/d14/d52/d2f/d5c/f126 x:0 0 0 2024-09-13T21:40:54.280 INFO:tasks.workunit.client.1.smithi116.stdout:8/900: symlink d2/d10/l113 0 2024-09-13T21:40:54.280 INFO:tasks.workunit.client.1.smithi116.stdout:8/901: write d2/d10/d19/d3a/d4c/fff [433554,99028] 0 2024-09-13T21:40:54.280 INFO:tasks.workunit.client.1.smithi116.stdout:8/902: chown d2/d10/d19/d21/d22/d5d 19489355 1 2024-09-13T21:40:54.280 INFO:tasks.workunit.client.1.smithi116.stdout:8/903: readlink d2/d10/d37/d64/lca 0 2024-09-13T21:40:54.281 INFO:tasks.workunit.client.1.smithi116.stdout:1/815: mknod d4/d14/d52/d2f/d5d/dc7/c127 0 2024-09-13T21:40:54.283 INFO:tasks.workunit.client.1.smithi116.stdout:8/904: symlink d2/d10/d4b/d6e/l114 0 2024-09-13T21:40:54.283 INFO:tasks.workunit.client.1.smithi116.stdout:8/905: read - d2/d10/d19/d42/f10c zero size 2024-09-13T21:40:54.283 INFO:tasks.workunit.client.1.smithi116.stdout:8/906: dread - d2/d27/d66/dcc/f108 zero size 2024-09-13T21:40:54.286 INFO:tasks.workunit.client.1.smithi116.stdout:4/842: rmdir d0/dd 39 2024-09-13T21:40:54.286 INFO:tasks.workunit.client.1.smithi116.stdout:4/843: write d0/d32/f49 [4994049,91316] 0 2024-09-13T21:40:54.287 INFO:tasks.workunit.client.1.smithi116.stdout:9/680: dwrite d2/d10/f52 [0,4194304] 0 2024-09-13T21:40:54.288 INFO:tasks.workunit.client.1.smithi116.stdout:1/816: unlink d4/d14/d52/d2f/d5c/daf/db9/le9 0 2024-09-13T21:40:54.293 INFO:tasks.workunit.client.1.smithi116.stdout:8/907: creat d2/d10/d19/d21/f115 x:0 0 0 2024-09-13T21:40:54.293 INFO:tasks.workunit.client.1.smithi116.stdout:8/908: fsync d2/d10/d19/fb1 0 2024-09-13T21:40:54.293 INFO:tasks.workunit.client.1.smithi116.stdout:8/909: getdents d2/d27 0 2024-09-13T21:40:54.299 INFO:tasks.workunit.client.1.smithi116.stdout:1/817: symlink d4/d23/l128 0 2024-09-13T21:40:54.299 INFO:tasks.workunit.client.1.smithi116.stdout:1/818: getdents d4/d14/d52/d2f/d5c/daf/db9/d116 0 2024-09-13T21:40:54.300 INFO:tasks.workunit.client.1.smithi116.stdout:4/844: dread d0/dd/d6b/d92/fa2 [0,4194304] 0 2024-09-13T21:40:54.301 INFO:tasks.workunit.client.1.smithi116.stdout:4/845: stat d0/d32/d5f 0 2024-09-13T21:40:54.307 INFO:tasks.workunit.client.1.smithi116.stdout:8/910: read d2/d5c/fc5 [3501578,95777] 0 2024-09-13T21:40:54.308 INFO:tasks.workunit.client.1.smithi116.stdout:1/819: write d4/d14/d52/d2f/d5d/f11a [953855,55159] 0 2024-09-13T21:40:54.312 INFO:tasks.workunit.client.1.smithi116.stdout:4/846: rename d0/dd/c3d to d0/dd/d13/d5a/d7a/c10b 0 2024-09-13T21:40:54.313 INFO:tasks.workunit.client.1.smithi116.stdout:4/847: dread d0/d56/d84/fc6 [0,4194304] 0 2024-09-13T21:40:54.316 INFO:tasks.workunit.client.1.smithi116.stdout:8/911: mknod d2/d5c/c116 0 2024-09-13T21:40:54.318 INFO:tasks.workunit.client.1.smithi116.stdout:4/848: creat d0/f10c x:0 0 0 2024-09-13T21:40:54.318 INFO:tasks.workunit.client.1.smithi116.stdout:4/849: truncate d0/d32/d5d/d85/fda 448927 0 2024-09-13T21:40:54.318 INFO:tasks.workunit.client.1.smithi116.stdout:4/850: chown d0/dd/d13/d5a/d7a/c10b 175 1 2024-09-13T21:40:54.319 INFO:tasks.workunit.client.1.smithi116.stdout:4/851: creat d0/dd/d13/f10d x:0 0 0 2024-09-13T21:40:54.320 INFO:tasks.workunit.client.1.smithi116.stdout:8/912: getdents d2/d27/d62 0 2024-09-13T21:40:54.320 INFO:tasks.workunit.client.1.smithi116.stdout:1/820: dwrite d4/d14/d52/f4a [0,4194304] 0 2024-09-13T21:40:54.322 INFO:tasks.workunit.client.1.smithi116.stdout:4/852: rmdir d0/d32/d5d/d85/dec 0 2024-09-13T21:40:54.322 INFO:tasks.workunit.client.1.smithi116.stdout:4/853: truncate d0/d32/da3/fca 842649 0 2024-09-13T21:40:54.322 INFO:tasks.workunit.client.1.smithi116.stdout:8/913: mkdir d2/d10/d19/d42/d45/d87/dc1/d117 0 2024-09-13T21:40:54.324 INFO:tasks.workunit.client.1.smithi116.stdout:4/854: mknod d0/d56/d84/c10e 0 2024-09-13T21:40:54.325 INFO:tasks.workunit.client.1.smithi116.stdout:8/914: rename d2/d10/d19/d21/d22/d5d/ff9 to d2/d10/d3e/f118 0 2024-09-13T21:40:54.327 INFO:tasks.workunit.client.1.smithi116.stdout:4/855: dread d0/d32/f49 [4194304,4194304] 0 2024-09-13T21:40:54.327 INFO:tasks.workunit.client.1.smithi116.stdout:8/915: link d2/d10/d19/dea/ffe d2/d10/d19/d3a/d4c/f119 0 2024-09-13T21:40:54.327 INFO:tasks.workunit.client.1.smithi116.stdout:8/916: chown d2/d27/d66/dcc 5 1 2024-09-13T21:40:54.328 INFO:tasks.workunit.client.1.smithi116.stdout:4/856: link d0/l25 d0/d56/l10f 0 2024-09-13T21:40:54.328 INFO:tasks.workunit.client.1.smithi116.stdout:8/917: dread d2/d27/d66/fc4 [0,4194304] 0 2024-09-13T21:40:54.328 INFO:tasks.workunit.client.1.smithi116.stdout:8/918: write d2/d10/d19/d42/f10c [218823,76868] 0 2024-09-13T21:40:54.329 INFO:tasks.workunit.client.1.smithi116.stdout:4/857: creat d0/d56/d84/dfa/f110 x:0 0 0 2024-09-13T21:40:54.331 INFO:tasks.workunit.client.1.smithi116.stdout:1/821: dread d4/d14/f48 [0,4194304] 0 2024-09-13T21:40:54.331 INFO:tasks.workunit.client.1.smithi116.stdout:1/822: write d4/d14/f48 [2384436,124149] 0 2024-09-13T21:40:54.333 INFO:tasks.workunit.client.1.smithi116.stdout:1/823: creat d4/d74/d8d/f129 x:0 0 0 2024-09-13T21:40:54.338 INFO:tasks.workunit.client.1.smithi116.stdout:1/824: rename d4/d14/d52/d2f/d5c/daf to d4/d14/d52/d2f/d91/dac/df0/dc0/d12a 0 2024-09-13T21:40:54.339 INFO:tasks.workunit.client.1.smithi116.stdout:1/825: creat d4/d23/f12b x:0 0 0 2024-09-13T21:40:54.339 INFO:tasks.workunit.client.1.smithi116.stdout:1/826: getdents d4/d23/d56/de4 0 2024-09-13T21:40:54.341 INFO:tasks.workunit.client.1.smithi116.stdout:1/827: link d4/f10f d4/f12c 0 2024-09-13T21:40:54.341 INFO:tasks.workunit.client.1.smithi116.stdout:1/828: chown d4/d23/d56/c9e 197935 1 2024-09-13T21:40:54.351 INFO:tasks.workunit.client.1.smithi116.stdout:1/829: write d4/d23/fbc [7084570,79178] 0 2024-09-13T21:40:54.351 INFO:tasks.workunit.client.1.smithi116.stdout:4/858: dwrite d0/d56/d57/fa0 [0,4194304] 0 2024-09-13T21:40:54.352 INFO:tasks.workunit.client.1.smithi116.stdout:4/859: symlink d0/dd/d6b/d92/d95/l111 0 2024-09-13T21:40:54.352 INFO:tasks.workunit.client.1.smithi116.stdout:4/860: truncate d0/d32/d5d/f6f 1322240 0 2024-09-13T21:40:54.376 INFO:tasks.workunit.client.1.smithi116.stdout:4/861: dwrite d0/dd/d6b/d92/d99/dbc/ff3 [0,4194304] 0 2024-09-13T21:40:54.376 INFO:tasks.workunit.client.1.smithi116.stdout:4/862: chown d0/dd/d13/d5a/d7a/lf9 3168 1 2024-09-13T21:40:54.376 INFO:tasks.workunit.client.1.smithi116.stdout:4/863: fdatasync d0/d32/d5d/d85/fa8 0 2024-09-13T21:40:54.378 INFO:tasks.workunit.client.1.smithi116.stdout:4/864: rename d0/dd/c12 to d0/dd/c112 0 2024-09-13T21:40:54.379 INFO:tasks.workunit.client.1.smithi116.stdout:4/865: truncate d0/dd/d13/f4f 476004 0 2024-09-13T21:40:54.381 INFO:tasks.workunit.client.1.smithi116.stdout:4/866: dread d0/dd/d13/d5a/d7a/ff5 [0,4194304] 0 2024-09-13T21:40:54.406 INFO:tasks.workunit.client.1.smithi116.stdout:4/867: dwrite d0/dd/d13/fed [0,4194304] 0 2024-09-13T21:40:54.406 INFO:tasks.workunit.client.1.smithi116.stdout:4/868: chown d0/fa1 0 1 2024-09-13T21:40:54.407 INFO:tasks.workunit.client.1.smithi116.stdout:4/869: fsync d0/f43 0 2024-09-13T21:40:54.409 INFO:tasks.workunit.client.1.smithi116.stdout:4/870: dread d0/dd/d13/d4e/f73 [0,4194304] 0 2024-09-13T21:40:54.414 INFO:tasks.workunit.client.1.smithi116.stdout:4/871: dread d0/f10 [0,4194304] 0 2024-09-13T21:40:55.030 INFO:tasks.workunit.client.1.smithi116.stdout:1/830: sync 2024-09-13T21:40:55.030 INFO:tasks.workunit.client.1.smithi116.stdout:4/872: sync 2024-09-13T21:40:55.030 INFO:tasks.workunit.client.1.smithi116.stdout:9/681: sync 2024-09-13T21:40:55.030 INFO:tasks.workunit.client.1.smithi116.stdout:8/919: sync 2024-09-13T21:40:55.030 INFO:tasks.workunit.client.1.smithi116.stdout:9/682: readlink d2/d10/d4c/l66 0 2024-09-13T21:40:55.030 INFO:tasks.workunit.client.1.smithi116.stdout:1/831: truncate d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/db9/fe1 1035573 0 2024-09-13T21:40:55.030 INFO:tasks.workunit.client.1.smithi116.stdout:8/920: write d2/d10/f11 [2676499,5683] 0 2024-09-13T21:40:55.030 INFO:tasks.workunit.client.1.smithi116.stdout:4/873: write d0/d56/d57/ff4 [731591,19500] 0 2024-09-13T21:40:55.031 INFO:tasks.workunit.client.1.smithi116.stdout:9/683: mknod d2/d5d/d69/d7d/cc7 0 2024-09-13T21:40:55.031 INFO:tasks.workunit.client.1.smithi116.stdout:1/832: mkdir d4/d74/d12d 0 2024-09-13T21:40:55.031 INFO:tasks.workunit.client.1.smithi116.stdout:8/921: symlink d2/d10/d75/l11a 0 2024-09-13T21:40:55.031 INFO:tasks.workunit.client.1.smithi116.stdout:8/922: write d2/d10/d19/f84 [5342409,71255] 0 2024-09-13T21:40:55.032 INFO:tasks.workunit.client.1.smithi116.stdout:9/684: mkdir d2/d5d/d69/d7d/dc8 0 2024-09-13T21:40:55.033 INFO:tasks.workunit.client.1.smithi116.stdout:1/833: creat d4/d14/d41/dab/f12e x:0 0 0 2024-09-13T21:40:55.033 INFO:tasks.workunit.client.1.smithi116.stdout:1/834: read - d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/db9/f111 zero size 2024-09-13T21:40:55.034 INFO:tasks.workunit.client.1.smithi116.stdout:1/835: dread d4/d14/d52/d2f/d91/ff8 [0,4194304] 0 2024-09-13T21:40:55.034 INFO:tasks.workunit.client.1.smithi116.stdout:9/685: creat d2/d5d/d69/fc9 x:0 0 0 2024-09-13T21:40:55.035 INFO:tasks.workunit.client.1.smithi116.stdout:8/923: mkdir d2/d11b 0 2024-09-13T21:40:55.036 INFO:tasks.workunit.client.1.smithi116.stdout:1/836: creat d4/d14/d41/f12f x:0 0 0 2024-09-13T21:40:55.036 INFO:tasks.workunit.client.1.smithi116.stdout:1/837: chown d4/d14/f1d 426396304 1 2024-09-13T21:40:55.037 INFO:tasks.workunit.client.1.smithi116.stdout:1/838: chown d4/d14/d52/d2f/c10b 49 1 2024-09-13T21:40:55.037 INFO:tasks.workunit.client.1.smithi116.stdout:9/686: creat d2/d5d/fca x:0 0 0 2024-09-13T21:40:55.038 INFO:tasks.workunit.client.1.smithi116.stdout:8/924: rename d2/d10/d19/fb1 to d2/d10/d37/f11c 0 2024-09-13T21:40:55.040 INFO:tasks.workunit.client.1.smithi116.stdout:8/925: symlink d2/d10/d75/dc7/l11d 0 2024-09-13T21:40:55.040 INFO:tasks.workunit.client.1.smithi116.stdout:8/926: chown d2/d10/d4b/d6e 50791471 1 2024-09-13T21:40:55.044 INFO:tasks.workunit.client.1.smithi116.stdout:9/687: dread d2/f4 [0,4194304] 0 2024-09-13T21:40:55.044 INFO:tasks.workunit.client.1.smithi116.stdout:9/688: write d2/d10/fb6 [688880,51652] 0 2024-09-13T21:40:55.045 INFO:tasks.workunit.client.1.smithi116.stdout:9/689: truncate d2/d10/d6e/f7f 2641436 0 2024-09-13T21:40:55.047 INFO:tasks.workunit.client.1.smithi116.stdout:9/690: creat d2/d5d/d69/d7d/dc8/fcb x:0 0 0 2024-09-13T21:40:55.047 INFO:tasks.workunit.client.1.smithi116.stdout:9/691: fdatasync d2/d10/d4c/f9a 0 2024-09-13T21:40:55.047 INFO:tasks.workunit.client.1.smithi116.stdout:9/692: write d2/d10/faa [688843,39149] 0 2024-09-13T21:40:55.047 INFO:tasks.workunit.client.1.smithi116.stdout:9/693: creat d2/d10/d6e/fcc x:0 0 0 2024-09-13T21:40:55.048 INFO:tasks.workunit.client.1.smithi116.stdout:4/874: dwrite d0/d32/d5d/f6f [0,4194304] 0 2024-09-13T21:40:55.048 INFO:tasks.workunit.client.1.smithi116.stdout:4/875: chown d0/dd/d6b/d92/d95/dc7 44982 1 2024-09-13T21:40:55.049 INFO:tasks.workunit.client.1.smithi116.stdout:4/876: dread d0/dd/d48/fdb [0,4194304] 0 2024-09-13T21:40:55.049 INFO:tasks.workunit.client.1.smithi116.stdout:4/877: chown d0/dad 0 1 2024-09-13T21:40:55.049 INFO:tasks.workunit.client.1.smithi116.stdout:4/878: fdatasync d0/dd/d13/f3c 0 2024-09-13T21:40:55.049 INFO:tasks.workunit.client.1.smithi116.stdout:4/879: write d0/dd/d6b/d71/f102 [521383,121015] 0 2024-09-13T21:40:55.049 INFO:tasks.workunit.client.1.smithi116.stdout:9/694: unlink d2/d8/c35 0 2024-09-13T21:40:55.051 INFO:tasks.workunit.client.1.smithi116.stdout:4/880: rmdir d0/dd/d7c/df0 0 2024-09-13T21:40:55.062 INFO:tasks.workunit.client.1.smithi116.stdout:1/839: dwrite d4/f37 [0,4194304] 0 2024-09-13T21:40:55.068 INFO:tasks.workunit.client.1.smithi116.stdout:8/927: dwrite d2/d10/d19/d3a/d4c/d7a/f89 [0,4194304] 0 2024-09-13T21:40:55.068 INFO:tasks.workunit.client.1.smithi116.stdout:4/881: dread d0/dad/fd6 [0,4194304] 0 2024-09-13T21:40:55.069 INFO:tasks.workunit.client.1.smithi116.stdout:8/928: mkdir d2/d27/d66/d100/d11e 0 2024-09-13T21:40:55.070 INFO:tasks.workunit.client.1.smithi116.stdout:9/695: dwrite d2/d8/f1a [0,4194304] 0 2024-09-13T21:40:55.070 INFO:tasks.workunit.client.1.smithi116.stdout:8/929: stat d2/d10/d19/d42/d45/fdf 0 2024-09-13T21:40:55.070 INFO:tasks.workunit.client.1.smithi116.stdout:8/930: chown d2/d10/d19/d3a/d4c/d7a/c92 50689507 1 2024-09-13T21:40:55.071 INFO:tasks.workunit.client.1.smithi116.stdout:4/882: mknod d0/dd/d7c/c113 0 2024-09-13T21:40:55.071 INFO:tasks.workunit.client.1.smithi116.stdout:4/883: chown d0/d32/d5d/d85/laa 0 1 2024-09-13T21:40:55.072 INFO:tasks.workunit.client.1.smithi116.stdout:9/696: mkdir d2/d8/d93/da0/dcd 0 2024-09-13T21:40:55.074 INFO:tasks.workunit.client.1.smithi116.stdout:8/931: rename d2/d10/d75/dc7 to d2/d10/d19/d11f 0 2024-09-13T21:40:55.077 INFO:tasks.workunit.client.1.smithi116.stdout:1/840: dwrite d4/f12c [0,4194304] 0 2024-09-13T21:40:55.077 INFO:tasks.workunit.client.1.smithi116.stdout:9/697: creat d2/d5d/d8f/db4/fce x:0 0 0 2024-09-13T21:40:55.082 INFO:tasks.workunit.client.1.smithi116.stdout:1/841: creat d4/d14/d52/f130 x:0 0 0 2024-09-13T21:40:55.083 INFO:tasks.workunit.client.1.smithi116.stdout:9/698: unlink d2/d5d/f89 0 2024-09-13T21:40:55.084 INFO:tasks.workunit.client.1.smithi116.stdout:8/932: symlink d2/d27/d66/l120 0 2024-09-13T21:40:55.089 INFO:tasks.workunit.client.1.smithi116.stdout:4/884: dwrite d0/d32/da3/db7/fe6 [0,4194304] 0 2024-09-13T21:40:55.089 INFO:tasks.workunit.client.1.smithi116.stdout:4/885: readlink d0/dd/lbb 0 2024-09-13T21:40:55.092 INFO:tasks.workunit.client.1.smithi116.stdout:4/886: creat d0/dad/de0/f114 x:0 0 0 2024-09-13T21:40:55.093 INFO:tasks.workunit.client.1.smithi116.stdout:4/887: link d0/dd/d6b/d92/d95/ddd/lf1 d0/d32/da3/db7/l115 0 2024-09-13T21:40:55.093 INFO:tasks.workunit.client.1.smithi116.stdout:4/888: truncate d0/dd/d13/d4e/f73 4486426 0 2024-09-13T21:40:55.093 INFO:tasks.workunit.client.1.smithi116.stdout:4/889: creat d0/dd/d13/d5a/dc4/f116 x:0 0 0 2024-09-13T21:40:55.093 INFO:tasks.workunit.client.1.smithi116.stdout:4/890: mkdir d0/dd/d7c/dfc/d117 0 2024-09-13T21:40:55.096 INFO:tasks.workunit.client.1.smithi116.stdout:1/842: write d4/f6f [3781840,26615] 0 2024-09-13T21:40:55.096 INFO:tasks.workunit.client.1.smithi116.stdout:1/843: fsync d4/d14/d2a/fbf 0 2024-09-13T21:40:55.096 INFO:tasks.workunit.client.1.smithi116.stdout:1/844: write d4/d14/d52/d2f/d91/fe3 [526403,48700] 0 2024-09-13T21:40:55.097 INFO:tasks.workunit.client.1.smithi116.stdout:1/845: write d4/d23/d57/d92/fa6 [4480810,107155] 0 2024-09-13T21:40:55.097 INFO:tasks.workunit.client.1.smithi116.stdout:1/846: chown d4/d23/c25 3369 1 2024-09-13T21:40:55.098 INFO:tasks.workunit.client.1.smithi116.stdout:8/933: dread d2/d10/d19/d21/d22/d5d/d46/f5b [0,4194304] 0 2024-09-13T21:40:55.098 INFO:tasks.workunit.client.1.smithi116.stdout:4/891: dread d0/dd/fcb [0,4194304] 0 2024-09-13T21:40:55.098 INFO:tasks.workunit.client.1.smithi116.stdout:1/847: creat d4/d74/d12d/f131 x:0 0 0 2024-09-13T21:40:55.099 INFO:tasks.workunit.client.1.smithi116.stdout:1/848: dread - d4/d23/f12b zero size 2024-09-13T21:40:55.099 INFO:tasks.workunit.client.1.smithi116.stdout:1/849: write d4/d14/d2a/f118 [106717,98820] 0 2024-09-13T21:40:55.100 INFO:tasks.workunit.client.1.smithi116.stdout:8/934: mkdir d2/d10/d75/d121 0 2024-09-13T21:40:55.100 INFO:tasks.workunit.client.1.smithi116.stdout:8/935: fdatasync d2/d10/d19/d21/d69/ff5 0 2024-09-13T21:40:55.103 INFO:tasks.workunit.client.1.smithi116.stdout:8/936: symlink d2/d27/d62/l122 0 2024-09-13T21:40:55.118 INFO:tasks.workunit.client.1.smithi116.stdout:1/850: dwrite d4/d14/fa0 [0,4194304] 0 2024-09-13T21:40:55.119 INFO:tasks.workunit.client.1.smithi116.stdout:1/851: symlink d4/d14/d52/d2f/d91/dac/l132 0 2024-09-13T21:40:55.120 INFO:tasks.workunit.client.1.smithi116.stdout:1/852: getdents d4/d23/d56/da3/dc4 0 2024-09-13T21:40:55.120 INFO:tasks.workunit.client.1.smithi116.stdout:1/853: mkdir d4/d14/d52/d133 0 2024-09-13T21:40:55.121 INFO:tasks.workunit.client.1.smithi116.stdout:1/854: stat d4/d14/d52/d2f/d91/lb6 0 2024-09-13T21:40:55.121 INFO:tasks.workunit.client.1.smithi116.stdout:9/699: write d2/f2b [2624150,122517] 0 2024-09-13T21:40:55.123 INFO:tasks.workunit.client.1.smithi116.stdout:9/700: link d2/d8/f33 d2/d10/fcf 0 2024-09-13T21:40:55.124 INFO:tasks.workunit.client.1.smithi116.stdout:9/701: chown d2/d10/d14/f21 2483454 1 2024-09-13T21:40:55.124 INFO:tasks.workunit.client.1.smithi116.stdout:9/702: read d2/d10/d14/f44 [4411417,111696] 0 2024-09-13T21:40:55.124 INFO:tasks.workunit.client.1.smithi116.stdout:9/703: read d2/d10/d14/d38/f4f [587622,14039] 0 2024-09-13T21:40:55.147 INFO:tasks.workunit.client.1.smithi116.stdout:1/855: dwrite d4/d14/d41/f49 [0,4194304] 0 2024-09-13T21:40:55.148 INFO:tasks.workunit.client.1.smithi116.stdout:9/704: dwrite d2/f2f [0,4194304] 0 2024-09-13T21:40:55.149 INFO:tasks.workunit.client.1.smithi116.stdout:9/705: rename d2/d10/d4c/f99 to d2/d43/fd0 0 2024-09-13T21:40:55.151 INFO:tasks.workunit.client.1.smithi116.stdout:9/706: rename d2/d10/c30 to d2/d10/d14/d38/cd1 0 2024-09-13T21:40:55.152 INFO:tasks.workunit.client.1.smithi116.stdout:9/707: mkdir d2/d5d/d69/d7d/dc8/dd2 0 2024-09-13T21:40:55.152 INFO:tasks.workunit.client.1.smithi116.stdout:9/708: chown d2/d8/c6a 818269 1 2024-09-13T21:40:55.153 INFO:tasks.workunit.client.1.smithi116.stdout:9/709: link d2/fc2 d2/d5d/d69/d47/fd3 0 2024-09-13T21:40:55.154 INFO:tasks.workunit.client.1.smithi116.stdout:9/710: mkdir d2/d10/d14/d38/dd4 0 2024-09-13T21:40:55.155 INFO:tasks.workunit.client.1.smithi116.stdout:9/711: unlink d2/f2b 0 2024-09-13T21:40:55.169 INFO:tasks.workunit.client.1.smithi116.stdout:9/712: dwrite d2/d10/d6e/fcc [0,4194304] 0 2024-09-13T21:40:55.169 INFO:tasks.workunit.client.1.smithi116.stdout:9/713: truncate d2/d5d/d69/fa9 1233226 0 2024-09-13T21:40:55.170 INFO:tasks.workunit.client.1.smithi116.stdout:9/714: mknod d2/d10/d4c/cd5 0 2024-09-13T21:40:55.171 INFO:tasks.workunit.client.1.smithi116.stdout:9/715: dread d2/d10/d14/fa1 [0,4194304] 0 2024-09-13T21:40:55.173 INFO:tasks.workunit.client.1.smithi116.stdout:9/716: rename d2/f2f to d2/d8/d3e/fd6 0 2024-09-13T21:40:55.187 INFO:tasks.workunit.client.1.smithi116.stdout:9/717: dwrite d2/d10/d6e/fcc [0,4194304] 0 2024-09-13T21:40:55.188 INFO:tasks.workunit.client.1.smithi116.stdout:9/718: rename d2/d8 to d2/d8/dd7 22 2024-09-13T21:40:55.189 INFO:tasks.workunit.client.1.smithi116.stdout:9/719: unlink d2/d8/d93/f94 0 2024-09-13T21:40:55.189 INFO:tasks.workunit.client.1.smithi116.stdout:9/720: creat d2/d8/d93/fd8 x:0 0 0 2024-09-13T21:40:55.191 INFO:tasks.workunit.client.1.smithi116.stdout:9/721: rmdir d2/d10/d14/d38/dd4 0 2024-09-13T21:40:55.204 INFO:tasks.workunit.client.1.smithi116.stdout:9/722: dwrite d2/f3 [8388608,4194304] 0 2024-09-13T21:40:55.206 INFO:tasks.workunit.client.1.smithi116.stdout:9/723: rename d2/d10/d14/d38/fb2 to d2/d8/d93/da0/fd9 0 2024-09-13T21:40:55.224 INFO:tasks.workunit.client.1.smithi116.stdout:9/724: dwrite d2/fc [0,4194304] 0 2024-09-13T21:40:55.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:55 smithi088 ceph-mon[27963]: pgmap v267: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 171 MiB/s rd, 187 MiB/s wr, 387 op/s 2024-09-13T21:40:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:55 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:55.532 INFO:tasks.workunit.client.1.smithi116.stdout:4/892: sync 2024-09-13T21:40:55.532 INFO:tasks.workunit.client.1.smithi116.stdout:4/893: stat d0/dd/d6b/dee 0 2024-09-13T21:40:55.535 INFO:tasks.workunit.client.1.smithi116.stdout:4/894: rename d0/dd/d6b/dee/f8f to d0/dad/de0/d107/f118 0 2024-09-13T21:40:55.535 INFO:tasks.workunit.client.1.smithi116.stdout:4/895: readlink d0/dd/d13/lbd 0 2024-09-13T21:40:55.535 INFO:tasks.workunit.client.1.smithi116.stdout:4/896: write d0/dd/f3b [1628003,96284] 0 2024-09-13T21:40:55.552 INFO:tasks.workunit.client.1.smithi116.stdout:4/897: dwrite d0/dd/d13/f3c [4194304,4194304] 0 2024-09-13T21:40:55.554 INFO:tasks.workunit.client.1.smithi116.stdout:4/898: creat d0/dd/d6b/d92/f119 x:0 0 0 2024-09-13T21:40:55.554 INFO:tasks.workunit.client.1.smithi116.stdout:4/899: getdents d0/d32/d5d 0 2024-09-13T21:40:55.559 INFO:tasks.workunit.client.1.smithi116.stdout:4/900: write d0/dad/fd6 [1797007,45599] 0 2024-09-13T21:40:55.560 INFO:tasks.workunit.client.1.smithi116.stdout:4/901: read - d0/d56/d57/f105 zero size 2024-09-13T21:40:55.562 INFO:tasks.workunit.client.1.smithi116.stdout:4/902: rename d0/d32/da3/db7/cf6 to d0/d32/d5d/d85/c11a 0 2024-09-13T21:40:55.563 INFO:tasks.workunit.client.1.smithi116.stdout:4/903: creat d0/d32/da3/db7/f11b x:0 0 0 2024-09-13T21:40:55.563 INFO:tasks.workunit.client.1.smithi116.stdout:4/904: dread - d0/dd/d6b/d92/f119 zero size 2024-09-13T21:40:55.564 INFO:tasks.workunit.client.1.smithi116.stdout:4/905: chown d0/d56/d84/db1/ce1 10 1 2024-09-13T21:40:55.580 INFO:tasks.workunit.client.1.smithi116.stdout:4/906: dwrite d0/dd/d13/d5a/dc4/dc8/de2/fe3 [0,4194304] 0 2024-09-13T21:40:55.584 INFO:tasks.workunit.client.1.smithi116.stdout:4/907: symlink d0/d32/d5d/l11c 0 2024-09-13T21:40:55.589 INFO:tasks.workunit.client.1.smithi116.stdout:4/908: creat d0/d56/d84/f11d x:0 0 0 2024-09-13T21:40:55.590 INFO:tasks.workunit.client.1.smithi116.stdout:4/909: fdatasync d0/dd/d6b/f93 0 2024-09-13T21:40:55.590 INFO:tasks.workunit.client.1.smithi116.stdout:4/910: write d0/f39 [4654909,36995] 0 2024-09-13T21:40:55.591 INFO:tasks.workunit.client.1.smithi116.stdout:4/911: unlink d0/d56/d84/f11d 0 2024-09-13T21:40:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:55 smithi116 ceph-mon[33391]: pgmap v267: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 171 MiB/s rd, 187 MiB/s wr, 387 op/s 2024-09-13T21:40:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:55 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:55.600 INFO:tasks.workunit.client.1.smithi116.stdout:8/937: sync 2024-09-13T21:40:55.600 INFO:tasks.workunit.client.1.smithi116.stdout:9/725: sync 2024-09-13T21:40:55.600 INFO:tasks.workunit.client.1.smithi116.stdout:1/856: sync 2024-09-13T21:40:55.601 INFO:tasks.workunit.client.1.smithi116.stdout:9/726: truncate d2/d8/f33 915391 0 2024-09-13T21:40:55.602 INFO:tasks.workunit.client.1.smithi116.stdout:1/857: link d4/d23/d57/f97 d4/d23/de8/f134 0 2024-09-13T21:40:55.603 INFO:tasks.workunit.client.1.smithi116.stdout:1/858: fsync d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/fc2 0 2024-09-13T21:40:55.605 INFO:tasks.workunit.client.1.smithi116.stdout:1/859: mknod d4/d14/d52/d2f/d5c/c135 0 2024-09-13T21:40:55.607 INFO:tasks.workunit.client.1.smithi116.stdout:1/860: getdents d4/d23 0 2024-09-13T21:40:55.609 INFO:tasks.workunit.client.1.smithi116.stdout:1/861: rename d4/d14/d41/c54 to d4/d14/d52/d2f/d91/dac/c136 0 2024-09-13T21:40:55.611 INFO:tasks.workunit.client.1.smithi116.stdout:1/862: mkdir d4/d74/d8d/d5f/d137 0 2024-09-13T21:40:55.611 INFO:tasks.workunit.client.1.smithi116.stdout:1/863: read d4/d14/d52/faa [124697,1868] 0 2024-09-13T21:40:55.612 INFO:tasks.workunit.client.1.smithi116.stdout:1/864: chown d4/d14/d52/d2f/d91/dac/df0/dc0 0 1 2024-09-13T21:40:55.618 INFO:tasks.workunit.client.1.smithi116.stdout:8/938: dwrite d2/d10/d4b/d6e/fb0 [4194304,4194304] 0 2024-09-13T21:40:55.618 INFO:tasks.workunit.client.1.smithi116.stdout:8/939: creat d2/d10/d4b/f123 x:0 0 0 2024-09-13T21:40:55.618 INFO:tasks.workunit.client.1.smithi116.stdout:8/940: write d2/d10/d3e/f118 [624680,103571] 0 2024-09-13T21:40:55.619 INFO:tasks.workunit.client.1.smithi116.stdout:4/912: dwrite d0/d56/d57/f89 [0,4194304] 0 2024-09-13T21:40:55.619 INFO:tasks.workunit.client.1.smithi116.stdout:4/913: write d0/dd/d13/f41 [3601366,79267] 0 2024-09-13T21:40:55.640 INFO:tasks.workunit.client.1.smithi116.stdout:1/865: dwrite d4/d14/d2a/f42 [0,4194304] 0 2024-09-13T21:40:55.640 INFO:tasks.workunit.client.1.smithi116.stdout:1/866: write d4/f6f [2927873,18881] 0 2024-09-13T21:40:55.641 INFO:tasks.workunit.client.1.smithi116.stdout:8/941: dwrite d2/d10/d19/f84 [0,4194304] 0 2024-09-13T21:40:55.643 INFO:tasks.workunit.client.1.smithi116.stdout:1/867: unlink d4/d14/d52/d2f/d5c/dff/f102 0 2024-09-13T21:40:55.644 INFO:tasks.workunit.client.1.smithi116.stdout:8/942: truncate d2/d10/f18 1140432 0 2024-09-13T21:40:55.644 INFO:tasks.workunit.client.1.smithi116.stdout:8/943: fsync d2/d5c/fc5 0 2024-09-13T21:40:55.644 INFO:tasks.workunit.client.1.smithi116.stdout:8/944: write d2/d27/d62/fab [5099810,62849] 0 2024-09-13T21:40:55.645 INFO:tasks.workunit.client.1.smithi116.stdout:8/945: readlink d2/d10/la6 0 2024-09-13T21:40:55.645 INFO:tasks.workunit.client.1.smithi116.stdout:8/946: readlink d2/d10/d37/d64/lca 0 2024-09-13T21:40:55.645 INFO:tasks.workunit.client.1.smithi116.stdout:8/947: dread - d2/d10/d3e/da4/fa7 zero size 2024-09-13T21:40:55.645 INFO:tasks.workunit.client.1.smithi116.stdout:4/914: dwrite d0/d56/d57/ff4 [0,4194304] 0 2024-09-13T21:40:55.645 INFO:tasks.workunit.client.1.smithi116.stdout:1/868: link d4/d23/c10a d4/d14/d52/d2f/d5d/dc7/c138 0 2024-09-13T21:40:55.645 INFO:tasks.workunit.client.1.smithi116.stdout:1/869: readlink d4/d14/d2a/dd3/l113 0 2024-09-13T21:40:55.647 INFO:tasks.workunit.client.1.smithi116.stdout:8/948: mknod d2/d10/d19/d21/d69/d90/da9/c124 0 2024-09-13T21:40:55.647 INFO:tasks.workunit.client.1.smithi116.stdout:8/949: write d2/d27/d62/f104 [192555,76059] 0 2024-09-13T21:40:55.649 INFO:tasks.workunit.client.1.smithi116.stdout:4/915: mknod d0/dd/d6b/d92/d95/dc7/c11e 0 2024-09-13T21:40:55.650 INFO:tasks.workunit.client.1.smithi116.stdout:1/870: creat d4/d23/f139 x:0 0 0 2024-09-13T21:40:55.650 INFO:tasks.workunit.client.1.smithi116.stdout:1/871: rename d4/d14/d52/d2f/d91 to d4/d14/d52/d2f/d91/d13a 22 2024-09-13T21:40:55.650 INFO:tasks.workunit.client.1.smithi116.stdout:4/916: mknod d0/d32/da3/c11f 0 2024-09-13T21:40:55.652 INFO:tasks.workunit.client.1.smithi116.stdout:4/917: link d0/dd/d13/f4c d0/d56/d84/dfa/f120 0 2024-09-13T21:40:55.654 INFO:tasks.workunit.client.1.smithi116.stdout:4/918: mknod d0/dd/d7c/dfc/d117/c121 0 2024-09-13T21:40:55.658 INFO:tasks.workunit.client.1.smithi116.stdout:8/950: dread d2/d10/d3e/da4/fb2 [0,4194304] 0 2024-09-13T21:40:55.660 INFO:tasks.workunit.client.1.smithi116.stdout:8/951: mkdir d2/d10/d19/d42/df3/d125 0 2024-09-13T21:40:55.676 INFO:tasks.workunit.client.1.smithi116.stdout:8/952: read d2/d10/d19/d21/d22/d5d/d46/f7d [326799,94788] 0 2024-09-13T21:40:55.677 INFO:tasks.workunit.client.1.smithi116.stdout:8/953: rename d2/d10/d3e/le2 to d2/d10/d19/d42/df3/l126 0 2024-09-13T21:40:55.677 INFO:tasks.workunit.client.1.smithi116.stdout:1/872: dwrite d4/d74/d8d/d5f/f78 [0,4194304] 0 2024-09-13T21:40:55.678 INFO:tasks.workunit.client.1.smithi116.stdout:4/919: dwrite d0/fb6 [0,4194304] 0 2024-09-13T21:40:55.679 INFO:tasks.workunit.client.1.smithi116.stdout:1/873: getdents d4/d14/d52/d2f/d91 0 2024-09-13T21:40:55.693 INFO:tasks.workunit.client.1.smithi116.stdout:8/954: dwrite d2/d10/d19/f84 [0,4194304] 0 2024-09-13T21:40:55.695 INFO:tasks.workunit.client.1.smithi116.stdout:4/920: write d0/d32/f3e [11060610,72922] 0 2024-09-13T21:40:55.696 INFO:tasks.workunit.client.1.smithi116.stdout:1/874: dread d4/d23/d57/f65 [0,4194304] 0 2024-09-13T21:40:55.696 INFO:tasks.workunit.client.1.smithi116.stdout:1/875: creat d4/d23/f13b x:0 0 0 2024-09-13T21:40:55.696 INFO:tasks.workunit.client.1.smithi116.stdout:4/921: link d0/cdc d0/dad/de0/d107/c122 0 2024-09-13T21:40:55.698 INFO:tasks.workunit.client.1.smithi116.stdout:1/876: unlink d4/d14/d2a/cde 0 2024-09-13T21:40:55.699 INFO:tasks.workunit.client.1.smithi116.stdout:1/877: creat d4/d23/d56/da3/dc4/f13c x:0 0 0 2024-09-13T21:40:55.701 INFO:tasks.workunit.client.1.smithi116.stdout:1/878: dread d4/d23/f7c [0,4194304] 0 2024-09-13T21:40:55.704 INFO:tasks.workunit.client.1.smithi116.stdout:1/879: link d4/d14/f9c d4/d14/d52/d2f/d91/dac/f13d 0 2024-09-13T21:40:55.704 INFO:tasks.workunit.client.1.smithi116.stdout:1/880: readlink d4/le2 0 2024-09-13T21:40:55.704 INFO:tasks.workunit.client.1.smithi116.stdout:1/881: write d4/d14/f9c [4562455,100587] 0 2024-09-13T21:40:55.705 INFO:tasks.workunit.client.1.smithi116.stdout:1/882: truncate d4/d14/d52/d2f/ff4 192912 0 2024-09-13T21:40:55.705 INFO:tasks.workunit.client.1.smithi116.stdout:1/883: creat d4/d23/d57/d92/f13e x:0 0 0 2024-09-13T21:40:55.706 INFO:tasks.workunit.client.1.smithi116.stdout:4/922: write d0/d32/f3e [3732386,115019] 0 2024-09-13T21:40:55.706 INFO:tasks.workunit.client.1.smithi116.stdout:4/923: creat d0/d56/d57/f123 x:0 0 0 2024-09-13T21:40:55.708 INFO:tasks.workunit.client.1.smithi116.stdout:4/924: creat d0/dd/d13/d4e/f124 x:0 0 0 2024-09-13T21:40:55.708 INFO:tasks.workunit.client.1.smithi116.stdout:4/925: mknod d0/d56/d84/db1/c125 0 2024-09-13T21:40:55.710 INFO:tasks.workunit.client.1.smithi116.stdout:4/926: getdents d0/dd/d13 0 2024-09-13T21:40:55.710 INFO:tasks.workunit.client.1.smithi116.stdout:4/927: fsync d0/dd/d6b/d71/f10a 0 2024-09-13T21:40:55.710 INFO:tasks.workunit.client.1.smithi116.stdout:4/928: truncate d0/dd/d13/f3c 5598933 0 2024-09-13T21:40:55.711 INFO:tasks.workunit.client.1.smithi116.stdout:4/929: chown d0/dd/d13/d5a/dc4/dc8/de2/fe3 1888615107 1 2024-09-13T21:40:55.711 INFO:tasks.workunit.client.1.smithi116.stdout:4/930: mkdir d0/dd/d13/d126 0 2024-09-13T21:40:55.716 INFO:tasks.workunit.client.1.smithi116.stdout:1/884: write d4/d14/d52/d2f/d91/dac/f13d [1818290,105409] 0 2024-09-13T21:40:55.716 INFO:tasks.workunit.client.1.smithi116.stdout:8/955: dwrite d2/d10/d19/d21/d69/f8b [4194304,4194304] 0 2024-09-13T21:40:55.719 INFO:tasks.workunit.client.1.smithi116.stdout:1/885: link d4/d14/l22 d4/d23/l13f 0 2024-09-13T21:40:55.720 INFO:tasks.workunit.client.1.smithi116.stdout:8/956: symlink d2/d10/d19/d11f/l127 0 2024-09-13T21:40:55.722 INFO:tasks.workunit.client.1.smithi116.stdout:1/886: mknod d4/c140 0 2024-09-13T21:40:55.722 INFO:tasks.workunit.client.1.smithi116.stdout:1/887: fsync d4/d74/d12d/f131 0 2024-09-13T21:40:55.730 INFO:tasks.workunit.client.1.smithi116.stdout:8/957: dread d2/d10/d19/d42/d45/fdf [0,4194304] 0 2024-09-13T21:40:55.730 INFO:tasks.workunit.client.1.smithi116.stdout:8/958: fdatasync d2/d10/d19/d42/d45/fdf 0 2024-09-13T21:40:55.730 INFO:tasks.workunit.client.1.smithi116.stdout:8/959: creat d2/d10/d19/d42/d45/d87/dc1/f128 x:0 0 0 2024-09-13T21:40:55.731 INFO:tasks.workunit.client.1.smithi116.stdout:4/931: dwrite d0/d56/d84/dfa/f120 [0,4194304] 0 2024-09-13T21:40:55.733 INFO:tasks.workunit.client.1.smithi116.stdout:8/960: mkdir d2/d11b/d129 0 2024-09-13T21:40:55.733 INFO:tasks.workunit.client.1.smithi116.stdout:8/961: fdatasync d2/d10/d19/f1d 0 2024-09-13T21:40:55.733 INFO:tasks.workunit.client.1.smithi116.stdout:8/962: stat d2/d5c/lb9 0 2024-09-13T21:40:55.734 INFO:tasks.workunit.client.1.smithi116.stdout:1/888: dread d4/f10f [0,4194304] 0 2024-09-13T21:40:55.734 INFO:tasks.workunit.client.1.smithi116.stdout:1/889: readlink d4/d23/l13f 0 2024-09-13T21:40:55.734 INFO:tasks.workunit.client.1.smithi116.stdout:4/932: creat d0/dd/d13/f127 x:0 0 0 2024-09-13T21:40:55.735 INFO:tasks.workunit.client.1.smithi116.stdout:8/963: getdents d2/d5c 0 2024-09-13T21:40:55.735 INFO:tasks.workunit.client.1.smithi116.stdout:1/890: getdents d4/d14/d2a/dd3 0 2024-09-13T21:40:55.735 INFO:tasks.workunit.client.1.smithi116.stdout:1/891: stat d4/d14/d2a/ldd 0 2024-09-13T21:40:55.737 INFO:tasks.workunit.client.1.smithi116.stdout:4/933: link d0/d56/d57/f105 d0/d56/d84/db1/f128 0 2024-09-13T21:40:55.737 INFO:tasks.workunit.client.1.smithi116.stdout:4/934: fdatasync d0/dd/f70 0 2024-09-13T21:40:55.737 INFO:tasks.workunit.client.1.smithi116.stdout:8/964: truncate d2/d10/d19/d3a/d4c/fe0 2266628 0 2024-09-13T21:40:55.738 INFO:tasks.workunit.client.1.smithi116.stdout:4/935: truncate d0/dd/d13/f4f 331015 0 2024-09-13T21:40:55.741 INFO:tasks.workunit.client.1.smithi116.stdout:4/936: mkdir d0/dd/d13/d5a/dc4/d129 0 2024-09-13T21:40:55.745 INFO:tasks.workunit.client.1.smithi116.stdout:8/965: dread d2/d10/d3e/ffa [4194304,4194304] 0 2024-09-13T21:40:55.747 INFO:tasks.workunit.client.1.smithi116.stdout:8/966: unlink d2/d27/d66/dcc/dec/fef 0 2024-09-13T21:40:55.763 INFO:tasks.workunit.client.1.smithi116.stdout:1/892: dwrite d4/d74/d8d/f9a [0,4194304] 0 2024-09-13T21:40:55.764 INFO:tasks.workunit.client.1.smithi116.stdout:4/937: dwrite d0/dd/d48/fdb [0,4194304] 0 2024-09-13T21:40:55.772 INFO:tasks.workunit.client.1.smithi116.stdout:4/938: creat d0/dd/dcf/f12a x:0 0 0 2024-09-13T21:40:55.772 INFO:tasks.workunit.client.1.smithi116.stdout:1/893: dread d4/d23/f27 [0,4194304] 0 2024-09-13T21:40:55.772 INFO:tasks.workunit.client.1.smithi116.stdout:1/894: write d4/ff [3371617,47566] 0 2024-09-13T21:40:55.773 INFO:tasks.workunit.client.1.smithi116.stdout:4/939: creat d0/dd/d6b/d92/d95/ddd/f12b x:0 0 0 2024-09-13T21:40:55.793 INFO:tasks.workunit.client.1.smithi116.stdout:1/895: dwrite d4/f83 [0,4194304] 0 2024-09-13T21:40:55.794 INFO:tasks.workunit.client.1.smithi116.stdout:4/940: dwrite d0/dad/de0/f114 [0,4194304] 0 2024-09-13T21:40:55.795 INFO:tasks.workunit.client.1.smithi116.stdout:4/941: chown d0/dd/d13/lbd 1 1 2024-09-13T21:40:55.796 INFO:tasks.workunit.client.1.smithi116.stdout:1/896: mkdir d4/d23/d56/da3/dc4/d141 0 2024-09-13T21:40:55.797 INFO:tasks.workunit.client.1.smithi116.stdout:1/897: write d4/d14/d52/d2f/f4b [125674,62387] 0 2024-09-13T21:40:55.798 INFO:tasks.workunit.client.1.smithi116.stdout:4/942: rename d0/c35 to d0/d56/d84/dfa/c12c 0 2024-09-13T21:40:55.798 INFO:tasks.workunit.client.1.smithi116.stdout:4/943: readlink d0/d32/d5f/lc1 0 2024-09-13T21:40:55.798 INFO:tasks.workunit.client.1.smithi116.stdout:4/944: dread - d0/dd/d6b/d92/f119 zero size 2024-09-13T21:40:55.798 INFO:tasks.workunit.client.1.smithi116.stdout:1/898: truncate d4/d23/d57/d92/fa6 3389820 0 2024-09-13T21:40:55.807 INFO:tasks.workunit.client.1.smithi116.stdout:1/899: read d4/f37 [3609391,110737] 0 2024-09-13T21:40:55.808 INFO:tasks.workunit.client.1.smithi116.stdout:4/945: write d0/f30 [3620695,63723] 0 2024-09-13T21:40:55.808 INFO:tasks.workunit.client.1.smithi116.stdout:1/900: mknod d4/d23/d57/d101/c142 0 2024-09-13T21:40:55.808 INFO:tasks.workunit.client.1.smithi116.stdout:1/901: truncate d4/d23/d57/f97 4944708 0 2024-09-13T21:40:55.809 INFO:tasks.workunit.client.1.smithi116.stdout:4/946: creat d0/dd/d13/d5a/d7a/f12d x:0 0 0 2024-09-13T21:40:55.835 INFO:tasks.workunit.client.1.smithi116.stdout:1/902: dwrite d4/d74/d8d/f55 [0,4194304] 0 2024-09-13T21:40:55.835 INFO:tasks.workunit.client.1.smithi116.stdout:4/947: dwrite d0/dd/d13/d4e/f73 [4194304,4194304] 0 2024-09-13T21:40:55.836 INFO:tasks.workunit.client.1.smithi116.stdout:4/948: fdatasync d0/d32/da3/fca 0 2024-09-13T21:40:55.836 INFO:tasks.workunit.client.1.smithi116.stdout:1/903: creat d4/d23/d56/da3/dc4/d141/f143 x:0 0 0 2024-09-13T21:40:55.836 INFO:tasks.workunit.client.1.smithi116.stdout:1/904: chown d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/dc3/ced 16001449 1 2024-09-13T21:40:55.836 INFO:tasks.workunit.client.1.smithi116.stdout:1/905: fdatasync d4/d74/d8d/f109 0 2024-09-13T21:40:55.841 INFO:tasks.workunit.client.1.smithi116.stdout:4/949: rename d0/dd/d6b/f93 to d0/dd/d13/d5a/d7a/f12e 0 2024-09-13T21:40:55.842 INFO:tasks.workunit.client.1.smithi116.stdout:1/906: symlink d4/d74/d8d/l144 0 2024-09-13T21:40:55.843 INFO:tasks.workunit.client.1.smithi116.stdout:4/950: mknod d0/dd/d7c/c12f 0 2024-09-13T21:40:55.844 INFO:tasks.workunit.client.1.smithi116.stdout:4/951: fsync d0/fa1 0 2024-09-13T21:40:55.846 INFO:tasks.workunit.client.1.smithi116.stdout:4/952: rename d0/d32/c8a to d0/dd/d6b/d92/d99/dbc/d106/c130 0 2024-09-13T21:40:55.864 INFO:tasks.workunit.client.1.smithi116.stdout:1/907: dwrite d4/d14/d2a/df2/f11d [0,4194304] 0 2024-09-13T21:40:55.864 INFO:tasks.workunit.client.1.smithi116.stdout:4/953: dwrite d0/d32/d5d/d85/fda [0,4194304] 0 2024-09-13T21:40:55.867 INFO:tasks.workunit.client.1.smithi116.stdout:4/954: mknod d0/dd/d13/c131 0 2024-09-13T21:40:55.880 INFO:tasks.workunit.client.1.smithi116.stdout:4/955: dwrite d0/dd/d48/f9d [0,4194304] 0 2024-09-13T21:40:55.881 INFO:tasks.workunit.client.1.smithi116.stdout:4/956: dread d0/dd/d6b/d92/d95/ddd/fef [0,4194304] 0 2024-09-13T21:40:55.882 INFO:tasks.workunit.client.1.smithi116.stdout:4/957: write d0/dd/d13/d5a/dc4/f116 [888873,13455] 0 2024-09-13T21:40:55.883 INFO:tasks.workunit.client.1.smithi116.stdout:4/958: rename d0/d32/d5d/l8c to d0/d56/d84/dfa/l132 0 2024-09-13T21:40:56.013 INFO:tasks.workunit.client.1.smithi116.stdout:9/727: sync 2024-09-13T21:40:56.014 INFO:tasks.workunit.client.1.smithi116.stdout:9/728: write d2/d10/d14/f21 [7003583,70460] 0 2024-09-13T21:40:56.040 INFO:tasks.workunit.client.1.smithi116.stdout:9/729: dwrite d2/fc2 [0,4194304] 0 2024-09-13T21:40:56.042 INFO:tasks.workunit.client.1.smithi116.stdout:9/730: unlink d2/d8/d93/lbf 0 2024-09-13T21:40:56.043 INFO:tasks.workunit.client.1.smithi116.stdout:9/731: symlink d2/d5d/d69/d7d/dc8/lda 0 2024-09-13T21:40:56.043 INFO:tasks.workunit.client.1.smithi116.stdout:9/732: creat d2/d5d/fdb x:0 0 0 2024-09-13T21:40:56.189 INFO:tasks.workunit.client.1.smithi116.stdout:8/967: sync 2024-09-13T21:40:56.190 INFO:tasks.workunit.client.1.smithi116.stdout:8/968: symlink d2/d10/d19/d3a/d4c/l12a 0 2024-09-13T21:40:56.192 INFO:tasks.workunit.client.1.smithi116.stdout:8/969: rename d2/d10/d37/c40 to d2/d5c/c12b 0 2024-09-13T21:40:56.193 INFO:tasks.workunit.client.1.smithi116.stdout:8/970: symlink d2/d10/d75/l12c 0 2024-09-13T21:40:56.193 INFO:tasks.workunit.client.1.smithi116.stdout:8/971: fdatasync d2/d10/d19/d3a/f3b 0 2024-09-13T21:40:56.193 INFO:tasks.workunit.client.1.smithi116.stdout:8/972: stat d2/d10/d19/d3a/d4c/f111 0 2024-09-13T21:40:56.194 INFO:tasks.workunit.client.1.smithi116.stdout:8/973: creat d2/d27/d66/d100/d11e/f12d x:0 0 0 2024-09-13T21:40:56.198 INFO:tasks.workunit.client.1.smithi116.stdout:8/974: dread d2/d10/f18 [0,4194304] 0 2024-09-13T21:40:56.199 INFO:tasks.workunit.client.1.smithi116.stdout:8/975: creat d2/d10/d3e/f12e x:0 0 0 2024-09-13T21:40:56.199 INFO:tasks.workunit.client.1.smithi116.stdout:8/976: symlink d2/d27/d66/dcc/dec/l12f 0 2024-09-13T21:40:56.201 INFO:tasks.workunit.client.1.smithi116.stdout:8/977: creat d2/d10/d75/f130 x:0 0 0 2024-09-13T21:40:56.209 INFO:tasks.workunit.client.1.smithi116.stdout:8/978: dread d2/d10/d19/d21/d22/d5d/d46/f5b [4194304,4194304] 0 2024-09-13T21:40:56.322 INFO:tasks.workunit.client.1.smithi116.stdout:1/908: sync 2024-09-13T21:40:56.322 INFO:tasks.workunit.client.1.smithi116.stdout:4/959: sync 2024-09-13T21:40:56.323 INFO:tasks.workunit.client.1.smithi116.stdout:1/909: creat d4/d23/de8/f145 x:0 0 0 2024-09-13T21:40:56.327 INFO:tasks.workunit.client.1.smithi116.stdout:4/960: dread d0/dd/f2e [0,4194304] 0 2024-09-13T21:40:56.329 INFO:tasks.workunit.client.1.smithi116.stdout:4/961: rename d0/d56/d84/db1/c125 to d0/d56/d57/c133 0 2024-09-13T21:40:56.338 INFO:tasks.workunit.client.1.smithi116.stdout:1/910: dwrite d4/d14/d2a/f88 [0,4194304] 0 2024-09-13T21:40:56.338 INFO:tasks.workunit.client.1.smithi116.stdout:1/911: stat d4/d14/fa4 0 2024-09-13T21:40:56.339 INFO:tasks.workunit.client.1.smithi116.stdout:1/912: rmdir d4/d74/d8d/d5f 39 2024-09-13T21:40:56.340 INFO:tasks.workunit.client.1.smithi116.stdout:1/913: write d4/d14/d52/d2f/d91/ff8 [880596,113589] 0 2024-09-13T21:40:56.341 INFO:tasks.workunit.client.1.smithi116.stdout:1/914: unlink d4/d23/d56/da3/dc4/f104 0 2024-09-13T21:40:56.348 INFO:tasks.workunit.client.1.smithi116.stdout:4/962: dwrite d0/dd/d13/f1e [4194304,4194304] 0 2024-09-13T21:40:56.350 INFO:tasks.workunit.client.1.smithi116.stdout:4/963: stat d0/dd/d13/f3c 0 2024-09-13T21:40:56.350 INFO:tasks.workunit.client.1.smithi116.stdout:4/964: fsync d0/dd/f9b 0 2024-09-13T21:40:56.350 INFO:tasks.workunit.client.1.smithi116.stdout:4/965: symlink d0/dd/d6b/dee/dd5/l134 0 2024-09-13T21:40:56.351 INFO:tasks.workunit.client.1.smithi116.stdout:4/966: mknod d0/dd/dcf/c135 0 2024-09-13T21:40:56.358 INFO:tasks.workunit.client.1.smithi116.stdout:1/915: dwrite d4/d74/d8d/f67 [4194304,4194304] 0 2024-09-13T21:40:56.359 INFO:tasks.workunit.client.1.smithi116.stdout:1/916: symlink d4/d23/d56/l146 0 2024-09-13T21:40:56.359 INFO:tasks.workunit.client.1.smithi116.stdout:1/917: chown d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/fdb 230967276 1 2024-09-13T21:40:56.377 INFO:tasks.workunit.client.1.smithi116.stdout:4/967: dwrite d0/dd/d48/fdb [0,4194304] 0 2024-09-13T21:40:56.378 INFO:tasks.workunit.client.1.smithi116.stdout:4/968: mknod d0/dd/d6b/d92/d95/c136 0 2024-09-13T21:40:56.378 INFO:tasks.workunit.client.1.smithi116.stdout:1/918: dwrite d4/d23/f8f [0,4194304] 0 2024-09-13T21:40:56.380 INFO:tasks.workunit.client.1.smithi116.stdout:4/969: write d0/d32/d5f/f63 [261397,81335] 0 2024-09-13T21:40:56.380 INFO:tasks.workunit.client.1.smithi116.stdout:4/970: fsync d0/dd/d13/d5a/f65 0 2024-09-13T21:40:56.383 INFO:tasks.workunit.client.1.smithi116.stdout:4/971: symlink d0/dd/d6b/d92/d99/l137 0 2024-09-13T21:40:56.384 INFO:tasks.workunit.client.1.smithi116.stdout:4/972: truncate d0/dd/d6b/d92/d95/ddd/fef 680065 0 2024-09-13T21:40:56.384 INFO:tasks.workunit.client.1.smithi116.stdout:4/973: fdatasync d0/d56/d84/db1/fff 0 2024-09-13T21:40:56.384 INFO:tasks.workunit.client.1.smithi116.stdout:4/974: creat d0/dd/d13/d5a/d7a/f138 x:0 0 0 2024-09-13T21:40:56.386 INFO:tasks.workunit.client.1.smithi116.stdout:4/975: getdents d0/dd/d13/d5a/dc4/dc8/de2 0 2024-09-13T21:40:56.387 INFO:tasks.workunit.client.1.smithi116.stdout:4/976: mkdir d0/d56/d57/d139 0 2024-09-13T21:40:56.395 INFO:tasks.workunit.client.1.smithi116.stdout:1/919: dwrite d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/fe6 [0,4194304] 0 2024-09-13T21:40:56.396 INFO:tasks.workunit.client.1.smithi116.stdout:4/977: write d0/dd/d13/f1e [8123316,40520] 0 2024-09-13T21:40:56.396 INFO:tasks.workunit.client.1.smithi116.stdout:1/920: truncate d4/d23/d57/fa1 680795 0 2024-09-13T21:40:56.396 INFO:tasks.workunit.client.1.smithi116.stdout:1/921: fdatasync d4/d14/d52/d2f/ff4 0 2024-09-13T21:40:56.396 INFO:tasks.workunit.client.1.smithi116.stdout:1/922: chown d4/d14/d2a/df2 68083113 1 2024-09-13T21:40:56.397 INFO:tasks.workunit.client.1.smithi116.stdout:4/978: unlink d0/d56/d84/db1/ce1 0 2024-09-13T21:40:56.397 INFO:tasks.workunit.client.1.smithi116.stdout:4/979: truncate d0/d32/da3/db7/fe6 4639486 0 2024-09-13T21:40:56.398 INFO:tasks.workunit.client.1.smithi116.stdout:4/980: mknod d0/dd/d7c/ddf/c13a 0 2024-09-13T21:40:56.401 INFO:tasks.workunit.client.1.smithi116.stdout:4/981: rename d0/dd/d7c/ddf/c13a to d0/dd/d6b/d92/d95/ddd/c13b 0 2024-09-13T21:40:56.401 INFO:tasks.workunit.client.1.smithi116.stdout:4/982: fsync d0/d32/d5f/f82 0 2024-09-13T21:40:56.402 INFO:tasks.workunit.client.1.smithi116.stdout:4/983: getdents d0/d32/da3 0 2024-09-13T21:40:56.402 INFO:tasks.workunit.client.1.smithi116.stdout:4/984: fsync d0/d56/d57/ff4 0 2024-09-13T21:40:56.403 INFO:tasks.workunit.client.1.smithi116.stdout:4/985: mkdir d0/dd/d6b/d92/d99/dbc/d13c 0 2024-09-13T21:40:56.405 INFO:tasks.workunit.client.1.smithi116.stdout:4/986: mkdir d0/dd/d13/d5a/d13d 0 2024-09-13T21:40:56.406 INFO:tasks.workunit.client.1.smithi116.stdout:4/987: chown d0/d56/d57 6999 1 2024-09-13T21:40:56.407 INFO:tasks.workunit.client.1.smithi116.stdout:4/988: mkdir d0/dd/d6b/d92/d95/dc7/d13e 0 2024-09-13T21:40:56.410 INFO:tasks.workunit.client.1.smithi116.stdout:4/989: rename d0/dd/dcf to d0/d56/d84/dfa/d13f 0 2024-09-13T21:40:56.411 INFO:tasks.workunit.client.1.smithi116.stdout:4/990: write d0/dd/d13/d5a/d7a/f12e [25126,17984] 0 2024-09-13T21:40:56.412 INFO:tasks.workunit.client.1.smithi116.stdout:4/991: mknod d0/dd/d13/d5a/dc4/d129/c140 0 2024-09-13T21:40:56.412 INFO:tasks.workunit.client.1.smithi116.stdout:4/992: chown d0/d56/d84 31104 1 2024-09-13T21:40:56.413 INFO:tasks.workunit.client.1.smithi116.stdout:4/993: creat d0/d32/d5d/f141 x:0 0 0 2024-09-13T21:40:56.414 INFO:tasks.workunit.client.1.smithi116.stdout:4/994: rename d0/d56/d84/dfa/c12c to d0/dd/d6b/d92/d99/c142 0 2024-09-13T21:40:56.414 INFO:tasks.workunit.client.1.smithi116.stdout:1/923: dwrite d4/d14/d2a/f42 [0,4194304] 0 2024-09-13T21:40:56.415 INFO:tasks.workunit.client.1.smithi116.stdout:1/924: write d4/d74/d8d/f67 [1848854,89871] 0 2024-09-13T21:40:56.415 INFO:tasks.workunit.client.1.smithi116.stdout:4/995: symlink d0/dd/d6b/d92/l143 0 2024-09-13T21:40:56.415 INFO:tasks.workunit.client.1.smithi116.stdout:4/996: chown d0/d56/l10f 1401077 1 2024-09-13T21:40:56.420 INFO:tasks.workunit.client.1.smithi116.stdout:1/925: unlink d4/d23/de8/f134 0 2024-09-13T21:40:56.421 INFO:tasks.workunit.client.1.smithi116.stdout:1/926: mkdir d4/d23/d57/d101/d147 0 2024-09-13T21:40:56.422 INFO:tasks.workunit.client.1.smithi116.stdout:4/997: getdents d0/dd/d13/d4e 0 2024-09-13T21:40:56.424 INFO:tasks.workunit.client.1.smithi116.stdout:1/927: mknod d4/d23/d56/de4/c148 0 2024-09-13T21:40:56.424 INFO:tasks.workunit.client.1.smithi116.stdout:1/928: write d4/f83 [5057388,93155] 0 2024-09-13T21:40:56.424 INFO:tasks.workunit.client.1.smithi116.stdout:1/929: write d4/d14/d52/d2f/d91/ff8 [22342,2325] 0 2024-09-13T21:40:56.424 INFO:tasks.workunit.client.1.smithi116.stdout:1/930: mknod d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/c149 0 2024-09-13T21:40:56.426 INFO:tasks.workunit.client.1.smithi116.stdout:1/931: mkdir d4/d23/d57/d101/d147/d14a 0 2024-09-13T21:40:56.426 INFO:tasks.workunit.client.1.smithi116.stdout:1/932: write d4/d14/d52/d2f/d5d/f120 [810055,91263] 0 2024-09-13T21:40:56.428 INFO:tasks.workunit.client.1.smithi116.stdout:1/933: truncate d4/d14/d52/d2f/d5d/f11a 1180334 0 2024-09-13T21:40:56.429 INFO:tasks.workunit.client.1.smithi116.stdout:1/934: getdents d4/d14/d52/d2f/d5d/d90 0 2024-09-13T21:40:56.432 INFO:tasks.workunit.client.1.smithi116.stdout:1/935: getdents d4/d23/d56/de4 0 2024-09-13T21:40:56.433 INFO:tasks.workunit.client.1.smithi116.stdout:1/936: write d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/fc2 [2139243,30149] 0 2024-09-13T21:40:56.435 INFO:tasks.workunit.client.1.smithi116.stdout:1/937: creat d4/d23/d56/da3/f14b x:0 0 0 2024-09-13T21:40:56.435 INFO:tasks.workunit.client.1.smithi116.stdout:9/733: sync 2024-09-13T21:40:56.436 INFO:tasks.workunit.client.1.smithi116.stdout:9/734: mkdir d2/d8/d93/da0/dcd/ddc 0 2024-09-13T21:40:56.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/735: link d2/d10/la6 d2/d8/d93/da0/dcd/ldd 0 2024-09-13T21:40:56.437 INFO:tasks.workunit.client.1.smithi116.stdout:9/736: truncate d2/d5d/d69/d47/f7b 560790 0 2024-09-13T21:40:56.438 INFO:tasks.workunit.client.1.smithi116.stdout:4/998: dwrite d0/d56/d84/dfa/d13f/f12a [0,4194304] 0 2024-09-13T21:40:56.438 INFO:tasks.workunit.client.1.smithi116.stdout:4/999: fsync d0/dd/d13/d5a/d7a/ff5 0 2024-09-13T21:40:56.439 INFO:tasks.workunit.client.1.smithi116.stdout:9/737: write d2/d8/d3e/f4d [115364,106018] 0 2024-09-13T21:40:56.440 INFO:tasks.workunit.client.1.smithi116.stdout:9/738: dread d2/d8/f33 [0,4194304] 0 2024-09-13T21:40:56.443 INFO:tasks.workunit.client.1.smithi116.stdout:9/739: mkdir d2/d8/d93/da0/dcd/dde 0 2024-09-13T21:40:56.453 INFO:tasks.workunit.client.1.smithi116.stdout:8/979: sync 2024-09-13T21:40:56.454 INFO:tasks.workunit.client.1.smithi116.stdout:1/938: dwrite f1 [0,4194304] 0 2024-09-13T21:40:56.454 INFO:tasks.workunit.client.1.smithi116.stdout:8/980: mknod d2/d10/d19/d21/d69/d9e/c131 0 2024-09-13T21:40:56.456 INFO:tasks.workunit.client.1.smithi116.stdout:8/981: creat d2/d11b/f132 x:0 0 0 2024-09-13T21:40:56.457 INFO:tasks.workunit.client.1.smithi116.stdout:8/982: mknod d2/d10/d4b/de7/c133 0 2024-09-13T21:40:56.458 INFO:tasks.workunit.client.1.smithi116.stdout:8/983: getdents d2/d10/d3e/da4 0 2024-09-13T21:40:56.469 INFO:tasks.workunit.client.1.smithi116.stdout:9/740: dwrite d2/d43/f91 [0,4194304] 0 2024-09-13T21:40:56.469 INFO:tasks.workunit.client.1.smithi116.stdout:9/741: chown d2/f53 569643 1 2024-09-13T21:40:56.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/742: link d2/d10/la6 d2/d8/d93/da0/dcd/dde/ldf 0 2024-09-13T21:40:56.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/743: write d2/d10/d4c/f4e [561580,107509] 0 2024-09-13T21:40:56.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/744: write d2/d8/f76 [596158,79815] 0 2024-09-13T21:40:56.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/745: creat d2/d5d/d69/fe0 x:0 0 0 2024-09-13T21:40:56.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/746: chown d2/d10/d14/d38/d3a/f6c 60 1 2024-09-13T21:40:56.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/747: fdatasync d2/d8/d3e/f56 0 2024-09-13T21:40:56.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/748: chown d2/d5d/d69/fa9 16009 1 2024-09-13T21:40:56.471 INFO:tasks.workunit.client.1.smithi116.stdout:9/749: getdents d2/d5d/d69/d7d/dc8/dd2 0 2024-09-13T21:40:56.489 INFO:tasks.workunit.client.1.smithi116.stdout:9/750: dwrite d2/f53 [0,4194304] 0 2024-09-13T21:40:56.509 INFO:tasks.workunit.client.1.smithi116.stdout:9/751: dwrite d2/d5d/d69/fa9 [0,4194304] 0 2024-09-13T21:40:56.512 INFO:tasks.workunit.client.1.smithi116.stdout:9/752: rmdir d2/d10/d4c/d98 39 2024-09-13T21:40:56.513 INFO:tasks.workunit.client.1.smithi116.stdout:9/753: mknod d2/d5d/d8f/db4/ce1 0 2024-09-13T21:40:56.527 INFO:tasks.workunit.client.1.smithi116.stdout:9/754: dwrite d2/d5d/d69/fe0 [0,4194304] 0 2024-09-13T21:40:56.534 INFO:tasks.workunit.client.1.smithi116.stdout:9/755: write d2/d8/d3e/f56 [1710543,51853] 0 2024-09-13T21:40:56.548 INFO:tasks.workunit.client.1.smithi116.stdout:9/756: dwrite d2/d5d/d8f/db4/fce [0,4194304] 0 2024-09-13T21:40:56.551 INFO:tasks.workunit.client.1.smithi116.stdout:9/757: link d2/c34 d2/d10/d4c/ce2 0 2024-09-13T21:40:56.552 INFO:tasks.workunit.client.1.smithi116.stdout:9/758: mknod d2/d10/ce3 0 2024-09-13T21:40:56.552 INFO:tasks.workunit.client.1.smithi116.stdout:9/759: fsync d2/d10/d6e/fc1 0 2024-09-13T21:40:56.553 INFO:tasks.workunit.client.1.smithi116.stdout:9/760: symlink d2/d5d/d69/d7d/dc8/le4 0 2024-09-13T21:40:56.553 INFO:tasks.workunit.client.1.smithi116.stdout:9/761: stat d2/d8/d3e/f56 0 2024-09-13T21:40:56.554 INFO:tasks.workunit.client.1.smithi116.stdout:9/762: symlink d2/d8/d3e/dae/le5 0 2024-09-13T21:40:56.554 INFO:tasks.workunit.client.1.smithi116.stdout:9/763: truncate d2/d10/d4c/d98/fb9 502259 0 2024-09-13T21:40:56.554 INFO:tasks.workunit.client.1.smithi116.stdout:9/764: mkdir d2/d72/de6 0 2024-09-13T21:40:56.560 INFO:tasks.workunit.client.1.smithi116.stdout:9/765: rmdir d2/d5d 39 2024-09-13T21:40:56.561 INFO:tasks.workunit.client.1.smithi116.stdout:9/766: mkdir d2/d8/d93/da0/dcd/dde/de7 0 2024-09-13T21:40:56.561 INFO:tasks.workunit.client.1.smithi116.stdout:9/767: fdatasync d2/d10/d6e/f7f 0 2024-09-13T21:40:56.580 INFO:tasks.workunit.client.1.smithi116.stdout:9/768: dwrite d2/d8/fd [0,4194304] 0 2024-09-13T21:40:56.580 INFO:tasks.workunit.client.1.smithi116.stdout:9/769: readlink d2/d10/la6 0 2024-09-13T21:40:56.581 INFO:tasks.workunit.client.1.smithi116.stdout:9/770: link d2/f5f d2/d10/d4c/fe8 0 2024-09-13T21:40:56.604 INFO:tasks.workunit.client.1.smithi116.stdout:9/771: dwrite d2/d8/d93/fd8 [0,4194304] 0 2024-09-13T21:40:56.611 INFO:tasks.workunit.client.1.smithi116.stdout:9/772: dread d2/d5d/d69/fe0 [0,4194304] 0 2024-09-13T21:40:56.620 INFO:tasks.workunit.client.1.smithi116.stdout:9/773: dread d2/d10/f52 [0,4194304] 0 2024-09-13T21:40:56.621 INFO:tasks.workunit.client.1.smithi116.stdout:9/774: unlink d2/d43/fb0 0 2024-09-13T21:40:56.622 INFO:tasks.workunit.client.1.smithi116.stdout:9/775: mknod d2/d10/d6e/ce9 0 2024-09-13T21:40:56.622 INFO:tasks.workunit.client.1.smithi116.stdout:9/776: read d2/d10/d14/f44 [2506657,126939] 0 2024-09-13T21:40:56.630 INFO:tasks.workunit.client.1.smithi116.stdout:9/777: write d2/d5d/d69/d47/fd3 [4065204,118856] 0 2024-09-13T21:40:56.631 INFO:tasks.workunit.client.1.smithi116.stdout:9/778: chown d2/d10/d4c/f4e 595957 1 2024-09-13T21:40:56.631 INFO:tasks.workunit.client.1.smithi116.stdout:9/779: readlink d2/l3b 0 2024-09-13T21:40:56.631 INFO:tasks.workunit.client.1.smithi116.stdout:9/780: chown d2/d5d/d8f 704 1 2024-09-13T21:40:56.638 INFO:tasks.workunit.client.1.smithi116.stdout:9/781: write d2/d10/d14/fba [2982599,81508] 0 2024-09-13T21:40:56.639 INFO:tasks.workunit.client.1.smithi116.stdout:9/782: stat d2/d10/fcf 0 2024-09-13T21:40:56.657 INFO:tasks.workunit.client.1.smithi116.stdout:9/783: dwrite d2/d10/d4c/fe8 [0,4194304] 0 2024-09-13T21:40:56.659 INFO:tasks.workunit.client.1.smithi116.stdout:9/784: link d2/d8/d3e/l42 d2/d8/d93/da0/dcd/dde/lea 0 2024-09-13T21:40:56.660 INFO:tasks.workunit.client.1.smithi116.stdout:9/785: fdatasync d2/d5d/d69/d7d/f9f 0 2024-09-13T21:40:56.660 INFO:tasks.workunit.client.1.smithi116.stdout:9/786: readlink d2/d8/d3e/l42 0 2024-09-13T21:40:56.661 INFO:tasks.workunit.client.1.smithi116.stdout:9/787: symlink d2/d10/d14/d38/d3a/leb 0 2024-09-13T21:40:56.661 INFO:tasks.workunit.client.1.smithi116.stdout:9/788: chown d2/d5d/d69/d47/lbc 5 1 2024-09-13T21:40:56.663 INFO:tasks.workunit.client.1.smithi116.stdout:9/789: link d2/d8/l73 d2/d8/d3e/dae/lec 0 2024-09-13T21:40:56.663 INFO:tasks.workunit.client.1.smithi116.stdout:9/790: chown d2/d10/d4c/d98/fb9 1 1 2024-09-13T21:40:56.674 INFO:tasks.workunit.client.1.smithi116.stdout:9/791: dwrite d2/d10/fcf [0,4194304] 0 2024-09-13T21:40:56.676 INFO:tasks.workunit.client.1.smithi116.stdout:9/792: symlink d2/d5d/d69/d7d/led 0 2024-09-13T21:40:56.676 INFO:tasks.workunit.client.1.smithi116.stdout:9/793: chown d2/d10/d14/fba 780959253 1 2024-09-13T21:40:56.676 INFO:tasks.workunit.client.1.smithi116.stdout:9/794: fsync d2/d10/d14/d38/d3a/f6c 0 2024-09-13T21:40:56.677 INFO:tasks.workunit.client.1.smithi116.stdout:9/795: mkdir d2/d8/d3e/dae/dee 0 2024-09-13T21:40:56.705 INFO:tasks.workunit.client.1.smithi116.stdout:9/796: dwrite d2/d72/fbb [0,4194304] 0 2024-09-13T21:40:56.705 INFO:tasks.workunit.client.1.smithi116.stdout:9/797: rmdir d2/d8/d93/da0/dcd/dde 39 2024-09-13T21:40:56.705 INFO:tasks.workunit.client.1.smithi116.stdout:9/798: creat d2/d10/d14/d38/fef x:0 0 0 2024-09-13T21:40:56.706 INFO:tasks.workunit.client.1.smithi116.stdout:9/799: creat d2/d5d/d8f/ff0 x:0 0 0 2024-09-13T21:40:56.706 INFO:tasks.workunit.client.1.smithi116.stdout:9/800: write d2/d5d/fdb [212369,124408] 0 2024-09-13T21:40:56.713 INFO:tasks.workunit.client.1.smithi116.stdout:8/984: sync 2024-09-13T21:40:56.713 INFO:tasks.workunit.client.1.smithi116.stdout:1/939: sync 2024-09-13T21:40:56.713 INFO:tasks.workunit.client.1.smithi116.stdout:1/940: chown d4/c5 28 1 2024-09-13T21:40:56.718 INFO:tasks.workunit.client.1.smithi116.stdout:9/801: dread d2/d10/d4c/f7a [0,4194304] 0 2024-09-13T21:40:56.724 INFO:tasks.workunit.client.1.smithi116.stdout:9/802: dread d2/d72/f79 [0,4194304] 0 2024-09-13T21:40:56.724 INFO:tasks.workunit.client.1.smithi116.stdout:9/803: readlink d2/d10/d4c/d98/dad/lb7 0 2024-09-13T21:40:56.726 INFO:tasks.workunit.client.1.smithi116.stdout:1/941: dread d4/d23/fbc [0,4194304] 0 2024-09-13T21:40:56.729 INFO:tasks.workunit.client.1.smithi116.stdout:8/985: write d2/d27/d62/f7b [1601622,27510] 0 2024-09-13T21:40:56.729 INFO:tasks.workunit.client.1.smithi116.stdout:8/986: truncate d2/d27/d62/f104 525746 0 2024-09-13T21:40:56.730 INFO:tasks.workunit.client.1.smithi116.stdout:8/987: mkdir d2/d10/d19/d134 0 2024-09-13T21:40:56.733 INFO:tasks.workunit.client.1.smithi116.stdout:8/988: rename d2/d10/d4b/de7/c133 to d2/d10/d19/c135 0 2024-09-13T21:40:56.735 INFO:tasks.workunit.client.1.smithi116.stdout:8/989: mknod d2/d10/d19/d11f/c136 0 2024-09-13T21:40:56.735 INFO:tasks.workunit.client.1.smithi116.stdout:8/990: readlink d2/d10/d19/d21/d22/l36 0 2024-09-13T21:40:56.735 INFO:tasks.workunit.client.1.smithi116.stdout:8/991: write d2/d10/d3e/da4/fb2 [3579455,39638] 0 2024-09-13T21:40:56.737 INFO:tasks.workunit.client.1.smithi116.stdout:8/992: unlink d2/d10/d19/d11f/l11d 0 2024-09-13T21:40:56.738 INFO:tasks.workunit.client.1.smithi116.stdout:1/942: write d4/d14/d52/d2f/d5d/d90/f93 [3146889,40903] 0 2024-09-13T21:40:56.738 INFO:tasks.workunit.client.1.smithi116.stdout:1/943: fsync d4/d14/f48 0 2024-09-13T21:40:56.738 INFO:tasks.workunit.client.1.smithi116.stdout:8/993: creat d2/d10/d37/d64/f137 x:0 0 0 2024-09-13T21:40:56.739 INFO:tasks.workunit.client.1.smithi116.stdout:1/944: mkdir d4/d14/d52/d133/d14c 0 2024-09-13T21:40:56.740 INFO:tasks.workunit.client.1.smithi116.stdout:8/994: symlink d2/d10/d19/d42/l138 0 2024-09-13T21:40:56.740 INFO:tasks.workunit.client.1.smithi116.stdout:8/995: fdatasync d2/d10/d4b/f123 0 2024-09-13T21:40:56.740 INFO:tasks.workunit.client.1.smithi116.stdout:8/996: getdents d2/d27/d62 0 2024-09-13T21:40:56.742 INFO:tasks.workunit.client.1.smithi116.stdout:8/997: rename d2/d10/d19/d42/l138 to d2/d11b/d129/l139 0 2024-09-13T21:40:56.744 INFO:tasks.workunit.client.1.smithi116.stdout:1/945: dread d4/d14/f24 [0,4194304] 0 2024-09-13T21:40:56.744 INFO:tasks.workunit.client.1.smithi116.stdout:1/946: fdatasync d4/d23/f139 0 2024-09-13T21:40:56.746 INFO:tasks.workunit.client.1.smithi116.stdout:1/947: rename d4/d74/d8d/d5f/f11b to d4/d14/d2a/df2/df3/f14d 0 2024-09-13T21:40:56.746 INFO:tasks.workunit.client.1.smithi116.stdout:1/948: creat d4/d14/d41/dab/f14e x:0 0 0 2024-09-13T21:40:56.747 INFO:tasks.workunit.client.1.smithi116.stdout:9/804: dwrite d2/d5d/d69/f92 [0,4194304] 0 2024-09-13T21:40:56.747 INFO:tasks.workunit.client.1.smithi116.stdout:9/805: dread - d2/d10/d6e/fc1 zero size 2024-09-13T21:40:56.747 INFO:tasks.workunit.client.1.smithi116.stdout:9/806: truncate d2/d5d/d69/fc9 121813 0 2024-09-13T21:40:56.747 INFO:tasks.workunit.client.1.smithi116.stdout:1/949: rmdir d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/dc3 39 2024-09-13T21:40:56.748 INFO:tasks.workunit.client.1.smithi116.stdout:1/950: read d4/d14/f48 [3078534,1545] 0 2024-09-13T21:40:56.750 INFO:tasks.workunit.client.1.smithi116.stdout:1/951: creat d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/db9/f14f x:0 0 0 2024-09-13T21:40:56.768 INFO:tasks.workunit.client.1.smithi116.stdout:8/998: dwrite d2/d10/d3e/f118 [0,4194304] 0 2024-09-13T21:40:56.768 INFO:tasks.workunit.client.1.smithi116.stdout:8/999: truncate d2/d10/d19/d42/f8e 422542 0 2024-09-13T21:40:56.768 INFO:tasks.workunit.client.1.smithi116.stdout:1/952: dwrite d4/d14/d52/d2f/d91/dac/ff5 [4194304,4194304] 0 2024-09-13T21:40:56.770 INFO:tasks.workunit.client.1.smithi116.stdout:1/953: mkdir d4/d14/d52/d2f/d91/dac/df0/d150 0 2024-09-13T21:40:56.771 INFO:tasks.workunit.client.1.smithi116.stdout:1/954: link d4/d14/f1d d4/d74/d8d/f151 0 2024-09-13T21:40:56.772 INFO:tasks.workunit.client.1.smithi116.stdout:1/955: getdents d4/d14/d52/d2f/d91/dac/df0/dc0 0 2024-09-13T21:40:56.776 INFO:tasks.workunit.client.1.smithi116.stdout:1/956: dread d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/fc2 [0,4194304] 0 2024-09-13T21:40:56.778 INFO:tasks.workunit.client.1.smithi116.stdout:1/957: link d4/d14/c6c d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/dc3/c152 0 2024-09-13T21:40:56.792 INFO:tasks.workunit.client.1.smithi116.stdout:1/958: dwrite d4/d23/d57/f65 [0,4194304] 0 2024-09-13T21:40:56.792 INFO:tasks.workunit.client.1.smithi116.stdout:1/959: write d4/d14/d52/d2f/f4b [1251297,95222] 0 2024-09-13T21:40:56.793 INFO:tasks.workunit.client.1.smithi116.stdout:1/960: rename d4/d74/d8d/f55 to d4/d74/d8d/f153 0 2024-09-13T21:40:56.794 INFO:tasks.workunit.client.1.smithi116.stdout:1/961: chown d4/d14/d52/d2f/d91/dac/fdf 20 1 2024-09-13T21:40:56.801 INFO:tasks.workunit.client.1.smithi116.stdout:1/962: read d4/d74/d8d/f151 [3228723,43939] 0 2024-09-13T21:40:56.801 INFO:tasks.workunit.client.1.smithi116.stdout:1/963: dread - d4/d14/f114 zero size 2024-09-13T21:40:56.801 INFO:tasks.workunit.client.1.smithi116.stdout:1/964: truncate d4/d23/f13b 454340 0 2024-09-13T21:40:56.810 INFO:tasks.workunit.client.1.smithi116.stdout:1/965: dread d4/d14/f4f [0,4194304] 0 2024-09-13T21:40:56.810 INFO:tasks.workunit.client.1.smithi116.stdout:1/966: chown d4/ff 70933407 1 2024-09-13T21:40:56.811 INFO:tasks.workunit.client.1.smithi116.stdout:1/967: mkdir d4/d14/d52/d2f/d5d/d90/d154 0 2024-09-13T21:40:56.812 INFO:tasks.workunit.client.1.smithi116.stdout:1/968: rmdir d4/d14/d52/d133/d14c 0 2024-09-13T21:40:56.832 INFO:tasks.workunit.client.1.smithi116.stdout:1/969: dwrite d4/d23/f13b [0,4194304] 0 2024-09-13T21:40:56.961 INFO:tasks.workunit.client.1.smithi116.stdout:9/807: sync 2024-09-13T21:40:56.961 INFO:tasks.workunit.client.1.smithi116.stdout:9/808: stat d2/d8/l9c 0 2024-09-13T21:40:56.962 INFO:tasks.workunit.client.1.smithi116.stdout:9/809: write d2/d5d/d69/d7d/f9f [1610159,25697] 0 2024-09-13T21:40:56.962 INFO:tasks.workunit.client.1.smithi116.stdout:9/810: symlink d2/lf1 0 2024-09-13T21:40:56.962 INFO:tasks.workunit.client.1.smithi116.stdout:9/811: readlink d2/d8/l16 0 2024-09-13T21:40:56.978 INFO:tasks.workunit.client.1.smithi116.stdout:9/812: dwrite d2/d10/fb6 [0,4194304] 0 2024-09-13T21:40:56.978 INFO:tasks.workunit.client.1.smithi116.stdout:9/813: read d2/d8/f9e [111715,12604] 0 2024-09-13T21:40:56.994 INFO:tasks.workunit.client.1.smithi116.stdout:9/814: dwrite d2/d10/d14/fba [0,4194304] 0 2024-09-13T21:40:56.995 INFO:tasks.workunit.client.1.smithi116.stdout:9/815: creat d2/d5d/d69/d47/ff2 x:0 0 0 2024-09-13T21:40:56.995 INFO:tasks.workunit.client.1.smithi116.stdout:9/816: mkdir d2/d8/d3e/dae/dee/df3 0 2024-09-13T21:40:56.996 INFO:tasks.workunit.client.1.smithi116.stdout:9/817: mknod d2/d5d/d8f/db4/cf4 0 2024-09-13T21:40:56.997 INFO:tasks.workunit.client.1.smithi116.stdout:9/818: symlink d2/d43/lf5 0 2024-09-13T21:40:56.998 INFO:tasks.workunit.client.1.smithi116.stdout:9/819: rename d2/d8/f33 to d2/d8/d93/da0/dcd/dde/ff6 0 2024-09-13T21:40:56.999 INFO:tasks.workunit.client.1.smithi116.stdout:9/820: stat d2/d5d/d69/c74 0 2024-09-13T21:40:56.999 INFO:tasks.workunit.client.1.smithi116.stdout:9/821: fdatasync d2/d10/d6e/f7f 0 2024-09-13T21:40:56.999 INFO:tasks.workunit.client.1.smithi116.stdout:9/822: creat d2/d5d/d8f/ff7 x:0 0 0 2024-09-13T21:40:57.014 INFO:tasks.workunit.client.1.smithi116.stdout:9/823: dwrite d2/d10/d6e/fcc [0,4194304] 0 2024-09-13T21:40:57.014 INFO:tasks.workunit.client.1.smithi116.stdout:9/824: write d2/d8/d3e/f56 [1420372,117162] 0 2024-09-13T21:40:57.015 INFO:tasks.workunit.client.1.smithi116.stdout:9/825: symlink d2/d5d/d8f/db4/lf8 0 2024-09-13T21:40:57.016 INFO:tasks.workunit.client.1.smithi116.stdout:9/826: unlink d2/d10/d4c/c7e 0 2024-09-13T21:40:57.024 INFO:tasks.workunit.client.1.smithi116.stdout:9/827: dread d2/d10/f32 [0,4194304] 0 2024-09-13T21:40:57.025 INFO:tasks.workunit.client.1.smithi116.stdout:9/828: mknod d2/d8/d93/da0/cf9 0 2024-09-13T21:40:57.026 INFO:tasks.workunit.client.1.smithi116.stdout:9/829: creat d2/d8/d93/da0/dcd/dde/ffa x:0 0 0 2024-09-13T21:40:57.035 INFO:tasks.workunit.client.1.smithi116.stdout:9/830: dread d2/fc2 [0,4194304] 0 2024-09-13T21:40:57.036 INFO:tasks.workunit.client.1.smithi116.stdout:9/831: getdents d2/d10/d4c 0 2024-09-13T21:40:57.037 INFO:tasks.workunit.client.1.smithi116.stdout:1/970: sync 2024-09-13T21:40:57.037 INFO:tasks.workunit.client.1.smithi116.stdout:9/832: mknod d2/d5d/cfb 0 2024-09-13T21:40:57.039 INFO:tasks.workunit.client.1.smithi116.stdout:9/833: dread d2/d5d/f62 [0,4194304] 0 2024-09-13T21:40:57.040 INFO:tasks.workunit.client.1.smithi116.stdout:9/834: dread d2/d10/d4c/f4e [0,4194304] 0 2024-09-13T21:40:57.042 INFO:tasks.workunit.client.1.smithi116.stdout:9/835: creat d2/d8/d3e/dae/dee/df3/ffc x:0 0 0 2024-09-13T21:40:57.042 INFO:tasks.workunit.client.1.smithi116.stdout:9/836: chown d2/d72/f96 228129954 1 2024-09-13T21:40:57.042 INFO:tasks.workunit.client.1.smithi116.stdout:9/837: dread - d2/d5d/d69/d7d/dc8/fcb zero size 2024-09-13T21:40:57.042 INFO:tasks.workunit.client.1.smithi116.stdout:9/838: readlink d2/d10/d4c/d98/dad/lb7 0 2024-09-13T21:40:57.047 INFO:tasks.workunit.client.1.smithi116.stdout:1/971: dread d4/d23/d57/f65 [0,4194304] 0 2024-09-13T21:40:57.048 INFO:tasks.workunit.client.1.smithi116.stdout:1/972: mkdir d4/d23/de8/d155 0 2024-09-13T21:40:57.049 INFO:tasks.workunit.client.1.smithi116.stdout:1/973: link d4/d74/d8d/d5f/dd4/l121 d4/d23/de8/d155/l156 0 2024-09-13T21:40:57.049 INFO:tasks.workunit.client.1.smithi116.stdout:1/974: stat d4/d74/d8d/d5f/f119 0 2024-09-13T21:40:57.050 INFO:tasks.workunit.client.1.smithi116.stdout:1/975: rename d4/d14/d52/d2f/d91/dac/df0/dc0/d12a/dc3 to d4/d23/d57/d92/d157 0 2024-09-13T21:40:57.051 INFO:tasks.workunit.client.1.smithi116.stdout:1/976: truncate d4/d14/d52/f3b 228492 0 2024-09-13T21:40:57.051 INFO:tasks.workunit.client.1.smithi116.stdout:1/977: read d4/d14/f4f [3515470,12823] 0 2024-09-13T21:40:57.051 INFO:tasks.workunit.client.1.smithi116.stdout:1/978: dread - d4/d23/d57/fd7 zero size 2024-09-13T21:40:57.051 INFO:tasks.workunit.client.1.smithi116.stdout:1/979: mknod d4/d14/d2a/dd3/d100/c158 0 2024-09-13T21:40:57.053 INFO:tasks.workunit.client.1.smithi116.stdout:1/980: link d4/d14/lb2 d4/d23/d56/da3/dc4/d141/l159 0 2024-09-13T21:40:57.053 INFO:tasks.workunit.client.1.smithi116.stdout:1/981: getdents d4/d23/d57/d101 0 2024-09-13T21:40:57.053 INFO:tasks.workunit.client.1.smithi116.stdout:1/982: write d4/d74/fea [590179,54789] 0 2024-09-13T21:40:57.058 INFO:tasks.workunit.client.1.smithi116.stdout:9/839: dwrite d2/d10/fb3 [0,4194304] 0 2024-09-13T21:40:57.058 INFO:tasks.workunit.client.1.smithi116.stdout:9/840: write d2/d5d/f62 [1261115,1520] 0 2024-09-13T21:40:57.059 INFO:tasks.workunit.client.1.smithi116.stdout:9/841: read d2/d10/d14/d38/f4f [894843,35093] 0 2024-09-13T21:40:57.061 INFO:tasks.workunit.client.1.smithi116.stdout:9/842: rename d2/d43/fd0 to d2/d8/ffd 0 2024-09-13T21:40:57.061 INFO:tasks.workunit.client.1.smithi116.stdout:9/843: chown d2/lf1 31 1 2024-09-13T21:40:57.062 INFO:tasks.workunit.client.1.smithi116.stdout:9/844: rename d2/f5f to d2/d8/d93/da0/dcd/ffe 0 2024-09-13T21:40:57.064 INFO:tasks.workunit.client.1.smithi116.stdout:9/845: rename d2/d10/fb3 to d2/d72/de6/fff 0 2024-09-13T21:40:57.064 INFO:tasks.workunit.client.1.smithi116.stdout:9/846: creat d2/d8/d3e/dae/dee/df3/f100 x:0 0 0 2024-09-13T21:40:57.064 INFO:tasks.workunit.client.1.smithi116.stdout:1/983: dread d4/f8b [0,4194304] 0 2024-09-13T21:40:57.074 INFO:tasks.workunit.client.1.smithi116.stdout:9/847: rename d2/d43 to d2/d10/d4c/d98/d101 0 2024-09-13T21:40:57.074 INFO:tasks.workunit.client.1.smithi116.stdout:9/848: write d2/f53 [5190859,98831] 0 2024-09-13T21:40:57.079 INFO:tasks.workunit.client.1.smithi116.stdout:1/984: dwrite d4/d14/f48 [0,4194304] 0 2024-09-13T21:40:57.081 INFO:tasks.workunit.client.1.smithi116.stdout:1/985: mkdir d4/d74/d8d/d5f/d137/d15a 0 2024-09-13T21:40:57.092 INFO:tasks.workunit.client.1.smithi116.stdout:9/849: dwrite d2/d8/d93/da0/dcd/dde/ff6 [0,4194304] 0 2024-09-13T21:40:57.092 INFO:tasks.workunit.client.1.smithi116.stdout:9/850: mkdir d2/d102 0 2024-09-13T21:40:57.093 INFO:tasks.workunit.client.1.smithi116.stdout:9/851: mknod d2/d8/c103 0 2024-09-13T21:40:57.093 INFO:tasks.workunit.client.1.smithi116.stdout:9/852: fdatasync d2/d10/d4c/f4e 0 2024-09-13T21:40:57.094 INFO:tasks.workunit.client.1.smithi116.stdout:9/853: truncate d2/fc 3814612 0 2024-09-13T21:40:57.095 INFO:tasks.workunit.client.1.smithi116.stdout:9/854: creat d2/d102/f104 x:0 0 0 2024-09-13T21:40:57.095 INFO:tasks.workunit.client.1.smithi116.stdout:9/855: symlink d2/d8/d93/da0/dcd/dde/l105 0 2024-09-13T21:40:57.096 INFO:tasks.workunit.client.1.smithi116.stdout:9/856: symlink d2/d8/d3e/l106 0 2024-09-13T21:40:57.096 INFO:tasks.workunit.client.1.smithi116.stdout:9/857: creat d2/d10/f107 x:0 0 0 2024-09-13T21:40:57.097 INFO:tasks.workunit.client.1.smithi116.stdout:9/858: creat d2/d10/d6e/f108 x:0 0 0 2024-09-13T21:40:57.099 INFO:tasks.workunit.client.1.smithi116.stdout:9/859: truncate d2/d10/d4c/f7a 3345894 0 2024-09-13T21:40:57.100 INFO:tasks.workunit.client.1.smithi116.stdout:9/860: dread d2/f13 [0,4194304] 0 2024-09-13T21:40:57.101 INFO:tasks.workunit.client.1.smithi116.stdout:9/861: creat d2/d8/d93/da0/dcd/ddc/f109 x:0 0 0 2024-09-13T21:40:57.102 INFO:tasks.workunit.client.1.smithi116.stdout:9/862: fsync d2/d8/d93/da0/dcd/dde/ffa 0 2024-09-13T21:40:57.115 INFO:tasks.workunit.client.1.smithi116.stdout:9/863: dwrite d2/d10/f107 [0,4194304] 0 2024-09-13T21:40:57.126 INFO:tasks.workunit.client.1.smithi116.stdout:9/864: dread d2/d8/d3e/f56 [0,4194304] 0 2024-09-13T21:40:57.128 INFO:tasks.workunit.client.1.smithi116.stdout:9/865: dread d2/f2d [0,4194304] 0 2024-09-13T21:40:57.132 INFO:tasks.workunit.client.1.smithi116.stdout:9/866: creat d2/d5d/d69/d7d/dc8/f10a x:0 0 0 2024-09-13T21:40:57.132 INFO:tasks.workunit.client.1.smithi116.stdout:9/867: symlink d2/d8/d3e/dae/dee/df3/l10b 0 2024-09-13T21:40:57.132 INFO:tasks.workunit.client.1.smithi116.stdout:9/868: mkdir d2/d10/d4c/d98/d101/d10c 0 2024-09-13T21:40:57.132 INFO:tasks.workunit.client.1.smithi116.stdout:9/869: creat d2/d72/de6/f10d x:0 0 0 2024-09-13T21:40:57.133 INFO:tasks.workunit.client.1.smithi116.stdout:9/870: mkdir d2/d10/d4c/d98/d101/d10c/d10e 0 2024-09-13T21:40:57.133 INFO:tasks.workunit.client.1.smithi116.stdout:9/871: chown d2/d5d 131378620 1 2024-09-13T21:40:57.133 INFO:tasks.workunit.client.1.smithi116.stdout:9/872: fsync d2/fc 0 2024-09-13T21:40:57.133 INFO:tasks.workunit.client.1.smithi116.stdout:9/873: mkdir d2/d8/d93/da0/d10f 0 2024-09-13T21:40:57.134 INFO:tasks.workunit.client.1.smithi116.stdout:9/874: rmdir d2/d8/d93/da0/dcd 39 2024-09-13T21:40:57.135 INFO:tasks.workunit.client.1.smithi116.stdout:9/875: dread d2/d10/d4c/d98/fb9 [0,4194304] 0 2024-09-13T21:40:57.135 INFO:tasks.workunit.client.1.smithi116.stdout:9/876: dread - d2/d72/fb8 zero size 2024-09-13T21:40:57.136 INFO:tasks.workunit.client.1.smithi116.stdout:9/877: creat d2/d10/d4c/d98/d101/f110 x:0 0 0 2024-09-13T21:40:57.136 INFO:tasks.workunit.client.1.smithi116.stdout:9/878: creat d2/d8/d93/f111 x:0 0 0 2024-09-13T21:40:57.136 INFO:tasks.workunit.client.1.smithi116.stdout:9/879: chown d2/l3b 381472 1 2024-09-13T21:40:57.138 INFO:tasks.workunit.client.1.smithi116.stdout:9/880: unlink d2/d8/d3e/dae/dee/df3/ffc 0 2024-09-13T21:40:57.138 INFO:tasks.workunit.client.1.smithi116.stdout:9/881: stat d2/d10/d4c/f9a 0 2024-09-13T21:40:57.138 INFO:tasks.workunit.client.1.smithi116.stdout:9/882: symlink d2/d102/l112 0 2024-09-13T21:40:57.139 INFO:tasks.workunit.client.1.smithi116.stdout:9/883: creat d2/d5d/d8f/f113 x:0 0 0 2024-09-13T21:40:57.140 INFO:tasks.workunit.client.1.smithi116.stdout:9/884: symlink d2/d8/d3e/dae/dee/l114 0 2024-09-13T21:40:57.145 INFO:tasks.workunit.client.1.smithi116.stdout:9/885: dread d2/d10/f52 [0,4194304] 0 2024-09-13T21:40:57.146 INFO:tasks.workunit.client.1.smithi116.stdout:9/886: unlink d2/d10/d4c/cd5 0 2024-09-13T21:40:57.147 INFO:tasks.workunit.client.1.smithi116.stdout:9/887: mknod d2/d5d/d8f/c115 0 2024-09-13T21:40:57.171 INFO:tasks.workunit.client.1.smithi116.stdout:9/888: dwrite d2/d8/d93/f97 [0,4194304] 0 2024-09-13T21:40:57.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:56 smithi088 ceph-mon[27963]: pgmap v268: 65 pgs: 65 active+clean; 2.1 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 171 MiB/s rd, 197 MiB/s wr, 471 op/s 2024-09-13T21:40:57.325 INFO:tasks.workunit.client.1.smithi116.stdout:1/986: sync 2024-09-13T21:40:57.326 INFO:tasks.workunit.client.1.smithi116.stdout:1/987: stat d4/d14/d2a/df2/df3 0 2024-09-13T21:40:57.326 INFO:tasks.workunit.client.1.smithi116.stdout:1/988: read - d4/d23/d56/da3/dc4/f13c zero size 2024-09-13T21:40:57.340 INFO:tasks.workunit.client.1.smithi116.stdout:1/989: dwrite d4/d14/d52/d2f/d91/dac/f13d [0,4194304] 0 2024-09-13T21:40:57.340 INFO:tasks.workunit.client.1.smithi116.stdout:1/990: read d4/d74/d8d/f151 [3064609,74687] 0 2024-09-13T21:40:57.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:56 smithi116 ceph-mon[33391]: pgmap v268: 65 pgs: 65 active+clean; 2.1 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 171 MiB/s rd, 197 MiB/s wr, 471 op/s 2024-09-13T21:40:57.353 INFO:tasks.workunit.client.1.smithi116.stdout:1/991: dwrite d4/d14/d2a/df2/f11d [0,4194304] 0 2024-09-13T21:40:57.356 INFO:tasks.workunit.client.1.smithi116.stdout:1/992: dread d4/d14/f1d [0,4194304] 0 2024-09-13T21:40:57.357 INFO:tasks.workunit.client.1.smithi116.stdout:1/993: read - d4/d14/d2a/f11f zero size 2024-09-13T21:40:57.358 INFO:tasks.workunit.client.1.smithi116.stdout:1/994: creat d4/d23/de8/d155/f15b x:0 0 0 2024-09-13T21:40:57.358 INFO:tasks.workunit.client.1.smithi116.stdout:1/995: creat d4/d23/f15c x:0 0 0 2024-09-13T21:40:57.358 INFO:tasks.workunit.client.1.smithi116.stdout:1/996: truncate d4/f115 756151 0 2024-09-13T21:40:57.359 INFO:tasks.workunit.client.1.smithi116.stdout:1/997: mkdir d4/d74/d8d/d5f/d15d 0 2024-09-13T21:40:57.373 INFO:tasks.workunit.client.1.smithi116.stdout:1/998: dwrite d4/d14/d52/d2f/d91/dac/ff5 [4194304,4194304] 0 2024-09-13T21:40:57.374 INFO:tasks.workunit.client.1.smithi116.stdout:1/999: creat d4/d23/d56/de4/f15e x:0 0 0 2024-09-13T21:40:57.429 INFO:tasks.workunit.client.1.smithi116.stdout:9/889: sync 2024-09-13T21:40:57.450 INFO:tasks.workunit.client.1.smithi116.stdout:9/890: dwrite d2/d10/d14/d38/f6b [4194304,4194304] 0 2024-09-13T21:40:57.451 INFO:tasks.workunit.client.1.smithi116.stdout:9/891: dread - d2/d10/d14/d38/d3a/f7c zero size 2024-09-13T21:40:57.451 INFO:tasks.workunit.client.1.smithi116.stdout:9/892: write d2/d5d/d8f/ff7 [613546,78700] 0 2024-09-13T21:40:57.451 INFO:tasks.workunit.client.1.smithi116.stdout:9/893: readlink d2/lf1 0 2024-09-13T21:40:57.451 INFO:tasks.workunit.client.1.smithi116.stdout:9/894: chown d2/d5d/d69/d7d/dc8/dd2 0 1 2024-09-13T21:40:57.452 INFO:tasks.workunit.client.1.smithi116.stdout:9/895: chown d2/d8/l16 5920344 1 2024-09-13T21:40:57.452 INFO:tasks.workunit.client.1.smithi116.stdout:9/896: mkdir d2/d5d/d8f/d116 0 2024-09-13T21:40:57.452 INFO:tasks.workunit.client.1.smithi116.stdout:9/897: mknod d2/d10/d4c/c117 0 2024-09-13T21:40:57.452 INFO:tasks.workunit.client.1.smithi116.stdout:9/898: chown d2/d10/d4c/f9a 8999497 1 2024-09-13T21:40:57.452 INFO:tasks.workunit.client.1.smithi116.stdout:9/899: creat d2/d8/d93/f118 x:0 0 0 2024-09-13T21:40:57.453 INFO:tasks.workunit.client.1.smithi116.stdout:9/900: symlink d2/d8/d93/da0/dcd/ddc/l119 0 2024-09-13T21:40:57.476 INFO:tasks.workunit.client.1.smithi116.stdout:9/901: dwrite d2/fc2 [0,4194304] 0 2024-09-13T21:40:57.484 INFO:tasks.workunit.client.1.smithi116.stdout:9/902: write d2/d10/d4c/fe8 [2062454,114891] 0 2024-09-13T21:40:57.485 INFO:tasks.workunit.client.1.smithi116.stdout:9/903: chown d2/d10/f52 2484268 1 2024-09-13T21:40:57.485 INFO:tasks.workunit.client.1.smithi116.stdout:9/904: truncate d2/d5d/f62 1018971 0 2024-09-13T21:40:57.499 INFO:tasks.workunit.client.1.smithi116.stdout:9/905: dwrite d2/d72/fb8 [0,4194304] 0 2024-09-13T21:40:57.499 INFO:tasks.workunit.client.1.smithi116.stdout:9/906: read d2/d10/d4c/fe8 [1153791,126904] 0 2024-09-13T21:40:57.759 INFO:tasks.workunit.client.1.smithi116.stdout:9/907: sync 2024-09-13T21:40:57.761 INFO:tasks.workunit.client.1.smithi116.stdout:9/908: creat d2/d10/d4c/f11a x:0 0 0 2024-09-13T21:40:57.761 INFO:tasks.workunit.client.1.smithi116.stdout:9/909: stat d2/d5d/d69/c77 0 2024-09-13T21:40:57.762 INFO:tasks.workunit.client.1.smithi116.stdout:9/910: symlink d2/l11b 0 2024-09-13T21:40:57.764 INFO:tasks.workunit.client.1.smithi116.stdout:9/911: unlink d2/d8/d3e/dae/le5 0 2024-09-13T21:40:57.764 INFO:tasks.workunit.client.1.smithi116.stdout:9/912: chown d2/d102/f104 0 1 2024-09-13T21:40:57.765 INFO:tasks.workunit.client.1.smithi116.stdout:9/913: rename d2/d10/d14/d38/d3a/fc5 to d2/d10/d6e/f11c 0 2024-09-13T21:40:57.766 INFO:tasks.workunit.client.1.smithi116.stdout:9/914: getdents d2/d8/d93/da0/dcd/ddc 0 2024-09-13T21:40:57.766 INFO:tasks.workunit.client.1.smithi116.stdout:9/915: write d2/d10/d14/f21 [4411876,101300] 0 2024-09-13T21:40:57.766 INFO:tasks.workunit.client.1.smithi116.stdout:9/916: creat d2/d10/d6e/f11d x:0 0 0 2024-09-13T21:40:57.768 INFO:tasks.workunit.client.1.smithi116.stdout:9/917: mknod d2/d8/d93/da0/dcd/ddc/c11e 0 2024-09-13T21:40:57.770 INFO:tasks.workunit.client.1.smithi116.stdout:9/918: dread d2/d5d/f62 [0,4194304] 0 2024-09-13T21:40:57.771 INFO:tasks.workunit.client.1.smithi116.stdout:9/919: link d2/d72/de6/fff d2/d10/d14/d38/d3a/f11f 0 2024-09-13T21:40:57.772 INFO:tasks.workunit.client.1.smithi116.stdout:9/920: dread - d2/d72/de6/f10d zero size 2024-09-13T21:40:57.791 INFO:tasks.workunit.client.1.smithi116.stdout:9/921: write d2/f53 [629130,103328] 0 2024-09-13T21:40:57.800 INFO:tasks.workunit.client.1.smithi116.stdout:9/922: write d2/d5d/d69/d47/fd3 [3220739,127861] 0 2024-09-13T21:40:57.848 INFO:tasks.workunit.client.1.smithi116.stdout:9/923: rmdir d2/d5d/d8f 39 2024-09-13T21:40:57.871 INFO:tasks.workunit.client.1.smithi116.stdout:9/924: dread d2/d10/d14/d38/d3a/f6c [0,4194304] 0 2024-09-13T21:40:57.871 INFO:tasks.workunit.client.1.smithi116.stdout:9/925: chown d2/d10/d4c/l66 1906784 1 2024-09-13T21:40:57.934 INFO:tasks.workunit.client.1.smithi116.stdout:9/926: mknod d2/d5d/d8f/db4/c120 0 2024-09-13T21:40:58.262 INFO:tasks.workunit.client.1.smithi116.stdout:9/927: sync 2024-09-13T21:40:58.267 INFO:tasks.workunit.client.1.smithi116.stdout:9/928: rename d2/d5d/d69/c74 to d2/d10/d4c/d98/c121 0 2024-09-13T21:40:58.267 INFO:tasks.workunit.client.1.smithi116.stdout:9/929: truncate d2/d10/d4c/d98/d101/fa2 1545421 0 2024-09-13T21:40:58.305 INFO:tasks.workunit.client.1.smithi116.stdout:9/930: symlink d2/d10/d4c/d98/l122 0 2024-09-13T21:40:58.305 INFO:tasks.workunit.client.1.smithi116.stdout:9/931: fdatasync d2/d8/d93/da0/dcd/dde/ffa 0 2024-09-13T21:40:58.308 INFO:tasks.workunit.client.1.smithi116.stdout:9/932: creat d2/d10/d4c/d98/d101/f123 x:0 0 0 2024-09-13T21:40:58.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/933: stat d2/d10/d14/d38/d3a/l3c 0 2024-09-13T21:40:58.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/934: chown d2/f53 120228558 1 2024-09-13T21:40:58.309 INFO:tasks.workunit.client.1.smithi116.stdout:9/935: write d2/d5d/d69/d47/f7b [1145158,91165] 0 2024-09-13T21:40:58.311 INFO:tasks.workunit.client.1.smithi116.stdout:9/936: mknod d2/d5d/c124 0 2024-09-13T21:40:58.337 INFO:tasks.workunit.client.1.smithi116.stdout:9/937: mknod d2/d102/c125 0 2024-09-13T21:40:58.342 INFO:tasks.workunit.client.1.smithi116.stdout:9/938: rename d2/l3b to d2/d10/d4c/d98/l126 0 2024-09-13T21:40:58.350 INFO:tasks.workunit.client.1.smithi116.stdout:9/939: rename d2/d8/d93/da0/dcd/ddc/l119 to d2/d8/d93/da0/dcd/dde/l127 0 2024-09-13T21:40:58.350 INFO:tasks.workunit.client.1.smithi116.stdout:9/940: read d2/d72/f79 [1794478,82176] 0 2024-09-13T21:40:58.354 INFO:tasks.workunit.client.1.smithi116.stdout:9/941: link d2/d8/d93/fd8 d2/d10/d4c/d98/f128 0 2024-09-13T21:40:58.377 INFO:tasks.workunit.client.1.smithi116.stdout:9/942: dwrite d2/d5d/d69/f4b [0,4194304] 0 2024-09-13T21:40:58.379 INFO:tasks.workunit.client.1.smithi116.stdout:9/943: link d2/d10/d4c/l66 d2/d10/d6e/dbd/l129 0 2024-09-13T21:40:58.379 INFO:tasks.workunit.client.1.smithi116.stdout:9/944: fsync d2/d10/d4c/d98/d101/fa2 0 2024-09-13T21:40:58.379 INFO:tasks.workunit.client.1.smithi116.stdout:9/945: stat d2/d8/d93/da0/d10f 0 2024-09-13T21:40:58.389 INFO:tasks.workunit.client.1.smithi116.stdout:9/946: rename d2/d8/d3e/dae/dee/l114 to d2/d8/d93/da0/dcd/ddc/l12a 0 2024-09-13T21:40:58.389 INFO:tasks.workunit.client.1.smithi116.stdout:9/947: write d2/d8/d93/fd8 [5219242,59126] 0 2024-09-13T21:40:58.401 INFO:tasks.workunit.client.1.smithi116.stdout:9/948: dread d2/d10/d4c/d98/d101/f91 [0,4194304] 0 2024-09-13T21:40:58.401 INFO:tasks.workunit.client.1.smithi116.stdout:9/949: readlink d2/d10/d14/d38/d3a/l3c 0 2024-09-13T21:40:58.420 INFO:tasks.workunit.client.1.smithi116.stdout:9/950: rename d2/d10/d4c/ce2 to d2/d5d/d8f/db4/c12b 0 2024-09-13T21:40:58.436 INFO:tasks.workunit.client.1.smithi116.stdout:9/951: dwrite d2/d5d/d69/fe0 [0,4194304] 0 2024-09-13T21:40:58.436 INFO:tasks.workunit.client.1.smithi116.stdout:9/952: chown d2/d10/d4c/d98/d101/f123 46247 1 2024-09-13T21:40:58.439 INFO:tasks.workunit.client.1.smithi116.stdout:9/953: fdatasync d2/d8/d93/fd8 0 2024-09-13T21:40:58.439 INFO:tasks.workunit.client.1.smithi116.stdout:9/954: chown d2/d5d/d69/d47/ff2 256959205 1 2024-09-13T21:40:58.440 INFO:tasks.workunit.client.1.smithi116.stdout:9/955: stat d2/d5d/d8f/db4/c12b 0 2024-09-13T21:40:58.443 INFO:tasks.workunit.client.1.smithi116.stdout:9/956: link d2/d10/d14/d38/d3a/f6c d2/d102/f12c 0 2024-09-13T21:40:58.453 INFO:tasks.workunit.client.1.smithi116.stdout:9/957: dread d2/d5d/d69/f4b [0,4194304] 0 2024-09-13T21:40:58.470 INFO:tasks.workunit.client.1.smithi116.stdout:9/958: dwrite d2/d10/d14/fba [0,4194304] 0 2024-09-13T21:40:58.487 INFO:tasks.workunit.client.1.smithi116.stdout:9/959: dwrite d2/d10/d4c/d98/d101/f110 [0,4194304] 0 2024-09-13T21:40:58.490 INFO:tasks.workunit.client.1.smithi116.stdout:9/960: creat d2/d5d/d69/d7d/f12d x:0 0 0 2024-09-13T21:40:58.491 INFO:tasks.workunit.client.1.smithi116.stdout:9/961: mkdir d2/d5d/d8f/d116/d12e 0 2024-09-13T21:40:58.493 INFO:tasks.workunit.client.1.smithi116.stdout:9/962: creat d2/d10/d4c/d98/d101/d10c/f12f x:0 0 0 2024-09-13T21:40:58.494 INFO:tasks.workunit.client.1.smithi116.stdout:9/963: creat d2/d10/d4c/d98/d101/d10c/d10e/f130 x:0 0 0 2024-09-13T21:40:58.496 INFO:tasks.workunit.client.1.smithi116.stdout:9/964: creat d2/d5d/d69/d7d/dc8/dd2/f131 x:0 0 0 2024-09-13T21:40:58.496 INFO:tasks.workunit.client.1.smithi116.stdout:9/965: write d2/d8/f9e [264868,79267] 0 2024-09-13T21:40:58.516 INFO:tasks.workunit.client.1.smithi116.stdout:9/966: dwrite d2/d5d/fdb [0,4194304] 0 2024-09-13T21:40:58.520 INFO:tasks.workunit.client.1.smithi116.stdout:9/967: rename d2/d10/faa to d2/d5d/d69/f132 0 2024-09-13T21:40:58.520 INFO:tasks.workunit.client.1.smithi116.stdout:9/968: truncate d2/d72/de6/f10d 930681 0 2024-09-13T21:40:58.520 INFO:tasks.workunit.client.1.smithi116.stdout:9/969: write d2/d8/ffd [2218794,55743] 0 2024-09-13T21:40:58.524 INFO:tasks.workunit.client.1.smithi116.stdout:9/970: creat d2/d8/d93/da0/dcd/f133 x:0 0 0 2024-09-13T21:40:58.546 INFO:tasks.workunit.client.1.smithi116.stdout:9/971: dwrite d2/d10/d14/d38/f6b [0,4194304] 0 2024-09-13T21:40:58.560 INFO:tasks.workunit.client.1.smithi116.stdout:9/972: dwrite d2/d8/faf [4194304,4194304] 0 2024-09-13T21:40:58.561 INFO:tasks.workunit.client.1.smithi116.stdout:9/973: chown d2/d10/d4c/d98/d101/f123 396 1 2024-09-13T21:40:58.565 INFO:tasks.workunit.client.1.smithi116.stdout:9/974: mkdir d2/d10/d14/d38/d3a/d134 0 2024-09-13T21:40:58.570 INFO:tasks.workunit.client.1.smithi116.stdout:9/975: rename d2/d5d/d69/d7d/cc7 to d2/d72/c135 0 2024-09-13T21:40:58.574 INFO:tasks.workunit.client.1.smithi116.stdout:9/976: stat d2/d10/d4c/d98/c121 0 2024-09-13T21:40:58.577 INFO:tasks.workunit.client.1.smithi116.stdout:9/977: rename d2/d10/d6e to d2/d8/d93/da0/d136 0 2024-09-13T21:40:58.595 INFO:tasks.workunit.client.1.smithi116.stdout:9/978: dwrite d2/d8/f1a [0,4194304] 0 2024-09-13T21:40:58.596 INFO:tasks.workunit.client.1.smithi116.stdout:9/979: unlink d2/d8/d3e/f56 0 2024-09-13T21:40:58.597 INFO:tasks.workunit.client.1.smithi116.stdout:9/980: readlink d2/d10/l90 0 2024-09-13T21:40:58.615 INFO:tasks.workunit.client.1.smithi116.stdout:9/981: dwrite d2/d8/d93/da0/d136/fc1 [0,4194304] 0 2024-09-13T21:40:58.619 INFO:tasks.workunit.client.1.smithi116.stdout:9/982: getdents d2/d5d/d8f/d116 0 2024-09-13T21:40:58.626 INFO:tasks.workunit.client.1.smithi116.stdout:9/983: truncate d2/d72/de6/f10d 861381 0 2024-09-13T21:40:58.626 INFO:tasks.workunit.client.1.smithi116.stdout:9/984: chown d2/d8/d93/da0/d10f 8991 1 2024-09-13T21:40:58.626 INFO:tasks.workunit.client.1.smithi116.stdout:9/985: chown d2/d8/d93/da0/d136/f108 1240336 1 2024-09-13T21:40:58.628 INFO:tasks.workunit.client.1.smithi116.stdout:9/986: rename d2/d8/d3e/dae/lc0 to d2/d8/d93/da0/d136/l137 0 2024-09-13T21:40:58.631 INFO:tasks.workunit.client.1.smithi116.stdout:9/987: write d2/d72/fb8 [498531,71034] 0 2024-09-13T21:40:58.633 INFO:tasks.workunit.client.1.smithi116.stdout:9/988: creat d2/d8/d93/da0/dcd/dde/de7/f138 x:0 0 0 2024-09-13T21:40:58.634 INFO:tasks.workunit.client.1.smithi116.stdout:9/989: mkdir d2/d5d/d69/d7d/dc8/dd2/d139 0 2024-09-13T21:40:58.638 INFO:tasks.workunit.client.1.smithi116.stdout:9/990: rename d2/d8/d93/da0/dcd/ddc/c11e to d2/d8/d93/da0/d136/c13a 0 2024-09-13T21:40:58.664 INFO:tasks.workunit.client.1.smithi116.stdout:9/991: dwrite d2/d5d/d69/d47/fd3 [0,4194304] 0 2024-09-13T21:40:58.675 INFO:tasks.workunit.client.1.smithi116.stdout:9/992: write d2/d10/d14/d38/d3a/f11f [708396,118391] 0 2024-09-13T21:40:58.675 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr fail", "who": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "mgr fail", "who": "smithi088.scyrwy"}]': finished 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: mgrmap e21: smithi116.bqnvtn(active, starting, since 0.00690963s) 2024-09-13T21:40:58.676 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:40:58.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:40:58.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:40:58.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:40:58.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:40:58.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr metadata", "who": "smithi116.bqnvtn", "id": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: Manager daemon smithi116.bqnvtn is now available 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: Migrating agent root cert to cert store 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: Migrating agent root key to cert store 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi116.bqnvtn/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi116.bqnvtn/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi116.bqnvtn/trash_purge_schedule"}]: dispatch 2024-09-13T21:40:58.679 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:58 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi116.bqnvtn/trash_purge_schedule"}]: dispatch 2024-09-13T21:40:58.680 INFO:tasks.workunit.client.1.smithi116.stdout:9/993: symlink d2/d10/d4c/d98/dad/dc3/l13b 0 2024-09-13T21:40:58.680 INFO:tasks.workunit.client.1.smithi116.stdout:9/994: symlink d2/d10/d4c/l13c 0 2024-09-13T21:40:58.686 INFO:tasks.workunit.client.1.smithi116.stdout:9/995: getdents d2/d10/d4c 0 2024-09-13T21:40:58.686 INFO:tasks.workunit.client.1.smithi116.stdout:9/996: fdatasync d2/d8/d93/da0/fbe 0 2024-09-13T21:40:58.703 INFO:tasks.workunit.client.1.smithi116.stdout:9/997: dwrite d2/d10/f32 [4194304,4194304] 0 2024-09-13T21:40:58.705 INFO:tasks.workunit.client.1.smithi116.stdout:9/998: mknod d2/d8/d3e/dae/dee/c13d 0 2024-09-13T21:40:58.706 INFO:tasks.workunit.client.1.smithi116.stdout:9/999: read - d2/d102/f104 zero size 2024-09-13T21:40:58.708 INFO:tasks.workunit.client.1.smithi116.stderr:+ rm -rf -- ./tmp.jo7nbdM8n8 2024-09-13T21:40:58.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:58.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:58.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:58.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:58.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' 2024-09-13T21:40:58.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:58.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr fail", "who": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:40:58.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14211 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "mgr fail", "who": "smithi088.scyrwy"}]': finished 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: mgrmap e21: smithi116.bqnvtn(active, starting, since 0.00690963s) 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr metadata", "who": "smithi116.bqnvtn", "id": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:40:58.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: Manager daemon smithi116.bqnvtn is now available 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: Migrating agent root cert to cert store 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: Migrating agent root key to cert store 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:40:58.850 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:58.851 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:58.851 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi116.bqnvtn/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:40:58.851 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi116.bqnvtn/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:40:58.851 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi116.bqnvtn/trash_purge_schedule"}]: dispatch 2024-09-13T21:40:58.851 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:58 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi116.bqnvtn/trash_purge_schedule"}]: dispatch 2024-09-13T21:40:59.873 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:59 smithi088 ceph-mon[27963]: Checking for cert/key for grafana.smithi088 2024-09-13T21:40:59.873 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:59 smithi088 ceph-mon[27963]: Migrating grafana.smithi088 cert to cert store 2024-09-13T21:40:59.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:59 smithi088 ceph-mon[27963]: Migrating grafana.smithi088 key to cert store 2024-09-13T21:40:59.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:59 smithi088 ceph-mon[27963]: Deploying cephadm binary to smithi088 2024-09-13T21:40:59.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:59 smithi088 ceph-mon[27963]: Deploying cephadm binary to smithi116 2024-09-13T21:40:59.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:59 smithi088 ceph-mon[27963]: mgrmap e22: smithi116.bqnvtn(active, since 1.00845s) 2024-09-13T21:40:59.874 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:40:59 smithi088 ceph-mon[27963]: pgmap v3: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-09-13T21:41:00.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:59 smithi116 ceph-mon[33391]: Checking for cert/key for grafana.smithi088 2024-09-13T21:41:00.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:59 smithi116 ceph-mon[33391]: Migrating grafana.smithi088 cert to cert store 2024-09-13T21:41:00.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:59 smithi116 ceph-mon[33391]: Migrating grafana.smithi088 key to cert store 2024-09-13T21:41:00.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:59 smithi116 ceph-mon[33391]: Deploying cephadm binary to smithi088 2024-09-13T21:41:00.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:59 smithi116 ceph-mon[33391]: Deploying cephadm binary to smithi116 2024-09-13T21:41:00.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:59 smithi116 ceph-mon[33391]: mgrmap e22: smithi116.bqnvtn(active, since 1.00845s) 2024-09-13T21:41:00.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:40:59 smithi116 ceph-mon[33391]: pgmap v3: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-09-13T21:41:01.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:00 smithi116 ceph-mon[33391]: pgmap v4: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-09-13T21:41:01.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:00 smithi088 ceph-mon[27963]: pgmap v4: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-09-13T21:41:01.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:01 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:00] ENGINE Bus STARTING 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:01 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:00] ENGINE Serving on https://172.21.15.116:7150 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:01 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:00] ENGINE Error in HTTPServer.serve 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Traceback (most recent call last): 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self._run(expiration_interval) 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:41:01.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: s = self.context.wrap_socket( 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: return self.sslsocket_class._create( 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self.do_handshake() 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self._sslobj.do_handshake() 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:01 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:00] ENGINE Serving on http://172.21.15.116:8765 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:01 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:00] ENGINE Bus STARTED 2024-09-13T21:41:01.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:01 smithi116 ceph-mon[33391]: mgrmap e23: smithi116.bqnvtn(active, since 3s) 2024-09-13T21:41:01.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:01 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:00] ENGINE Bus STARTING 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:01 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:00] ENGINE Serving on https://172.21.15.116:7150 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:01 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:00] ENGINE Error in HTTPServer.serve 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Traceback (most recent call last): 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._run(expiration_interval) 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:41:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s = self.context.wrap_socket( 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: return self.sslsocket_class._create( 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self.do_handshake() 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._sslobj.do_handshake() 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:01 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:00] ENGINE Serving on http://172.21.15.116:8765 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:01 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:00] ENGINE Bus STARTED 2024-09-13T21:41:01.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:01 smithi088 ceph-mon[27963]: mgrmap e23: smithi116.bqnvtn(active, since 3s) 2024-09-13T21:41:03.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:02 smithi116 ceph-mon[33391]: pgmap v5: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-09-13T21:41:03.215 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:02 smithi088 ceph-mon[27963]: pgmap v5: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-09-13T21:41:04.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:04 smithi088 ceph-mon[27963]: pgmap v6: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 27 KiB/s rd, 27 KiB/s wr, 57 op/s 2024-09-13T21:41:04.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:04 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:04.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:04 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:05.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:04 smithi116 ceph-mon[33391]: pgmap v6: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 27 KiB/s rd, 27 KiB/s wr, 57 op/s 2024-09-13T21:41:05.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:04 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:05.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:04 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:05.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.209+0000 7f357e837700 1 -- 172.21.15.88:0/3272901273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578100250 msgr2=0x7f3578100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.209+0000 7f357e837700 1 --2- 172.21.15.88:0/3272901273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578100250 0x7f3578100660 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3568009910 tx=0x7f3568009c20 comp rx=0 tx=0).stop 2024-09-13T21:41:05.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.209+0000 7f357e837700 1 -- 172.21.15.88:0/3272901273 shutdown_connections 2024-09-13T21:41:05.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.209+0000 7f357e837700 1 --2- 172.21.15.88:0/3272901273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3578101450 0x7f35781018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.209+0000 7f357e837700 1 --2- 172.21.15.88:0/3272901273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578100250 0x7f3578100660 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.209+0000 7f357e837700 1 -- 172.21.15.88:0/3272901273 >> 172.21.15.88:0/3272901273 conn(0x7f35780fb7e0 msgr2=0x7f35780fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:05.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.209+0000 7f357e837700 1 -- 172.21.15.88:0/3272901273 shutdown_connections 2024-09-13T21:41:05.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.209+0000 7f357e837700 1 -- 172.21.15.88:0/3272901273 wait complete. 2024-09-13T21:41:05.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.210+0000 7f357e837700 1 Processor -- start 2024-09-13T21:41:05.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.210+0000 7f357e837700 1 -- start start 2024-09-13T21:41:05.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.211+0000 7f357e837700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578100250 0x7f3578197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.211+0000 7f357e837700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3578101450 0x7f35781981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.211+0000 7f357e837700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35781987f0 con 0x7f3578100250 2024-09-13T21:41:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.211+0000 7f357e837700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3578198960 con 0x7f3578101450 2024-09-13T21:41:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.211+0000 7f35777fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3578101450 0x7f35781981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.211+0000 7f35777fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3578101450 0x7f35781981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:52142/0 (socket says 172.21.15.88:52142) 2024-09-13T21:41:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.211+0000 7f35777fe700 1 -- 172.21.15.88:0/1258513173 learned_addr learned my addr 172.21.15.88:0/1258513173 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:05.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.212+0000 7f35777fe700 1 -- 172.21.15.88:0/1258513173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578100250 msgr2=0x7f3578197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.212+0000 7f35777fe700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578100250 0x7f3578197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.212+0000 7f35777fe700 1 -- 172.21.15.88:0/1258513173 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c009520 con 0x7f3578101450 2024-09-13T21:41:05.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.212+0000 7f35777fe700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3578101450 0x7f35781981f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f356c00eab0 tx=0x7f356c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:05.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.214+0000 7f35757fa700 1 -- 172.21.15.88:0/1258513173 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f356c00cc60 con 0x7f3578101450 2024-09-13T21:41:05.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.214+0000 7f35757fa700 1 -- 172.21.15.88:0/1258513173 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f356c0044d0 con 0x7f3578101450 2024-09-13T21:41:05.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.214+0000 7f35757fa700 1 -- 172.21.15.88:0/1258513173 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f356c005250 con 0x7f3578101450 2024-09-13T21:41:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.214+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35680095f0 con 0x7f3578101450 2024-09-13T21:41:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.214+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357819d750 con 0x7f3578101450 2024-09-13T21:41:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.215+0000 7f35757fa700 1 -- 172.21.15.88:0/1258513173 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 23) v1 ==== 46602+0+0 (secure 0 0 0) 0x7f356c0053b0 con 0x7f3578101450 2024-09-13T21:41:05.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.215+0000 7f35757fa700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f3560039640 0x7f356003baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:05.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.215+0000 7f35757fa700 1 -- 172.21.15.88:0/1258513173 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f356c014070 con 0x7f3578101450 2024-09-13T21:41:05.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.216+0000 7f3577fff700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f3560039640 0x7f356003baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:05.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.217+0000 7f3577fff700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f3560039640 0x7f356003baf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3568009fd0 tx=0x7f3568000bc0 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:05.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.217+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3578074330 con 0x7f3578101450 2024-09-13T21:41:05.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.229+0000 7f35757fa700 1 -- 172.21.15.88:0/1258513173 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f356c01f990 con 0x7f3578101450 2024-09-13T21:41:05.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.540+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 --> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3578105810 con 0x7f3560039640 2024-09-13T21:41:05.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.541+0000 7f35757fa700 1 -- 172.21.15.88:0/1258513173 <== mgr.14574 v2:172.21.15.116:6828/622892853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f3578105810 con 0x7f3560039640 2024-09-13T21:41:05.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.545+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f3560039640 msgr2=0x7f356003baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.545+0000 7f357e837700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f3560039640 0x7f356003baf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3568009fd0 tx=0x7f3568000bc0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.545+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3578101450 msgr2=0x7f35781981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.545+0000 7f357e837700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3578101450 0x7f35781981f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f356c00eab0 tx=0x7f356c00ee70 comp rx=0 tx=0).stop 2024-09-13T21:41:05.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.546+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 shutdown_connections 2024-09-13T21:41:05.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.546+0000 7f357e837700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578100250 0x7f3578197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.546+0000 7f357e837700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f3560039640 0x7f356003baf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.546+0000 7f357e837700 1 --2- 172.21.15.88:0/1258513173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3578101450 0x7f35781981f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.546+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 >> 172.21.15.88:0/1258513173 conn(0x7f35780fb7e0 msgr2=0x7f35780fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:05.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.546+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 shutdown_connections 2024-09-13T21:41:05.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.546+0000 7f357e837700 1 -- 172.21.15.88:0/1258513173 wait complete. 2024-09-13T21:41:05.561 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:41:05.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.693+0000 7f92197bd700 1 -- 172.21.15.88:0/392438638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 msgr2=0x7f92140ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.693+0000 7f92197bd700 1 --2- 172.21.15.88:0/392438638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 0x7f92140ff560 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9204009910 tx=0x7f9204009c20 comp rx=0 tx=0).stop 2024-09-13T21:41:05.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.693+0000 7f92197bd700 1 -- 172.21.15.88:0/392438638 shutdown_connections 2024-09-13T21:41:05.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.693+0000 7f92197bd700 1 --2- 172.21.15.88:0/392438638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92141003f0 0x7f9214100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.693+0000 7f92197bd700 1 --2- 172.21.15.88:0/392438638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 0x7f92140ff560 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.693+0000 7f92197bd700 1 -- 172.21.15.88:0/392438638 >> 172.21.15.88:0/392438638 conn(0x7f92140fa7a0 msgr2=0x7f92140fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:05.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.693+0000 7f92197bd700 1 -- 172.21.15.88:0/392438638 shutdown_connections 2024-09-13T21:41:05.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.693+0000 7f92197bd700 1 -- 172.21.15.88:0/392438638 wait complete. 2024-09-13T21:41:05.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f92197bd700 1 Processor -- start 2024-09-13T21:41:05.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f92197bd700 1 -- start start 2024-09-13T21:41:05.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f92197bd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 0x7f9214069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:05.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f92197bd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92141003f0 0x7f921419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:05.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f92197bd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921419b120 con 0x7f92140ff150 2024-09-13T21:41:05.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f92197bd700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921419b260 con 0x7f92141003f0 2024-09-13T21:41:05.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f92127fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92141003f0 0x7f921419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:05.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f9212ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 0x7f9214069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f92127fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92141003f0 0x7f921419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:52174/0 (socket says 172.21.15.88:52174) 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f9212ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 0x7f9214069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50676/0 (socket says 172.21.15.88:50676) 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.694+0000 7f92127fc700 1 -- 172.21.15.88:0/2186903771 learned_addr learned my addr 172.21.15.88:0/2186903771 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.695+0000 7f9212ffd700 1 -- 172.21.15.88:0/2186903771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92141003f0 msgr2=0x7f921419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.695+0000 7f9212ffd700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92141003f0 0x7f921419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.695+0000 7f9212ffd700 1 -- 172.21.15.88:0/2186903771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040095f0 con 0x7f92140ff150 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.695+0000 7f9212ffd700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 0x7f9214069930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9204009910 tx=0x7f920400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.695+0000 7f91fbfff700 1 -- 172.21.15.88:0/2186903771 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f920401d070 con 0x7f92140ff150 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.695+0000 7f91fbfff700 1 -- 172.21.15.88:0/2186903771 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9204005dc0 con 0x7f92140ff150 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.695+0000 7f91fbfff700 1 -- 172.21.15.88:0/2186903771 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9204017400 con 0x7f92140ff150 2024-09-13T21:41:05.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.695+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921419b4e0 con 0x7f92140ff150 2024-09-13T21:41:05.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.696+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921419b980 con 0x7f92140ff150 2024-09-13T21:41:05.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.697+0000 7f91fbfff700 1 -- 172.21.15.88:0/2186903771 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 23) v1 ==== 46602+0+0 (secure 0 0 0) 0x7f9204017630 con 0x7f92140ff150 2024-09-13T21:41:05.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.697+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9214068ab0 con 0x7f92140ff150 2024-09-13T21:41:05.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.697+0000 7f91fbfff700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f91fc0395a0 0x7f91fc03ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:05.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.697+0000 7f91fbfff700 1 -- 172.21.15.88:0/2186903771 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f920404ea90 con 0x7f92140ff150 2024-09-13T21:41:05.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.697+0000 7f92127fc700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f91fc0395a0 0x7f91fc03ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:05.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.698+0000 7f92127fc700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f91fc0395a0 0x7f91fc03ba50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9214069eb0 tx=0x7f9208009260 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:05.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:05.703+0000 7f91fbfff700 1 -- 172.21.15.88:0/2186903771 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f920400fa40 con 0x7f92140ff150 2024-09-13T21:41:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.091+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 --> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9214104e20 con 0x7f91fc0395a0 2024-09-13T21:41:06.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:05 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:06.094 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:05 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:06.094 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:05 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:06.094 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:05 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:06.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.093+0000 7f91fbfff700 1 -- 172.21.15.88:0/2186903771 <== mgr.14574 v2:172.21.15.116:6828/622892853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f9214104e20 con 0x7f91fc0395a0 2024-09-13T21:41:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:05 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:05 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:05 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:05 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f91fc0395a0 msgr2=0x7f91fc03ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f91fc0395a0 0x7f91fc03ba50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9214069eb0 tx=0x7f9208009260 comp rx=0 tx=0).stop 2024-09-13T21:41:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 msgr2=0x7f9214069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 0x7f9214069930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9204009910 tx=0x7f920400f690 comp rx=0 tx=0).stop 2024-09-13T21:41:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 shutdown_connections 2024-09-13T21:41:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92140ff150 0x7f9214069930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f91fc0395a0 0x7f91fc03ba50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 --2- 172.21.15.88:0/2186903771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92141003f0 0x7f921419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 >> 172.21.15.88:0/2186903771 conn(0x7f92140fa7a0 msgr2=0x7f92141036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:06.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.095+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 shutdown_connections 2024-09-13T21:41:06.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.096+0000 7f92197bd700 1 -- 172.21.15.88:0/2186903771 wait complete. 2024-09-13T21:41:06.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.237+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3967936028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b380fee50 msgr2=0x7f9b38101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.237+0000 7f9b3fa4f700 1 --2- 172.21.15.88:0/3967936028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b380fee50 0x7f9b38101580 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009910 tx=0x7f9b28009c20 comp rx=0 tx=0).stop 2024-09-13T21:41:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.237+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3967936028 shutdown_connections 2024-09-13T21:41:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.237+0000 7f9b3fa4f700 1 --2- 172.21.15.88:0/3967936028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b380fee50 0x7f9b38101580 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.237+0000 7f9b3fa4f700 1 --2- 172.21.15.88:0/3967936028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b380fe500 0x7f9b380fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.237+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3967936028 >> 172.21.15.88:0/3967936028 conn(0x7f9b380f9f10 msgr2=0x7f9b380fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.238+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3967936028 shutdown_connections 2024-09-13T21:41:06.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.238+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3967936028 wait complete. 2024-09-13T21:41:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.238+0000 7f9b3fa4f700 1 Processor -- start 2024-09-13T21:41:06.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3fa4f700 1 -- start start 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3fa4f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b380fe500 0x7f9b38195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3fa4f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b380fee50 0x7f9b38196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3fa4f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38196620 con 0x7f9b380fe500 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3fa4f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38196760 con 0x7f9b380fee50 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3d7eb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b380fe500 0x7f9b38195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3cfea700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b380fee50 0x7f9b38196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3cfea700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b380fee50 0x7f9b38196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:52194/0 (socket says 172.21.15.88:52194) 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3cfea700 1 -- 172.21.15.88:0/3429495169 learned_addr learned my addr 172.21.15.88:0/3429495169 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3cfea700 1 -- 172.21.15.88:0/3429495169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b380fe500 msgr2=0x7f9b38195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3cfea700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b380fe500 0x7f9b38195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.239+0000 7f9b3cfea700 1 -- 172.21.15.88:0/3429495169 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b34009520 con 0x7f9b380fee50 2024-09-13T21:41:06.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.240+0000 7f9b3cfea700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b380fee50 0x7f9b38196000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800f690 tx=0x7f9b2800f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.240+0000 7f9b2e7fc700 1 -- 172.21.15.88:0/3429495169 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b2801d070 con 0x7f9b380fee50 2024-09-13T21:41:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.240+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b280095f0 con 0x7f9b380fee50 2024-09-13T21:41:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.240+0000 7f9b2e7fc700 1 -- 172.21.15.88:0/3429495169 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b28005dc0 con 0x7f9b380fee50 2024-09-13T21:41:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.240+0000 7f9b2e7fc700 1 -- 172.21.15.88:0/3429495169 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b2801d070 con 0x7f9b380fee50 2024-09-13T21:41:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.240+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b380ff6d0 con 0x7f9b380fee50 2024-09-13T21:41:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.241+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b38108d10 con 0x7f9b380fee50 2024-09-13T21:41:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.241+0000 7f9b2e7fc700 1 -- 172.21.15.88:0/3429495169 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 23) v1 ==== 46602+0+0 (secure 0 0 0) 0x7f9b2802b440 con 0x7f9b380fee50 2024-09-13T21:41:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.241+0000 7f9b2e7fc700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f9b24039600 0x7f9b2403bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.242+0000 7f9b2e7fc700 1 -- 172.21.15.88:0/3429495169 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9b2804e850 con 0x7f9b380fee50 2024-09-13T21:41:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.242+0000 7f9b3d7eb700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f9b24039600 0x7f9b2403bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.242+0000 7f9b3d7eb700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f9b24039600 0x7f9b2403bab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009df0 tx=0x7f9b34014040 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.251+0000 7f9b2e7fc700 1 -- 172.21.15.88:0/3429495169 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f9b28016e20 con 0x7f9b380fee50 2024-09-13T21:41:06.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.622+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 --> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b38105ed0 con 0x7f9b24039600 2024-09-13T21:41:06.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.633+0000 7f9b2e7fc700 1 -- 172.21.15.88:0/3429495169 <== mgr.14574 v2:172.21.15.116:6828/622892853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f9b38105ed0 con 0x7f9b24039600 2024-09-13T21:41:06.635 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:41:06.635 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (7m) 0s ago 8m 24.8M - 0.25.0 c8568f914cd2 c82eca12b874 2024-09-13T21:41:06.635 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (8m) 0s ago 8m 7625k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:41:06.635 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (7m) 2s ago 7m 7562k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:41:06.635 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (8m) 0s ago 8m 6665k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:41:06.635 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (7m) 2s ago 7m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:41:06.635 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (6m) 0s ago 8m 86.6M - 9.4.7 954c08fa6188 aa2cd07a9c2d 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (2m) 0s ago 2m 139M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (3m) 0s ago 3m 13.3M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (2m) 2s ago 2m 14.9M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (2m) 2s ago 2m 159M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:9283,8765,8443 running (9m) 0s ago 9m 171M - 18.2.0 dc2bc1663786 9fc04dc2c4a7 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (53s) 2s ago 7m 480M - 19.1.1-324-gecab7be5 0652ff2b5d78 6eeb3d026c01 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (9m) 0s ago 10m 48.8M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (7m) 2s ago 7m 40.0M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (8m) 0s ago 8m 16.0M - 1.5.0 0da6a335fe13 71ce2b0df304 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (7m) 2s ago 7m 15.8M - 1.5.0 0da6a335fe13 6d3c62590d98 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (6m) 0s ago 6m 231M 3946M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (6m) 0s ago 6m 236M 3946M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:41:06.636 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (5m) 0s ago 5m 199M 3946M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:41:06.637 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (5m) 2s ago 5m 232M 4970M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:41:06.637 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (4m) 2s ago 4m 218M 4970M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:41:06.637 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (4m) 2s ago 4m 241M 4970M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:41:06.637 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (6m) 0s ago 8m 70.7M - 2.43.0 a07b618ecd1d 85cb356d6671 2024-09-13T21:41:06.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f9b24039600 msgr2=0x7f9b2403bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f9b24039600 0x7f9b2403bab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009df0 tx=0x7f9b34014040 comp rx=0 tx=0).stop 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b380fee50 msgr2=0x7f9b38196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b380fee50 0x7f9b38196000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800f690 tx=0x7f9b2800f6c0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 shutdown_connections 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b380fe500 0x7f9b38195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f9b24039600 0x7f9b2403bab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 --2- 172.21.15.88:0/3429495169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b380fee50 0x7f9b38196000 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 >> 172.21.15.88:0/3429495169 conn(0x7f9b380f9f10 msgr2=0x7f9b381047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 shutdown_connections 2024-09-13T21:41:06.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.637+0000 7f9b3fa4f700 1 -- 172.21.15.88:0/3429495169 wait complete. 2024-09-13T21:41:06.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.765+0000 7f053e209700 1 -- 172.21.15.88:0/2965710347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05380ff130 msgr2=0x7f05380ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:06.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.765+0000 7f053e209700 1 --2- 172.21.15.88:0/2965710347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05380ff130 0x7f05380ff540 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0528013e70 tx=0x7f05280097f0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.766+0000 7f053e209700 1 -- 172.21.15.88:0/2965710347 shutdown_connections 2024-09-13T21:41:06.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.766+0000 7f053e209700 1 --2- 172.21.15.88:0/2965710347 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05381003d0 0x7f0538100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.766+0000 7f053e209700 1 --2- 172.21.15.88:0/2965710347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05380ff130 0x7f05380ff540 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.766+0000 7f053e209700 1 -- 172.21.15.88:0/2965710347 >> 172.21.15.88:0/2965710347 conn(0x7f05380fa780 msgr2=0x7f05380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:06.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.766+0000 7f053e209700 1 -- 172.21.15.88:0/2965710347 shutdown_connections 2024-09-13T21:41:06.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.766+0000 7f053e209700 1 -- 172.21.15.88:0/2965710347 wait complete. 2024-09-13T21:41:06.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.766+0000 7f053e209700 1 Processor -- start 2024-09-13T21:41:06.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f053e209700 1 -- start start 2024-09-13T21:41:06.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f053e209700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05380ff130 0x7f0538193870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:06.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f053e209700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05381003d0 0x7f0538193db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:06.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f053e209700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05381943d0 con 0x7f05381003d0 2024-09-13T21:41:06.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f053e209700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0538194510 con 0x7f05380ff130 2024-09-13T21:41:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f0536ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05381003d0 0x7f0538193db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f05377fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05380ff130 0x7f0538193870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f05377fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05380ff130 0x7f0538193870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:52206/0 (socket says 172.21.15.88:52206) 2024-09-13T21:41:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f0536ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05381003d0 0x7f0538193db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50710/0 (socket says 172.21.15.88:50710) 2024-09-13T21:41:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f05377fe700 1 -- 172.21.15.88:0/2083961619 learned_addr learned my addr 172.21.15.88:0/2083961619 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f0536ffd700 1 -- 172.21.15.88:0/2083961619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05380ff130 msgr2=0x7f0538193870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f0536ffd700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05380ff130 0x7f0538193870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.767+0000 7f0536ffd700 1 -- 172.21.15.88:0/2083961619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528013b50 con 0x7f05381003d0 2024-09-13T21:41:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.768+0000 7f0536ffd700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05381003d0 0x7f0538193db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f052c00e970 tx=0x7f052c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:06.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.768+0000 7f0534ff9700 1 -- 172.21.15.88:0/2083961619 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f052c00c9d0 con 0x7f05381003d0 2024-09-13T21:41:06.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.768+0000 7f0534ff9700 1 -- 172.21.15.88:0/2083961619 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f052c010430 con 0x7f05381003d0 2024-09-13T21:41:06.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.769+0000 7f0534ff9700 1 -- 172.21.15.88:0/2083961619 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f052c018650 con 0x7f05381003d0 2024-09-13T21:41:06.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.769+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0538198fc0 con 0x7f05381003d0 2024-09-13T21:41:06.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.769+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05381994e0 con 0x7f05381003d0 2024-09-13T21:41:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.770+0000 7f0534ff9700 1 -- 172.21.15.88:0/2083961619 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 23) v1 ==== 46602+0+0 (secure 0 0 0) 0x7f052c0105a0 con 0x7f05381003d0 2024-09-13T21:41:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.770+0000 7f0534ff9700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f0520039390 0x7f052003b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.770+0000 7f0534ff9700 1 -- 172.21.15.88:0/2083961619 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f052c014070 con 0x7f05381003d0 2024-09-13T21:41:06.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.770+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053818d0e0 con 0x7f05381003d0 2024-09-13T21:41:06.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.770+0000 7f05377fe700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f0520039390 0x7f052003b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:06.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.771+0000 7f05377fe700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f0520039390 0x7f052003b840 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0528005390 tx=0x7f0528005a90 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:06.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.776+0000 7f0534ff9700 1 -- 172.21.15.88:0/2083961619 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f052c0187b0 con 0x7f05381003d0 2024-09-13T21:41:06.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:06.963+0000 7f0534ff9700 1 -- 172.21.15.88:0/2083961619 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 24) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f052c00ad10 con 0x7f05381003d0 2024-09-13T21:41:07.062 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: pgmap v7: 65 pgs: 65 active+clean; 1.8 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 57 KiB/s rd, 1.5 MiB/s wr, 275 op/s 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: Standby manager daemon smithi088.scyrwy started 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.scyrwy/crt"}]: dispatch 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.scyrwy/key"}]: dispatch 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.063 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.064 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.064 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:06 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:07.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.189+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f053802cc30 con 0x7f05381003d0 2024-09-13T21:41:07.191 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:07.191 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: pgmap v7: 65 pgs: 65 active+clean; 1.8 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 57 KiB/s rd, 1.5 MiB/s wr, 275 op/s 2024-09-13T21:41:07.191 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: Standby manager daemon smithi088.scyrwy started 2024-09-13T21:41:07.191 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.scyrwy/crt"}]: dispatch 2024-09-13T21:41:07.191 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:41:07.191 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.scyrwy/key"}]: dispatch 2024-09-13T21:41:07.191 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.88:0/2' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:41:07.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:07.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:07.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:07.192 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:06 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:07.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.189+0000 7f0534ff9700 1 -- 172.21.15.88:0/2083961619 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7f052c05ccb0 con 0x7f05381003d0 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:41:07.193 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:41:07.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.191+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f0520039390 msgr2=0x7f052003b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:07.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.191+0000 7f053e209700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f0520039390 0x7f052003b840 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0528005390 tx=0x7f0528005a90 comp rx=0 tx=0).stop 2024-09-13T21:41:07.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.191+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05381003d0 msgr2=0x7f0538193db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:07.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.191+0000 7f053e209700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05381003d0 0x7f0538193db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f052c00e970 tx=0x7f052c00ec80 comp rx=0 tx=0).stop 2024-09-13T21:41:07.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.192+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 shutdown_connections 2024-09-13T21:41:07.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.192+0000 7f053e209700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f0520039390 0x7f052003b840 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:07.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.192+0000 7f053e209700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05380ff130 0x7f0538193870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:07.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.192+0000 7f053e209700 1 --2- 172.21.15.88:0/2083961619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05381003d0 0x7f0538193db0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:07.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.192+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 >> 172.21.15.88:0/2083961619 conn(0x7f05380fa780 msgr2=0x7f053818a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:07.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.192+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 shutdown_connections 2024-09-13T21:41:07.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.192+0000 7f053e209700 1 -- 172.21.15.88:0/2083961619 wait complete. 2024-09-13T21:41:07.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.306+0000 7f2b83c57700 1 -- 172.21.15.88:0/3747202055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 msgr2=0x7f2b7c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:07.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.306+0000 7f2b83c57700 1 --2- 172.21.15.88:0/3747202055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 0x7f2b7c100650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009910 tx=0x7f2b78009c20 comp rx=0 tx=0).stop 2024-09-13T21:41:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.306+0000 7f2b83c57700 1 -- 172.21.15.88:0/3747202055 shutdown_connections 2024-09-13T21:41:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.306+0000 7f2b83c57700 1 --2- 172.21.15.88:0/3747202055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b7c101440 0x7f2b7c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.306+0000 7f2b83c57700 1 --2- 172.21.15.88:0/3747202055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 0x7f2b7c100650 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.306+0000 7f2b83c57700 1 -- 172.21.15.88:0/3747202055 >> 172.21.15.88:0/3747202055 conn(0x7f2b7c0fb7f0 msgr2=0x7f2b7c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.306+0000 7f2b83c57700 1 -- 172.21.15.88:0/3747202055 shutdown_connections 2024-09-13T21:41:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.306+0000 7f2b83c57700 1 -- 172.21.15.88:0/3747202055 wait complete. 2024-09-13T21:41:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b83c57700 1 Processor -- start 2024-09-13T21:41:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b83c57700 1 -- start start 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b83c57700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 0x7f2b7c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b83c57700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b7c101440 0x7f2b7c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b83c57700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c073680 con 0x7f2b7c100240 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b83c57700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0737c0 con 0x7f2b7c101440 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b819f3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 0x7f2b7c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b819f3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 0x7f2b7c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50722/0 (socket says 172.21.15.88:50722) 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b819f3700 1 -- 172.21.15.88:0/1737160441 learned_addr learned my addr 172.21.15.88:0/1737160441 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.307+0000 7f2b811f2700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b7c101440 0x7f2b7c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.308+0000 7f2b819f3700 1 -- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b7c101440 msgr2=0x7f2b7c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.308+0000 7f2b819f3700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b7c101440 0x7f2b7c073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.308+0000 7f2b819f3700 1 -- 172.21.15.88:0/1737160441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b780095f0 con 0x7f2b7c100240 2024-09-13T21:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.308+0000 7f2b819f3700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 0x7f2b7c074af0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b78000c00 tx=0x7f2b7800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.308+0000 7f2b72ffd700 1 -- 172.21.15.88:0/1737160441 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b7801d070 con 0x7f2b7c100240 2024-09-13T21:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.308+0000 7f2b72ffd700 1 -- 172.21.15.88:0/1737160441 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2b78005dc0 con 0x7f2b7c100240 2024-09-13T21:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.308+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c073a40 con 0x7f2b7c100240 2024-09-13T21:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.308+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c073f30 con 0x7f2b7c100240 2024-09-13T21:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.308+0000 7f2b72ffd700 1 -- 172.21.15.88:0/1737160441 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b78022470 con 0x7f2b7c100240 2024-09-13T21:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.309+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c108d90 con 0x7f2b7c100240 2024-09-13T21:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.310+0000 7f2b72ffd700 1 -- 172.21.15.88:0/1737160441 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 24) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f2b78003810 con 0x7f2b7c100240 2024-09-13T21:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.310+0000 7f2b72ffd700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f2b6806d600 0x7f2b6806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.310+0000 7f2b72ffd700 1 -- 172.21.15.88:0/1737160441 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2b7808e3a0 con 0x7f2b7c100240 2024-09-13T21:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.310+0000 7f2b811f2700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f2b6806d600 0x7f2b6806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.311+0000 7f2b811f2700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f2b6806d600 0x7f2b6806fab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009c60 tx=0x7f2b6c009260 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:07.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.315+0000 7f2b72ffd700 1 -- 172.21.15.88:0/1737160441 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f2b7805b4d0 con 0x7f2b7c100240 2024-09-13T21:41:07.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.555+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 --> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b7c105d90 con 0x7f2b6806d600 2024-09-13T21:41:07.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.557+0000 7f2b72ffd700 1 -- 172.21.15.88:0/1737160441 <== mgr.14574 v2:172.21.15.116:6828/622892853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2b7c105d90 con 0x7f2b6806d600 2024-09-13T21:41:07.558 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:41:07.558 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:41:07.558 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:41:07.559 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T21:41:07.559 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-13T21:41:07.559 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "1/2 daemons upgraded", 2024-09-13T21:41:07.559 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-09-13T21:41:07.559 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:41:07.559 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:41:07.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f2b6806d600 msgr2=0x7f2b6806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:07.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f2b6806d600 0x7f2b6806fab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009c60 tx=0x7f2b6c009260 comp rx=0 tx=0).stop 2024-09-13T21:41:07.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 msgr2=0x7f2b7c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:07.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 0x7f2b7c074af0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b78000c00 tx=0x7f2b7800f690 comp rx=0 tx=0).stop 2024-09-13T21:41:07.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 shutdown_connections 2024-09-13T21:41:07.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b7c100240 0x7f2b7c074af0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:07.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f2b6806d600 0x7f2b6806fab0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:07.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 --2- 172.21.15.88:0/1737160441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b7c101440 0x7f2b7c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:07.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 >> 172.21.15.88:0/1737160441 conn(0x7f2b7c0fb7f0 msgr2=0x7f2b7c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:07.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 shutdown_connections 2024-09-13T21:41:07.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:07.559+0000 7f2b83c57700 1 -- 172.21.15.88:0/1737160441 wait complete. 2024-09-13T21:41:07.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:07 smithi088 ceph-mon[27963]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:07.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:07 smithi088 ceph-mon[27963]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:07.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:07 smithi088 ceph-mon[27963]: Adjusting osd_memory_target on smithi088 to 1216M 2024-09-13T21:41:07.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:07 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:41:07.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:07 smithi088 ceph-mon[27963]: mgrmap e24: smithi116.bqnvtn(active, since 9s), standbys: smithi088.scyrwy 2024-09-13T21:41:07.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:07 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2083961619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:41:08.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:07 smithi116 ceph-mon[33391]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:08.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:07 smithi116 ceph-mon[33391]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:08.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:07 smithi116 ceph-mon[33391]: Adjusting osd_memory_target on smithi088 to 1216M 2024-09-13T21:41:08.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:07 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:41:08.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:07 smithi116 ceph-mon[33391]: mgrmap e24: smithi116.bqnvtn(active, since 9s), standbys: smithi088.scyrwy 2024-09-13T21:41:08.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:07 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2083961619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:41:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: pgmap v8: 65 pgs: 65 active+clean; 1.8 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 45 KiB/s rd, 1.2 MiB/s wr, 213 op/s 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:09.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:08 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: pgmap v8: 65 pgs: 65 active+clean; 1.8 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 45 KiB/s rd, 1.2 MiB/s wr, 213 op/s 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:09.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:08 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:41:10.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: Adjusting osd_memory_target on smithi116 to 2240M 2024-09-13T21:41:10.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-13T21:41:10.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T21:41:10.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:41:10.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:41:10.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:09 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: Adjusting osd_memory_target on smithi116 to 2240M 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:10.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:09 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:11.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:10 smithi116 ceph-mon[33391]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:41:11.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:10 smithi116 ceph-mon[33391]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:41:11.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:10 smithi116 ceph-mon[33391]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:41:11.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:10 smithi116 ceph-mon[33391]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:41:11.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:10 smithi116 ceph-mon[33391]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-13T21:41:11.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:10 smithi116 ceph-mon[33391]: pgmap v9: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 61 KiB/s rd, 2.0 MiB/s wr, 381 op/s 2024-09-13T21:41:11.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:10 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:41:11.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:10 smithi088 ceph-mon[27963]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:41:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:10 smithi088 ceph-mon[27963]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:41:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:10 smithi088 ceph-mon[27963]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:41:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:10 smithi088 ceph-mon[27963]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:41:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:10 smithi088 ceph-mon[27963]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-13T21:41:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:10 smithi088 ceph-mon[27963]: pgmap v9: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 61 KiB/s rd, 2.0 MiB/s wr, 381 op/s 2024-09-13T21:41:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:10 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:41:12.078 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:11 smithi088 ceph-mon[27963]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-13T21:41:12.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:11 smithi116 ceph-mon[33391]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-13T21:41:13.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:12 smithi116 ceph-mon[33391]: pgmap v10: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 349 op/s 2024-09-13T21:41:13.109 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T21:41:13.109 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T21:41:13.154 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:12 smithi088 ceph-mon[27963]: pgmap v10: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 349 op/s 2024-09-13T21:41:14.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:13 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:14.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:13 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:15.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:14 smithi116 ceph-mon[33391]: pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 70 KiB/s rd, 1.8 MiB/s wr, 375 op/s 2024-09-13T21:41:15.138 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:14 smithi088 ceph-mon[27963]: pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 70 KiB/s rd, 1.8 MiB/s wr, 375 op/s 2024-09-13T21:41:15.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:15 smithi088 ceph-mon[27963]: pgmap v12: 65 pgs: 65 active+clean; 433 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 63 KiB/s rd, 2.6 MiB/s wr, 482 op/s 2024-09-13T21:41:16.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:15 smithi116 ceph-mon[33391]: pgmap v12: 65 pgs: 65 active+clean; 433 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 63 KiB/s rd, 2.6 MiB/s wr, 482 op/s 2024-09-13T21:41:16.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:16 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:16 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:16 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:41:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:16 smithi088 ceph-mon[27963]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:41:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:16 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:16 smithi088 ceph-mon[27963]: Upgrade: Need to upgrade myself (mgr.smithi116.bqnvtn) 2024-09-13T21:41:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:16 smithi088 ceph-mon[27963]: Upgrade: Need to upgrade myself (mgr.smithi116.bqnvtn) 2024-09-13T21:41:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:16 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:17.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:16 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:17.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:16 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:41:17.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:16 smithi116 ceph-mon[33391]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:41:17.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:16 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:17.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:16 smithi116 ceph-mon[33391]: Upgrade: Need to upgrade myself (mgr.smithi116.bqnvtn) 2024-09-13T21:41:17.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:16 smithi116 ceph-mon[33391]: Upgrade: Need to upgrade myself (mgr.smithi116.bqnvtn) 2024-09-13T21:41:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:18 smithi088 ceph-mon[27963]: Upgrade: Updating mgr.smithi088.scyrwy 2024-09-13T21:41:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:18 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:18 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.scyrwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:41:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:18 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.scyrwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:41:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:18 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:41:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:18 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:18 smithi088 ceph-mon[27963]: Deploying daemon mgr.smithi088.scyrwy on smithi088 2024-09-13T21:41:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:18 smithi088 ceph-mon[27963]: pgmap v13: 65 pgs: 65 active+clean; 433 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 346 op/s 2024-09-13T21:41:18.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:18 smithi116 ceph-mon[33391]: Upgrade: Updating mgr.smithi088.scyrwy 2024-09-13T21:41:18.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:18 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:18.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:18 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.scyrwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:41:18.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:18 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.scyrwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:41:18.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:18 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:41:18.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:18 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:18.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:18 smithi116 ceph-mon[33391]: Deploying daemon mgr.smithi088.scyrwy on smithi088 2024-09-13T21:41:18.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:18 smithi116 ceph-mon[33391]: pgmap v13: 65 pgs: 65 active+clean; 433 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 346 op/s 2024-09-13T21:41:21.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:20 smithi116 ceph-mon[33391]: pgmap v14: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 60 KiB/s rd, 3.4 MiB/s wr, 529 op/s 2024-09-13T21:41:21.109 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:20 smithi088 ceph-mon[27963]: pgmap v14: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 60 KiB/s rd, 3.4 MiB/s wr, 529 op/s 2024-09-13T21:41:22.130 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:21 smithi088 ceph-mon[27963]: pgmap v15: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 2.4 MiB/s wr, 340 op/s 2024-09-13T21:41:22.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:21 smithi116 ceph-mon[33391]: pgmap v15: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 2.4 MiB/s wr, 340 op/s 2024-09-13T21:41:23.418 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:23 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:23.418 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:23 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:23.418 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:23 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:23.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:23 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:23.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:23 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:23.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:23 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:24.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:24 smithi088 ceph-mon[27963]: pgmap v16: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 379 op/s 2024-09-13T21:41:24.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:24 smithi116 ceph-mon[33391]: pgmap v16: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 379 op/s 2024-09-13T21:41:26.886 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:26 smithi088 ceph-mon[27963]: pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 3.8 MiB/s wr, 542 op/s 2024-09-13T21:41:27.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:26 smithi116 ceph-mon[33391]: pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 3.8 MiB/s wr, 542 op/s 2024-09-13T21:41:28.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: pgmap v18: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 3.0 MiB/s wr, 411 op/s 2024-09-13T21:41:28.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:28.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:28.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:28.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: Standby manager daemon smithi088.scyrwy restarted 2024-09-13T21:41:28.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: Standby manager daemon smithi088.scyrwy started 2024-09-13T21:41:28.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.scyrwy/crt"}]: dispatch 2024-09-13T21:41:28.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:41:28.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.scyrwy/key"}]: dispatch 2024-09-13T21:41:28.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:28 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:41:29.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: pgmap v18: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 3.0 MiB/s wr, 411 op/s 2024-09-13T21:41:29.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:29.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:29.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:29.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: Standby manager daemon smithi088.scyrwy restarted 2024-09-13T21:41:29.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: Standby manager daemon smithi088.scyrwy started 2024-09-13T21:41:29.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.scyrwy/crt"}]: dispatch 2024-09-13T21:41:29.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:41:29.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi088.scyrwy/key"}]: dispatch 2024-09-13T21:41:29.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:28 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:41:30.334 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:30 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:30.334 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:30 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:30.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:30 smithi088 ceph-mon[27963]: mgrmap e25: smithi116.bqnvtn(active, since 31s), standbys: smithi088.scyrwy 2024-09-13T21:41:30.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:30 smithi088 ceph-mon[27963]: pgmap v19: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 63 KiB/s rd, 4.1 MiB/s wr, 669 op/s 2024-09-13T21:41:30.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:30 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:30.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:30 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:30.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:30 smithi116 ceph-mon[33391]: mgrmap e25: smithi116.bqnvtn(active, since 31s), standbys: smithi088.scyrwy 2024-09-13T21:41:30.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:30 smithi116 ceph-mon[33391]: pgmap v19: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 63 KiB/s rd, 4.1 MiB/s wr, 669 op/s 2024-09-13T21:41:32.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:31 smithi088 ceph-mon[27963]: pgmap v20: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.5 MiB/s wr, 485 op/s 2024-09-13T21:41:32.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:31 smithi116 ceph-mon[33391]: pgmap v20: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.5 MiB/s wr, 485 op/s 2024-09-13T21:41:33.552 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T21:41:33.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T21:41:34.135 DEBUG:teuthology.parallel:result is None 2024-09-13T21:41:35.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:34 smithi116 ceph-mon[33391]: pgmap v21: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 68 KiB/s rd, 2.9 MiB/s wr, 591 op/s 2024-09-13T21:41:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:34 smithi088 ceph-mon[27963]: pgmap v21: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 68 KiB/s rd, 2.9 MiB/s wr, 591 op/s 2024-09-13T21:41:36.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:36 smithi088 ceph-mon[27963]: pgmap v22: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s rd, 3.4 MiB/s wr, 689 op/s 2024-09-13T21:41:37.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:36 smithi116 ceph-mon[33391]: pgmap v22: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s rd, 3.4 MiB/s wr, 689 op/s 2024-09-13T21:41:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.671+0000 7f137ab50700 1 -- 172.21.15.88:0/928510234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 msgr2=0x7f13740fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.671+0000 7f137ab50700 1 --2- 172.21.15.88:0/928510234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 0x7f13740fe910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f136c009910 tx=0x7f136c009c20 comp rx=0 tx=0).stop 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.671+0000 7f137ab50700 1 -- 172.21.15.88:0/928510234 shutdown_connections 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.671+0000 7f137ab50700 1 --2- 172.21.15.88:0/928510234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13740fee50 0x7f1374101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.671+0000 7f137ab50700 1 --2- 172.21.15.88:0/928510234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 0x7f13740fe910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.671+0000 7f137ab50700 1 -- 172.21.15.88:0/928510234 >> 172.21.15.88:0/928510234 conn(0x7f13740f9f10 msgr2=0x7f13740fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.671+0000 7f137ab50700 1 -- 172.21.15.88:0/928510234 shutdown_connections 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.671+0000 7f137ab50700 1 -- 172.21.15.88:0/928510234 wait complete. 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f137ab50700 1 Processor -- start 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f137ab50700 1 -- start start 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f137ab50700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 0x7f1374100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f137ab50700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13740fee50 0x7f13740ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f137ab50700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740ffa70 con 0x7f13740fe500 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f137ab50700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740ffbb0 con 0x7f13740fee50 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f13788ec700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 0x7f1374100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f13788ec700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 0x7f1374100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44472/0 (socket says 172.21.15.88:44472) 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f13788ec700 1 -- 172.21.15.88:0/4272040260 learned_addr learned my addr 172.21.15.88:0/4272040260 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f1373fff700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13740fee50 0x7f13740ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f13788ec700 1 -- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13740fee50 msgr2=0x7f13740ff530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f13788ec700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13740fee50 0x7f13740ff530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f13788ec700 1 -- 172.21.15.88:0/4272040260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0095f0 con 0x7f13740fe500 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.672+0000 7f13788ec700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 0x7f1374100ee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f136c000c00 tx=0x7f136c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.673+0000 7f1371ffb700 1 -- 172.21.15.88:0/4272040260 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136c01d070 con 0x7f13740fe500 2024-09-13T21:41:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.673+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13740ffe30 con 0x7f13740fe500 2024-09-13T21:41:37.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.673+0000 7f1371ffb700 1 -- 172.21.15.88:0/4272040260 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f136c005dc0 con 0x7f13740fe500 2024-09-13T21:41:37.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.673+0000 7f1371ffb700 1 -- 172.21.15.88:0/4272040260 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136c0226a0 con 0x7f13740fe500 2024-09-13T21:41:37.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.673+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1374100320 con 0x7f13740fe500 2024-09-13T21:41:37.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.674+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1374108d50 con 0x7f13740fe500 2024-09-13T21:41:37.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.674+0000 7f1371ffb700 1 -- 172.21.15.88:0/4272040260 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 92508+0+0 (secure 0 0 0) 0x7f136c0038f0 con 0x7f13740fe500 2024-09-13T21:41:37.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.675+0000 7f1371ffb700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f136006e440 0x7f13600708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:37.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.675+0000 7f1371ffb700 1 -- 172.21.15.88:0/4272040260 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f136c08f5d0 con 0x7f13740fe500 2024-09-13T21:41:37.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.675+0000 7f1373fff700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f136006e440 0x7f13600708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:37.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.675+0000 7f1373fff700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f136006e440 0x7f13600708f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1374068200 tx=0x7f136400b040 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:37.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.680+0000 7f1371ffb700 1 -- 172.21.15.88:0/4272040260 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f136c05c780 con 0x7f13740fe500 2024-09-13T21:41:37.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.912+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 --> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f137419e070 con 0x7f136006e440 2024-09-13T21:41:37.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.913+0000 7f1371ffb700 1 -- 172.21.15.88:0/4272040260 <== mgr.14574 v2:172.21.15.116:6828/622892853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f137419e070 con 0x7f136006e440 2024-09-13T21:41:37.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.915+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f136006e440 msgr2=0x7f13600708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:37.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.915+0000 7f137ab50700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f136006e440 0x7f13600708f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1374068200 tx=0x7f136400b040 comp rx=0 tx=0).stop 2024-09-13T21:41:37.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.915+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 msgr2=0x7f1374100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:37.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.915+0000 7f137ab50700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 0x7f1374100ee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f136c000c00 tx=0x7f136c00f690 comp rx=0 tx=0).stop 2024-09-13T21:41:37.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.915+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 shutdown_connections 2024-09-13T21:41:37.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.915+0000 7f137ab50700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13740fe500 0x7f1374100ee0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:37.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.915+0000 7f137ab50700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f136006e440 0x7f13600708f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:37.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.915+0000 7f137ab50700 1 --2- 172.21.15.88:0/4272040260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13740fee50 0x7f13740ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:37.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.915+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 >> 172.21.15.88:0/4272040260 conn(0x7f13740f9f10 msgr2=0x7f13741047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:37.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.916+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 shutdown_connections 2024-09-13T21:41:37.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:37.916+0000 7f137ab50700 1 -- 172.21.15.88:0/4272040260 wait complete. 2024-09-13T21:41:37.929 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:41:38.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.024+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3091498023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac74100750 msgr2=0x7fac74100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.024+0000 7fac7bdd2700 1 --2- 172.21.15.88:0/3091498023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac74100750 0x7fac74100b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fac70009910 tx=0x7fac70009c20 comp rx=0 tx=0).stop 2024-09-13T21:41:38.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.024+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3091498023 shutdown_connections 2024-09-13T21:41:38.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.024+0000 7fac7bdd2700 1 --2- 172.21.15.88:0/3091498023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac741010a0 0x7fac740ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.024+0000 7fac7bdd2700 1 --2- 172.21.15.88:0/3091498023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac74100750 0x7fac74100b60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.024+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3091498023 >> 172.21.15.88:0/3091498023 conn(0x7fac740f9f10 msgr2=0x7fac740fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:38.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.024+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3091498023 shutdown_connections 2024-09-13T21:41:38.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.024+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3091498023 wait complete. 2024-09-13T21:41:38.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac7bdd2700 1 Processor -- start 2024-09-13T21:41:38.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac7bdd2700 1 -- start start 2024-09-13T21:41:38.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac7bdd2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac74100750 0x7fac741949e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac7bdd2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac741010a0 0x7fac74194f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac7bdd2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac74195540 con 0x7fac741010a0 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac7bdd2700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac74195680 con 0x7fac74100750 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac7936d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac741010a0 0x7fac74194f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac7936d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac741010a0 0x7fac74194f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44490/0 (socket says 172.21.15.88:44490) 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac7936d700 1 -- 172.21.15.88:0/3103083787 learned_addr learned my addr 172.21.15.88:0/3103083787 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.025+0000 7fac79b6e700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac74100750 0x7fac741949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.026+0000 7fac7936d700 1 -- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac74100750 msgr2=0x7fac741949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.026+0000 7fac7936d700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac74100750 0x7fac741949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.026+0000 7fac7936d700 1 -- 172.21.15.88:0/3103083787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac700095f0 con 0x7fac741010a0 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.026+0000 7fac7936d700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac741010a0 0x7fac74194f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fac6400eab0 tx=0x7fac6400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.026+0000 7fac6affd700 1 -- 172.21.15.88:0/3103083787 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac64013070 con 0x7fac741010a0 2024-09-13T21:41:38.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.026+0000 7fac6affd700 1 -- 172.21.15.88:0/3103083787 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fac64017410 con 0x7fac741010a0 2024-09-13T21:41:38.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.026+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac740fe3a0 con 0x7fac741010a0 2024-09-13T21:41:38.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.026+0000 7fac6affd700 1 -- 172.21.15.88:0/3103083787 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac640165e0 con 0x7fac741010a0 2024-09-13T21:41:38.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.026+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac740fe8f0 con 0x7fac741010a0 2024-09-13T21:41:38.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.027+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac74107c00 con 0x7fac741010a0 2024-09-13T21:41:38.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.027+0000 7fac6affd700 1 -- 172.21.15.88:0/3103083787 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 92508+0+0 (secure 0 0 0) 0x7fac64017580 con 0x7fac741010a0 2024-09-13T21:41:38.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.028+0000 7fac6affd700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fac6006e440 0x7fac600708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.028+0000 7fac6affd700 1 -- 172.21.15.88:0/3103083787 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fac6408fa70 con 0x7fac741010a0 2024-09-13T21:41:38.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.028+0000 7fac79b6e700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fac6006e440 0x7fac600708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.029+0000 7fac79b6e700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fac6006e440 0x7fac600708f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac70009fd0 tx=0x7fac70005fd0 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:38.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.032+0000 7fac6affd700 1 -- 172.21.15.88:0/3103083787 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fac6405cc50 con 0x7fac741010a0 2024-09-13T21:41:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.269+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 --> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac74104db0 con 0x7fac6006e440 2024-09-13T21:41:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.270+0000 7fac6affd700 1 -- 172.21.15.88:0/3103083787 <== mgr.14574 v2:172.21.15.116:6828/622892853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fac74104db0 con 0x7fac6006e440 2024-09-13T21:41:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fac6006e440 msgr2=0x7fac600708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fac6006e440 0x7fac600708f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac70009fd0 tx=0x7fac70005fd0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac741010a0 msgr2=0x7fac74194f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac741010a0 0x7fac74194f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fac6400eab0 tx=0x7fac6400edc0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 shutdown_connections 2024-09-13T21:41:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fac6006e440 0x7fac600708f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac74100750 0x7fac741949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 --2- 172.21.15.88:0/3103083787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac741010a0 0x7fac74194f20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 >> 172.21.15.88:0/3103083787 conn(0x7fac740f9f10 msgr2=0x7fac74103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 shutdown_connections 2024-09-13T21:41:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.273+0000 7fac7bdd2700 1 -- 172.21.15.88:0/3103083787 wait complete. 2024-09-13T21:41:38.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.380+0000 7f3981a86700 1 -- 172.21.15.88:0/1215683704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 msgr2=0x7f397c0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.380+0000 7f3981a86700 1 --2- 172.21.15.88:0/1215683704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 0x7f397c0731e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f396c009910 tx=0x7f396c009c20 comp rx=0 tx=0).stop 2024-09-13T21:41:38.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.380+0000 7f3981a86700 1 -- 172.21.15.88:0/1215683704 shutdown_connections 2024-09-13T21:41:38.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.380+0000 7f3981a86700 1 --2- 172.21.15.88:0/1215683704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f397c0737b0 0x7f397c073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.380+0000 7f3981a86700 1 --2- 172.21.15.88:0/1215683704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 0x7f397c0731e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.380+0000 7f3981a86700 1 -- 172.21.15.88:0/1215683704 >> 172.21.15.88:0/1215683704 conn(0x7f397c0fb7f0 msgr2=0x7f397c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:38.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.380+0000 7f3981a86700 1 -- 172.21.15.88:0/1215683704 shutdown_connections 2024-09-13T21:41:38.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.380+0000 7f3981a86700 1 -- 172.21.15.88:0/1215683704 wait complete. 2024-09-13T21:41:38.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.381+0000 7f3981a86700 1 Processor -- start 2024-09-13T21:41:38.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.381+0000 7f3981a86700 1 -- start start 2024-09-13T21:41:38.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.381+0000 7f3981a86700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f397c0737b0 0x7f397c19c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.381+0000 7f3981a86700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 0x7f397c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.381+0000 7f3981a86700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c19cbf0 con 0x7f397c074d80 2024-09-13T21:41:38.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.381+0000 7f3981a86700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c19cd30 con 0x7f397c0737b0 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f397affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 0x7f397c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f397affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 0x7f397c19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44516/0 (socket says 172.21.15.88:44516) 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f397affd700 1 -- 172.21.15.88:0/2774802681 learned_addr learned my addr 172.21.15.88:0/2774802681 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f397b7fe700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f397c0737b0 0x7f397c19c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f397affd700 1 -- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f397c0737b0 msgr2=0x7f397c19c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f397affd700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f397c0737b0 0x7f397c19c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f397affd700 1 -- 172.21.15.88:0/2774802681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0095f0 con 0x7f397c074d80 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f397affd700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 0x7f397c19c5d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f397000e920 tx=0x7f397000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f3978ff9700 1 -- 172.21.15.88:0/2774802681 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397000c9d0 con 0x7f397c074d80 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c1a17e0 con 0x7f397c074d80 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f3978ff9700 1 -- 172.21.15.88:0/2774802681 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3970010430 con 0x7f397c074d80 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f3978ff9700 1 -- 172.21.15.88:0/2774802681 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3970018650 con 0x7f397c074d80 2024-09-13T21:41:38.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.382+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c1a1d30 con 0x7f397c074d80 2024-09-13T21:41:38.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.383+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c10f370 con 0x7f397c074d80 2024-09-13T21:41:38.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.384+0000 7f3978ff9700 1 -- 172.21.15.88:0/2774802681 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 92508+0+0 (secure 0 0 0) 0x7f39700105a0 con 0x7f397c074d80 2024-09-13T21:41:38.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.384+0000 7f3978ff9700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f396406e440 0x7f39640708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.384+0000 7f3978ff9700 1 -- 172.21.15.88:0/2774802681 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3970014070 con 0x7f397c074d80 2024-09-13T21:41:38.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.385+0000 7f397b7fe700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f396406e440 0x7f39640708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.385+0000 7f397b7fe700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f396406e440 0x7f39640708f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f396c009fd0 tx=0x7f396c005940 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:38.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.389+0000 7f3978ff9700 1 -- 172.21.15.88:0/2774802681 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f39700539d0 con 0x7f397c074d80 2024-09-13T21:41:38.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.653+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 --> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f397c1a2430 con 0x7f396406e440 2024-09-13T21:41:38.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.664+0000 7f3978ff9700 1 -- 172.21.15.88:0/2774802681 <== mgr.14574 v2:172.21.15.116:6828/622892853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f397c1a2430 con 0x7f396406e440 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (7m) 10s ago 8m 24.8M - 0.25.0 c8568f914cd2 c82eca12b874 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (9m) 10s ago 9m 7654k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (8m) 34s ago 8m 7562k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (9m) 10s ago 9m 6665k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (8m) 34s ago 8m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (7m) 10s ago 8m 88.1M - 9.4.7 954c08fa6188 aa2cd07a9c2d 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (3m) 10s ago 3m 152M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (3m) 10s ago 3m 13.5M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:41:38.667 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (3m) 34s ago 3m 14.9M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (3m) 34s ago 3m 159M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (17s) 10s ago 10m 63.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (85s) 34s ago 8m 480M - 19.1.1-324-gecab7be5 0652ff2b5d78 6eeb3d026c01 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (10m) 10s ago 10m 50.6M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (7m) 34s ago 7m 40.0M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (9m) 10s ago 9m 15.8M - 1.5.0 0da6a335fe13 71ce2b0df304 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (8m) 34s ago 8m 15.8M - 1.5.0 0da6a335fe13 6d3c62590d98 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (7m) 10s ago 7m 204M 1216M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (6m) 10s ago 6m 218M 1216M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (6m) 10s ago 6m 182M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (5m) 34s ago 5m 232M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:41:38.668 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (5m) 34s ago 5m 218M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:41:38.669 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (4m) 34s ago 4m 241M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:41:38.669 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (23s) 10s ago 8m 41.7M - 2.43.0 a07b618ecd1d bd239bcf968d 2024-09-13T21:41:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f396406e440 msgr2=0x7f39640708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f396406e440 0x7f39640708f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f396c009fd0 tx=0x7f396c005940 comp rx=0 tx=0).stop 2024-09-13T21:41:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 msgr2=0x7f397c19c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 0x7f397c19c5d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f397000e920 tx=0x7f397000ec30 comp rx=0 tx=0).stop 2024-09-13T21:41:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 shutdown_connections 2024-09-13T21:41:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f396406e440 0x7f39640708f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f397c0737b0 0x7f397c19c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 --2- 172.21.15.88:0/2774802681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f397c074d80 0x7f397c19c5d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 >> 172.21.15.88:0/2774802681 conn(0x7f397c0fb7f0 msgr2=0x7f397c101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 shutdown_connections 2024-09-13T21:41:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.666+0000 7f3981a86700 1 -- 172.21.15.88:0/2774802681 wait complete. 2024-09-13T21:41:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.774+0000 7fa4d5c39700 1 -- 172.21.15.88:0/2286905860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d00ff150 msgr2=0x7fa4d00ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.774+0000 7fa4d5c39700 1 --2- 172.21.15.88:0/2286905860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d00ff150 0x7fa4d00ff560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009910 tx=0x7fa4c0009c20 comp rx=0 tx=0).stop 2024-09-13T21:41:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.774+0000 7fa4d5c39700 1 -- 172.21.15.88:0/2286905860 shutdown_connections 2024-09-13T21:41:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.774+0000 7fa4d5c39700 1 --2- 172.21.15.88:0/2286905860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4d01003f0 0x7fa4d0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.774+0000 7fa4d5c39700 1 --2- 172.21.15.88:0/2286905860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d00ff150 0x7fa4d00ff560 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.774+0000 7fa4d5c39700 1 -- 172.21.15.88:0/2286905860 >> 172.21.15.88:0/2286905860 conn(0x7fa4d00fa7a0 msgr2=0x7fa4d00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.774+0000 7fa4d5c39700 1 -- 172.21.15.88:0/2286905860 shutdown_connections 2024-09-13T21:41:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.774+0000 7fa4d5c39700 1 -- 172.21.15.88:0/2286905860 wait complete. 2024-09-13T21:41:38.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.774+0000 7fa4d5c39700 1 Processor -- start 2024-09-13T21:41:38.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4d5c39700 1 -- start start 2024-09-13T21:41:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4d5c39700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4d00ff150 0x7fa4d0195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4d5c39700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d01003f0 0x7fa4d0196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4d5c39700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0196970 con 0x7fa4d01003f0 2024-09-13T21:41:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4d5c39700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0196ab0 con 0x7fa4d00ff150 2024-09-13T21:41:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4ceffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d01003f0 0x7fa4d0196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4ceffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d01003f0 0x7fa4d0196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44532/0 (socket says 172.21.15.88:44532) 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4ceffd700 1 -- 172.21.15.88:0/1854032169 learned_addr learned my addr 172.21.15.88:0/1854032169 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4cf7fe700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4d00ff150 0x7fa4d0195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4ceffd700 1 -- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4d00ff150 msgr2=0x7fa4d0195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4ceffd700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4d00ff150 0x7fa4d0195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4ceffd700 1 -- 172.21.15.88:0/1854032169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00095f0 con 0x7fa4d01003f0 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.775+0000 7fa4ceffd700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d01003f0 0x7fa4d0196350 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400d8d0 tx=0x7fa4c400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.776+0000 7fa4ccff9700 1 -- 172.21.15.88:0/1854032169 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c40098a0 con 0x7fa4d01003f0 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.776+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d019b560 con 0x7fa4d01003f0 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.776+0000 7fa4ccff9700 1 -- 172.21.15.88:0/1854032169 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4c4010460 con 0x7fa4d01003f0 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.776+0000 7fa4ccff9700 1 -- 172.21.15.88:0/1854032169 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c400f5f0 con 0x7fa4d01003f0 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.776+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d019bab0 con 0x7fa4d01003f0 2024-09-13T21:41:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.777+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d0068ab0 con 0x7fa4d01003f0 2024-09-13T21:41:38.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.777+0000 7fa4ccff9700 1 -- 172.21.15.88:0/1854032169 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 92508+0+0 (secure 0 0 0) 0x7fa4c4009a00 con 0x7fa4d01003f0 2024-09-13T21:41:38.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.778+0000 7fa4ccff9700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fa4b806e440 0x7fa4b80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.778+0000 7fa4ccff9700 1 -- 172.21.15.88:0/1854032169 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa4c408e0c0 con 0x7fa4d01003f0 2024-09-13T21:41:38.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.778+0000 7fa4cf7fe700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fa4b806e440 0x7fa4b80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.778+0000 7fa4cf7fe700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fa4b806e440 0x7fa4b80708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0006010 tx=0x7fa4c000b540 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:38.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:38.782+0000 7fa4ccff9700 1 -- 172.21.15.88:0/1854032169 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fa4c405b1f0 con 0x7fa4d01003f0 2024-09-13T21:41:38.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:38 smithi088 ceph-mon[27963]: pgmap v23: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.2 MiB/s wr, 500 op/s 2024-09-13T21:41:39.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:38 smithi116 ceph-mon[33391]: pgmap v23: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.2 MiB/s wr, 500 op/s 2024-09-13T21:41:39.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.124+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa4d019bd90 con 0x7fa4d01003f0 2024-09-13T21:41:39.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.124+0000 7fa4ccff9700 1 -- 172.21.15.88:0/1854032169 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fa4c405ad80 con 0x7fa4d01003f0 2024-09-13T21:41:39.127 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:41:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:41:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:41:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:41:39.127 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:41:39.128 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:41:39.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fa4b806e440 msgr2=0x7fa4b80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fa4b806e440 0x7fa4b80708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0006010 tx=0x7fa4c000b540 comp rx=0 tx=0).stop 2024-09-13T21:41:39.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d01003f0 msgr2=0x7fa4d0196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d01003f0 0x7fa4d0196350 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400d8d0 tx=0x7fa4c400dbe0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 shutdown_connections 2024-09-13T21:41:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7fa4b806e440 0x7fa4b80708f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4d00ff150 0x7fa4d0195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 --2- 172.21.15.88:0/1854032169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d01003f0 0x7fa4d0196350 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 >> 172.21.15.88:0/1854032169 conn(0x7fa4d00fa7a0 msgr2=0x7fa4d0068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 shutdown_connections 2024-09-13T21:41:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.127+0000 7fa4d5c39700 1 -- 172.21.15.88:0/1854032169 wait complete. 2024-09-13T21:41:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.242+0000 7f919774e700 1 -- 172.21.15.88:0/1037029273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190103600 msgr2=0x7f91901059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.242+0000 7f919774e700 1 --2- 172.21.15.88:0/1037029273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190103600 0x7f91901059e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9180009910 tx=0x7f9180009c20 comp rx=0 tx=0).stop 2024-09-13T21:41:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.242+0000 7f919774e700 1 -- 172.21.15.88:0/1037029273 shutdown_connections 2024-09-13T21:41:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.242+0000 7f919774e700 1 --2- 172.21.15.88:0/1037029273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190103600 0x7f91901059e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.242+0000 7f919774e700 1 --2- 172.21.15.88:0/1037029273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9190100ce0 0x7f91901030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.242+0000 7f919774e700 1 -- 172.21.15.88:0/1037029273 >> 172.21.15.88:0/1037029273 conn(0x7f91900fa700 msgr2=0x7f91900fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.242+0000 7f919774e700 1 -- 172.21.15.88:0/1037029273 shutdown_connections 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.242+0000 7f919774e700 1 -- 172.21.15.88:0/1037029273 wait complete. 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f919774e700 1 Processor -- start 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f919774e700 1 -- start start 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f919774e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190100ce0 0x7f9190195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f919774e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9190103600 0x7f9190196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f919774e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190196620 con 0x7f9190100ce0 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f919774e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190196760 con 0x7f9190103600 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f91954ea700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190100ce0 0x7f9190195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f91954ea700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190100ce0 0x7f9190195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44548/0 (socket says 172.21.15.88:44548) 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f91954ea700 1 -- 172.21.15.88:0/3091593541 learned_addr learned my addr 172.21.15.88:0/3091593541 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:41:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f9194ce9700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9190103600 0x7f9190196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f91954ea700 1 -- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9190103600 msgr2=0x7f9190196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f91954ea700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9190103600 0x7f9190196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.243+0000 7f91954ea700 1 -- 172.21.15.88:0/3091593541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91800095f0 con 0x7f9190100ce0 2024-09-13T21:41:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.244+0000 7f91954ea700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190100ce0 0x7f9190195ac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f918c00e920 tx=0x7f918c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.244+0000 7f91867fc700 1 -- 172.21.15.88:0/3091593541 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f918c00c9d0 con 0x7f9190100ce0 2024-09-13T21:41:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.244+0000 7f91867fc700 1 -- 172.21.15.88:0/3091593541 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f918c010430 con 0x7f9190100ce0 2024-09-13T21:41:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.244+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919019b1c0 con 0x7f9190100ce0 2024-09-13T21:41:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.244+0000 7f91867fc700 1 -- 172.21.15.88:0/3091593541 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f918c018650 con 0x7f9190100ce0 2024-09-13T21:41:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.244+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919019b710 con 0x7f9190100ce0 2024-09-13T21:41:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.245+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919018fc70 con 0x7f9190100ce0 2024-09-13T21:41:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.245+0000 7f91867fc700 1 -- 172.21.15.88:0/3091593541 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 25) v1 ==== 92508+0+0 (secure 0 0 0) 0x7f918c0105a0 con 0x7f9190100ce0 2024-09-13T21:41:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.246+0000 7f91867fc700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f917c06e440 0x7f917c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.246+0000 7f91867fc700 1 -- 172.21.15.88:0/3091593541 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f918c014070 con 0x7f9190100ce0 2024-09-13T21:41:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.246+0000 7f9194ce9700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f917c06e440 0x7f917c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.246+0000 7f9194ce9700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f917c06e440 0x7f917c0708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9180009fd0 tx=0x7f9180005940 comp rx=0 tx=0).ready entity=mgr.14574 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:39.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.250+0000 7f91867fc700 1 -- 172.21.15.88:0/3091593541 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f918c0539d0 con 0x7f9190100ce0 2024-09-13T21:41:39.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.552+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 --> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9190061190 con 0x7f917c06e440 2024-09-13T21:41:39.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.554+0000 7f91867fc700 1 -- 172.21.15.88:0/3091593541 <== mgr.14574 v2:172.21.15.116:6828/622892853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f9190061190 con 0x7f917c06e440 2024-09-13T21:41:39.556 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:41:39.557 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:41:39.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.558+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f917c06e440 msgr2=0x7f917c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.558+0000 7f919774e700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f917c06e440 0x7f917c0708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9180009fd0 tx=0x7f9180005940 comp rx=0 tx=0).stop 2024-09-13T21:41:39.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.558+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190100ce0 msgr2=0x7f9190195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.558+0000 7f919774e700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190100ce0 0x7f9190195ac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f918c00e920 tx=0x7f918c00ec30 comp rx=0 tx=0).stop 2024-09-13T21:41:39.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.558+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 shutdown_connections 2024-09-13T21:41:39.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.558+0000 7f919774e700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9190100ce0 0x7f9190195ac0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.558+0000 7f919774e700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:6828/622892853,v1:172.21.15.116:6829/622892853] conn(0x7f917c06e440 0x7f917c0708f0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9180009fd0 tx=0x7f9180005940 comp rx=0 tx=0).stop 2024-09-13T21:41:39.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.558+0000 7f919774e700 1 --2- 172.21.15.88:0/3091593541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9190103600 0x7f9190196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.558+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 >> 172.21.15.88:0/3091593541 conn(0x7f91900fa700 msgr2=0x7f91900fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:39.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.560+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 shutdown_connections 2024-09-13T21:41:39.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:41:39.560+0000 7f919774e700 1 -- 172.21.15.88:0/3091593541 wait complete. 2024-09-13T21:41:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:39 smithi116 ceph-mon[33391]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:39 smithi116 ceph-mon[33391]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:39 smithi116 ceph-mon[33391]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:39 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/1854032169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:41:40.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:39 smithi088 ceph-mon[27963]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:40.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:39 smithi088 ceph-mon[27963]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:40.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:39 smithi088 ceph-mon[27963]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:40.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:39 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1854032169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:41:40.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:40 smithi116 ceph-mon[33391]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:40.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:40 smithi116 ceph-mon[33391]: pgmap v24: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 63 KiB/s rd, 3.0 MiB/s wr, 652 op/s 2024-09-13T21:41:40.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:40 smithi088 ceph-mon[27963]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:40.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:40 smithi088 ceph-mon[27963]: pgmap v24: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 63 KiB/s rd, 3.0 MiB/s wr, 652 op/s 2024-09-13T21:41:43.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: pgmap v25: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 393 op/s 2024-09-13T21:41:43.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:43.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:43.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:43.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:41:43.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:43.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:43.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr fail", "who": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:41:43.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr fail", "who": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd='[{"prefix": "mgr fail", "who": "smithi116.bqnvtn"}]': finished 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: mgrmap e26: smithi088.scyrwy(active, starting, since 0.00749878s) 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:41:43.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: Manager daemon smithi088.scyrwy is now available 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:41:43.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/trash_purge_schedule"}]: dispatch 2024-09-13T21:41:43.236 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: pgmap v25: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 393 op/s 2024-09-13T21:41:43.236 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:43.236 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:43.236 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:43.236 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:41:43.236 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' 2024-09-13T21:41:43.236 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14574 172.21.15.116:0/3924661038' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr fail", "who": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "mgr fail", "who": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14574 ' entity='mgr.smithi116.bqnvtn' cmd='[{"prefix": "mgr fail", "who": "smithi116.bqnvtn"}]': finished 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: mgrmap e26: smithi088.scyrwy(active, starting, since 0.00749878s) 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:41:43.237 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: Manager daemon smithi088.scyrwy is now available 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:41:43.238 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/trash_purge_schedule"}]: dispatch 2024-09-13T21:41:44.169 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:43 smithi116 ceph-mon[33391]: mgrmap e27: smithi088.scyrwy(active, since 1.01778s) 2024-09-13T21:41:44.169 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:43 smithi116 ceph-mon[33391]: pgmap v3: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:44.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:43 smithi088 ceph-mon[27963]: mgrmap e27: smithi088.scyrwy(active, since 1.01778s) 2024-09-13T21:41:44.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:43 smithi088 ceph-mon[27963]: pgmap v3: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:45.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:44 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:44] ENGINE Bus STARTING 2024-09-13T21:41:45.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:44 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:44] ENGINE Serving on http://172.21.15.88:8765 2024-09-13T21:41:45.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:44 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:44] ENGINE Serving on https://172.21.15.88:7150 2024-09-13T21:41:45.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:44 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:44] ENGINE Bus STARTED 2024-09-13T21:41:45.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:44 smithi088 ceph-mon[27963]: [13/Sep/2024:21:41:44] ENGINE Error in HTTPServer.serve 2024-09-13T21:41:45.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Traceback (most recent call last): 2024-09-13T21:41:45.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:41:45.219 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._run(expiration_interval) 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s = self.context.wrap_socket( 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: return self.sslsocket_class._create( 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:41:45.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self.do_handshake() 2024-09-13T21:41:45.221 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:41:45.221 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._sslobj.do_handshake() 2024-09-13T21:41:45.221 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:41:45.286 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:44 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:44] ENGINE Bus STARTING 2024-09-13T21:41:45.286 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:44 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:44] ENGINE Serving on http://172.21.15.88:8765 2024-09-13T21:41:45.286 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:44 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:44] ENGINE Serving on https://172.21.15.88:7150 2024-09-13T21:41:45.286 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:44 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:44] ENGINE Bus STARTED 2024-09-13T21:41:45.286 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:44 smithi116 ceph-mon[33391]: [13/Sep/2024:21:41:44] ENGINE Error in HTTPServer.serve 2024-09-13T21:41:45.286 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Traceback (most recent call last): 2024-09-13T21:41:45.288 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:41:45.288 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:41:45.288 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:41:45.288 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self._run(expiration_interval) 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: s = self.context.wrap_socket( 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: return self.sslsocket_class._create( 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self.do_handshake() 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self._sslobj.do_handshake() 2024-09-13T21:41:45.289 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:41:46.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:45 smithi088 ceph-mon[27963]: mgrmap e28: smithi088.scyrwy(active, since 3s) 2024-09-13T21:41:46.260 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:45 smithi116 ceph-mon[33391]: mgrmap e28: smithi088.scyrwy(active, since 3s) 2024-09-13T21:41:47.349 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:47 smithi088 ceph-mon[27963]: pgmap v5: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:47.349 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:47 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:47.349 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:47 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:47.349 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:47 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:47.349 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:47 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:47 smithi116 ceph-mon[33391]: pgmap v5: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:47 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:47 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:47 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:47.625 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:47 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:48.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:48 smithi088 ceph-mon[27963]: Standby manager daemon smithi116.bqnvtn started 2024-09-13T21:41:48.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:48 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/2167997440' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/crt"}]: dispatch 2024-09-13T21:41:48.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:48 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/2167997440' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:41:48.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:48 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/2167997440' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/key"}]: dispatch 2024-09-13T21:41:48.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:48 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/2167997440' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:41:48.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:48 smithi116 ceph-mon[33391]: Standby manager daemon smithi116.bqnvtn started 2024-09-13T21:41:48.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:48 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/2167997440' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/crt"}]: dispatch 2024-09-13T21:41:48.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:48 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/2167997440' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:41:48.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:48 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/2167997440' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/key"}]: dispatch 2024-09-13T21:41:48.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:48 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/2167997440' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:41:49.658 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:49 smithi088 ceph-mon[27963]: pgmap v6: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:49.658 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:49 smithi088 ceph-mon[27963]: mgrmap e29: smithi088.scyrwy(active, since 6s), standbys: smithi116.bqnvtn 2024-09-13T21:41:49.658 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:49 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi116.bqnvtn", "id": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:41:49.659 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:49 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:49.659 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:49 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:49.659 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:49 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:49.659 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:49 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:49.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:49 smithi116 ceph-mon[33391]: pgmap v6: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:49.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:49 smithi116 ceph-mon[33391]: mgrmap e29: smithi088.scyrwy(active, since 6s), standbys: smithi116.bqnvtn 2024-09-13T21:41:49.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:49 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi116.bqnvtn", "id": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:41:49.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:49 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:49.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:49 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:49.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:49 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:49.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:49 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:52.173 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:51 smithi088 ceph-mon[27963]: pgmap v7: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 1.1 MiB/s wr, 265 op/s 2024-09-13T21:41:52.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:51 smithi116 ceph-mon[33391]: pgmap v7: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 1.1 MiB/s wr, 265 op/s 2024-09-13T21:41:53.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:53 smithi088 ceph-mon[27963]: pgmap v8: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 874 KiB/s wr, 206 op/s 2024-09-13T21:41:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:53 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:53 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:53 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:53 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:41:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:53 smithi088 ceph-mon[27963]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-13T21:41:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:53 smithi088 ceph-mon[27963]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T21:41:54.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:53 smithi116 ceph-mon[33391]: pgmap v8: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 874 KiB/s wr, 206 op/s 2024-09-13T21:41:54.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:53 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:54.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:53 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:54.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:53 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:54.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:53 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:41:54.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:53 smithi116 ceph-mon[33391]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-13T21:41:54.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:53 smithi116 ceph-mon[33391]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T21:41:54.883 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:54.884 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:54 smithi088 ceph-mon[27963]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-13T21:41:55.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:41:55.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:41:55.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:41:55.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:41:55.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:41:55.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:41:55.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:55.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:55.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:55.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:55.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:41:55.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:54 smithi116 ceph-mon[33391]: Reconfiguring prometheus.smithi088 (dependencies changed)... 2024-09-13T21:41:55.190 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T21:41:55.190 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T21:41:55.547 DEBUG:teuthology.parallel:result is None 2024-09-13T21:41:55.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T21:41:55.581 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T21:41:55.581 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T21:41:55.616 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T21:41:55.616 DEBUG:teuthology.parallel:result is None 2024-09-13T21:41:55.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:55 smithi116 ceph-mon[33391]: pgmap v9: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 1.4 MiB/s wr, 333 op/s 2024-09-13T21:41:55.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:55 smithi116 ceph-mon[33391]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-13T21:41:55.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:55 smithi088 ceph-mon[27963]: pgmap v9: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 1.4 MiB/s wr, 333 op/s 2024-09-13T21:41:55.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:55 smithi088 ceph-mon[27963]: Reconfiguring daemon prometheus.smithi088 on smithi088 2024-09-13T21:41:57.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:57 smithi116 ceph-mon[33391]: pgmap v10: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 305 op/s 2024-09-13T21:41:57.410 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:57 smithi088 ceph-mon[27963]: pgmap v10: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 305 op/s 2024-09-13T21:41:58.181 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:58 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:58.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:58 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:59.179 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:41:59 smithi088 ceph-mon[27963]: pgmap v11: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 305 op/s 2024-09-13T21:41:59.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:41:59 smithi116 ceph-mon[33391]: pgmap v11: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 305 op/s 2024-09-13T21:42:00.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:00 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:00 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:00 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:42:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:00 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:42:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:00 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:01.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:00 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:01.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:00 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:01.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:00 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:42:01.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:00 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:42:01.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:00 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:01.965 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:01 smithi116 ceph-mon[33391]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 1.6 MiB/s wr, 388 op/s 2024-09-13T21:42:01.965 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:01 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:42:01.965 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:01 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:42:01.965 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:01 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:01.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:01 smithi088 ceph-mon[27963]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 1.6 MiB/s wr, 388 op/s 2024-09-13T21:42:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:01 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:42:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:01 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:42:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:01 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:02.769 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:02 smithi116 ceph-mon[33391]: Upgrade: Updating mgr.smithi116.bqnvtn 2024-09-13T21:42:02.769 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:02 smithi116 ceph-mon[33391]: Deploying daemon mgr.smithi116.bqnvtn on smithi116 2024-09-13T21:42:02.971 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:02 smithi088 ceph-mon[27963]: Upgrade: Updating mgr.smithi116.bqnvtn 2024-09-13T21:42:02.971 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:02 smithi088 ceph-mon[27963]: Deploying daemon mgr.smithi116.bqnvtn on smithi116 2024-09-13T21:42:03.958 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:03 smithi116 ceph-mon[33391]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 934 KiB/s wr, 234 op/s 2024-09-13T21:42:03.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:03 smithi088 ceph-mon[27963]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 934 KiB/s wr, 234 op/s 2024-09-13T21:42:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:05 smithi116 ceph-mon[33391]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 935 KiB/s wr, 235 op/s 2024-09-13T21:42:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:05 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:05 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:05 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:06.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:05 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:06.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:05 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:06.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:05 smithi088 ceph-mon[27963]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 935 KiB/s wr, 235 op/s 2024-09-13T21:42:06.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:05 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:06.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:05 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:06.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:05 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:06.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:05 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:06.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:05 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:06 smithi088 ceph-mon[27963]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 314 KiB/s wr, 84 op/s 2024-09-13T21:42:07.300 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:06 smithi116 ceph-mon[33391]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 314 KiB/s wr, 84 op/s 2024-09-13T21:42:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:08 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:08 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:08 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:08 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:08 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:08 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:08 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:08 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:09.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.689+0000 7fc3dab34700 1 -- 172.21.15.88:0/2755485330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4100740 msgr2=0x7fc3d4100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:09.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.689+0000 7fc3dab34700 1 --2- 172.21.15.88:0/2755485330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4100740 0x7fc3d4100b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009910 tx=0x7fc3c8009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:09.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.689+0000 7fc3dab34700 1 -- 172.21.15.88:0/2755485330 shutdown_connections 2024-09-13T21:42:09.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.689+0000 7fc3dab34700 1 --2- 172.21.15.88:0/2755485330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3d4101090 0x7fc3d40ff490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.689+0000 7fc3dab34700 1 --2- 172.21.15.88:0/2755485330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4100740 0x7fc3d4100b50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.689+0000 7fc3dab34700 1 -- 172.21.15.88:0/2755485330 >> 172.21.15.88:0/2755485330 conn(0x7fc3d40f9f10 msgr2=0x7fc3d40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.690+0000 7fc3dab34700 1 -- 172.21.15.88:0/2755485330 shutdown_connections 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.690+0000 7fc3dab34700 1 -- 172.21.15.88:0/2755485330 wait complete. 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.690+0000 7fc3dab34700 1 Processor -- start 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.690+0000 7fc3dab34700 1 -- start start 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.690+0000 7fc3dab34700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3d4100740 0x7fc3d4194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.690+0000 7fc3dab34700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4101090 0x7fc3d4194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.690+0000 7fc3dab34700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4195570 con 0x7fc3d4101090 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.690+0000 7fc3dab34700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d41956b0 con 0x7fc3d4100740 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.690+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4101090 0x7fc3d4194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4101090 0x7fc3d4194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37852/0 (socket says 172.21.15.88:37852) 2024-09-13T21:42:09.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d3fff700 1 -- 172.21.15.88:0/96004382 learned_addr learned my addr 172.21.15.88:0/96004382 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d88d0700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3d4100740 0x7fc3d4194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d3fff700 1 -- 172.21.15.88:0/96004382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3d4100740 msgr2=0x7fc3d4194a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d3fff700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3d4100740 0x7fc3d4194a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:09.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d3fff700 1 -- 172.21.15.88:0/96004382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80095f0 con 0x7fc3d4101090 2024-09-13T21:42:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d3fff700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4101090 0x7fc3d4194f50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000d8d0 tx=0x7fc3c000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d1ffb700 1 -- 172.21.15.88:0/96004382 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c00041f0 con 0x7fc3d4101090 2024-09-13T21:42:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d1ffb700 1 -- 172.21.15.88:0/96004382 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3c0004ce0 con 0x7fc3d4101090 2024-09-13T21:42:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d419a160 con 0x7fc3d4101090 2024-09-13T21:42:09.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.691+0000 7fc3d1ffb700 1 -- 172.21.15.88:0/96004382 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c000f690 con 0x7fc3d4101090 2024-09-13T21:42:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.692+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d419a6b0 con 0x7fc3d4101090 2024-09-13T21:42:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.692+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d4107c50 con 0x7fc3d4101090 2024-09-13T21:42:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.693+0000 7fc3d1ffb700 1 -- 172.21.15.88:0/96004382 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 29) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fc3c0004e50 con 0x7fc3d4101090 2024-09-13T21:42:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.693+0000 7fc3d1ffb700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fc3c406e440 0x7fc3c40708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.693+0000 7fc3d1ffb700 1 -- 172.21.15.88:0/96004382 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fc3c008e1f0 con 0x7fc3d4101090 2024-09-13T21:42:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.693+0000 7fc3d88d0700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fc3c406e440 0x7fc3c40708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:09.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.694+0000 7fc3d88d0700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fc3c406e440 0x7fc3c40708f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800b5c0 tx=0x7fc3c8005ee0 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:09.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.698+0000 7fc3d1ffb700 1 -- 172.21.15.88:0/96004382 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fc3c005b1d0 con 0x7fc3d4101090 2024-09-13T21:42:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.914+0000 7fc3d1ffb700 1 -- 172.21.15.88:0/96004382 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fc3c0004350 con 0x7fc3d4101090 2024-09-13T21:42:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.924+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3d4104df0 con 0x7fc3c406e440 2024-09-13T21:42:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.926+0000 7fc3d1ffb700 1 -- 172.21.15.88:0/96004382 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fc3d4104df0 con 0x7fc3c406e440 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fc3c406e440 msgr2=0x7fc3c40708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fc3c406e440 0x7fc3c40708f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800b5c0 tx=0x7fc3c8005ee0 comp rx=0 tx=0).stop 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4101090 msgr2=0x7fc3d4194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4101090 0x7fc3d4194f50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000d8d0 tx=0x7fc3c000dbe0 comp rx=0 tx=0).stop 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 shutdown_connections 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fc3c406e440 0x7fc3c40708f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3d4100740 0x7fc3d4194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 --2- 172.21.15.88:0/96004382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3d4101090 0x7fc3d4194f50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 >> 172.21.15.88:0/96004382 conn(0x7fc3d40f9f10 msgr2=0x7fc3d41036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 shutdown_connections 2024-09-13T21:42:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:09.928+0000 7fc3dab34700 1 -- 172.21.15.88:0/96004382 wait complete. 2024-09-13T21:42:09.939 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:42:09.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:09 smithi088 ceph-mon[27963]: pgmap v16: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 314 KiB/s wr, 84 op/s 2024-09-13T21:42:09.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:09 smithi088 ceph-mon[27963]: Standby manager daemon smithi116.bqnvtn restarted 2024-09-13T21:42:09.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:09 smithi088 ceph-mon[27963]: Standby manager daemon smithi116.bqnvtn started 2024-09-13T21:42:09.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:09 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/214737570' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/crt"}]: dispatch 2024-09-13T21:42:09.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:09 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/214737570' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:42:09.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:09 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/214737570' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/key"}]: dispatch 2024-09-13T21:42:09.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:09 smithi088 ceph-mon[27963]: from='mgr.? 172.21.15.116:0/214737570' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:42:10.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.035+0000 7f6153647700 1 -- 172.21.15.88:0/2820209010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f614c101450 msgr2=0x7f614c1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.035+0000 7f6153647700 1 --2- 172.21.15.88:0/2820209010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f614c101450 0x7f614c1018a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6140009910 tx=0x7f6140009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:10.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.035+0000 7f6153647700 1 -- 172.21.15.88:0/2820209010 shutdown_connections 2024-09-13T21:42:10.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.035+0000 7f6153647700 1 --2- 172.21.15.88:0/2820209010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f614c101450 0x7f614c1018a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.035+0000 7f6153647700 1 --2- 172.21.15.88:0/2820209010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f614c100250 0x7f614c100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.035+0000 7f6153647700 1 -- 172.21.15.88:0/2820209010 >> 172.21.15.88:0/2820209010 conn(0x7f614c0fb7e0 msgr2=0x7f614c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.036+0000 7f6153647700 1 -- 172.21.15.88:0/2820209010 shutdown_connections 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.036+0000 7f6153647700 1 -- 172.21.15.88:0/2820209010 wait complete. 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.036+0000 7f6153647700 1 Processor -- start 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.036+0000 7f6153647700 1 -- start start 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.036+0000 7f6153647700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f614c100250 0x7f614c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.036+0000 7f6153647700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f614c101450 0x7f614c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.036+0000 7f6153647700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c073680 con 0x7f614c100250 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.036+0000 7f6153647700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0737c0 con 0x7f614c101450 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f6150be2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f614c101450 0x7f614c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f6150be2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f614c101450 0x7f614c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.88:35240/0 (socket says 172.21.15.88:35240) 2024-09-13T21:42:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f6150be2700 1 -- 172.21.15.88:0/3416908101 learned_addr learned my addr 172.21.15.88:0/3416908101 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f61513e3700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f614c100250 0x7f614c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f61513e3700 1 -- 172.21.15.88:0/3416908101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f614c101450 msgr2=0x7f614c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f61513e3700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f614c101450 0x7f614c073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f61513e3700 1 -- 172.21.15.88:0/3416908101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400095f0 con 0x7f614c100250 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f6150be2700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f614c101450 0x7f614c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f61513e3700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f614c100250 0x7f614c074af0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6144007e60 tx=0x7f614400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f614a7fc700 1 -- 172.21.15.88:0/3416908101 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614400dda0 con 0x7f614c100250 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c073aa0 con 0x7f614c100250 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f614a7fc700 1 -- 172.21.15.88:0/3416908101 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f614400f040 con 0x7f614c100250 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f614a7fc700 1 -- 172.21.15.88:0/3416908101 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61440145d0 con 0x7f614c100250 2024-09-13T21:42:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.037+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c19db00 con 0x7f614c100250 2024-09-13T21:42:10.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.038+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c108da0 con 0x7f614c100250 2024-09-13T21:42:10.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.039+0000 7f614a7fc700 1 -- 172.21.15.88:0/3416908101 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f6144015400 con 0x7f614c100250 2024-09-13T21:42:10.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.039+0000 7f614a7fc700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f613406e440 0x7f61340708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:10.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.039+0000 7f614a7fc700 1 -- 172.21.15.88:0/3416908101 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f614408de90 con 0x7f614c100250 2024-09-13T21:42:10.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.039+0000 7f6150be2700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f613406e440 0x7f61340708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:10.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.040+0000 7f6150be2700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f613406e440 0x7f61340708f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6140005090 tx=0x7f614000b560 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:10.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.044+0000 7f614a7fc700 1 -- 172.21.15.88:0/3416908101 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f614405ae70 con 0x7f614c100250 2024-09-13T21:42:10.153 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:09 smithi116 ceph-mon[33391]: pgmap v16: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 314 KiB/s wr, 84 op/s 2024-09-13T21:42:10.153 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:09 smithi116 ceph-mon[33391]: Standby manager daemon smithi116.bqnvtn restarted 2024-09-13T21:42:10.153 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:09 smithi116 ceph-mon[33391]: Standby manager daemon smithi116.bqnvtn started 2024-09-13T21:42:10.153 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:09 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/214737570' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/crt"}]: dispatch 2024-09-13T21:42:10.153 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:09 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/214737570' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:42:10.153 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:09 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/214737570' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/key"}]: dispatch 2024-09-13T21:42:10.153 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:09 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/214737570' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:42:10.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.272+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f614c105da0 con 0x7f613406e440 2024-09-13T21:42:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.273+0000 7f614a7fc700 1 -- 172.21.15.88:0/3416908101 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f614c105da0 con 0x7f613406e440 2024-09-13T21:42:10.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.275+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f613406e440 msgr2=0x7f61340708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.275+0000 7f6153647700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f613406e440 0x7f61340708f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6140005090 tx=0x7f614000b560 comp rx=0 tx=0).stop 2024-09-13T21:42:10.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.275+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f614c100250 msgr2=0x7f614c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.275+0000 7f6153647700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f614c100250 0x7f614c074af0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6144007e60 tx=0x7f614400d3b0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.275+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 shutdown_connections 2024-09-13T21:42:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.275+0000 7f6153647700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f613406e440 0x7f61340708f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.275+0000 7f6153647700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f614c100250 0x7f614c074af0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.275+0000 7f6153647700 1 --2- 172.21.15.88:0/3416908101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f614c101450 0x7f614c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.275+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 >> 172.21.15.88:0/3416908101 conn(0x7f614c0fb7e0 msgr2=0x7f614c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.276+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 shutdown_connections 2024-09-13T21:42:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.276+0000 7f6153647700 1 -- 172.21.15.88:0/3416908101 wait complete. 2024-09-13T21:42:10.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 -- 172.21.15.88:0/2811020638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4103330 msgr2=0x7fdad4105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 --2- 172.21.15.88:0/2811020638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4103330 0x7fdad4105790 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009910 tx=0x7fdac4009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:10.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 -- 172.21.15.88:0/2811020638 shutdown_connections 2024-09-13T21:42:10.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 --2- 172.21.15.88:0/2811020638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4103330 0x7fdad4105790 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 --2- 172.21.15.88:0/2811020638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad4069250 0x7fdad4102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 -- 172.21.15.88:0/2811020638 >> 172.21.15.88:0/2811020638 conn(0x7fdad40fa780 msgr2=0x7fdad40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:10.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 -- 172.21.15.88:0/2811020638 shutdown_connections 2024-09-13T21:42:10.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 -- 172.21.15.88:0/2811020638 wait complete. 2024-09-13T21:42:10.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 Processor -- start 2024-09-13T21:42:10.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.381+0000 7fdadb339700 1 -- start start 2024-09-13T21:42:10.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdadb339700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4069250 0x7fdad4195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:10.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdadb339700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad4103330 0x7fdad4195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:10.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdadb339700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4196610 con 0x7fdad4069250 2024-09-13T21:42:10.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdadb339700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4196750 con 0x7fdad4103330 2024-09-13T21:42:10.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdad90d5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4069250 0x7fdad4195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:10.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdad90d5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4069250 0x7fdad4195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44330/0 (socket says 172.21.15.88:44330) 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdad90d5700 1 -- 172.21.15.88:0/2827859394 learned_addr learned my addr 172.21.15.88:0/2827859394 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdad88d4700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad4103330 0x7fdad4195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdad90d5700 1 -- 172.21.15.88:0/2827859394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad4103330 msgr2=0x7fdad4195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdad90d5700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad4103330 0x7fdad4195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdad90d5700 1 -- 172.21.15.88:0/2827859394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40095f0 con 0x7fdad4069250 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdad90d5700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4069250 0x7fdad4195ab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdad000b990 tx=0x7fdad000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdaca7fc700 1 -- 172.21.15.88:0/2827859394 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad000d8b0 con 0x7fdad4069250 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdaca7fc700 1 -- 172.21.15.88:0/2827859394 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdad0015420 con 0x7fdad4069250 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad419b200 con 0x7fdad4069250 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.382+0000 7fdaca7fc700 1 -- 172.21.15.88:0/2827859394 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad000c630 con 0x7fdad4069250 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.383+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad419b750 con 0x7fdad4069250 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.383+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad418fc70 con 0x7fdad4069250 2024-09-13T21:42:10.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.384+0000 7fdaca7fc700 1 -- 172.21.15.88:0/2827859394 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fdad0015590 con 0x7fdad4069250 2024-09-13T21:42:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.385+0000 7fdaca7fc700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fdac006e440 0x7fdac00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.385+0000 7fdad88d4700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fdac006e440 0x7fdac00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.385+0000 7fdaca7fc700 1 -- 172.21.15.88:0/2827859394 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fdad0011070 con 0x7fdad4069250 2024-09-13T21:42:10.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.385+0000 7fdad88d4700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fdac006e440 0x7fdac00708f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdac4000c00 tx=0x7fdac400b540 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:10.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.389+0000 7fdaca7fc700 1 -- 172.21.15.88:0/2827859394 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fdad00509d0 con 0x7fdad4069250 2024-09-13T21:42:10.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.602+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdad4061190 con 0x7fdac006e440 2024-09-13T21:42:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.613+0000 7fdaca7fc700 1 -- 172.21.15.88:0/2827859394 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fdad4061190 con 0x7fdac006e440 2024-09-13T21:42:10.615 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:42:10.615 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (8m) 22s ago 9m 24.8M - 0.25.0 c8568f914cd2 c82eca12b874 2024-09-13T21:42:10.615 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (9m) 22s ago 9m 7692k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:42:10.615 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (8m) 2s ago 8m 7642k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (9m) 22s ago 9m 6665k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (8m) 2s ago 8m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (7m) 22s ago 9m 88.5M - 9.4.7 954c08fa6188 aa2cd07a9c2d 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (3m) 22s ago 3m 138M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (4m) 22s ago 4m 13.8M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (3m) 2s ago 3m 15.6M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (4m) 2s ago 4m 121M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (49s) 22s ago 10m 474M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (6s) 2s ago 8m 66.2M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (11m) 22s ago 11m 52.4M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (8m) 2s ago 8m 40.1M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (9m) 22s ago 9m 15.9M - 1.5.0 0da6a335fe13 71ce2b0df304 2024-09-13T21:42:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (8m) 2s ago 8m 15.9M - 1.5.0 0da6a335fe13 6d3c62590d98 2024-09-13T21:42:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (7m) 22s ago 7m 218M 1216M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:42:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (7m) 22s ago 7m 230M 1216M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:42:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (6m) 22s ago 6m 188M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:42:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (6m) 2s ago 6m 269M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:42:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (5m) 2s ago 5m 253M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:42:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (5m) 2s ago 5m 226M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:42:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 starting - - - - 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fdac006e440 msgr2=0x7fdac00708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fdac006e440 0x7fdac00708f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdac4000c00 tx=0x7fdac400b540 comp rx=0 tx=0).stop 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4069250 msgr2=0x7fdad4195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4069250 0x7fdad4195ab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdad000b990 tx=0x7fdad000bca0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 shutdown_connections 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fdac006e440 0x7fdac00708f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad4069250 0x7fdad4195ab0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 --2- 172.21.15.88:0/2827859394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad4103330 0x7fdad4195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 >> 172.21.15.88:0/2827859394 conn(0x7fdad40fa780 msgr2=0x7fdad40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 shutdown_connections 2024-09-13T21:42:10.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.616+0000 7fdadb339700 1 -- 172.21.15.88:0/2827859394 wait complete. 2024-09-13T21:42:10.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.737+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/2010365047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41021f0 msgr2=0x7ff1f40fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.737+0000 7ff1f9cbd700 1 --2- 172.21.15.88:0/2010365047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41021f0 0x7ff1f40fe320 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009910 tx=0x7ff1e8009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:10.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.737+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/2010365047 shutdown_connections 2024-09-13T21:42:10.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.737+0000 7ff1f9cbd700 1 --2- 172.21.15.88:0/2010365047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41021f0 0x7ff1f40fe320 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.737+0000 7ff1f9cbd700 1 --2- 172.21.15.88:0/2010365047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f41018a0 0x7ff1f4101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.737+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/2010365047 >> 172.21.15.88:0/2010365047 conn(0x7ff1f40f9f10 msgr2=0x7ff1f40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:10.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.737+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/2010365047 shutdown_connections 2024-09-13T21:42:10.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.737+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/2010365047 wait complete. 2024-09-13T21:42:10.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.738+0000 7ff1f9cbd700 1 Processor -- start 2024-09-13T21:42:10.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.738+0000 7ff1f9cbd700 1 -- start start 2024-09-13T21:42:10.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.738+0000 7ff1f9cbd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41018a0 0x7ff1f4195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:10.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.738+0000 7ff1f9cbd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f41021f0 0x7ff1f4196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:10.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.738+0000 7ff1f9cbd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f4196640 con 0x7ff1f41018a0 2024-09-13T21:42:10.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.738+0000 7ff1f9cbd700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f4196780 con 0x7ff1f41021f0 2024-09-13T21:42:10.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41018a0 0x7ff1f4195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:10.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41018a0 0x7ff1f4195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44346/0 (socket says 172.21.15.88:44346) 2024-09-13T21:42:10.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f37fe700 1 -- 172.21.15.88:0/3771860843 learned_addr learned my addr 172.21.15.88:0/3771860843 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f2ffd700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f41021f0 0x7ff1f4196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f2ffd700 1 -- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41018a0 msgr2=0x7ff1f4195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f2ffd700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41018a0 0x7ff1f4195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f2ffd700 1 -- 172.21.15.88:0/3771860843 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80095f0 con 0x7ff1f41021f0 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f37fe700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41018a0 0x7ff1f4195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f2ffd700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f41021f0 0x7ff1f4196020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8000c00 tx=0x7ff1e800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f0ff9700 1 -- 172.21.15.88:0/3771860843 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e801d070 con 0x7ff1f41021f0 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f0ff9700 1 -- 172.21.15.88:0/3771860843 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff1e8005dc0 con 0x7ff1f41021f0 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.739+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f419b1d0 con 0x7ff1f41021f0 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.740+0000 7ff1f0ff9700 1 -- 172.21.15.88:0/3771860843 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e8017400 con 0x7ff1f41021f0 2024-09-13T21:42:10.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.740+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f419b600 con 0x7ff1f41021f0 2024-09-13T21:42:10.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.741+0000 7ff1f0ff9700 1 -- 172.21.15.88:0/3771860843 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7ff1e800fa40 con 0x7ff1f41021f0 2024-09-13T21:42:10.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.741+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f4108d10 con 0x7ff1f41021f0 2024-09-13T21:42:10.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.741+0000 7ff1f0ff9700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff1dc06e440 0x7ff1dc0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:10.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.742+0000 7ff1f0ff9700 1 -- 172.21.15.88:0/3771860843 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff1e808f550 con 0x7ff1f41021f0 2024-09-13T21:42:10.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.742+0000 7ff1f37fe700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff1dc06e440 0x7ff1dc0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:10.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.742+0000 7ff1f37fe700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff1dc06e440 0x7ff1dc0708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4011550 tx=0x7ff1e4009260 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:10.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:10.746+0000 7ff1f0ff9700 1 -- 172.21.15.88:0/3771860843 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff1e805c510 con 0x7ff1f41021f0 2024-09-13T21:42:11.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.041+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff1f419bd50 con 0x7ff1f41021f0 2024-09-13T21:42:11.043 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:10 smithi088 ceph-mon[27963]: mgrmap e30: smithi088.scyrwy(active, since 27s), standbys: smithi116.bqnvtn 2024-09-13T21:42:11.043 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:10 smithi088 ceph-mon[27963]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:11.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.041+0000 7ff1f0ff9700 1 -- 172.21.15.88:0/3771860843 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7ff1e805c0a0 con 0x7ff1f41021f0 2024-09-13T21:42:11.044 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:42:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:42:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:42:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:42:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:42:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:42:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:42:11.045 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:42:11.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff1dc06e440 msgr2=0x7ff1dc0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:11.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff1dc06e440 0x7ff1dc0708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4011550 tx=0x7ff1e4009260 comp rx=0 tx=0).stop 2024-09-13T21:42:11.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f41021f0 msgr2=0x7ff1f4196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:11.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f41021f0 0x7ff1f4196020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8000c00 tx=0x7ff1e800f690 comp rx=0 tx=0).stop 2024-09-13T21:42:11.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 shutdown_connections 2024-09-13T21:42:11.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff1dc06e440 0x7ff1dc0708f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f41018a0 0x7ff1f4195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 --2- 172.21.15.88:0/3771860843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f41021f0 0x7ff1f4196020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 >> 172.21.15.88:0/3771860843 conn(0x7ff1f40f9f10 msgr2=0x7ff1f4104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:11.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 shutdown_connections 2024-09-13T21:42:11.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.044+0000 7ff1f9cbd700 1 -- 172.21.15.88:0/3771860843 wait complete. 2024-09-13T21:42:11.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:10 smithi116 ceph-mon[33391]: mgrmap e30: smithi088.scyrwy(active, since 27s), standbys: smithi116.bqnvtn 2024-09-13T21:42:11.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:10 smithi116 ceph-mon[33391]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:11.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.151+0000 7f35a2b3a700 1 -- 172.21.15.88:0/81029243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c103330 msgr2=0x7f359c105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:11.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.151+0000 7f35a2b3a700 1 --2- 172.21.15.88:0/81029243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c103330 0x7f359c105790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f358c009910 tx=0x7f358c009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:11.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.151+0000 7f35a2b3a700 1 -- 172.21.15.88:0/81029243 shutdown_connections 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.151+0000 7f35a2b3a700 1 --2- 172.21.15.88:0/81029243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c103330 0x7f359c105790 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.151+0000 7f35a2b3a700 1 --2- 172.21.15.88:0/81029243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f359c069250 0x7f359c102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.151+0000 7f35a2b3a700 1 -- 172.21.15.88:0/81029243 >> 172.21.15.88:0/81029243 conn(0x7f359c0fa780 msgr2=0x7f359c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.151+0000 7f35a2b3a700 1 -- 172.21.15.88:0/81029243 shutdown_connections 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.151+0000 7f35a2b3a700 1 -- 172.21.15.88:0/81029243 wait complete. 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a2b3a700 1 Processor -- start 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a2b3a700 1 -- start start 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a2b3a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c069250 0x7f359c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a2b3a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f359c103330 0x7f359c0fed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a2b3a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0ff2d0 con 0x7f359c069250 2024-09-13T21:42:11.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a2b3a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0ff410 con 0x7f359c103330 2024-09-13T21:42:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a08d6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c069250 0x7f359c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a08d6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c069250 0x7f359c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44362/0 (socket says 172.21.15.88:44362) 2024-09-13T21:42:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a08d6700 1 -- 172.21.15.88:0/3191607454 learned_addr learned my addr 172.21.15.88:0/3191607454 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f3593fff700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f359c103330 0x7f359c0fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a08d6700 1 -- 172.21.15.88:0/3191607454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f359c103330 msgr2=0x7f359c0fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a08d6700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f359c103330 0x7f359c0fed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.152+0000 7f35a08d6700 1 -- 172.21.15.88:0/3191607454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c0095f0 con 0x7f359c069250 2024-09-13T21:42:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.153+0000 7f35a08d6700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c069250 0x7f359c100740 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f359800d8d0 tx=0x7f359800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.153+0000 7f3591ffb700 1 -- 172.21.15.88:0/3191607454 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359800f860 con 0x7f359c069250 2024-09-13T21:42:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.153+0000 7f3591ffb700 1 -- 172.21.15.88:0/3191607454 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f359800fe70 con 0x7f359c069250 2024-09-13T21:42:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.153+0000 7f3591ffb700 1 -- 172.21.15.88:0/3191607454 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359800e5e0 con 0x7f359c069250 2024-09-13T21:42:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.153+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c0ff6f0 con 0x7f359c069250 2024-09-13T21:42:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.153+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c19db50 con 0x7f359c069250 2024-09-13T21:42:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.154+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c18fc10 con 0x7f359c069250 2024-09-13T21:42:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.155+0000 7f3591ffb700 1 -- 172.21.15.88:0/3191607454 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f3598010460 con 0x7f359c069250 2024-09-13T21:42:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.155+0000 7f3591ffb700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f358406e440 0x7f35840708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.155+0000 7f3591ffb700 1 -- 172.21.15.88:0/3191607454 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f359808df10 con 0x7f359c069250 2024-09-13T21:42:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.155+0000 7f3593fff700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f358406e440 0x7f35840708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.156+0000 7f3593fff700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f358406e440 0x7f35840708f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f358c006010 tx=0x7f358c00b540 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.160+0000 7f3591ffb700 1 -- 172.21.15.88:0/3191607454 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f359805aef0 con 0x7f359c069250 2024-09-13T21:42:11.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.406+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f359c061190 con 0x7f358406e440 2024-09-13T21:42:11.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.407+0000 7f3591ffb700 1 -- 172.21.15.88:0/3191607454 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f359c061190 con 0x7f358406e440 2024-09-13T21:42:11.409 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:42:11.409 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:42:11.409 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:42:11.409 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T21:42:11.409 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:42:11.409 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-13T21:42:11.410 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:42:11.410 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T21:42:11.410 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T21:42:11.410 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:42:11.410 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:42:11.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f358406e440 msgr2=0x7f35840708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:11.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f358406e440 0x7f35840708f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f358c006010 tx=0x7f358c00b540 comp rx=0 tx=0).stop 2024-09-13T21:42:11.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c069250 msgr2=0x7f359c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:11.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c069250 0x7f359c100740 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f359800d8d0 tx=0x7f359800dbe0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 shutdown_connections 2024-09-13T21:42:11.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f358406e440 0x7f35840708f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f359c069250 0x7f359c100740 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 --2- 172.21.15.88:0/3191607454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f359c103330 0x7f359c0fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:11.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 >> 172.21.15.88:0/3191607454 conn(0x7f359c0fa780 msgr2=0x7f359c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:11.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 shutdown_connections 2024-09-13T21:42:11.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:11.410+0000 7f35a2b3a700 1 -- 172.21.15.88:0/3191607454 wait complete. 2024-09-13T21:42:12.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:11 smithi088 ceph-mon[27963]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 314 KiB/s wr, 84 op/s 2024-09-13T21:42:12.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:11 smithi088 ceph-mon[27963]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:12.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:11 smithi088 ceph-mon[27963]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:12.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:11 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3771860843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:12.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:11 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:12.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:11 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:12.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:11 smithi116 ceph-mon[33391]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8.7 KiB/s rd, 314 KiB/s wr, 84 op/s 2024-09-13T21:42:12.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:11 smithi116 ceph-mon[33391]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:12.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:11 smithi116 ceph-mon[33391]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:12.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:11 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3771860843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:12.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:11 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:12.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:11 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:13.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:12 smithi088 ceph-mon[27963]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:13.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:12 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:13.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:12 smithi116 ceph-mon[33391]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:13.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:12 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:14.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:13 smithi088 ceph-mon[27963]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2024-09-13T21:42:14.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:13 smithi116 ceph-mon[33391]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2024-09-13T21:42:15.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: Upgrade: Setting container_image for all mgr 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.scyrwy"}]: dispatch 2024-09-13T21:42:15.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.scyrwy"}]': finished 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi116.bqnvtn"}]: dispatch 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi116.bqnvtn"}]': finished 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: Upgrade: Setting container_image for all rgw 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.849 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:15 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2024-09-13T21:42:15.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:15.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:15.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.952 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: Upgrade: Setting container_image for all mgr 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.scyrwy"}]: dispatch 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi088.scyrwy"}]': finished 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi116.bqnvtn"}]: dispatch 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi116.bqnvtn"}]': finished 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: Upgrade: Setting container_image for all rgw 2024-09-13T21:42:15.953 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:15.954 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:15 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:16.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:16 smithi088 ceph-mon[27963]: Upgrade: Setting container_image for all iscsi 2024-09-13T21:42:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:16 smithi088 ceph-mon[27963]: Upgrade: Setting container_image for all nfs 2024-09-13T21:42:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:16 smithi088 ceph-mon[27963]: Upgrade: Setting container_image for all nvmeof 2024-09-13T21:42:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:16 smithi116 ceph-mon[33391]: Upgrade: Setting container_image for all iscsi 2024-09-13T21:42:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:16 smithi116 ceph-mon[33391]: Upgrade: Setting container_image for all nfs 2024-09-13T21:42:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:16 smithi116 ceph-mon[33391]: Upgrade: Setting container_image for all nvmeof 2024-09-13T21:42:18.058 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:17 smithi088 ceph-mon[27963]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:18.058 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:17 smithi088 ceph-mon[27963]: Upgrade: Updating node-exporter.smithi088 (1/2) 2024-09-13T21:42:18.058 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:17 smithi088 ceph-mon[27963]: Deploying daemon node-exporter.smithi088 on smithi088 2024-09-13T21:42:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:17 smithi116 ceph-mon[33391]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:17 smithi116 ceph-mon[33391]: Upgrade: Updating node-exporter.smithi088 (1/2) 2024-09-13T21:42:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:17 smithi116 ceph-mon[33391]: Deploying daemon node-exporter.smithi088 on smithi088 2024-09-13T21:42:20.170 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:19 smithi116 ceph-mon[33391]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:20.170 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:19 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:20.170 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:19 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:20.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:19 smithi088 ceph-mon[27963]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:20.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:19 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:20.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:19 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:22.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:21 smithi116 ceph-mon[33391]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:22.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:21 smithi116 ceph-mon[33391]: Upgrade: Updating node-exporter.smithi116 (2/2) 2024-09-13T21:42:22.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:21 smithi116 ceph-mon[33391]: Deploying daemon node-exporter.smithi116 on smithi116 2024-09-13T21:42:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:21 smithi088 ceph-mon[27963]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:21 smithi088 ceph-mon[27963]: Upgrade: Updating node-exporter.smithi116 (2/2) 2024-09-13T21:42:22.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:21 smithi088 ceph-mon[27963]: Deploying daemon node-exporter.smithi116 on smithi116 2024-09-13T21:42:23.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:23 smithi088 ceph-mon[27963]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:23 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:23 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:23 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:23.933 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:23 smithi116 ceph-mon[33391]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:23.934 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:23 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:23.934 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:23 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:23.934 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:23 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:25.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:25 smithi088 ceph-mon[27963]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:25.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:25 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:25.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:25 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:26.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:25 smithi116 ceph-mon[33391]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:26.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:25 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:26.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:25 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:27.141 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:27 smithi088 ceph-mon[27963]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:27.141 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:27.141 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:27 smithi116 ceph-mon[33391]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:28.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:28.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:28.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:28.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:28.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:28.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:29 smithi116 ceph-mon[33391]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:29 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:29 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:29 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:29 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:29.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:29 smithi088 ceph-mon[27963]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:29.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:29 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:29.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:29 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:29.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:29 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:29.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:29 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:31.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:31 smithi088 ceph-mon[27963]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:31 smithi116 ceph-mon[33391]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:32 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:32.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:32.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:32.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:32.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:32.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:32.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:32.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:32 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:33.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:33 smithi088 ceph-mon[27963]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:33.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:33 smithi088 ceph-mon[27963]: Upgrade: Updating prometheus.smithi088 2024-09-13T21:42:33.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:33 smithi116 ceph-mon[33391]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:33.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:33 smithi116 ceph-mon[33391]: Upgrade: Updating prometheus.smithi088 2024-09-13T21:42:34.715 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:34 smithi088 ceph-mon[27963]: Deploying daemon prometheus.smithi088 on smithi088 2024-09-13T21:42:34.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:34 smithi116 ceph-mon[33391]: Deploying daemon prometheus.smithi088 on smithi088 2024-09-13T21:42:35.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:35 smithi088 ceph-mon[27963]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:35.794 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:35 smithi116 ceph-mon[33391]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:37.206 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:36 smithi088 ceph-mon[27963]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:37.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:36 smithi116 ceph-mon[33391]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:39.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:39 smithi088 ceph-mon[27963]: pgmap v31: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:39.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:39 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:39.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:39 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:39.977 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:39 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:39 smithi116 ceph-mon[33391]: pgmap v31: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:39 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:39 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:39 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.520+0000 7f43d348c700 1 -- 172.21.15.88:0/558753693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 msgr2=0x7f43cc103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.520+0000 7f43d348c700 1 --2- 172.21.15.88:0/558753693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 0x7f43cc103140 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009910 tx=0x7f43bc009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.520+0000 7f43d348c700 1 -- 172.21.15.88:0/558753693 shutdown_connections 2024-09-13T21:42:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.520+0000 7f43d348c700 1 --2- 172.21.15.88:0/558753693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc103680 0x7f43cc105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.520+0000 7f43d348c700 1 --2- 172.21.15.88:0/558753693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 0x7f43cc103140 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.520+0000 7f43d348c700 1 -- 172.21.15.88:0/558753693 >> 172.21.15.88:0/558753693 conn(0x7f43cc0fa780 msgr2=0x7f43cc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.520+0000 7f43d348c700 1 -- 172.21.15.88:0/558753693 shutdown_connections 2024-09-13T21:42:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.520+0000 7f43d348c700 1 -- 172.21.15.88:0/558753693 wait complete. 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d348c700 1 Processor -- start 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d348c700 1 -- start start 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d348c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 0x7f43cc195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d348c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc103680 0x7f43cc195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d348c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc196610 con 0x7f43cc100d60 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d348c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc196750 con 0x7f43cc103680 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d1228700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 0x7f43cc195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d1228700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 0x7f43cc195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47038/0 (socket says 172.21.15.88:47038) 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d1228700 1 -- 172.21.15.88:0/2613173846 learned_addr learned my addr 172.21.15.88:0/2613173846 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d1228700 1 -- 172.21.15.88:0/2613173846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc103680 msgr2=0x7f43cc195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d1228700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc103680 0x7f43cc195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d1228700 1 -- 172.21.15.88:0/2613173846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0095f0 con 0x7f43cc100d60 2024-09-13T21:42:41.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.521+0000 7f43d1228700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 0x7f43cc195ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00bda0 tx=0x7f43bc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:41.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.522+0000 7f43c27fc700 1 -- 172.21.15.88:0/2613173846 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43bc01d070 con 0x7f43cc100d60 2024-09-13T21:42:41.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.522+0000 7f43c27fc700 1 -- 172.21.15.88:0/2613173846 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f43bc004c50 con 0x7f43cc100d60 2024-09-13T21:42:41.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.522+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc19b1a0 con 0x7f43cc100d60 2024-09-13T21:42:41.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.522+0000 7f43c27fc700 1 -- 172.21.15.88:0/2613173846 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43bc00f690 con 0x7f43cc100d60 2024-09-13T21:42:41.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.522+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc19b690 con 0x7f43cc100d60 2024-09-13T21:42:41.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.523+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc18fbc0 con 0x7f43cc100d60 2024-09-13T21:42:41.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.523+0000 7f43c27fc700 1 -- 172.21.15.88:0/2613173846 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f43bc0229b0 con 0x7f43cc100d60 2024-09-13T21:42:41.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.524+0000 7f43c27fc700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43b806e440 0x7f43b80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:41.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.524+0000 7f43c27fc700 1 -- 172.21.15.88:0/2613173846 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f43bc08f9f0 con 0x7f43cc100d60 2024-09-13T21:42:41.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.524+0000 7f43d0a27700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43b806e440 0x7f43b80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:41.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.524+0000 7f43d0a27700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43b806e440 0x7f43b80708f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43c800a990 tx=0x7f43c8005c80 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:41.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.528+0000 7f43c27fc700 1 -- 172.21.15.88:0/2613173846 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f43bc091e60 con 0x7f43cc100d60 2024-09-13T21:42:41.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.754+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43cc061190 con 0x7f43b806e440 2024-09-13T21:42:41.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.755+0000 7f43c27fc700 1 -- 172.21.15.88:0/2613173846 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f43cc061190 con 0x7f43b806e440 2024-09-13T21:42:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.757+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43b806e440 msgr2=0x7f43b80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.757+0000 7f43d348c700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43b806e440 0x7f43b80708f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43c800a990 tx=0x7f43c8005c80 comp rx=0 tx=0).stop 2024-09-13T21:42:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.757+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 msgr2=0x7f43cc195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.757+0000 7f43d348c700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 0x7f43cc195ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00bda0 tx=0x7f43bc00be80 comp rx=0 tx=0).stop 2024-09-13T21:42:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.757+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 shutdown_connections 2024-09-13T21:42:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.757+0000 7f43d348c700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43b806e440 0x7f43b80708f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.758+0000 7f43d348c700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc100d60 0x7f43cc195ab0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.758+0000 7f43d348c700 1 --2- 172.21.15.88:0/2613173846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43cc103680 0x7f43cc195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.758+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 >> 172.21.15.88:0/2613173846 conn(0x7f43cc0fa780 msgr2=0x7f43cc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.758+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 shutdown_connections 2024-09-13T21:42:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.758+0000 7f43d348c700 1 -- 172.21.15.88:0/2613173846 wait complete. 2024-09-13T21:42:41.769 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:42:41.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.882+0000 7f018102d700 1 -- 172.21.15.88:0/957519059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 msgr2=0x7f017c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.882+0000 7f018102d700 1 --2- 172.21.15.88:0/957519059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 0x7f017c101890 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f016c009910 tx=0x7f016c009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:41.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.882+0000 7f018102d700 1 -- 172.21.15.88:0/957519059 shutdown_connections 2024-09-13T21:42:41.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.882+0000 7f018102d700 1 --2- 172.21.15.88:0/957519059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 0x7f017c101890 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.882+0000 7f018102d700 1 --2- 172.21.15.88:0/957519059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f017c100240 0x7f017c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.882+0000 7f018102d700 1 -- 172.21.15.88:0/957519059 >> 172.21.15.88:0/957519059 conn(0x7f017c0fb7f0 msgr2=0x7f017c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:41.885 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:41 smithi088 ceph-mon[27963]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:41.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.882+0000 7f018102d700 1 -- 172.21.15.88:0/957519059 shutdown_connections 2024-09-13T21:42:41.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.882+0000 7f018102d700 1 -- 172.21.15.88:0/957519059 wait complete. 2024-09-13T21:42:41.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.883+0000 7f018102d700 1 Processor -- start 2024-09-13T21:42:41.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.883+0000 7f018102d700 1 -- start start 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.883+0000 7f018102d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f017c100240 0x7f017c195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f018102d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 0x7f017c195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f018102d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c196560 con 0x7f017c101440 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f018102d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c1966a0 con 0x7f017c100240 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f017a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 0x7f017c195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f017a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 0x7f017c195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47064/0 (socket says 172.21.15.88:47064) 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f017a59c700 1 -- 172.21.15.88:0/3280338852 learned_addr learned my addr 172.21.15.88:0/3280338852 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f017ad9d700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f017c100240 0x7f017c195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f017a59c700 1 -- 172.21.15.88:0/3280338852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f017c100240 msgr2=0x7f017c195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f017a59c700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f017c100240 0x7f017c195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f017a59c700 1 -- 172.21.15.88:0/3280338852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0095f0 con 0x7f017c101440 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f017a59c700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 0x7f017c195fd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f016c00bd70 tx=0x7f016c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f0163fff700 1 -- 172.21.15.88:0/3280338852 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f016c01d070 con 0x7f017c101440 2024-09-13T21:42:41.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f0163fff700 1 -- 172.21.15.88:0/3280338852 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f016c022470 con 0x7f017c101440 2024-09-13T21:42:41.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c19b100 con 0x7f017c101440 2024-09-13T21:42:41.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f0163fff700 1 -- 172.21.15.88:0/3280338852 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f016c00f670 con 0x7f017c101440 2024-09-13T21:42:41.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.884+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c19b5c0 con 0x7f017c101440 2024-09-13T21:42:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.885+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c108d90 con 0x7f017c101440 2024-09-13T21:42:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.886+0000 7f0163fff700 1 -- 172.21.15.88:0/3280338852 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f016c022a50 con 0x7f017c101440 2024-09-13T21:42:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.886+0000 7f0163fff700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f016406e440 0x7f01640708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.886+0000 7f0163fff700 1 -- 172.21.15.88:0/3280338852 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f016c08f9a0 con 0x7f017c101440 2024-09-13T21:42:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.886+0000 7f017ad9d700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f016406e440 0x7f01640708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.887+0000 7f017ad9d700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f016406e440 0x7f01640708f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0170005fd0 tx=0x7f0170005e50 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:41.891+0000 7f0163fff700 1 -- 172.21.15.88:0/3280338852 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f016c05ca30 con 0x7f017c101440 2024-09-13T21:42:42.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:41 smithi116 ceph-mon[33391]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.123+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f017c105d90 con 0x7f016406e440 2024-09-13T21:42:42.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.124+0000 7f0163fff700 1 -- 172.21.15.88:0/3280338852 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f017c105d90 con 0x7f016406e440 2024-09-13T21:42:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f016406e440 msgr2=0x7f01640708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f016406e440 0x7f01640708f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0170005fd0 tx=0x7f0170005e50 comp rx=0 tx=0).stop 2024-09-13T21:42:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 msgr2=0x7f017c195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 0x7f017c195fd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f016c00bd70 tx=0x7f016c00be50 comp rx=0 tx=0).stop 2024-09-13T21:42:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 shutdown_connections 2024-09-13T21:42:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f016406e440 0x7f01640708f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f017c100240 0x7f017c195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 --2- 172.21.15.88:0/3280338852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f017c101440 0x7f017c195fd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 >> 172.21.15.88:0/3280338852 conn(0x7f017c0fb7f0 msgr2=0x7f017c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:42.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 shutdown_connections 2024-09-13T21:42:42.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.126+0000 7f018102d700 1 -- 172.21.15.88:0/3280338852 wait complete. 2024-09-13T21:42:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.241+0000 7f4c894ed700 1 -- 172.21.15.88:0/1062158519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c840ff150 msgr2=0x7f4c840ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.241+0000 7f4c894ed700 1 --2- 172.21.15.88:0/1062158519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c840ff150 0x7f4c840ff560 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009910 tx=0x7f4c74009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.241+0000 7f4c894ed700 1 -- 172.21.15.88:0/1062158519 shutdown_connections 2024-09-13T21:42:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.241+0000 7f4c894ed700 1 --2- 172.21.15.88:0/1062158519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c841003f0 0x7f4c84100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.241+0000 7f4c894ed700 1 --2- 172.21.15.88:0/1062158519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c840ff150 0x7f4c840ff560 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.241+0000 7f4c894ed700 1 -- 172.21.15.88:0/1062158519 >> 172.21.15.88:0/1062158519 conn(0x7f4c840fa7a0 msgr2=0x7f4c840fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.241+0000 7f4c894ed700 1 -- 172.21.15.88:0/1062158519 shutdown_connections 2024-09-13T21:42:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.241+0000 7f4c894ed700 1 -- 172.21.15.88:0/1062158519 wait complete. 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c894ed700 1 Processor -- start 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c894ed700 1 -- start start 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c894ed700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c840ff150 0x7f4c84069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c894ed700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c841003f0 0x7f4c8419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c894ed700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8419b120 con 0x7f4c841003f0 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c894ed700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8419b260 con 0x7f4c840ff150 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c827fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c841003f0 0x7f4c8419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c827fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c841003f0 0x7f4c8419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47084/0 (socket says 172.21.15.88:47084) 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c827fc700 1 -- 172.21.15.88:0/3038992372 learned_addr learned my addr 172.21.15.88:0/3038992372 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c82ffd700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c840ff150 0x7f4c84069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c827fc700 1 -- 172.21.15.88:0/3038992372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c840ff150 msgr2=0x7f4c84069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.242+0000 7f4c827fc700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c840ff150 0x7f4c84069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.243+0000 7f4c827fc700 1 -- 172.21.15.88:0/3038992372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c740095f0 con 0x7f4c841003f0 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.243+0000 7f4c82ffd700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c840ff150 0x7f4c84069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.243+0000 7f4c827fc700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c841003f0 0x7f4c8419ab50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800d8d0 tx=0x7f4c7800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.243+0000 7f4c6bfff700 1 -- 172.21.15.88:0/3038992372 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c78009940 con 0x7f4c841003f0 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.243+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8419b540 con 0x7f4c841003f0 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.243+0000 7f4c6bfff700 1 -- 172.21.15.88:0/3038992372 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c78010460 con 0x7f4c841003f0 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.243+0000 7f4c6bfff700 1 -- 172.21.15.88:0/3038992372 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7800f5d0 con 0x7f4c841003f0 2024-09-13T21:42:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.243+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8419ba90 con 0x7f4c841003f0 2024-09-13T21:42:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.244+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c84068ab0 con 0x7f4c841003f0 2024-09-13T21:42:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.245+0000 7f4c6bfff700 1 -- 172.21.15.88:0/3038992372 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f4c7800f7c0 con 0x7f4c841003f0 2024-09-13T21:42:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.245+0000 7f4c6bfff700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4c6c06e440 0x7f4c6c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.246+0000 7f4c6bfff700 1 -- 172.21.15.88:0/3038992372 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f4c7808e310 con 0x7f4c841003f0 2024-09-13T21:42:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.246+0000 7f4c82ffd700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4c6c06e440 0x7f4c6c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.246+0000 7f4c82ffd700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4c6c06e440 0x7f4c6c0708f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400b5c0 tx=0x7f4c74005e20 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:42.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.254+0000 7f4c6bfff700 1 -- 172.21.15.88:0/3038992372 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f4c7805b360 con 0x7f4c841003f0 2024-09-13T21:42:42.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.475+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c84104e20 con 0x7f4c6c06e440 2024-09-13T21:42:42.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.484+0000 7f4c6bfff700 1 -- 172.21.15.88:0/3038992372 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f4c84104e20 con 0x7f4c6c06e440 2024-09-13T21:42:42.486 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:42:42.486 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (8m) 14s ago 10m 24.8M - 0.25.0 c8568f914cd2 c82eca12b874 2024-09-13T21:42:42.486 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (10m) 14s ago 10m 7750k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:42:42.486 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (9m) 17s ago 9m 7666k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:42:42.486 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (10m) 14s ago 10m 6665k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:42:42.486 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (9m) 17s ago 9m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (8m) 14s ago 9m 88.6M - 9.4.7 954c08fa6188 aa2cd07a9c2d 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (4m) 14s ago 4m 120M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (4m) 14s ago 4m 14.0M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (4m) 17s ago 4m 15.9M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (4m) 17s ago 4m 121M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (80s) 14s ago 11m 494M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (38s) 17s ago 9m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (11m) 14s ago 11m 54.2M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (9m) 17s ago 9m 42.7M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (24s) 14s ago 10m 8024k - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (20s) 17s ago 9m 3649k - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (8m) 14s ago 8m 223M 1216M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:42:42.487 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (7m) 14s ago 7m 240M 1216M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:42:42.488 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (7m) 14s ago 7m 194M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:42:42.488 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (6m) 17s ago 6m 270M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:42:42.488 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (6m) 17s ago 6m 253M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:42:42.488 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (6m) 17s ago 6m 226M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:42:42.488 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 starting - - - - 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.486+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4c6c06e440 msgr2=0x7f4c6c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.486+0000 7f4c894ed700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4c6c06e440 0x7f4c6c0708f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400b5c0 tx=0x7f4c74005e20 comp rx=0 tx=0).stop 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.486+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c841003f0 msgr2=0x7f4c8419ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.486+0000 7f4c894ed700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c841003f0 0x7f4c8419ab50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800d8d0 tx=0x7f4c7800dc90 comp rx=0 tx=0).stop 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.486+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 shutdown_connections 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.486+0000 7f4c894ed700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4c6c06e440 0x7f4c6c0708f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.486+0000 7f4c894ed700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c840ff150 0x7f4c84069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.486+0000 7f4c894ed700 1 --2- 172.21.15.88:0/3038992372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c841003f0 0x7f4c8419ab50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.486+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 >> 172.21.15.88:0/3038992372 conn(0x7f4c840fa7a0 msgr2=0x7f4c841036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.487+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 shutdown_connections 2024-09-13T21:42:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.487+0000 7f4c894ed700 1 -- 172.21.15.88:0/3038992372 wait complete. 2024-09-13T21:42:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.594+0000 7f5448617700 1 -- 172.21.15.88:0/2366130829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 msgr2=0x7f5440073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.594+0000 7f5448617700 1 --2- 172.21.15.88:0/2366130829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 0x7f5440073ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5430009910 tx=0x7f5430009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.594+0000 7f5448617700 1 -- 172.21.15.88:0/2366130829 shutdown_connections 2024-09-13T21:42:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.594+0000 7f5448617700 1 --2- 172.21.15.88:0/2366130829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 0x7f5440073ba0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.594+0000 7f5448617700 1 --2- 172.21.15.88:0/2366130829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5440074d00 0x7f5440073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.594+0000 7f5448617700 1 -- 172.21.15.88:0/2366130829 >> 172.21.15.88:0/2366130829 conn(0x7f54400fb7e0 msgr2=0x7f54400fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.594+0000 7f5448617700 1 -- 172.21.15.88:0/2366130829 shutdown_connections 2024-09-13T21:42:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.594+0000 7f5448617700 1 -- 172.21.15.88:0/2366130829 wait complete. 2024-09-13T21:42:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.595+0000 7f5448617700 1 Processor -- start 2024-09-13T21:42:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.595+0000 7f5448617700 1 -- start start 2024-09-13T21:42:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f5448617700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 0x7f5440197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f5448617700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5440074d00 0x7f54401981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f5448617700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54401987e0 con 0x7f5440073730 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f5448617700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440198950 con 0x7f5440074d00 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f54463b3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 0x7f5440197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f54463b3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 0x7f5440197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47112/0 (socket says 172.21.15.88:47112) 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f54463b3700 1 -- 172.21.15.88:0/2990854406 learned_addr learned my addr 172.21.15.88:0/2990854406 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f5445bb2700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5440074d00 0x7f54401981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f54463b3700 1 -- 172.21.15.88:0/2990854406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5440074d00 msgr2=0x7f54401981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f54463b3700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5440074d00 0x7f54401981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.596+0000 7f54463b3700 1 -- 172.21.15.88:0/2990854406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54300095f0 con 0x7f5440073730 2024-09-13T21:42:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.597+0000 7f54463b3700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 0x7f5440197ca0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f543c00d8d0 tx=0x7f543c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.597+0000 7f54377fe700 1 -- 172.21.15.88:0/2990854406 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543c0098a0 con 0x7f5440073730 2024-09-13T21:42:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.597+0000 7f54377fe700 1 -- 172.21.15.88:0/2990854406 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f543c010460 con 0x7f5440073730 2024-09-13T21:42:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.597+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544019d3e0 con 0x7f5440073730 2024-09-13T21:42:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.597+0000 7f54377fe700 1 -- 172.21.15.88:0/2990854406 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543c00f5f0 con 0x7f5440073730 2024-09-13T21:42:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.597+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544019d930 con 0x7f5440073730 2024-09-13T21:42:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.598+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544010af80 con 0x7f5440073730 2024-09-13T21:42:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.599+0000 7f54377fe700 1 -- 172.21.15.88:0/2990854406 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f543c009a00 con 0x7f5440073730 2024-09-13T21:42:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.599+0000 7f54377fe700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f542c06e440 0x7f542c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.600+0000 7f54377fe700 1 -- 172.21.15.88:0/2990854406 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f543c08e210 con 0x7f5440073730 2024-09-13T21:42:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.600+0000 7f5445bb2700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f542c06e440 0x7f542c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.600+0000 7f5445bb2700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f542c06e440 0x7f542c0708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54401991b0 tx=0x7f543000b540 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:42.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.604+0000 7f54377fe700 1 -- 172.21.15.88:0/2990854406 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f543c0576c0 con 0x7f5440073730 2024-09-13T21:42:42.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.901+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f544019d570 con 0x7f5440073730 2024-09-13T21:42:42.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:42 smithi088 ceph-mon[27963]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:42.903 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:42 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:42.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.902+0000 7f54377fe700 1 -- 172.21.15.88:0/2990854406 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f544019d570 con 0x7f5440073730 2024-09-13T21:42:42.904 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:42:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:42:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:42:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:42:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:42:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:42:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:42:42.905 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:42:42.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.904+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f542c06e440 msgr2=0x7f542c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.904+0000 7f5448617700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f542c06e440 0x7f542c0708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54401991b0 tx=0x7f543000b540 comp rx=0 tx=0).stop 2024-09-13T21:42:42.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.904+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 msgr2=0x7f5440197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:42.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.904+0000 7f5448617700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 0x7f5440197ca0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f543c00d8d0 tx=0x7f543c00dbe0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.904+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 shutdown_connections 2024-09-13T21:42:42.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.905+0000 7f5448617700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f542c06e440 0x7f542c0708f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.905+0000 7f5448617700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5440073730 0x7f5440197ca0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.905+0000 7f5448617700 1 --2- 172.21.15.88:0/2990854406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5440074d00 0x7f54401981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:42.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.905+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 >> 172.21.15.88:0/2990854406 conn(0x7f54400fb7e0 msgr2=0x7f54401060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:42.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.905+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 shutdown_connections 2024-09-13T21:42:42.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:42.905+0000 7f5448617700 1 -- 172.21.15.88:0/2990854406 wait complete. 2024-09-13T21:42:43.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.012+0000 7f7559eb2700 1 -- 172.21.15.88:0/3851109087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 msgr2=0x7f7554100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:43.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.012+0000 7f7559eb2700 1 --2- 172.21.15.88:0/3851109087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 0x7f7554100860 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7548009910 tx=0x7f7548009c20 comp rx=0 tx=0).stop 2024-09-13T21:42:43.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.012+0000 7f7559eb2700 1 -- 172.21.15.88:0/3851109087 shutdown_connections 2024-09-13T21:42:43.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.012+0000 7f7559eb2700 1 --2- 172.21.15.88:0/3851109087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 0x7f7554100860 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.012+0000 7f7559eb2700 1 --2- 172.21.15.88:0/3851109087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75540ff150 0x7f75540ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.012+0000 7f7559eb2700 1 -- 172.21.15.88:0/3851109087 >> 172.21.15.88:0/3851109087 conn(0x7f75540fa7a0 msgr2=0x7f75540fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.012+0000 7f7559eb2700 1 -- 172.21.15.88:0/3851109087 shutdown_connections 2024-09-13T21:42:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.012+0000 7f7559eb2700 1 -- 172.21.15.88:0/3851109087 wait complete. 2024-09-13T21:42:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.013+0000 7f7559eb2700 1 Processor -- start 2024-09-13T21:42:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.013+0000 7f7559eb2700 1 -- start start 2024-09-13T21:42:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.013+0000 7f7559eb2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75540ff150 0x7f7554069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.013+0000 7f7559eb2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 0x7f755419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.013+0000 7f7559eb2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755419b0e0 con 0x7f75541003f0 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.013+0000 7f7559eb2700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755419b220 con 0x7f75540ff150 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.013+0000 7f7552ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 0x7f755419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7552ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 0x7f755419ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47134/0 (socket says 172.21.15.88:47134) 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7552ffd700 1 -- 172.21.15.88:0/957804916 learned_addr learned my addr 172.21.15.88:0/957804916 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f75537fe700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75540ff150 0x7f7554069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7552ffd700 1 -- 172.21.15.88:0/957804916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75540ff150 msgr2=0x7f7554069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7552ffd700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75540ff150 0x7f7554069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7552ffd700 1 -- 172.21.15.88:0/957804916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480095f0 con 0x7f75541003f0 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7552ffd700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 0x7f755419ab10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f754800bd70 tx=0x7f754800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7550ff9700 1 -- 172.21.15.88:0/957804916 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f754801d070 con 0x7f75541003f0 2024-09-13T21:42:43.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7550ff9700 1 -- 172.21.15.88:0/957804916 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7548005940 con 0x7f75541003f0 2024-09-13T21:42:43.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755419b4a0 con 0x7f75541003f0 2024-09-13T21:42:43.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7550ff9700 1 -- 172.21.15.88:0/957804916 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7548021430 con 0x7f75541003f0 2024-09-13T21:42:43.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.014+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755419b990 con 0x7f75541003f0 2024-09-13T21:42:43.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.015+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7554068ab0 con 0x7f75541003f0 2024-09-13T21:42:43.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.016+0000 7f7550ff9700 1 -- 172.21.15.88:0/957804916 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f754800f860 con 0x7f75541003f0 2024-09-13T21:42:43.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.016+0000 7f7550ff9700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f753c06e440 0x7f753c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:43.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.016+0000 7f7550ff9700 1 -- 172.21.15.88:0/957804916 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f754808f6b0 con 0x7f75541003f0 2024-09-13T21:42:43.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.016+0000 7f75537fe700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f753c06e440 0x7f753c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:43.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.017+0000 7f75537fe700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f753c06e440 0x7f753c0708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7544005950 tx=0x7f754400a300 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:43.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.021+0000 7f7550ff9700 1 -- 172.21.15.88:0/957804916 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f754805c690 con 0x7f75541003f0 2024-09-13T21:42:43.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:42 smithi116 ceph-mon[33391]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:43.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:42 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:43.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.248+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7554104e40 con 0x7f753c06e440 2024-09-13T21:42:43.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.249+0000 7f7550ff9700 1 -- 172.21.15.88:0/957804916 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f7554104e40 con 0x7f753c06e440 2024-09-13T21:42:43.251 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:42:43.251 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:42:43.251 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:42:43.251 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T21:42:43.251 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:42:43.251 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-13T21:42:43.251 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:42:43.252 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T21:42:43.252 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-13T21:42:43.252 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:42:43.252 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:42:43.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f753c06e440 msgr2=0x7f753c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:43.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f753c06e440 0x7f753c0708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7544005950 tx=0x7f754400a300 comp rx=0 tx=0).stop 2024-09-13T21:42:43.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 msgr2=0x7f755419ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:43.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 0x7f755419ab10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f754800bd70 tx=0x7f754800bda0 comp rx=0 tx=0).stop 2024-09-13T21:42:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 shutdown_connections 2024-09-13T21:42:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f753c06e440 0x7f753c0708f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75540ff150 0x7f7554069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 --2- 172.21.15.88:0/957804916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75541003f0 0x7f755419ab10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 >> 172.21.15.88:0/957804916 conn(0x7f75540fa7a0 msgr2=0x7f7554103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 shutdown_connections 2024-09-13T21:42:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:42:43.252+0000 7f7559eb2700 1 -- 172.21.15.88:0/957804916 wait complete. 2024-09-13T21:42:43.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:43 smithi088 ceph-mon[27963]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:43.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:43 smithi088 ceph-mon[27963]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:43.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:43 smithi088 ceph-mon[27963]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:43.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:43 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2990854406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:43.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:43 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:43.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:43 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:44.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:43 smithi116 ceph-mon[33391]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:44.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:43 smithi116 ceph-mon[33391]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:44.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:43 smithi116 ceph-mon[33391]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:44.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:43 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2990854406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:44.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:43 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:44.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:43 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:44.928 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:44 smithi088 ceph-mon[27963]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:44.929 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:44 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:44.929 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:44 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:45.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:44 smithi116 ceph-mon[33391]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:45.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:44 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:45.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:44 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:45.892 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:45 smithi116 ceph-mon[33391]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:45.943 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:45 smithi088 ceph-mon[27963]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:47.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:46 smithi088 ceph-mon[27963]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:46 smithi116 ceph-mon[33391]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:48.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:48.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:48.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:48.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:48.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:48.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:42:48.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:42:48.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:48.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:48 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:48 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:42:49.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:49 smithi088 ceph-mon[27963]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:49 smithi088 ceph-mon[27963]: Upgrade: Updating alertmanager.smithi088 2024-09-13T21:42:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:49 smithi088 ceph-mon[27963]: Deploying daemon alertmanager.smithi088 on smithi088 2024-09-13T21:42:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:49 smithi116 ceph-mon[33391]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:49 smithi116 ceph-mon[33391]: Upgrade: Updating alertmanager.smithi088 2024-09-13T21:42:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:49 smithi116 ceph-mon[33391]: Deploying daemon alertmanager.smithi088 on smithi088 2024-09-13T21:42:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:51 smithi116 ceph-mon[33391]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:51.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:51 smithi088 ceph-mon[27963]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:53 smithi116 ceph-mon[33391]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:53.658 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:53 smithi088 ceph-mon[27963]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:56.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:55 smithi116 ceph-mon[33391]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:56.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:55 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:56.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:55 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:56.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:55 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:56.146 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:55 smithi088 ceph-mon[27963]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:56.146 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:55 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:56.146 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:55 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:42:56.146 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:55 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:57.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:56 smithi088 ceph-mon[27963]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:57.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:56 smithi116 ceph-mon[33391]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:58.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:57 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:58.357 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:57 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:59.329 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:42:58 smithi088 ceph-mon[27963]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:59.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:42:58 smithi116 ceph-mon[33391]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:00.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:00 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:00 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:00 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:00.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:00 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:01.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:00 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:01.040 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:00 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:01.041 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:00 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:01.041 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:00 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:02.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:01 smithi116 ceph-mon[33391]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:02.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:01 smithi088 ceph-mon[27963]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:04.052 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.053 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.054 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.054 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.054 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.054 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:03 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:04.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:04.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:04.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:04.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:04.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:04.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:43:04.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:04.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:03 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:04.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:04 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:43:05.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:04 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:43:06.089 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:05 smithi116 ceph-mon[33391]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:06.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:05 smithi088 ceph-mon[27963]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:06 smithi116 ceph-mon[33391]: Upgrade: Updating grafana.smithi088 2024-09-13T21:43:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:06 smithi116 ceph-mon[33391]: Deploying daemon grafana.smithi088 on smithi088 2024-09-13T21:43:07.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:06 smithi088 ceph-mon[27963]: Upgrade: Updating grafana.smithi088 2024-09-13T21:43:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:06 smithi088 ceph-mon[27963]: Deploying daemon grafana.smithi088 on smithi088 2024-09-13T21:43:08.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:07 smithi116 ceph-mon[33391]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:08.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:07 smithi088 ceph-mon[27963]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:10.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:09 smithi116 ceph-mon[33391]: pgmap v46: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:10.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:09 smithi088 ceph-mon[27963]: pgmap v46: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:12.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:11 smithi116 ceph-mon[33391]: pgmap v47: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:12.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:11 smithi088 ceph-mon[27963]: pgmap v47: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:12.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:12 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:13.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:12 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:13.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.371+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/1623250227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 msgr2=0x7f9f68100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:13.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.371+0000 7f9f6d3a3700 1 --2- 172.21.15.88:0/1623250227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 0x7f9f68100790 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009910 tx=0x7f9f58009c20 comp rx=0 tx=0).stop 2024-09-13T21:43:13.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.371+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/1623250227 shutdown_connections 2024-09-13T21:43:13.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.371+0000 7f9f6d3a3700 1 --2- 172.21.15.88:0/1623250227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 0x7f9f68100790 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.371+0000 7f9f6d3a3700 1 --2- 172.21.15.88:0/1623250227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f680ff140 0x7f9f680ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.371+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/1623250227 >> 172.21.15.88:0/1623250227 conn(0x7f9f680fa6d0 msgr2=0x7f9f680fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:13.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.371+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/1623250227 shutdown_connections 2024-09-13T21:43:13.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.371+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/1623250227 wait complete. 2024-09-13T21:43:13.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.372+0000 7f9f6d3a3700 1 Processor -- start 2024-09-13T21:43:13.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.372+0000 7f9f6d3a3700 1 -- start start 2024-09-13T21:43:13.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.372+0000 7f9f6d3a3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f680ff140 0x7f9f68194990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:13.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.372+0000 7f9f6d3a3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 0x7f9f68194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:13.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.372+0000 7f9f6d3a3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f681954f0 con 0x7f9f68100340 2024-09-13T21:43:13.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.372+0000 7f9f6d3a3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f68195630 con 0x7f9f680ff140 2024-09-13T21:43:13.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f667fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 0x7f9f68194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:13.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f667fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 0x7f9f68194ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58286/0 (socket says 172.21.15.88:58286) 2024-09-13T21:43:13.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f667fc700 1 -- 172.21.15.88:0/2771688120 learned_addr learned my addr 172.21.15.88:0/2771688120 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f66ffd700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f680ff140 0x7f9f68194990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f667fc700 1 -- 172.21.15.88:0/2771688120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f680ff140 msgr2=0x7f9f68194990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f667fc700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f680ff140 0x7f9f68194990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f667fc700 1 -- 172.21.15.88:0/2771688120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f580095f0 con 0x7f9f68100340 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f66ffd700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f680ff140 0x7f9f68194990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f667fc700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 0x7f9f68194ed0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9f580092e0 tx=0x7f9f5800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f4ffff700 1 -- 172.21.15.88:0/2771688120 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5801d070 con 0x7f9f68100340 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f4ffff700 1 -- 172.21.15.88:0/2771688120 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9f5800f460 con 0x7f9f68100340 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6819a080 con 0x7f9f68100340 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f4ffff700 1 -- 172.21.15.88:0/2771688120 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f58021640 con 0x7f9f68100340 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.373+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6819a570 con 0x7f9f68100340 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.374+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f54005320 con 0x7f9f68100340 2024-09-13T21:43:13.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.375+0000 7f9f4ffff700 1 -- 172.21.15.88:0/2771688120 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f9f58003a60 con 0x7f9f68100340 2024-09-13T21:43:13.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.375+0000 7f9f4ffff700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9f5006e300 0x7f9f500707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:13.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.376+0000 7f9f4ffff700 1 -- 172.21.15.88:0/2771688120 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f9f5808f330 con 0x7f9f68100340 2024-09-13T21:43:13.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.376+0000 7f9f66ffd700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9f5006e300 0x7f9f500707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:13.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.376+0000 7f9f66ffd700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9f5006e300 0x7f9f500707b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f681001a0 tx=0x7f9f5c005f90 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:13.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.380+0000 7f9f4ffff700 1 -- 172.21.15.88:0/2771688120 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f9f5805c5b0 con 0x7f9f68100340 2024-09-13T21:43:13.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.640+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f54000bf0 con 0x7f9f5006e300 2024-09-13T21:43:13.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.642+0000 7f9f4ffff700 1 -- 172.21.15.88:0/2771688120 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f9f54000bf0 con 0x7f9f5006e300 2024-09-13T21:43:13.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9f5006e300 msgr2=0x7f9f500707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9f5006e300 0x7f9f500707b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f681001a0 tx=0x7f9f5c005f90 comp rx=0 tx=0).stop 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 msgr2=0x7f9f68194ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 0x7f9f68194ed0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9f580092e0 tx=0x7f9f5800be20 comp rx=0 tx=0).stop 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 shutdown_connections 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9f5006e300 0x7f9f500707b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f680ff140 0x7f9f68194990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 --2- 172.21.15.88:0/2771688120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f68100340 0x7f9f68194ed0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 >> 172.21.15.88:0/2771688120 conn(0x7f9f680fa6d0 msgr2=0x7f9f68103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 shutdown_connections 2024-09-13T21:43:13.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.644+0000 7f9f6d3a3700 1 -- 172.21.15.88:0/2771688120 wait complete. 2024-09-13T21:43:13.656 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:43:13.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 -- 172.21.15.88:0/1882308896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 msgr2=0x7faa98100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 --2- 172.21.15.88:0/1882308896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 0x7faa98100b60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faa88009910 tx=0x7faa88009c20 comp rx=0 tx=0).stop 2024-09-13T21:43:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 -- 172.21.15.88:0/1882308896 shutdown_connections 2024-09-13T21:43:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 --2- 172.21.15.88:0/1882308896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa981010a0 0x7faa980ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 --2- 172.21.15.88:0/1882308896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 0x7faa98100b60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 -- 172.21.15.88:0/1882308896 >> 172.21.15.88:0/1882308896 conn(0x7faa980f9f10 msgr2=0x7faa980fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 -- 172.21.15.88:0/1882308896 shutdown_connections 2024-09-13T21:43:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 -- 172.21.15.88:0/1882308896 wait complete. 2024-09-13T21:43:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 Processor -- start 2024-09-13T21:43:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.753+0000 7faa9dcb9700 1 -- start start 2024-09-13T21:43:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa9dcb9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 0x7faa98195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa9dcb9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa981010a0 0x7faa981960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa9dcb9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa981966c0 con 0x7faa98100750 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa9dcb9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa98196800 con 0x7faa981010a0 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa977fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 0x7faa98195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa977fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 0x7faa98195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58312/0 (socket says 172.21.15.88:58312) 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa977fe700 1 -- 172.21.15.88:0/690301418 learned_addr learned my addr 172.21.15.88:0/690301418 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa8ffff700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa981010a0 0x7faa981960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa977fe700 1 -- 172.21.15.88:0/690301418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa981010a0 msgr2=0x7faa981960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa977fe700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa981010a0 0x7faa981960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa977fe700 1 -- 172.21.15.88:0/690301418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa880095f0 con 0x7faa98100750 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa8ffff700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa981010a0 0x7faa981960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa977fe700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 0x7faa98195b60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faa8800bda0 tx=0x7faa8800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa957fa700 1 -- 172.21.15.88:0/690301418 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa8801d070 con 0x7faa98100750 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa957fa700 1 -- 172.21.15.88:0/690301418 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faa88004c50 con 0x7faa98100750 2024-09-13T21:43:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9819b250 con 0x7faa98100750 2024-09-13T21:43:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa957fa700 1 -- 172.21.15.88:0/690301418 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa8800f690 con 0x7faa98100750 2024-09-13T21:43:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.754+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9819b740 con 0x7faa98100750 2024-09-13T21:43:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.755+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa98107c80 con 0x7faa98100750 2024-09-13T21:43:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.756+0000 7faa957fa700 1 -- 172.21.15.88:0/690301418 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7faa880229b0 con 0x7faa98100750 2024-09-13T21:43:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.756+0000 7faa957fa700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7faa8406e300 0x7faa840707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.756+0000 7faa957fa700 1 -- 172.21.15.88:0/690301418 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7faa8808f7c0 con 0x7faa98100750 2024-09-13T21:43:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.756+0000 7faa8ffff700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7faa8406e300 0x7faa840707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.757+0000 7faa8ffff700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7faa8406e300 0x7faa840707b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faa80007900 tx=0x7faa80008040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:13.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.761+0000 7faa957fa700 1 -- 172.21.15.88:0/690301418 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7faa8805ca70 con 0x7faa98100750 2024-09-13T21:43:13.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:13 smithi088 ceph-mon[27963]: pgmap v48: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:13.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:13 smithi088 ceph-mon[27963]: mgrmap e31: smithi088.scyrwy(active, since 90s), standbys: smithi116.bqnvtn 2024-09-13T21:43:13.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.993+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa980fea50 con 0x7faa8406e300 2024-09-13T21:43:13.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.994+0000 7faa957fa700 1 -- 172.21.15.88:0/690301418 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7faa980fea50 con 0x7faa8406e300 2024-09-13T21:43:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.996+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7faa8406e300 msgr2=0x7faa840707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.996+0000 7faa9dcb9700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7faa8406e300 0x7faa840707b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faa80007900 tx=0x7faa80008040 comp rx=0 tx=0).stop 2024-09-13T21:43:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.996+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 msgr2=0x7faa98195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.996+0000 7faa9dcb9700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 0x7faa98195b60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faa8800bda0 tx=0x7faa8800be80 comp rx=0 tx=0).stop 2024-09-13T21:43:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.997+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 shutdown_connections 2024-09-13T21:43:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.997+0000 7faa9dcb9700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7faa8406e300 0x7faa840707b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.997+0000 7faa9dcb9700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa98100750 0x7faa98195b60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.997+0000 7faa9dcb9700 1 --2- 172.21.15.88:0/690301418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa981010a0 0x7faa981960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.997+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 >> 172.21.15.88:0/690301418 conn(0x7faa980f9f10 msgr2=0x7faa980fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.997+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 shutdown_connections 2024-09-13T21:43:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:13.997+0000 7faa9dcb9700 1 -- 172.21.15.88:0/690301418 wait complete. 2024-09-13T21:43:14.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:13 smithi116 ceph-mon[33391]: pgmap v48: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:14.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:13 smithi116 ceph-mon[33391]: mgrmap e31: smithi088.scyrwy(active, since 90s), standbys: smithi116.bqnvtn 2024-09-13T21:43:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.102+0000 7fd847469700 1 -- 172.21.15.88:0/1745955080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 msgr2=0x7fd8400ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.102+0000 7fd847469700 1 --2- 172.21.15.88:0/1745955080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 0x7fd8400ff540 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd830009910 tx=0x7fd830009c20 comp rx=0 tx=0).stop 2024-09-13T21:43:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.102+0000 7fd847469700 1 -- 172.21.15.88:0/1745955080 shutdown_connections 2024-09-13T21:43:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.102+0000 7fd847469700 1 --2- 172.21.15.88:0/1745955080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8401003d0 0x7fd840100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.102+0000 7fd847469700 1 --2- 172.21.15.88:0/1745955080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 0x7fd8400ff540 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.102+0000 7fd847469700 1 -- 172.21.15.88:0/1745955080 >> 172.21.15.88:0/1745955080 conn(0x7fd8400fa780 msgr2=0x7fd8400fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.102+0000 7fd847469700 1 -- 172.21.15.88:0/1745955080 shutdown_connections 2024-09-13T21:43:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.102+0000 7fd847469700 1 -- 172.21.15.88:0/1745955080 wait complete. 2024-09-13T21:43:14.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd847469700 1 Processor -- start 2024-09-13T21:43:14.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd847469700 1 -- start start 2024-09-13T21:43:14.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd847469700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 0x7fd8400690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:14.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd847469700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8401003d0 0x7fd84019a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:14.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd847469700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84019ae30 con 0x7fd8400ff130 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd847469700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84019af70 con 0x7fd8401003d0 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd845205700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 0x7fd8400690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd845205700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 0x7fd8400690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58324/0 (socket says 172.21.15.88:58324) 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd845205700 1 -- 172.21.15.88:0/3209712914 learned_addr learned my addr 172.21.15.88:0/3209712914 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd845205700 1 -- 172.21.15.88:0/3209712914 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8401003d0 msgr2=0x7fd84019a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd844a04700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8401003d0 0x7fd84019a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd845205700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8401003d0 0x7fd84019a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd845205700 1 -- 172.21.15.88:0/3209712914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300095f0 con 0x7fd8400ff130 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd844a04700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8401003d0 0x7fd84019a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.103+0000 7fd845205700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 0x7fd8400690a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd83000bd70 tx=0x7fd83000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.104+0000 7fd8367fc700 1 -- 172.21.15.88:0/3209712914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83001d070 con 0x7fd8400ff130 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.104+0000 7fd8367fc700 1 -- 172.21.15.88:0/3209712914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd830022470 con 0x7fd8400ff130 2024-09-13T21:43:14.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.104+0000 7fd8367fc700 1 -- 172.21.15.88:0/3209712914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83000f670 con 0x7fd8400ff130 2024-09-13T21:43:14.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.104+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84019b1f0 con 0x7fd8400ff130 2024-09-13T21:43:14.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.104+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84019b6e0 con 0x7fd8400ff130 2024-09-13T21:43:14.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.105+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd840107c90 con 0x7fd8400ff130 2024-09-13T21:43:14.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.105+0000 7fd8367fc700 1 -- 172.21.15.88:0/3209712914 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7fd830022a50 con 0x7fd8400ff130 2024-09-13T21:43:14.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.106+0000 7fd8367fc700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fd82c06e300 0x7fd82c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:14.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.106+0000 7fd8367fc700 1 -- 172.21.15.88:0/3209712914 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fd83008f6a0 con 0x7fd8400ff130 2024-09-13T21:43:14.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.106+0000 7fd844a04700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fd82c06e300 0x7fd82c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:14.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.106+0000 7fd844a04700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fd82c06e300 0x7fd82c0707b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd840069620 tx=0x7fd83c008040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.110+0000 7fd8367fc700 1 -- 172.21.15.88:0/3209712914 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fd83005c9d0 con 0x7fd8400ff130 2024-09-13T21:43:14.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.326+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd840104d20 con 0x7fd82c06e300 2024-09-13T21:43:14.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.336+0000 7fd8367fc700 1 -- 172.21.15.88:0/3209712914 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd840104d20 con 0x7fd82c06e300 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (20s) 14s ago 10m 16.7M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (10m) 14s ago 10m 7796k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (9m) 48s ago 9m 7666k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (10m) 14s ago 10m 6669k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (9m) 48s ago 9m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (8m) 14s ago 10m 88.6M - 9.4.7 954c08fa6188 aa2cd07a9c2d 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (5m) 14s ago 5m 120M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (5m) 14s ago 5m 14.3M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (4m) 48s ago 4m 15.9M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:43:14.338 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (5m) 48s ago 5m 121M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (112s) 14s ago 12m 497M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (69s) 48s ago 9m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (12m) 14s ago 12m 55.5M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (9m) 48s ago 9m 42.7M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (55s) 14s ago 10m 8220k - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (52s) 48s ago 9m 3649k - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (8m) 14s ago 8m 223M 1216M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (8m) 14s ago 8m 241M 1216M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (7m) 14s ago 7m 194M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (7m) 48s ago 7m 270M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (7m) 48s ago 6m 253M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (6m) 48s ago 6m 226M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:43:14.339 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (36s) 14s ago 10m 55.4M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:43:14.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fd82c06e300 msgr2=0x7fd82c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fd82c06e300 0x7fd82c0707b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd840069620 tx=0x7fd83c008040 comp rx=0 tx=0).stop 2024-09-13T21:43:14.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 msgr2=0x7fd8400690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 0x7fd8400690a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd83000bd70 tx=0x7fd83000be50 comp rx=0 tx=0).stop 2024-09-13T21:43:14.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 shutdown_connections 2024-09-13T21:43:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fd82c06e300 0x7fd82c0707b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8400ff130 0x7fd8400690a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 --2- 172.21.15.88:0/3209712914 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8401003d0 0x7fd84019a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 >> 172.21.15.88:0/3209712914 conn(0x7fd8400fa780 msgr2=0x7fd840103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 shutdown_connections 2024-09-13T21:43:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.338+0000 7fd847469700 1 -- 172.21.15.88:0/3209712914 wait complete. 2024-09-13T21:43:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 -- 172.21.15.88:0/3197413711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 msgr2=0x7fe5380ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 --2- 172.21.15.88:0/3197413711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 0x7fe5380ff4b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009910 tx=0x7fe52c009c20 comp rx=0 tx=0).stop 2024-09-13T21:43:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 -- 172.21.15.88:0/3197413711 shutdown_connections 2024-09-13T21:43:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 --2- 172.21.15.88:0/3197413711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 0x7fe5380ff4b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 --2- 172.21.15.88:0/3197413711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe538100750 0x7fe538100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 -- 172.21.15.88:0/3197413711 >> 172.21.15.88:0/3197413711 conn(0x7fe5380f9f10 msgr2=0x7fe5380fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 -- 172.21.15.88:0/3197413711 shutdown_connections 2024-09-13T21:43:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 -- 172.21.15.88:0/3197413711 wait complete. 2024-09-13T21:43:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 Processor -- start 2024-09-13T21:43:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.443+0000 7fe53f48d700 1 -- start start 2024-09-13T21:43:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53f48d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe538100750 0x7fe538195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53f48d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 0x7fe5381960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53f48d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5381966f0 con 0x7fe5381010a0 2024-09-13T21:43:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53f48d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538196830 con 0x7fe538100750 2024-09-13T21:43:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53ca28700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 0x7fe5381960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53ca28700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 0x7fe5381960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58338/0 (socket says 172.21.15.88:58338) 2024-09-13T21:43:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53ca28700 1 -- 172.21.15.88:0/3822008107 learned_addr learned my addr 172.21.15.88:0/3822008107 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53d229700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe538100750 0x7fe538195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53ca28700 1 -- 172.21.15.88:0/3822008107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe538100750 msgr2=0x7fe538195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53ca28700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe538100750 0x7fe538195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53ca28700 1 -- 172.21.15.88:0/3822008107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c0095f0 con 0x7fe5381010a0 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53d229700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe538100750 0x7fe538195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53ca28700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 0x7fe5381960d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe52c006010 tx=0x7fe52c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe5367fc700 1 -- 172.21.15.88:0/3822008107 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe52c01d070 con 0x7fe5381010a0 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe5367fc700 1 -- 172.21.15.88:0/3822008107 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe52c00f460 con 0x7fe5381010a0 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53819b280 con 0x7fe5381010a0 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.444+0000 7fe5367fc700 1 -- 172.21.15.88:0/3822008107 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe52c021640 con 0x7fe5381010a0 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.445+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53819b770 con 0x7fe5381010a0 2024-09-13T21:43:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.445+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe538107ca0 con 0x7fe5381010a0 2024-09-13T21:43:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.446+0000 7fe5367fc700 1 -- 172.21.15.88:0/3822008107 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7fe52c00fab0 con 0x7fe5381010a0 2024-09-13T21:43:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.446+0000 7fe5367fc700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe52006e300 0x7fe5200707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.447+0000 7fe5367fc700 1 -- 172.21.15.88:0/3822008107 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe52c08f5c0 con 0x7fe5381010a0 2024-09-13T21:43:14.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.447+0000 7fe53d229700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe52006e300 0x7fe5200707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:14.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.447+0000 7fe53d229700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe52006e300 0x7fe5200707b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe538068da0 tx=0x7fe5300073c0 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:14.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.451+0000 7fe5367fc700 1 -- 172.21.15.88:0/3822008107 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fe52c05c7c0 con 0x7fe5381010a0 2024-09-13T21:43:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.736+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe53819c090 con 0x7fe5381010a0 2024-09-13T21:43:14.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.737+0000 7fe5367fc700 1 -- 172.21.15.88:0/3822008107 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fe52c05c350 con 0x7fe5381010a0 2024-09-13T21:43:14.738 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:43:14.739 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:43:14.740 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T21:43:14.740 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:43:14.740 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:43:14.740 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:43:14.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe52006e300 msgr2=0x7fe5200707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe52006e300 0x7fe5200707b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe538068da0 tx=0x7fe5300073c0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 msgr2=0x7fe5381960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 0x7fe5381960d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe52c006010 tx=0x7fe52c00be20 comp rx=0 tx=0).stop 2024-09-13T21:43:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 shutdown_connections 2024-09-13T21:43:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe52006e300 0x7fe5200707b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe538100750 0x7fe538195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 --2- 172.21.15.88:0/3822008107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5381010a0 0x7fe5381960d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 >> 172.21.15.88:0/3822008107 conn(0x7fe5380f9f10 msgr2=0x7fe5380fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 shutdown_connections 2024-09-13T21:43:14.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.739+0000 7fe53f48d700 1 -- 172.21.15.88:0/3822008107 wait complete. 2024-09-13T21:43:14.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.848+0000 7f19a1796700 1 -- 172.21.15.88:0/1707974839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 msgr2=0x7f199c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.848+0000 7f19a1796700 1 --2- 172.21.15.88:0/1707974839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 0x7f199c100650 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1984009910 tx=0x7f1984009c20 comp rx=0 tx=0).stop 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.848+0000 7f19a1796700 1 -- 172.21.15.88:0/1707974839 shutdown_connections 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.848+0000 7f19a1796700 1 --2- 172.21.15.88:0/1707974839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f199c101440 0x7f199c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.848+0000 7f19a1796700 1 --2- 172.21.15.88:0/1707974839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 0x7f199c100650 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.848+0000 7f19a1796700 1 -- 172.21.15.88:0/1707974839 >> 172.21.15.88:0/1707974839 conn(0x7f199c0fb7f0 msgr2=0x7f199c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.848+0000 7f19a1796700 1 -- 172.21.15.88:0/1707974839 shutdown_connections 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.848+0000 7f19a1796700 1 -- 172.21.15.88:0/1707974839 wait complete. 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f19a1796700 1 Processor -- start 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f19a1796700 1 -- start start 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f19a1796700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 0x7f199c197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f19a1796700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f199c101440 0x7f199c198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f19a1796700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c198850 con 0x7f199c100240 2024-09-13T21:43:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f19a1796700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19d260 con 0x7f199c101440 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f199affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 0x7f199c197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f199affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 0x7f199c197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58364/0 (socket says 172.21.15.88:58364) 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f199affd700 1 -- 172.21.15.88:0/551450262 learned_addr learned my addr 172.21.15.88:0/551450262 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f199a7fc700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f199c101440 0x7f199c198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f199affd700 1 -- 172.21.15.88:0/551450262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f199c101440 msgr2=0x7f199c198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f199affd700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f199c101440 0x7f199c198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.849+0000 7f199affd700 1 -- 172.21.15.88:0/551450262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840095f0 con 0x7f199c100240 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.850+0000 7f199affd700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 0x7f199c197cf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f198400bda0 tx=0x7f198400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.850+0000 7f1993fff700 1 -- 172.21.15.88:0/551450262 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198401d070 con 0x7f199c100240 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.850+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c19d400 con 0x7f199c100240 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.850+0000 7f1993fff700 1 -- 172.21.15.88:0/551450262 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f198400f460 con 0x7f199c100240 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.850+0000 7f1993fff700 1 -- 172.21.15.88:0/551450262 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1984021620 con 0x7f199c100240 2024-09-13T21:43:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.850+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c19d8c0 con 0x7f199c100240 2024-09-13T21:43:14.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.851+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c105520 con 0x7f199c100240 2024-09-13T21:43:14.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.851+0000 7f1993fff700 1 -- 172.21.15.88:0/551450262 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f198400f5d0 con 0x7f199c100240 2024-09-13T21:43:14.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.852+0000 7f1993fff700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f198806e300 0x7f19880707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:14.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.852+0000 7f1993fff700 1 -- 172.21.15.88:0/551450262 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f198408f320 con 0x7f199c100240 2024-09-13T21:43:14.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.852+0000 7f199a7fc700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f198806e300 0x7f19880707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:14.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.852+0000 7f199a7fc700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f198806e300 0x7f19880707b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f198c005950 tx=0x7f198c00b410 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:14.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:14.856+0000 7f1993fff700 1 -- 172.21.15.88:0/551450262 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f19840589f0 con 0x7f199c100240 2024-09-13T21:43:15.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:14 smithi088 ceph-mon[27963]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:15.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:14 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/3822008107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:15.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:14 smithi116 ceph-mon[33391]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:15.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:14 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/3822008107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:15.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.095+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f199c061190 con 0x7f198806e300 2024-09-13T21:43:15.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.096+0000 7f1993fff700 1 -- 172.21.15.88:0/551450262 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f199c061190 con 0x7f198806e300 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading grafana daemons", 2024-09-13T21:43:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:43:15.099 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:43:15.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f198806e300 msgr2=0x7f19880707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f198806e300 0x7f19880707b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f198c005950 tx=0x7f198c00b410 comp rx=0 tx=0).stop 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 msgr2=0x7f199c197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 0x7f199c197cf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f198400bda0 tx=0x7f198400bdd0 comp rx=0 tx=0).stop 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 shutdown_connections 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f198806e300 0x7f19880707b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c100240 0x7f199c197cf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 --2- 172.21.15.88:0/551450262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f199c101440 0x7f199c198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 >> 172.21.15.88:0/551450262 conn(0x7f199c0fb7f0 msgr2=0x7f199c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 shutdown_connections 2024-09-13T21:43:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:15.099+0000 7f19a1796700 1 -- 172.21.15.88:0/551450262 wait complete. 2024-09-13T21:43:15.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:15 smithi088 ceph-mon[27963]: pgmap v49: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:15.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:15 smithi088 ceph-mon[27963]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:15.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:15 smithi088 ceph-mon[27963]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:16.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:15 smithi116 ceph-mon[33391]: pgmap v49: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:16.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:15 smithi116 ceph-mon[33391]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:16.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:15 smithi116 ceph-mon[33391]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:16 smithi088 ceph-mon[27963]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:16 smithi116 ceph-mon[33391]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:17 smithi116 ceph-mon[33391]: pgmap v50: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:17 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:17 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:17 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:17 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:17 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:18.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:17 smithi088 ceph-mon[27963]: pgmap v50: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:17 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:17 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:17 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:17 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:17 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:20.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:19 smithi116 ceph-mon[33391]: pgmap v51: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:20.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:19 smithi088 ceph-mon[27963]: pgmap v51: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:21.912 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:21 smithi088 ceph-mon[27963]: pgmap v52: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:22.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:21 smithi116 ceph-mon[33391]: pgmap v52: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:23.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:23 smithi088 ceph-mon[27963]: pgmap v53: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:23 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:23 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:23 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:23 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:23 smithi116 ceph-mon[33391]: pgmap v53: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:23 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:23 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:23 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:23 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:25.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:25 smithi088 ceph-mon[27963]: pgmap v54: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:25.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:25 smithi116 ceph-mon[33391]: pgmap v54: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:27.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:26 smithi088 ceph-mon[27963]: pgmap v55: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:26 smithi116 ceph-mon[33391]: pgmap v55: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:28.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: Upgrade: Finalizing container_image settings 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T21:43:28.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T21:43:28.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T21:43:28.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T21:43:28.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T21:43:28.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T21:43:28.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T21:43:28.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T21:43:28.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: Upgrade: Complete! 2024-09-13T21:43:28.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T21:43:28.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T21:43:28.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:28.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:28.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:28.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:28.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:28.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:28.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:28.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: Upgrade: Finalizing container_image settings 2024-09-13T21:43:28.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:28.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T21:43:28.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T21:43:28.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T21:43:28.486 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: Upgrade: Complete! 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T21:43:28.487 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:27 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:28.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:28 smithi088 ceph-mon[27963]: pgmap v56: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:28.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:28.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:28.996 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:28.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:28.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:28.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:28.997 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:28 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:28 smithi116 ceph-mon[33391]: pgmap v56: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:29.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:29.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:29.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:28 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:31.303 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:30 smithi088 ceph-mon[27963]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:31.336 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:30 smithi116 ceph-mon[33391]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:33.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:33 smithi088 ceph-mon[27963]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:33.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:33 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:33.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:33 smithi116 ceph-mon[33391]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:33.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:33 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:43:35.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:35 smithi088 ceph-mon[27963]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:35.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:35 smithi116 ceph-mon[33391]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:37.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:36 smithi116 ceph-mon[33391]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:37.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:36 smithi088 ceph-mon[27963]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:39.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:39 smithi088 ceph-mon[27963]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:39.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:39 smithi116 ceph-mon[33391]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:41.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:41 smithi116 ceph-mon[33391]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:41.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:41 smithi088 ceph-mon[27963]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:43.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:43 smithi116 ceph-mon[33391]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:43.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:43 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:43.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:43 smithi088 ceph-mon[27963]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:43.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:43 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:45.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.219+0000 7f2d62175700 1 -- 172.21.15.88:0/946264339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 msgr2=0x7f2d5c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.219+0000 7f2d62175700 1 --2- 172.21.15.88:0/946264339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 0x7f2d5c100860 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009910 tx=0x7f2d50009c20 comp rx=0 tx=0).stop 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.219+0000 7f2d62175700 1 -- 172.21.15.88:0/946264339 shutdown_connections 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.219+0000 7f2d62175700 1 --2- 172.21.15.88:0/946264339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 0x7f2d5c100860 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.219+0000 7f2d62175700 1 --2- 172.21.15.88:0/946264339 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d5c0ff150 0x7f2d5c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.219+0000 7f2d62175700 1 -- 172.21.15.88:0/946264339 >> 172.21.15.88:0/946264339 conn(0x7f2d5c0fa7a0 msgr2=0x7f2d5c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.219+0000 7f2d62175700 1 -- 172.21.15.88:0/946264339 shutdown_connections 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.219+0000 7f2d62175700 1 -- 172.21.15.88:0/946264339 wait complete. 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.219+0000 7f2d62175700 1 Processor -- start 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d62175700 1 -- start start 2024-09-13T21:43:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d62175700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d5c0ff150 0x7f2d5c194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d62175700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 0x7f2d5c1951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d62175700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c1957f0 con 0x7f2d5c1003f0 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d62175700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c195960 con 0x7f2d5c0ff150 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d5affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 0x7f2d5c1951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d5affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 0x7f2d5c1951f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47530/0 (socket says 172.21.15.88:47530) 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d5affd700 1 -- 172.21.15.88:0/1041420435 learned_addr learned my addr 172.21.15.88:0/1041420435 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d5b7fe700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d5c0ff150 0x7f2d5c194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d5affd700 1 -- 172.21.15.88:0/1041420435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d5c0ff150 msgr2=0x7f2d5c194cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d5affd700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d5c0ff150 0x7f2d5c194cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d5affd700 1 -- 172.21.15.88:0/1041420435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500095f0 con 0x7f2d5c1003f0 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.220+0000 7f2d5affd700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 0x7f2d5c1951f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2d50006010 tx=0x7f2d5000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.221+0000 7f2d58ff9700 1 -- 172.21.15.88:0/1041420435 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d5001d070 con 0x7f2d5c1003f0 2024-09-13T21:43:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.221+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c19a390 con 0x7f2d5c1003f0 2024-09-13T21:43:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.221+0000 7f2d58ff9700 1 -- 172.21.15.88:0/1041420435 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d5000f460 con 0x7f2d5c1003f0 2024-09-13T21:43:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.221+0000 7f2d58ff9700 1 -- 172.21.15.88:0/1041420435 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d50021640 con 0x7f2d5c1003f0 2024-09-13T21:43:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.221+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c19a880 con 0x7f2d5c1003f0 2024-09-13T21:43:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.222+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c068ab0 con 0x7f2d5c1003f0 2024-09-13T21:43:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.222+0000 7f2d58ff9700 1 -- 172.21.15.88:0/1041420435 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f2d5000fab0 con 0x7f2d5c1003f0 2024-09-13T21:43:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.223+0000 7f2d58ff9700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f2d4406e300 0x7f2d440707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.223+0000 7f2d58ff9700 1 -- 172.21.15.88:0/1041420435 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f2d5008f400 con 0x7f2d5c1003f0 2024-09-13T21:43:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.223+0000 7f2d5b7fe700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f2d4406e300 0x7f2d440707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.223+0000 7f2d5b7fe700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f2d4406e300 0x7f2d440707b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005950 tx=0x7f2d4c0058e0 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:45.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.227+0000 7f2d58ff9700 1 -- 172.21.15.88:0/1041420435 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f2d50058ad0 con 0x7f2d5c1003f0 2024-09-13T21:43:45.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:45 smithi116 ceph-mon[33391]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.447+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d5c104e40 con 0x7f2d4406e300 2024-09-13T21:43:45.449 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:45 smithi088 ceph-mon[27963]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.448+0000 7f2d58ff9700 1 -- 172.21.15.88:0/1041420435 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f2d5c104e40 con 0x7f2d4406e300 2024-09-13T21:43:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.450+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f2d4406e300 msgr2=0x7f2d440707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.450+0000 7f2d62175700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f2d4406e300 0x7f2d440707b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005950 tx=0x7f2d4c0058e0 comp rx=0 tx=0).stop 2024-09-13T21:43:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.450+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 msgr2=0x7f2d5c1951f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.450+0000 7f2d62175700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 0x7f2d5c1951f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2d50006010 tx=0x7f2d5000be20 comp rx=0 tx=0).stop 2024-09-13T21:43:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.451+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 shutdown_connections 2024-09-13T21:43:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.451+0000 7f2d62175700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f2d4406e300 0x7f2d440707b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.451+0000 7f2d62175700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d5c0ff150 0x7f2d5c194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.451+0000 7f2d62175700 1 --2- 172.21.15.88:0/1041420435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d5c1003f0 0x7f2d5c1951f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.451+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 >> 172.21.15.88:0/1041420435 conn(0x7f2d5c0fa7a0 msgr2=0x7f2d5c103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.451+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 shutdown_connections 2024-09-13T21:43:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:45.451+0000 7f2d62175700 1 -- 172.21.15.88:0/1041420435 wait complete. 2024-09-13T21:43:46.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-13T21:43:46.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:46 smithi116 ceph-mon[33391]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:46.363 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:43:46.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:46 smithi088 ceph-mon[27963]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:47.177 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:47 smithi088 ceph-mon[27963]: pgmap v65: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:47 smithi116 ceph-mon[33391]: pgmap v65: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:48.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.079+0000 7fb1cafd2700 1 -- 172.21.15.88:0/2575965518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ffc60 msgr2=0x7fb1c410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:48.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.079+0000 7fb1cafd2700 1 --2- 172.21.15.88:0/2575965518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ffc60 0x7fb1c410a6d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400b0a0 tx=0x7fb1b400b3b0 comp rx=0 tx=0).stop 2024-09-13T21:43:48.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.079+0000 7fb1cafd2700 1 -- 172.21.15.88:0/2575965518 shutdown_connections 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.079+0000 7fb1cafd2700 1 --2- 172.21.15.88:0/2575965518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ffc60 0x7fb1c410a6d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.079+0000 7fb1cafd2700 1 --2- 172.21.15.88:0/2575965518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1c40ff350 0x7fb1c40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.079+0000 7fb1cafd2700 1 -- 172.21.15.88:0/2575965518 >> 172.21.15.88:0/2575965518 conn(0x7fb1c40748b0 msgr2=0x7fb1c4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.079+0000 7fb1cafd2700 1 -- 172.21.15.88:0/2575965518 shutdown_connections 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.079+0000 7fb1cafd2700 1 -- 172.21.15.88:0/2575965518 wait complete. 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1cafd2700 1 Processor -- start 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1cafd2700 1 -- start start 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1cafd2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ff350 0x7fb1c4195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1cafd2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1c40ffc60 0x7fb1c4196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1cafd2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4196b40 con 0x7fb1c40ff350 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1cafd2700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c419a8d0 con 0x7fb1c40ffc60 2024-09-13T21:43:48.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1c8d6e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ff350 0x7fb1c4195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1c8d6e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ff350 0x7fb1c4195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47538/0 (socket says 172.21.15.88:47538) 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1c8d6e700 1 -- 172.21.15.88:0/4037327504 learned_addr learned my addr 172.21.15.88:0/4037327504 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1c8d6e700 1 -- 172.21.15.88:0/4037327504 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1c40ffc60 msgr2=0x7fb1c4196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1c8d6e700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1c40ffc60 0x7fb1c4196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1c8d6e700 1 -- 172.21.15.88:0/4037327504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4009d00 con 0x7fb1c40ff350 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.080+0000 7fb1c8d6e700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ff350 0x7fb1c4195f20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00b4b0 tx=0x7fb1bc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.081+0000 7fb1c1ffb700 1 -- 172.21.15.88:0/4037327504 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1bc011800 con 0x7fb1c40ff350 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.081+0000 7fb1c1ffb700 1 -- 172.21.15.88:0/4037327504 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1bc011e20 con 0x7fb1c40ff350 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.081+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c419abb0 con 0x7fb1c40ff350 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.081+0000 7fb1c1ffb700 1 -- 172.21.15.88:0/4037327504 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1bc00f2e0 con 0x7fb1c40ff350 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.081+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c419b100 con 0x7fb1c40ff350 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.082+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c4107dd0 con 0x7fb1c40ff350 2024-09-13T21:43:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.082+0000 7fb1c1ffb700 1 -- 172.21.15.88:0/4037327504 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7fb1bc010380 con 0x7fb1c40ff350 2024-09-13T21:43:48.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.083+0000 7fb1c1ffb700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb1b006e300 0x7fb1b00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:48.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.083+0000 7fb1c1ffb700 1 -- 172.21.15.88:0/4037327504 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb1bc08dc70 con 0x7fb1c40ff350 2024-09-13T21:43:48.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.083+0000 7fb1c3fff700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb1b006e300 0x7fb1b00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:48.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.083+0000 7fb1c3fff700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb1b006e300 0x7fb1b00707b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009480 tx=0x7fb1b40097c0 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:48.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.088+0000 7fb1c1ffb700 1 -- 172.21.15.88:0/4037327504 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fb1bc057340 con 0x7fb1c40ff350 2024-09-13T21:43:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.386+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb1c419b3d0 con 0x7fb1c40ff350 2024-09-13T21:43:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.387+0000 7fb1c1ffb700 1 -- 172.21.15.88:0/4037327504 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fb1bc05aa00 con 0x7fb1c40ff350 2024-09-13T21:43:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb1b006e300 msgr2=0x7fb1b00707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb1b006e300 0x7fb1b00707b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009480 tx=0x7fb1b40097c0 comp rx=0 tx=0).stop 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ff350 msgr2=0x7fb1c4195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ff350 0x7fb1c4195f20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00b4b0 tx=0x7fb1bc00b870 comp rx=0 tx=0).stop 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 shutdown_connections 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb1b006e300 0x7fb1b00707b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c40ff350 0x7fb1c4195f20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 --2- 172.21.15.88:0/4037327504 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1c40ffc60 0x7fb1c4196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 >> 172.21.15.88:0/4037327504 conn(0x7fb1c40748b0 msgr2=0x7fb1c4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 shutdown_connections 2024-09-13T21:43:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:48.389+0000 7fb1cafd2700 1 -- 172.21.15.88:0/4037327504 wait complete. 2024-09-13T21:43:48.401 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:43:49.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-13T21:43:49.258 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:43:49.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:49 smithi116 ceph-mon[33391]: pgmap v66: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:49.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:49 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:43:49.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:49 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/4037327504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:49.369 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:49 smithi088 ceph-mon[27963]: pgmap v66: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:49.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:49 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:43:49.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:49 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/4037327504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.023+0000 7feb5b17b700 1 -- 172.21.15.88:0/2640742067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ff3c0 msgr2=0x7feb540ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.023+0000 7feb5b17b700 1 --2- 172.21.15.88:0/2640742067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ff3c0 0x7feb540ff790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7feb48009910 tx=0x7feb48009c20 comp rx=0 tx=0).stop 2024-09-13T21:43:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.024+0000 7feb5b17b700 1 -- 172.21.15.88:0/2640742067 shutdown_connections 2024-09-13T21:43:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.024+0000 7feb5b17b700 1 --2- 172.21.15.88:0/2640742067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb540ffd60 0x7feb54103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.024+0000 7feb5b17b700 1 --2- 172.21.15.88:0/2640742067 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ff3c0 0x7feb540ff790 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.024+0000 7feb5b17b700 1 -- 172.21.15.88:0/2640742067 >> 172.21.15.88:0/2640742067 conn(0x7feb540fac80 msgr2=0x7feb540fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.024+0000 7feb5b17b700 1 -- 172.21.15.88:0/2640742067 shutdown_connections 2024-09-13T21:43:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.024+0000 7feb5b17b700 1 -- 172.21.15.88:0/2640742067 wait complete. 2024-09-13T21:43:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.024+0000 7feb5b17b700 1 Processor -- start 2024-09-13T21:43:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.024+0000 7feb5b17b700 1 -- start start 2024-09-13T21:43:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb5b17b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb540ff3c0 0x7feb54100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb5b17b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ffd60 0x7feb54101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb5b17b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb54101850 con 0x7feb540ffd60 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb5b17b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb54101990 con 0x7feb540ff3c0 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb53fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ffd60 0x7feb54101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb53fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ffd60 0x7feb54101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43106/0 (socket says 172.21.15.88:43106) 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb53fff700 1 -- 172.21.15.88:0/2319874545 learned_addr learned my addr 172.21.15.88:0/2319874545 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb53fff700 1 -- 172.21.15.88:0/2319874545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb540ff3c0 msgr2=0x7feb54100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb53fff700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb540ff3c0 0x7feb54100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb53fff700 1 -- 172.21.15.88:0/2319874545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb480095f0 con 0x7feb540ffd60 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb53fff700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ffd60 0x7feb54101310 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb4000b480 tx=0x7feb4000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb51ffb700 1 -- 172.21.15.88:0/2319874545 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb400118c0 con 0x7feb540ffd60 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb541a2140 con 0x7feb540ffd60 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb51ffb700 1 -- 172.21.15.88:0/2319874545 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb40010380 con 0x7feb540ffd60 2024-09-13T21:43:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.025+0000 7feb51ffb700 1 -- 172.21.15.88:0/2319874545 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb4000f4f0 con 0x7feb540ffd60 2024-09-13T21:43:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.026+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb541a2550 con 0x7feb540ffd60 2024-09-13T21:43:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.026+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5404f2a0 con 0x7feb540ffd60 2024-09-13T21:43:51.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.027+0000 7feb51ffb700 1 -- 172.21.15.88:0/2319874545 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7feb400104f0 con 0x7feb540ffd60 2024-09-13T21:43:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.027+0000 7feb51ffb700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7feb4406e300 0x7feb440707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.028+0000 7feb51ffb700 1 -- 172.21.15.88:0/2319874545 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7feb4008dd00 con 0x7feb540ffd60 2024-09-13T21:43:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.028+0000 7feb58f17700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7feb4406e300 0x7feb440707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.028+0000 7feb58f17700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7feb4406e300 0x7feb440707b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feb48009fd0 tx=0x7feb4800b560 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.032+0000 7feb51ffb700 1 -- 172.21.15.88:0/2319874545 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7feb40091030 con 0x7feb540ffd60 2024-09-13T21:43:51.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.324+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feb541a27a0 con 0x7feb540ffd60 2024-09-13T21:43:51.326 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:51 smithi088 ceph-mon[27963]: pgmap v67: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:51.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.324+0000 7feb51ffb700 1 -- 172.21.15.88:0/2319874545 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7feb400573d0 con 0x7feb540ffd60 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7feb4406e300 msgr2=0x7feb440707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7feb4406e300 0x7feb440707b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feb48009fd0 tx=0x7feb4800b560 comp rx=0 tx=0).stop 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ffd60 msgr2=0x7feb54101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ffd60 0x7feb54101310 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb4000b480 tx=0x7feb4000b840 comp rx=0 tx=0).stop 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 shutdown_connections 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7feb4406e300 0x7feb440707b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb540ff3c0 0x7feb54100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 --2- 172.21.15.88:0/2319874545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb540ffd60 0x7feb54101310 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 >> 172.21.15.88:0/2319874545 conn(0x7feb540fac80 msgr2=0x7feb54103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:51.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 shutdown_connections 2024-09-13T21:43:51.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:51.326+0000 7feb5b17b700 1 -- 172.21.15.88:0/2319874545 wait complete. 2024-09-13T21:43:51.338 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)" 2024-09-13T21:43:51.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:51 smithi116 ceph-mon[33391]: pgmap v67: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:52.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-13T21:43:52.259 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:43:52.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:52 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2319874545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:52.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:52 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2319874545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:53.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:53 smithi116 ceph-mon[33391]: pgmap v68: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:53.358 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:53 smithi088 ceph-mon[27963]: pgmap v68: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:53.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.894+0000 7f3ad8708700 1 -- 172.21.15.88:0/1147094012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0068540 msgr2=0x7f3ad00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:53.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.894+0000 7f3ad8708700 1 --2- 172.21.15.88:0/1147094012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0068540 0x7f3ad00689b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009910 tx=0x7f3acc009c20 comp rx=0 tx=0).stop 2024-09-13T21:43:53.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.894+0000 7f3ad8708700 1 -- 172.21.15.88:0/1147094012 shutdown_connections 2024-09-13T21:43:53.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.894+0000 7f3ad8708700 1 --2- 172.21.15.88:0/1147094012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0068540 0x7f3ad00689b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:53.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.894+0000 7f3ad8708700 1 --2- 172.21.15.88:0/1147094012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ad0105230 0x7f3ad0105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:53.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.894+0000 7f3ad8708700 1 -- 172.21.15.88:0/1147094012 >> 172.21.15.88:0/1147094012 conn(0x7f3ad0075130 msgr2=0x7f3ad0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:53.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.894+0000 7f3ad8708700 1 -- 172.21.15.88:0/1147094012 shutdown_connections 2024-09-13T21:43:53.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.894+0000 7f3ad8708700 1 -- 172.21.15.88:0/1147094012 wait complete. 2024-09-13T21:43:53.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad8708700 1 Processor -- start 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad8708700 1 -- start start 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad8708700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ad0068540 0x7f3ad00ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad8708700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0105230 0x7f3ad01001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad8708700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad01007b0 con 0x7f3ad0105230 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad8708700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0100920 con 0x7f3ad0068540 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad5ca3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0105230 0x7f3ad01001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad5ca3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0105230 0x7f3ad01001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43122/0 (socket says 172.21.15.88:43122) 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad5ca3700 1 -- 172.21.15.88:0/1604657125 learned_addr learned my addr 172.21.15.88:0/1604657125 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad64a4700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ad0068540 0x7f3ad00ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad5ca3700 1 -- 172.21.15.88:0/1604657125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ad0068540 msgr2=0x7f3ad00ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad5ca3700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ad0068540 0x7f3ad00ffca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.895+0000 7f3ad5ca3700 1 -- 172.21.15.88:0/1604657125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0095f0 con 0x7f3ad0105230 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.896+0000 7f3ad5ca3700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0105230 0x7f3ad01001e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3acc006010 tx=0x7f3acc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.896+0000 7f3ac77fe700 1 -- 172.21.15.88:0/1604657125 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc01d070 con 0x7f3ad0105230 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.896+0000 7f3ac77fe700 1 -- 172.21.15.88:0/1604657125 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3acc00f460 con 0x7f3ad0105230 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.896+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad01a2090 con 0x7f3ad0105230 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.896+0000 7f3ac77fe700 1 -- 172.21.15.88:0/1604657125 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc017610 con 0x7f3ad0105230 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.896+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad01a2440 con 0x7f3ad0105230 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.897+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad0108770 con 0x7f3ad0105230 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.897+0000 7f3ac77fe700 1 -- 172.21.15.88:0/1604657125 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f3acc00f5d0 con 0x7f3ad0105230 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.898+0000 7f3ac77fe700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3abc06e300 0x7f3abc0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:53.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.898+0000 7f3ac77fe700 1 -- 172.21.15.88:0/1604657125 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f3acc08f5a0 con 0x7f3ad0105230 2024-09-13T21:43:53.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.898+0000 7f3ad64a4700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3abc06e300 0x7f3abc0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:53.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.898+0000 7f3ad64a4700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3abc06e300 0x7f3abc0707b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009a10 tx=0x7f3ac0009190 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:53.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:53.902+0000 7f3ac77fe700 1 -- 172.21.15.88:0/1604657125 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f3acc058cf0 con 0x7f3ad0105230 2024-09-13T21:43:54.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.193+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ad004f2a0 con 0x7f3ad0105230 2024-09-13T21:43:54.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.194+0000 7f3ac77fe700 1 -- 172.21.15.88:0/1604657125 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f3acc05c3b0 con 0x7f3ad0105230 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3abc06e300 msgr2=0x7f3abc0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3abc06e300 0x7f3abc0707b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009a10 tx=0x7f3ac0009190 comp rx=0 tx=0).stop 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0105230 msgr2=0x7f3ad01001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0105230 0x7f3ad01001e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3acc006010 tx=0x7f3acc00bd70 comp rx=0 tx=0).stop 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 shutdown_connections 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3abc06e300 0x7f3abc0707b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ad0068540 0x7f3ad00ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 --2- 172.21.15.88:0/1604657125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ad0105230 0x7f3ad01001e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 >> 172.21.15.88:0/1604657125 conn(0x7f3ad0075130 msgr2=0x7f3ad00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 shutdown_connections 2024-09-13T21:43:54.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:54.196+0000 7f3ad8708700 1 -- 172.21.15.88:0/1604657125 wait complete. 2024-09-13T21:43:54.209 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:43:54.858 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-13T21:43:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:43:55.183 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:55 smithi088 ceph-mon[27963]: pgmap v69: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:55.184 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:55 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1604657125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:55.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:55 smithi116 ceph-mon[33391]: pgmap v69: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:55.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:55 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/1604657125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:56.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.854+0000 7f43eea93700 1 -- 172.21.15.88:0/2819860891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 msgr2=0x7f43e8104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.854+0000 7f43eea93700 1 --2- 172.21.15.88:0/2819860891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 0x7f43e8104eb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009910 tx=0x7f43d4009c20 comp rx=0 tx=0).stop 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.854+0000 7f43eea93700 1 -- 172.21.15.88:0/2819860891 shutdown_connections 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.854+0000 7f43eea93700 1 --2- 172.21.15.88:0/2819860891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 0x7f43e8104eb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.854+0000 7f43eea93700 1 --2- 172.21.15.88:0/2819860891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43e80687a0 0x7f43e8068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.854+0000 7f43eea93700 1 -- 172.21.15.88:0/2819860891 >> 172.21.15.88:0/2819860891 conn(0x7f43e8075130 msgr2=0x7f43e8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.854+0000 7f43eea93700 1 -- 172.21.15.88:0/2819860891 shutdown_connections 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.854+0000 7f43eea93700 1 -- 172.21.15.88:0/2819860891 wait complete. 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43eea93700 1 Processor -- start 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43eea93700 1 -- start start 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43eea93700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43e80687a0 0x7f43e8195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:56.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43eea93700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 0x7f43e81964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:56.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43eea93700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8196b80 con 0x7f43e8069140 2024-09-13T21:43:56.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43eea93700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e819a910 con 0x7f43e80687a0 2024-09-13T21:43:56.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43e7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 0x7f43e81964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:56.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43e7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 0x7f43e81964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43150/0 (socket says 172.21.15.88:43150) 2024-09-13T21:43:56.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43e7fff700 1 -- 172.21.15.88:0/3340618139 learned_addr learned my addr 172.21.15.88:0/3340618139 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:43:56.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43e7fff700 1 -- 172.21.15.88:0/3340618139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43e80687a0 msgr2=0x7f43e8195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:56.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43e7fff700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43e80687a0 0x7f43e8195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:56.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43e7fff700 1 -- 172.21.15.88:0/3340618139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40095f0 con 0x7f43e8069140 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.855+0000 7f43e7fff700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 0x7f43e81964a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f43d40092e0 tx=0x7f43d400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.856+0000 7f43e5ffb700 1 -- 172.21.15.88:0/3340618139 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d401d070 con 0x7f43e8069140 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.856+0000 7f43e5ffb700 1 -- 172.21.15.88:0/3340618139 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43d400f460 con 0x7f43e8069140 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.856+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e819ab90 con 0x7f43e8069140 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.856+0000 7f43e5ffb700 1 -- 172.21.15.88:0/3340618139 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d40175f0 con 0x7f43e8069140 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.856+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e819b080 con 0x7f43e8069140 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.857+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e81087e0 con 0x7f43e8069140 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.857+0000 7f43e5ffb700 1 -- 172.21.15.88:0/3340618139 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f43d400f5d0 con 0x7f43e8069140 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.858+0000 7f43e5ffb700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43d806e300 0x7f43d80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.858+0000 7f43e5ffb700 1 -- 172.21.15.88:0/3340618139 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f43d408f550 con 0x7f43e8069140 2024-09-13T21:43:56.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.858+0000 7f43ec82f700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43d806e300 0x7f43d80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:56.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.858+0000 7f43ec82f700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43d806e300 0x7f43d80707b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00ab90 tx=0x7f43dc009250 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:56.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:56.863+0000 7f43e5ffb700 1 -- 172.21.15.88:0/3340618139 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f43d4058ca0 con 0x7f43e8069140 2024-09-13T21:43:57.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:57.087+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}) v1 -- 0x7f43e819b3b0 con 0x7f43d806e300 2024-09-13T21:43:57.089 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:56 smithi088 ceph-mon[27963]: pgmap v70: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:57.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:56 smithi116 ceph-mon[33391]: pgmap v70: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:58.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:57 smithi088 ceph-mon[27963]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:58.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:57 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:58.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:57 smithi116 ceph-mon[33391]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:58.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:57 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:59.102 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:43:59 smithi088 ceph-mon[27963]: pgmap v71: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:59.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.129+0000 7f43e5ffb700 1 -- 172.21.15.88:0/3340618139 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5393 (secure 0 0 0) 0x7f43e819b3b0 con 0x7f43d806e300 2024-09-13T21:43:59.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43d806e300 msgr2=0x7f43d80707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:59.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43d806e300 0x7f43d80707b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00ab90 tx=0x7f43dc009250 comp rx=0 tx=0).stop 2024-09-13T21:43:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 msgr2=0x7f43e81964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 0x7f43e81964a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f43d40092e0 tx=0x7f43d400be20 comp rx=0 tx=0).stop 2024-09-13T21:43:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 shutdown_connections 2024-09-13T21:43:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f43d806e300 0x7f43d80707b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43e80687a0 0x7f43e8195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 --2- 172.21.15.88:0/3340618139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e8069140 0x7f43e81964a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 >> 172.21.15.88:0/3340618139 conn(0x7f43e8075130 msgr2=0x7f43e80fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 shutdown_connections 2024-09-13T21:43:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:43:59.132+0000 7f43eea93700 1 -- 172.21.15.88:0/3340618139 wait complete. 2024-09-13T21:43:59.145 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:43:59.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:43:59 smithi116 ceph-mon[33391]: pgmap v71: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:59.727 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T21:43:59.926 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:44:00.276 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:00 smithi088 ceph-mon[27963]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:44:00.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:00 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:44:01.311 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:01 smithi088 ceph-mon[27963]: pgmap v72: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:01.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:01 smithi116 ceph-mon[33391]: pgmap v72: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.701+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/1476807984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b54100e80 msgr2=0x7f7b54104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.701+0000 7f7b5ab1c700 1 --2- 172.21.15.88:0/1476807984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b54100e80 0x7f7b54104e50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009910 tx=0x7f7b40009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/1476807984 shutdown_connections 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 --2- 172.21.15.88:0/1476807984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b54100e80 0x7f7b54104e50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 --2- 172.21.15.88:0/1476807984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b541004e0 0x7f7b541008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/1476807984 >> 172.21.15.88:0/1476807984 conn(0x7f7b540fbda0 msgr2=0x7f7b540fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/1476807984 shutdown_connections 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/1476807984 wait complete. 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 Processor -- start 2024-09-13T21:44:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 -- start start 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b541004e0 0x7f7b54196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b54100e80 0x7f7b54196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54196c20 con 0x7f7b541004e0 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.702+0000 7f7b5ab1c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5419a9b0 con 0x7f7b54100e80 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b588b8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b541004e0 0x7f7b54196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b588b8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b541004e0 0x7f7b54196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60504/0 (socket says 172.21.15.88:60504) 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b588b8700 1 -- 172.21.15.88:0/2178545409 learned_addr learned my addr 172.21.15.88:0/2178545409 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b53fff700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b54100e80 0x7f7b54196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b588b8700 1 -- 172.21.15.88:0/2178545409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b54100e80 msgr2=0x7f7b54196540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b588b8700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b54100e80 0x7f7b54196540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b588b8700 1 -- 172.21.15.88:0/2178545409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400095f0 con 0x7f7b541004e0 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b588b8700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b541004e0 0x7f7b54196000 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800b4b0 tx=0x7f7b4800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b51ffb700 1 -- 172.21.15.88:0/2178545409 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b48011800 con 0x7f7b541004e0 2024-09-13T21:44:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5419ac90 con 0x7f7b541004e0 2024-09-13T21:44:01.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b51ffb700 1 -- 172.21.15.88:0/2178545409 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b48011e20 con 0x7f7b541004e0 2024-09-13T21:44:01.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b51ffb700 1 -- 172.21.15.88:0/2178545409 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b4800f2e0 con 0x7f7b541004e0 2024-09-13T21:44:01.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.703+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5419b1e0 con 0x7f7b541004e0 2024-09-13T21:44:01.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.704+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b54108780 con 0x7f7b541004e0 2024-09-13T21:44:01.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.705+0000 7f7b51ffb700 1 -- 172.21.15.88:0/2178545409 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f7b48010380 con 0x7f7b541004e0 2024-09-13T21:44:01.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.705+0000 7f7b51ffb700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f7b4406e300 0x7f7b440707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:01.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.705+0000 7f7b51ffb700 1 -- 172.21.15.88:0/2178545409 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f7b4808dbf0 con 0x7f7b541004e0 2024-09-13T21:44:01.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.705+0000 7f7b53fff700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f7b4406e300 0x7f7b440707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:01.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.706+0000 7f7b53fff700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f7b4406e300 0x7f7b440707b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b54197620 tx=0x7f7b4001a040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:01.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.710+0000 7f7b51ffb700 1 -- 172.21.15.88:0/2178545409 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f7b480572c0 con 0x7f7b541004e0 2024-09-13T21:44:01.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.917+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b5419b460 con 0x7f7b4406e300 2024-09-13T21:44:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.927+0000 7f7b51ffb700 1 -- 172.21.15.88:0/2178545409 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7b5419b460 con 0x7f7b4406e300 2024-09-13T21:44:01.928 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (67s) 39s ago 11m 16.9M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (11m) 39s ago 11m 7822k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (10m) 96s ago 10m 7666k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (11m) 39s ago 11m 6669k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (10m) 96s ago 10m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (45s) 39s ago 11m 47.4M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (5m) 39s ago 5m 120M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (5m) 39s ago 5m 14.5M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (5m) 96s ago 5m 15.9M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (5m) 96s ago 5m 121M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (2m) 39s ago 12m 504M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (117s) 96s ago 10m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (12m) 39s ago 12m 56.4M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:44:01.929 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (10m) 96s ago 10m 42.7M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:44:01.930 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (103s) 39s ago 11m 8312k - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:44:01.930 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (99s) 96s ago 10m 3649k - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:44:01.930 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (9m) 39s ago 9m 224M 1216M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:44:01.930 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (9m) 39s ago 9m 241M 1216M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:44:01.930 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (8m) 39s ago 8m 195M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:44:01.930 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (8m) 96s ago 8m 270M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:44:01.930 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (7m) 96s ago 7m 253M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:44:01.930 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (7m) 96s ago 7m 226M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:44:01.930 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (83s) 39s ago 10m 56.0M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f7b4406e300 msgr2=0x7f7b440707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f7b4406e300 0x7f7b440707b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b54197620 tx=0x7f7b4001a040 comp rx=0 tx=0).stop 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b541004e0 msgr2=0x7f7b54196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b541004e0 0x7f7b54196000 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800b4b0 tx=0x7f7b4800b7c0 comp rx=0 tx=0).stop 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 shutdown_connections 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f7b4406e300 0x7f7b440707b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b541004e0 0x7f7b54196000 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 --2- 172.21.15.88:0/2178545409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b54100e80 0x7f7b54196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 >> 172.21.15.88:0/2178545409 conn(0x7f7b540fbda0 msgr2=0x7f7b540fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 shutdown_connections 2024-09-13T21:44:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:01.929+0000 7f7b5ab1c700 1 -- 172.21.15.88:0/2178545409 wait complete. 2024-09-13T21:44:02.228 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:02 smithi088 ceph-mon[27963]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:02.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:02 smithi116 ceph-mon[33391]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:02.542 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T21:44:02.544 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:44:02.544 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-13T21:44:02.762 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:44:03.148 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:03 smithi088 ceph-mon[27963]: pgmap v73: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:03.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:03 smithi116 ceph-mon[33391]: pgmap v73: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:04.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.391+0000 7f8e36f4e700 1 -- 172.21.15.88:0/3801786688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e30104130 msgr2=0x7f8e30104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:04.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.391+0000 7f8e36f4e700 1 --2- 172.21.15.88:0/3801786688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e30104130 0x7f8e30104500 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009910 tx=0x7f8e24009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.391+0000 7f8e36f4e700 1 -- 172.21.15.88:0/3801786688 shutdown_connections 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.391+0000 7f8e36f4e700 1 --2- 172.21.15.88:0/3801786688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e300ffbd0 0x7f8e30100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.391+0000 7f8e36f4e700 1 --2- 172.21.15.88:0/3801786688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e30104130 0x7f8e30104500 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.391+0000 7f8e36f4e700 1 -- 172.21.15.88:0/3801786688 >> 172.21.15.88:0/3801786688 conn(0x7f8e30075130 msgr2=0x7f8e30075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.391+0000 7f8e36f4e700 1 -- 172.21.15.88:0/3801786688 shutdown_connections 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.391+0000 7f8e36f4e700 1 -- 172.21.15.88:0/3801786688 wait complete. 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e36f4e700 1 Processor -- start 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e36f4e700 1 -- start start 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e36f4e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e300ffbd0 0x7f8e30196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:04.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e36f4e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e30104130 0x7f8e301972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e36f4e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e301979d0 con 0x7f8e300ffbd0 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e36f4e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30197b40 con 0x7f8e30104130 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e34cea700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e300ffbd0 0x7f8e30196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e34cea700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e300ffbd0 0x7f8e30196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60526/0 (socket says 172.21.15.88:60526) 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e34cea700 1 -- 172.21.15.88:0/2225248972 learned_addr learned my addr 172.21.15.88:0/2225248972 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.392+0000 7f8e2ffff700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e30104130 0x7f8e301972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.393+0000 7f8e34cea700 1 -- 172.21.15.88:0/2225248972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e30104130 msgr2=0x7f8e301972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.393+0000 7f8e34cea700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e30104130 0x7f8e301972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.393+0000 7f8e34cea700 1 -- 172.21.15.88:0/2225248972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240095f0 con 0x7f8e300ffbd0 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.393+0000 7f8e34cea700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e300ffbd0 0x7f8e30196db0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400bd70 tx=0x7f8e2400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.393+0000 7f8e2dffb700 1 -- 172.21.15.88:0/2225248972 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2401d070 con 0x7f8e300ffbd0 2024-09-13T21:44:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.393+0000 7f8e2dffb700 1 -- 172.21.15.88:0/2225248972 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e2400f460 con 0x7f8e300ffbd0 2024-09-13T21:44:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.393+0000 7f8e2dffb700 1 -- 172.21.15.88:0/2225248972 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e24017630 con 0x7f8e300ffbd0 2024-09-13T21:44:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.393+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3019fe20 con 0x7f8e300ffbd0 2024-09-13T21:44:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.393+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e301a0240 con 0x7f8e300ffbd0 2024-09-13T21:44:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.394+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e301076a0 con 0x7f8e300ffbd0 2024-09-13T21:44:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.395+0000 7f8e2dffb700 1 -- 172.21.15.88:0/2225248972 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f8e2400f5d0 con 0x7f8e300ffbd0 2024-09-13T21:44:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.395+0000 7f8e2dffb700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f8e2006e300 0x7f8e200707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.395+0000 7f8e2dffb700 1 -- 172.21.15.88:0/2225248972 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f8e2408f6b0 con 0x7f8e300ffbd0 2024-09-13T21:44:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.395+0000 7f8e2ffff700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f8e2006e300 0x7f8e200707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.396+0000 7f8e2ffff700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f8e2006e300 0x7f8e200707b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c006fd0 tx=0x7f8e1c008040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.400+0000 7f8e2dffb700 1 -- 172.21.15.88:0/2225248972 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f8e24058d80 con 0x7f8e300ffbd0 2024-09-13T21:44:04.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.600+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f8e30107080 con 0x7f8e300ffbd0 2024-09-13T21:44:04.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.604+0000 7f8e2dffb700 1 -- 172.21.15.88:0/2225248972 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v45)=0 v45) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8e2405c440 con 0x7f8e300ffbd0 2024-09-13T21:44:04.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f8e2006e300 msgr2=0x7f8e200707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:04.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f8e2006e300 0x7f8e200707b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c006fd0 tx=0x7f8e1c008040 comp rx=0 tx=0).stop 2024-09-13T21:44:04.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e300ffbd0 msgr2=0x7f8e30196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e300ffbd0 0x7f8e30196db0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400bd70 tx=0x7f8e2400be50 comp rx=0 tx=0).stop 2024-09-13T21:44:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 shutdown_connections 2024-09-13T21:44:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f8e2006e300 0x7f8e200707b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e300ffbd0 0x7f8e30196db0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 --2- 172.21.15.88:0/2225248972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e30104130 0x7f8e301972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 >> 172.21.15.88:0/2225248972 conn(0x7f8e30075130 msgr2=0x7f8e300fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 shutdown_connections 2024-09-13T21:44:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:04.607+0000 7f8e36f4e700 1 -- 172.21.15.88:0/2225248972 wait complete. 2024-09-13T21:44:05.273 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T21:44:05.274 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:44:05.274 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T21:44:05.476 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:44:05.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:05 smithi088 ceph-mon[27963]: pgmap v74: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:05.904 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:05 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2225248972' entity='client.admin' 2024-09-13T21:44:05.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:05 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:05.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:05 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:05.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:05 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:05.905 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:05 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:05 smithi116 ceph-mon[33391]: pgmap v74: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:05 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2225248972' entity='client.admin' 2024-09-13T21:44:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:05 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:06.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:05 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:06.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:05 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:06.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:05 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:07.136 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:06 smithi088 ceph-mon[27963]: pgmap v75: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.240+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/3306133809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e4104130 msgr2=0x7fb9e4104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.240+0000 7fb9ebbe1700 1 --2- 172.21.15.88:0/3306133809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e4104130 0x7fb9e4104500 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009910 tx=0x7fb9e0009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.240+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/3306133809 shutdown_connections 2024-09-13T21:44:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.240+0000 7fb9ebbe1700 1 --2- 172.21.15.88:0/3306133809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e40ffbd0 0x7fb9e4100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.240+0000 7fb9ebbe1700 1 --2- 172.21.15.88:0/3306133809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e4104130 0x7fb9e4104500 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.240+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/3306133809 >> 172.21.15.88:0/3306133809 conn(0x7fb9e4075130 msgr2=0x7fb9e4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.240+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/3306133809 shutdown_connections 2024-09-13T21:44:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.240+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/3306133809 wait complete. 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9ebbe1700 1 Processor -- start 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9ebbe1700 1 -- start start 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9ebbe1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e40ffbd0 0x7fb9e4196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9ebbe1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e4104130 0x7fb9e41972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9ebbe1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e41979b0 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9ebbe1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4197b20 con 0x7fb9e4104130 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9e997d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e40ffbd0 0x7fb9e4196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9e997d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e40ffbd0 0x7fb9e4196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60538/0 (socket says 172.21.15.88:60538) 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9e997d700 1 -- 172.21.15.88:0/4175553822 learned_addr learned my addr 172.21.15.88:0/4175553822 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9e917c700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e4104130 0x7fb9e41972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9e997d700 1 -- 172.21.15.88:0/4175553822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e4104130 msgr2=0x7fb9e41972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9e997d700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e4104130 0x7fb9e41972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.241+0000 7fb9e997d700 1 -- 172.21.15.88:0/4175553822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00095f0 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.242+0000 7fb9e997d700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e40ffbd0 0x7fb9e4196d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000bd70 tx=0x7fb9e000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.242+0000 7fb9daffd700 1 -- 172.21.15.88:0/4175553822 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9e001d070 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.242+0000 7fb9daffd700 1 -- 172.21.15.88:0/4175553822 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9e000f460 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.242+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e419fe00 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.242+0000 7fb9daffd700 1 -- 172.21.15.88:0/4175553822 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9e0017630 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.242+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e41a0240 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.243+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e41076a0 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.243+0000 7fb9daffd700 1 -- 172.21.15.88:0/4175553822 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7fb9e000f5d0 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.244+0000 7fb9daffd700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb9d006e300 0x7fb9d00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.244+0000 7fb9daffd700 1 -- 172.21.15.88:0/4175553822 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb9e008f610 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.244+0000 7fb9e917c700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb9d006e300 0x7fb9d00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.244+0000 7fb9e917c700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb9d006e300 0x7fb9d00707b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006fd0 tx=0x7fb9d4008040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:07.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.249+0000 7fb9daffd700 1 -- 172.21.15.88:0/4175553822 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fb9e0058d60 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:06 smithi116 ceph-mon[33391]: pgmap v75: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.446+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fb9e4107080 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.447+0000 7fb9daffd700 1 -- 172.21.15.88:0/4175553822 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v45)=0 v45) v1 ==== 155+0+0 (secure 0 0 0) 0x7fb9e005c420 con 0x7fb9e40ffbd0 2024-09-13T21:44:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb9d006e300 msgr2=0x7fb9d00707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb9d006e300 0x7fb9d00707b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006fd0 tx=0x7fb9d4008040 comp rx=0 tx=0).stop 2024-09-13T21:44:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e40ffbd0 msgr2=0x7fb9e4196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e40ffbd0 0x7fb9e4196d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000bd70 tx=0x7fb9e000be50 comp rx=0 tx=0).stop 2024-09-13T21:44:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 shutdown_connections 2024-09-13T21:44:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fb9d006e300 0x7fb9d00707b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e40ffbd0 0x7fb9e4196d90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 --2- 172.21.15.88:0/4175553822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e4104130 0x7fb9e41972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 >> 172.21.15.88:0/4175553822 conn(0x7fb9e4075130 msgr2=0x7fb9e40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 shutdown_connections 2024-09-13T21:44:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:07.449+0000 7fb9ebbe1700 1 -- 172.21.15.88:0/4175553822 wait complete. 2024-09-13T21:44:08.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T21:44:08.211 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:44:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:09 smithi116 ceph-mon[33391]: pgmap v76: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:09.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:09 smithi088 ceph-mon[27963]: pgmap v76: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:09.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.913+0000 7f5c46343700 1 -- 172.21.15.88:0/792325281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 msgr2=0x7f5c40109550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.913+0000 7f5c46343700 1 --2- 172.21.15.88:0/792325281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 0x7f5c40109550 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009910 tx=0x7f5c34009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.913+0000 7f5c46343700 1 -- 172.21.15.88:0/792325281 shutdown_connections 2024-09-13T21:44:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.913+0000 7f5c46343700 1 --2- 172.21.15.88:0/792325281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 0x7f5c40109550 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.913+0000 7f5c46343700 1 --2- 172.21.15.88:0/792325281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c401004e0 0x7f5c401008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.913+0000 7f5c46343700 1 -- 172.21.15.88:0/792325281 >> 172.21.15.88:0/792325281 conn(0x7f5c40074930 msgr2=0x7f5c40074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.913+0000 7f5c46343700 1 -- 172.21.15.88:0/792325281 shutdown_connections 2024-09-13T21:44:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.913+0000 7f5c46343700 1 -- 172.21.15.88:0/792325281 wait complete. 2024-09-13T21:44:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.914+0000 7f5c46343700 1 Processor -- start 2024-09-13T21:44:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.914+0000 7f5c46343700 1 -- start start 2024-09-13T21:44:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.914+0000 7f5c46343700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c401004e0 0x7f5c40196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c46343700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 0x7f5c401972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c46343700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401978d0 con 0x7f5c40100df0 2024-09-13T21:44:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c46343700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40197a10 con 0x7f5c401004e0 2024-09-13T21:44:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 0x7f5c401972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 0x7f5c401972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60556/0 (socket says 172.21.15.88:60556) 2024-09-13T21:44:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3f7fe700 1 -- 172.21.15.88:0/1502472564 learned_addr learned my addr 172.21.15.88:0/1502472564 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3ffff700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c401004e0 0x7f5c40196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3f7fe700 1 -- 172.21.15.88:0/1502472564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c401004e0 msgr2=0x7f5c40196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3f7fe700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c401004e0 0x7f5c40196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3f7fe700 1 -- 172.21.15.88:0/1502472564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340095f0 con 0x7f5c40100df0 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3ffff700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c401004e0 0x7f5c40196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3f7fe700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 0x7f5c401972b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5c34006010 tx=0x7f5c3400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3d7fa700 1 -- 172.21.15.88:0/1502472564 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c3401d070 con 0x7f5c40100df0 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4019fde0 con 0x7f5c40100df0 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3d7fa700 1 -- 172.21.15.88:0/1502472564 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c34004fb0 con 0x7f5c40100df0 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.915+0000 7f5c3d7fa700 1 -- 172.21.15.88:0/1502472564 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c34022ea0 con 0x7f5c40100df0 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.916+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c401a01f0 con 0x7f5c40100df0 2024-09-13T21:44:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.916+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40106c50 con 0x7f5c40100df0 2024-09-13T21:44:09.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.917+0000 7f5c3d7fa700 1 -- 172.21.15.88:0/1502472564 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f5c34004af0 con 0x7f5c40100df0 2024-09-13T21:44:09.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.917+0000 7f5c3d7fa700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f5c2806e300 0x7f5c280707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.918+0000 7f5c3d7fa700 1 -- 172.21.15.88:0/1502472564 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f5c3408f530 con 0x7f5c40100df0 2024-09-13T21:44:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.918+0000 7f5c3ffff700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f5c2806e300 0x7f5c280707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.918+0000 7f5c3ffff700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f5c2806e300 0x7f5c280707b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5c30007900 tx=0x7f5c30008040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:09.922+0000 7f5c3d7fa700 1 -- 172.21.15.88:0/1502472564 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5c34058e50 con 0x7f5c40100df0 2024-09-13T21:44:10.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.119+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f5c40106630 con 0x7f5c40100df0 2024-09-13T21:44:10.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.119+0000 7f5c3d7fa700 1 -- 172.21.15.88:0/1502472564 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v45)=0 v45) v1 ==== 163+0+0 (secure 0 0 0) 0x7f5c3405c510 con 0x7f5c40100df0 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f5c2806e300 msgr2=0x7f5c280707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f5c2806e300 0x7f5c280707b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5c30007900 tx=0x7f5c30008040 comp rx=0 tx=0).stop 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 msgr2=0x7f5c401972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 0x7f5c401972b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5c34006010 tx=0x7f5c3400be20 comp rx=0 tx=0).stop 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 shutdown_connections 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f5c2806e300 0x7f5c280707b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c401004e0 0x7f5c40196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 --2- 172.21.15.88:0/1502472564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40100df0 0x7f5c401972b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 >> 172.21.15.88:0/1502472564 conn(0x7f5c40074930 msgr2=0x7f5c40103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 shutdown_connections 2024-09-13T21:44:10.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:10.121+0000 7f5c46343700 1 -- 172.21.15.88:0/1502472564 wait complete. 2024-09-13T21:44:10.761 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T21:44:10.959 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:44:11.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:11 smithi116 ceph-mon[33391]: pgmap v77: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:11.402 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:11 smithi088 ceph-mon[27963]: pgmap v77: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.645+0000 7f4cbf36c700 1 -- 172.21.15.88:0/60277383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb8100e60 msgr2=0x7f4cb8104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.645+0000 7f4cbf36c700 1 --2- 172.21.15.88:0/60277383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb8100e60 0x7f4cb8104e30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009910 tx=0x7f4ca8009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.645+0000 7f4cbf36c700 1 -- 172.21.15.88:0/60277383 shutdown_connections 2024-09-13T21:44:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.645+0000 7f4cbf36c700 1 --2- 172.21.15.88:0/60277383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb8100e60 0x7f4cb8104e30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.645+0000 7f4cbf36c700 1 --2- 172.21.15.88:0/60277383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb81004c0 0x7f4cb8100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.645+0000 7f4cbf36c700 1 -- 172.21.15.88:0/60277383 >> 172.21.15.88:0/60277383 conn(0x7f4cb80fbd80 msgr2=0x7f4cb80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.645+0000 7f4cbf36c700 1 -- 172.21.15.88:0/60277383 shutdown_connections 2024-09-13T21:44:12.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.645+0000 7f4cbf36c700 1 -- 172.21.15.88:0/60277383 wait complete. 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbf36c700 1 Processor -- start 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbf36c700 1 -- start start 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbf36c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb81004c0 0x7f4cb8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbf36c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb8100e60 0x7f4cb8196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbf36c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8196a80 con 0x7f4cb81004c0 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbf36c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8196bc0 con 0x7f4cb8100e60 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbd108700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb81004c0 0x7f4cb8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbd108700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb81004c0 0x7f4cb8195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36000/0 (socket says 172.21.15.88:36000) 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbd108700 1 -- 172.21.15.88:0/1389815129 learned_addr learned my addr 172.21.15.88:0/1389815129 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbc907700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb8100e60 0x7f4cb8196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbd108700 1 -- 172.21.15.88:0/1389815129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb8100e60 msgr2=0x7f4cb8196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbd108700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb8100e60 0x7f4cb8196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.646+0000 7f4cbd108700 1 -- 172.21.15.88:0/1389815129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca80095f0 con 0x7f4cb81004c0 2024-09-13T21:44:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.647+0000 7f4cbd108700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb81004c0 0x7f4cb8195ef0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400cfd0 tx=0x7f4cb400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.647+0000 7f4cae7fc700 1 -- 172.21.15.88:0/1389815129 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cb400ad70 con 0x7f4cb81004c0 2024-09-13T21:44:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.647+0000 7f4cae7fc700 1 -- 172.21.15.88:0/1389815129 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4cb4007e70 con 0x7f4cb81004c0 2024-09-13T21:44:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.647+0000 7f4cae7fc700 1 -- 172.21.15.88:0/1389815129 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cb4011810 con 0x7f4cb81004c0 2024-09-13T21:44:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.647+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb819aa10 con 0x7f4cb81004c0 2024-09-13T21:44:12.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.647+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb819af60 con 0x7f4cb81004c0 2024-09-13T21:44:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.648+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb8108830 con 0x7f4cb81004c0 2024-09-13T21:44:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.648+0000 7f4cae7fc700 1 -- 172.21.15.88:0/1389815129 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f4cb40119b0 con 0x7f4cb81004c0 2024-09-13T21:44:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.649+0000 7f4cae7fc700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4ca406e300 0x7f4ca40707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.649+0000 7f4cae7fc700 1 -- 172.21.15.88:0/1389815129 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f4cb408e050 con 0x7f4cb81004c0 2024-09-13T21:44:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.649+0000 7f4cbc907700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4ca406e300 0x7f4ca40707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:12.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.649+0000 7f4cbc907700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4ca406e300 0x7f4ca40707b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8197510 tx=0x7f4ca801a040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:12.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.654+0000 7f4cae7fc700 1 -- 172.21.15.88:0/1389815129 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f4cb40577a0 con 0x7f4cb81004c0 2024-09-13T21:44:12.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.849+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f4cb804f2a0 con 0x7f4cb81004c0 2024-09-13T21:44:12.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.850+0000 7f4cae7fc700 1 -- 172.21.15.88:0/1389815129 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v45)=0 v45) v1 ==== 135+0+0 (secure 0 0 0) 0x7f4cb405ae60 con 0x7f4cb81004c0 2024-09-13T21:44:12.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.852+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4ca406e300 msgr2=0x7f4ca40707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.852+0000 7f4cbf36c700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4ca406e300 0x7f4ca40707b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8197510 tx=0x7f4ca801a040 comp rx=0 tx=0).stop 2024-09-13T21:44:12.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.852+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb81004c0 msgr2=0x7f4cb8195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.852+0000 7f4cbf36c700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb81004c0 0x7f4cb8195ef0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400cfd0 tx=0x7f4cb400a340 comp rx=0 tx=0).stop 2024-09-13T21:44:12.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.853+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 shutdown_connections 2024-09-13T21:44:12.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.853+0000 7f4cbf36c700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f4ca406e300 0x7f4ca40707b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.853+0000 7f4cbf36c700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb81004c0 0x7f4cb8195ef0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.853+0000 7f4cbf36c700 1 --2- 172.21.15.88:0/1389815129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb8100e60 0x7f4cb8196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.853+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 >> 172.21.15.88:0/1389815129 conn(0x7f4cb80fbd80 msgr2=0x7f4cb80fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:12.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.853+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 shutdown_connections 2024-09-13T21:44:12.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:12.853+0000 7f4cbf36c700 1 -- 172.21.15.88:0/1389815129 wait complete. 2024-09-13T21:44:13.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:13 smithi088 ceph-mon[27963]: pgmap v78: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:13.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:13 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:13.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:13 smithi116 ceph-mon[33391]: pgmap v78: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:13.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:13 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:13.489 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T21:44:13.689 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:44:15.188 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:15 smithi088 ceph-mon[27963]: pgmap v79: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:15.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.291+0000 7f1f14eb8700 1 -- 172.21.15.88:0/12576131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100d70 msgr2=0x7f1f101094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:15.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.291+0000 7f1f14eb8700 1 --2- 172.21.15.88:0/12576131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100d70 0x7f1f101094d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009910 tx=0x7f1f00009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:15.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.291+0000 7f1f14eb8700 1 -- 172.21.15.88:0/12576131 shutdown_connections 2024-09-13T21:44:15.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.291+0000 7f1f14eb8700 1 --2- 172.21.15.88:0/12576131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100d70 0x7f1f101094d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:15.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.291+0000 7f1f14eb8700 1 --2- 172.21.15.88:0/12576131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f10100460 0x7f1f10100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:15.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.291+0000 7f1f14eb8700 1 -- 172.21.15.88:0/12576131 >> 172.21.15.88:0/12576131 conn(0x7f1f100748b0 msgr2=0x7f1f10074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:15.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.291+0000 7f1f14eb8700 1 -- 172.21.15.88:0/12576131 shutdown_connections 2024-09-13T21:44:15.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.291+0000 7f1f14eb8700 1 -- 172.21.15.88:0/12576131 wait complete. 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.292+0000 7f1f14eb8700 1 Processor -- start 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.292+0000 7f1f14eb8700 1 -- start start 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.292+0000 7f1f14eb8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100460 0x7f1f10194b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.292+0000 7f1f14eb8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f10100d70 0x7f1f101950c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.292+0000 7f1f14eb8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10100310 con 0x7f1f10100460 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.292+0000 7f1f14eb8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10195600 con 0x7f1f10100d70 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.292+0000 7f1f0e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100460 0x7f1f10194b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.292+0000 7f1f0e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100460 0x7f1f10194b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36018/0 (socket says 172.21.15.88:36018) 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.292+0000 7f1f0e59c700 1 -- 172.21.15.88:0/3636447361 learned_addr learned my addr 172.21.15.88:0/3636447361 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f0dd9b700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f10100d70 0x7f1f101950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f0e59c700 1 -- 172.21.15.88:0/3636447361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f10100d70 msgr2=0x7f1f101950c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f0e59c700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f10100d70 0x7f1f101950c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:15.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f0e59c700 1 -- 172.21.15.88:0/3636447361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f000095f0 con 0x7f1f10100460 2024-09-13T21:44:15.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f0dd9b700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f10100d70 0x7f1f101950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:44:15.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f0e59c700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100460 0x7f1f10194b80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c930 tx=0x7f1ef800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:15.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f077fe700 1 -- 172.21.15.88:0/3636447361 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef8007ad0 con 0x7f1f10100460 2024-09-13T21:44:15.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f101958e0 con 0x7f1f10100460 2024-09-13T21:44:15.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f077fe700 1 -- 172.21.15.88:0/3636447361 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ef8007c30 con 0x7f1f10100460 2024-09-13T21:44:15.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f077fe700 1 -- 172.21.15.88:0/3636447361 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef8018610 con 0x7f1f10100460 2024-09-13T21:44:15.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.293+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f101a24d0 con 0x7f1f10100460 2024-09-13T21:44:15.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.294+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f10106bd0 con 0x7f1f10100460 2024-09-13T21:44:15.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.295+0000 7f1f077fe700 1 -- 172.21.15.88:0/3636447361 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f1ef800f450 con 0x7f1f10100460 2024-09-13T21:44:15.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.295+0000 7f1f077fe700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f1efc06e300 0x7f1efc0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:15.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.295+0000 7f1f077fe700 1 -- 172.21.15.88:0/3636447361 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f1ef808e2c0 con 0x7f1f10100460 2024-09-13T21:44:15.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.295+0000 7f1f0dd9b700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f1efc06e300 0x7f1efc0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:15.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.296+0000 7f1f0dd9b700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f1efc06e300 0x7f1efc0707b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1f100ffcb0 tx=0x7f1f0001a040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:15.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.300+0000 7f1f077fe700 1 -- 172.21.15.88:0/3636447361 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f1ef805b4c0 con 0x7f1f10100460 2024-09-13T21:44:15.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:15 smithi116 ceph-mon[33391]: pgmap v79: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:15.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.522+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f10061190 con 0x7f1efc06e300 2024-09-13T21:44:15.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.528+0000 7f1f077fe700 1 -- 172.21.15.88:0/3636447361 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f1f10061190 con 0x7f1efc06e300 2024-09-13T21:44:15.531 INFO:teuthology.orchestra.run.smithi088.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:44:15.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.530+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f1efc06e300 msgr2=0x7f1efc0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:15.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.530+0000 7f1f14eb8700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f1efc06e300 0x7f1efc0707b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1f100ffcb0 tx=0x7f1f0001a040 comp rx=0 tx=0).stop 2024-09-13T21:44:15.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.531+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100460 msgr2=0x7f1f10194b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:15.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.531+0000 7f1f14eb8700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100460 0x7f1f10194b80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c930 tx=0x7f1ef800ccf0 comp rx=0 tx=0).stop 2024-09-13T21:44:15.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.531+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 shutdown_connections 2024-09-13T21:44:15.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.531+0000 7f1f14eb8700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f1efc06e300 0x7f1efc0707b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:15.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.531+0000 7f1f14eb8700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f10100460 0x7f1f10194b80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:15.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.531+0000 7f1f14eb8700 1 --2- 172.21.15.88:0/3636447361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f10100d70 0x7f1f101950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:15.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.531+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 >> 172.21.15.88:0/3636447361 conn(0x7f1f100748b0 msgr2=0x7f1f10103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:15.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.531+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 shutdown_connections 2024-09-13T21:44:15.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:15.531+0000 7f1f14eb8700 1 -- 172.21.15.88:0/3636447361 wait complete. 2024-09-13T21:44:16.205 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T21:44:16.205 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:44:16.206 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T21:44:16.422 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:44:16.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:16 smithi116 ceph-mon[33391]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:16.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:16 smithi116 ceph-mon[33391]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:44:16.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:16 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:16.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:16 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:16.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:16 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:16.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:16 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:16.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:16 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:16.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:16 smithi116 ceph-mon[33391]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:44:16.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:16 smithi088 ceph-mon[27963]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:16.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:16 smithi088 ceph-mon[27963]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:44:16.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:16 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:16.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:16 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:16.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:16 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:16.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:16 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:16.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:16 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:16.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:16 smithi088 ceph-mon[27963]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:44:17.794 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:17 smithi088 ceph-mon[27963]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:17.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:17 smithi116 ceph-mon[33391]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:18.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.200+0000 7fec60ded700 1 -- 172.21.15.88:0/3570783347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ff3c0 msgr2=0x7fec5c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.200+0000 7fec60ded700 1 --2- 172.21.15.88:0/3570783347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ff3c0 0x7fec5c0ff790 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009910 tx=0x7fec4c009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:18.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.201+0000 7fec60ded700 1 -- 172.21.15.88:0/3570783347 shutdown_connections 2024-09-13T21:44:18.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.201+0000 7fec60ded700 1 --2- 172.21.15.88:0/3570783347 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec5c0ffd60 0x7fec5c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.201+0000 7fec60ded700 1 --2- 172.21.15.88:0/3570783347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ff3c0 0x7fec5c0ff790 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.201+0000 7fec60ded700 1 -- 172.21.15.88:0/3570783347 >> 172.21.15.88:0/3570783347 conn(0x7fec5c0fac80 msgr2=0x7fec5c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:18.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.201+0000 7fec60ded700 1 -- 172.21.15.88:0/3570783347 shutdown_connections 2024-09-13T21:44:18.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.201+0000 7fec60ded700 1 -- 172.21.15.88:0/3570783347 wait complete. 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.201+0000 7fec60ded700 1 Processor -- start 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.201+0000 7fec60ded700 1 -- start start 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec60ded700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec5c0ff3c0 0x7fec5c196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec60ded700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ffd60 0x7fec5c197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec60ded700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c197830 con 0x7fec5c0ffd60 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec60ded700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c1979a0 con 0x7fec5c0ff3c0 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec59d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ffd60 0x7fec5c197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec59d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ffd60 0x7fec5c197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36026/0 (socket says 172.21.15.88:36026) 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec59d9b700 1 -- 172.21.15.88:0/759675692 learned_addr learned my addr 172.21.15.88:0/759675692 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec5a59c700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec5c0ff3c0 0x7fec5c196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec59d9b700 1 -- 172.21.15.88:0/759675692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec5c0ff3c0 msgr2=0x7fec5c196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec59d9b700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec5c0ff3c0 0x7fec5c196cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec59d9b700 1 -- 172.21.15.88:0/759675692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c0095f0 con 0x7fec5c0ffd60 2024-09-13T21:44:18.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec59d9b700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ffd60 0x7fec5c197210 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d900 tx=0x7fec5000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:18.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec4b7fe700 1 -- 172.21.15.88:0/759675692 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec50009900 con 0x7fec5c0ffd60 2024-09-13T21:44:18.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec4b7fe700 1 -- 172.21.15.88:0/759675692 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec50010460 con 0x7fec5c0ffd60 2024-09-13T21:44:18.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c19fd40 con 0x7fec5c0ffd60 2024-09-13T21:44:18.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.202+0000 7fec4b7fe700 1 -- 172.21.15.88:0/759675692 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5000f5f0 con 0x7fec5c0ffd60 2024-09-13T21:44:18.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.203+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c1a0230 con 0x7fec5c0ffd60 2024-09-13T21:44:18.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.204+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c1076d0 con 0x7fec5c0ffd60 2024-09-13T21:44:18.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.204+0000 7fec4b7fe700 1 -- 172.21.15.88:0/759675692 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7fec500105d0 con 0x7fec5c0ffd60 2024-09-13T21:44:18.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.205+0000 7fec4b7fe700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fec4406e300 0x7fec440707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:18.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.205+0000 7fec4b7fe700 1 -- 172.21.15.88:0/759675692 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fec5008dc70 con 0x7fec5c0ffd60 2024-09-13T21:44:18.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.205+0000 7fec5a59c700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fec4406e300 0x7fec440707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:18.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.206+0000 7fec5a59c700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fec4406e300 0x7fec440707b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00b5c0 tx=0x7fec4c01a040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:18.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.210+0000 7fec4b7fe700 1 -- 172.21.15.88:0/759675692 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fec50057340 con 0x7fec5c0ffd60 2024-09-13T21:44:18.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.438+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec5c02cca0 con 0x7fec4406e300 2024-09-13T21:44:18.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.439+0000 7fec4b7fe700 1 -- 172.21.15.88:0/759675692 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fec5c02cca0 con 0x7fec4406e300 2024-09-13T21:44:18.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fec4406e300 msgr2=0x7fec440707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fec4406e300 0x7fec440707b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00b5c0 tx=0x7fec4c01a040 comp rx=0 tx=0).stop 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ffd60 msgr2=0x7fec5c197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ffd60 0x7fec5c197210 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d900 tx=0x7fec5000dc10 comp rx=0 tx=0).stop 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 shutdown_connections 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fec4406e300 0x7fec440707b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec5c0ff3c0 0x7fec5c196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 --2- 172.21.15.88:0/759675692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5c0ffd60 0x7fec5c197210 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 >> 172.21.15.88:0/759675692 conn(0x7fec5c0fac80 msgr2=0x7fec5c0fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 shutdown_connections 2024-09-13T21:44:18.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.442+0000 7fec60ded700 1 -- 172.21.15.88:0/759675692 wait complete. 2024-09-13T21:44:18.454 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:44:18.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.552+0000 7ff53f1ce700 1 -- 172.21.15.88:0/369908758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 msgr2=0x7ff5381094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.552+0000 7ff53f1ce700 1 --2- 172.21.15.88:0/369908758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 0x7ff5381094d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff524009910 tx=0x7ff524009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:18.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.552+0000 7ff53f1ce700 1 -- 172.21.15.88:0/369908758 shutdown_connections 2024-09-13T21:44:18.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.552+0000 7ff53f1ce700 1 --2- 172.21.15.88:0/369908758 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 0x7ff5381094d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.552+0000 7ff53f1ce700 1 --2- 172.21.15.88:0/369908758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff538100460 0x7ff538100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.552+0000 7ff53f1ce700 1 -- 172.21.15.88:0/369908758 >> 172.21.15.88:0/369908758 conn(0x7ff5380748b0 msgr2=0x7ff538074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:18.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.552+0000 7ff53f1ce700 1 -- 172.21.15.88:0/369908758 shutdown_connections 2024-09-13T21:44:18.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.552+0000 7ff53f1ce700 1 -- 172.21.15.88:0/369908758 wait complete. 2024-09-13T21:44:18.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff53f1ce700 1 Processor -- start 2024-09-13T21:44:18.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff53f1ce700 1 -- start start 2024-09-13T21:44:18.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff53f1ce700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff538100460 0x7ff538195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:18.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff53f1ce700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 0x7ff5381963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff53f1ce700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff538196aa0 con 0x7ff538100d70 2024-09-13T21:44:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff53f1ce700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53819a830 con 0x7ff538100460 2024-09-13T21:44:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff537fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 0x7ff5381963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff537fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 0x7ff5381963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36044/0 (socket says 172.21.15.88:36044) 2024-09-13T21:44:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff537fff700 1 -- 172.21.15.88:0/1536097963 learned_addr learned my addr 172.21.15.88:0/1536097963 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff53cf6a700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff538100460 0x7ff538195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff537fff700 1 -- 172.21.15.88:0/1536097963 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff538100460 msgr2=0x7ff538195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff537fff700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff538100460 0x7ff538195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.553+0000 7ff537fff700 1 -- 172.21.15.88:0/1536097963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240095f0 con 0x7ff538100d70 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.554+0000 7ff537fff700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 0x7ff5381963c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff524006010 tx=0x7ff52400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.554+0000 7ff535ffb700 1 -- 172.21.15.88:0/1536097963 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff52401d070 con 0x7ff538100d70 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.554+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53819aab0 con 0x7ff538100d70 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.554+0000 7ff535ffb700 1 -- 172.21.15.88:0/1536097963 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff524004fb0 con 0x7ff538100d70 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.554+0000 7ff535ffb700 1 -- 172.21.15.88:0/1536097963 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff524022ea0 con 0x7ff538100d70 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.554+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53819afa0 con 0x7ff538100d70 2024-09-13T21:44:18.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.555+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff538107e40 con 0x7ff538100d70 2024-09-13T21:44:18.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.556+0000 7ff535ffb700 1 -- 172.21.15.88:0/1536097963 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7ff524022470 con 0x7ff538100d70 2024-09-13T21:44:18.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.556+0000 7ff535ffb700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff52806e300 0x7ff5280707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:18.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.556+0000 7ff535ffb700 1 -- 172.21.15.88:0/1536097963 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff52408f630 con 0x7ff538100d70 2024-09-13T21:44:18.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.556+0000 7ff53cf6a700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff52806e300 0x7ff5280707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:18.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.557+0000 7ff53cf6a700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff52806e300 0x7ff5280707b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff52c005fd0 tx=0x7ff52c00a560 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:18.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.561+0000 7ff535ffb700 1 -- 172.21.15.88:0/1536097963 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff524058db0 con 0x7ff538100d70 2024-09-13T21:44:18.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.819+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff53802cca0 con 0x7ff52806e300 2024-09-13T21:44:18.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.820+0000 7ff535ffb700 1 -- 172.21.15.88:0/1536097963 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ff53802cca0 con 0x7ff52806e300 2024-09-13T21:44:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.822+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff52806e300 msgr2=0x7ff5280707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.822+0000 7ff53f1ce700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff52806e300 0x7ff5280707b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff52c005fd0 tx=0x7ff52c00a560 comp rx=0 tx=0).stop 2024-09-13T21:44:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.822+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 msgr2=0x7ff5381963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.822+0000 7ff53f1ce700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 0x7ff5381963c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff524006010 tx=0x7ff52400be20 comp rx=0 tx=0).stop 2024-09-13T21:44:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.822+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 shutdown_connections 2024-09-13T21:44:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.822+0000 7ff53f1ce700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7ff52806e300 0x7ff5280707b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.822+0000 7ff53f1ce700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff538100460 0x7ff538195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.822+0000 7ff53f1ce700 1 --2- 172.21.15.88:0/1536097963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538100d70 0x7ff5381963c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.822+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 >> 172.21.15.88:0/1536097963 conn(0x7ff5380748b0 msgr2=0x7ff5380fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.823+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 shutdown_connections 2024-09-13T21:44:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.823+0000 7ff53f1ce700 1 -- 172.21.15.88:0/1536097963 wait complete. 2024-09-13T21:44:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.935+0000 7f3e7564a700 1 -- 172.21.15.88:0/3219659506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 msgr2=0x7f3e700ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.935+0000 7f3e7564a700 1 --2- 172.21.15.88:0/3219659506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 0x7f3e700ff720 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3e60009910 tx=0x7f3e60009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.935+0000 7f3e7564a700 1 -- 172.21.15.88:0/3219659506 shutdown_connections 2024-09-13T21:44:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.935+0000 7f3e7564a700 1 --2- 172.21.15.88:0/3219659506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e700ffc60 0x7f3e7010a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.935+0000 7f3e7564a700 1 --2- 172.21.15.88:0/3219659506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 0x7f3e700ff720 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.935+0000 7f3e7564a700 1 -- 172.21.15.88:0/3219659506 >> 172.21.15.88:0/3219659506 conn(0x7f3e700748b0 msgr2=0x7f3e70074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.935+0000 7f3e7564a700 1 -- 172.21.15.88:0/3219659506 shutdown_connections 2024-09-13T21:44:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.935+0000 7f3e7564a700 1 -- 172.21.15.88:0/3219659506 wait complete. 2024-09-13T21:44:18.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.935+0000 7f3e7564a700 1 Processor -- start 2024-09-13T21:44:18.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e7564a700 1 -- start start 2024-09-13T21:44:18.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e7564a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 0x7f3e70100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:18.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e7564a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e700ffc60 0x7f3e70100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:18.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e7564a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70100fb0 con 0x7f3e700ff350 2024-09-13T21:44:18.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e7564a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e701010f0 con 0x7f3e700ffc60 2024-09-13T21:44:18.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e6effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 0x7f3e70100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:18.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e6effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 0x7f3e70100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36050/0 (socket says 172.21.15.88:36050) 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e6effd700 1 -- 172.21.15.88:0/2362649198 learned_addr learned my addr 172.21.15.88:0/2362649198 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e6e7fc700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e700ffc60 0x7f3e70100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e6effd700 1 -- 172.21.15.88:0/2362649198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e700ffc60 msgr2=0x7f3e70100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e6effd700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e700ffc60 0x7f3e70100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e6effd700 1 -- 172.21.15.88:0/2362649198 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e600095f0 con 0x7f3e700ff350 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.936+0000 7f3e6effd700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 0x7f3e70100530 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3e600092e0 tx=0x7f3e6000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.937+0000 7f3e57fff700 1 -- 172.21.15.88:0/2362649198 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e6001d070 con 0x7f3e700ff350 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.937+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e70101370 con 0x7f3e700ff350 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.937+0000 7f3e57fff700 1 -- 172.21.15.88:0/2362649198 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e6000f460 con 0x7f3e700ff350 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.937+0000 7f3e57fff700 1 -- 172.21.15.88:0/2362649198 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e600175d0 con 0x7f3e700ff350 2024-09-13T21:44:18.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.937+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e701a24c0 con 0x7f3e700ff350 2024-09-13T21:44:18.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.938+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e70107dd0 con 0x7f3e700ff350 2024-09-13T21:44:18.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.938+0000 7f3e57fff700 1 -- 172.21.15.88:0/2362649198 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f3e60017890 con 0x7f3e700ff350 2024-09-13T21:44:18.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.939+0000 7f3e57fff700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3e5806e300 0x7f3e580707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:18.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.939+0000 7f3e57fff700 1 -- 172.21.15.88:0/2362649198 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f3e6008f4f0 con 0x7f3e700ff350 2024-09-13T21:44:18.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.939+0000 7f3e6e7fc700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3e5806e300 0x7f3e580707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:18.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.939+0000 7f3e6e7fc700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3e5806e300 0x7f3e580707b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e70101d20 tx=0x7f3e64009190 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:18.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:18.943+0000 7f3e57fff700 1 -- 172.21.15.88:0/2362649198 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f3e60058d80 con 0x7f3e700ff350 2024-09-13T21:44:19.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.161+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e70061190 con 0x7f3e5806e300 2024-09-13T21:44:19.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.171+0000 7f3e57fff700 1 -- 172.21.15.88:0/2362649198 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3e70061190 con 0x7f3e5806e300 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (85s) 56s ago 11m 16.9M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (11m) 56s ago 11m 7822k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (10m) 113s ago 10m 7666k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (11m) 56s ago 11m 6669k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (10m) 113s ago 10m 6660k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (62s) 56s ago 11m 47.4M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (6m) 56s ago 6m 120M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (6m) 56s ago 6m 14.5M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (6m) 113s ago 6m 15.9M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (6m) 113s ago 6m 121M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:44:19.173 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (2m) 56s ago 13m 504M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (2m) 113s ago 10m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (13m) 56s ago 13m 56.4M 2048M 18.2.0 dc2bc1663786 a9c74c8daaf1 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (10m) 113s ago 10m 42.7M 2048M 18.2.0 dc2bc1663786 19814db7b3d9 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (2m) 56s ago 11m 8312k - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (117s) 113s ago 10m 3649k - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (9m) 56s ago 9m 224M 1216M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (9m) 56s ago 9m 241M 1216M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (8m) 56s ago 8m 195M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (8m) 113s ago 8m 270M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (8m) 113s ago 8m 253M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (7m) 113s ago 7m 226M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:44:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (101s) 56s ago 11m 56.0M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:44:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3e5806e300 msgr2=0x7f3e580707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3e5806e300 0x7f3e580707b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e70101d20 tx=0x7f3e64009190 comp rx=0 tx=0).stop 2024-09-13T21:44:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 msgr2=0x7f3e70100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 0x7f3e70100530 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3e600092e0 tx=0x7f3e6000bd70 comp rx=0 tx=0).stop 2024-09-13T21:44:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 shutdown_connections 2024-09-13T21:44:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f3e5806e300 0x7f3e580707b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e700ff350 0x7f3e70100530 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 --2- 172.21.15.88:0/2362649198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e700ffc60 0x7f3e70100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 >> 172.21.15.88:0/2362649198 conn(0x7f3e700748b0 msgr2=0x7f3e70104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 shutdown_connections 2024-09-13T21:44:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.173+0000 7f3e7564a700 1 -- 172.21.15.88:0/2362649198 wait complete. 2024-09-13T21:44:19.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.281+0000 7f2209ead700 1 -- 172.21.15.88:0/482298420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 msgr2=0x7f2204100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.281+0000 7f2209ead700 1 --2- 172.21.15.88:0/482298420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 0x7f2204100040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009910 tx=0x7f21f8009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:19.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.281+0000 7f2209ead700 1 -- 172.21.15.88:0/482298420 shutdown_connections 2024-09-13T21:44:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.281+0000 7f2209ead700 1 --2- 172.21.15.88:0/482298420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 0x7f2204100040 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.281+0000 7f2209ead700 1 --2- 172.21.15.88:0/482298420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2204104130 0x7f2204104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.281+0000 7f2209ead700 1 -- 172.21.15.88:0/482298420 >> 172.21.15.88:0/482298420 conn(0x7f2204075130 msgr2=0x7f2204075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.281+0000 7f2209ead700 1 -- 172.21.15.88:0/482298420 shutdown_connections 2024-09-13T21:44:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.281+0000 7f2209ead700 1 -- 172.21.15.88:0/482298420 wait complete. 2024-09-13T21:44:19.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.282+0000 7f2209ead700 1 Processor -- start 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.282+0000 7f2209ead700 1 -- start start 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f2209ead700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 0x7f2204194bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f2209ead700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2204104130 0x7f22041950f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f2209ead700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2204195630 con 0x7f22040ffbd0 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f2209ead700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22041957a0 con 0x7f2204104130 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f22037fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 0x7f2204194bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f22037fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 0x7f2204194bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36072/0 (socket says 172.21.15.88:36072) 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f22037fe700 1 -- 172.21.15.88:0/2610022141 learned_addr learned my addr 172.21.15.88:0/2610022141 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f2202ffd700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2204104130 0x7f22041950f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f22037fe700 1 -- 172.21.15.88:0/2610022141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2204104130 msgr2=0x7f22041950f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f22037fe700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2204104130 0x7f22041950f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f22037fe700 1 -- 172.21.15.88:0/2610022141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f80095f0 con 0x7f22040ffbd0 2024-09-13T21:44:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f2202ffd700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2204104130 0x7f22041950f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:44:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.283+0000 7f22037fe700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 0x7f2204194bb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b4b0 tx=0x7f21f400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.284+0000 7f2200ff9700 1 -- 172.21.15.88:0/2610022141 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21f4011800 con 0x7f22040ffbd0 2024-09-13T21:44:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.284+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22041a2220 con 0x7f22040ffbd0 2024-09-13T21:44:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.284+0000 7f2200ff9700 1 -- 172.21.15.88:0/2610022141 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21f4011e20 con 0x7f22040ffbd0 2024-09-13T21:44:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.284+0000 7f2200ff9700 1 -- 172.21.15.88:0/2610022141 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21f400f2e0 con 0x7f22040ffbd0 2024-09-13T21:44:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.284+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22041a2580 con 0x7f22040ffbd0 2024-09-13T21:44:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.285+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220404f2a0 con 0x7f22040ffbd0 2024-09-13T21:44:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.285+0000 7f2200ff9700 1 -- 172.21.15.88:0/2610022141 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f21f4010380 con 0x7f22040ffbd0 2024-09-13T21:44:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.286+0000 7f2200ff9700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f21ec06e300 0x7f21ec0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.286+0000 7f2200ff9700 1 -- 172.21.15.88:0/2610022141 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f21f408db10 con 0x7f22040ffbd0 2024-09-13T21:44:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.286+0000 7f2202ffd700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f21ec06e300 0x7f21ec0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.286+0000 7f2202ffd700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f21ec06e300 0x7f21ec0707b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21f8006010 tx=0x7f21f800b540 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.292+0000 7f2200ff9700 1 -- 172.21.15.88:0/2610022141 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f21f405ad90 con 0x7f22040ffbd0 2024-09-13T21:44:19.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.597+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22041a28b0 con 0x7f22040ffbd0 2024-09-13T21:44:19.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.597+0000 7f2200ff9700 1 -- 172.21.15.88:0/2610022141 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f21f405a920 con 0x7f22040ffbd0 2024-09-13T21:44:19.599 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:44:19.599 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:44:19.599 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T21:44:19.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:44:19.599 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:44:19.599 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:44:19.600 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f21ec06e300 msgr2=0x7f21ec0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f21ec06e300 0x7f21ec0707b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21f8006010 tx=0x7f21f800b540 comp rx=0 tx=0).stop 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 msgr2=0x7f2204194bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 0x7f2204194bb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b4b0 tx=0x7f21f400b870 comp rx=0 tx=0).stop 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 shutdown_connections 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f21ec06e300 0x7f21ec0707b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22040ffbd0 0x7f2204194bb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 --2- 172.21.15.88:0/2610022141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2204104130 0x7f22041950f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 >> 172.21.15.88:0/2610022141 conn(0x7f2204075130 msgr2=0x7f22040fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 shutdown_connections 2024-09-13T21:44:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.600+0000 7f2209ead700 1 -- 172.21.15.88:0/2610022141 wait complete. 2024-09-13T21:44:19.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.714+0000 7fe4d66f8700 1 -- 172.21.15.88:0/3193179735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 msgr2=0x7fe4d0104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.714+0000 7fe4d66f8700 1 --2- 172.21.15.88:0/3193179735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 0x7fe4d0104500 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009910 tx=0x7fe4c0009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:19.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.714+0000 7fe4d66f8700 1 -- 172.21.15.88:0/3193179735 shutdown_connections 2024-09-13T21:44:19.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.714+0000 7fe4d66f8700 1 --2- 172.21.15.88:0/3193179735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4d00ffbd0 0x7fe4d0100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.714+0000 7fe4d66f8700 1 --2- 172.21.15.88:0/3193179735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 0x7fe4d0104500 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.714+0000 7fe4d66f8700 1 -- 172.21.15.88:0/3193179735 >> 172.21.15.88:0/3193179735 conn(0x7fe4d0075130 msgr2=0x7fe4d0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:19.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.714+0000 7fe4d66f8700 1 -- 172.21.15.88:0/3193179735 shutdown_connections 2024-09-13T21:44:19.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.714+0000 7fe4d66f8700 1 -- 172.21.15.88:0/3193179735 wait complete. 2024-09-13T21:44:19.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.715+0000 7fe4d66f8700 1 Processor -- start 2024-09-13T21:44:19.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.715+0000 7fe4d66f8700 1 -- start start 2024-09-13T21:44:19.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4d66f8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4d00ffbd0 0x7fe4d0196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:19.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4d66f8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 0x7fe4d01971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:19.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4d66f8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0197810 con 0x7fe4d0104130 2024-09-13T21:44:19.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4d66f8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0197950 con 0x7fe4d00ffbd0 2024-09-13T21:44:19.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 0x7fe4d01971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:19.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 0x7fe4d01971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36098/0 (socket says 172.21.15.88:36098) 2024-09-13T21:44:19.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cf7fe700 1 -- 172.21.15.88:0/1006964816 learned_addr learned my addr 172.21.15.88:0/1006964816 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cffff700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4d00ffbd0 0x7fe4d0196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cf7fe700 1 -- 172.21.15.88:0/1006964816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4d00ffbd0 msgr2=0x7fe4d0196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cf7fe700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4d00ffbd0 0x7fe4d0196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cf7fe700 1 -- 172.21.15.88:0/1006964816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00095f0 con 0x7fe4d0104130 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cf7fe700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 0x7fe4d01971f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c8a0 tx=0x7fe4c400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cd7fa700 1 -- 172.21.15.88:0/1006964816 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c40078e0 con 0x7fe4d0104130 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4cd7fa700 1 -- 172.21.15.88:0/1006964816 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4c400f450 con 0x7fe4d0104130 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.716+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d019fd20 con 0x7fe4d0104130 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.717+0000 7fe4cd7fa700 1 -- 172.21.15.88:0/1006964816 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c400e5e0 con 0x7fe4d0104130 2024-09-13T21:44:19.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.717+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d01a01e0 con 0x7fe4d0104130 2024-09-13T21:44:19.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.718+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d01076a0 con 0x7fe4d0104130 2024-09-13T21:44:19.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.718+0000 7fe4cd7fa700 1 -- 172.21.15.88:0/1006964816 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7fe4c400f5c0 con 0x7fe4d0104130 2024-09-13T21:44:19.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.718+0000 7fe4cd7fa700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe4b806e300 0x7fe4b80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:19.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.719+0000 7fe4cd7fa700 1 -- 172.21.15.88:0/1006964816 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe4c408df80 con 0x7fe4d0104130 2024-09-13T21:44:19.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.719+0000 7fe4cffff700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe4b806e300 0x7fe4b80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:19.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.719+0000 7fe4cffff700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe4b806e300 0x7fe4b80707b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000c00 tx=0x7fe4c001a040 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:19.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.723+0000 7fe4cd7fa700 1 -- 172.21.15.88:0/1006964816 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fe4c40576d0 con 0x7fe4d0104130 2024-09-13T21:44:19.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:19 smithi116 ceph-mon[33391]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:19.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:19 smithi116 ceph-mon[33391]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:19.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:19 smithi116 ceph-mon[33391]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:19.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:19 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:19.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:19 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:19.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:19 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:19.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:19 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:19.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:19 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T21:44:19.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:19 smithi088 ceph-mon[27963]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:19.893 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:19 smithi088 ceph-mon[27963]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:19.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:19 smithi088 ceph-mon[27963]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:19.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:19 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:19.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:19 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:19.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:19 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:19.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:19 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:19.894 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:19 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T21:44:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.976+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe4d004f2a0 con 0x7fe4d0104130 2024-09-13T21:44:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.977+0000 7fe4cd7fa700 1 -- 172.21.15.88:0/1006964816 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1832 (secure 0 0 0) 0x7fe4c405ad90 con 0x7fe4d0104130 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout:e20 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 20 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:44:19.979 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:44:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:44:19.981 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:44:19.982 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:19.982 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:19.982 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:44:19.982 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:44:19.982 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:44:19.982 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:44:19.982 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:19.982 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe4b806e300 msgr2=0x7fe4b80707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe4b806e300 0x7fe4b80707b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000c00 tx=0x7fe4c001a040 comp rx=0 tx=0).stop 2024-09-13T21:44:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 msgr2=0x7fe4d01971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 0x7fe4d01971f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c8a0 tx=0x7fe4c400cbb0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 shutdown_connections 2024-09-13T21:44:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7fe4b806e300 0x7fe4b80707b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4d00ffbd0 0x7fe4d0196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 --2- 172.21.15.88:0/1006964816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d0104130 0x7fe4d01971f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:19.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 >> 172.21.15.88:0/1006964816 conn(0x7fe4d0075130 msgr2=0x7fe4d00fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:19.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 shutdown_connections 2024-09-13T21:44:19.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:19.979+0000 7fe4d66f8700 1 -- 172.21.15.88:0/1006964816 wait complete. 2024-09-13T21:44:19.984 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:44:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.089+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1195476101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 msgr2=0x7f78d00ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.089+0000 7f78d6c0b700 1 --2- 172.21.15.88:0/1195476101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 0x7f78d00ff790 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009910 tx=0x7f78c4009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.089+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1195476101 shutdown_connections 2024-09-13T21:44:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.089+0000 7f78d6c0b700 1 --2- 172.21.15.88:0/1195476101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d00ffd60 0x7f78d0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.089+0000 7f78d6c0b700 1 --2- 172.21.15.88:0/1195476101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 0x7f78d00ff790 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.089+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1195476101 >> 172.21.15.88:0/1195476101 conn(0x7f78d00fac80 msgr2=0x7f78d00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.089+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1195476101 shutdown_connections 2024-09-13T21:44:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.089+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1195476101 wait complete. 2024-09-13T21:44:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d6c0b700 1 Processor -- start 2024-09-13T21:44:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d6c0b700 1 -- start start 2024-09-13T21:44:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d6c0b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 0x7f78d0194ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d6c0b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d00ffd60 0x7f78d0195020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d6c0b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d0195560 con 0x7f78d00ff3c0 2024-09-13T21:44:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d6c0b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d01956d0 con 0x7f78d00ffd60 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d49a7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 0x7f78d0194ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d49a7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 0x7f78d0194ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58940/0 (socket says 172.21.15.88:58940) 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d49a7700 1 -- 172.21.15.88:0/1968198537 learned_addr learned my addr 172.21.15.88:0/1968198537 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78cffff700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d00ffd60 0x7f78d0195020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d49a7700 1 -- 172.21.15.88:0/1968198537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d00ffd60 msgr2=0x7f78d0195020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d49a7700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d00ffd60 0x7f78d0195020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.090+0000 7f78d49a7700 1 -- 172.21.15.88:0/1968198537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c40095f0 con 0x7f78d00ff3c0 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.091+0000 7f78d49a7700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 0x7f78d0194ae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f78c4006010 tx=0x7f78c400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.091+0000 7f78cdffb700 1 -- 172.21.15.88:0/1968198537 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c401d070 con 0x7f78d00ff3c0 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.091+0000 7f78cdffb700 1 -- 172.21.15.88:0/1968198537 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78c4005dc0 con 0x7f78d00ff3c0 2024-09-13T21:44:20.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.091+0000 7f78cdffb700 1 -- 172.21.15.88:0/1968198537 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c4017400 con 0x7f78d00ff3c0 2024-09-13T21:44:20.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.091+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d0195950 con 0x7f78d00ff3c0 2024-09-13T21:44:20.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.091+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d01a23d0 con 0x7f78d00ff3c0 2024-09-13T21:44:20.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.092+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d01076d0 con 0x7f78d00ff3c0 2024-09-13T21:44:20.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.093+0000 7f78cdffb700 1 -- 172.21.15.88:0/1968198537 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f78c4003a60 con 0x7f78d00ff3c0 2024-09-13T21:44:20.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.093+0000 7f78cdffb700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f78c006e300 0x7f78c00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:20.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.093+0000 7f78cdffb700 1 -- 172.21.15.88:0/1968198537 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f78c408f2d0 con 0x7f78d00ff3c0 2024-09-13T21:44:20.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.093+0000 7f78cffff700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f78c006e300 0x7f78c00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:20.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.094+0000 7f78cffff700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f78c006e300 0x7f78c00707b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78d0069730 tx=0x7f78bc0073d0 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:20.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.098+0000 7f78cdffb700 1 -- 172.21.15.88:0/1968198537 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f78c405c550 con 0x7f78d00ff3c0 2024-09-13T21:44:20.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.332+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 --> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78d0195950 con 0x7f78c006e300 2024-09-13T21:44:20.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.333+0000 7f78cdffb700 1 -- 172.21.15.88:0/1968198537 <== mgr.14642 v2:172.21.15.88:6800/310029485 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f78d0195950 con 0x7f78c006e300 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/23 daemons upgraded", 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:44:20.335 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f78c006e300 msgr2=0x7f78c00707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f78c006e300 0x7f78c00707b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78d0069730 tx=0x7f78bc0073d0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 msgr2=0x7f78d0194ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 0x7f78d0194ae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f78c4006010 tx=0x7f78c400bd70 comp rx=0 tx=0).stop 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 shutdown_connections 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f78c006e300 0x7f78c00707b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d00ff3c0 0x7f78d0194ae0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 --2- 172.21.15.88:0/1968198537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d00ffd60 0x7f78d0195020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 >> 172.21.15.88:0/1968198537 conn(0x7f78d00fac80 msgr2=0x7f78d00fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 shutdown_connections 2024-09-13T21:44:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.335+0000 7f78d6c0b700 1 -- 172.21.15.88:0/1968198537 wait complete. 2024-09-13T21:44:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.443+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/284549369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 msgr2=0x7f9e34100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.443+0000 7f9e3a2fe700 1 --2- 172.21.15.88:0/284549369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 0x7f9e34100830 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009940 tx=0x7f9e24009c50 comp rx=0 tx=0).stop 2024-09-13T21:44:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.443+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/284549369 shutdown_connections 2024-09-13T21:44:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.443+0000 7f9e3a2fe700 1 --2- 172.21.15.88:0/284549369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e34100d70 0x7f9e341094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.443+0000 7f9e3a2fe700 1 --2- 172.21.15.88:0/284549369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 0x7f9e34100830 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.443+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/284549369 >> 172.21.15.88:0/284549369 conn(0x7f9e340748b0 msgr2=0x7f9e34074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.443+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/284549369 shutdown_connections 2024-09-13T21:44:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.443+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/284549369 wait complete. 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e3a2fe700 1 Processor -- start 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e3a2fe700 1 -- start start 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e3a2fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 0x7f9e34195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e3a2fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e34100d70 0x7f9e341962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e3a2fe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34196980 con 0x7f9e34100460 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e3a2fe700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3419a710 con 0x7f9e34100d70 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e33fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 0x7f9e34195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e33fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 0x7f9e34195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58956/0 (socket says 172.21.15.88:58956) 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e33fff700 1 -- 172.21.15.88:0/2431870092 learned_addr learned my addr 172.21.15.88:0/2431870092 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:20.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e2bfff700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e34100d70 0x7f9e341962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e33fff700 1 -- 172.21.15.88:0/2431870092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e34100d70 msgr2=0x7f9e341962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e33fff700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e34100d70 0x7f9e341962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e33fff700 1 -- 172.21.15.88:0/2431870092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240095f0 con 0x7f9e34100460 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e33fff700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 0x7f9e34195d60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9e240055f0 tx=0x7f9e240056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.444+0000 7f9e31ffb700 1 -- 172.21.15.88:0/2431870092 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e2401d070 con 0x7f9e34100460 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.445+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3419a9f0 con 0x7f9e34100460 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.445+0000 7f9e31ffb700 1 -- 172.21.15.88:0/2431870092 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e2400f460 con 0x7f9e34100460 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.445+0000 7f9e31ffb700 1 -- 172.21.15.88:0/2431870092 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e24021640 con 0x7f9e34100460 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.445+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3419af40 con 0x7f9e34100460 2024-09-13T21:44:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.445+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3404f2a0 con 0x7f9e34100460 2024-09-13T21:44:20.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.446+0000 7f9e31ffb700 1 -- 172.21.15.88:0/2431870092 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 31) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f9e2400fab0 con 0x7f9e34100460 2024-09-13T21:44:20.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.446+0000 7f9e31ffb700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9e2006e300 0x7f9e200707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:20.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.447+0000 7f9e31ffb700 1 -- 172.21.15.88:0/2431870092 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f9e2408f2f0 con 0x7f9e34100460 2024-09-13T21:44:20.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.447+0000 7f9e2bfff700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9e2006e300 0x7f9e200707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:20.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.447+0000 7f9e2bfff700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9e2006e300 0x7f9e200707b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c005fd0 tx=0x7f9e1c005f60 comp rx=0 tx=0).ready entity=mgr.14642 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:20.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.451+0000 7f9e31ffb700 1 -- 172.21.15.88:0/2431870092 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f9e240589c0 con 0x7f9e34100460 2024-09-13T21:44:20.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:20 smithi088 ceph-mon[27963]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:20.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:20 smithi088 ceph-mon[27963]: Upgrade: Target is version 19.1.1-324-gecab7be5 (squid) 2024-09-13T21:44:20.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:20 smithi088 ceph-mon[27963]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T21:44:20.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:20 smithi088 ceph-mon[27963]: Upgrade: Setting container_image for all mgr 2024-09-13T21:44:20.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:20 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2610022141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:20.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:20 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/1006964816' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:44:20.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.744+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9e3419b390 con 0x7f9e34100460 2024-09-13T21:44:20.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.745+0000 7f9e31ffb700 1 -- 172.21.15.88:0/2431870092 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f9e2405c080 con 0x7f9e34100460 2024-09-13T21:44:20.746 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:20.747 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:20.747 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:44:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9e2006e300 msgr2=0x7f9e200707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9e2006e300 0x7f9e200707b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c005fd0 tx=0x7f9e1c005f60 comp rx=0 tx=0).stop 2024-09-13T21:44:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 msgr2=0x7f9e34195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 0x7f9e34195d60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9e240055f0 tx=0x7f9e240056d0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 shutdown_connections 2024-09-13T21:44:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:6800/310029485,v1:172.21.15.88:6801/310029485] conn(0x7f9e2006e300 0x7f9e200707b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e34100460 0x7f9e34195d60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 --2- 172.21.15.88:0/2431870092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e34100d70 0x7f9e341962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 >> 172.21.15.88:0/2431870092 conn(0x7f9e340748b0 msgr2=0x7f9e340fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 shutdown_connections 2024-09-13T21:44:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:20.747+0000 7f9e3a2fe700 1 -- 172.21.15.88:0/2431870092 wait complete. 2024-09-13T21:44:20.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:20 smithi116 ceph-mon[33391]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:20.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:20 smithi116 ceph-mon[33391]: Upgrade: Target is version 19.1.1-324-gecab7be5 (squid) 2024-09-13T21:44:20.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:20 smithi116 ceph-mon[33391]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T21:44:20.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:20 smithi116 ceph-mon[33391]: Upgrade: Setting container_image for all mgr 2024-09-13T21:44:20.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:20 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2610022141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:20.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:20 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/1006964816' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:44:21.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:21 smithi088 ceph-mon[27963]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:21.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:21 smithi088 ceph-mon[27963]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:21.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:21 smithi088 ceph-mon[27963]: from='client.? 172.21.15.88:0/2431870092' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:44:21.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:21 smithi088 ceph-mon[27963]: Upgrade: Updating mon.smithi088 2024-09-13T21:44:21.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:21 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:21.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:21 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:44:21.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:21 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:44:21.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:21 smithi088 ceph-mon[27963]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:21.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:21 smithi088 ceph-mon[27963]: Deploying daemon mon.smithi088 on smithi088 2024-09-13T21:44:21.827 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:21 smithi116 ceph-mon[33391]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:21.827 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:21 smithi116 ceph-mon[33391]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:21.827 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:21 smithi116 ceph-mon[33391]: from='client.? 172.21.15.88:0/2431870092' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:44:21.827 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:21 smithi116 ceph-mon[33391]: Upgrade: Updating mon.smithi088 2024-09-13T21:44:21.827 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:21 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:21.828 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:21 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:44:21.828 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:21 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:44:21.828 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:21 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:21.828 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:21 smithi116 ceph-mon[33391]: Deploying daemon mon.smithi088 on smithi088 2024-09-13T21:44:22.635 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:22 smithi088 systemd[1]: Stopping Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:44:22.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:22 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088[27959]: 2024-09-13T21:44:22.632+0000 7ff3a93bf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi088 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:44:22.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:22 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088[27959]: 2024-09-13T21:44:22.633+0000 7ff3a93bf700 -1 mon.smithi088@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T21:44:22.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:22 smithi088 podman[86672]: 2024-09-13 21:44:22.725247423 +0000 UTC m=+0.213557961 container died a9c74c8daaf15f4d0434c890f5ee7f9dd2faef30c7fe7661e049a0e6ea584dcd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2) 2024-09-13T21:44:23.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:23 smithi088 podman[86672]: 2024-09-13 21:44:23.116389302 +0000 UTC m=+0.604699841 container cleanup a9c74c8daaf15f4d0434c890f5ee7f9dd2faef30c7fe7661e049a0e6ea584dcd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=HEAD, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T21:44:23.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:23 smithi088 bash[86672]: ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088 2024-09-13T21:44:23.705 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:23 smithi088 podman[86684]: 2024-09-13 21:44:23.376205567 +0000 UTC m=+0.653173345 container remove a9c74c8daaf15f4d0434c890f5ee7f9dd2faef30c7fe7661e049a0e6ea584dcd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-13T21:44:23.705 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:23 smithi088 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088.service: Deactivated successfully. 2024-09-13T21:44:23.705 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:23 smithi088 systemd[1]: Stopped Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:44:23.706 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:23 smithi088 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088.service: Consumed 13.489s CPU time. 2024-09-13T21:44:23.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:23 smithi088 systemd[1]: Starting Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:44:23.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:23 smithi088 podman[86824]: 2024-09-13 21:44:23.815760719 +0000 UTC m=+0.015498583 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:44:23.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:23 smithi088 podman[86824]: 2024-09-13 21:44:23.944059686 +0000 UTC m=+0.143797579 container create 7959cd284dbb586c275222a666c14b05d6645875b35b21d231661f229be72d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T21:44:24.366 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 podman[86824]: 2024-09-13 21:44:24.138326089 +0000 UTC m=+0.338063949 container init 7959cd284dbb586c275222a666c14b05d6645875b35b21d231661f229be72d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T21:44:24.366 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 podman[86824]: 2024-09-13 21:44:24.142064406 +0000 UTC m=+0.341802266 container start 7959cd284dbb586c275222a666c14b05d6645875b35b21d231661f229be72d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T21:44:24.366 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T21:44:24.366 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T21:44:24.366 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: pidfile_write: ignore empty --pid-file 2024-09-13T21:44:24.366 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: load: jerasure load: lrc 2024-09-13T21:44:24.366 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: RocksDB version: 7.9.2 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Git sha 0 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: DB SUMMARY 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: DB Session ID: K5F598C40OTECT09ZXAD 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: CURRENT file: CURRENT 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1510 Bytes 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi088/store.db dir, Total Num: 1, files: 000032.sst 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi088/store.db: 000030.log size: 3374773 ; 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.error_if_exists: 0 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.create_if_missing: 0 2024-09-13T21:44:24.367 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.paranoid_checks: 1 2024-09-13T21:44:24.368 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T21:44:24.368 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T21:44:24.368 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T21:44:24.368 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.env: 0x564575640940 2024-09-13T21:44:24.368 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T21:44:24.368 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.info_log: 0x5645769a98c0 2024-09-13T21:44:24.368 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T21:44:24.369 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.statistics: (nil) 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.use_fsync: 0 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_log_file_size: 0 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.allow_fallocate: 1 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T21:44:24.370 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.use_direct_reads: 0 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.db_log_dir: 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.wal_dir: 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T21:44:24.371 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.write_buffer_manager: 0x5645769b8dc0 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.unordered_write: 0 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T21:44:24.372 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.row_cache: None 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.wal_filter: None 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.two_write_queues: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.wal_compression: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.atomic_flush: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.log_readahead_size: 0 2024-09-13T21:44:24.373 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_background_jobs: 2 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_background_compactions: -1 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_subcompactions: 1 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T21:44:24.374 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_open_files: -1 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_background_flushes: -1 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Compression algorithms supported: 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: kZSTD supported: 0 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: kXpressCompression supported: 0 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: kBZip2Compression supported: 0 2024-09-13T21:44:24.375 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: kLZ4Compression supported: 1 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: kZlibCompression supported: 1 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: kSnappyCompression supported: 1 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000015 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.merge_operator: 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_filter: None 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T21:44:24.376 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5645769a9520) 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks: 1 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: pin_top_level_index_and_filter: 1 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_type: 0 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_index_type: 0 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_shortening: 1 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: checksum: 4 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: no_block_cache: 0 2024-09-13T21:44:24.377 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache: 0x56457699d1f0 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_name: BinnedLRUCache 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_options: 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: capacity : 536870912 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_shard_bits : 4 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: strict_capacity_limit : 0 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: high_pri_pool_ratio: 0.000 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_cache_compressed: (nil) 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: persistent_cache: (nil) 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size: 4096 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_size_deviation: 10 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_restart_interval: 16 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: index_block_restart_interval: 1 2024-09-13T21:44:24.378 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: metadata_block_size: 4096 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: partition_filters: 0 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: use_delta_encoding: 1 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: filter_policy: bloomfilter 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: whole_key_filtering: 1 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: verify_compression: 0 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: read_amp_bytes_per_bit: 0 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: format_version: 5 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_index_compression: 1 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: block_align: 0 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_auto_readahead_size: 262144 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: prepopulate_block_cache: 0 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: initial_auto_readahead_size: 8192 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T21:44:24.379 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression: NoCompression 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.num_levels: 7 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T21:44:24.380 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:44:24.381 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T21:44:24.382 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T21:44:24.383 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.inplace_update_support: 0 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.bloom_locality: 0 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.max_successive_merges: 0 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T21:44:24.384 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.ttl: 2592000 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.enable_blob_files: false 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.min_blob_size: 0 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T21:44:24.385 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi088/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12133, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f3f6af3b-cf08-413f-939d-bd5f2dfc8574 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263864168220, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263864178260, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2919786, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12134, "largest_seqno": 14943, "table_properties": {"data_size": 2908995, "index_size": 6480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3269, "raw_key_size": 28549, "raw_average_key_size": 22, "raw_value_size": 2883955, "raw_average_value_size": 2228, "num_data_blocks": 295, "num_entries": 1294, "num_filter_entries": 1294, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726263864, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f3f6af3b-cf08-413f-939d-bd5f2dfc8574", "db_session_id": "K5F598C40OTECT09ZXAD", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263864178413, "job": 1, "event": "recovery_finished"} 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-13T21:44:24.386 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi088/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5645769cae00 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: DB pointer 0x564576ac6000 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** DB Stats ** 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:44:24.387 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L0 1/0 2.78 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: L6 1/0 5.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Sum 2/0 8.61 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** Compaction Stats [default] ** 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 609.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-13T21:44:24.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Cumulative compaction: 0.00 GB write, 171.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Interval compaction: 0.00 GB write, 171.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache BinnedLRUCache@0x56457699d1f0#2 capacity: 512.00 MB usage: 9.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T21:44:24.389 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,3.28 KB,0.000625849%) IndexBlock(1,6.58 KB,0.00125468%) Misc(1,0.00 KB,0%) 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: starting mon.smithi088 rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi088 fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: mon.smithi088@-1(???) e2 preinit fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: mon.smithi088@-1(???).mds e20 new map 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: mon.smithi088@-1(???).mds e20 print_map 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: e20 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: legacy client fscid: 1 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Filesystem 'cephfs' (1) 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: fs_name cephfs 2024-09-13T21:44:24.390 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: epoch 20 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: tableserver 0 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: root 0 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: session_timeout 60 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: session_autoclose 300 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_file_size 1099511627776 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_xattr_size 65536 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: required_client_features {} 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: last_failure 0 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: last_failure_osd_epoch 47 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:24.391 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: max_mds 2 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: in 0,1 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: up {0=14480,1=24277} 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: failed 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: damaged 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: stopped 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: data_pools [3] 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: metadata_pool 2 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: inline_data enabled 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: balancer 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: bal_rank_mask -1 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: standby_count_wanted 1 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: qdb_cluster leader: 0 members: 2024-09-13T21:44:24.392 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: [mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: [mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Standby daemons: 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: [mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: [mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: mon.smithi088@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: mon.smithi088@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: mon.smithi088@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: mon.smithi088@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 ceph-mon[86843]: mon.smithi088@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 bash[86824]: 7959cd284dbb586c275222a666c14b05d6645875b35b21d231661f229be72d39 2024-09-13T21:44:24.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:24 smithi088 systemd[1]: Started Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:44:27.572 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:44:27.572 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:44:27.572 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: pgmap v84: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:27.572 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: pgmap v85: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:27.572 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: mon.smithi088 calling monitor election 2024-09-13T21:44:27.572 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: mon.smithi088 is new leader, mons smithi088,smithi116 in quorum (ranks 0,1) 2024-09-13T21:44:27.572 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: monmap epoch 2 2024-09-13T21:44:27.572 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: last_changed 2024-09-13T21:33:41.967632+0000 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: created 2024-09-13T21:30:53.455498+0000 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: min_mon_release 18 (reef) 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: election_strategy: 1 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.smithi116 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: mgrmap e31: smithi088.scyrwy(active, since 2m), standbys: smithi116.bqnvtn 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:44:27.573 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: from='mgr.14642 ' entity='' 2024-09-13T21:44:27.574 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:27 smithi116 ceph-mon[33391]: mgrmap e32: smithi088.scyrwy(active, since 2m), standbys: smithi116.bqnvtn 2024-09-13T21:44:27.574 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:44:27.574 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: from='mgr.14642 172.21.15.88:0/2609646011' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: pgmap v84: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: pgmap v85: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: mon.smithi088 calling monitor election 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: mon.smithi088 is new leader, mons smithi088,smithi116 in quorum (ranks 0,1) 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: monmap epoch 2 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: last_changed 2024-09-13T21:33:41.967632+0000 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: created 2024-09-13T21:30:53.455498+0000 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: min_mon_release 18 (reef) 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: election_strategy: 1 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.smithi116 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:44:27.575 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T21:44:27.576 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: mgrmap e31: smithi088.scyrwy(active, since 2m), standbys: smithi116.bqnvtn 2024-09-13T21:44:27.576 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:27.576 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:27.576 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:44:27.576 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: from='mgr.14642 ' entity='' 2024-09-13T21:44:27.576 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:27 smithi088 ceph-mon[86843]: mgrmap e32: smithi088.scyrwy(active, since 2m), standbys: smithi116.bqnvtn 2024-09-13T21:44:32.300 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:32 smithi116 ceph-mon[33391]: Standby manager daemon smithi116.bqnvtn restarted 2024-09-13T21:44:32.301 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:32 smithi116 ceph-mon[33391]: Standby manager daemon smithi116.bqnvtn started 2024-09-13T21:44:32.301 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:32 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/1812718830' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/crt"}]: dispatch 2024-09-13T21:44:32.301 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:32 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/1812718830' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:44:32.301 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:32 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/1812718830' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/key"}]: dispatch 2024-09-13T21:44:32.301 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:32 smithi116 ceph-mon[33391]: from='mgr.? 172.21.15.116:0/1812718830' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:44:32.313 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:32 smithi088 ceph-mon[86843]: Standby manager daemon smithi116.bqnvtn restarted 2024-09-13T21:44:32.313 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:32 smithi088 ceph-mon[86843]: Standby manager daemon smithi116.bqnvtn started 2024-09-13T21:44:32.314 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:32 smithi088 ceph-mon[86843]: from='mgr.? 172.21.15.116:0/1812718830' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/crt"}]: dispatch 2024-09-13T21:44:32.314 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:32 smithi088 ceph-mon[86843]: from='mgr.? 172.21.15.116:0/1812718830' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:44:32.314 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:32 smithi088 ceph-mon[86843]: from='mgr.? 172.21.15.116:0/1812718830' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi116.bqnvtn/key"}]: dispatch 2024-09-13T21:44:32.314 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:32 smithi088 ceph-mon[86843]: from='mgr.? 172.21.15.116:0/1812718830' entity='mgr.smithi116.bqnvtn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:44:33.319 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: mgrmap e33: smithi088.scyrwy(active, since 2m), standbys: smithi116.bqnvtn 2024-09-13T21:44:33.319 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: Active manager daemon smithi088.scyrwy restarted 2024-09-13T21:44:33.319 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: Activating manager daemon smithi088.scyrwy 2024-09-13T21:44:33.319 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T21:44:33.319 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: mgrmap e34: smithi088.scyrwy(active, starting, since 0.00694351s), standbys: smithi116.bqnvtn 2024-09-13T21:44:33.319 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:44:33.319 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:44:33.319 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi116.bqnvtn", "id": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:44:33.320 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:44:33.321 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:44:33.321 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: Manager daemon smithi088.scyrwy is now available 2024-09-13T21:44:33.321 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:33.321 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:33.321 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:44:33.321 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:33 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/trash_purge_schedule"}]: dispatch 2024-09-13T21:44:33.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: mgrmap e33: smithi088.scyrwy(active, since 2m), standbys: smithi116.bqnvtn 2024-09-13T21:44:33.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: Active manager daemon smithi088.scyrwy restarted 2024-09-13T21:44:33.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: Activating manager daemon smithi088.scyrwy 2024-09-13T21:44:33.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T21:44:33.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: mgrmap e34: smithi088.scyrwy(active, starting, since 0.00694351s), standbys: smithi116.bqnvtn 2024-09-13T21:44:33.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:44:33.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:44:33.335 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi088.scyrwy", "id": "smithi088.scyrwy"}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr metadata", "who": "smithi116.bqnvtn", "id": "smithi116.bqnvtn"}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:44:33.336 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:44:33.337 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: Manager daemon smithi088.scyrwy is now available 2024-09-13T21:44:33.337 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:33.337 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:33.337 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:44:33.337 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi088.scyrwy/trash_purge_schedule"}]: dispatch 2024-09-13T21:44:34.200 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:34 smithi116 ceph-mon[33391]: mgrmap e35: smithi088.scyrwy(active, since 1.01069s), standbys: smithi116.bqnvtn 2024-09-13T21:44:34.200 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:34 smithi116 ceph-mon[33391]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:34.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:34 smithi088 ceph-mon[86843]: mgrmap e35: smithi088.scyrwy(active, since 1.01069s), standbys: smithi116.bqnvtn 2024-09-13T21:44:34.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:34 smithi088 ceph-mon[86843]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:35 smithi088 ceph-mon[86843]: [13/Sep/2024:21:44:33] ENGINE Bus STARTING 2024-09-13T21:44:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:35 smithi088 ceph-mon[86843]: [13/Sep/2024:21:44:34] ENGINE Serving on http://172.21.15.88:8765 2024-09-13T21:44:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:35 smithi088 ceph-mon[86843]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:35 smithi088 ceph-mon[86843]: mgrmap e36: smithi088.scyrwy(active, since 2s), standbys: smithi116.bqnvtn 2024-09-13T21:44:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:35 smithi088 ceph-mon[86843]: [13/Sep/2024:21:44:34] ENGINE Serving on https://172.21.15.88:7150 2024-09-13T21:44:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:35 smithi088 ceph-mon[86843]: [13/Sep/2024:21:44:34] ENGINE Bus STARTED 2024-09-13T21:44:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:35 smithi088 ceph-mon[86843]: [13/Sep/2024:21:44:34] ENGINE Error in HTTPServer.serve 2024-09-13T21:44:35.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: Traceback (most recent call last): 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._run(expiration_interval) 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: s = self.context.wrap_socket( 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:44:35.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: return self.sslsocket_class._create( 2024-09-13T21:44:35.235 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:44:35.235 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self.do_handshake() 2024-09-13T21:44:35.235 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:44:35.235 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: self._sslobj.do_handshake() 2024-09-13T21:44:35.235 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:44:35.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:35 smithi116 ceph-mon[33391]: [13/Sep/2024:21:44:33] ENGINE Bus STARTING 2024-09-13T21:44:35.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:35 smithi116 ceph-mon[33391]: [13/Sep/2024:21:44:34] ENGINE Serving on http://172.21.15.88:8765 2024-09-13T21:44:35.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:35 smithi116 ceph-mon[33391]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:35.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:35 smithi116 ceph-mon[33391]: mgrmap e36: smithi088.scyrwy(active, since 2s), standbys: smithi116.bqnvtn 2024-09-13T21:44:35.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:35 smithi116 ceph-mon[33391]: [13/Sep/2024:21:44:34] ENGINE Serving on https://172.21.15.88:7150 2024-09-13T21:44:35.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:35 smithi116 ceph-mon[33391]: [13/Sep/2024:21:44:34] ENGINE Bus STARTED 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:35 smithi116 ceph-mon[33391]: [13/Sep/2024:21:44:34] ENGINE Error in HTTPServer.serve 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Traceback (most recent call last): 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self._run(expiration_interval) 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: s = self.context.wrap_socket( 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:44:35.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: return self.sslsocket_class._create( 2024-09-13T21:44:35.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:44:35.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self.do_handshake() 2024-09-13T21:44:35.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:44:35.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: self._sslobj.do_handshake() 2024-09-13T21:44:35.348 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:44:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:36 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:36 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:36 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:36 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:36.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:36 smithi088 ceph-mon[86843]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:36.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:36 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:36.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:36 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:36.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:36 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:36.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:36 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:36.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:36 smithi116 ceph-mon[33391]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:37.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:37 smithi088 ceph-mon[86843]: mgrmap e37: smithi088.scyrwy(active, since 4s), standbys: smithi116.bqnvtn 2024-09-13T21:44:37.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:37 smithi116 ceph-mon[33391]: mgrmap e37: smithi088.scyrwy(active, since 4s), standbys: smithi116.bqnvtn 2024-09-13T21:44:38.957 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:38.958 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:38.958 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:38 smithi088 ceph-mon[86843]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:38.958 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:38.958 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:39.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:38 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:39.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:38 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:38 smithi116 ceph-mon[33391]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:38 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:38 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:41.310 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:41 smithi088 ceph-mon[86843]: pgmap v7: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T21:44:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:41 smithi116 ceph-mon[33391]: pgmap v7: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T21:44:42.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: Detected new or changed devices on smithi088 2024-09-13T21:44:42.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:44:42.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: pgmap v8: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T21:44:42.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:42 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.613 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: Detected new or changed devices on smithi088 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:44:42.614 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: Updating smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:44:42.615 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: Updating smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:44:42.615 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: pgmap v8: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T21:44:42.615 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.615 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.615 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.615 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:42.615 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:42 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:43 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:43 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:43 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T21:44:43.752 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:43 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:43.752 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:43 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:43.752 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:43 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T21:44:44.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:44 smithi088 ceph-mon[86843]: Upgrade: Updating mon.smithi116 2024-09-13T21:44:44.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:44 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:44.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:44 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:44:44.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:44 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:44:44.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:44 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:44.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:44 smithi088 ceph-mon[86843]: Deploying daemon mon.smithi116 on smithi116 2024-09-13T21:44:44.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:44 smithi088 ceph-mon[86843]: pgmap v9: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T21:44:45.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:44 smithi116 ceph-mon[33391]: Upgrade: Updating mon.smithi116 2024-09-13T21:44:45.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:44 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:45.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:44 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:44:45.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:44 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:44:45.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:44 smithi116 ceph-mon[33391]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:45.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:44 smithi116 ceph-mon[33391]: Deploying daemon mon.smithi116 on smithi116 2024-09-13T21:44:45.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:44 smithi116 ceph-mon[33391]: pgmap v9: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T21:44:45.804 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:45 smithi116 systemd[1]: Stopping Ceph mon.smithi116 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:44:45.804 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:45 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116[33372]: 2024-09-13T21:44:45.740+0000 7fe80bcf2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi116 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:44:45.804 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:45 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116[33372]: 2024-09-13T21:44:45.740+0000 7fe80bcf2700 -1 mon.smithi116@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T21:44:46.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:45 smithi116 podman[65069]: 2024-09-13 21:44:45.802791048 +0000 UTC m=+0.157304197 container died 19814db7b3d94769b21a519e315e171e35329dd61e8c16444c0fe7bb5fb6b749 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, ceph=True, io.buildah.version=1.29.1) 2024-09-13T21:44:46.435 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:46 smithi116 podman[65069]: 2024-09-13 21:44:46.216442989 +0000 UTC m=+0.570956139 container cleanup 19814db7b3d94769b21a519e315e171e35329dd61e8c16444c0fe7bb5fb6b749 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T21:44:46.435 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:46 smithi116 bash[65069]: ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116 2024-09-13T21:44:46.689 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:46 smithi116 podman[65081]: 2024-09-13 21:44:46.434469336 +0000 UTC m=+0.631836577 container remove 19814db7b3d94769b21a519e315e171e35329dd61e8c16444c0fe7bb5fb6b749 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0) 2024-09-13T21:44:46.882 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:46 smithi116 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi116.service: Deactivated successfully. 2024-09-13T21:44:46.882 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:46 smithi116 systemd[1]: Stopped Ceph mon.smithi116 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:44:46.882 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:46 smithi116 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi116.service: Consumed 7.382s CPU time. 2024-09-13T21:44:46.882 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:46 smithi116 systemd[1]: Starting Ceph mon.smithi116 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:44:47.330 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 podman[65212]: 2024-09-13 21:44:46.990668463 +0000 UTC m=+0.015804513 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:44:47.330 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 podman[65212]: 2024-09-13 21:44:47.118772698 +0000 UTC m=+0.143908787 container create 27f0dd428044baf862e10577cea2eab9afae6882ff2c0190c81c8dc8cc0c3270 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:44:47.330 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 podman[65212]: 2024-09-13 21:44:47.329342058 +0000 UTC m=+0.354478101 container init 27f0dd428044baf862e10577cea2eab9afae6882ff2c0190c81c8dc8cc0c3270 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be) 2024-09-13T21:44:47.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 podman[65212]: 2024-09-13 21:44:47.332548298 +0000 UTC m=+0.357684342 container start 27f0dd428044baf862e10577cea2eab9afae6882ff2c0190c81c8dc8cc0c3270 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T21:44:47.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T21:44:47.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T21:44:47.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: pidfile_write: ignore empty --pid-file 2024-09-13T21:44:47.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: load: jerasure load: lrc 2024-09-13T21:44:47.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: RocksDB version: 7.9.2 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Git sha 0 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: DB SUMMARY 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: DB Session ID: BPE39BJX0FDIA8RKI465 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: CURRENT file: CURRENT 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1404 Bytes 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi116/store.db dir, Total Num: 1, files: 000027.sst 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi116/store.db: 000025.log size: 7972370 ; 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.error_if_exists: 0 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.create_if_missing: 0 2024-09-13T21:44:47.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.paranoid_checks: 1 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.env: 0x562be2d5f940 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.info_log: 0x562be3a9d8c0 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.statistics: (nil) 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.use_fsync: 0 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_log_file_size: 0 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T21:44:47.599 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.allow_fallocate: 1 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.use_direct_reads: 0 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.db_log_dir: 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.wal_dir: 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T21:44:47.600 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.write_buffer_manager: 0x562be3aacdc0 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T21:44:47.601 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.unordered_write: 0 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.row_cache: None 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.wal_filter: None 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.two_write_queues: 0 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.wal_compression: 0 2024-09-13T21:44:47.602 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.atomic_flush: 0 2024-09-13T21:44:47.603 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T21:44:47.603 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T21:44:47.603 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T21:44:47.604 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.log_readahead_size: 0 2024-09-13T21:44:47.604 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T21:44:47.604 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T21:44:47.604 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_background_jobs: 2 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_background_compactions: -1 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_subcompactions: 1 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T21:44:47.605 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_open_files: -1 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_background_flushes: -1 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Compression algorithms supported: 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: kZSTD supported: 0 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: kXpressCompression supported: 0 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: kBZip2Compression supported: 0 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T21:44:47.606 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: kLZ4Compression supported: 1 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: kZlibCompression supported: 1 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: kSnappyCompression supported: 1 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi116/store.db/MANIFEST-000010 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.merge_operator: 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_filter: None 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T21:44:47.607 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562be3a9d520) 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: cache_index_and_filter_blocks: 1 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: pin_top_level_index_and_filter: 1 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: index_type: 0 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: data_block_index_type: 0 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: index_shortening: 1 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: checksum: 4 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: no_block_cache: 0 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: block_cache: 0x562be3a911f0 2024-09-13T21:44:47.608 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: block_cache_name: BinnedLRUCache 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: block_cache_options: 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: capacity : 536870912 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: num_shard_bits : 4 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: strict_capacity_limit : 0 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: high_pri_pool_ratio: 0.000 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: block_cache_compressed: (nil) 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: persistent_cache: (nil) 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: block_size: 4096 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: block_size_deviation: 10 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: block_restart_interval: 16 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: index_block_restart_interval: 1 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: metadata_block_size: 4096 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: partition_filters: 0 2024-09-13T21:44:47.609 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: use_delta_encoding: 1 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: filter_policy: bloomfilter 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: whole_key_filtering: 1 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: verify_compression: 0 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: read_amp_bytes_per_bit: 0 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: format_version: 5 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: enable_index_compression: 1 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: block_align: 0 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: max_auto_readahead_size: 262144 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: prepopulate_block_cache: 0 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: initial_auto_readahead_size: 8192 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T21:44:47.610 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression: NoCompression 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.num_levels: 7 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:44:47.611 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:44:47.612 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T21:44:47.613 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T21:44:47.614 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.inplace_update_support: 0 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.bloom_locality: 0 2024-09-13T21:44:47.615 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.max_successive_merges: 0 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.ttl: 2592000 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.enable_blob_files: false 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.min_blob_size: 0 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T21:44:47.616 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi116/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12191, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e205b9d1-7c40-43e1-a2be-bc62b9d488b5 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263887359023, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263887376630, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4749002, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12196, "largest_seqno": 15767, "table_properties": {"data_size": 4736238, "index_size": 7941, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3781, "raw_key_size": 33398, "raw_average_key_size": 22, "raw_value_size": 4706870, "raw_average_value_size": 3140, "num_data_blocks": 359, "num_entries": 1499, "num_filter_entries": 1499, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726263887, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e205b9d1-7c40-43e1-a2be-bc62b9d488b5", "db_session_id": "BPE39BJX0FDIA8RKI465", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-13T21:44:47.617 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263887376863, "job": 1, "event": "recovery_finished"} 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi116/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562be3abee00 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: DB pointer 0x562be3bba000 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: ** DB Stats ** 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T21:44:47.618 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: ** Compaction Stats [default] ** 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: L0 1/0 4.53 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 684.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: L6 1/0 5.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Sum 2/0 10.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 684.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 684.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: ** Compaction Stats [default] ** 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:44:47.619 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 684.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Cumulative compaction: 0.00 GB write, 221.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Interval compaction: 0.00 GB write, 221.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T21:44:47.620 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Block cache BinnedLRUCache@0x562be3a911f0#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: starting mon.smithi116 rank 1 at public addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] at bind addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi116 fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: mon.smithi116@-1(???) e2 preinit fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: mon.smithi116@-1(???).mds e20 new map 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: mon.smithi116@-1(???).mds e20 print_map 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: e20 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: legacy client fscid: 1 2024-09-13T21:44:47.621 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Filesystem 'cephfs' (1) 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: fs_name cephfs 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: epoch 20 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: tableserver 0 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: root 0 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: session_timeout 60 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: session_autoclose 300 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: max_file_size 1099511627776 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: max_xattr_size 65536 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: required_client_features {} 2024-09-13T21:44:47.622 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: last_failure 0 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: last_failure_osd_epoch 47 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: max_mds 2 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: in 0,1 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: up {0=14480,1=24277} 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: failed 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: damaged 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: stopped 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: data_pools [3] 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: metadata_pool 2 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: inline_data enabled 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: balancer 2024-09-13T21:44:47.623 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: bal_rank_mask -1 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: standby_count_wanted 1 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: qdb_cluster leader: 0 members: 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: [mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: [mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: Standby daemons: 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: [mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout: [mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: mon.smithi116@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: mon.smithi116@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:44:47.624 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: mon.smithi116@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:44:47.625 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: mon.smithi116@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:44:47.625 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 ceph-mon[65231]: mon.smithi116@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-13T21:44:47.625 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 bash[65212]: 27f0dd428044baf862e10577cea2eab9afae6882ff2c0190c81c8dc8cc0c3270 2024-09-13T21:44:47.625 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:47 smithi116 systemd[1]: Started Ceph mon.smithi116 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:44:48.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: mon.smithi088 calling monitor election 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: mon.smithi116 calling monitor election 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: mon.smithi088 is new leader, mons smithi088,smithi116 in quorum (ranks 0,1) 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: monmap epoch 3 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: last_changed 2024-09-13T21:44:47.550497+0000 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: created 2024-09-13T21:30:53.455498+0000 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: min_mon_release 19 (squid) 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: election_strategy: 1 2024-09-13T21:44:48.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.smithi116 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: mgrmap e37: smithi088.scyrwy(active, since 15s), standbys: smithi116.bqnvtn 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:48.848 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:48 smithi116 ceph-mon[65231]: pgmap v11: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:44:48.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi088"}]: dispatch 2024-09-13T21:44:48.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mon metadata", "id": "smithi116"}]: dispatch 2024-09-13T21:44:48.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: mon.smithi088 calling monitor election 2024-09-13T21:44:48.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: mon.smithi116 calling monitor election 2024-09-13T21:44:48.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: mon.smithi088 is new leader, mons smithi088,smithi116 in quorum (ranks 0,1) 2024-09-13T21:44:48.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: monmap epoch 3 2024-09-13T21:44:48.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: fsid 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:44:48.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: last_changed 2024-09-13T21:44:47.550497+0000 2024-09-13T21:44:48.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: created 2024-09-13T21:30:53.455498+0000 2024-09-13T21:44:48.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: min_mon_release 19 (squid) 2024-09-13T21:44:48.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: election_strategy: 1 2024-09-13T21:44:48.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.smithi088 2024-09-13T21:44:48.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.smithi116 2024-09-13T21:44:48.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: fsmap cephfs:2 {0=cephfs.smithi088.vqfqko=up:active,1=cephfs.smithi116.rwfayz=up:active} 2 up:standby 2024-09-13T21:44:48.985 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T21:44:48.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: mgrmap e37: smithi088.scyrwy(active, since 15s), standbys: smithi116.bqnvtn 2024-09-13T21:44:48.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:48.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:48.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:44:48.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:48.986 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:48.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:48.987 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:48 smithi088 ceph-mon[86843]: pgmap v11: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:44:50.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.871+0000 7ff5e9864700 1 -- 172.21.15.88:0/3470312871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101d30 msgr2=0x7ff5e410a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:50.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.871+0000 7ff5e9864700 1 --2- 172.21.15.88:0/3470312871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101d30 0x7ff5e410a230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009910 tx=0x7ff5cc009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:50.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.871+0000 7ff5e9864700 1 -- 172.21.15.88:0/3470312871 shutdown_connections 2024-09-13T21:44:50.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.871+0000 7ff5e9864700 1 --2- 172.21.15.88:0/3470312871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101d30 0x7ff5e410a230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.871+0000 7ff5e9864700 1 --2- 172.21.15.88:0/3470312871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101420 0x7ff5e41017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.871+0000 7ff5e9864700 1 -- 172.21.15.88:0/3470312871 >> 172.21.15.88:0/3470312871 conn(0x7ff5e40fac80 msgr2=0x7ff5e40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.871+0000 7ff5e9864700 1 -- 172.21.15.88:0/3470312871 shutdown_connections 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.871+0000 7ff5e9864700 1 -- 172.21.15.88:0/3470312871 wait complete. 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.872+0000 7ff5e9864700 1 Processor -- start 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.872+0000 7ff5e9864700 1 -- start start 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.872+0000 7ff5e9864700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101420 0x7ff5e40ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e9864700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101d30 0x7ff5e40ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e9864700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40ffb00 con 0x7ff5e4101420 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e9864700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40ffc40 con 0x7ff5e4101d30 2024-09-13T21:44:50.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101420 0x7ff5e40ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101420 0x7ff5e40ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59442/0 (socket says 172.21.15.88:59442) 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e2ffd700 1 -- 172.21.15.88:0/3742440838 learned_addr learned my addr 172.21.15.88:0/3742440838 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e27fc700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101d30 0x7ff5e40ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e27fc700 1 -- 172.21.15.88:0/3742440838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101d30 msgr2=0x7ff5e40ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e27fc700 1 -- 172.21.15.88:0/3742440838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101d30 msgr2=0x7ff5e40ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e27fc700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101d30 0x7ff5e40ff5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e27fc700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101d30 0x7ff5e40ff5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e2ffd700 1 -- 172.21.15.88:0/3742440838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101d30 msgr2=0x7ff5e40ff5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e2ffd700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101d30 0x7ff5e40ff5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e2ffd700 1 -- 172.21.15.88:0/3742440838 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc0095f0 con 0x7ff5e4101420 2024-09-13T21:44:50.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e2ffd700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101420 0x7ff5e40ff080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4007e60 tx=0x7ff5d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:50.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e8862700 1 -- 172.21.15.88:0/3742440838 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d400de60 con 0x7ff5e4101420 2024-09-13T21:44:50.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e8862700 1 -- 172.21.15.88:0/3742440838 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5d400f040 con 0x7ff5e4101420 2024-09-13T21:44:50.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.873+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e41a2050 con 0x7ff5e4101420 2024-09-13T21:44:50.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.874+0000 7ff5e8862700 1 -- 172.21.15.88:0/3742440838 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d40133f0 con 0x7ff5e4101420 2024-09-13T21:44:50.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.874+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e41a2460 con 0x7ff5e4101420 2024-09-13T21:44:50.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.875+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e41078a0 con 0x7ff5e4101420 2024-09-13T21:44:50.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.875+0000 7ff5e8862700 1 -- 172.21.15.88:0/3742440838 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7ff5d4004ad0 con 0x7ff5e4101420 2024-09-13T21:44:50.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.876+0000 7ff5e8862700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff5d006e7b0 0x7ff5d0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:50.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.876+0000 7ff5e8862700 1 -- 172.21.15.88:0/3742440838 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff5d408dc90 con 0x7ff5e4101420 2024-09-13T21:44:50.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.876+0000 7ff5e27fc700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff5d006e7b0 0x7ff5d0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:50.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.876+0000 7ff5e27fc700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff5d006e7b0 0x7ff5d0070c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4100870 tx=0x7ff5cc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:50.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:50.881+0000 7ff5e8862700 1 -- 172.21.15.88:0/3742440838 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff5d4056d40 con 0x7ff5e4101420 2024-09-13T21:44:51.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.111+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5e4061190 con 0x7ff5d006e7b0 2024-09-13T21:44:51.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.112+0000 7ff5e8862700 1 -- 172.21.15.88:0/3742440838 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff5e4061190 con 0x7ff5d006e7b0 2024-09-13T21:44:51.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff5d006e7b0 msgr2=0x7ff5d0070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff5d006e7b0 0x7ff5d0070c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4100870 tx=0x7ff5cc01a040 comp rx=0 tx=0).stop 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101420 msgr2=0x7ff5e40ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101420 0x7ff5e40ff080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4007e60 tx=0x7ff5d400d3b0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 shutdown_connections 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff5d006e7b0 0x7ff5d0070c60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e4101420 0x7ff5e40ff080 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 --2- 172.21.15.88:0/3742440838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4101d30 0x7ff5e40ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 >> 172.21.15.88:0/3742440838 conn(0x7ff5e40fac80 msgr2=0x7ff5e41049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 shutdown_connections 2024-09-13T21:44:51.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.114+0000 7ff5e9864700 1 -- 172.21.15.88:0/3742440838 wait complete. 2024-09-13T21:44:51.126 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:44:51.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.224+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1377839401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 msgr2=0x7f4eb01008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:51.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.224+0000 7f4eb49b3700 1 --2- 172.21.15.88:0/1377839401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 0x7f4eb01008b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009910 tx=0x7f4ea0009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:51.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.224+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1377839401 shutdown_connections 2024-09-13T21:44:51.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.224+0000 7f4eb49b3700 1 --2- 172.21.15.88:0/1377839401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 0x7f4eb0104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.224+0000 7f4eb49b3700 1 --2- 172.21.15.88:0/1377839401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 0x7f4eb01008b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.224+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1377839401 >> 172.21.15.88:0/1377839401 conn(0x7f4eb00fbda0 msgr2=0x7f4eb00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:51.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.224+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1377839401 shutdown_connections 2024-09-13T21:44:51.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.224+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1377839401 wait complete. 2024-09-13T21:44:51.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.224+0000 7f4eb49b3700 1 Processor -- start 2024-09-13T21:44:51.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eb49b3700 1 -- start start 2024-09-13T21:44:51.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eb49b3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 0x7f4eb0195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:51.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eb49b3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 0x7f4eb0196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:51.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eb49b3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb0196b10 con 0x7f4eb01004e0 2024-09-13T21:44:51.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eb49b3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb019a8a0 con 0x7f4eb0100e80 2024-09-13T21:44:51.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eae59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 0x7f4eb0195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eae59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 0x7f4eb0195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59448/0 (socket says 172.21.15.88:59448) 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eae59c700 1 -- 172.21.15.88:0/1016839732 learned_addr learned my addr 172.21.15.88:0/1016839732 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4ea5d9b700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 0x7f4eb0196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4ea5d9b700 1 -- 172.21.15.88:0/1016839732 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 msgr2=0x7f4eb0196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4ea5d9b700 1 -- 172.21.15.88:0/1016839732 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 msgr2=0x7f4eb0196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4ea5d9b700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 0x7f4eb0196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4ea5d9b700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 0x7f4eb0196430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eae59c700 1 -- 172.21.15.88:0/1016839732 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 msgr2=0x7f4eb0196430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eae59c700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 0x7f4eb0196430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.225+0000 7f4eae59c700 1 -- 172.21.15.88:0/1016839732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00095f0 con 0x7f4eb01004e0 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.226+0000 7f4eae59c700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 0x7f4eb0195ef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0006010 tx=0x7f4ea000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.226+0000 7f4ea7fff700 1 -- 172.21.15.88:0/1016839732 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ea001d070 con 0x7f4eb01004e0 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.226+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb019ab20 con 0x7f4eb01004e0 2024-09-13T21:44:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.226+0000 7f4ea7fff700 1 -- 172.21.15.88:0/1016839732 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ea000f460 con 0x7f4eb01004e0 2024-09-13T21:44:51.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.226+0000 7f4ea7fff700 1 -- 172.21.15.88:0/1016839732 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ea0017630 con 0x7f4eb01004e0 2024-09-13T21:44:51.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.226+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb019b010 con 0x7f4eb01004e0 2024-09-13T21:44:51.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.227+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb01087f0 con 0x7f4eb01004e0 2024-09-13T21:44:51.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.227+0000 7f4ea7fff700 1 -- 172.21.15.88:0/1016839732 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f4ea000f5d0 con 0x7f4eb01004e0 2024-09-13T21:44:51.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.228+0000 7f4ea7fff700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4e9c06e7c0 0x7f4e9c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:51.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.228+0000 7f4ea7fff700 1 -- 172.21.15.88:0/1016839732 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4ea008fcd0 con 0x7f4eb01004e0 2024-09-13T21:44:51.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.228+0000 7f4ea5d9b700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4e9c06e7c0 0x7f4e9c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:51.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.228+0000 7f4ea5d9b700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4e9c06e7c0 0x7f4e9c070c70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e98005950 tx=0x7f4e980058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:51.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.232+0000 7f4ea7fff700 1 -- 172.21.15.88:0/1016839732 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4ea0058d00 con 0x7f4eb01004e0 2024-09-13T21:44:51.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.455+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4eb019b230 con 0x7f4e9c06e7c0 2024-09-13T21:44:51.457 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:51 smithi088 ceph-mon[86843]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:44:51.457 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:51 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:51.458 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:51 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:51.458 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:51 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:51.458 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:51 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:51.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.457+0000 7f4ea7fff700 1 -- 172.21.15.88:0/1016839732 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4eb019b230 con 0x7f4e9c06e7c0 2024-09-13T21:44:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4e9c06e7c0 msgr2=0x7f4e9c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4e9c06e7c0 0x7f4e9c070c70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e98005950 tx=0x7f4e980058e0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 msgr2=0x7f4eb0195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 0x7f4eb0195ef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0006010 tx=0x7f4ea000be20 comp rx=0 tx=0).stop 2024-09-13T21:44:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 shutdown_connections 2024-09-13T21:44:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4e9c06e7c0 0x7f4e9c070c70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4eb01004e0 0x7f4eb0195ef0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 --2- 172.21.15.88:0/1016839732 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb0100e80 0x7f4eb0196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 >> 172.21.15.88:0/1016839732 conn(0x7f4eb00fbda0 msgr2=0x7f4eb00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:51.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 shutdown_connections 2024-09-13T21:44:51.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.459+0000 7f4eb49b3700 1 -- 172.21.15.88:0/1016839732 wait complete. 2024-09-13T21:44:51.497 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:51 smithi116 ceph-mon[65231]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:44:51.497 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:51 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:51.497 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:51 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:51.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:51 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:51.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:51 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.563+0000 7f066454e700 1 -- 172.21.15.88:0/4068055851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 msgr2=0x7f065c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.563+0000 7f066454e700 1 --2- 172.21.15.88:0/4068055851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 0x7f065c104e50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0658009910 tx=0x7f0658009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.563+0000 7f066454e700 1 -- 172.21.15.88:0/4068055851 shutdown_connections 2024-09-13T21:44:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.563+0000 7f066454e700 1 --2- 172.21.15.88:0/4068055851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 0x7f065c104e50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.563+0000 7f066454e700 1 --2- 172.21.15.88:0/4068055851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 0x7f065c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.563+0000 7f066454e700 1 -- 172.21.15.88:0/4068055851 >> 172.21.15.88:0/4068055851 conn(0x7f065c0fbda0 msgr2=0x7f065c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.563+0000 7f066454e700 1 -- 172.21.15.88:0/4068055851 shutdown_connections 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.563+0000 7f066454e700 1 -- 172.21.15.88:0/4068055851 wait complete. 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.564+0000 7f066454e700 1 Processor -- start 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.564+0000 7f066454e700 1 -- start start 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.564+0000 7f066454e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 0x7f065c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.564+0000 7f066454e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 0x7f065c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.564+0000 7f066454e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c196b50 con 0x7f065c100e80 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.564+0000 7f066454e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c19a8e0 con 0x7f065c1004e0 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.564+0000 7f0661ae9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 0x7f065c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.564+0000 7f0661ae9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 0x7f065c196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59460/0 (socket says 172.21.15.88:59460) 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.564+0000 7f0661ae9700 1 -- 172.21.15.88:0/2007856879 learned_addr learned my addr 172.21.15.88:0/2007856879 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f06622ea700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 0x7f065c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f06622ea700 1 -- 172.21.15.88:0/2007856879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 msgr2=0x7f065c195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f06622ea700 1 -- 172.21.15.88:0/2007856879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 msgr2=0x7f065c195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f06622ea700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 0x7f065c195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f06622ea700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 0x7f065c195f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f0661ae9700 1 -- 172.21.15.88:0/2007856879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 msgr2=0x7f065c195f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f0661ae9700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 0x7f065c195f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f0661ae9700 1 -- 172.21.15.88:0/2007856879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580095f0 con 0x7f065c100e80 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f0661ae9700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 0x7f065c196470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06580092e0 tx=0x7f065800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f06537fe700 1 -- 172.21.15.88:0/2007856879 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f065801d070 con 0x7f065c100e80 2024-09-13T21:44:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f06537fe700 1 -- 172.21.15.88:0/2007856879 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0658005dc0 con 0x7f065c100e80 2024-09-13T21:44:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c19ab60 con 0x7f065c100e80 2024-09-13T21:44:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f06537fe700 1 -- 172.21.15.88:0/2007856879 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0658017400 con 0x7f065c100e80 2024-09-13T21:44:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.565+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c19b050 con 0x7f065c100e80 2024-09-13T21:44:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.566+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c108850 con 0x7f065c100e80 2024-09-13T21:44:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.567+0000 7f06537fe700 1 -- 172.21.15.88:0/2007856879 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f065800f460 con 0x7f065c100e80 2024-09-13T21:44:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.567+0000 7f06537fe700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f064806e7c0 0x7f0648070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.567+0000 7f06537fe700 1 -- 172.21.15.88:0/2007856879 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f065808fd20 con 0x7f065c100e80 2024-09-13T21:44:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.567+0000 7f06622ea700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f064806e7c0 0x7f0648070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.568+0000 7f06622ea700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f064806e7c0 0x7f0648070c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f064c005920 tx=0x7f064c00b2c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:51.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.572+0000 7f06537fe700 1 -- 172.21.15.88:0/2007856879 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0658058d50 con 0x7f065c100e80 2024-09-13T21:44:51.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.784+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f065c19b330 con 0x7f064806e7c0 2024-09-13T21:44:51.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.794+0000 7f06537fe700 1 -- 172.21.15.88:0/2007856879 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f065c19b330 con 0x7f064806e7c0 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (117s) 14s ago 12m 17.1M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (12m) 14s ago 12m 7922k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (11m) 1s ago 11m 7864k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (12m) 14s ago 12m 6669k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (11m) 1s ago 11m 6665k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (95s) 14s ago 12m 76.2M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (6m) 14s ago 6m 121M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (6m) 14s ago 6m 15.5M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:44:51.796 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (6m) 1s ago 6m 17.1M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (6m) 1s ago 6m 122M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (3m) 14s ago 13m 473M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (2m) 1s ago 11m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (27s) 14s ago 13m 32.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (4s) 1s ago 11m 25.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (2m) 14s ago 12m 14.9M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (2m) 1s ago 11m 17.0M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (10m) 14s ago 10m 224M 1216M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (9m) 14s ago 9m 241M 1216M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (9m) 14s ago 9m 196M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (9m) 1s ago 9m 272M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (8m) 1s ago 8m 255M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:44:51.797 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (8m) 1s ago 8m 229M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:44:51.798 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (2m) 14s ago 11m 65.3M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:44:51.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.796+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f064806e7c0 msgr2=0x7f0648070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:51.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.796+0000 7f066454e700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f064806e7c0 0x7f0648070c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f064c005920 tx=0x7f064c00b2c0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.796+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 msgr2=0x7f065c196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:51.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.796+0000 7f066454e700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 0x7f065c196470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06580092e0 tx=0x7f065800be20 comp rx=0 tx=0).stop 2024-09-13T21:44:51.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.796+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 shutdown_connections 2024-09-13T21:44:51.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.796+0000 7f066454e700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f064806e7c0 0x7f0648070c70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.796+0000 7f066454e700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f065c1004e0 0x7f065c195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.796+0000 7f066454e700 1 --2- 172.21.15.88:0/2007856879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f065c100e80 0x7f065c196470 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.797+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 >> 172.21.15.88:0/2007856879 conn(0x7f065c0fbda0 msgr2=0x7f065c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:51.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.797+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 shutdown_connections 2024-09-13T21:44:51.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.797+0000 7f066454e700 1 -- 172.21.15.88:0/2007856879 wait complete. 2024-09-13T21:44:51.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 -- 172.21.15.88:0/4233516484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 msgr2=0x7f0354103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:51.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 --2- 172.21.15.88:0/4233516484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 0x7f0354103c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f034400c210 tx=0x7f034400c520 comp rx=0 tx=0).stop 2024-09-13T21:44:51.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 -- 172.21.15.88:0/4233516484 shutdown_connections 2024-09-13T21:44:51.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 --2- 172.21.15.88:0/4233516484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 0x7f03540ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 --2- 172.21.15.88:0/4233516484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 0x7f0354103c80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 -- 172.21.15.88:0/4233516484 >> 172.21.15.88:0/4233516484 conn(0x7f03540748b0 msgr2=0x7f0354074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:51.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 -- 172.21.15.88:0/4233516484 shutdown_connections 2024-09-13T21:44:51.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 -- 172.21.15.88:0/4233516484 wait complete. 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 Processor -- start 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.900+0000 7f0359feb700 1 -- start start 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0359feb700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 0x7f03541005b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0359feb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 0x7f0354100af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0359feb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0354101030 con 0x7f03541038b0 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0359feb700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0354101170 con 0x7f03540ff350 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0352ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 0x7f0354100af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0352ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 0x7f0354100af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59472/0 (socket says 172.21.15.88:59472) 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0352ffd700 1 -- 172.21.15.88:0/1763339801 learned_addr learned my addr 172.21.15.88:0/1763339801 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f03537fe700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 0x7f03541005b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:51.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f03537fe700 1 -- 172.21.15.88:0/1763339801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 msgr2=0x7f03541005b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f03537fe700 1 -- 172.21.15.88:0/1763339801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 msgr2=0x7f03541005b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f03537fe700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 0x7f03541005b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f03537fe700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 0x7f03541005b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0352ffd700 1 -- 172.21.15.88:0/1763339801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 msgr2=0x7f03541005b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0352ffd700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 0x7f03541005b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0352ffd700 1 -- 172.21.15.88:0/1763339801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034400ae10 con 0x7f03541038b0 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0352ffd700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 0x7f0354100af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f034800c930 tx=0x7f034800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0350ff9700 1 -- 172.21.15.88:0/1763339801 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0348007ad0 con 0x7f03541038b0 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.901+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03541a20b0 con 0x7f03541038b0 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.902+0000 7f0350ff9700 1 -- 172.21.15.88:0/1763339801 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0348007c30 con 0x7f03541038b0 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.902+0000 7f0350ff9700 1 -- 172.21.15.88:0/1763339801 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0348018610 con 0x7f03541038b0 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.902+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03541a2410 con 0x7f03541038b0 2024-09-13T21:44:51.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.902+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0354108e30 con 0x7f03541038b0 2024-09-13T21:44:51.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.903+0000 7f0350ff9700 1 -- 172.21.15.88:0/1763339801 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f034800f450 con 0x7f03541038b0 2024-09-13T21:44:51.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.903+0000 7f0350ff9700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f033c06e7c0 0x7f033c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:51.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.903+0000 7f0350ff9700 1 -- 172.21.15.88:0/1763339801 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f034808ea50 con 0x7f03541038b0 2024-09-13T21:44:51.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.903+0000 7f03537fe700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f033c06e7c0 0x7f033c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:51.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.904+0000 7f03537fe700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f033c06e7c0 0x7f033c070c70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f034400a960 tx=0x7f034400a8d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:51.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:51.908+0000 7f0350ff9700 1 -- 172.21.15.88:0/1763339801 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0348057a80 con 0x7f03541038b0 2024-09-13T21:44:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.195+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0354101b80 con 0x7f03541038b0 2024-09-13T21:44:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.195+0000 7f0350ff9700 1 -- 172.21.15.88:0/1763339801 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7f034805b140 con 0x7f03541038b0 2024-09-13T21:44:52.197 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:44:52.197 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:44:52.197 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:44:52.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:44:52.197 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:44:52.197 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:44:52.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:44:52.197 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:44:52.198 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:44:52.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f033c06e7c0 msgr2=0x7f033c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f033c06e7c0 0x7f033c070c70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f034400a960 tx=0x7f034400a8d0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 msgr2=0x7f0354100af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 0x7f0354100af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f034800c930 tx=0x7f034800ccf0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 shutdown_connections 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f033c06e7c0 0x7f033c070c70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03540ff350 0x7f03541005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 --2- 172.21.15.88:0/1763339801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03541038b0 0x7f0354100af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 >> 172.21.15.88:0/1763339801 conn(0x7f03540748b0 msgr2=0x7f03540fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 shutdown_connections 2024-09-13T21:44:52.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.198+0000 7f0359feb700 1 -- 172.21.15.88:0/1763339801 wait complete. 2024-09-13T21:44:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 -- 172.21.15.88:0/230433126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 msgr2=0x7fbb940ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 --2- 172.21.15.88:0/230433126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 0x7fbb940ff790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009910 tx=0x7fbb88009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 -- 172.21.15.88:0/230433126 shutdown_connections 2024-09-13T21:44:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 --2- 172.21.15.88:0/230433126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940ffd60 0x7fbb94103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 --2- 172.21.15.88:0/230433126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 0x7fbb940ff790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 -- 172.21.15.88:0/230433126 >> 172.21.15.88:0/230433126 conn(0x7fbb940fac60 msgr2=0x7fbb940fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 -- 172.21.15.88:0/230433126 shutdown_connections 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 -- 172.21.15.88:0/230433126 wait complete. 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 Processor -- start 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.303+0000 7fbb9ab60700 1 -- start start 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb9ab60700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 0x7fbb94194dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb9ab60700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940ffd60 0x7fbb94195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb9ab60700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941959e0 con 0x7fbb940ff3c0 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb9ab60700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94199770 con 0x7fbb940ffd60 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb988fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 0x7fbb94194dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb988fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 0x7fbb94194dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59484/0 (socket says 172.21.15.88:59484) 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb988fc700 1 -- 172.21.15.88:0/3516745171 learned_addr learned my addr 172.21.15.88:0/3516745171 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb93fff700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940ffd60 0x7fbb94195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb988fc700 1 -- 172.21.15.88:0/3516745171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940ffd60 msgr2=0x7fbb94195300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb988fc700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940ffd60 0x7fbb94195300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb988fc700 1 -- 172.21.15.88:0/3516745171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880095f0 con 0x7fbb940ff3c0 2024-09-13T21:44:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb988fc700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 0x7fbb94194dc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb88006010 tx=0x7fbb8800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb91ffb700 1 -- 172.21.15.88:0/3516745171 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8801f070 con 0x7fbb940ff3c0 2024-09-13T21:44:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb91ffb700 1 -- 172.21.15.88:0/3516745171 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb88019610 con 0x7fbb940ff3c0 2024-09-13T21:44:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb941999f0 con 0x7fbb940ff3c0 2024-09-13T21:44:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.304+0000 7fbb91ffb700 1 -- 172.21.15.88:0/3516745171 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8800f690 con 0x7fbb940ff3c0 2024-09-13T21:44:52.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.305+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb94199ee0 con 0x7fbb940ff3c0 2024-09-13T21:44:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.306+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9404f2a0 con 0x7fbb940ff3c0 2024-09-13T21:44:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.306+0000 7fbb91ffb700 1 -- 172.21.15.88:0/3516745171 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fbb88003a60 con 0x7fbb940ff3c0 2024-09-13T21:44:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.306+0000 7fbb91ffb700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fbb8406e7c0 0x7fbb84070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.307+0000 7fbb91ffb700 1 -- 172.21.15.88:0/3516745171 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbb88091f40 con 0x7fbb940ff3c0 2024-09-13T21:44:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.307+0000 7fbb93fff700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fbb8406e7c0 0x7fbb84070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:52.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.307+0000 7fbb93fff700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fbb8406e7c0 0x7fbb84070c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005950 tx=0x7fbb800058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:52.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.311+0000 7fbb91ffb700 1 -- 172.21.15.88:0/3516745171 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbb880c71b0 con 0x7fbb940ff3c0 2024-09-13T21:44:52.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:52 smithi088 ceph-mon[86843]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:52.511 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:52 smithi116 ceph-mon[65231]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:52.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.558+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbb9419a1c0 con 0x7fbb940ff3c0 2024-09-13T21:44:52.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.558+0000 7fbb91ffb700 1 -- 172.21.15.88:0/3516745171 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1923 (secure 0 0 0) 0x7fbb8805aff0 con 0x7fbb940ff3c0 2024-09-13T21:44:52.560 INFO:teuthology.orchestra.run.smithi088.stdout:e20 2024-09-13T21:44:52.560 INFO:teuthology.orchestra.run.smithi088.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:44:52.560 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:44:52.560 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 20 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:44:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:44:52.562 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:52.563 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:52.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fbb8406e7c0 msgr2=0x7fbb84070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fbb8406e7c0 0x7fbb84070c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005950 tx=0x7fbb800058e0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 msgr2=0x7fbb94194dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 0x7fbb94194dc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb88006010 tx=0x7fbb8800be20 comp rx=0 tx=0).stop 2024-09-13T21:44:52.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 shutdown_connections 2024-09-13T21:44:52.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fbb8406e7c0 0x7fbb84070c70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb940ff3c0 0x7fbb94194dc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 --2- 172.21.15.88:0/3516745171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb940ffd60 0x7fbb94195300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 >> 172.21.15.88:0/3516745171 conn(0x7fbb940fac60 msgr2=0x7fbb940fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:52.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 shutdown_connections 2024-09-13T21:44:52.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.561+0000 7fbb9ab60700 1 -- 172.21.15.88:0/3516745171 wait complete. 2024-09-13T21:44:52.565 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:44:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.665+0000 7ff89ce22700 1 -- 172.21.15.88:0/3024321923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8980ffd60 msgr2=0x7ff898103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.665+0000 7ff89ce22700 1 --2- 172.21.15.88:0/3024321923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8980ffd60 0x7ff898103d30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff888009910 tx=0x7ff888009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.665+0000 7ff89ce22700 1 -- 172.21.15.88:0/3024321923 shutdown_connections 2024-09-13T21:44:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.665+0000 7ff89ce22700 1 --2- 172.21.15.88:0/3024321923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8980ffd60 0x7ff898103d30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.665+0000 7ff89ce22700 1 --2- 172.21.15.88:0/3024321923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8980ff3c0 0x7ff8980ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.665+0000 7ff89ce22700 1 -- 172.21.15.88:0/3024321923 >> 172.21.15.88:0/3024321923 conn(0x7ff8980fac60 msgr2=0x7ff8980fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.665+0000 7ff89ce22700 1 -- 172.21.15.88:0/3024321923 shutdown_connections 2024-09-13T21:44:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.665+0000 7ff89ce22700 1 -- 172.21.15.88:0/3024321923 wait complete. 2024-09-13T21:44:52.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.666+0000 7ff89ce22700 1 Processor -- start 2024-09-13T21:44:52.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.666+0000 7ff89ce22700 1 -- start start 2024-09-13T21:44:52.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff89ce22700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8980ff3c0 0x7ff898194db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff89ce22700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8980ffd60 0x7ff8981952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff89ce22700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981959d0 con 0x7ff8980ff3c0 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff89ce22700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff898199760 con 0x7ff8980ffd60 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff89659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8980ff3c0 0x7ff898194db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8980ffd60 0x7ff8981952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff89659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8980ff3c0 0x7ff898194db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59496/0 (socket says 172.21.15.88:59496) 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff89659c700 1 -- 172.21.15.88:0/505119275 learned_addr learned my addr 172.21.15.88:0/505119275 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff895d9b700 1 -- 172.21.15.88:0/505119275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8980ff3c0 msgr2=0x7ff898194db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff895d9b700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8980ff3c0 0x7ff898194db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.667+0000 7ff895d9b700 1 -- 172.21.15.88:0/505119275 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880095f0 con 0x7ff8980ffd60 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.668+0000 7ff895d9b700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8980ffd60 0x7ff8981952f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff888000c00 tx=0x7ff88800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.668+0000 7ff8877fe700 1 -- 172.21.15.88:0/505119275 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88801d070 con 0x7ff8980ffd60 2024-09-13T21:44:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.668+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8981999e0 con 0x7ff8980ffd60 2024-09-13T21:44:52.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.668+0000 7ff8877fe700 1 -- 172.21.15.88:0/505119275 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff888005dc0 con 0x7ff8980ffd60 2024-09-13T21:44:52.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.668+0000 7ff8877fe700 1 -- 172.21.15.88:0/505119275 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88800fe60 con 0x7ff8980ffd60 2024-09-13T21:44:52.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.668+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff898199ed0 con 0x7ff8980ffd60 2024-09-13T21:44:52.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.669+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89804f2a0 con 0x7ff8980ffd60 2024-09-13T21:44:52.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.670+0000 7ff8877fe700 1 -- 172.21.15.88:0/505119275 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7ff88800f660 con 0x7ff8980ffd60 2024-09-13T21:44:52.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.670+0000 7ff8877fe700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff8800709c0 0x7ff880072e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:52.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.670+0000 7ff8877fe700 1 -- 172.21.15.88:0/505119275 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff88808fb80 con 0x7ff8980ffd60 2024-09-13T21:44:52.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.670+0000 7ff89659c700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff8800709c0 0x7ff880072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:52.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.671+0000 7ff89659c700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff8800709c0 0x7ff880072e70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff88c005950 tx=0x7ff88c00b500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.675+0000 7ff8877fe700 1 -- 172.21.15.88:0/505119275 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff888058c30 con 0x7ff8980ffd60 2024-09-13T21:44:52.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.895+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff89819a200 con 0x7ff8800709c0 2024-09-13T21:44:52.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.896+0000 7ff8877fe700 1 -- 172.21.15.88:0/505119275 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff89819a200 con 0x7ff8800709c0 2024-09-13T21:44:52.898 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:44:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:44:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:44:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:44:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:44:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:44:52.898 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-13T21:44:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:44:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "4/23 daemons upgraded", 2024-09-13T21:44:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T21:44:52.899 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:44:52.899 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:44:52.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff8800709c0 msgr2=0x7ff880072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff8800709c0 0x7ff880072e70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff88c005950 tx=0x7ff88c00b500 comp rx=0 tx=0).stop 2024-09-13T21:44:52.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8980ffd60 msgr2=0x7ff8981952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:52.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8980ffd60 0x7ff8981952f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff888000c00 tx=0x7ff88800bd70 comp rx=0 tx=0).stop 2024-09-13T21:44:52.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 shutdown_connections 2024-09-13T21:44:52.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff8800709c0 0x7ff880072e70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8980ff3c0 0x7ff898194db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 --2- 172.21.15.88:0/505119275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8980ffd60 0x7ff8981952f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:52.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 >> 172.21.15.88:0/505119275 conn(0x7ff8980fac60 msgr2=0x7ff8980fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:52.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 shutdown_connections 2024-09-13T21:44:52.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:52.899+0000 7ff89ce22700 1 -- 172.21.15.88:0/505119275 wait complete. 2024-09-13T21:44:53.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.003+0000 7fb6810b7700 1 -- 172.21.15.88:0/43008721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 msgr2=0x7fb67c10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:53.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.003+0000 7fb6810b7700 1 --2- 172.21.15.88:0/43008721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 0x7fb67c10a6d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009910 tx=0x7fb66c009c20 comp rx=0 tx=0).stop 2024-09-13T21:44:53.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.003+0000 7fb6810b7700 1 -- 172.21.15.88:0/43008721 shutdown_connections 2024-09-13T21:44:53.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.003+0000 7fb6810b7700 1 --2- 172.21.15.88:0/43008721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 0x7fb67c10a6d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:53.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.003+0000 7fb6810b7700 1 --2- 172.21.15.88:0/43008721 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c0ff350 0x7fb67c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:53.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.003+0000 7fb6810b7700 1 -- 172.21.15.88:0/43008721 >> 172.21.15.88:0/43008721 conn(0x7fb67c0748b0 msgr2=0x7fb67c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:53.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.003+0000 7fb6810b7700 1 -- 172.21.15.88:0/43008721 shutdown_connections 2024-09-13T21:44:53.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.003+0000 7fb6810b7700 1 -- 172.21.15.88:0/43008721 wait complete. 2024-09-13T21:44:53.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb6810b7700 1 Processor -- start 2024-09-13T21:44:53.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb6810b7700 1 -- start start 2024-09-13T21:44:53.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb6810b7700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c0ff350 0x7fb67c195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:53.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb6810b7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 0x7fb67c196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:53.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb6810b7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c196b00 con 0x7fb67c0ffc60 2024-09-13T21:44:53.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb6810b7700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c19a890 con 0x7fb67c0ff350 2024-09-13T21:44:53.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb67a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 0x7fb67c196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:53.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb67a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 0x7fb67c196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59524/0 (socket says 172.21.15.88:59524) 2024-09-13T21:44:53.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb67a59c700 1 -- 172.21.15.88:0/3601105906 learned_addr learned my addr 172.21.15.88:0/3601105906 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.004+0000 7fb67ad9d700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c0ff350 0x7fb67c195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.005+0000 7fb67a59c700 1 -- 172.21.15.88:0/3601105906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c0ff350 msgr2=0x7fb67c195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.005+0000 7fb67a59c700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c0ff350 0x7fb67c195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.005+0000 7fb67a59c700 1 -- 172.21.15.88:0/3601105906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c0095f0 con 0x7fb67c0ffc60 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.005+0000 7fb67a59c700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 0x7fb67c196420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb66c006010 tx=0x7fb66c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.005+0000 7fb663fff700 1 -- 172.21.15.88:0/3601105906 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb66c01d070 con 0x7fb67c0ffc60 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.005+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c19ab10 con 0x7fb67c0ffc60 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.005+0000 7fb663fff700 1 -- 172.21.15.88:0/3601105906 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb66c005dc0 con 0x7fb67c0ffc60 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.005+0000 7fb663fff700 1 -- 172.21.15.88:0/3601105906 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb66c017400 con 0x7fb67c0ffc60 2024-09-13T21:44:53.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.005+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c19b000 con 0x7fb67c0ffc60 2024-09-13T21:44:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.006+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c107dd0 con 0x7fb67c0ffc60 2024-09-13T21:44:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.006+0000 7fb663fff700 1 -- 172.21.15.88:0/3601105906 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fb66c003a60 con 0x7fb67c0ffc60 2024-09-13T21:44:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.007+0000 7fb663fff700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb66406e7c0 0x7fb664070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.007+0000 7fb663fff700 1 -- 172.21.15.88:0/3601105906 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb66c08fcb0 con 0x7fb67c0ffc60 2024-09-13T21:44:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.007+0000 7fb67ad9d700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb66406e7c0 0x7fb664070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.007+0000 7fb67ad9d700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb66406e7c0 0x7fb664070c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb67c06a640 tx=0x7fb670007400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:53.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.011+0000 7fb663fff700 1 -- 172.21.15.88:0/3601105906 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb66c058ce0 con 0x7fb67c0ffc60 2024-09-13T21:44:53.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.296+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb67c197240 con 0x7fb67c0ffc60 2024-09-13T21:44:53.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:53 smithi088 ceph-mon[86843]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:53.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:53 smithi088 ceph-mon[86843]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:53.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:53 smithi088 ceph-mon[86843]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:53.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:53 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1763339801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:53.298 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:53 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3516745171' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:44:53.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.296+0000 7fb663fff700 1 -- 172.21.15.88:0/3601105906 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb66c05c3a0 con 0x7fb67c0ffc60 2024-09-13T21:44:53.298 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:53.299 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:44:53.299 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:44:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb66406e7c0 msgr2=0x7fb664070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb66406e7c0 0x7fb664070c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb67c06a640 tx=0x7fb670007400 comp rx=0 tx=0).stop 2024-09-13T21:44:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 msgr2=0x7fb67c196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 0x7fb67c196420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb66c006010 tx=0x7fb66c00bd70 comp rx=0 tx=0).stop 2024-09-13T21:44:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 shutdown_connections 2024-09-13T21:44:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb66406e7c0 0x7fb664070c70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c0ff350 0x7fb67c195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 --2- 172.21.15.88:0/3601105906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb67c0ffc60 0x7fb67c196420 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 >> 172.21.15.88:0/3601105906 conn(0x7fb67c0748b0 msgr2=0x7fb67c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 shutdown_connections 2024-09-13T21:44:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:44:53.298+0000 7fb6810b7700 1 -- 172.21.15.88:0/3601105906 wait complete. 2024-09-13T21:44:53.361 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:53 smithi116 ceph-mon[65231]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:53.361 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:53 smithi116 ceph-mon[65231]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:53.361 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:53 smithi116 ceph-mon[65231]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:53.361 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:53 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1763339801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:53.361 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:53 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3516745171' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:44:54.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:54 smithi088 ceph-mon[86843]: from='client.44101 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:54.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:54 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3601105906' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:44:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:54 smithi116 ceph-mon[65231]: from='client.44101 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:54 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3601105906' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:44:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: Detected new or changed devices on smithi116 2024-09-13T21:44:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:44:55.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:44:55.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: Detected new or changed devices on smithi116 2024-09-13T21:44:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:44:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:44:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:56.424 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:56 smithi088 ceph-mon[86843]: Reconfiguring mon.smithi088 (monmap changed)... 2024-09-13T21:44:56.424 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:56 smithi088 ceph-mon[86843]: Reconfiguring daemon mon.smithi088 on smithi088 2024-09-13T21:44:56.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:56.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:56.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.scyrwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:44:56.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:44:56.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:56.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:56 smithi116 ceph-mon[65231]: Reconfiguring mon.smithi088 (monmap changed)... 2024-09-13T21:44:56.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:56 smithi116 ceph-mon[65231]: Reconfiguring daemon mon.smithi088 on smithi088 2024-09-13T21:44:56.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:56.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:56.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi088.scyrwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:44:56.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:44:56.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:57.466 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: Reconfiguring mgr.smithi088.scyrwy (monmap changed)... 2024-09-13T21:44:57.466 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: Reconfiguring daemon mgr.smithi088.scyrwy on smithi088 2024-09-13T21:44:57.466 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:57.467 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:57.467 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:57.467 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:44:57.467 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:44:57.467 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T21:44:57.467 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi088"}]: dispatch 2024-09-13T21:44:57.467 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: Reconfiguring mgr.smithi088.scyrwy (monmap changed)... 2024-09-13T21:44:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: Reconfiguring daemon mgr.smithi088.scyrwy on smithi088 2024-09-13T21:44:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:57.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:57.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:57.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:44:57.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:44:57.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T21:44:57.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi088"}]: dispatch 2024-09-13T21:44:57.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:58.469 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:58 smithi088 ceph-mon[86843]: Reconfiguring ceph-exporter.smithi088 (monmap changed)... 2024-09-13T21:44:58.469 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:58 smithi088 ceph-mon[86843]: Unable to update caps for client.ceph-exporter.smithi088 2024-09-13T21:44:58.469 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:58 smithi088 ceph-mon[86843]: Reconfiguring daemon ceph-exporter.smithi088 on smithi088 2024-09-13T21:44:58.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:58 smithi116 ceph-mon[65231]: Reconfiguring ceph-exporter.smithi088 (monmap changed)... 2024-09-13T21:44:58.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:58 smithi116 ceph-mon[65231]: Unable to update caps for client.ceph-exporter.smithi088 2024-09-13T21:44:58.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:58 smithi116 ceph-mon[65231]: Reconfiguring daemon ceph-exporter.smithi088 on smithi088 2024-09-13T21:44:59.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:59 smithi088 ceph-mon[86843]: pgmap v16: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:59.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:59 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:59 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:59 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:44:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:44:59 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:59 smithi116 ceph-mon[65231]: pgmap v16: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:44:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:59 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:59 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:44:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:59 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:44:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:44:59 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:00.505 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:00 smithi088 ceph-mon[86843]: Reconfiguring crash.smithi088 (monmap changed)... 2024-09-13T21:45:00.505 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:00 smithi088 ceph-mon[86843]: Reconfiguring daemon crash.smithi088 on smithi088 2024-09-13T21:45:00.505 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:00 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:00.505 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:00 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:00.505 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:00 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:45:00.506 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:00 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:00.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:00 smithi116 ceph-mon[65231]: Reconfiguring crash.smithi088 (monmap changed)... 2024-09-13T21:45:00.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:00 smithi116 ceph-mon[65231]: Reconfiguring daemon crash.smithi088 on smithi088 2024-09-13T21:45:00.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:00 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:00.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:00 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:00.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:00 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:45:00.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:00 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:01 smithi116 ceph-mon[65231]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T21:45:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:01 smithi116 ceph-mon[65231]: Reconfiguring daemon osd.0 on smithi088 2024-09-13T21:45:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:01 smithi116 ceph-mon[65231]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:01.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:01 smithi088 ceph-mon[86843]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T21:45:01.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:01 smithi088 ceph-mon[86843]: Reconfiguring daemon osd.0 on smithi088 2024-09-13T21:45:01.726 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:01 smithi088 ceph-mon[86843]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:02.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:02.801 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:02.801 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:02 smithi116 ceph-mon[65231]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T21:45:02.801 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:45:02.801 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:02.801 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:02 smithi116 ceph-mon[65231]: Reconfiguring daemon osd.1 on smithi088 2024-09-13T21:45:02.801 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:02 smithi116 ceph-mon[65231]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:02.801 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:02.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:02.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:02.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:02 smithi088 ceph-mon[86843]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T21:45:02.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:45:02.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:02.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:02 smithi088 ceph-mon[86843]: Reconfiguring daemon osd.1 on smithi088 2024-09-13T21:45:02.802 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:02 smithi088 ceph-mon[86843]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:02.803 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:04.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:04.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:04.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:03 smithi116 ceph-mon[65231]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T21:45:04.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:45:04.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:04.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:03 smithi116 ceph-mon[65231]: Reconfiguring daemon osd.2 on smithi088 2024-09-13T21:45:04.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:04.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:04.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:03 smithi088 ceph-mon[86843]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T21:45:04.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:45:04.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:04.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:03 smithi088 ceph-mon[86843]: Reconfiguring daemon osd.2 on smithi088 2024-09-13T21:45:05.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:04 smithi088 ceph-mon[86843]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:05.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:04 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:05.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:04 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:05.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:04 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.yszliw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:45:05.048 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:04 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:05.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:04 smithi116 ceph-mon[65231]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:05.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:04 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:05.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:04 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:05.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:04 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.yszliw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:45:05.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:04 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:05.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:05 smithi088 ceph-mon[86843]: Reconfiguring mds.cephfs.smithi088.yszliw (monmap changed)... 2024-09-13T21:45:05.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:05 smithi088 ceph-mon[86843]: Reconfiguring daemon mds.cephfs.smithi088.yszliw on smithi088 2024-09-13T21:45:05.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:05.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:05.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.vqfqko", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:45:05.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:06.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:05 smithi116 ceph-mon[65231]: Reconfiguring mds.cephfs.smithi088.yszliw (monmap changed)... 2024-09-13T21:45:06.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:05 smithi116 ceph-mon[65231]: Reconfiguring daemon mds.cephfs.smithi088.yszliw on smithi088 2024-09-13T21:45:06.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:06.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:06.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.vqfqko", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:45:06.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:07.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:06 smithi088 ceph-mon[86843]: Reconfiguring mds.cephfs.smithi088.vqfqko (monmap changed)... 2024-09-13T21:45:07.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:06 smithi088 ceph-mon[86843]: Reconfiguring daemon mds.cephfs.smithi088.vqfqko on smithi088 2024-09-13T21:45:07.114 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:06 smithi088 ceph-mon[86843]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:07.249 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:06 smithi116 ceph-mon[65231]: Reconfiguring mds.cephfs.smithi088.vqfqko (monmap changed)... 2024-09-13T21:45:07.250 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:06 smithi116 ceph-mon[65231]: Reconfiguring daemon mds.cephfs.smithi088.vqfqko on smithi088 2024-09-13T21:45:07.250 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:06 smithi116 ceph-mon[65231]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: Reconfiguring ceph-exporter.smithi116 (monmap changed)... 2024-09-13T21:45:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:45:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:45:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T21:45:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: Unable to update caps for client.ceph-exporter.smithi116 2024-09-13T21:45:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi116"}]: dispatch 2024-09-13T21:45:08.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:08.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:08 smithi088 ceph-mon[86843]: Reconfiguring daemon ceph-exporter.smithi116 on smithi116 2024-09-13T21:45:08.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:08.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:08.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: Reconfiguring ceph-exporter.smithi116 (monmap changed)... 2024-09-13T21:45:08.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:45:08.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:45:08.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T21:45:08.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: Unable to update caps for client.ceph-exporter.smithi116 2024-09-13T21:45:08.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi116"}]: dispatch 2024-09-13T21:45:08.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:08.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:08 smithi116 ceph-mon[65231]: Reconfiguring daemon ceph-exporter.smithi116 on smithi116 2024-09-13T21:45:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:09 smithi116 ceph-mon[65231]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:09 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:09.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:09 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:09.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:09 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi116", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:45:09.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:09 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:09.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:09 smithi088 ceph-mon[86843]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:09 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:09 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:09 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi116", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:45:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:09 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:10 smithi116 ceph-mon[65231]: Reconfiguring crash.smithi116 (monmap changed)... 2024-09-13T21:45:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:10 smithi116 ceph-mon[65231]: Reconfiguring daemon crash.smithi116 on smithi116 2024-09-13T21:45:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:10 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:10 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:10 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:45:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:10 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:45:10.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:10 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:10.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:10 smithi088 ceph-mon[86843]: Reconfiguring crash.smithi116 (monmap changed)... 2024-09-13T21:45:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:10 smithi088 ceph-mon[86843]: Reconfiguring daemon crash.smithi116 on smithi116 2024-09-13T21:45:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:10 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:10 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:10 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi116.bqnvtn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:45:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:10 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:45:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:10 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:11.394 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:11 smithi116 ceph-mon[65231]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:11.394 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:11 smithi116 ceph-mon[65231]: Reconfiguring mgr.smithi116.bqnvtn (monmap changed)... 2024-09-13T21:45:11.395 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:11 smithi116 ceph-mon[65231]: Reconfiguring daemon mgr.smithi116.bqnvtn on smithi116 2024-09-13T21:45:11.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:11 smithi088 ceph-mon[86843]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:11 smithi088 ceph-mon[86843]: Reconfiguring mgr.smithi116.bqnvtn (monmap changed)... 2024-09-13T21:45:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:11 smithi088 ceph-mon[86843]: Reconfiguring daemon mgr.smithi116.bqnvtn on smithi116 2024-09-13T21:45:12.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:12 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:12.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:12 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:12.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:12 smithi088 ceph-mon[86843]: Reconfiguring mon.smithi116 (monmap changed)... 2024-09-13T21:45:12.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:12 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:45:12.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:12 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:45:12.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:12 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:12.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:12 smithi088 ceph-mon[86843]: Reconfiguring daemon mon.smithi116 on smithi116 2024-09-13T21:45:12.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:12 smithi088 ceph-mon[86843]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:12.785 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:12 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:12.785 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:12 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:12.785 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:12 smithi116 ceph-mon[65231]: Reconfiguring mon.smithi116 (monmap changed)... 2024-09-13T21:45:12.785 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:12 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:45:12.785 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:12 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:45:12.785 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:12 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:12.785 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:12 smithi116 ceph-mon[65231]: Reconfiguring daemon mon.smithi116 on smithi116 2024-09-13T21:45:12.785 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:12 smithi116 ceph-mon[65231]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:14.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:13 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:14.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:13 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:14.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:13 smithi116 ceph-mon[65231]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T21:45:14.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:13 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:45:14.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:13 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:14.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:13 smithi116 ceph-mon[65231]: Reconfiguring daemon osd.3 on smithi116 2024-09-13T21:45:14.168 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:13 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:14.169 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:13 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:14.169 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:13 smithi088 ceph-mon[86843]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T21:45:14.169 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:13 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:45:14.169 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:13 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:14.169 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:13 smithi088 ceph-mon[86843]: Reconfiguring daemon osd.3 on smithi116 2024-09-13T21:45:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:15 smithi088 ceph-mon[86843]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:15 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:15 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:15 smithi088 ceph-mon[86843]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T21:45:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:15 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:45:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:15 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:15 smithi088 ceph-mon[86843]: Reconfiguring daemon osd.4 on smithi116 2024-09-13T21:45:15.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:15 smithi116 ceph-mon[65231]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:15.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:15 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:15.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:15 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:15.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:15 smithi116 ceph-mon[65231]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T21:45:15.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:15 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:45:15.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:15 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:15.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:15 smithi116 ceph-mon[65231]: Reconfiguring daemon osd.4 on smithi116 2024-09-13T21:45:17.077 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:17.077 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:17.077 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:16 smithi116 ceph-mon[65231]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T21:45:17.077 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:45:17.077 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:17.077 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:16 smithi116 ceph-mon[65231]: Reconfiguring daemon osd.5 on smithi116 2024-09-13T21:45:17.077 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:16 smithi116 ceph-mon[65231]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:17.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:17.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:17.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:16 smithi088 ceph-mon[86843]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T21:45:17.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:45:17.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:17.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:16 smithi088 ceph-mon[86843]: Reconfiguring daemon osd.5 on smithi116 2024-09-13T21:45:17.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:16 smithi088 ceph-mon[86843]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:17.967 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:17.967 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:17.967 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:17.967 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:17 smithi116 ceph-mon[65231]: Reconfiguring mds.cephfs.smithi116.rwfayz (monmap changed)... 2024-09-13T21:45:17.968 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.rwfayz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:45:17.968 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:17.968 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:17 smithi116 ceph-mon[65231]: Reconfiguring daemon mds.cephfs.smithi116.rwfayz on smithi116 2024-09-13T21:45:18.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:17 smithi088 ceph-mon[86843]: Reconfiguring mds.cephfs.smithi116.rwfayz (monmap changed)... 2024-09-13T21:45:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.rwfayz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:45:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:18.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:17 smithi088 ceph-mon[86843]: Reconfiguring daemon mds.cephfs.smithi116.rwfayz on smithi116 2024-09-13T21:45:18.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:18 smithi116 ceph-mon[65231]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:18.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:18.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:18.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.mjrkvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:45:18.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:19.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:18 smithi088 ceph-mon[86843]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:19.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:19.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:19.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.mjrkvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:45:19.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:20.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:19 smithi116 ceph-mon[65231]: Reconfiguring mds.cephfs.smithi116.mjrkvg (monmap changed)... 2024-09-13T21:45:20.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:19 smithi116 ceph-mon[65231]: Reconfiguring daemon mds.cephfs.smithi116.mjrkvg on smithi116 2024-09-13T21:45:20.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:19 smithi088 ceph-mon[86843]: Reconfiguring mds.cephfs.smithi116.mjrkvg (monmap changed)... 2024-09-13T21:45:20.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:19 smithi088 ceph-mon[86843]: Reconfiguring daemon mds.cephfs.smithi116.mjrkvg on smithi116 2024-09-13T21:45:21.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all mon 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]: dispatch 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]': finished 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi116"}]: dispatch 2024-09-13T21:45:21.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:21 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi116"}]': finished 2024-09-13T21:45:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all mon 2024-09-13T21:45:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]: dispatch 2024-09-13T21:45:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi088"}]': finished 2024-09-13T21:45:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi116"}]: dispatch 2024-09-13T21:45:21.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:21 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi116"}]': finished 2024-09-13T21:45:22.843 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:22 smithi088 ceph-mon[86843]: Upgrade: Updating crash.smithi088 (1/2) 2024-09-13T21:45:22.843 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:22 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:22.844 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:22 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:45:22.844 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:22 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:22.844 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:22 smithi088 ceph-mon[86843]: Deploying daemon crash.smithi088 on smithi088 2024-09-13T21:45:22.844 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:22 smithi088 ceph-mon[86843]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:22 smithi116 ceph-mon[65231]: Upgrade: Updating crash.smithi088 (1/2) 2024-09-13T21:45:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:22 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:22 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi088", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:45:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:22 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:22 smithi116 ceph-mon[65231]: Deploying daemon crash.smithi088 on smithi088 2024-09-13T21:45:22.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:22 smithi116 ceph-mon[65231]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:23.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.407+0000 7f7f4e723700 1 -- 172.21.15.88:0/2156898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ff3c0 msgr2=0x7f7f480ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:23.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.407+0000 7f7f4e723700 1 --2- 172.21.15.88:0/2156898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ff3c0 0x7f7f480ff790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009910 tx=0x7f7f38009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:23.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.407+0000 7f7f4e723700 1 -- 172.21.15.88:0/2156898 shutdown_connections 2024-09-13T21:45:23.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.407+0000 7f7f4e723700 1 --2- 172.21.15.88:0/2156898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f480ffd60 0x7f7f48103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.407+0000 7f7f4e723700 1 --2- 172.21.15.88:0/2156898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ff3c0 0x7f7f480ff790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.407+0000 7f7f4e723700 1 -- 172.21.15.88:0/2156898 >> 172.21.15.88:0/2156898 conn(0x7f7f480fac80 msgr2=0x7f7f480fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.407+0000 7f7f4e723700 1 -- 172.21.15.88:0/2156898 shutdown_connections 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.407+0000 7f7f4e723700 1 -- 172.21.15.88:0/2156898 wait complete. 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f4e723700 1 Processor -- start 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f4e723700 1 -- start start 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f4e723700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f480ff3c0 0x7f7f48196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f4e723700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ffd60 0x7f7f481971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f4e723700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481978b0 con 0x7f7f480ffd60 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f4e723700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481979f0 con 0x7f7f480ff3c0 2024-09-13T21:45:23.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f477fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ffd60 0x7f7f481971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f477fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ffd60 0x7f7f481971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35698/0 (socket says 172.21.15.88:35698) 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f477fe700 1 -- 172.21.15.88:0/2708336505 learned_addr learned my addr 172.21.15.88:0/2708336505 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.408+0000 7f7f47fff700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f480ff3c0 0x7f7f48196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f477fe700 1 -- 172.21.15.88:0/2708336505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f480ff3c0 msgr2=0x7f7f48196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f477fe700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f480ff3c0 0x7f7f48196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f477fe700 1 -- 172.21.15.88:0/2708336505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380095f0 con 0x7f7f480ffd60 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f47fff700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f480ff3c0 0x7f7f48196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f477fe700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ffd60 0x7f7f481971d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000d900 tx=0x7f7f3000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f457fa700 1 -- 172.21.15.88:0/2708336505 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f30009900 con 0x7f7f480ffd60 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f457fa700 1 -- 172.21.15.88:0/2708336505 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f30010460 con 0x7f7f480ffd60 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4819fd00 con 0x7f7f480ffd60 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f457fa700 1 -- 172.21.15.88:0/2708336505 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f3000f5f0 con 0x7f7f480ffd60 2024-09-13T21:45:23.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.409+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f481a0220 con 0x7f7f480ffd60 2024-09-13T21:45:23.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.410+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f481076d0 con 0x7f7f480ffd60 2024-09-13T21:45:23.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.411+0000 7f7f457fa700 1 -- 172.21.15.88:0/2708336505 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f7f300105d0 con 0x7f7f480ffd60 2024-09-13T21:45:23.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.411+0000 7f7f457fa700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7f3406e7b0 0x7f7f34070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:23.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.411+0000 7f7f457fa700 1 -- 172.21.15.88:0/2708336505 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7f3008e6c0 con 0x7f7f480ffd60 2024-09-13T21:45:23.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.411+0000 7f7f47fff700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7f3406e7b0 0x7f7f34070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:23.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.412+0000 7f7f47fff700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7f3406e7b0 0x7f7f34070c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f38005b40 tx=0x7f7f3801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:23.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.417+0000 7f7f457fa700 1 -- 172.21.15.88:0/2708336505 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7f300576f0 con 0x7f7f480ffd60 2024-09-13T21:45:23.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.645+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f48061190 con 0x7f7f3406e7b0 2024-09-13T21:45:23.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.646+0000 7f7f457fa700 1 -- 172.21.15.88:0/2708336505 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f7f48061190 con 0x7f7f3406e7b0 2024-09-13T21:45:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.648+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7f3406e7b0 msgr2=0x7f7f34070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.648+0000 7f7f4e723700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7f3406e7b0 0x7f7f34070c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f38005b40 tx=0x7f7f3801a040 comp rx=0 tx=0).stop 2024-09-13T21:45:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.648+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ffd60 msgr2=0x7f7f481971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.648+0000 7f7f4e723700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ffd60 0x7f7f481971d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000d900 tx=0x7f7f3000dcc0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.648+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 shutdown_connections 2024-09-13T21:45:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.648+0000 7f7f4e723700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7f3406e7b0 0x7f7f34070c60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.648+0000 7f7f4e723700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f480ff3c0 0x7f7f48196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.648+0000 7f7f4e723700 1 --2- 172.21.15.88:0/2708336505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f480ffd60 0x7f7f481971d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.648+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 >> 172.21.15.88:0/2708336505 conn(0x7f7f480fac80 msgr2=0x7f7f480fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:23.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.649+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 shutdown_connections 2024-09-13T21:45:23.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.649+0000 7f7f4e723700 1 -- 172.21.15.88:0/2708336505 wait complete. 2024-09-13T21:45:23.660 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:45:23.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.756+0000 7fe290884700 1 -- 172.21.15.88:0/478382778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 msgr2=0x7fe28c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:23.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.756+0000 7fe290884700 1 --2- 172.21.15.88:0/478382778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 0x7fe28c1094d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe274009910 tx=0x7fe274009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:23.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.756+0000 7fe290884700 1 -- 172.21.15.88:0/478382778 shutdown_connections 2024-09-13T21:45:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.756+0000 7fe290884700 1 --2- 172.21.15.88:0/478382778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 0x7fe28c1094d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.756+0000 7fe290884700 1 --2- 172.21.15.88:0/478382778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe28c100460 0x7fe28c100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.756+0000 7fe290884700 1 -- 172.21.15.88:0/478382778 >> 172.21.15.88:0/478382778 conn(0x7fe28c0748b0 msgr2=0x7fe28c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.756+0000 7fe290884700 1 -- 172.21.15.88:0/478382778 shutdown_connections 2024-09-13T21:45:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.756+0000 7fe290884700 1 -- 172.21.15.88:0/478382778 wait complete. 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.757+0000 7fe290884700 1 Processor -- start 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.757+0000 7fe290884700 1 -- start start 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.757+0000 7fe290884700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe28c100460 0x7fe28c194b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.757+0000 7fe290884700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 0x7fe28c1950c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.757+0000 7fe290884700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c195600 con 0x7fe28c100d70 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.757+0000 7fe290884700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c195770 con 0x7fe28c100460 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.757+0000 7fe289d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 0x7fe28c1950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.757+0000 7fe289d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 0x7fe28c1950c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35724/0 (socket says 172.21.15.88:35724) 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.757+0000 7fe289d9b700 1 -- 172.21.15.88:0/1699919085 learned_addr learned my addr 172.21.15.88:0/1699919085 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:23.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe28a59c700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe28c100460 0x7fe28c194b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe289d9b700 1 -- 172.21.15.88:0/1699919085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe28c100460 msgr2=0x7fe28c194b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe289d9b700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe28c100460 0x7fe28c194b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe289d9b700 1 -- 172.21.15.88:0/1699919085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2740095f0 con 0x7fe28c100d70 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe28a59c700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe28c100460 0x7fe28c194b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe289d9b700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 0x7fe28c1950c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe274005f50 tx=0x7fe27400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe2837fe700 1 -- 172.21.15.88:0/1699919085 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe27401d070 con 0x7fe28c100d70 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe2837fe700 1 -- 172.21.15.88:0/1699919085 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe27400b610 con 0x7fe28c100d70 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c1959f0 con 0x7fe28c100d70 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe2837fe700 1 -- 172.21.15.88:0/1699919085 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe274022470 con 0x7fe28c100d70 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.758+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c1a2470 con 0x7fe28c100d70 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.759+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c106bd0 con 0x7fe28c100d70 2024-09-13T21:45:23.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.760+0000 7fe2837fe700 1 -- 172.21.15.88:0/1699919085 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fe27400fca0 con 0x7fe28c100d70 2024-09-13T21:45:23.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.760+0000 7fe2837fe700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe27806e7c0 0x7fe278070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:23.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.760+0000 7fe28a59c700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe27806e7c0 0x7fe278070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:23.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.760+0000 7fe2837fe700 1 -- 172.21.15.88:0/1699919085 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe27408fb60 con 0x7fe28c100d70 2024-09-13T21:45:23.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.761+0000 7fe28a59c700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe27806e7c0 0x7fe278070c70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0093a0 tx=0x7fe27c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:23.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:23.765+0000 7fe2837fe700 1 -- 172.21.15.88:0/1699919085 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe27405c6c0 con 0x7fe28c100d70 2024-09-13T21:45:24.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.041+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe28c1959f0 con 0x7fe27806e7c0 2024-09-13T21:45:24.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.042+0000 7fe2837fe700 1 -- 172.21.15.88:0/1699919085 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fe28c1959f0 con 0x7fe27806e7c0 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe27806e7c0 msgr2=0x7fe278070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe27806e7c0 0x7fe278070c70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0093a0 tx=0x7fe27c00b040 comp rx=0 tx=0).stop 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 msgr2=0x7fe28c1950c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 0x7fe28c1950c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe274005f50 tx=0x7fe27400f740 comp rx=0 tx=0).stop 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 shutdown_connections 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe27806e7c0 0x7fe278070c70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe28c100460 0x7fe28c194b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 --2- 172.21.15.88:0/1699919085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe28c100d70 0x7fe28c1950c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 >> 172.21.15.88:0/1699919085 conn(0x7fe28c0748b0 msgr2=0x7fe28c103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 shutdown_connections 2024-09-13T21:45:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.044+0000 7fe290884700 1 -- 172.21.15.88:0/1699919085 wait complete. 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.159+0000 7fb70a075700 1 -- 172.21.15.88:0/2432260628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb704104130 msgr2=0x7fb704104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.159+0000 7fb70a075700 1 --2- 172.21.15.88:0/2432260628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb704104130 0x7fb704104500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00b0a0 tx=0x7fb6fc00b3b0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.159+0000 7fb70a075700 1 -- 172.21.15.88:0/2432260628 shutdown_connections 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.159+0000 7fb70a075700 1 --2- 172.21.15.88:0/2432260628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7040ffbd0 0x7fb704100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.159+0000 7fb70a075700 1 --2- 172.21.15.88:0/2432260628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb704104130 0x7fb704104500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.159+0000 7fb70a075700 1 -- 172.21.15.88:0/2432260628 >> 172.21.15.88:0/2432260628 conn(0x7fb704075130 msgr2=0x7fb704075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.159+0000 7fb70a075700 1 -- 172.21.15.88:0/2432260628 shutdown_connections 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.159+0000 7fb70a075700 1 -- 172.21.15.88:0/2432260628 wait complete. 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.159+0000 7fb70a075700 1 Processor -- start 2024-09-13T21:45:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb70a075700 1 -- start start 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb70a075700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7040ffbd0 0x7fb704100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb70a075700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb704104130 0x7fb704101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb70a075700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7041018b0 con 0x7fb7040ffbd0 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb70a075700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7041019f0 con 0x7fb704104130 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb7037fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7040ffbd0 0x7fb704100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb7037fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7040ffbd0 0x7fb704100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35750/0 (socket says 172.21.15.88:35750) 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb7037fe700 1 -- 172.21.15.88:0/2513791350 learned_addr learned my addr 172.21.15.88:0/2513791350 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb702ffd700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb704104130 0x7fb704101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb7037fe700 1 -- 172.21.15.88:0/2513791350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb704104130 msgr2=0x7fb704101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb7037fe700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb704104130 0x7fb704101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb7037fe700 1 -- 172.21.15.88:0/2513791350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc009d00 con 0x7fb7040ffbd0 2024-09-13T21:45:24.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb702ffd700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb704104130 0x7fb704101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:45:24.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.160+0000 7fb7037fe700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7040ffbd0 0x7fb704100e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000f80 tx=0x7fb6fc00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:24.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.161+0000 7fb700ff9700 1 -- 172.21.15.88:0/2513791350 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6fc00e040 con 0x7fb7040ffbd0 2024-09-13T21:45:24.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.161+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb704101c70 con 0x7fb7040ffbd0 2024-09-13T21:45:24.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.161+0000 7fb700ff9700 1 -- 172.21.15.88:0/2513791350 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6fc003de0 con 0x7fb7040ffbd0 2024-09-13T21:45:24.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.161+0000 7fb700ff9700 1 -- 172.21.15.88:0/2513791350 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6fc01d8e0 con 0x7fb7040ffbd0 2024-09-13T21:45:24.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.161+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7041a2460 con 0x7fb7040ffbd0 2024-09-13T21:45:24.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.162+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7041086a0 con 0x7fb7040ffbd0 2024-09-13T21:45:24.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.162+0000 7fb700ff9700 1 -- 172.21.15.88:0/2513791350 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fb6fc004820 con 0x7fb7040ffbd0 2024-09-13T21:45:24.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.163+0000 7fb700ff9700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb6f006e7b0 0x7fb6f0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:24.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.163+0000 7fb700ff9700 1 -- 172.21.15.88:0/2513791350 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb6fc0900f0 con 0x7fb7040ffbd0 2024-09-13T21:45:24.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.163+0000 7fb702ffd700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb6f006e7b0 0x7fb6f0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:24.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.163+0000 7fb702ffd700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb6f006e7b0 0x7fb6f0070c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb7041025b0 tx=0x7fb6ec008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:24.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.167+0000 7fb700ff9700 1 -- 172.21.15.88:0/2513791350 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb6fc059120 con 0x7fb7040ffbd0 2024-09-13T21:45:24.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.406+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb704061190 con 0x7fb6f006e7b0 2024-09-13T21:45:24.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.417+0000 7fb700ff9700 1 -- 172.21.15.88:0/2513791350 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fb704061190 con 0x7fb6f006e7b0 2024-09-13T21:45:24.418 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:45:24.418 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (2m) 46s ago 12m 17.1M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (13m) 46s ago 13m 7922k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (11m) 33s ago 11m 7864k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (12m) 46s ago 12m 6669k - 18.2.0 dc2bc1663786 aad0f40230ae 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (11m) 33s ago 11m 6665k - 18.2.0 dc2bc1663786 f828dce7c90f 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (2m) 46s ago 12m 76.2M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (7m) 46s ago 7m 121M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (7m) 46s ago 7m 15.5M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (7m) 33s ago 7m 17.1M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (7m) 33s ago 7m 122M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (4m) 46s ago 14m 473M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (3m) 33s ago 11m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:45:24.419 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (60s) 46s ago 14m 32.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (37s) 33s ago 11m 25.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (3m) 46s ago 12m 14.9M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (3m) 33s ago 11m 17.0M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (10m) 46s ago 10m 224M 1216M 18.2.0 dc2bc1663786 85a6443a1ef9 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (10m) 46s ago 10m 241M 1216M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (10m) 46s ago 10m 196M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (9m) 33s ago 9m 272M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (9m) 33s ago 9m 255M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (8m) 33s ago 8m 229M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:45:24.420 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (2m) 46s ago 12m 65.3M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:45:24.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.419+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb6f006e7b0 msgr2=0x7fb6f0070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.419+0000 7fb70a075700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb6f006e7b0 0x7fb6f0070c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb7041025b0 tx=0x7fb6ec008040 comp rx=0 tx=0).stop 2024-09-13T21:45:24.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.420+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7040ffbd0 msgr2=0x7fb704100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.420+0000 7fb70a075700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7040ffbd0 0x7fb704100e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000f80 tx=0x7fb6fc00cdd0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.420+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 shutdown_connections 2024-09-13T21:45:24.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.420+0000 7fb70a075700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb6f006e7b0 0x7fb6f0070c60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.420+0000 7fb70a075700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7040ffbd0 0x7fb704100e30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.420+0000 7fb70a075700 1 --2- 172.21.15.88:0/2513791350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb704104130 0x7fb704101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.420+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 >> 172.21.15.88:0/2513791350 conn(0x7fb704075130 msgr2=0x7fb7040febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:24.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.420+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 shutdown_connections 2024-09-13T21:45:24.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.420+0000 7fb70a075700 1 -- 172.21.15.88:0/2513791350 wait complete. 2024-09-13T21:45:24.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.543+0000 7f36ec4e8700 1 -- 172.21.15.88:0/4278009202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 msgr2=0x7f36e4104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.543+0000 7f36ec4e8700 1 --2- 172.21.15.88:0/4278009202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 0x7f36e4104500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009910 tx=0x7f36e0009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:24.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.543+0000 7f36ec4e8700 1 -- 172.21.15.88:0/4278009202 shutdown_connections 2024-09-13T21:45:24.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.543+0000 7f36ec4e8700 1 --2- 172.21.15.88:0/4278009202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36e40ffbd0 0x7f36e4100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.543+0000 7f36ec4e8700 1 --2- 172.21.15.88:0/4278009202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 0x7f36e4104500 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.543+0000 7f36ec4e8700 1 -- 172.21.15.88:0/4278009202 >> 172.21.15.88:0/4278009202 conn(0x7f36e4075130 msgr2=0x7f36e4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.543+0000 7f36ec4e8700 1 -- 172.21.15.88:0/4278009202 shutdown_connections 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.544+0000 7f36ec4e8700 1 -- 172.21.15.88:0/4278009202 wait complete. 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.544+0000 7f36ec4e8700 1 Processor -- start 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.544+0000 7f36ec4e8700 1 -- start start 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.544+0000 7f36ec4e8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36e40ffbd0 0x7f36e4195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.544+0000 7f36ec4e8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 0x7f36e4196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.544+0000 7f36ec4e8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4196a50 con 0x7f36e4104130 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.544+0000 7f36ec4e8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e419a7e0 con 0x7f36e40ffbd0 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36e9a83700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 0x7f36e4196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36e9a83700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 0x7f36e4196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35778/0 (socket says 172.21.15.88:35778) 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36e9a83700 1 -- 172.21.15.88:0/2499050385 learned_addr learned my addr 172.21.15.88:0/2499050385 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:24.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36ea284700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36e40ffbd0 0x7f36e4195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36e9a83700 1 -- 172.21.15.88:0/2499050385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36e40ffbd0 msgr2=0x7f36e4195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36e9a83700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36e40ffbd0 0x7f36e4195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36e9a83700 1 -- 172.21.15.88:0/2499050385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00095f0 con 0x7f36e4104130 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36ea284700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36e40ffbd0 0x7f36e4195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36e9a83700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 0x7f36e4196370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d8d0 tx=0x7f36d400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36db7fe700 1 -- 172.21.15.88:0/2499050385 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36d4009940 con 0x7f36e4104130 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36db7fe700 1 -- 172.21.15.88:0/2499050385 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36d4010460 con 0x7f36e4104130 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e419aac0 con 0x7f36e4104130 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36db7fe700 1 -- 172.21.15.88:0/2499050385 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36d400f5f0 con 0x7f36e4104130 2024-09-13T21:45:24.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.545+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e419b010 con 0x7f36e4104130 2024-09-13T21:45:24.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.546+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e404f2a0 con 0x7f36e4104130 2024-09-13T21:45:24.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.547+0000 7f36db7fe700 1 -- 172.21.15.88:0/2499050385 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f36d40105d0 con 0x7f36e4104130 2024-09-13T21:45:24.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.547+0000 7f36db7fe700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36d006e7b0 0x7f36d0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:24.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.547+0000 7f36db7fe700 1 -- 172.21.15.88:0/2499050385 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f36d408e850 con 0x7f36e4104130 2024-09-13T21:45:24.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.548+0000 7f36ea284700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36d006e7b0 0x7f36d0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:24.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.548+0000 7f36ea284700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36d006e7b0 0x7f36d0070c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f36e0006010 tx=0x7f36e000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:24.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.552+0000 7f36db7fe700 1 -- 172.21.15.88:0/2499050385 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f36d4057880 con 0x7f36e4104130 2024-09-13T21:45:24.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.848+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f36e419b2d0 con 0x7f36e4104130 2024-09-13T21:45:24.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.848+0000 7f36db7fe700 1 -- 172.21.15.88:0/2499050385 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7f36d405af40 con 0x7f36e4104130 2024-09-13T21:45:24.850 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:45:24.850 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:45:24.850 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-13T21:45:24.851 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:45:24.852 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:45:24.852 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:45:24.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36d006e7b0 msgr2=0x7f36d0070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36d006e7b0 0x7f36d0070c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f36e0006010 tx=0x7f36e000b540 comp rx=0 tx=0).stop 2024-09-13T21:45:24.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 msgr2=0x7f36e4196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 0x7f36e4196370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d8d0 tx=0x7f36d400dc90 comp rx=0 tx=0).stop 2024-09-13T21:45:24.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 shutdown_connections 2024-09-13T21:45:24.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36d006e7b0 0x7f36d0070c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36e40ffbd0 0x7f36e4195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 --2- 172.21.15.88:0/2499050385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36e4104130 0x7f36e4196370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 >> 172.21.15.88:0/2499050385 conn(0x7f36e4075130 msgr2=0x7f36e40685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:24.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 shutdown_connections 2024-09-13T21:45:24.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.851+0000 7f36ec4e8700 1 -- 172.21.15.88:0/2499050385 wait complete. 2024-09-13T21:45:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.962+0000 7faefe749700 1 -- 172.21.15.88:0/2676700764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101d30 msgr2=0x7faef810a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.962+0000 7faefe749700 1 --2- 172.21.15.88:0/2676700764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101d30 0x7faef810a230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faeec009910 tx=0x7faeec009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.962+0000 7faefe749700 1 -- 172.21.15.88:0/2676700764 shutdown_connections 2024-09-13T21:45:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.962+0000 7faefe749700 1 --2- 172.21.15.88:0/2676700764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101d30 0x7faef810a230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.962+0000 7faefe749700 1 --2- 172.21.15.88:0/2676700764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faef8101420 0x7faef81017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.962+0000 7faefe749700 1 -- 172.21.15.88:0/2676700764 >> 172.21.15.88:0/2676700764 conn(0x7faef80fac60 msgr2=0x7faef80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:24.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.962+0000 7faefe749700 1 -- 172.21.15.88:0/2676700764 shutdown_connections 2024-09-13T21:45:24.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.962+0000 7faefe749700 1 -- 172.21.15.88:0/2676700764 wait complete. 2024-09-13T21:45:24.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faefe749700 1 Processor -- start 2024-09-13T21:45:24.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faefe749700 1 -- start start 2024-09-13T21:45:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faefe749700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101420 0x7faef80ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faefe749700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faef8101d30 0x7faef80ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faefe749700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef80ffb00 con 0x7faef8101420 2024-09-13T21:45:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faefe749700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef80ffc40 con 0x7faef8101d30 2024-09-13T21:45:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faef7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101420 0x7faef80ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faef7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101420 0x7faef80ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35786/0 (socket says 172.21.15.88:35786) 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faef7fff700 1 -- 172.21.15.88:0/3486304608 learned_addr learned my addr 172.21.15.88:0/3486304608 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.963+0000 7faef77fe700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faef8101d30 0x7faef80ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.964+0000 7faef7fff700 1 -- 172.21.15.88:0/3486304608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faef8101d30 msgr2=0x7faef80ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.964+0000 7faef7fff700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faef8101d30 0x7faef80ff5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.964+0000 7faef7fff700 1 -- 172.21.15.88:0/3486304608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec0095f0 con 0x7faef8101420 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.964+0000 7faef7fff700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101420 0x7faef80ff080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faee800e940 tx=0x7faee800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.964+0000 7faef57fa700 1 -- 172.21.15.88:0/3486304608 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faee800cba0 con 0x7faef8101420 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.964+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef81a2080 con 0x7faef8101420 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.964+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef81a2430 con 0x7faef8101420 2024-09-13T21:45:24.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.964+0000 7faef57fa700 1 -- 172.21.15.88:0/3486304608 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faee800ee90 con 0x7faef8101420 2024-09-13T21:45:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.965+0000 7faef57fa700 1 -- 172.21.15.88:0/3486304608 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faee80055d0 con 0x7faef8101420 2024-09-13T21:45:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.966+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee4005320 con 0x7faef8101420 2024-09-13T21:45:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.966+0000 7faef57fa700 1 -- 172.21.15.88:0/3486304608 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7faee8021440 con 0x7faef8101420 2024-09-13T21:45:24.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.967+0000 7faef57fa700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faee006e7b0 0x7faee0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.967+0000 7faef57fa700 1 -- 172.21.15.88:0/3486304608 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7faee8014070 con 0x7faef8101420 2024-09-13T21:45:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.967+0000 7faef77fe700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faee006e7b0 0x7faee0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:24.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.967+0000 7faef77fe700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faee006e7b0 0x7faee0070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faef8100820 tx=0x7faeec005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:24.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:24.971+0000 7faef57fa700 1 -- 172.21.15.88:0/3486304608 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faee8057a90 con 0x7faef8101420 2024-09-13T21:45:25.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.228+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faee4005cc0 con 0x7faef8101420 2024-09-13T21:45:25.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.228+0000 7faef57fa700 1 -- 172.21.15.88:0/3486304608 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1923 (secure 0 0 0) 0x7faee808e020 con 0x7faef8101420 2024-09-13T21:45:25.230 INFO:teuthology.orchestra.run.smithi088.stdout:e20 2024-09-13T21:45:25.230 INFO:teuthology.orchestra.run.smithi088.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:45:25.230 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:45:25.230 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:45:25.230 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:45:25.230 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 20 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:45:25.231 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:45:25.232 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:25.233 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.230+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faee006e7b0 msgr2=0x7faee0070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.230+0000 7faefe749700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faee006e7b0 0x7faee0070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faef8100820 tx=0x7faeec005a90 comp rx=0 tx=0).stop 2024-09-13T21:45:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.230+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101420 msgr2=0x7faef80ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.230+0000 7faefe749700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101420 0x7faef80ff080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faee800e940 tx=0x7faee800ec50 comp rx=0 tx=0).stop 2024-09-13T21:45:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.230+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 shutdown_connections 2024-09-13T21:45:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.230+0000 7faefe749700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faee006e7b0 0x7faee0070c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.230+0000 7faefe749700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faef8101420 0x7faef80ff080 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.230+0000 7faefe749700 1 --2- 172.21.15.88:0/3486304608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faef8101d30 0x7faef80ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.230+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 >> 172.21.15.88:0/3486304608 conn(0x7faef80fac60 msgr2=0x7faef81049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.231+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 shutdown_connections 2024-09-13T21:45:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.231+0000 7faefe749700 1 -- 172.21.15.88:0/3486304608 wait complete. 2024-09-13T21:45:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:45:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.337+0000 7f07d2255700 1 -- 172.21.15.88:0/995676456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 msgr2=0x7f07cc103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.337+0000 7f07d2255700 1 --2- 172.21.15.88:0/995676456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 0x7f07cc103c20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009910 tx=0x7f07c0009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:25.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.337+0000 7f07d2255700 1 -- 172.21.15.88:0/995676456 shutdown_connections 2024-09-13T21:45:25.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.337+0000 7f07d2255700 1 --2- 172.21.15.88:0/995676456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 0x7f07cc103c20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.337+0000 7f07d2255700 1 --2- 172.21.15.88:0/995676456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07cc0ff2b0 0x7f07cc0ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.337+0000 7f07d2255700 1 -- 172.21.15.88:0/995676456 >> 172.21.15.88:0/995676456 conn(0x7f07cc0fab50 msgr2=0x7f07cc0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:25.339 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:25 smithi088 ceph-mon[86843]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:25.339 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:25 smithi088 ceph-mon[86843]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:25.340 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:25 smithi088 ceph-mon[86843]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:25.340 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:25 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2499050385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:25.340 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:25 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:25.340 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:25 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.337+0000 7f07d2255700 1 -- 172.21.15.88:0/995676456 shutdown_connections 2024-09-13T21:45:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.337+0000 7f07d2255700 1 -- 172.21.15.88:0/995676456 wait complete. 2024-09-13T21:45:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.337+0000 7f07d2255700 1 Processor -- start 2024-09-13T21:45:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07d2255700 1 -- start start 2024-09-13T21:45:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07d2255700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07cc0ff2b0 0x7f07cc196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07d2255700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 0x7f07cc197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07d2255700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc1976e0 con 0x7f07cc0ffc50 2024-09-13T21:45:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07d2255700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc197820 con 0x7f07cc0ff2b0 2024-09-13T21:45:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07caffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 0x7f07cc197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07caffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 0x7f07cc197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35812/0 (socket says 172.21.15.88:35812) 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07caffd700 1 -- 172.21.15.88:0/3925494238 learned_addr learned my addr 172.21.15.88:0/3925494238 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07cb7fe700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07cc0ff2b0 0x7f07cc196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07caffd700 1 -- 172.21.15.88:0/3925494238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07cc0ff2b0 msgr2=0x7f07cc196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07caffd700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07cc0ff2b0 0x7f07cc196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07caffd700 1 -- 172.21.15.88:0/3925494238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00095f0 con 0x7f07cc0ffc50 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.338+0000 7f07caffd700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 0x7f07cc197110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f07c000bd70 tx=0x7f07c000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.339+0000 7f07c8ff9700 1 -- 172.21.15.88:0/3925494238 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c001d070 con 0x7f07cc0ffc50 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.339+0000 7f07c8ff9700 1 -- 172.21.15.88:0/3925494238 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07c0005dc0 con 0x7f07cc0ffc50 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.339+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07cc19fc40 con 0x7f07cc0ffc50 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.339+0000 7f07c8ff9700 1 -- 172.21.15.88:0/3925494238 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c0017400 con 0x7f07cc0ffc50 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.339+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc19fff0 con 0x7f07cc0ffc50 2024-09-13T21:45:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.340+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07cc04f2a0 con 0x7f07cc0ffc50 2024-09-13T21:45:25.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.340+0000 7f07c8ff9700 1 -- 172.21.15.88:0/3925494238 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f07c000f460 con 0x7f07cc0ffc50 2024-09-13T21:45:25.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.341+0000 7f07c8ff9700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07b406e7b0 0x7f07b4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:25.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.341+0000 7f07c8ff9700 1 -- 172.21.15.88:0/3925494238 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f07c008fbb0 con 0x7f07cc0ffc50 2024-09-13T21:45:25.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.341+0000 7f07cb7fe700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07b406e7b0 0x7f07b4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:25.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.341+0000 7f07cb7fe700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07b406e7b0 0x7f07b4070c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f07bc005950 tx=0x7f07bc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:25.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.345+0000 7f07c8ff9700 1 -- 172.21.15.88:0/3925494238 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f07c0096080 con 0x7f07cc0ffc50 2024-09-13T21:45:25.479 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:25 smithi116 ceph-mon[65231]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:25.479 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:25 smithi116 ceph-mon[65231]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:25.479 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:25 smithi116 ceph-mon[65231]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:25.479 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:25 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2499050385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:25.480 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:25 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:25.480 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:25 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:25.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.568+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07cc0fce60 con 0x7f07b406e7b0 2024-09-13T21:45:25.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.569+0000 7f07c8ff9700 1 -- 172.21.15.88:0/3925494238 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f07cc0fce60 con 0x7f07b406e7b0 2024-09-13T21:45:25.570 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:45:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "4/23 daemons upgraded", 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading crash daemons", 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:45:25.571 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07b406e7b0 msgr2=0x7f07b4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07b406e7b0 0x7f07b4070c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f07bc005950 tx=0x7f07bc00b410 comp rx=0 tx=0).stop 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 msgr2=0x7f07cc197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 0x7f07cc197110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f07c000bd70 tx=0x7f07c000bda0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 shutdown_connections 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07b406e7b0 0x7f07b4070c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07cc0ff2b0 0x7f07cc196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 --2- 172.21.15.88:0/3925494238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07cc0ffc50 0x7f07cc197110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 >> 172.21.15.88:0/3925494238 conn(0x7f07cc0fab50 msgr2=0x7f07cc0fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 shutdown_connections 2024-09-13T21:45:25.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.571+0000 7f07d2255700 1 -- 172.21.15.88:0/3925494238 wait complete. 2024-09-13T21:45:25.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.674+0000 7f3efe1d6700 1 -- 172.21.15.88:0/2346403759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 msgr2=0x7f3ef8104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.674+0000 7f3efe1d6700 1 --2- 172.21.15.88:0/2346403759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 0x7f3ef8104e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009910 tx=0x7f3eec009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:25.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.674+0000 7f3efe1d6700 1 -- 172.21.15.88:0/2346403759 shutdown_connections 2024-09-13T21:45:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.674+0000 7f3efe1d6700 1 --2- 172.21.15.88:0/2346403759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 0x7f3ef8104e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.674+0000 7f3efe1d6700 1 --2- 172.21.15.88:0/2346403759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ef81004e0 0x7f3ef81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.674+0000 7f3efe1d6700 1 -- 172.21.15.88:0/2346403759 >> 172.21.15.88:0/2346403759 conn(0x7f3ef80fbda0 msgr2=0x7f3ef80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.674+0000 7f3efe1d6700 1 -- 172.21.15.88:0/2346403759 shutdown_connections 2024-09-13T21:45:25.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.674+0000 7f3efe1d6700 1 -- 172.21.15.88:0/2346403759 wait complete. 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3efe1d6700 1 Processor -- start 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3efe1d6700 1 -- start start 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3efe1d6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ef81004e0 0x7f3ef8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3efe1d6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 0x7f3ef8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3efe1d6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8073ad0 con 0x7f3ef8100e80 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3efe1d6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8073c10 con 0x7f3ef81004e0 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3ef6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 0x7f3ef8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3ef6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 0x7f3ef8073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35838/0 (socket says 172.21.15.88:35838) 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3ef6ffd700 1 -- 172.21.15.88:0/3881837516 learned_addr learned my addr 172.21.15.88:0/3881837516 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.675+0000 7f3ef77fe700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ef81004e0 0x7f3ef8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.676+0000 7f3ef6ffd700 1 -- 172.21.15.88:0/3881837516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ef81004e0 msgr2=0x7f3ef8073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.676+0000 7f3ef6ffd700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ef81004e0 0x7f3ef8073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.676+0000 7f3ef6ffd700 1 -- 172.21.15.88:0/3881837516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0095f0 con 0x7f3ef8100e80 2024-09-13T21:45:25.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.676+0000 7f3ef6ffd700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 0x7f3ef8073590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00bda0 tx=0x7f3eec00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.676+0000 7f3ef4ff9700 1 -- 172.21.15.88:0/3881837516 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eec01d070 con 0x7f3ef8100e80 2024-09-13T21:45:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.676+0000 7f3ef4ff9700 1 -- 172.21.15.88:0/3881837516 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3eec00f460 con 0x7f3ef8100e80 2024-09-13T21:45:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.676+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef8073e90 con 0x7f3ef8100e80 2024-09-13T21:45:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.676+0000 7f3ef4ff9700 1 -- 172.21.15.88:0/3881837516 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eec017630 con 0x7f3ef8100e80 2024-09-13T21:45:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.676+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef81a23c0 con 0x7f3ef8100e80 2024-09-13T21:45:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.677+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef8108850 con 0x7f3ef8100e80 2024-09-13T21:45:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.678+0000 7f3ef4ff9700 1 -- 172.21.15.88:0/3881837516 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3eec00fab0 con 0x7f3ef8100e80 2024-09-13T21:45:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.678+0000 7f3ef4ff9700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ee006e7b0 0x7f3ee0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.678+0000 7f3ef4ff9700 1 -- 172.21.15.88:0/3881837516 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3eec08fcc0 con 0x7f3ef8100e80 2024-09-13T21:45:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.679+0000 7f3ef77fe700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ee006e7b0 0x7f3ee0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.679+0000 7f3ef77fe700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ee006e7b0 0x7f3ee0070c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800f440 tx=0x7f3ee80079e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.683+0000 7f3ef4ff9700 1 -- 172.21.15.88:0/3881837516 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3eec058d70 con 0x7f3ef8100e80 2024-09-13T21:45:25.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.966+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3ef80745b0 con 0x7f3ef8100e80 2024-09-13T21:45:25.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.967+0000 7f3ef4ff9700 1 -- 172.21.15.88:0/3881837516 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f3eec05c430 con 0x7f3ef8100e80 2024-09-13T21:45:25.969 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:45:25.969 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:45:25.969 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:45:25.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ee006e7b0 msgr2=0x7f3ee0070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ee006e7b0 0x7f3ee0070c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800f440 tx=0x7f3ee80079e0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 msgr2=0x7f3ef8073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 0x7f3ef8073590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00bda0 tx=0x7f3eec00bdd0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 shutdown_connections 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ee006e7b0 0x7f3ee0070c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ef81004e0 0x7f3ef8073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 --2- 172.21.15.88:0/3881837516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef8100e80 0x7f3ef8073590 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 >> 172.21.15.88:0/3881837516 conn(0x7f3ef80fbda0 msgr2=0x7f3ef80fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 shutdown_connections 2024-09-13T21:45:25.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:25.969+0000 7f3efe1d6700 1 -- 172.21.15.88:0/3881837516 wait complete. 2024-09-13T21:45:26.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:26 smithi088 ceph-mon[86843]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:26.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:26 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3486304608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:45:26.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:26 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3881837516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:45:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:26 smithi116 ceph-mon[65231]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:26 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3486304608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:45:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:26 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3881837516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:45:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:27 smithi116 ceph-mon[65231]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:27 smithi116 ceph-mon[65231]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:27 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:27 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi116", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:45:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:27 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:27.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:27 smithi088 ceph-mon[86843]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:27.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:27 smithi088 ceph-mon[86843]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:27.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:27 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:27.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:27 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi116", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:45:27.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:27 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:28.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:28 smithi116 ceph-mon[65231]: Upgrade: Updating crash.smithi116 (2/2) 2024-09-13T21:45:28.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:28 smithi116 ceph-mon[65231]: Deploying daemon crash.smithi116 on smithi116 2024-09-13T21:45:28.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:28 smithi088 ceph-mon[86843]: Upgrade: Updating crash.smithi116 (2/2) 2024-09-13T21:45:28.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:28 smithi088 ceph-mon[86843]: Deploying daemon crash.smithi116 on smithi116 2024-09-13T21:45:29.267 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:29 smithi116 ceph-mon[65231]: pgmap v31: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:29.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:29 smithi088 ceph-mon[86843]: pgmap v31: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:31.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:31.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:31.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:31.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:30 smithi088 ceph-mon[86843]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:31.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:31.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:31.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:31.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:30 smithi116 ceph-mon[65231]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:32.365 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:32.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:33.461 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:33 smithi088 ceph-mon[86843]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:33.461 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:33.461 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:33 smithi116 ceph-mon[65231]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:34.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:34 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:34.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:34 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:34.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:34 smithi116 ceph-mon[65231]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:34.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:34 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:34.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:34 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:34.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:34 smithi088 ceph-mon[86843]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:36.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:35 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:36.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:35 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:36.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:35 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:36.008 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:35 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:36.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:35 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:36.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:35 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:36.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:35 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:36.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:35 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:36.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:36 smithi088 ceph-mon[86843]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:37.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:36 smithi116 ceph-mon[65231]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:38.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:38.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:38.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:38.123 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:39.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:39.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]: dispatch 2024-09-13T21:45:39.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]': finished 2024-09-13T21:45:39.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi116"}]: dispatch 2024-09-13T21:45:39.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi116"}]': finished 2024-09-13T21:45:39.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T21:45:39.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:39.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:39.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:39.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:39.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:45:39.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:39.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:39.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:39.133 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:39.134 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:39.134 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:39.134 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]: dispatch 2024-09-13T21:45:39.134 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi088"}]': finished 2024-09-13T21:45:39.134 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi116"}]: dispatch 2024-09-13T21:45:39.134 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi116"}]': finished 2024-09-13T21:45:39.134 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T21:45:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:39 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all crash 2024-09-13T21:45:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:39 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T21:45:40.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:39 smithi116 ceph-mon[65231]: Upgrade: osd.0 is safe to restart 2024-09-13T21:45:40.118 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:39 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all crash 2024-09-13T21:45:40.118 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:39 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T21:45:40.118 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:39 smithi088 ceph-mon[86843]: Upgrade: osd.0 is safe to restart 2024-09-13T21:45:41.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:40 smithi088 ceph-mon[86843]: Upgrade: Updating osd.0 2024-09-13T21:45:41.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:40 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:41.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:40 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:45:41.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:40 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:41.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:40 smithi088 ceph-mon[86843]: Deploying daemon osd.0 on smithi088 2024-09-13T21:45:41.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:40 smithi088 ceph-mon[86843]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:41.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:40 smithi116 ceph-mon[65231]: Upgrade: Updating osd.0 2024-09-13T21:45:41.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:40 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:41.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:40 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:45:41.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:40 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:41.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:40 smithi116 ceph-mon[65231]: Deploying daemon osd.0 on smithi088 2024-09-13T21:45:41.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:40 smithi116 ceph-mon[65231]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:43.085 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:42 smithi088 systemd[1]: Stopping Ceph osd.0 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:45:43.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:43 smithi088 ceph-mon[86843]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:43.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:43 smithi088 ceph-mon[86843]: osd.0 marked itself down and dead 2024-09-13T21:45:43.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:43 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[42819]: 2024-09-13T21:45:43.083+0000 7fe37cb4c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:45:43.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:43 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[42819]: 2024-09-13T21:45:43.083+0000 7fe37cb4c700 -1 osd.0 50 *** Got signal Terminated *** 2024-09-13T21:45:43.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:43 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[42819]: 2024-09-13T21:45:43.083+0000 7fe37cb4c700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:45:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:43 smithi116 ceph-mon[65231]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:43 smithi116 ceph-mon[65231]: osd.0 marked itself down and dead 2024-09-13T21:45:43.982 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:43 smithi088 podman[98031]: 2024-09-13 21:45:43.696493229 +0000 UTC m=+0.720071771 container died 85a6443a1ef9b9dec68534a22b089b91e2003c32007a6931e668f977ed8e8232 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T21:45:44.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:44 smithi088 ceph-mon[86843]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:45:44.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:44 smithi088 ceph-mon[86843]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T21:45:44.361 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:44 smithi088 podman[98031]: 2024-09-13 21:45:44.09139535 +0000 UTC m=+1.114973894 container cleanup 85a6443a1ef9b9dec68534a22b089b91e2003c32007a6931e668f977ed8e8232 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-13T21:45:44.361 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:44 smithi088 bash[98031]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0 2024-09-13T21:45:44.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:44 smithi116 ceph-mon[65231]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:45:44.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:44 smithi116 ceph-mon[65231]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T21:45:44.718 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:44 smithi088 podman[98045]: 2024-09-13 21:45:44.359754959 +0000 UTC m=+0.661036950 container remove 85a6443a1ef9b9dec68534a22b089b91e2003c32007a6931e668f977ed8e8232 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T21:45:44.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:44 smithi088 podman[98137]: 2024-09-13 21:45:44.620627381 +0000 UTC m=+0.015937129 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:45:44.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:44 smithi088 podman[98137]: 2024-09-13 21:45:44.759333044 +0000 UTC m=+0.154642821 container create fb5b17c934e08d206f4ac25c9b4c32e2ae21af51beb72b56a3964b77cd0f7bfd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:45:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:45 smithi088 ceph-mon[86843]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:45.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:45 smithi088 ceph-mon[86843]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T21:45:45.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:44 smithi088 podman[98137]: 2024-09-13 21:45:44.988318475 +0000 UTC m=+0.383628209 container init fb5b17c934e08d206f4ac25c9b4c32e2ae21af51beb72b56a3964b77cd0f7bfd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be) 2024-09-13T21:45:45.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:44 smithi088 podman[98137]: 2024-09-13 21:45:44.991772152 +0000 UTC m=+0.387081898 container start fb5b17c934e08d206f4ac25c9b4c32e2ae21af51beb72b56a3964b77cd0f7bfd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T21:45:45.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:45 smithi088 podman[98137]: 2024-09-13 21:45:45.10506763 +0000 UTC m=+0.500377366 container attach fb5b17c934e08d206f4ac25c9b4c32e2ae21af51beb72b56a3964b77cd0f7bfd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T21:45:45.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:45 smithi088 podman[98137]: 2024-09-13 21:45:45.186333364 +0000 UTC m=+0.581643113 container died fb5b17c934e08d206f4ac25c9b4c32e2ae21af51beb72b56a3964b77cd0f7bfd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T21:45:45.497 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:45 smithi116 ceph-mon[65231]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:45.497 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:45 smithi116 ceph-mon[65231]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T21:45:46.233 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:45 smithi088 podman[98160]: 2024-09-13 21:45:45.808984227 +0000 UTC m=+0.615262568 container remove fb5b17c934e08d206f4ac25c9b4c32e2ae21af51beb72b56a3964b77cd0f7bfd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T21:45:46.233 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:45 smithi088 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T21:45:46.233 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:45 smithi088 systemd[1]: Stopped Ceph osd.0 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:45:46.233 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:45 smithi088 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.0.service: Consumed 56.090s CPU time. 2024-09-13T21:45:46.233 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 systemd[1]: Starting Ceph osd.0 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:45:46.564 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 podman[98259]: 2024-09-13 21:45:46.159632185 +0000 UTC m=+0.016551251 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:45:46.564 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 podman[98259]: 2024-09-13 21:45:46.309765156 +0000 UTC m=+0.166684215 container create b8830240aa17f11a49046a7d2ec61f0b5137801a2a93207ba5a20cfe5f64dcef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T21:45:46.564 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 podman[98259]: 2024-09-13 21:45:46.563471137 +0000 UTC m=+0.420390204 container init b8830240aa17f11a49046a7d2ec61f0b5137801a2a93207ba5a20cfe5f64dcef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T21:45:46.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 podman[98259]: 2024-09-13 21:45:46.567298064 +0000 UTC m=+0.424217132 container start b8830240aa17f11a49046a7d2ec61f0b5137801a2a93207ba5a20cfe5f64dcef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux ) 2024-09-13T21:45:46.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 podman[98259]: 2024-09-13 21:45:46.662796367 +0000 UTC m=+0.519715435 container attach b8830240aa17f11a49046a7d2ec61f0b5137801a2a93207ba5a20cfe5f64dcef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_CLEAN=True) 2024-09-13T21:45:46.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate[98273]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:45:46.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 bash[98259]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:45:46.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate[98273]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:45:46.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:46 smithi088 bash[98259]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:45:47.436 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-mon[86843]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:47.436 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:47.436 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:47 smithi116 ceph-mon[65231]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:45:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:47.719 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate[98273]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T21:45:47.719 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 bash[98259]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T21:45:47.719 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate[98273]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T21:45:47.719 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 bash[98259]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T21:45:47.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate[98273]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T21:45:47.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 bash[98259]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T21:45:47.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate[98273]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T21:45:47.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 bash[98259]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T21:45:47.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate[98273]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T21:45:47.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 bash[98259]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T21:45:47.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate[98273]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T21:45:47.984 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 bash[98259]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T21:45:47.984 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate[98273]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T21:45:47.984 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 bash[98259]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T21:45:47.984 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:47 smithi088 podman[98259]: 2024-09-13 21:45:47.746324681 +0000 UTC m=+1.603243740 container died b8830240aa17f11a49046a7d2ec61f0b5137801a2a93207ba5a20cfe5f64dcef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux ) 2024-09-13T21:45:48.401 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:48 smithi088 ceph-mon[86843]: Health check failed: Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T21:45:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:48 smithi116 ceph-mon[65231]: Health check failed: Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T21:45:48.733 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:48 smithi088 podman[98424]: 2024-09-13 21:45:48.400262283 +0000 UTC m=+0.647445599 container remove b8830240aa17f11a49046a7d2ec61f0b5137801a2a93207ba5a20cfe5f64dcef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:45:48.733 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:48 smithi088 podman[98486]: 2024-09-13 21:45:48.508729941 +0000 UTC m=+0.015896156 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:45:48.733 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:48 smithi088 podman[98486]: 2024-09-13 21:45:48.634635838 +0000 UTC m=+0.141802049 container create 4c58e1e6303866f38ba3af84f91ad010e3efc2c2f2926edbfda3d69b629b319b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T21:45:49.214 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:48 smithi088 podman[98486]: 2024-09-13 21:45:48.828568154 +0000 UTC m=+0.335734365 container init 4c58e1e6303866f38ba3af84f91ad010e3efc2c2f2926edbfda3d69b629b319b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-ecab7be, GIT_CLEAN=True) 2024-09-13T21:45:49.214 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:48 smithi088 podman[98486]: 2024-09-13 21:45:48.831760242 +0000 UTC m=+0.338926454 container start 4c58e1e6303866f38ba3af84f91ad010e3efc2c2f2926edbfda3d69b629b319b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:45:49.214 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:48 smithi088 ceph-osd[98505]: -- 172.21.15.88:0/1750193477 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c1604ea1e0 con 0x55c15f697c00 2024-09-13T21:45:49.214 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:48 smithi088 bash[98486]: 4c58e1e6303866f38ba3af84f91ad010e3efc2c2f2926edbfda3d69b629b319b 2024-09-13T21:45:49.215 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:48 smithi088 systemd[1]: Started Ceph osd.0 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:45:49.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:49 smithi088 ceph-mon[86843]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:49 smithi116 ceph-mon[65231]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:49.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:49.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:50.983 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:50 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[98501]: 2024-09-13T21:45:50.740+0000 7f3697a87640 -1 Falling back to public interface 2024-09-13T21:45:51.340 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:51 smithi088 ceph-mon[86843]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:51 smithi116 ceph-mon[65231]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:53.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:53 smithi088 ceph-mon[86843]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:53 smithi116 ceph-mon[65231]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:55.180 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:55.181 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:55.181 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:54 smithi088 ceph-mon[86843]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:55.181 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:55.181 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:55.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:55.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:55.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:54 smithi116 ceph-mon[65231]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:55.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:55.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:56.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.094+0000 7f8881202700 1 -- 172.21.15.88:0/2961353348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c0739a0 msgr2=0x7f887c10c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.094+0000 7f8881202700 1 --2- 172.21.15.88:0/2961353348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c0739a0 0x7f887c10c430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8870009940 tx=0x7f8870009c50 comp rx=0 tx=0).stop 2024-09-13T21:45:56.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.094+0000 7f8881202700 1 -- 172.21.15.88:0/2961353348 shutdown_connections 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.094+0000 7f8881202700 1 --2- 172.21.15.88:0/2961353348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c0739a0 0x7f887c10c430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.094+0000 7f8881202700 1 --2- 172.21.15.88:0/2961353348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f887c073090 0x7f887c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.094+0000 7f8881202700 1 -- 172.21.15.88:0/2961353348 >> 172.21.15.88:0/2961353348 conn(0x7f887c0fbbd0 msgr2=0x7f887c0fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.094+0000 7f8881202700 1 -- 172.21.15.88:0/2961353348 shutdown_connections 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.094+0000 7f8881202700 1 -- 172.21.15.88:0/2961353348 wait complete. 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.095+0000 7f8881202700 1 Processor -- start 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.095+0000 7f8881202700 1 -- start start 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.095+0000 7f8881202700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c073090 0x7f887c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.095+0000 7f8881202700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f887c0739a0 0x7f887c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:56.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.095+0000 7f8881202700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c198b50 con 0x7f887c073090 2024-09-13T21:45:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.095+0000 7f8881202700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c19c8e0 con 0x7f887c0739a0 2024-09-13T21:45:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f887ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c073090 0x7f887c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f887ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c073090 0x7f887c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47822/0 (socket says 172.21.15.88:47822) 2024-09-13T21:45:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f887ad9d700 1 -- 172.21.15.88:0/2823512638 learned_addr learned my addr 172.21.15.88:0/2823512638 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f887a59c700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f887c0739a0 0x7f887c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f887ad9d700 1 -- 172.21.15.88:0/2823512638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f887c0739a0 msgr2=0x7f887c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f887ad9d700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f887c0739a0 0x7f887c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f887ad9d700 1 -- 172.21.15.88:0/2823512638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700095f0 con 0x7f887c073090 2024-09-13T21:45:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f887ad9d700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c073090 0x7f887c197f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f886c00b4b0 tx=0x7f886c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:56.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f887a59c700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f887c0739a0 0x7f887c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:45:56.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f8863fff700 1 -- 172.21.15.88:0/2823512638 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f886c011800 con 0x7f887c073090 2024-09-13T21:45:56.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f8863fff700 1 -- 172.21.15.88:0/2823512638 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f886c011e20 con 0x7f887c073090 2024-09-13T21:45:56.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c19cbc0 con 0x7f887c073090 2024-09-13T21:45:56.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f8863fff700 1 -- 172.21.15.88:0/2823512638 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f886c00f2e0 con 0x7f887c073090 2024-09-13T21:45:56.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.096+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c19d110 con 0x7f887c073090 2024-09-13T21:45:56.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.097+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c109b30 con 0x7f887c073090 2024-09-13T21:45:56.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.098+0000 7f8863fff700 1 -- 172.21.15.88:0/2823512638 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f886c010380 con 0x7f887c073090 2024-09-13T21:45:56.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.099+0000 7f8863fff700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f886406e7c0 0x7f8864070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:56.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.099+0000 7f8863fff700 1 -- 172.21.15.88:0/2823512638 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f886c08e620 con 0x7f887c073090 2024-09-13T21:45:56.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.099+0000 7f887a59c700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f886406e7c0 0x7f8864070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:56.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.099+0000 7f887a59c700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f886406e7c0 0x7f8864070c70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f887c199550 tx=0x7f8870005c00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:56.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.107+0000 7f8863fff700 1 -- 172.21.15.88:0/2823512638 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f886c057880 con 0x7f887c073090 2024-09-13T21:45:56.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.348+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f887c19d3e0 con 0x7f886406e7c0 2024-09-13T21:45:56.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.349+0000 7f8863fff700 1 -- 172.21.15.88:0/2823512638 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f887c19d3e0 con 0x7f886406e7c0 2024-09-13T21:45:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.352+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f886406e7c0 msgr2=0x7f8864070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.352+0000 7f8881202700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f886406e7c0 0x7f8864070c70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f887c199550 tx=0x7f8870005c00 comp rx=0 tx=0).stop 2024-09-13T21:45:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.352+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c073090 msgr2=0x7f887c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.352+0000 7f8881202700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c073090 0x7f887c197f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f886c00b4b0 tx=0x7f886c00b870 comp rx=0 tx=0).stop 2024-09-13T21:45:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.353+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 shutdown_connections 2024-09-13T21:45:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.353+0000 7f8881202700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f886406e7c0 0x7f8864070c70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.353+0000 7f8881202700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f887c073090 0x7f887c197f30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.353+0000 7f8881202700 1 --2- 172.21.15.88:0/2823512638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f887c0739a0 0x7f887c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.353+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 >> 172.21.15.88:0/2823512638 conn(0x7f887c0fbbd0 msgr2=0x7f887c106c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:56.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.353+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 shutdown_connections 2024-09-13T21:45:56.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.353+0000 7f8881202700 1 -- 172.21.15.88:0/2823512638 wait complete. 2024-09-13T21:45:56.365 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:45:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.480+0000 7f1e93112700 1 -- 172.21.15.88:0/2560911365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c104130 msgr2=0x7f1e8c104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.480+0000 7f1e93112700 1 --2- 172.21.15.88:0/2560911365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c104130 0x7f1e8c104500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009910 tx=0x7f1e80009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.480+0000 7f1e93112700 1 -- 172.21.15.88:0/2560911365 shutdown_connections 2024-09-13T21:45:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.480+0000 7f1e93112700 1 --2- 172.21.15.88:0/2560911365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e8c0ffbd0 0x7f1e8c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.480+0000 7f1e93112700 1 --2- 172.21.15.88:0/2560911365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c104130 0x7f1e8c104500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.480+0000 7f1e93112700 1 -- 172.21.15.88:0/2560911365 >> 172.21.15.88:0/2560911365 conn(0x7f1e8c075130 msgr2=0x7f1e8c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.480+0000 7f1e93112700 1 -- 172.21.15.88:0/2560911365 shutdown_connections 2024-09-13T21:45:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.480+0000 7f1e93112700 1 -- 172.21.15.88:0/2560911365 wait complete. 2024-09-13T21:45:56.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.481+0000 7f1e93112700 1 Processor -- start 2024-09-13T21:45:56.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.481+0000 7f1e93112700 1 -- start start 2024-09-13T21:45:56.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.481+0000 7f1e93112700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c0ffbd0 0x7f1e8c196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:56.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.481+0000 7f1e93112700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e8c104130 0x7f1e8c1971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:56.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.481+0000 7f1e93112700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c1977f0 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.481+0000 7f1e93112700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c197960 con 0x7f1e8c104130 2024-09-13T21:45:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.481+0000 7f1e90eae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c0ffbd0 0x7f1e8c196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.481+0000 7f1e90eae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c0ffbd0 0x7f1e8c196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47836/0 (socket says 172.21.15.88:47836) 2024-09-13T21:45:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.481+0000 7f1e90eae700 1 -- 172.21.15.88:0/1090264818 learned_addr learned my addr 172.21.15.88:0/1090264818 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e8bfff700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e8c104130 0x7f1e8c1971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e90eae700 1 -- 172.21.15.88:0/1090264818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e8c104130 msgr2=0x7f1e8c1971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e90eae700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e8c104130 0x7f1e8c1971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e90eae700 1 -- 172.21.15.88:0/1090264818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800095f0 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e90eae700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c0ffbd0 0x7f1e8c196c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000b7d0 tx=0x7f1e8000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:56.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e89ffb700 1 -- 172.21.15.88:0/1090264818 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8001d070 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c19fd00 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e89ffb700 1 -- 172.21.15.88:0/1090264818 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e800052a0 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e89ffb700 1 -- 172.21.15.88:0/1090264818 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e80022470 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.482+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c1a0170 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.484+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c1076a0 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.484+0000 7f1e89ffb700 1 -- 172.21.15.88:0/1090264818 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f1e8000f850 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.485+0000 7f1e89ffb700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1e7c06e7c0 0x7f1e7c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.485+0000 7f1e89ffb700 1 -- 172.21.15.88:0/1090264818 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1e8008fcd0 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.485+0000 7f1e8bfff700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1e7c06e7c0 0x7f1e7c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.486+0000 7f1e8bfff700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1e7c06e7c0 0x7f1e7c070c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c068e10 tx=0x7f1e78009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:56.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.490+0000 7f1e89ffb700 1 -- 172.21.15.88:0/1090264818 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1e80058d00 con 0x7f1e8c0ffbd0 2024-09-13T21:45:56.521 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:56 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[98501]: 2024-09-13T21:45:56.288+0000 7f3697a87640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-13T21:45:56.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.729+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e8c061190 con 0x7f1e7c06e7c0 2024-09-13T21:45:56.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.731+0000 7f1e89ffb700 1 -- 172.21.15.88:0/1090264818 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1e8c061190 con 0x7f1e7c06e7c0 2024-09-13T21:45:56.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1e7c06e7c0 msgr2=0x7f1e7c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1e7c06e7c0 0x7f1e7c070c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c068e10 tx=0x7f1e78009260 comp rx=0 tx=0).stop 2024-09-13T21:45:56.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c0ffbd0 msgr2=0x7f1e8c196c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c0ffbd0 0x7f1e8c196c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000b7d0 tx=0x7f1e8000bf90 comp rx=0 tx=0).stop 2024-09-13T21:45:56.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 shutdown_connections 2024-09-13T21:45:56.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1e7c06e7c0 0x7f1e7c070c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e8c0ffbd0 0x7f1e8c196c90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 --2- 172.21.15.88:0/1090264818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e8c104130 0x7f1e8c1971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 >> 172.21.15.88:0/1090264818 conn(0x7f1e8c075130 msgr2=0x7f1e8c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:56.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 shutdown_connections 2024-09-13T21:45:56.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.733+0000 7f1e93112700 1 -- 172.21.15.88:0/1090264818 wait complete. 2024-09-13T21:45:56.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.841+0000 7faa78ef7700 1 -- 172.21.15.88:0/1600898499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 msgr2=0x7faa741008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.841+0000 7faa78ef7700 1 --2- 172.21.15.88:0/1600898499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 0x7faa741008b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa64009910 tx=0x7faa64009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:56.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.842+0000 7faa78ef7700 1 -- 172.21.15.88:0/1600898499 shutdown_connections 2024-09-13T21:45:56.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.842+0000 7faa78ef7700 1 --2- 172.21.15.88:0/1600898499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa74100e80 0x7faa74104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.842+0000 7faa78ef7700 1 --2- 172.21.15.88:0/1600898499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 0x7faa741008b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.842+0000 7faa78ef7700 1 -- 172.21.15.88:0/1600898499 >> 172.21.15.88:0/1600898499 conn(0x7faa740fbda0 msgr2=0x7faa740fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:56.844 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:56 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[98501]: 2024-09-13T21:45:56.695+0000 7f3697a87640 -1 osd.0 50 log_to_monitors true 2024-09-13T21:45:56.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.842+0000 7faa78ef7700 1 -- 172.21.15.88:0/1600898499 shutdown_connections 2024-09-13T21:45:56.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.842+0000 7faa78ef7700 1 -- 172.21.15.88:0/1600898499 wait complete. 2024-09-13T21:45:56.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa78ef7700 1 Processor -- start 2024-09-13T21:45:56.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa78ef7700 1 -- start start 2024-09-13T21:45:56.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa78ef7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 0x7faa741980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:56.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa78ef7700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa74100e80 0x7faa74198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:56.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa78ef7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa74198d10 con 0x7faa741004e0 2024-09-13T21:45:56.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa78ef7700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7419caa0 con 0x7faa74100e80 2024-09-13T21:45:56.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa7259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 0x7faa741980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa7259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 0x7faa741980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47850/0 (socket says 172.21.15.88:47850) 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa7259c700 1 -- 172.21.15.88:0/822131386 learned_addr learned my addr 172.21.15.88:0/822131386 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa71d9b700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa74100e80 0x7faa74198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa7259c700 1 -- 172.21.15.88:0/822131386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa74100e80 msgr2=0x7faa74198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa7259c700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa74100e80 0x7faa74198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.843+0000 7faa7259c700 1 -- 172.21.15.88:0/822131386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640095f0 con 0x7faa741004e0 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.844+0000 7faa7259c700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 0x7faa741980f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa64005f50 tx=0x7faa6400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.844+0000 7faa637fe700 1 -- 172.21.15.88:0/822131386 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa6401d070 con 0x7faa741004e0 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.844+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7419cd20 con 0x7faa741004e0 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.844+0000 7faa637fe700 1 -- 172.21.15.88:0/822131386 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa6400b610 con 0x7faa741004e0 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.844+0000 7faa637fe700 1 -- 172.21.15.88:0/822131386 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa64022470 con 0x7faa741004e0 2024-09-13T21:45:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.844+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7419d210 con 0x7faa741004e0 2024-09-13T21:45:56.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.845+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa741045d0 con 0x7faa741004e0 2024-09-13T21:45:56.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.846+0000 7faa637fe700 1 -- 172.21.15.88:0/822131386 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7faa64003780 con 0x7faa741004e0 2024-09-13T21:45:56.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.847+0000 7faa637fe700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faa5c06e7c0 0x7faa5c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:56.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.847+0000 7faa637fe700 1 -- 172.21.15.88:0/822131386 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7faa6408fd80 con 0x7faa741004e0 2024-09-13T21:45:56.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.847+0000 7faa71d9b700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faa5c06e7c0 0x7faa5c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:56.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.847+0000 7faa71d9b700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faa5c06e7c0 0x7faa5c070c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa74199710 tx=0x7faa68009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:56.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:56.851+0000 7faa637fe700 1 -- 172.21.15.88:0/822131386 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faa64058f90 con 0x7faa741004e0 2024-09-13T21:45:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.071+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa7419d540 con 0x7faa5c06e7c0 2024-09-13T21:45:57.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.081+0000 7faa637fe700 1 -- 172.21.15.88:0/822131386 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7faa7419d540 con 0x7faa5c06e7c0 2024-09-13T21:45:57.082 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (3m) 3s ago 13m 25.3M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (13m) 3s ago 13m 8028k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (12m) 24s ago 12m 7918k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (32s) 3s ago 13m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (27s) 24s ago 12m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (2m) 3s ago 13m 77.2M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (7m) 3s ago 7m 119M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (7m) 3s ago 7m 16.1M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (7m) 24s ago 7m 17.3M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (7m) 24s ago 7m 122M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (4m) 3s ago 14m 495M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:45:57.083 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (3m) 24s ago 12m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (93s) 3s ago 14m 45.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (70s) 24s ago 12m 34.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (3m) 3s ago 13m 15.2M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (3m) 24s ago 12m 17.2M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (8s) 3s ago 11m 11.4M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (11m) 3s ago 11m 242M 1216M 18.2.0 dc2bc1663786 df5428327f18 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (10m) 3s ago 10m 197M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (10m) 24s ago 10m 272M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (9m) 24s ago 9m 255M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (9m) 24s ago 9m 229M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:45:57.084 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 3s ago 12m 78.3M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:45:57.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.083+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faa5c06e7c0 msgr2=0x7faa5c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faa5c06e7c0 0x7faa5c070c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa74199710 tx=0x7faa68009260 comp rx=0 tx=0).stop 2024-09-13T21:45:57.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 msgr2=0x7faa741980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 0x7faa741980f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa64005f50 tx=0x7faa6400f690 comp rx=0 tx=0).stop 2024-09-13T21:45:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 shutdown_connections 2024-09-13T21:45:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faa5c06e7c0 0x7faa5c070c70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa741004e0 0x7faa741980f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 --2- 172.21.15.88:0/822131386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa74100e80 0x7faa74198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 >> 172.21.15.88:0/822131386 conn(0x7faa740fbda0 msgr2=0x7faa740fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 shutdown_connections 2024-09-13T21:45:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.084+0000 7faa78ef7700 1 -- 172.21.15.88:0/822131386 wait complete. 2024-09-13T21:45:57.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.199+0000 7f45b82f1700 1 -- 172.21.15.88:0/1281056908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b0104130 msgr2=0x7f45b0104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.199+0000 7f45b82f1700 1 --2- 172.21.15.88:0/1281056908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b0104130 0x7f45b0104500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009910 tx=0x7f45ac009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:57.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.199+0000 7f45b82f1700 1 -- 172.21.15.88:0/1281056908 shutdown_connections 2024-09-13T21:45:57.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.199+0000 7f45b82f1700 1 --2- 172.21.15.88:0/1281056908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45b00ffbd0 0x7f45b0100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.199+0000 7f45b82f1700 1 --2- 172.21.15.88:0/1281056908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b0104130 0x7f45b0104500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.199+0000 7f45b82f1700 1 -- 172.21.15.88:0/1281056908 >> 172.21.15.88:0/1281056908 conn(0x7f45b0075130 msgr2=0x7f45b0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.199+0000 7f45b82f1700 1 -- 172.21.15.88:0/1281056908 shutdown_connections 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.199+0000 7f45b82f1700 1 -- 172.21.15.88:0/1281056908 wait complete. 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.200+0000 7f45b82f1700 1 Processor -- start 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.200+0000 7f45b82f1700 1 -- start start 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.200+0000 7f45b82f1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b00ffbd0 0x7f45b0198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.200+0000 7f45b82f1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45b0104130 0x7f45b0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.200+0000 7f45b82f1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b0198c60 con 0x7f45b00ffbd0 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.200+0000 7f45b82f1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b019c9f0 con 0x7f45b0104130 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.200+0000 7f45b608d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b00ffbd0 0x7f45b0198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45b608d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b00ffbd0 0x7f45b0198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47870/0 (socket says 172.21.15.88:47870) 2024-09-13T21:45:57.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45b608d700 1 -- 172.21.15.88:0/2021826713 learned_addr learned my addr 172.21.15.88:0/2021826713 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45b588c700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45b0104130 0x7f45b0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45b608d700 1 -- 172.21.15.88:0/2021826713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45b0104130 msgr2=0x7f45b0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45b608d700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45b0104130 0x7f45b0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45b608d700 1 -- 172.21.15.88:0/2021826713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0095f0 con 0x7f45b00ffbd0 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45b608d700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b00ffbd0 0x7f45b0198040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00bd70 tx=0x7f45ac00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45a77fe700 1 -- 172.21.15.88:0/2021826713 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45ac01d070 con 0x7f45b00ffbd0 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45a77fe700 1 -- 172.21.15.88:0/2021826713 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45ac005dc0 con 0x7f45b00ffbd0 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b019cc70 con 0x7f45b00ffbd0 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45a77fe700 1 -- 172.21.15.88:0/2021826713 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45ac017400 con 0x7f45b00ffbd0 2024-09-13T21:45:57.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.201+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b019d160 con 0x7f45b00ffbd0 2024-09-13T21:45:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.202+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b004f2a0 con 0x7f45b00ffbd0 2024-09-13T21:45:57.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.203+0000 7f45a77fe700 1 -- 172.21.15.88:0/2021826713 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f45ac00f460 con 0x7f45b00ffbd0 2024-09-13T21:45:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.203+0000 7f45a77fe700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f459c06e7c0 0x7f459c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.203+0000 7f45a77fe700 1 -- 172.21.15.88:0/2021826713 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f45ac08fcb0 con 0x7f45b00ffbd0 2024-09-13T21:45:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.203+0000 7f45b588c700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f459c06e7c0 0x7f459c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:57.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.204+0000 7f45b588c700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f459c06e7c0 0x7f459c070c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f45b0199660 tx=0x7f45a00073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:57.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.212+0000 7f45a77fe700 1 -- 172.21.15.88:0/2021826713 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f45ac058da0 con 0x7f45b00ffbd0 2024-09-13T21:45:57.361 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:57 smithi088 ceph-mon[86843]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:57.362 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:57 smithi088 ceph-mon[86843]: from='osd.0 [v2:172.21.15.88:6802/3462934338,v1:172.21.15.88:6803/3462934338]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T21:45:57.362 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:45:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[98501]: 2024-09-13T21:45:57.167+0000 7f368f821640 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:45:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.513+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f45b019d480 con 0x7f45b00ffbd0 2024-09-13T21:45:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.514+0000 7f45a77fe700 1 -- 172.21.15.88:0/2021826713 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+693 (secure 0 0 0) 0x7f45ac05c460 con 0x7f45b00ffbd0 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:45:57.516 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:45:57.517 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:45:57.517 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-09-13T21:45:57.517 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:45:57.517 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:45:57.517 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f459c06e7c0 msgr2=0x7f459c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f459c06e7c0 0x7f459c070c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f45b0199660 tx=0x7f45a00073d0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b00ffbd0 msgr2=0x7f45b0198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b00ffbd0 0x7f45b0198040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00bd70 tx=0x7f45ac00bda0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 shutdown_connections 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f459c06e7c0 0x7f459c070c70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45b00ffbd0 0x7f45b0198040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 --2- 172.21.15.88:0/2021826713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45b0104130 0x7f45b0198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 >> 172.21.15.88:0/2021826713 conn(0x7f45b0075130 msgr2=0x7f45b00685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 shutdown_connections 2024-09-13T21:45:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.516+0000 7f45b82f1700 1 -- 172.21.15.88:0/2021826713 wait complete. 2024-09-13T21:45:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:57 smithi116 ceph-mon[65231]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:57 smithi116 ceph-mon[65231]: from='osd.0 [v2:172.21.15.88:6802/3462934338,v1:172.21.15.88:6803/3462934338]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T21:45:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.626+0000 7f9afc6d8700 1 -- 172.21.15.88:0/680148831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af41004c0 msgr2=0x7f9af4100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.626+0000 7f9afc6d8700 1 --2- 172.21.15.88:0/680148831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af41004c0 0x7f9af4100890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009910 tx=0x7f9af0009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.626+0000 7f9afc6d8700 1 -- 172.21.15.88:0/680148831 shutdown_connections 2024-09-13T21:45:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.626+0000 7f9afc6d8700 1 --2- 172.21.15.88:0/680148831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9af4100e60 0x7f9af4104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.626+0000 7f9afc6d8700 1 --2- 172.21.15.88:0/680148831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af41004c0 0x7f9af4100890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.626+0000 7f9afc6d8700 1 -- 172.21.15.88:0/680148831 >> 172.21.15.88:0/680148831 conn(0x7f9af40fbd80 msgr2=0x7f9af40fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.626+0000 7f9afc6d8700 1 -- 172.21.15.88:0/680148831 shutdown_connections 2024-09-13T21:45:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.626+0000 7f9afc6d8700 1 -- 172.21.15.88:0/680148831 wait complete. 2024-09-13T21:45:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.627+0000 7f9afc6d8700 1 Processor -- start 2024-09-13T21:45:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.627+0000 7f9afc6d8700 1 -- start start 2024-09-13T21:45:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.627+0000 7f9afc6d8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9af41004c0 0x7f9af4195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.627+0000 7f9afc6d8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af4100e60 0x7f9af4196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.627+0000 7f9afc6d8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4196b50 con 0x7f9af4100e60 2024-09-13T21:45:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.627+0000 7f9afc6d8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af419a8e0 con 0x7f9af41004c0 2024-09-13T21:45:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.627+0000 7f9af9c73700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af4100e60 0x7f9af4196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.627+0000 7f9af9c73700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af4100e60 0x7f9af4196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47890/0 (socket says 172.21.15.88:47890) 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.627+0000 7f9af9c73700 1 -- 172.21.15.88:0/69314295 learned_addr learned my addr 172.21.15.88:0/69314295 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9afa474700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9af41004c0 0x7f9af4195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9af9c73700 1 -- 172.21.15.88:0/69314295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9af41004c0 msgr2=0x7f9af4195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9af9c73700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9af41004c0 0x7f9af4195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9af9c73700 1 -- 172.21.15.88:0/69314295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af00095f0 con 0x7f9af4100e60 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9af9c73700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af4100e60 0x7f9af4196470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400d900 tx=0x7f9ae400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9aeb7fe700 1 -- 172.21.15.88:0/69314295 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ae4009900 con 0x7f9af4100e60 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9aeb7fe700 1 -- 172.21.15.88:0/69314295 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ae4010460 con 0x7f9af4100e60 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9aeb7fe700 1 -- 172.21.15.88:0/69314295 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ae400f5f0 con 0x7f9af4100e60 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af419abc0 con 0x7f9af4100e60 2024-09-13T21:45:57.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.628+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af419b0c0 con 0x7f9af4100e60 2024-09-13T21:45:57.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.629+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af41087d0 con 0x7f9af4100e60 2024-09-13T21:45:57.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.630+0000 7f9aeb7fe700 1 -- 172.21.15.88:0/69314295 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f9ae40105d0 con 0x7f9af4100e60 2024-09-13T21:45:57.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.630+0000 7f9aeb7fe700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f9ae006e7c0 0x7f9ae0070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:57.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.631+0000 7f9aeb7fe700 1 -- 172.21.15.88:0/69314295 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9ae408e410 con 0x7f9af4100e60 2024-09-13T21:45:57.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.631+0000 7f9afa474700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f9ae006e7c0 0x7f9ae0070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:57.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.631+0000 7f9afa474700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f9ae006e7c0 0x7f9ae0070c70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9af0006010 tx=0x7f9af001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:57.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.636+0000 7f9aeb7fe700 1 -- 172.21.15.88:0/69314295 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9ae4057440 con 0x7f9af4100e60 2024-09-13T21:45:57.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.915+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9af404f2a0 con 0x7f9af4100e60 2024-09-13T21:45:57.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.916+0000 7f9aeb7fe700 1 -- 172.21.15.88:0/69314295 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1923 (secure 0 0 0) 0x7f9ae405ab00 con 0x7f9af4100e60 2024-09-13T21:45:57.917 INFO:teuthology.orchestra.run.smithi088.stdout:e20 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 20 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:45:57.918 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:45:57.919 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:45:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:45:57.921 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:45:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:45:57.921 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:57.921 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f9ae006e7c0 msgr2=0x7f9ae0070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f9ae006e7c0 0x7f9ae0070c70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9af0006010 tx=0x7f9af001a040 comp rx=0 tx=0).stop 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af4100e60 msgr2=0x7f9af4196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af4100e60 0x7f9af4196470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400d900 tx=0x7f9ae400dc10 comp rx=0 tx=0).stop 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 shutdown_connections 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f9ae006e7c0 0x7f9ae0070c70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9af41004c0 0x7f9af4195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 --2- 172.21.15.88:0/69314295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9af4100e60 0x7f9af4196470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 >> 172.21.15.88:0/69314295 conn(0x7f9af40fbd80 msgr2=0x7f9af40fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 shutdown_connections 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:57.919+0000 7f9afc6d8700 1 -- 172.21.15.88:0/69314295 wait complete. 2024-09-13T21:45:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:45:58.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.027+0000 7f12a6b77700 1 -- 172.21.15.88:0/2829063860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100d70 msgr2=0x7f12a01094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:58.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.027+0000 7f12a6b77700 1 --2- 172.21.15.88:0/2829063860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100d70 0x7f12a01094d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f128c009910 tx=0x7f128c009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:58.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.027+0000 7f12a6b77700 1 -- 172.21.15.88:0/2829063860 shutdown_connections 2024-09-13T21:45:58.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.027+0000 7f12a6b77700 1 --2- 172.21.15.88:0/2829063860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100d70 0x7f12a01094d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.027+0000 7f12a6b77700 1 --2- 172.21.15.88:0/2829063860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12a0100460 0x7f12a0100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.027+0000 7f12a6b77700 1 -- 172.21.15.88:0/2829063860 >> 172.21.15.88:0/2829063860 conn(0x7f12a00748b0 msgr2=0x7f12a0074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:58.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.028+0000 7f12a6b77700 1 -- 172.21.15.88:0/2829063860 shutdown_connections 2024-09-13T21:45:58.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.028+0000 7f12a6b77700 1 -- 172.21.15.88:0/2829063860 wait complete. 2024-09-13T21:45:58.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.028+0000 7f12a6b77700 1 Processor -- start 2024-09-13T21:45:58.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.028+0000 7f12a6b77700 1 -- start start 2024-09-13T21:45:58.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a6b77700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100460 0x7f12a019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a6b77700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12a0100d70 0x7f12a019aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a6b77700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a019b680 con 0x7f12a0100460 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a6b77700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a0194b30 con 0x7f12a0100d70 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a4913700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100460 0x7f12a019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a4913700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100460 0x7f12a019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47896/0 (socket says 172.21.15.88:47896) 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a4913700 1 -- 172.21.15.88:0/239540089 learned_addr learned my addr 172.21.15.88:0/239540089 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f129ffff700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12a0100d70 0x7f12a019aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a4913700 1 -- 172.21.15.88:0/239540089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12a0100d70 msgr2=0x7f12a019aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a4913700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12a0100d70 0x7f12a019aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a4913700 1 -- 172.21.15.88:0/239540089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0095f0 con 0x7f12a0100460 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f12a4913700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100460 0x7f12a019aab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f129400c8a0 tx=0x7f129400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.029+0000 7f129dffb700 1 -- 172.21.15.88:0/239540089 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12940078e0 con 0x7f12a0100460 2024-09-13T21:45:58.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.030+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a0194e10 con 0x7f12a0100460 2024-09-13T21:45:58.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.030+0000 7f129dffb700 1 -- 172.21.15.88:0/239540089 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f129400f450 con 0x7f12a0100460 2024-09-13T21:45:58.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.030+0000 7f129dffb700 1 -- 172.21.15.88:0/239540089 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129400e5e0 con 0x7f12a0100460 2024-09-13T21:45:58.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.030+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a0195360 con 0x7f12a0100460 2024-09-13T21:45:58.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.031+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a0106bd0 con 0x7f12a0100460 2024-09-13T21:45:58.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.031+0000 7f129dffb700 1 -- 172.21.15.88:0/239540089 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f129400f5c0 con 0x7f12a0100460 2024-09-13T21:45:58.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.032+0000 7f129dffb700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f129006e7b0 0x7f1290070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:58.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.032+0000 7f129dffb700 1 -- 172.21.15.88:0/239540089 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f129408e860 con 0x7f12a0100460 2024-09-13T21:45:58.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.032+0000 7f129ffff700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f129006e7b0 0x7f1290070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:58.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.032+0000 7f129ffff700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f129006e7b0 0x7f1290070c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f12a00ff110 tx=0x7f128c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:58.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.036+0000 7f129dffb700 1 -- 172.21.15.88:0/239540089 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f129405b3c0 con 0x7f12a0100460 2024-09-13T21:45:58.167 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:58.167 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:58.167 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:58.167 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='osd.0 [v2:172.21.15.88:6802/3462934338,v1:172.21.15.88:6803/3462934338]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T21:45:58.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.278+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12a01955e0 con 0x7f129006e7b0 2024-09-13T21:45:58.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.279+0000 7f129dffb700 1 -- 172.21.15.88:0/239540089 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f12a01955e0 con 0x7f129006e7b0 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "7/23 daemons upgraded", 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:45:58.283 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:45:58.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f129006e7b0 msgr2=0x7f1290070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:58.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f129006e7b0 0x7f1290070c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f12a00ff110 tx=0x7f128c01a040 comp rx=0 tx=0).stop 2024-09-13T21:45:58.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100460 msgr2=0x7f12a019aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:58.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100460 0x7f12a019aab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f129400c8a0 tx=0x7f129400cbb0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 shutdown_connections 2024-09-13T21:45:58.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f129006e7b0 0x7f1290070c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12a0100460 0x7f12a019aab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 --2- 172.21.15.88:0/239540089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12a0100d70 0x7f12a019aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 >> 172.21.15.88:0/239540089 conn(0x7f12a00748b0 msgr2=0x7f12a0103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:58.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 shutdown_connections 2024-09-13T21:45:58.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.282+0000 7f12a6b77700 1 -- 172.21.15.88:0/239540089 wait complete. 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.388+0000 7f706d8ae700 1 -- 172.21.15.88:0/3409677486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ff3c0 msgr2=0x7f70680ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.388+0000 7f706d8ae700 1 --2- 172.21.15.88:0/3409677486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ff3c0 0x7f70680ff790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7058009910 tx=0x7f7058009c20 comp rx=0 tx=0).stop 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.388+0000 7f706d8ae700 1 -- 172.21.15.88:0/3409677486 shutdown_connections 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.388+0000 7f706d8ae700 1 --2- 172.21.15.88:0/3409677486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70680ffd60 0x7f7068103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.388+0000 7f706d8ae700 1 --2- 172.21.15.88:0/3409677486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ff3c0 0x7f70680ff790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.388+0000 7f706d8ae700 1 -- 172.21.15.88:0/3409677486 >> 172.21.15.88:0/3409677486 conn(0x7f70680fac60 msgr2=0x7f70680fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.388+0000 7f706d8ae700 1 -- 172.21.15.88:0/3409677486 shutdown_connections 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.388+0000 7f706d8ae700 1 -- 172.21.15.88:0/3409677486 wait complete. 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.388+0000 7f706d8ae700 1 Processor -- start 2024-09-13T21:45:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f706d8ae700 1 -- start start 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f706d8ae700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70680ff3c0 0x7f7068198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f706d8ae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ffd60 0x7f70681985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f706d8ae700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7068198bf0 con 0x7f70680ffd60 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f706d8ae700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7068198d30 con 0x7f70680ff3c0 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f70667fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ffd60 0x7f70681985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f70667fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ffd60 0x7f70681985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47924/0 (socket says 172.21.15.88:47924) 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f70667fc700 1 -- 172.21.15.88:0/264924182 learned_addr learned my addr 172.21.15.88:0/264924182 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f7066ffd700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70680ff3c0 0x7f7068198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f70667fc700 1 -- 172.21.15.88:0/264924182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70680ff3c0 msgr2=0x7f7068198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f70667fc700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70680ff3c0 0x7f7068198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.389+0000 7f70667fc700 1 -- 172.21.15.88:0/264924182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70580095f0 con 0x7f70680ffd60 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.390+0000 7f70667fc700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ffd60 0x7f70681985a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f705c00c960 tx=0x7f705c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.390+0000 7f706c8ac700 1 -- 172.21.15.88:0/264924182 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c007a70 con 0x7f70680ffd60 2024-09-13T21:45:58.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.390+0000 7f706c8ac700 1 -- 172.21.15.88:0/264924182 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f705c007bd0 con 0x7f70680ffd60 2024-09-13T21:45:58.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.390+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706819cb80 con 0x7f70680ffd60 2024-09-13T21:45:58.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.390+0000 7f706c8ac700 1 -- 172.21.15.88:0/264924182 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c0186c0 con 0x7f70680ffd60 2024-09-13T21:45:58.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.390+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706819d0d0 con 0x7f70680ffd60 2024-09-13T21:45:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.391+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706804f2a0 con 0x7f70680ffd60 2024-09-13T21:45:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.392+0000 7f706c8ac700 1 -- 172.21.15.88:0/264924182 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f705c00faa0 con 0x7f70680ffd60 2024-09-13T21:45:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.392+0000 7f706c8ac700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f705006e7b0 0x7f7050070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.392+0000 7f706c8ac700 1 -- 172.21.15.88:0/264924182 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f705c08e880 con 0x7f70680ffd60 2024-09-13T21:45:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.392+0000 7f7066ffd700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f705006e7b0 0x7f7050070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.393+0000 7f7066ffd700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f705006e7b0 0x7f7050070c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7058006010 tx=0x7f705801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:58.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.397+0000 7f706c8ac700 1 -- 172.21.15.88:0/264924182 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f705c05b3e0 con 0x7f70680ffd60 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='osd.0 [v2:172.21.15.88:6802/3462934338,v1:172.21.15.88:6803/3462934338]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2021826713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/69314295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:45:58.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:58.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:58.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:58.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:58.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:58 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:45:58.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='osd.0 [v2:172.21.15.88:6802/3462934338,v1:172.21.15.88:6803/3462934338]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='osd.0 [v2:172.21.15.88:6802/3462934338,v1:172.21.15.88:6803/3462934338]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2021826713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:45:58.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/69314295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:45:58.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:58.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:58.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:58.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:58.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:58 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:45:58.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.684+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f70681993c0 con 0x7f70680ffd60 2024-09-13T21:45:58.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.684+0000 7f706c8ac700 1 -- 172.21.15.88:0/264924182 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1429 (secure 0 0 0) 0x7f705c05af70 con 0x7f70680ffd60 2024-09-13T21:45:58.687 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded 2024-09-13T21:45:58.687 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:45:58.687 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:45:58.687 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded 2024-09-13T21:45:58.687 INFO:teuthology.orchestra.run.smithi088.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-13T21:45:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-13T21:45:58.689 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-13T21:45:58.689 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-13T21:45:58.689 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-13T21:45:58.689 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-13T21:45:58.689 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-13T21:45:58.689 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.686+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f705006e7b0 msgr2=0x7f7050070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.686+0000 7f706d8ae700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f705006e7b0 0x7f7050070c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7058006010 tx=0x7f705801a040 comp rx=0 tx=0).stop 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.686+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ffd60 msgr2=0x7f70681985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.686+0000 7f706d8ae700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ffd60 0x7f70681985a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f705c00c960 tx=0x7f705c00cd20 comp rx=0 tx=0).stop 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.687+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 shutdown_connections 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.687+0000 7f706d8ae700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f705006e7b0 0x7f7050070c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.687+0000 7f706d8ae700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70680ff3c0 0x7f7068198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.687+0000 7f706d8ae700 1 --2- 172.21.15.88:0/264924182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70680ffd60 0x7f70681985a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.687+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 >> 172.21.15.88:0/264924182 conn(0x7f70680fac60 msgr2=0x7f7068102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.687+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 shutdown_connections 2024-09-13T21:45:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:45:58.687+0000 7f706d8ae700 1 -- 172.21.15.88:0/264924182 wait complete. 2024-09-13T21:45:59.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:45:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T21:45:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: pgmap v49: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:45:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: osd.0 [v2:172.21.15.88:6802/3462934338,v1:172.21.15.88:6803/3462934338] boot 2024-09-13T21:45:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: osdmap e54: 6 total, 6 up, 6 in 2024-09-13T21:45:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:45:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/264924182' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:45:59.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:45:59 smithi088 ceph-mon[86843]: osdmap e55: 6 total, 6 up, 6 in 2024-09-13T21:45:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:45:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T21:45:59.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: pgmap v49: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:45:59.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:45:59.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: osd.0 [v2:172.21.15.88:6802/3462934338,v1:172.21.15.88:6803/3462934338] boot 2024-09-13T21:45:59.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: osdmap e54: 6 total, 6 up, 6 in 2024-09-13T21:45:59.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:45:59.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:59.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/264924182' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:45:59.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:45:59 smithi116 ceph-mon[65231]: osdmap e55: 6 total, 6 up, 6 in 2024-09-13T21:46:01.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:01 smithi088 ceph-mon[86843]: pgmap v52: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:46:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:01 smithi116 ceph-mon[65231]: pgmap v52: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:46:03.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:03 smithi088 ceph-mon[86843]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:46:03.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:03.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:03 smithi116 ceph-mon[65231]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2024-09-13T21:46:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:04.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:04 smithi088 ceph-mon[86843]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded) 2024-09-13T21:46:04.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:04 smithi088 ceph-mon[86843]: mgrmap e38: smithi088.scyrwy(active, since 92s), standbys: smithi116.bqnvtn 2024-09-13T21:46:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:04 smithi116 ceph-mon[65231]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded) 2024-09-13T21:46:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:04 smithi116 ceph-mon[65231]: mgrmap e38: smithi088.scyrwy(active, since 92s), standbys: smithi116.bqnvtn 2024-09-13T21:46:05.343 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:05 smithi088 ceph-mon[86843]: pgmap v54: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 589 B/s wr, 0 op/s 2024-09-13T21:46:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:05 smithi116 ceph-mon[65231]: pgmap v54: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 589 B/s wr, 0 op/s 2024-09-13T21:46:07.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:07 smithi088 ceph-mon[86843]: pgmap v55: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:46:07.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:07 smithi116 ceph-mon[65231]: pgmap v55: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:46:09.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:09 smithi088 ceph-mon[86843]: pgmap v56: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 515 B/s wr, 0 op/s 2024-09-13T21:46:09.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:09 smithi116 ceph-mon[65231]: pgmap v56: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 515 B/s wr, 0 op/s 2024-09-13T21:46:11.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:11 smithi088 ceph-mon[86843]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 468 B/s wr, 0 op/s 2024-09-13T21:46:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:11 smithi116 ceph-mon[65231]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 468 B/s wr, 0 op/s 2024-09-13T21:46:13.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:13 smithi088 ceph-mon[86843]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:46:13.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:13 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:13.393 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:13 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:46:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:13 smithi116 ceph-mon[65231]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:46:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:13 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:13 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:46:14.396 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:14 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:46:14.396 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:14 smithi088 ceph-mon[86843]: Upgrade: osd.1 is safe to restart 2024-09-13T21:46:14.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:14 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:46:14.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:14 smithi116 ceph-mon[65231]: Upgrade: osd.1 is safe to restart 2024-09-13T21:46:15.414 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:15 smithi088 ceph-mon[86843]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:46:15.414 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:15 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:15.414 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:15 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:46:15.414 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:15 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:15.497 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:15 smithi116 ceph-mon[65231]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:46:15.497 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:15 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:15.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:15 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:46:15.498 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:15 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:16.342 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:16 smithi088 ceph-mon[86843]: Upgrade: Updating osd.1 2024-09-13T21:46:16.342 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:16 smithi088 ceph-mon[86843]: Deploying daemon osd.1 on smithi088 2024-09-13T21:46:16.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:16 smithi116 ceph-mon[65231]: Upgrade: Updating osd.1 2024-09-13T21:46:16.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:16 smithi116 ceph-mon[65231]: Deploying daemon osd.1 on smithi088 2024-09-13T21:46:17.456 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:17 smithi088 ceph-mon[86843]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:46:17.456 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:17.456 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:17 smithi116 ceph-mon[65231]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:46:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:17.728 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:17 smithi088 systemd[1]: Stopping Ceph osd.1 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:46:17.982 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:17 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[48360]: 2024-09-13T21:46:17.726+0000 7f475bf90700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:46:17.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:17 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[48360]: 2024-09-13T21:46:17.726+0000 7f475bf90700 -1 osd.1 55 *** Got signal Terminated *** 2024-09-13T21:46:17.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:17 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[48360]: 2024-09-13T21:46:17.726+0000 7f475bf90700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:46:18.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:18 smithi116 ceph-mon[65231]: osd.1 marked itself down and dead 2024-09-13T21:46:18.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:18 smithi088 ceph-mon[86843]: osd.1 marked itself down and dead 2024-09-13T21:46:18.953 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:18 smithi088 podman[103564]: 2024-09-13 21:46:18.657348944 +0000 UTC m=+1.057461891 container died df5428327f1815441f3aec3e4e3566d8331d40ef447d75ce640dae6b1b4a9d33 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T21:46:19.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:19 smithi088 ceph-mon[86843]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:46:19.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:19 smithi088 ceph-mon[86843]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:46:19.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:19 smithi088 ceph-mon[86843]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T21:46:19.233 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:19 smithi088 podman[103564]: 2024-09-13 21:46:19.135264058 +0000 UTC m=+1.535377000 container cleanup df5428327f1815441f3aec3e4e3566d8331d40ef447d75ce640dae6b1b4a9d33 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_CLEAN=True) 2024-09-13T21:46:19.233 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:19 smithi088 bash[103564]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1 2024-09-13T21:46:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:19 smithi116 ceph-mon[65231]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:46:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:19 smithi116 ceph-mon[65231]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:46:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:19 smithi116 ceph-mon[65231]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T21:46:19.733 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:19 smithi088 podman[103580]: 2024-09-13 21:46:19.411807084 +0000 UTC m=+0.757613095 container remove df5428327f1815441f3aec3e4e3566d8331d40ef447d75ce640dae6b1b4a9d33 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20231212, ceph=True, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T21:46:20.099 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:19 smithi088 podman[103667]: 2024-09-13 21:46:19.671655103 +0000 UTC m=+0.016385825 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:46:20.099 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:19 smithi088 podman[103667]: 2024-09-13 21:46:19.771159504 +0000 UTC m=+0.115890263 container create 72a48deaa4408b3af385ca6b999355dfa4bdbe62af73f07007145c735ca240b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-13T21:46:20.099 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:20 smithi088 podman[103667]: 2024-09-13 21:46:20.01525399 +0000 UTC m=+0.359984704 container init 72a48deaa4408b3af385ca6b999355dfa4bdbe62af73f07007145c735ca240b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T21:46:20.100 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:20 smithi088 podman[103667]: 2024-09-13 21:46:20.018770414 +0000 UTC m=+0.363501127 container start 72a48deaa4408b3af385ca6b999355dfa4bdbe62af73f07007145c735ca240b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-13T21:46:20.100 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:20 smithi088 podman[103667]: 2024-09-13 21:46:20.098463915 +0000 UTC m=+0.443194640 container attach 72a48deaa4408b3af385ca6b999355dfa4bdbe62af73f07007145c735ca240b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:46:20.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:20 smithi088 ceph-mon[86843]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T21:46:20.483 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:20 smithi088 podman[103667]: 2024-09-13 21:46:20.213447961 +0000 UTC m=+0.558178682 container died 72a48deaa4408b3af385ca6b999355dfa4bdbe62af73f07007145c735ca240b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T21:46:20.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:20 smithi116 ceph-mon[65231]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T21:46:21.172 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:20 smithi088 podman[103691]: 2024-09-13 21:46:20.835978199 +0000 UTC m=+0.616346692 container remove 72a48deaa4408b3af385ca6b999355dfa4bdbe62af73f07007145c735ca240b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T21:46:21.172 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:20 smithi088 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T21:46:21.172 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:20 smithi088 systemd[1]: Stopped Ceph osd.1 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:46:21.172 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:20 smithi088 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 2.683s CPU time. 2024-09-13T21:46:21.172 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 systemd[1]: Starting Ceph osd.1 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:46:21.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:21 smithi088 ceph-mon[86843]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:21.424 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 podman[103791]: 2024-09-13 21:46:21.185432851 +0000 UTC m=+0.016396544 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:46:21.424 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 podman[103791]: 2024-09-13 21:46:21.312148136 +0000 UTC m=+0.143111820 container create b9a9e15f5492b5dde9a9b1806fbb7a4778e7860f47b709bb4946a4f0400056f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T21:46:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:21 smithi116 ceph-mon[65231]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:21.680 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 podman[103791]: 2024-09-13 21:46:21.531100031 +0000 UTC m=+0.362063722 container init b9a9e15f5492b5dde9a9b1806fbb7a4778e7860f47b709bb4946a4f0400056f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T21:46:21.680 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 podman[103791]: 2024-09-13 21:46:21.535147095 +0000 UTC m=+0.366110796 container start b9a9e15f5492b5dde9a9b1806fbb7a4778e7860f47b709bb4946a4f0400056f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T21:46:21.680 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate[103806]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:46:21.680 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate[103806]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:46:21.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 bash[103791]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:46:21.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 bash[103791]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:46:21.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:21 smithi088 podman[103791]: 2024-09-13 21:46:21.798293474 +0000 UTC m=+0.629257262 container attach b9a9e15f5492b5dde9a9b1806fbb7a4778e7860f47b709bb4946a4f0400056f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T21:46:22.682 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate[103806]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T21:46:22.683 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 bash[103791]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T21:46:22.683 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate[103806]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T21:46:22.683 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 bash[103791]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T21:46:22.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate[103806]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T21:46:22.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 bash[103791]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T21:46:22.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate[103806]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T21:46:22.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 bash[103791]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T21:46:22.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate[103806]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T21:46:22.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 bash[103791]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T21:46:22.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate[103806]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T21:46:22.984 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 bash[103791]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T21:46:22.984 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate[103806]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T21:46:22.984 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 bash[103791]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T21:46:22.984 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:22 smithi088 podman[103791]: 2024-09-13 21:46:22.710217226 +0000 UTC m=+1.541180931 container died b9a9e15f5492b5dde9a9b1806fbb7a4778e7860f47b709bb4946a4f0400056f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T21:46:23.313 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:23 smithi088 ceph-mon[86843]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:23.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:23 smithi116 ceph-mon[65231]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:23.631 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:23 smithi088 podman[103957]: 2024-09-13 21:46:23.31256778 +0000 UTC m=+0.592525778 container remove b9a9e15f5492b5dde9a9b1806fbb7a4778e7860f47b709bb4946a4f0400056f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T21:46:23.631 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:23 smithi088 podman[104016]: 2024-09-13 21:46:23.419930964 +0000 UTC m=+0.016108746 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:46:23.631 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:23 smithi088 podman[104016]: 2024-09-13 21:46:23.521834443 +0000 UTC m=+0.118012223 container create 1899bd970e44329f96f8d2ae0b27f8715f22ce7e7219ea534b32c30d17eef456 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T21:46:23.982 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:23 smithi088 podman[104016]: 2024-09-13 21:46:23.732740367 +0000 UTC m=+0.328918154 container init 1899bd970e44329f96f8d2ae0b27f8715f22ce7e7219ea534b32c30d17eef456 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-13T21:46:23.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:23 smithi088 podman[104016]: 2024-09-13 21:46:23.735933672 +0000 UTC m=+0.332111461 container start 1899bd970e44329f96f8d2ae0b27f8715f22ce7e7219ea534b32c30d17eef456 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T21:46:23.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:23 smithi088 ceph-osd[104034]: -- 172.21.15.88:0/3407219417 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577b65f61e0 con 0x5577b658c000 2024-09-13T21:46:23.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:23 smithi088 bash[104016]: 1899bd970e44329f96f8d2ae0b27f8715f22ce7e7219ea534b32c30d17eef456 2024-09-13T21:46:23.983 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:23 smithi088 systemd[1]: Started Ceph osd.1 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:46:25.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:24 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:25.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:24 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:25.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:24 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:25.190 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:24 smithi088 ceph-mon[86843]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:25.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:24 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:25.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:24 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:25.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:24 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:25.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:24 smithi116 ceph-mon[65231]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:25.851 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:25 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[104030]: 2024-09-13T21:46:25.624+0000 7f9c84dde640 -1 Falling back to public interface 2024-09-13T21:46:26.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:25 smithi088 ceph-mon[86843]: Health check failed: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T21:46:26.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:25 smithi116 ceph-mon[65231]: Health check failed: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T21:46:27.208 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:26 smithi088 ceph-mon[86843]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:26 smithi116 ceph-mon[65231]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.799+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/3076231143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 msgr2=0x7fa3d0068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.799+0000 7fa3d7ad4700 1 --2- 172.21.15.88:0/3076231143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 0x7fa3d0068b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009910 tx=0x7fa3c0009c20 comp rx=0 tx=0).stop 2024-09-13T21:46:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.799+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/3076231143 shutdown_connections 2024-09-13T21:46:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.799+0000 7fa3d7ad4700 1 --2- 172.21.15.88:0/3076231143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d0069140 0x7fa3d0104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.799+0000 7fa3d7ad4700 1 --2- 172.21.15.88:0/3076231143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 0x7fa3d0068b70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.799+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/3076231143 >> 172.21.15.88:0/3076231143 conn(0x7fa3d0075130 msgr2=0x7fa3d0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.799+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/3076231143 shutdown_connections 2024-09-13T21:46:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.799+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/3076231143 wait complete. 2024-09-13T21:46:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d7ad4700 1 Processor -- start 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d7ad4700 1 -- start start 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d7ad4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 0x7fa3d00ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d7ad4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d0069140 0x7fa3d01001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d7ad4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d0100720 con 0x7fa3d00687a0 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d7ad4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d0100860 con 0x7fa3d0069140 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d5870700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 0x7fa3d00ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d5870700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 0x7fa3d00ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36266/0 (socket says 172.21.15.88:36266) 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d5870700 1 -- 172.21.15.88:0/386917878 learned_addr learned my addr 172.21.15.88:0/386917878 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d506f700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d0069140 0x7fa3d01001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d5870700 1 -- 172.21.15.88:0/386917878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d0069140 msgr2=0x7fa3d01001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:28.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d5870700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d0069140 0x7fa3d01001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.800+0000 7fa3d5870700 1 -- 172.21.15.88:0/386917878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00095f0 con 0x7fa3d00687a0 2024-09-13T21:46:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.801+0000 7fa3d5870700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 0x7fa3d00ffca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00092e0 tx=0x7fa3c000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.801+0000 7fa3c6ffd700 1 -- 172.21.15.88:0/386917878 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c001d070 con 0x7fa3d00687a0 2024-09-13T21:46:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.801+0000 7fa3c6ffd700 1 -- 172.21.15.88:0/386917878 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3c0005e00 con 0x7fa3d00687a0 2024-09-13T21:46:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.801+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d0100ae0 con 0x7fa3d00687a0 2024-09-13T21:46:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.801+0000 7fa3c6ffd700 1 -- 172.21.15.88:0/386917878 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c0017400 con 0x7fa3d00687a0 2024-09-13T21:46:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.801+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d01a23e0 con 0x7fa3d00687a0 2024-09-13T21:46:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.802+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d0108790 con 0x7fa3d00687a0 2024-09-13T21:46:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.802+0000 7fa3c6ffd700 1 -- 172.21.15.88:0/386917878 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa3c000f460 con 0x7fa3d00687a0 2024-09-13T21:46:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.803+0000 7fa3c6ffd700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa3bc06e680 0x7fa3bc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.803+0000 7fa3c6ffd700 1 -- 172.21.15.88:0/386917878 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa3c008fae0 con 0x7fa3d00687a0 2024-09-13T21:46:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.803+0000 7fa3d506f700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa3bc06e680 0x7fa3bc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.804+0000 7fa3d506f700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa3bc06e680 0x7fa3bc070b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc005950 tx=0x7fa3cc0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:28.807+0000 7fa3c6ffd700 1 -- 172.21.15.88:0/386917878 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa3c0058d30 con 0x7fa3d00687a0 2024-09-13T21:46:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.052+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3d0061190 con 0x7fa3bc06e680 2024-09-13T21:46:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.054+0000 7fa3c6ffd700 1 -- 172.21.15.88:0/386917878 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa3d0061190 con 0x7fa3bc06e680 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa3bc06e680 msgr2=0x7fa3bc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa3bc06e680 0x7fa3bc070b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc005950 tx=0x7fa3cc0058e0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 msgr2=0x7fa3d00ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 0x7fa3d00ffca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00092e0 tx=0x7fa3c000be20 comp rx=0 tx=0).stop 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 shutdown_connections 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa3bc06e680 0x7fa3bc070b30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d00687a0 0x7fa3d00ffca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 --2- 172.21.15.88:0/386917878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d0069140 0x7fa3d01001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 >> 172.21.15.88:0/386917878 conn(0x7fa3d0075130 msgr2=0x7fa3d00fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 shutdown_connections 2024-09-13T21:46:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.056+0000 7fa3d7ad4700 1 -- 172.21.15.88:0/386917878 wait complete. 2024-09-13T21:46:29.069 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:46:29.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.170+0000 7f48b8313700 1 -- 172.21.15.88:0/130881148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 msgr2=0x7f48b010a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.170+0000 7f48b8313700 1 --2- 172.21.15.88:0/130881148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 0x7f48b010a2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009910 tx=0x7f48a0009c20 comp rx=0 tx=0).stop 2024-09-13T21:46:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.171+0000 7f48b8313700 1 -- 172.21.15.88:0/130881148 shutdown_connections 2024-09-13T21:46:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.171+0000 7f48b8313700 1 --2- 172.21.15.88:0/130881148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 0x7f48b010a2d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.171+0000 7f48b8313700 1 --2- 172.21.15.88:0/130881148 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48b01012f0 0x7f48b01016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.171+0000 7f48b8313700 1 -- 172.21.15.88:0/130881148 >> 172.21.15.88:0/130881148 conn(0x7f48b00fac60 msgr2=0x7f48b00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.171+0000 7f48b8313700 1 -- 172.21.15.88:0/130881148 shutdown_connections 2024-09-13T21:46:29.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.171+0000 7f48b8313700 1 -- 172.21.15.88:0/130881148 wait complete. 2024-09-13T21:46:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.171+0000 7f48b8313700 1 Processor -- start 2024-09-13T21:46:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.171+0000 7f48b8313700 1 -- start start 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b8313700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48b01012f0 0x7f48b01980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b8313700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 0x7f48b0198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b8313700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0198c80 con 0x7f48b0101c00 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b8313700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0198dc0 con 0x7f48b01012f0 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b58ae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 0x7f48b0198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b58ae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 0x7f48b0198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36278/0 (socket says 172.21.15.88:36278) 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b58ae700 1 -- 172.21.15.88:0/4263736605 learned_addr learned my addr 172.21.15.88:0/4263736605 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b60af700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48b01012f0 0x7f48b01980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b58ae700 1 -- 172.21.15.88:0/4263736605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48b01012f0 msgr2=0x7f48b01980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b58ae700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48b01012f0 0x7f48b01980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b58ae700 1 -- 172.21.15.88:0/4263736605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a00095f0 con 0x7f48b0101c00 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48b58ae700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 0x7f48b0198630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f48a0006010 tx=0x7f48a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.172+0000 7f48a77fe700 1 -- 172.21.15.88:0/4263736605 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a001d070 con 0x7f48b0101c00 2024-09-13T21:46:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.173+0000 7f48a77fe700 1 -- 172.21.15.88:0/4263736605 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48a0004fb0 con 0x7f48b0101c00 2024-09-13T21:46:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.173+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b019cbb0 con 0x7f48b0101c00 2024-09-13T21:46:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.173+0000 7f48a77fe700 1 -- 172.21.15.88:0/4263736605 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a0022ea0 con 0x7f48b0101c00 2024-09-13T21:46:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.173+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b019d0a0 con 0x7f48b0101c00 2024-09-13T21:46:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.174+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b004f2a0 con 0x7f48b0101c00 2024-09-13T21:46:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.174+0000 7f48a77fe700 1 -- 172.21.15.88:0/4263736605 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f48a0022470 con 0x7f48b0101c00 2024-09-13T21:46:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.175+0000 7f48a77fe700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f489c06e680 0x7f489c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.175+0000 7f48a77fe700 1 -- 172.21.15.88:0/4263736605 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f48a008fb40 con 0x7f48b0101c00 2024-09-13T21:46:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.175+0000 7f48b60af700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f489c06e680 0x7f489c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.176+0000 7f48b60af700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f489c06e680 0x7f489c070b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48ac005ea0 tx=0x7f48ac005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:29.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.180+0000 7f48a77fe700 1 -- 172.21.15.88:0/4263736605 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f48a0058e40 con 0x7f48b0101c00 2024-09-13T21:46:29.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.417+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48b0109890 con 0x7f489c06e680 2024-09-13T21:46:29.419 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:29 smithi088 ceph-mon[86843]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:29.419 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:29 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:29.419 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:29 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:29.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.418+0000 7f48a77fe700 1 -- 172.21.15.88:0/4263736605 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f48b0109890 con 0x7f489c06e680 2024-09-13T21:46:29.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f489c06e680 msgr2=0x7f489c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f489c06e680 0x7f489c070b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48ac005ea0 tx=0x7f48ac005e30 comp rx=0 tx=0).stop 2024-09-13T21:46:29.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 msgr2=0x7f48b0198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 0x7f48b0198630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f48a0006010 tx=0x7f48a000be20 comp rx=0 tx=0).stop 2024-09-13T21:46:29.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 shutdown_connections 2024-09-13T21:46:29.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f489c06e680 0x7f489c070b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48b01012f0 0x7f48b01980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 --2- 172.21.15.88:0/4263736605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0101c00 0x7f48b0198630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 >> 172.21.15.88:0/4263736605 conn(0x7f48b00fac60 msgr2=0x7f48b00ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:29.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 shutdown_connections 2024-09-13T21:46:29.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.421+0000 7f48b8313700 1 -- 172.21.15.88:0/4263736605 wait complete. 2024-09-13T21:46:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.536+0000 7f5331382700 1 -- 172.21.15.88:0/2469970138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c1004c0 msgr2=0x7f532c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.536+0000 7f5331382700 1 --2- 172.21.15.88:0/2469970138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c1004c0 0x7f532c100890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f531c009910 tx=0x7f531c009c20 comp rx=0 tx=0).stop 2024-09-13T21:46:29.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.536+0000 7f5331382700 1 -- 172.21.15.88:0/2469970138 shutdown_connections 2024-09-13T21:46:29.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.536+0000 7f5331382700 1 --2- 172.21.15.88:0/2469970138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f532c100e60 0x7f532c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.536+0000 7f5331382700 1 --2- 172.21.15.88:0/2469970138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c1004c0 0x7f532c100890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.536+0000 7f5331382700 1 -- 172.21.15.88:0/2469970138 >> 172.21.15.88:0/2469970138 conn(0x7f532c0fbd80 msgr2=0x7f532c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:29.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.537+0000 7f5331382700 1 -- 172.21.15.88:0/2469970138 shutdown_connections 2024-09-13T21:46:29.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.537+0000 7f5331382700 1 -- 172.21.15.88:0/2469970138 wait complete. 2024-09-13T21:46:29.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f5331382700 1 Processor -- start 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f5331382700 1 -- start start 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f5331382700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f532c1004c0 0x7f532c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f5331382700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c100e60 0x7f532c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f5331382700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c073ad0 con 0x7f532c100e60 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f5331382700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c073c10 con 0x7f532c1004c0 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f532a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c100e60 0x7f532c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f532a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c100e60 0x7f532c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36306/0 (socket says 172.21.15.88:36306) 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f532a7fc700 1 -- 172.21.15.88:0/1388054905 learned_addr learned my addr 172.21.15.88:0/1388054905 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.538+0000 7f532affd700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f532c1004c0 0x7f532c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f532affd700 1 -- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c100e60 msgr2=0x7f532c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f532affd700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c100e60 0x7f532c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f532affd700 1 -- 172.21.15.88:0/1388054905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0095f0 con 0x7f532c1004c0 2024-09-13T21:46:29.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f532a7fc700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c100e60 0x7f532c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:46:29.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f532affd700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f532c1004c0 0x7f532c073050 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f531c009fd0 tx=0x7f531c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:29.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f5313fff700 1 -- 172.21.15.88:0/1388054905 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f531c01d070 con 0x7f532c1004c0 2024-09-13T21:46:29.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f5313fff700 1 -- 172.21.15.88:0/1388054905 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f531c0050d0 con 0x7f532c1004c0 2024-09-13T21:46:29.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c073e90 con 0x7f532c1004c0 2024-09-13T21:46:29.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f5313fff700 1 -- 172.21.15.88:0/1388054905 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f531c003e90 con 0x7f532c1004c0 2024-09-13T21:46:29.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.539+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c1a23e0 con 0x7f532c1004c0 2024-09-13T21:46:29.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.540+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c1087d0 con 0x7f532c1004c0 2024-09-13T21:46:29.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.541+0000 7f5313fff700 1 -- 172.21.15.88:0/1388054905 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f531c017400 con 0x7f532c1004c0 2024-09-13T21:46:29.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.542+0000 7f5313fff700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f531406e680 0x7f5314070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:29.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.542+0000 7f5313fff700 1 -- 172.21.15.88:0/1388054905 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f531c08f8e0 con 0x7f532c1004c0 2024-09-13T21:46:29.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.542+0000 7f532a7fc700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f531406e680 0x7f5314070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:29.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.542+0000 7f532a7fc700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f531406e680 0x7f5314070b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f532c074840 tx=0x7f5320009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:29.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.547+0000 7f5313fff700 1 -- 172.21.15.88:0/1388054905 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f531c058c20 con 0x7f532c1004c0 2024-09-13T21:46:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:29 smithi116 ceph-mon[65231]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:29 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:29 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:29.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.788+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f532c061190 con 0x7f531406e680 2024-09-13T21:46:29.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.797+0000 7f5313fff700 1 -- 172.21.15.88:0/1388054905 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f532c061190 con 0x7f531406e680 2024-09-13T21:46:29.799 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (3m) 1s ago 13m 25.3M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (14m) 1s ago 14m 8280k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (13m) 56s ago 13m 7918k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (65s) 1s ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (60s) 56s ago 13m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (3m) 1s ago 13m 78.0M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (8m) 1s ago 8m 119M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (8m) 1s ago 8m 16.4M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (8m) 56s ago 8m 17.3M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:46:29.800 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (8m) 56s ago 8m 122M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (5m) 1s ago 15m 500M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (4m) 56s ago 12m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (2m) 1s ago 15m 49.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (102s) 56s ago 12m 34.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (4m) 1s ago 13m 15.8M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (4m) 56s ago 12m 17.2M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (41s) 1s ago 12m 87.7M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (6s) 1s ago 11m 12.1M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 1899bd970e44 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (11m) 1s ago 11m 197M 1216M 18.2.0 dc2bc1663786 f6180a479fe9 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (10m) 56s ago 10m 272M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (10m) 56s ago 10m 255M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:46:29.801 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (9m) 56s ago 9m 229M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:46:29.802 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (3m) 1s ago 13m 78.3M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:46:29.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f531406e680 msgr2=0x7f5314070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f531406e680 0x7f5314070b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f532c074840 tx=0x7f5320009260 comp rx=0 tx=0).stop 2024-09-13T21:46:29.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f532c1004c0 msgr2=0x7f532c073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f532c1004c0 0x7f532c073050 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f531c009fd0 tx=0x7f531c00f690 comp rx=0 tx=0).stop 2024-09-13T21:46:29.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 shutdown_connections 2024-09-13T21:46:29.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f531406e680 0x7f5314070b30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f532c1004c0 0x7f532c073050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 --2- 172.21.15.88:0/1388054905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f532c100e60 0x7f532c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 >> 172.21.15.88:0/1388054905 conn(0x7f532c0fbd80 msgr2=0x7f532c0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:29.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 shutdown_connections 2024-09-13T21:46:29.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.800+0000 7f5331382700 1 -- 172.21.15.88:0/1388054905 wait complete. 2024-09-13T21:46:29.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.911+0000 7eff29055700 1 -- 172.21.15.88:0/3820526968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 msgr2=0x7eff240ff5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.911+0000 7eff29055700 1 --2- 172.21.15.88:0/3820526968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 0x7eff240ff5e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff14009910 tx=0x7eff14009c20 comp rx=0 tx=0).stop 2024-09-13T21:46:29.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.911+0000 7eff29055700 1 -- 172.21.15.88:0/3820526968 shutdown_connections 2024-09-13T21:46:29.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.911+0000 7eff29055700 1 --2- 172.21.15.88:0/3820526968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff240ffb20 0x7eff24104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.911+0000 7eff29055700 1 --2- 172.21.15.88:0/3820526968 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 0x7eff240ff5e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.911+0000 7eff29055700 1 -- 172.21.15.88:0/3820526968 >> 172.21.15.88:0/3820526968 conn(0x7eff240fac80 msgr2=0x7eff240fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:29.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.911+0000 7eff29055700 1 -- 172.21.15.88:0/3820526968 shutdown_connections 2024-09-13T21:46:29.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.911+0000 7eff29055700 1 -- 172.21.15.88:0/3820526968 wait complete. 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.911+0000 7eff29055700 1 Processor -- start 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff29055700 1 -- start start 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff29055700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 0x7eff2419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff29055700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff240ffb20 0x7eff2419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff29055700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2419d060 con 0x7eff240ff210 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff29055700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff241a0df0 con 0x7eff240ffb20 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff22d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 0x7eff2419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff22d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 0x7eff2419c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36332/0 (socket says 172.21.15.88:36332) 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff22d9d700 1 -- 172.21.15.88:0/2595325221 learned_addr learned my addr 172.21.15.88:0/2595325221 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff2259c700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff240ffb20 0x7eff2419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:29.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff22d9d700 1 -- 172.21.15.88:0/2595325221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff240ffb20 msgr2=0x7eff2419c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:29.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff22d9d700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff240ffb20 0x7eff2419c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:29.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.912+0000 7eff22d9d700 1 -- 172.21.15.88:0/2595325221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140095f0 con 0x7eff240ff210 2024-09-13T21:46:29.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.913+0000 7eff22d9d700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 0x7eff2419c440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff1400f690 tx=0x7eff1400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:29.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.913+0000 7eff0bfff700 1 -- 172.21.15.88:0/2595325221 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff1401d070 con 0x7eff240ff210 2024-09-13T21:46:29.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.913+0000 7eff0bfff700 1 -- 172.21.15.88:0/2595325221 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff140050d0 con 0x7eff240ff210 2024-09-13T21:46:29.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.913+0000 7eff0bfff700 1 -- 172.21.15.88:0/2595325221 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff14022470 con 0x7eff240ff210 2024-09-13T21:46:29.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.913+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff241a1070 con 0x7eff240ff210 2024-09-13T21:46:29.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.913+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff241a1560 con 0x7eff240ff210 2024-09-13T21:46:29.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.914+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff24101730 con 0x7eff240ff210 2024-09-13T21:46:29.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.914+0000 7eff0bfff700 1 -- 172.21.15.88:0/2595325221 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7eff14003780 con 0x7eff240ff210 2024-09-13T21:46:29.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.915+0000 7eff0bfff700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7eff0c06e680 0x7eff0c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:29.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.915+0000 7eff0bfff700 1 -- 172.21.15.88:0/2595325221 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7eff1408fa40 con 0x7eff240ff210 2024-09-13T21:46:29.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.915+0000 7eff2259c700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7eff0c06e680 0x7eff0c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:29.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.915+0000 7eff2259c700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7eff0c06e680 0x7eff0c070b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff2419da60 tx=0x7eff18009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:29.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:29.920+0000 7eff0bfff700 1 -- 172.21.15.88:0/2595325221 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7eff14058c90 con 0x7eff240ff210 2024-09-13T21:46:30.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.217+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7eff241a1840 con 0x7eff240ff210 2024-09-13T21:46:30.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.218+0000 7eff0bfff700 1 -- 172.21.15.88:0/2595325221 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7eff1405c350 con 0x7eff240ff210 2024-09-13T21:46:30.219 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:46:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:46:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:46:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-09-13T21:46:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T21:46:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:46:30.221 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:46:30.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7eff0c06e680 msgr2=0x7eff0c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7eff0c06e680 0x7eff0c070b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff2419da60 tx=0x7eff18009260 comp rx=0 tx=0).stop 2024-09-13T21:46:30.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 msgr2=0x7eff2419c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 0x7eff2419c440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff1400f690 tx=0x7eff1400f6c0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 shutdown_connections 2024-09-13T21:46:30.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7eff0c06e680 0x7eff0c070b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff240ff210 0x7eff2419c440 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 --2- 172.21.15.88:0/2595325221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff240ffb20 0x7eff2419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 >> 172.21.15.88:0/2595325221 conn(0x7eff240fac80 msgr2=0x7eff24110680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:30.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 shutdown_connections 2024-09-13T21:46:30.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.220+0000 7eff29055700 1 -- 172.21.15.88:0/2595325221 wait complete. 2024-09-13T21:46:30.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.326+0000 7f2d9a552700 1 -- 172.21.15.88:0/1490204120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 msgr2=0x7f2d94103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.326+0000 7f2d9a552700 1 --2- 172.21.15.88:0/1490204120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 0x7f2d94103d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009910 tx=0x7f2d88009c20 comp rx=0 tx=0).stop 2024-09-13T21:46:30.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.326+0000 7f2d9a552700 1 -- 172.21.15.88:0/1490204120 shutdown_connections 2024-09-13T21:46:30.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.326+0000 7f2d9a552700 1 --2- 172.21.15.88:0/1490204120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 0x7f2d94103d30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.326+0000 7f2d9a552700 1 --2- 172.21.15.88:0/1490204120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d940ff3c0 0x7f2d940ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.326+0000 7f2d9a552700 1 -- 172.21.15.88:0/1490204120 >> 172.21.15.88:0/1490204120 conn(0x7f2d940fac80 msgr2=0x7f2d940fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:30.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.326+0000 7f2d9a552700 1 -- 172.21.15.88:0/1490204120 shutdown_connections 2024-09-13T21:46:30.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.326+0000 7f2d9a552700 1 -- 172.21.15.88:0/1490204120 wait complete. 2024-09-13T21:46:30.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.327+0000 7f2d9a552700 1 Processor -- start 2024-09-13T21:46:30.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.327+0000 7f2d9a552700 1 -- start start 2024-09-13T21:46:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.327+0000 7f2d9a552700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d940ff3c0 0x7f2d94194e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.327+0000 7f2d9a552700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 0x7f2d94195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.327+0000 7f2d9a552700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94195a30 con 0x7f2d940ffd60 2024-09-13T21:46:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.327+0000 7f2d9a552700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d941997c0 con 0x7f2d940ff3c0 2024-09-13T21:46:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 0x7f2d94195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 0x7f2d94195350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60450/0 (socket says 172.21.15.88:60450) 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d937fe700 1 -- 172.21.15.88:0/1921753332 learned_addr learned my addr 172.21.15.88:0/1921753332 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d93fff700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d940ff3c0 0x7f2d94194e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d937fe700 1 -- 172.21.15.88:0/1921753332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d940ff3c0 msgr2=0x7f2d94194e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d937fe700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d940ff3c0 0x7f2d94194e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d937fe700 1 -- 172.21.15.88:0/1921753332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d880095f0 con 0x7f2d940ffd60 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d937fe700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 0x7f2d94195350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d880059d0 tx=0x7f2d8801a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d917fa700 1 -- 172.21.15.88:0/1921753332 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d8801f070 con 0x7f2d940ffd60 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d917fa700 1 -- 172.21.15.88:0/1921753332 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d8800b610 con 0x7f2d940ffd60 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d94199a40 con 0x7f2d940ffd60 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d917fa700 1 -- 172.21.15.88:0/1921753332 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d8800f460 con 0x7f2d940ffd60 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.328+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d94199f30 con 0x7f2d940ffd60 2024-09-13T21:46:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.329+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9404f2a0 con 0x7f2d940ffd60 2024-09-13T21:46:30.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.330+0000 7f2d917fa700 1 -- 172.21.15.88:0/1921753332 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2d88023070 con 0x7f2d940ffd60 2024-09-13T21:46:30.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.330+0000 7f2d917fa700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2d7c06e680 0x7f2d7c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:30.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.331+0000 7f2d93fff700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2d7c06e680 0x7f2d7c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:30.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.331+0000 7f2d917fa700 1 -- 172.21.15.88:0/1921753332 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2d88091780 con 0x7f2d940ffd60 2024-09-13T21:46:30.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.331+0000 7f2d93fff700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2d7c06e680 0x7f2d7c070b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009c60 tx=0x7f2d84009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:30.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.335+0000 7f2d917fa700 1 -- 172.21.15.88:0/1921753332 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2d8805aa50 con 0x7f2d940ffd60 2024-09-13T21:46:30.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:30 smithi088 ceph-mon[86843]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:30.579 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:30.580 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:30.580 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:30 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2595325221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:30.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:30 smithi116 ceph-mon[65231]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:30.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:30.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:30.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:30 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2595325221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.597+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2d9419a1a0 con 0x7f2d940ffd60 2024-09-13T21:46:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.597+0000 7f2d917fa700 1 -- 172.21.15.88:0/1921753332 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1923 (secure 0 0 0) 0x7f2d8805e110 con 0x7f2d940ffd60 2024-09-13T21:46:30.601 INFO:teuthology.orchestra.run.smithi088.stdout:e20 2024-09-13T21:46:30.601 INFO:teuthology.orchestra.run.smithi088.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:46:30.601 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:46:30.601 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:46:30.602 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:46:30.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:46:30.602 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:46:30.602 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:46:30.602 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 20 2024-09-13T21:46:30.603 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:46:30.603 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:46:30.603 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:46:30.603 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:46:30.603 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:46:30.603 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:46:30.603 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:46:30.604 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:46:30.605 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:46:30.606 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:30.606 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.600+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2d7c06e680 msgr2=0x7f2d7c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.600+0000 7f2d9a552700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2d7c06e680 0x7f2d7c070b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009c60 tx=0x7f2d84009260 comp rx=0 tx=0).stop 2024-09-13T21:46:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.600+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 msgr2=0x7f2d94195350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.600+0000 7f2d9a552700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 0x7f2d94195350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d880059d0 tx=0x7f2d8801a850 comp rx=0 tx=0).stop 2024-09-13T21:46:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.601+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 shutdown_connections 2024-09-13T21:46:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.601+0000 7f2d9a552700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2d7c06e680 0x7f2d7c070b30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.601+0000 7f2d9a552700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d940ff3c0 0x7f2d94194e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.601+0000 7f2d9a552700 1 --2- 172.21.15.88:0/1921753332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d940ffd60 0x7f2d94195350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.601+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 >> 172.21.15.88:0/1921753332 conn(0x7f2d940fac80 msgr2=0x7f2d940fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.601+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 shutdown_connections 2024-09-13T21:46:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.601+0000 7f2d9a552700 1 -- 172.21.15.88:0/1921753332 wait complete. 2024-09-13T21:46:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:46:30.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.720+0000 7f52b71f9700 1 -- 172.21.15.88:0/1778985874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101d30 msgr2=0x7f52b010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.720+0000 7f52b71f9700 1 --2- 172.21.15.88:0/1778985874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101d30 0x7f52b010a230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f529c009910 tx=0x7f529c009c20 comp rx=0 tx=0).stop 2024-09-13T21:46:30.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.720+0000 7f52b71f9700 1 -- 172.21.15.88:0/1778985874 shutdown_connections 2024-09-13T21:46:30.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.720+0000 7f52b71f9700 1 --2- 172.21.15.88:0/1778985874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101d30 0x7f52b010a230 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.720+0000 7f52b71f9700 1 --2- 172.21.15.88:0/1778985874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52b0101420 0x7f52b01017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.720+0000 7f52b71f9700 1 -- 172.21.15.88:0/1778985874 >> 172.21.15.88:0/1778985874 conn(0x7f52b00fac60 msgr2=0x7f52b00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.720+0000 7f52b71f9700 1 -- 172.21.15.88:0/1778985874 shutdown_connections 2024-09-13T21:46:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.720+0000 7f52b71f9700 1 -- 172.21.15.88:0/1778985874 wait complete. 2024-09-13T21:46:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b71f9700 1 Processor -- start 2024-09-13T21:46:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b71f9700 1 -- start start 2024-09-13T21:46:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b71f9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101420 0x7f52b00ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b71f9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52b0101d30 0x7f52b00ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b71f9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b00ffb00 con 0x7f52b0101420 2024-09-13T21:46:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b71f9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b00ffc40 con 0x7f52b0101d30 2024-09-13T21:46:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b4f95700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101420 0x7f52b00ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b4f95700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101420 0x7f52b00ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60468/0 (socket says 172.21.15.88:60468) 2024-09-13T21:46:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b4f95700 1 -- 172.21.15.88:0/3050970582 learned_addr learned my addr 172.21.15.88:0/3050970582 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:46:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b4f95700 1 -- 172.21.15.88:0/3050970582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52b0101d30 msgr2=0x7f52b00ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b4f95700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52b0101d30 0x7f52b00ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b4f95700 1 -- 172.21.15.88:0/3050970582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c0095f0 con 0x7f52b0101420 2024-09-13T21:46:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.721+0000 7f52b4f95700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101420 0x7f52b00ff080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c930 tx=0x7f52a400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.722+0000 7f52adffb700 1 -- 172.21.15.88:0/3050970582 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a4007ad0 con 0x7f52b0101420 2024-09-13T21:46:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.722+0000 7f52adffb700 1 -- 172.21.15.88:0/3050970582 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52a4007c30 con 0x7f52b0101420 2024-09-13T21:46:30.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.722+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b01a2020 con 0x7f52b0101420 2024-09-13T21:46:30.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.722+0000 7f52adffb700 1 -- 172.21.15.88:0/3050970582 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a4018610 con 0x7f52b0101420 2024-09-13T21:46:30.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.722+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b01a2380 con 0x7f52b0101420 2024-09-13T21:46:30.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.723+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b01078a0 con 0x7f52b0101420 2024-09-13T21:46:30.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.724+0000 7f52adffb700 1 -- 172.21.15.88:0/3050970582 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f52a400f450 con 0x7f52b0101420 2024-09-13T21:46:30.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.724+0000 7f52adffb700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f52a006e680 0x7f52a0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:30.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.724+0000 7f52adffb700 1 -- 172.21.15.88:0/3050970582 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f52a408e7d0 con 0x7f52b0101420 2024-09-13T21:46:30.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.724+0000 7f52affff700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f52a006e680 0x7f52a0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:30.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.725+0000 7f52affff700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f52a006e680 0x7f52a0070b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f529c00b5c0 tx=0x7f529c005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:30.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.729+0000 7f52adffb700 1 -- 172.21.15.88:0/3050970582 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f52a4057a20 con 0x7f52b0101420 2024-09-13T21:46:30.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.964+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52b0061190 con 0x7f52a006e680 2024-09-13T21:46:30.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.966+0000 7f52adffb700 1 -- 172.21.15.88:0/3050970582 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f52b0061190 con 0x7f52a006e680 2024-09-13T21:46:30.967 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:46:30.967 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:46:30.967 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "8/23 daemons upgraded", 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:46:30.968 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:46:30.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f52a006e680 msgr2=0x7f52a0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f52a006e680 0x7f52a0070b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f529c00b5c0 tx=0x7f529c005fd0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101420 msgr2=0x7f52b00ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101420 0x7f52b00ff080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c930 tx=0x7f52a400ccf0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 shutdown_connections 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f52a006e680 0x7f52a0070b30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52b0101420 0x7f52b00ff080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 --2- 172.21.15.88:0/3050970582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52b0101d30 0x7f52b00ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 >> 172.21.15.88:0/3050970582 conn(0x7f52b00fac60 msgr2=0x7f52b01049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 shutdown_connections 2024-09-13T21:46:30.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:30.968+0000 7f52b71f9700 1 -- 172.21.15.88:0/3050970582 wait complete. 2024-09-13T21:46:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.080+0000 7f599778d700 1 -- 172.21.15.88:0/2005824926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ff3c0 msgr2=0x7f59900ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.080+0000 7f599778d700 1 --2- 172.21.15.88:0/2005824926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ff3c0 0x7f59900ff790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f598c009910 tx=0x7f598c009c20 comp rx=0 tx=0).stop 2024-09-13T21:46:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.080+0000 7f599778d700 1 -- 172.21.15.88:0/2005824926 shutdown_connections 2024-09-13T21:46:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.080+0000 7f599778d700 1 --2- 172.21.15.88:0/2005824926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59900ffd60 0x7f5990103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.080+0000 7f599778d700 1 --2- 172.21.15.88:0/2005824926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ff3c0 0x7f59900ff790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.080+0000 7f599778d700 1 -- 172.21.15.88:0/2005824926 >> 172.21.15.88:0/2005824926 conn(0x7f59900fac80 msgr2=0x7f59900fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.080+0000 7f599778d700 1 -- 172.21.15.88:0/2005824926 shutdown_connections 2024-09-13T21:46:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.080+0000 7f599778d700 1 -- 172.21.15.88:0/2005824926 wait complete. 2024-09-13T21:46:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.081+0000 7f599778d700 1 Processor -- start 2024-09-13T21:46:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.081+0000 7f599778d700 1 -- start start 2024-09-13T21:46:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.081+0000 7f599778d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59900ff3c0 0x7f5990195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.081+0000 7f599778d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ffd60 0x7f59901963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.081+0000 7f599778d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990196a80 con 0x7f59900ffd60 2024-09-13T21:46:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.081+0000 7f599778d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599019a810 con 0x7f59900ff3c0 2024-09-13T21:46:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.081+0000 7f5994d28700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ffd60 0x7f59901963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f5994d28700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ffd60 0x7f59901963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60480/0 (socket says 172.21.15.88:60480) 2024-09-13T21:46:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f5994d28700 1 -- 172.21.15.88:0/2025993518 learned_addr learned my addr 172.21.15.88:0/2025993518 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:46:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f5995529700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59900ff3c0 0x7f5990195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f5994d28700 1 -- 172.21.15.88:0/2025993518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59900ff3c0 msgr2=0x7f5990195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f5994d28700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59900ff3c0 0x7f5990195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f5994d28700 1 -- 172.21.15.88:0/2025993518 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c0095f0 con 0x7f59900ffd60 2024-09-13T21:46:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f5994d28700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ffd60 0x7f59901963a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f598000e8f0 tx=0x7f598000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f59867fc700 1 -- 172.21.15.88:0/2025993518 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5980009790 con 0x7f59900ffd60 2024-09-13T21:46:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f59867fc700 1 -- 172.21.15.88:0/2025993518 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f598000c810 con 0x7f59900ffd60 2024-09-13T21:46:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.082+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599019aaf0 con 0x7f59900ffd60 2024-09-13T21:46:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.083+0000 7f59867fc700 1 -- 172.21.15.88:0/2025993518 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5980005580 con 0x7f59900ffd60 2024-09-13T21:46:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.083+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599019b040 con 0x7f59900ffd60 2024-09-13T21:46:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.084+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599004f2a0 con 0x7f59900ffd60 2024-09-13T21:46:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.084+0000 7f59867fc700 1 -- 172.21.15.88:0/2025993518 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f598000c980 con 0x7f59900ffd60 2024-09-13T21:46:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.085+0000 7f59867fc700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f597c06e680 0x7f597c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.085+0000 7f59867fc700 1 -- 172.21.15.88:0/2025993518 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5980014070 con 0x7f59900ffd60 2024-09-13T21:46:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.085+0000 7f5995529700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f597c06e680 0x7f597c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.086+0000 7f5995529700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f597c06e680 0x7f597c070b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f598c00b760 tx=0x7f598c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:31.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.092+0000 7f59867fc700 1 -- 172.21.15.88:0/2025993518 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5980057a40 con 0x7f59900ffd60 2024-09-13T21:46:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.436+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f599019b3b0 con 0x7f59900ffd60 2024-09-13T21:46:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.437+0000 7f59867fc700 1 -- 172.21.15.88:0/2025993518 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1350 (secure 0 0 0) 0x7f598005b100 con 0x7f59900ffd60 2024-09-13T21:46:31.439 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded 2024-09-13T21:46:31.439 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:46:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:46:31.439 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T21:46:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: osd.1 (root=default,host=smithi088) is down 2024-09-13T21:46:31.439 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded 2024-09-13T21:46:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-13T21:46:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-13T21:46:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-13T21:46:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-13T21:46:31.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f597c06e680 msgr2=0x7f597c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:31.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f597c06e680 0x7f597c070b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f598c00b760 tx=0x7f598c005a90 comp rx=0 tx=0).stop 2024-09-13T21:46:31.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ffd60 msgr2=0x7f59901963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ffd60 0x7f59901963a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f598000e8f0 tx=0x7f598000ec00 comp rx=0 tx=0).stop 2024-09-13T21:46:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 shutdown_connections 2024-09-13T21:46:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f597c06e680 0x7f597c070b30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59900ff3c0 0x7f5990195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 --2- 172.21.15.88:0/2025993518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59900ffd60 0x7f59901963a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 >> 172.21.15.88:0/2025993518 conn(0x7f59900fac80 msgr2=0x7f59900fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 shutdown_connections 2024-09-13T21:46:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:46:31.440+0000 7f599778d700 1 -- 172.21.15.88:0/2025993518 wait complete. 2024-09-13T21:46:31.482 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:31 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[104030]: 2024-09-13T21:46:31.260+0000 7f9c84dde640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-13T21:46:31.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:31 smithi088 ceph-mon[86843]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:31.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:31 smithi088 ceph-mon[86843]: from='client.44163 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:31.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:31 smithi088 ceph-mon[86843]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:31.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:31 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1921753332' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:46:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:31 smithi116 ceph-mon[65231]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:31 smithi116 ceph-mon[65231]: from='client.44163 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:31.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:31 smithi116 ceph-mon[65231]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:31.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:31 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1921753332' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:46:32.224 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:31 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[104030]: 2024-09-13T21:46:31.744+0000 7f9c84dde640 -1 osd.1 55 log_to_monitors true 2024-09-13T21:46:32.483 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:46:32 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[104030]: 2024-09-13T21:46:32.316+0000 7f9c7cb78640 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:46:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:32 smithi088 ceph-mon[86843]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:32 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2025993518' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:46:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:32 smithi088 ceph-mon[86843]: from='osd.1 [v2:172.21.15.88:6810/2897034870,v1:172.21.15.88:6811/2897034870]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T21:46:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:32.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:32 smithi116 ceph-mon[65231]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:32.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:32 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2025993518' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:46:32.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:32 smithi116 ceph-mon[65231]: from='osd.1 [v2:172.21.15.88:6810/2897034870,v1:172.21.15.88:6811/2897034870]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T21:46:32.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:32.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:33.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:33.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='osd.1 [v2:172.21.15.88:6810/2897034870,v1:172.21.15.88:6811/2897034870]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T21:46:33.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T21:46:33.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='osd.1 [v2:172.21.15.88:6810/2897034870,v1:172.21.15.88:6811/2897034870]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:46:33.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:33 smithi116 ceph-mon[65231]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T21:46:33.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:33.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='osd.1 [v2:172.21.15.88:6810/2897034870,v1:172.21.15.88:6811/2897034870]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T21:46:33.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T21:46:33.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='osd.1 [v2:172.21.15.88:6810/2897034870,v1:172.21.15.88:6811/2897034870]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:46:33.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:33 smithi088 ceph-mon[86843]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T21:46:34.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:34 smithi116 ceph-mon[65231]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:46:34.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:34 smithi116 ceph-mon[65231]: osd.1 [v2:172.21.15.88:6810/2897034870,v1:172.21.15.88:6811/2897034870] boot 2024-09-13T21:46:34.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:34 smithi116 ceph-mon[65231]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T21:46:34.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:34 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:46:34.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:34 smithi116 ceph-mon[65231]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:34.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:34 smithi116 ceph-mon[65231]: osdmap e60: 6 total, 6 up, 6 in 2024-09-13T21:46:34.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:34 smithi088 ceph-mon[86843]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:46:34.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:34 smithi088 ceph-mon[86843]: osd.1 [v2:172.21.15.88:6810/2897034870,v1:172.21.15.88:6811/2897034870] boot 2024-09-13T21:46:34.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:34 smithi088 ceph-mon[86843]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T21:46:34.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:34 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:46:34.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:34 smithi088 ceph-mon[86843]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:34.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:34 smithi088 ceph-mon[86843]: osdmap e60: 6 total, 6 up, 6 in 2024-09-13T21:46:37.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:37 smithi088 ceph-mon[86843]: pgmap v75: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:37 smithi116 ceph-mon[65231]: pgmap v75: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T21:46:38.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:38 smithi088 ceph-mon[86843]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded) 2024-09-13T21:46:38.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:38 smithi116 ceph-mon[65231]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded) 2024-09-13T21:46:39.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:39 smithi088 ceph-mon[86843]: pgmap v76: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:39.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:39 smithi116 ceph-mon[65231]: pgmap v76: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:41.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:41 smithi088 ceph-mon[86843]: pgmap v77: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:41 smithi116 ceph-mon[65231]: pgmap v77: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:43.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:43 smithi088 ceph-mon[86843]: pgmap v78: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:43 smithi116 ceph-mon[65231]: pgmap v78: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:45.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:45 smithi088 ceph-mon[86843]: pgmap v79: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:45 smithi116 ceph-mon[65231]: pgmap v79: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:47.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:47 smithi088 ceph-mon[86843]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:47 smithi116 ceph-mon[65231]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:48.368 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:46:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:46:49.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:49 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:46:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:49 smithi088 ceph-mon[86843]: Upgrade: osd.2 is safe to restart 2024-09-13T21:46:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:49 smithi088 ceph-mon[86843]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:46:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:49 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:46:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:49 smithi116 ceph-mon[65231]: Upgrade: osd.2 is safe to restart 2024-09-13T21:46:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:49 smithi116 ceph-mon[65231]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:46:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:46:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:50.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:50 smithi088 ceph-mon[86843]: Upgrade: Updating osd.2 2024-09-13T21:46:50.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:50 smithi088 ceph-mon[86843]: Deploying daemon osd.2 on smithi088 2024-09-13T21:46:50.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:50 smithi116 ceph-mon[65231]: Upgrade: Updating osd.2 2024-09-13T21:46:50.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:50 smithi116 ceph-mon[65231]: Deploying daemon osd.2 on smithi088 2024-09-13T21:46:51.426 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:51 smithi088 ceph-mon[86843]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:51 smithi116 ceph-mon[65231]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:52.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:52 smithi088 systemd[1]: Stopping Ceph osd.2 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:46:52.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:52 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[53739]: 2024-09-13T21:46:52.791+0000 7f89a5fa0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:46:52.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:52 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[53739]: 2024-09-13T21:46:52.791+0000 7f89a5fa0700 -1 osd.2 60 *** Got signal Terminated *** 2024-09-13T21:46:52.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:52 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[53739]: 2024-09-13T21:46:52.791+0000 7f89a5fa0700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:46:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:53 smithi116 ceph-mon[65231]: pgmap v83: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:53 smithi116 ceph-mon[65231]: osd.2 marked itself down and dead 2024-09-13T21:46:53.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:53 smithi088 ceph-mon[86843]: pgmap v83: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:53.642 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:53 smithi088 ceph-mon[86843]: osd.2 marked itself down and dead 2024-09-13T21:46:53.937 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:53 smithi088 podman[109409]: 2024-09-13 21:46:53.641204499 +0000 UTC m=+0.951589572 container died f6180a479fe9e9bf534f3cb1f3a0708242667db8c6732613390c1f88f30bc3a4 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20231212, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-09-13T21:46:54.233 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:54 smithi088 podman[109409]: 2024-09-13 21:46:54.034162516 +0000 UTC m=+1.344547592 container cleanup f6180a479fe9e9bf534f3cb1f3a0708242667db8c6732613390c1f88f30bc3a4 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, GIT_CLEAN=True, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T21:46:54.233 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:54 smithi088 bash[109409]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2 2024-09-13T21:46:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:54 smithi116 ceph-mon[65231]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:46:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:54 smithi116 ceph-mon[65231]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T21:46:54.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:54 smithi088 ceph-mon[86843]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:46:54.637 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:54 smithi088 ceph-mon[86843]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T21:46:54.637 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:54 smithi088 podman[109426]: 2024-09-13 21:46:54.302529749 +0000 UTC m=+0.654397400 container remove f6180a479fe9e9bf534f3cb1f3a0708242667db8c6732613390c1f88f30bc3a4 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T21:46:54.948 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:54 smithi088 podman[109516]: 2024-09-13 21:46:54.636718381 +0000 UTC m=+0.102121505 container create 2aa0c62ad42988300b936ff767f56c698ac8bb87f1a20ac5020b9bbfeb07b290 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, ceph=True) 2024-09-13T21:46:54.949 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:54 smithi088 podman[109516]: 2024-09-13 21:46:54.550436809 +0000 UTC m=+0.015839932 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:46:54.949 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:54 smithi088 podman[109516]: 2024-09-13 21:46:54.872861143 +0000 UTC m=+0.338264268 container init 2aa0c62ad42988300b936ff767f56c698ac8bb87f1a20ac5020b9bbfeb07b290 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:46:54.949 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:54 smithi088 podman[109516]: 2024-09-13 21:46:54.876187984 +0000 UTC m=+0.341591114 container start 2aa0c62ad42988300b936ff767f56c698ac8bb87f1a20ac5020b9bbfeb07b290 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T21:46:54.949 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:54 smithi088 podman[109516]: 2024-09-13 21:46:54.947680674 +0000 UTC m=+0.413083801 container attach 2aa0c62ad42988300b936ff767f56c698ac8bb87f1a20ac5020b9bbfeb07b290 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T21:46:55.232 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:55 smithi088 podman[109516]: 2024-09-13 21:46:55.08149597 +0000 UTC m=+0.546899093 container died 2aa0c62ad42988300b936ff767f56c698ac8bb87f1a20ac5020b9bbfeb07b290 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be) 2024-09-13T21:46:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:55 smithi116 ceph-mon[65231]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:55 smithi116 ceph-mon[65231]: osdmap e62: 6 total, 5 up, 6 in 2024-09-13T21:46:55.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:55 smithi088 ceph-mon[86843]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:55.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:55 smithi088 ceph-mon[86843]: osdmap e62: 6 total, 5 up, 6 in 2024-09-13T21:46:56.219 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:55 smithi088 podman[109538]: 2024-09-13 21:46:55.770887596 +0000 UTC m=+0.683192998 container remove 2aa0c62ad42988300b936ff767f56c698ac8bb87f1a20ac5020b9bbfeb07b290 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-13T21:46:56.219 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:55 smithi088 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T21:46:56.219 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:55 smithi088 systemd[1]: Stopped Ceph osd.2 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:46:56.219 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:55 smithi088 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.2.service: Consumed 51.639s CPU time. 2024-09-13T21:46:56.219 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 systemd[1]: Starting Ceph osd.2 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:46:56.483 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 podman[109639]: 2024-09-13 21:46:56.12040473 +0000 UTC m=+0.016471458 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:46:56.483 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 podman[109639]: 2024-09-13 21:46:56.269685796 +0000 UTC m=+0.165752526 container create 6730faf9ca87428d1f936d7a86242089c6c9b7a6c5b0196e335975201bc7f7ec (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T21:46:56.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 podman[109639]: 2024-09-13 21:46:56.530870727 +0000 UTC m=+0.426937455 container init 6730faf9ca87428d1f936d7a86242089c6c9b7a6c5b0196e335975201bc7f7ec (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-13T21:46:56.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 podman[109639]: 2024-09-13 21:46:56.534695318 +0000 UTC m=+0.430762055 container start 6730faf9ca87428d1f936d7a86242089c6c9b7a6c5b0196e335975201bc7f7ec (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T21:46:56.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 podman[109639]: 2024-09-13 21:46:56.630938501 +0000 UTC m=+0.527005258 container attach 6730faf9ca87428d1f936d7a86242089c6c9b7a6c5b0196e335975201bc7f7ec (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, GIT_CLEAN=True) 2024-09-13T21:46:56.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate[109653]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:46:56.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 bash[109639]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:46:56.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate[109653]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:46:56.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:56 smithi088 bash[109639]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:46:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:57 smithi116 ceph-mon[65231]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:57.693 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:57 smithi088 ceph-mon[86843]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:46:57.693 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate[109653]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T21:46:57.693 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 bash[109639]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T21:46:57.693 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate[109653]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T21:46:57.693 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 bash[109639]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T21:46:57.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate[109653]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T21:46:57.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 bash[109639]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T21:46:57.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate[109653]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T21:46:57.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 bash[109639]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T21:46:57.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate[109653]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T21:46:57.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 bash[109639]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T21:46:57.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate[109653]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T21:46:57.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 bash[109639]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T21:46:57.983 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate[109653]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T21:46:57.984 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 bash[109639]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T21:46:57.984 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:57 smithi088 podman[109639]: 2024-09-13 21:46:57.72038161 +0000 UTC m=+1.616448338 container died 6730faf9ca87428d1f936d7a86242089c6c9b7a6c5b0196e335975201bc7f7ec (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:46:58.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:58 smithi116 ceph-mon[65231]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:46:58.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:46:58 smithi116 ceph-mon[65231]: Health check failed: Degraded data redundancy: 44/360 objects degraded (12.222%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T21:46:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:58 smithi088 ceph-mon[86843]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:46:58.638 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:46:58 smithi088 ceph-mon[86843]: Health check failed: Degraded data redundancy: 44/360 objects degraded (12.222%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T21:46:58.638 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:58 smithi088 podman[109804]: 2024-09-13 21:46:58.435702605 +0000 UTC m=+0.709304965 container remove 6730faf9ca87428d1f936d7a86242089c6c9b7a6c5b0196e335975201bc7f7ec (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T21:46:58.906 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:58 smithi088 podman[109864]: 2024-09-13 21:46:58.636656799 +0000 UTC m=+0.108187266 container create c38a8f2ec340ce8d1c79a6db33ae2b16c6c211aa0fd4fcbdf635eb29d89fe0b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be) 2024-09-13T21:46:58.906 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:58 smithi088 podman[109864]: 2024-09-13 21:46:58.544370184 +0000 UTC m=+0.015900616 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:46:58.907 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:58 smithi088 podman[109864]: 2024-09-13 21:46:58.90597641 +0000 UTC m=+0.377506856 container init c38a8f2ec340ce8d1c79a6db33ae2b16c6c211aa0fd4fcbdf635eb29d89fe0b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-13T21:46:59.232 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:58 smithi088 podman[109864]: 2024-09-13 21:46:58.909161305 +0000 UTC m=+0.380691734 container start c38a8f2ec340ce8d1c79a6db33ae2b16c6c211aa0fd4fcbdf635eb29d89fe0b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T21:46:59.233 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:58 smithi088 ceph-osd[109884]: -- 172.21.15.88:0/3838727604 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5626dc6761e0 con 0x5626dc60c000 2024-09-13T21:46:59.233 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:58 smithi088 bash[109864]: c38a8f2ec340ce8d1c79a6db33ae2b16c6c211aa0fd4fcbdf635eb29d89fe0b9 2024-09-13T21:46:59.233 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:46:59 smithi088 systemd[1]: Started Ceph osd.2 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:47:00.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:00 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:00.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:00 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:00.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:00 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:00.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:00 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:00.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:00 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:00.388 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:00 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:01.051 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:47:00 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[109880]: 2024-09-13T21:47:00.789+0000 7f496606e640 -1 Falling back to public interface 2024-09-13T21:47:01.312 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:01 smithi088 ceph-mon[86843]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:01.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:01 smithi116 ceph-mon[65231]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 -- 172.21.15.88:0/609926399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 msgr2=0x7f77f00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 --2- 172.21.15.88:0/609926399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 0x7f77f00689b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009910 tx=0x7f77ec009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 -- 172.21.15.88:0/609926399 shutdown_connections 2024-09-13T21:47:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 --2- 172.21.15.88:0/609926399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 0x7f77f00689b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 --2- 172.21.15.88:0/609926399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77f0106320 0x7f77f01066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 -- 172.21.15.88:0/609926399 >> 172.21.15.88:0/609926399 conn(0x7f77f0075130 msgr2=0x7f77f0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 -- 172.21.15.88:0/609926399 shutdown_connections 2024-09-13T21:47:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 -- 172.21.15.88:0/609926399 wait complete. 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 Processor -- start 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.557+0000 7f77f7e38700 1 -- start start 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.558+0000 7f77f7e38700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 0x7f77f0195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.558+0000 7f77f7e38700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77f0106320 0x7f77f01963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.558+0000 7f77f7e38700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0196a80 con 0x7f77f0068540 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.558+0000 7f77f7e38700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f019a810 con 0x7f77f0106320 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.558+0000 7f77f5bd4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 0x7f77f0195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.558+0000 7f77f5bd4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 0x7f77f0195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33582/0 (socket says 172.21.15.88:33582) 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.558+0000 7f77f5bd4700 1 -- 172.21.15.88:0/3694618386 learned_addr learned my addr 172.21.15.88:0/3694618386 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.558+0000 7f77f53d3700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77f0106320 0x7f77f01963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.559+0000 7f77f5bd4700 1 -- 172.21.15.88:0/3694618386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77f0106320 msgr2=0x7f77f01963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.559+0000 7f77f5bd4700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77f0106320 0x7f77f01963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.559+0000 7f77f5bd4700 1 -- 172.21.15.88:0/3694618386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0095f0 con 0x7f77f0068540 2024-09-13T21:47:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.559+0000 7f77f5bd4700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 0x7f77f0195e60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77e800d8d0 tx=0x7f77e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.559+0000 7f77e2ffd700 1 -- 172.21.15.88:0/3694618386 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e8009940 con 0x7f77f0068540 2024-09-13T21:47:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.559+0000 7f77e2ffd700 1 -- 172.21.15.88:0/3694618386 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77e8010460 con 0x7f77f0068540 2024-09-13T21:47:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.559+0000 7f77e2ffd700 1 -- 172.21.15.88:0/3694618386 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e800f5f0 con 0x7f77f0068540 2024-09-13T21:47:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.559+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f019aaf0 con 0x7f77f0068540 2024-09-13T21:47:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.560+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f019b040 con 0x7f77f0068540 2024-09-13T21:47:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.561+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f0108770 con 0x7f77f0068540 2024-09-13T21:47:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.561+0000 7f77e2ffd700 1 -- 172.21.15.88:0/3694618386 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f77e80105d0 con 0x7f77f0068540 2024-09-13T21:47:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.562+0000 7f77e2ffd700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77dc06e680 0x7f77dc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.562+0000 7f77e2ffd700 1 -- 172.21.15.88:0/3694618386 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f77e808e510 con 0x7f77f0068540 2024-09-13T21:47:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.562+0000 7f77f53d3700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77dc06e680 0x7f77dc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.563+0000 7f77f53d3700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77dc06e680 0x7f77dc070b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f77f0197480 tx=0x7f77ec01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.567+0000 7f77e2ffd700 1 -- 172.21.15.88:0/3694618386 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f77e80577e0 con 0x7f77f0068540 2024-09-13T21:47:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.805+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77f019b370 con 0x7f77dc06e680 2024-09-13T21:47:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.807+0000 7f77e2ffd700 1 -- 172.21.15.88:0/3694618386 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f77f019b370 con 0x7f77dc06e680 2024-09-13T21:47:01.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.809+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77dc06e680 msgr2=0x7f77dc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:01.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.809+0000 7f77f7e38700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77dc06e680 0x7f77dc070b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f77f0197480 tx=0x7f77ec01a040 comp rx=0 tx=0).stop 2024-09-13T21:47:01.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.809+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 msgr2=0x7f77f0195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:01.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.809+0000 7f77f7e38700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 0x7f77f0195e60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77e800d8d0 tx=0x7f77e800dc90 comp rx=0 tx=0).stop 2024-09-13T21:47:01.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.809+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 shutdown_connections 2024-09-13T21:47:01.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.809+0000 7f77f7e38700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77dc06e680 0x7f77dc070b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:01.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.809+0000 7f77f7e38700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f0068540 0x7f77f0195e60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:01.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.809+0000 7f77f7e38700 1 --2- 172.21.15.88:0/3694618386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77f0106320 0x7f77f01963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:01.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.809+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 >> 172.21.15.88:0/3694618386 conn(0x7f77f0075130 msgr2=0x7f77f00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:01.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.810+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 shutdown_connections 2024-09-13T21:47:01.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.810+0000 7f77f7e38700 1 -- 172.21.15.88:0/3694618386 wait complete. 2024-09-13T21:47:01.821 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:47:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.926+0000 7f300899e700 1 -- 172.21.15.88:0/1549097507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ff190 msgr2=0x7f30040ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.926+0000 7f300899e700 1 --2- 172.21.15.88:0/1549097507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ff190 0x7f30040ff560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009910 tx=0x7f2ff4009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.926+0000 7f300899e700 1 -- 172.21.15.88:0/1549097507 shutdown_connections 2024-09-13T21:47:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.926+0000 7f300899e700 1 --2- 172.21.15.88:0/1549097507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30040ffb30 0x7f3004103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.926+0000 7f300899e700 1 --2- 172.21.15.88:0/1549097507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ff190 0x7f30040ff560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.926+0000 7f300899e700 1 -- 172.21.15.88:0/1549097507 >> 172.21.15.88:0/1549097507 conn(0x7f30040faa10 msgr2=0x7f30040fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.926+0000 7f300899e700 1 -- 172.21.15.88:0/1549097507 shutdown_connections 2024-09-13T21:47:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.926+0000 7f300899e700 1 -- 172.21.15.88:0/1549097507 wait complete. 2024-09-13T21:47:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.927+0000 7f300899e700 1 Processor -- start 2024-09-13T21:47:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.927+0000 7f300899e700 1 -- start start 2024-09-13T21:47:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.927+0000 7f300899e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30040ff190 0x7f3004100ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.927+0000 7f300899e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ffb30 0x7f30041010e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.927+0000 7f300899e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004101620 con 0x7f30040ffb30 2024-09-13T21:47:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.927+0000 7f300899e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004101760 con 0x7f30040ff190 2024-09-13T21:47:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.927+0000 7f3002ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ffb30 0x7f30041010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f3002ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ffb30 0x7f30041010e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33592/0 (socket says 172.21.15.88:33592) 2024-09-13T21:47:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f3002ffd700 1 -- 172.21.15.88:0/188570201 learned_addr learned my addr 172.21.15.88:0/188570201 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f30037fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30040ff190 0x7f3004100ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f3002ffd700 1 -- 172.21.15.88:0/188570201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30040ff190 msgr2=0x7f3004100ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f3002ffd700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30040ff190 0x7f3004100ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f3002ffd700 1 -- 172.21.15.88:0/188570201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff40095f0 con 0x7f30040ffb30 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f3002ffd700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ffb30 0x7f30041010e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800c8f0 tx=0x7f2ff800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f3000ff9700 1 -- 172.21.15.88:0/188570201 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff80078a0 con 0x7f30040ffb30 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f3000ff9700 1 -- 172.21.15.88:0/188570201 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ff800f450 con 0x7f30040ffb30 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30041a1e80 con 0x7f30040ffb30 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f3000ff9700 1 -- 172.21.15.88:0/188570201 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff8018610 con 0x7f30040ffb30 2024-09-13T21:47:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.928+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30041a2290 con 0x7f30040ffb30 2024-09-13T21:47:01.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.929+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3004062380 con 0x7f30040ffb30 2024-09-13T21:47:01.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.930+0000 7f3000ff9700 1 -- 172.21.15.88:0/188570201 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2ff800f5c0 con 0x7f30040ffb30 2024-09-13T21:47:01.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.931+0000 7f3000ff9700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fec06e680 0x7f2fec070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:01.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.931+0000 7f3000ff9700 1 -- 172.21.15.88:0/188570201 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2ff808e4f0 con 0x7f30040ffb30 2024-09-13T21:47:01.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.931+0000 7f30037fe700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fec06e680 0x7f2fec070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:01.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.931+0000 7f30037fe700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fec06e680 0x7f2fec070b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4006010 tx=0x7f2ff401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:01.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:01.935+0000 7f3000ff9700 1 -- 172.21.15.88:0/188570201 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2ff8057760 con 0x7f30040ffb30 2024-09-13T21:47:02.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.167+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30040fb760 con 0x7f2fec06e680 2024-09-13T21:47:02.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.169+0000 7f3000ff9700 1 -- 172.21.15.88:0/188570201 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f30040fb760 con 0x7f2fec06e680 2024-09-13T21:47:02.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fec06e680 msgr2=0x7f2fec070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fec06e680 0x7f2fec070b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4006010 tx=0x7f2ff401a040 comp rx=0 tx=0).stop 2024-09-13T21:47:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ffb30 msgr2=0x7f30041010e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ffb30 0x7f30041010e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800c8f0 tx=0x7f2ff800cc00 comp rx=0 tx=0).stop 2024-09-13T21:47:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 shutdown_connections 2024-09-13T21:47:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fec06e680 0x7f2fec070b30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30040ff190 0x7f3004100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 --2- 172.21.15.88:0/188570201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30040ffb30 0x7f30041010e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 >> 172.21.15.88:0/188570201 conn(0x7f30040faa10 msgr2=0x7f3004103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 shutdown_connections 2024-09-13T21:47:02.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.171+0000 7f300899e700 1 -- 172.21.15.88:0/188570201 wait complete. 2024-09-13T21:47:02.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.281+0000 7f07e0d97700 1 -- 172.21.15.88:0/2897551809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 msgr2=0x7f07dc10a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.281+0000 7f07e0d97700 1 --2- 172.21.15.88:0/2897551809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 0x7f07dc10a220 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009910 tx=0x7f07d0009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:02.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.281+0000 7f07e0d97700 1 -- 172.21.15.88:0/2897551809 shutdown_connections 2024-09-13T21:47:02.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.281+0000 7f07e0d97700 1 --2- 172.21.15.88:0/2897551809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 0x7f07dc10a220 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.281+0000 7f07e0d97700 1 --2- 172.21.15.88:0/2897551809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc101410 0x7f07dc1017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.281+0000 7f07e0d97700 1 -- 172.21.15.88:0/2897551809 >> 172.21.15.88:0/2897551809 conn(0x7f07dc0fac90 msgr2=0x7f07dc0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:02.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.281+0000 7f07e0d97700 1 -- 172.21.15.88:0/2897551809 shutdown_connections 2024-09-13T21:47:02.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.281+0000 7f07e0d97700 1 -- 172.21.15.88:0/2897551809 wait complete. 2024-09-13T21:47:02.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.282+0000 7f07e0d97700 1 Processor -- start 2024-09-13T21:47:02.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.282+0000 7f07e0d97700 1 -- start start 2024-09-13T21:47:02.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.282+0000 7f07e0d97700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc101410 0x7f07dc195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:02.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.282+0000 7f07e0d97700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 0x7f07dc196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:02.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.282+0000 7f07e0d97700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc196a60 con 0x7f07dc101d20 2024-09-13T21:47:02.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.282+0000 7f07e0d97700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc19a7f0 con 0x7f07dc101410 2024-09-13T21:47:02.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07d9d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 0x7f07dc196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:02.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07d9d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 0x7f07dc196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33610/0 (socket says 172.21.15.88:33610) 2024-09-13T21:47:02.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07d9d9b700 1 -- 172.21.15.88:0/1990736943 learned_addr learned my addr 172.21.15.88:0/1990736943 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:02.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07da59c700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc101410 0x7f07dc195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:02.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07d9d9b700 1 -- 172.21.15.88:0/1990736943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc101410 msgr2=0x7f07dc195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07d9d9b700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc101410 0x7f07dc195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07d9d9b700 1 -- 172.21.15.88:0/1990736943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00095f0 con 0x7f07dc101d20 2024-09-13T21:47:02.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07d9d9b700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 0x7f07dc196380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07d0006010 tx=0x7f07d000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:02.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07cb7fe700 1 -- 172.21.15.88:0/1990736943 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d001d070 con 0x7f07dc101d20 2024-09-13T21:47:02.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.283+0000 7f07cb7fe700 1 -- 172.21.15.88:0/1990736943 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07d0005dc0 con 0x7f07dc101d20 2024-09-13T21:47:02.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.284+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc19aa70 con 0x7f07dc101d20 2024-09-13T21:47:02.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.284+0000 7f07cb7fe700 1 -- 172.21.15.88:0/1990736943 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d0017400 con 0x7f07dc101d20 2024-09-13T21:47:02.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.284+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc19af60 con 0x7f07dc101d20 2024-09-13T21:47:02.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.285+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc107890 con 0x7f07dc101d20 2024-09-13T21:47:02.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.285+0000 7f07cb7fe700 1 -- 172.21.15.88:0/1990736943 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f07d0017560 con 0x7f07dc101d20 2024-09-13T21:47:02.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.286+0000 7f07cb7fe700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07c406e680 0x7f07c4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:02.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.286+0000 7f07cb7fe700 1 -- 172.21.15.88:0/1990736943 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f07d008f9b0 con 0x7f07dc101d20 2024-09-13T21:47:02.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.286+0000 7f07da59c700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07c406e680 0x7f07c4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:02.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.286+0000 7f07da59c700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07c406e680 0x7f07c4070b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07cc005950 tx=0x7f07cc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:02.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.292+0000 7f07cb7fe700 1 -- 172.21.15.88:0/1990736943 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f07d0058cf0 con 0x7f07dc101d20 2024-09-13T21:47:02.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.528+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f07dc02cca0 con 0x7f07c406e680 2024-09-13T21:47:02.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.537+0000 7f07cb7fe700 1 -- 172.21.15.88:0/1990736943 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f07dc02cca0 con 0x7f07c406e680 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (4m) 33s ago 14m 25.3M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (14m) 33s ago 14m 8280k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (13m) 89s ago 13m 7918k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (97s) 33s ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (93s) 89s ago 13m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (3m) 33s ago 14m 78.0M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (8m) 33s ago 8m 119M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (8m) 33s ago 8m 16.4M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:47:02.539 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (8m) 89s ago 8m 17.3M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (8m) 89s ago 8m 122M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (5m) 33s ago 15m 500M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (4m) 89s ago 13m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (2m) 33s ago 15m 49.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (2m) 89s ago 13m 34.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (4m) 33s ago 14m 15.8M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (4m) 89s ago 13m 17.2M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (74s) 33s ago 12m 87.7M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (39s) 33s ago 12m 12.1M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 1899bd970e44 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 starting - - - 1216M 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (11m) 89s ago 11m 272M 2240M 18.2.0 dc2bc1663786 a5d7fbb8057d 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (10m) 89s ago 10m 255M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:47:02.540 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (10m) 89s ago 10m 229M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:47:02.541 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (4m) 33s ago 14m 78.3M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:47:02.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07c406e680 msgr2=0x7f07c4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07c406e680 0x7f07c4070b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07cc005950 tx=0x7f07cc00b410 comp rx=0 tx=0).stop 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 msgr2=0x7f07dc196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 0x7f07dc196380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07d0006010 tx=0x7f07d000bd70 comp rx=0 tx=0).stop 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 shutdown_connections 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f07c406e680 0x7f07c4070b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc101410 0x7f07dc195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 --2- 172.21.15.88:0/1990736943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07dc101d20 0x7f07dc196380 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 >> 172.21.15.88:0/1990736943 conn(0x7f07dc0fac90 msgr2=0x7f07dc1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 shutdown_connections 2024-09-13T21:47:02.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.539+0000 7f07e0d97700 1 -- 172.21.15.88:0/1990736943 wait complete. 2024-09-13T21:47:02.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.644+0000 7fa4e2b75700 1 -- 172.21.15.88:0/289247967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc100e80 msgr2=0x7fa4dc104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.644+0000 7fa4e2b75700 1 --2- 172.21.15.88:0/289247967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc100e80 0x7fa4dc104e50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009910 tx=0x7fa4c8009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.645+0000 7fa4e2b75700 1 -- 172.21.15.88:0/289247967 shutdown_connections 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.645+0000 7fa4e2b75700 1 --2- 172.21.15.88:0/289247967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc100e80 0x7fa4dc104e50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.645+0000 7fa4e2b75700 1 --2- 172.21.15.88:0/289247967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4dc1004e0 0x7fa4dc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.645+0000 7fa4e2b75700 1 -- 172.21.15.88:0/289247967 >> 172.21.15.88:0/289247967 conn(0x7fa4dc0fbda0 msgr2=0x7fa4dc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.645+0000 7fa4e2b75700 1 -- 172.21.15.88:0/289247967 shutdown_connections 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.645+0000 7fa4e2b75700 1 -- 172.21.15.88:0/289247967 wait complete. 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.645+0000 7fa4e2b75700 1 Processor -- start 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.645+0000 7fa4e2b75700 1 -- start start 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e2b75700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc1004e0 0x7fa4dc195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e2b75700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4dc100e80 0x7fa4dc196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e2b75700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc196b50 con 0x7fa4dc1004e0 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e2b75700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc19a8e0 con 0x7fa4dc100e80 2024-09-13T21:47:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e0911700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc1004e0 0x7fa4dc195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e0911700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc1004e0 0x7fa4dc195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33626/0 (socket says 172.21.15.88:33626) 2024-09-13T21:47:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e0911700 1 -- 172.21.15.88:0/1119411787 learned_addr learned my addr 172.21.15.88:0/1119411787 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4dbfff700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4dc100e80 0x7fa4dc196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e0911700 1 -- 172.21.15.88:0/1119411787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4dc100e80 msgr2=0x7fa4dc196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e0911700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4dc100e80 0x7fa4dc196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e0911700 1 -- 172.21.15.88:0/1119411787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c80095f0 con 0x7fa4dc1004e0 2024-09-13T21:47:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e0911700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc1004e0 0x7fa4dc195f30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000d8d0 tx=0x7fa4d000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4d9ffb700 1 -- 172.21.15.88:0/1119411787 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4d00098a0 con 0x7fa4dc1004e0 2024-09-13T21:47:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4d9ffb700 1 -- 172.21.15.88:0/1119411787 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4d0010460 con 0x7fa4dc1004e0 2024-09-13T21:47:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.646+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc19abc0 con 0x7fa4dc1004e0 2024-09-13T21:47:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.647+0000 7fa4d9ffb700 1 -- 172.21.15.88:0/1119411787 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4d000f5f0 con 0x7fa4dc1004e0 2024-09-13T21:47:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.647+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc19b110 con 0x7fa4dc1004e0 2024-09-13T21:47:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.648+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc108850 con 0x7fa4dc1004e0 2024-09-13T21:47:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.648+0000 7fa4d9ffb700 1 -- 172.21.15.88:0/1119411787 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa4d0009a00 con 0x7fa4dc1004e0 2024-09-13T21:47:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.649+0000 7fa4d9ffb700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa4cc06e680 0x7fa4cc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.649+0000 7fa4d9ffb700 1 -- 172.21.15.88:0/1119411787 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa4d008e3a0 con 0x7fa4dc1004e0 2024-09-13T21:47:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.649+0000 7fa4dbfff700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa4cc06e680 0x7fa4cc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.649+0000 7fa4dbfff700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa4cc06e680 0x7fa4cc070b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc197550 tx=0x7fa4c801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:02.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.654+0000 7fa4d9ffb700 1 -- 172.21.15.88:0/1119411787 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4d0057670 con 0x7fa4dc1004e0 2024-09-13T21:47:02.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.954+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa4dc19b380 con 0x7fa4dc1004e0 2024-09-13T21:47:02.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.954+0000 7fa4d9ffb700 1 -- 172.21.15.88:0/1119411787 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fa4d005ad30 con 0x7fa4dc1004e0 2024-09-13T21:47:02.956 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:47:02.956 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:47:02.956 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-09-13T21:47:02.957 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:47:02.958 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:47:02.958 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:47:02.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa4cc06e680 msgr2=0x7fa4cc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa4cc06e680 0x7fa4cc070b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc197550 tx=0x7fa4c801a040 comp rx=0 tx=0).stop 2024-09-13T21:47:02.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc1004e0 msgr2=0x7fa4dc195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:02.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc1004e0 0x7fa4dc195f30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000d8d0 tx=0x7fa4d000dbe0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 shutdown_connections 2024-09-13T21:47:02.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa4cc06e680 0x7fa4cc070b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4dc1004e0 0x7fa4dc195f30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 --2- 172.21.15.88:0/1119411787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4dc100e80 0x7fa4dc196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:02.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 >> 172.21.15.88:0/1119411787 conn(0x7fa4dc0fbda0 msgr2=0x7fa4dc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:02.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 shutdown_connections 2024-09-13T21:47:02.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:02.957+0000 7fa4e2b75700 1 -- 172.21.15.88:0/1119411787 wait complete. 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.064+0000 7f7221a91700 1 -- 172.21.15.88:0/2830965639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ff3c0 msgr2=0x7f721c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.064+0000 7f7221a91700 1 --2- 172.21.15.88:0/2830965639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ff3c0 0x7f721c0ff790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f720c009910 tx=0x7f720c009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.064+0000 7f7221a91700 1 -- 172.21.15.88:0/2830965639 shutdown_connections 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.064+0000 7f7221a91700 1 --2- 172.21.15.88:0/2830965639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721c0ffd60 0x7f721c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.064+0000 7f7221a91700 1 --2- 172.21.15.88:0/2830965639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ff3c0 0x7f721c0ff790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.064+0000 7f7221a91700 1 -- 172.21.15.88:0/2830965639 >> 172.21.15.88:0/2830965639 conn(0x7f721c0fac80 msgr2=0x7f721c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.064+0000 7f7221a91700 1 -- 172.21.15.88:0/2830965639 shutdown_connections 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.064+0000 7f7221a91700 1 -- 172.21.15.88:0/2830965639 wait complete. 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.064+0000 7f7221a91700 1 Processor -- start 2024-09-13T21:47:03.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7221a91700 1 -- start start 2024-09-13T21:47:03.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7221a91700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721c0ff3c0 0x7f721c195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:03.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7221a91700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ffd60 0x7f721c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:03.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7221a91700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c196a80 con 0x7f721c0ffd60 2024-09-13T21:47:03.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7221a91700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c19a810 con 0x7f721c0ff3c0 2024-09-13T21:47:03.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7213fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ffd60 0x7f721c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:03.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7213fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ffd60 0x7f721c1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33634/0 (socket says 172.21.15.88:33634) 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7213fff700 1 -- 172.21.15.88:0/3725498759 learned_addr learned my addr 172.21.15.88:0/3725498759 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7213fff700 1 -- 172.21.15.88:0/3725498759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721c0ff3c0 msgr2=0x7f721c195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f721b7fe700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721c0ff3c0 0x7f721c195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7213fff700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721c0ff3c0 0x7f721c195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7213fff700 1 -- 172.21.15.88:0/3725498759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c0095f0 con 0x7f721c0ffd60 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7213fff700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ffd60 0x7f721c1963a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f720400d900 tx=0x7f720400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f72197fa700 1 -- 172.21.15.88:0/3725498759 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7204009900 con 0x7f721c0ffd60 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f72197fa700 1 -- 172.21.15.88:0/3725498759 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7204010460 con 0x7f721c0ffd60 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c19aaf0 con 0x7f721c0ffd60 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.065+0000 7f72197fa700 1 -- 172.21.15.88:0/3725498759 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f720400f5f0 con 0x7f721c0ffd60 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.066+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c19b040 con 0x7f721c0ffd60 2024-09-13T21:47:03.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.067+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c04f2a0 con 0x7f721c0ffd60 2024-09-13T21:47:03.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.067+0000 7f72197fa700 1 -- 172.21.15.88:0/3725498759 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f72040105d0 con 0x7f721c0ffd60 2024-09-13T21:47:03.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.067+0000 7f72197fa700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f720806e680 0x7f7208070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:03.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.068+0000 7f72197fa700 1 -- 172.21.15.88:0/3725498759 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f720408e450 con 0x7f721c0ffd60 2024-09-13T21:47:03.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.068+0000 7f721b7fe700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f720806e680 0x7f7208070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:03.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.068+0000 7f721b7fe700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f720806e680 0x7f7208070b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f720c006010 tx=0x7f720c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:03.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.072+0000 7f72197fa700 1 -- 172.21.15.88:0/3725498759 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f72040576a0 con 0x7f721c0ffd60 2024-09-13T21:47:03.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:03 smithi088 ceph-mon[86843]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:03 smithi088 ceph-mon[86843]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:03 smithi088 ceph-mon[86843]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:03.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:03 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1119411787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:03.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.343+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f721c1971c0 con 0x7f721c0ffd60 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.344+0000 7f72197fa700 1 -- 172.21.15.88:0/3725498759 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1923 (secure 0 0 0) 0x7f720405ad60 con 0x7f721c0ffd60 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout:e20 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 20 2024-09-13T21:47:03.346 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:47:03.347 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:47:03.348 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:47:03.349 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:03.349 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:47:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:47:03.349 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:47:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:47:03.349 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:03.349 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f720806e680 msgr2=0x7f7208070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f720806e680 0x7f7208070b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f720c006010 tx=0x7f720c00b540 comp rx=0 tx=0).stop 2024-09-13T21:47:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ffd60 msgr2=0x7f721c1963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ffd60 0x7f721c1963a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f720400d900 tx=0x7f720400dcc0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 shutdown_connections 2024-09-13T21:47:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f720806e680 0x7f7208070b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721c0ff3c0 0x7f721c195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 --2- 172.21.15.88:0/3725498759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f721c0ffd60 0x7f721c1963a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 >> 172.21.15.88:0/3725498759 conn(0x7f721c0fac80 msgr2=0x7f721c0fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 shutdown_connections 2024-09-13T21:47:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.346+0000 7f7221a91700 1 -- 172.21.15.88:0/3725498759 wait complete. 2024-09-13T21:47:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:47:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.458+0000 7fc56088a700 1 -- 172.21.15.88:0/2203462466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 msgr2=0x7fc55c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.458+0000 7fc56088a700 1 --2- 172.21.15.88:0/2203462466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 0x7fc55c103d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc550009910 tx=0x7fc550009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.458+0000 7fc56088a700 1 -- 172.21.15.88:0/2203462466 shutdown_connections 2024-09-13T21:47:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.458+0000 7fc56088a700 1 --2- 172.21.15.88:0/2203462466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 0x7fc55c103d30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.458+0000 7fc56088a700 1 --2- 172.21.15.88:0/2203462466 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc55c0ff3c0 0x7fc55c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.458+0000 7fc56088a700 1 -- 172.21.15.88:0/2203462466 >> 172.21.15.88:0/2203462466 conn(0x7fc55c0fac80 msgr2=0x7fc55c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.459+0000 7fc56088a700 1 -- 172.21.15.88:0/2203462466 shutdown_connections 2024-09-13T21:47:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.459+0000 7fc56088a700 1 -- 172.21.15.88:0/2203462466 wait complete. 2024-09-13T21:47:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.459+0000 7fc56088a700 1 Processor -- start 2024-09-13T21:47:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.459+0000 7fc56088a700 1 -- start start 2024-09-13T21:47:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc56088a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc55c0ff3c0 0x7fc55c194db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc56088a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 0x7fc55c1952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc56088a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c1959d0 con 0x7fc55c0ffd60 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc56088a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c1996f0 con 0x7fc55c0ff3c0 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc559d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 0x7fc55c1952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc559d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 0x7fc55c1952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33652/0 (socket says 172.21.15.88:33652) 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc559d9b700 1 -- 172.21.15.88:0/2646800687 learned_addr learned my addr 172.21.15.88:0/2646800687 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc55a59c700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc55c0ff3c0 0x7fc55c194db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc559d9b700 1 -- 172.21.15.88:0/2646800687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc55c0ff3c0 msgr2=0x7fc55c194db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc559d9b700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc55c0ff3c0 0x7fc55c194db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc559d9b700 1 -- 172.21.15.88:0/2646800687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500095f0 con 0x7fc55c0ffd60 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc559d9b700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 0x7fc55c1952f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc5500092e0 tx=0x7fc55000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc54b7fe700 1 -- 172.21.15.88:0/2646800687 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc55001f070 con 0x7fc55c0ffd60 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc54b7fe700 1 -- 172.21.15.88:0/2646800687 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc550019610 con 0x7fc55c0ffd60 2024-09-13T21:47:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc54b7fe700 1 -- 172.21.15.88:0/2646800687 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc55000f690 con 0x7fc55c0ffd60 2024-09-13T21:47:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c199970 con 0x7fc55c0ffd60 2024-09-13T21:47:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.460+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c199e60 con 0x7fc55c0ffd60 2024-09-13T21:47:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.461+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c04f2a0 con 0x7fc55c0ffd60 2024-09-13T21:47:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.462+0000 7fc54b7fe700 1 -- 172.21.15.88:0/2646800687 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc550019780 con 0x7fc55c0ffd60 2024-09-13T21:47:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.462+0000 7fc54b7fe700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc54406e680 0x7fc544070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.462+0000 7fc54b7fe700 1 -- 172.21.15.88:0/2646800687 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc550091cd0 con 0x7fc55c0ffd60 2024-09-13T21:47:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.462+0000 7fc55a59c700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc54406e680 0x7fc544070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.463+0000 7fc55a59c700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc54406e680 0x7fc544070b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc54c005950 tx=0x7fc54c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:03.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.467+0000 7fc54b7fe700 1 -- 172.21.15.88:0/2646800687 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc55005afa0 con 0x7fc55c0ffd60 2024-09-13T21:47:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:03 smithi116 ceph-mon[65231]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:03 smithi116 ceph-mon[65231]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:03 smithi116 ceph-mon[65231]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:03.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:03 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1119411787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:03.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.697+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc55c19a0d0 con 0x7fc54406e680 2024-09-13T21:47:03.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.698+0000 7fc54b7fe700 1 -- 172.21.15.88:0/2646800687 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc55c19a0d0 con 0x7fc54406e680 2024-09-13T21:47:03.700 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:47:03.700 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:47:03.700 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:47:03.700 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:47:03.700 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:47:03.700 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:47:03.700 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-13T21:47:03.701 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-13T21:47:03.701 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:47:03.701 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "8/23 daemons upgraded", 2024-09-13T21:47:03.701 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:47:03.701 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:47:03.701 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:47:03.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.700+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc54406e680 msgr2=0x7fc544070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.700+0000 7fc56088a700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc54406e680 0x7fc544070b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc54c005950 tx=0x7fc54c0058e0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.700+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 msgr2=0x7fc55c1952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.700+0000 7fc56088a700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 0x7fc55c1952f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc5500092e0 tx=0x7fc55000be20 comp rx=0 tx=0).stop 2024-09-13T21:47:03.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.700+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 shutdown_connections 2024-09-13T21:47:03.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.700+0000 7fc56088a700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc54406e680 0x7fc544070b30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.700+0000 7fc56088a700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc55c0ff3c0 0x7fc55c194db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.701+0000 7fc56088a700 1 --2- 172.21.15.88:0/2646800687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55c0ffd60 0x7fc55c1952f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.701+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 >> 172.21.15.88:0/2646800687 conn(0x7fc55c0fac80 msgr2=0x7fc55c1035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:03.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.701+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 shutdown_connections 2024-09-13T21:47:03.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.701+0000 7fc56088a700 1 -- 172.21.15.88:0/2646800687 wait complete. 2024-09-13T21:47:03.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.807+0000 7f89ace46700 1 -- 172.21.15.88:0/2105076002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 msgr2=0x7f89a8100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.807+0000 7f89ace46700 1 --2- 172.21.15.88:0/2105076002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 0x7f89a8100040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f899c009910 tx=0x7f899c009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.807+0000 7f89ace46700 1 -- 172.21.15.88:0/2105076002 shutdown_connections 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.807+0000 7f89ace46700 1 --2- 172.21.15.88:0/2105076002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 0x7f89a8100040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.807+0000 7f89ace46700 1 --2- 172.21.15.88:0/2105076002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89a8104130 0x7f89a8104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.807+0000 7f89ace46700 1 -- 172.21.15.88:0/2105076002 >> 172.21.15.88:0/2105076002 conn(0x7f89a8075130 msgr2=0x7f89a8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.807+0000 7f89ace46700 1 -- 172.21.15.88:0/2105076002 shutdown_connections 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.807+0000 7f89ace46700 1 -- 172.21.15.88:0/2105076002 wait complete. 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89ace46700 1 Processor -- start 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89ace46700 1 -- start start 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89ace46700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 0x7f89a8194d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89ace46700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89a8104130 0x7f89a8195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89ace46700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8195950 con 0x7f89a80ffbd0 2024-09-13T21:47:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89ace46700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a81996e0 con 0x7f89a8104130 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89a659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 0x7f89a8194d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89a659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 0x7f89a8194d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33664/0 (socket says 172.21.15.88:33664) 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89a659c700 1 -- 172.21.15.88:0/2534436984 learned_addr learned my addr 172.21.15.88:0/2534436984 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89a5d9b700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89a8104130 0x7f89a8195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89a659c700 1 -- 172.21.15.88:0/2534436984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89a8104130 msgr2=0x7f89a8195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89a659c700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89a8104130 0x7f89a8195270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.808+0000 7f89a659c700 1 -- 172.21.15.88:0/2534436984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0095f0 con 0x7f89a80ffbd0 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.809+0000 7f89a659c700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 0x7f89a8194d30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f899800eab0 tx=0x7f899800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.809+0000 7f89977fe700 1 -- 172.21.15.88:0/2534436984 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8998013070 con 0x7f89a80ffbd0 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.809+0000 7f89977fe700 1 -- 172.21.15.88:0/2534436984 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8998017410 con 0x7f89a80ffbd0 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.809+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a8199960 con 0x7f89a80ffbd0 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.809+0000 7f89977fe700 1 -- 172.21.15.88:0/2534436984 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89980165e0 con 0x7f89a80ffbd0 2024-09-13T21:47:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.809+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a8199eb0 con 0x7f89a80ffbd0 2024-09-13T21:47:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.810+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a804f2a0 con 0x7f89a80ffbd0 2024-09-13T21:47:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.810+0000 7f89977fe700 1 -- 172.21.15.88:0/2534436984 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8998017580 con 0x7f89a80ffbd0 2024-09-13T21:47:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.811+0000 7f89977fe700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f899006e680 0x7f8990070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.811+0000 7f89977fe700 1 -- 172.21.15.88:0/2534436984 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f899808fde0 con 0x7f89a80ffbd0 2024-09-13T21:47:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.811+0000 7f89a5d9b700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f899006e680 0x7f8990070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.811+0000 7f89a5d9b700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f899006e680 0x7f8990070b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89a8196350 tx=0x7f899c009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:03.815+0000 7f89977fe700 1 -- 172.21.15.88:0/2534436984 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f89980590e0 con 0x7f89a80ffbd0 2024-09-13T21:47:04.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.181+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f89a8196090 con 0x7f89a80ffbd0 2024-09-13T21:47:04.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.182+0000 7f89977fe700 1 -- 172.21.15.88:0/2534436984 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1131 (secure 0 0 0) 0x7f899801c480 con 0x7f89a80ffbd0 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 44/360 objects degraded (12.222%), 12 pgs degraded 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout: osd.2 (root=default,host=smithi088) is down 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 44/360 objects degraded (12.222%), 12 pgs degraded 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-13T21:47:04.184 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-13T21:47:04.185 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-13T21:47:04.185 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-13T21:47:04.185 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-13T21:47:04.185 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-13T21:47:04.185 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-13T21:47:04.185 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f899006e680 msgr2=0x7f8990070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f899006e680 0x7f8990070b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89a8196350 tx=0x7f899c009f70 comp rx=0 tx=0).stop 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 msgr2=0x7f89a8194d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 0x7f89a8194d30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f899800eab0 tx=0x7f899800edc0 comp rx=0 tx=0).stop 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 shutdown_connections 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f899006e680 0x7f8990070b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89a80ffbd0 0x7f89a8194d30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 --2- 172.21.15.88:0/2534436984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89a8104130 0x7f89a8195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 >> 172.21.15.88:0/2534436984 conn(0x7f89a8075130 msgr2=0x7f89a80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 shutdown_connections 2024-09-13T21:47:04.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:04.184+0000 7f89ace46700 1 -- 172.21.15.88:0/2534436984 wait complete. 2024-09-13T21:47:04.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:04 smithi088 ceph-mon[86843]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:04.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:04 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3725498759' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:47:04.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:04 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:04.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:04 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:04 smithi116 ceph-mon[65231]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:04 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3725498759' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:47:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:04 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:04.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:04 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:05.325 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:05 smithi088 ceph-mon[86843]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:05.325 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:05 smithi088 ceph-mon[86843]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:05.325 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:05 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2534436984' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:47:05.325 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:05.325 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:05 smithi116 ceph-mon[65231]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:05 smithi116 ceph-mon[65231]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:05.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:05 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2534436984' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:47:05.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:05.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:06.482 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:47:06 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[109880]: 2024-09-13T21:47:06.279+0000 7f496606e640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-13T21:47:06.982 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:47:06 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[109880]: 2024-09-13T21:47:06.646+0000 7f496606e640 -1 osd.2 60 log_to_monitors true 2024-09-13T21:47:07.246 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:07 smithi088 ceph-mon[86843]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:07.247 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:07 smithi088 ceph-mon[86843]: from='osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T21:47:07.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:07 smithi116 ceph-mon[65231]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:07.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:07 smithi116 ceph-mon[65231]: from='osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T21:47:08.232 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:47:07 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[109880]: 2024-09-13T21:47:07.943+0000 7f4959e00640 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649]' entity='osd.2' 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:08.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:08.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:08.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:08.234 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:47:08.424 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T21:47:08.424 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T21:47:08.424 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649]' entity='osd.2' 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:08.425 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:47:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:09 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:47:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:09 smithi088 ceph-mon[86843]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T21:47:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:09 smithi088 ceph-mon[86843]: pgmap v94: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:09 smithi088 ceph-mon[86843]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:47:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:09 smithi088 ceph-mon[86843]: osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649] boot 2024-09-13T21:47:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:09 smithi088 ceph-mon[86843]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T21:47:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:09 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:47:09.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:09 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:47:09.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:09 smithi116 ceph-mon[65231]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T21:47:09.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:09 smithi116 ceph-mon[65231]: pgmap v94: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:09.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:09 smithi116 ceph-mon[65231]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:47:09.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:09 smithi116 ceph-mon[65231]: osd.2 [v2:172.21.15.88:6818/1659085649,v1:172.21.15.88:6819/1659085649] boot 2024-09-13T21:47:09.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:09 smithi116 ceph-mon[65231]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T21:47:09.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:09 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:47:11.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:10 smithi088 ceph-mon[86843]: osdmap e65: 6 total, 6 up, 6 in 2024-09-13T21:47:11.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:10 smithi088 ceph-mon[86843]: pgmap v97: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:11.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:10 smithi116 ceph-mon[65231]: osdmap e65: 6 total, 6 up, 6 in 2024-09-13T21:47:11.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:10 smithi116 ceph-mon[65231]: pgmap v97: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:13.472 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:13 smithi116 ceph-mon[65231]: pgmap v98: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:13.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:13 smithi088 ceph-mon[86843]: pgmap v98: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2024-09-13T21:47:14.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:14 smithi088 ceph-mon[86843]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/360 objects degraded (12.222%), 12 pgs degraded) 2024-09-13T21:47:14.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:14 smithi116 ceph-mon[65231]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/360 objects degraded (12.222%), 12 pgs degraded) 2024-09-13T21:47:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:15 smithi088 ceph-mon[86843]: pgmap v99: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:15.497 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:15 smithi116 ceph-mon[65231]: pgmap v99: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:17.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:17 smithi088 ceph-mon[86843]: pgmap v100: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:17.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:17.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:17 smithi116 ceph-mon[65231]: pgmap v100: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:19.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:19 smithi088 ceph-mon[86843]: pgmap v101: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:19 smithi116 ceph-mon[65231]: pgmap v101: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:21.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:21 smithi088 ceph-mon[86843]: pgmap v102: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:21 smithi116 ceph-mon[65231]: pgmap v102: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:23.476 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:23 smithi116 ceph-mon[65231]: pgmap v103: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:23.477 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:23.477 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:47:23.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:23 smithi088 ceph-mon[86843]: pgmap v103: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:23.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:23.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:47:24.472 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:24 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:47:24.472 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:24 smithi116 ceph-mon[65231]: Upgrade: osd.3 is safe to restart 2024-09-13T21:47:24.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:24 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:47:24.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:24 smithi088 ceph-mon[86843]: Upgrade: osd.3 is safe to restart 2024-09-13T21:47:25.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:25 smithi088 ceph-mon[86843]: pgmap v104: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:25.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:25 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:25 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:47:25.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:25 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:25.563 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:25 smithi116 ceph-mon[65231]: pgmap v104: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:25.563 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:25 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:25.563 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:25 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:47:25.563 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:25 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:26.446 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:26 smithi116 ceph-mon[65231]: Upgrade: Updating osd.3 2024-09-13T21:47:26.446 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:26 smithi116 ceph-mon[65231]: Deploying daemon osd.3 on smithi116 2024-09-13T21:47:26.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:26 smithi088 ceph-mon[86843]: Upgrade: Updating osd.3 2024-09-13T21:47:26.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:26 smithi088 ceph-mon[86843]: Deploying daemon osd.3 on smithi116 2024-09-13T21:47:27.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:27 smithi088 ceph-mon[86843]: pgmap v105: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:27.564 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:27 smithi116 ceph-mon[65231]: pgmap v105: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:27.819 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:27 smithi116 systemd[1]: Stopping Ceph osd.3 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:47:28.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:27 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[39405]: 2024-09-13T21:47:27.833+0000 7f278430f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:47:28.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:27 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[39405]: 2024-09-13T21:47:27.833+0000 7f278430f700 -1 osd.3 65 *** Got signal Terminated *** 2024-09-13T21:47:28.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:27 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[39405]: 2024-09-13T21:47:27.833+0000 7f278430f700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:47:28.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:28 smithi088 ceph-mon[86843]: osd.3 marked itself down and dead 2024-09-13T21:47:28.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:28 smithi116 ceph-mon[65231]: osd.3 marked itself down and dead 2024-09-13T21:47:29.034 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:28 smithi116 podman[74291]: 2024-09-13 21:47:28.748171192 +0000 UTC m=+1.027975303 container died a5d7fbb8057d3c105a2ad6df0aff8e3faa756691d9e722540ce474656f041512 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, ceph=True, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T21:47:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:29 smithi116 ceph-mon[65231]: pgmap v106: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:29 smithi116 ceph-mon[65231]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:47:29.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:29 smithi116 ceph-mon[65231]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T21:47:29.346 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:29 smithi116 podman[74291]: 2024-09-13 21:47:29.232747352 +0000 UTC m=+1.512551462 container cleanup a5d7fbb8057d3c105a2ad6df0aff8e3faa756691d9e722540ce474656f041512 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-13T21:47:29.346 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:29 smithi116 bash[74291]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3 2024-09-13T21:47:29.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:29 smithi088 ceph-mon[86843]: pgmap v106: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:29.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:29 smithi088 ceph-mon[86843]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:47:29.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:29 smithi088 ceph-mon[86843]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T21:47:29.836 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:29 smithi116 podman[74316]: 2024-09-13 21:47:29.509619771 +0000 UTC m=+0.762322366 container remove a5d7fbb8057d3c105a2ad6df0aff8e3faa756691d9e722540ce474656f041512 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212) 2024-09-13T21:47:30.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:29 smithi116 podman[74409]: 2024-09-13 21:47:29.835325372 +0000 UTC m=+0.105628167 container create 1a16c008185d9542b50d9fa88ddf1c154a1c84109025a46e2eedd81bfe36b275 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T21:47:30.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:29 smithi116 podman[74409]: 2024-09-13 21:47:29.745375145 +0000 UTC m=+0.015677948 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:47:30.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:30 smithi116 podman[74409]: 2024-09-13 21:47:30.079309513 +0000 UTC m=+0.349612307 container init 1a16c008185d9542b50d9fa88ddf1c154a1c84109025a46e2eedd81bfe36b275 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T21:47:30.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:30 smithi116 podman[74409]: 2024-09-13 21:47:30.082925906 +0000 UTC m=+0.353228701 container start 1a16c008185d9542b50d9fa88ddf1c154a1c84109025a46e2eedd81bfe36b275 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T21:47:30.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:30 smithi088 ceph-mon[86843]: osdmap e67: 6 total, 5 up, 6 in 2024-09-13T21:47:30.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:30 smithi116 ceph-mon[65231]: osdmap e67: 6 total, 5 up, 6 in 2024-09-13T21:47:30.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:30 smithi116 podman[74409]: 2024-09-13 21:47:30.198462082 +0000 UTC m=+0.468764882 container attach 1a16c008185d9542b50d9fa88ddf1c154a1c84109025a46e2eedd81bfe36b275 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T21:47:30.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:30 smithi116 podman[74409]: 2024-09-13 21:47:30.276491365 +0000 UTC m=+0.546794161 container died 1a16c008185d9542b50d9fa88ddf1c154a1c84109025a46e2eedd81bfe36b275 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be) 2024-09-13T21:47:31.200 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:30 smithi116 podman[74432]: 2024-09-13 21:47:30.883152828 +0000 UTC m=+0.600974637 container remove 1a16c008185d9542b50d9fa88ddf1c154a1c84109025a46e2eedd81bfe36b275 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:47:31.200 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:30 smithi116 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T21:47:31.200 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:30 smithi116 systemd[1]: Stopped Ceph osd.3 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:47:31.200 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:30 smithi116 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 8.171s CPU time. 2024-09-13T21:47:31.200 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 systemd[1]: Starting Ceph osd.3 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:47:31.463 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:31 smithi116 ceph-mon[65231]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:31.464 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 podman[74531]: 2024-09-13 21:47:31.231262352 +0000 UTC m=+0.015545675 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:47:31.464 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 podman[74531]: 2024-09-13 21:47:31.334427033 +0000 UTC m=+0.118710394 container create bf66c87325f05ca40a112a9631bb90e6a26959e6bf685c0075275512f1657650 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T21:47:31.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:31 smithi088 ceph-mon[86843]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:31.846 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 podman[74531]: 2024-09-13 21:47:31.57838118 +0000 UTC m=+0.362664495 container init bf66c87325f05ca40a112a9631bb90e6a26959e6bf685c0075275512f1657650 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:47:31.846 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 podman[74531]: 2024-09-13 21:47:31.582061676 +0000 UTC m=+0.366344995 container start bf66c87325f05ca40a112a9631bb90e6a26959e6bf685c0075275512f1657650 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T21:47:31.846 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 podman[74531]: 2024-09-13 21:47:31.678309014 +0000 UTC m=+0.462592353 container attach bf66c87325f05ca40a112a9631bb90e6a26959e6bf685c0075275512f1657650 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T21:47:31.847 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate[74547]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:47:31.847 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 bash[74531]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:47:31.847 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate[74547]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:47:31.847 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:31 smithi116 bash[74531]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:47:32.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 3]}]: dispatch 2024-09-13T21:47:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]: dispatch 2024-09-13T21:47:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]: dispatch 2024-09-13T21:47:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 3]}]: dispatch 2024-09-13T21:47:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 3]}]: dispatch 2024-09-13T21:47:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]: dispatch 2024-09-13T21:47:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]: dispatch 2024-09-13T21:47:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:32.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:32.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate[74547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T21:47:32.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 bash[74531]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T21:47:32.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate[74547]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T21:47:32.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 bash[74531]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T21:47:32.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 3]}]: dispatch 2024-09-13T21:47:32.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]: dispatch 2024-09-13T21:47:32.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]: dispatch 2024-09-13T21:47:32.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 3]}]: dispatch 2024-09-13T21:47:32.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 3]}]: dispatch 2024-09-13T21:47:32.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]: dispatch 2024-09-13T21:47:32.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]: dispatch 2024-09-13T21:47:32.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:32.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:33.041 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate[74547]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T21:47:33.041 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 bash[74531]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T21:47:33.041 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate[74547]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T21:47:33.041 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 bash[74531]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T21:47:33.041 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate[74547]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T21:47:33.042 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 bash[74531]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T21:47:33.042 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate[74547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T21:47:33.042 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 bash[74531]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T21:47:33.042 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate[74547]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T21:47:33.042 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 bash[74531]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T21:47:33.042 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:32 smithi116 podman[74531]: 2024-09-13 21:47:32.752394768 +0000 UTC m=+1.536678095 container died bf66c87325f05ca40a112a9631bb90e6a26959e6bf685c0075275512f1657650 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T21:47:33.324 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-mon[65231]: pgmap v110: 65 pgs: 16 stale+active+clean, 49 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:33.324 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 3]}]': finished 2024-09-13T21:47:33.325 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]': finished 2024-09-13T21:47:33.325 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]': finished 2024-09-13T21:47:33.325 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 3]}]': finished 2024-09-13T21:47:33.325 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 3]}]': finished 2024-09-13T21:47:33.325 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]': finished 2024-09-13T21:47:33.325 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]': finished 2024-09-13T21:47:33.325 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-mon[65231]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T21:47:33.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:33 smithi088 ceph-mon[86843]: pgmap v110: 65 pgs: 16 stale+active+clean, 49 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:47:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 3]}]': finished 2024-09-13T21:47:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]': finished 2024-09-13T21:47:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]': finished 2024-09-13T21:47:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 3]}]': finished 2024-09-13T21:47:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 3]}]': finished 2024-09-13T21:47:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]': finished 2024-09-13T21:47:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]': finished 2024-09-13T21:47:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:33 smithi088 ceph-mon[86843]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T21:47:33.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:33 smithi116 podman[74677]: 2024-09-13 21:47:33.323704477 +0000 UTC m=+0.565291111 container remove bf66c87325f05ca40a112a9631bb90e6a26959e6bf685c0075275512f1657650 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T21:47:33.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:33 smithi116 podman[74735]: 2024-09-13 21:47:33.434268855 +0000 UTC m=+0.016388951 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:47:33.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:33 smithi116 podman[74735]: 2024-09-13 21:47:33.533132962 +0000 UTC m=+0.115253049 container create 7b16f89f60866ea33a34032635dca78253c4a8401619be0168d133f1179447a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T21:47:34.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:33 smithi116 podman[74735]: 2024-09-13 21:47:33.794526939 +0000 UTC m=+0.376647040 container init 7b16f89f60866ea33a34032635dca78253c4a8401619be0168d133f1179447a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS) 2024-09-13T21:47:34.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:33 smithi116 podman[74735]: 2024-09-13 21:47:33.797865613 +0000 UTC m=+0.379985701 container start 7b16f89f60866ea33a34032635dca78253c4a8401619be0168d133f1179447a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be) 2024-09-13T21:47:34.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:33 smithi116 ceph-osd[74753]: -- 172.21.15.116:0/1838747859 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557a1eebe1e0 con 0x557a1ee54000 2024-09-13T21:47:34.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:33 smithi116 bash[74735]: 7b16f89f60866ea33a34032635dca78253c4a8401619be0168d133f1179447a8 2024-09-13T21:47:34.097 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:33 smithi116 systemd[1]: Started Ceph osd.3 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:47:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.333+0000 7f72a8efb700 1 -- 172.21.15.88:0/2748447642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 msgr2=0x7f72a4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.333+0000 7f72a8efb700 1 --2- 172.21.15.88:0/2748447642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 0x7f72a4103d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7298009910 tx=0x7f7298009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.333+0000 7f72a8efb700 1 -- 172.21.15.88:0/2748447642 shutdown_connections 2024-09-13T21:47:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.333+0000 7f72a8efb700 1 --2- 172.21.15.88:0/2748447642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 0x7f72a4103d30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.333+0000 7f72a8efb700 1 --2- 172.21.15.88:0/2748447642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72a40ff3c0 0x7f72a40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.333+0000 7f72a8efb700 1 -- 172.21.15.88:0/2748447642 >> 172.21.15.88:0/2748447642 conn(0x7f72a40fac80 msgr2=0x7f72a40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.333+0000 7f72a8efb700 1 -- 172.21.15.88:0/2748447642 shutdown_connections 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.333+0000 7f72a8efb700 1 -- 172.21.15.88:0/2748447642 wait complete. 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.334+0000 7f72a8efb700 1 Processor -- start 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.334+0000 7f72a8efb700 1 -- start start 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.334+0000 7f72a8efb700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72a40ff3c0 0x7f72a4100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.334+0000 7f72a8efb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 0x7f72a4101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.334+0000 7f72a8efb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4101850 con 0x7f72a40ffd60 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.334+0000 7f72a8efb700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4101990 con 0x7f72a40ff3c0 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a1d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 0x7f72a4101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72a40ff3c0 0x7f72a4100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a1d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 0x7f72a4101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40958/0 (socket says 172.21.15.88:40958) 2024-09-13T21:47:34.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a1d9b700 1 -- 172.21.15.88:0/3726978287 learned_addr learned my addr 172.21.15.88:0/3726978287 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a1d9b700 1 -- 172.21.15.88:0/3726978287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72a40ff3c0 msgr2=0x7f72a4100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a1d9b700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72a40ff3c0 0x7f72a4100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a1d9b700 1 -- 172.21.15.88:0/3726978287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980095f0 con 0x7f72a40ffd60 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a259c700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72a40ff3c0 0x7f72a4100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a1d9b700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 0x7f72a4101310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f72980059d0 tx=0x7f729800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72937fe700 1 -- 172.21.15.88:0/3726978287 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f729801d070 con 0x7f72a40ffd60 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72937fe700 1 -- 172.21.15.88:0/3726978287 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f729800b610 con 0x7f72a40ffd60 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72937fe700 1 -- 172.21.15.88:0/3726978287 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7298022470 con 0x7f72a40ffd60 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a4101c10 con 0x7f72a40ffd60 2024-09-13T21:47:34.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.335+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a41a2450 con 0x7f72a40ffd60 2024-09-13T21:47:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.336+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a4108740 con 0x7f72a40ffd60 2024-09-13T21:47:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.337+0000 7f72937fe700 1 -- 172.21.15.88:0/3726978287 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f729800fac0 con 0x7f72a40ffd60 2024-09-13T21:47:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.337+0000 7f72937fe700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f728c06e680 0x7f728c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.338+0000 7f72937fe700 1 -- 172.21.15.88:0/3726978287 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6578+0+0 (secure 0 0 0) 0x7f729808fb40 con 0x7f72a40ffd60 2024-09-13T21:47:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.338+0000 7f72a259c700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f728c06e680 0x7f728c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.338+0000 7f72a259c700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f728c06e680 0x7f728c070b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7294011490 tx=0x7f7294009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.343+0000 7f72937fe700 1 -- 172.21.15.88:0/3726978287 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7298058d10 con 0x7f72a40ffd60 2024-09-13T21:47:34.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:34 smithi088 ceph-mon[86843]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T21:47:34.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:34 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:34.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:34 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:34.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:34 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:34.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:34 smithi088 ceph-mon[86843]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T21:47:34.567 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:34 smithi116 ceph-mon[65231]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T21:47:34.567 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:34 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:34.567 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:34 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:34.567 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:34 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:34.568 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:34 smithi116 ceph-mon[65231]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T21:47:34.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.610+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f72a4102370 con 0x7f728c06e680 2024-09-13T21:47:34.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.612+0000 7f72937fe700 1 -- 172.21.15.88:0/3726978287 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f72a4102370 con 0x7f728c06e680 2024-09-13T21:47:34.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.614+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f728c06e680 msgr2=0x7f728c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.614+0000 7f72a8efb700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f728c06e680 0x7f728c070b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7294011490 tx=0x7f7294009260 comp rx=0 tx=0).stop 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.614+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 msgr2=0x7f72a4101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.614+0000 7f72a8efb700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 0x7f72a4101310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f72980059d0 tx=0x7f729800f690 comp rx=0 tx=0).stop 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.614+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 shutdown_connections 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.614+0000 7f72a8efb700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f728c06e680 0x7f728c070b30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.614+0000 7f72a8efb700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72a40ff3c0 0x7f72a4100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.614+0000 7f72a8efb700 1 --2- 172.21.15.88:0/3726978287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a40ffd60 0x7f72a4101310 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.614+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 >> 172.21.15.88:0/3726978287 conn(0x7f72a40fac80 msgr2=0x7f72a4069050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.615+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 shutdown_connections 2024-09-13T21:47:34.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.615+0000 7f72a8efb700 1 -- 172.21.15.88:0/3726978287 wait complete. 2024-09-13T21:47:34.628 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:47:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.743+0000 7f48f0832700 1 -- 172.21.15.88:0/1456243145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 msgr2=0x7f48ec10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.743+0000 7f48f0832700 1 --2- 172.21.15.88:0/1456243145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 0x7f48ec10a6d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009910 tx=0x7f48e0009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.743+0000 7f48f0832700 1 -- 172.21.15.88:0/1456243145 shutdown_connections 2024-09-13T21:47:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.743+0000 7f48f0832700 1 --2- 172.21.15.88:0/1456243145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 0x7f48ec10a6d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.743+0000 7f48f0832700 1 --2- 172.21.15.88:0/1456243145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48ec0ff350 0x7f48ec0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.743+0000 7f48f0832700 1 -- 172.21.15.88:0/1456243145 >> 172.21.15.88:0/1456243145 conn(0x7f48ec0748b0 msgr2=0x7f48ec074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:34.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.743+0000 7f48f0832700 1 -- 172.21.15.88:0/1456243145 shutdown_connections 2024-09-13T21:47:34.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.743+0000 7f48f0832700 1 -- 172.21.15.88:0/1456243145 wait complete. 2024-09-13T21:47:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48f0832700 1 Processor -- start 2024-09-13T21:47:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48f0832700 1 -- start start 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48f0832700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48ec0ff350 0x7f48ec195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48f0832700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 0x7f48ec196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48f0832700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec196a20 con 0x7f48ec0ffc60 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48f0832700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec19a7b0 con 0x7f48ec0ff350 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48e9d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 0x7f48ec196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48e9d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 0x7f48ec196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40974/0 (socket says 172.21.15.88:40974) 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48e9d9b700 1 -- 172.21.15.88:0/988647673 learned_addr learned my addr 172.21.15.88:0/988647673 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.744+0000 7f48ea59c700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48ec0ff350 0x7f48ec195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.745+0000 7f48e9d9b700 1 -- 172.21.15.88:0/988647673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48ec0ff350 msgr2=0x7f48ec195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.745+0000 7f48e9d9b700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48ec0ff350 0x7f48ec195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.745+0000 7f48e9d9b700 1 -- 172.21.15.88:0/988647673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e00095f0 con 0x7f48ec0ffc60 2024-09-13T21:47:34.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.745+0000 7f48e9d9b700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 0x7f48ec196340 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f48e000f690 tx=0x7f48e000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:34.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.745+0000 7f48db7fe700 1 -- 172.21.15.88:0/988647673 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e001d070 con 0x7f48ec0ffc60 2024-09-13T21:47:34.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.745+0000 7f48db7fe700 1 -- 172.21.15.88:0/988647673 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48e00050d0 con 0x7f48ec0ffc60 2024-09-13T21:47:34.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.745+0000 7f48db7fe700 1 -- 172.21.15.88:0/988647673 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e0022470 con 0x7f48ec0ffc60 2024-09-13T21:47:34.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.745+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec19aa30 con 0x7f48ec0ffc60 2024-09-13T21:47:34.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.745+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec19af20 con 0x7f48ec0ffc60 2024-09-13T21:47:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.746+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ec107dd0 con 0x7f48ec0ffc60 2024-09-13T21:47:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.747+0000 7f48db7fe700 1 -- 172.21.15.88:0/988647673 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f48e0003780 con 0x7f48ec0ffc60 2024-09-13T21:47:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.748+0000 7f48db7fe700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f48d406e680 0x7f48d4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.748+0000 7f48db7fe700 1 -- 172.21.15.88:0/988647673 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6578+0+0 (secure 0 0 0) 0x7f48e008fb20 con 0x7f48ec0ffc60 2024-09-13T21:47:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.748+0000 7f48ea59c700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f48d406e680 0x7f48d4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:34.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.748+0000 7f48ea59c700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f48d406e680 0x7f48d4070b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0773d0 tx=0x7f48dc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:34.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:34.753+0000 7f48db7fe700 1 -- 172.21.15.88:0/988647673 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f48e0058c40 con 0x7f48ec0ffc60 2024-09-13T21:47:35.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.016+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48ec02ccf0 con 0x7f48d406e680 2024-09-13T21:47:35.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.018+0000 7f48db7fe700 1 -- 172.21.15.88:0/988647673 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f48ec02ccf0 con 0x7f48d406e680 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f48d406e680 msgr2=0x7f48d4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f48d406e680 0x7f48d4070b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0773d0 tx=0x7f48dc009260 comp rx=0 tx=0).stop 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 msgr2=0x7f48ec196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 0x7f48ec196340 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f48e000f690 tx=0x7f48e000f6c0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 shutdown_connections 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f48d406e680 0x7f48d4070b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48ec0ff350 0x7f48ec195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 --2- 172.21.15.88:0/988647673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec0ffc60 0x7f48ec196340 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 >> 172.21.15.88:0/988647673 conn(0x7f48ec0748b0 msgr2=0x7f48ec104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 shutdown_connections 2024-09-13T21:47:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.020+0000 7f48f0832700 1 -- 172.21.15.88:0/988647673 wait complete. 2024-09-13T21:47:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.149+0000 7f6af810a700 1 -- 172.21.15.88:0/2807137808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 msgr2=0x7f6af0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.149+0000 7f6af810a700 1 --2- 172.21.15.88:0/2807137808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 0x7f6af0103d30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009910 tx=0x7f6ae0009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.149+0000 7f6af810a700 1 -- 172.21.15.88:0/2807137808 shutdown_connections 2024-09-13T21:47:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.149+0000 7f6af810a700 1 --2- 172.21.15.88:0/2807137808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 0x7f6af0103d30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.149+0000 7f6af810a700 1 --2- 172.21.15.88:0/2807137808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6af00ff3c0 0x7f6af00ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.149+0000 7f6af810a700 1 -- 172.21.15.88:0/2807137808 >> 172.21.15.88:0/2807137808 conn(0x7f6af00fac80 msgr2=0x7f6af00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.149+0000 7f6af810a700 1 -- 172.21.15.88:0/2807137808 shutdown_connections 2024-09-13T21:47:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.149+0000 7f6af810a700 1 -- 172.21.15.88:0/2807137808 wait complete. 2024-09-13T21:47:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af810a700 1 Processor -- start 2024-09-13T21:47:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af810a700 1 -- start start 2024-09-13T21:47:35.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af810a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6af00ff3c0 0x7f6af0195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:35.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af810a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 0x7f6af01963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af810a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af0196ac0 con 0x7f6af00ffd60 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af810a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af019a850 con 0x7f6af00ff3c0 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af56a5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 0x7f6af01963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af56a5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 0x7f6af01963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41002/0 (socket says 172.21.15.88:41002) 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af5ea6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6af00ff3c0 0x7f6af0195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af56a5700 1 -- 172.21.15.88:0/1128759267 learned_addr learned my addr 172.21.15.88:0/1128759267 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af56a5700 1 -- 172.21.15.88:0/1128759267 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6af00ff3c0 msgr2=0x7f6af0195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af56a5700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6af00ff3c0 0x7f6af0195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.150+0000 7f6af56a5700 1 -- 172.21.15.88:0/1128759267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00095f0 con 0x7f6af00ffd60 2024-09-13T21:47:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.151+0000 7f6af56a5700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 0x7f6af01963e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000bda0 tx=0x7f6ae000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.151+0000 7f6ae6ffd700 1 -- 172.21.15.88:0/1128759267 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ae001d070 con 0x7f6af00ffd60 2024-09-13T21:47:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.151+0000 7f6ae6ffd700 1 -- 172.21.15.88:0/1128759267 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ae0005dc0 con 0x7f6af00ffd60 2024-09-13T21:47:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.151+0000 7f6ae6ffd700 1 -- 172.21.15.88:0/1128759267 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ae0017400 con 0x7f6af00ffd60 2024-09-13T21:47:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.151+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af019aad0 con 0x7f6af00ffd60 2024-09-13T21:47:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.151+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af019afc0 con 0x7f6af00ffd60 2024-09-13T21:47:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.152+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af0108640 con 0x7f6af00ffd60 2024-09-13T21:47:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.153+0000 7f6ae6ffd700 1 -- 172.21.15.88:0/1128759267 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6ae000f460 con 0x7f6af00ffd60 2024-09-13T21:47:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.153+0000 7f6ae6ffd700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6adc06e680 0x7f6adc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.154+0000 7f6ae6ffd700 1 -- 172.21.15.88:0/1128759267 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6578+0+0 (secure 0 0 0) 0x7f6ae008fb20 con 0x7f6af00ffd60 2024-09-13T21:47:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.154+0000 7f6af5ea6700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6adc06e680 0x7f6adc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.154+0000 7f6af5ea6700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6adc06e680 0x7f6adc070b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6aec004630 tx=0x7f6aec00b3c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.158+0000 7f6ae6ffd700 1 -- 172.21.15.88:0/1128759267 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6ae0058ba0 con 0x7f6af00ffd60 2024-09-13T21:47:35.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.476+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6af002cca0 con 0x7f6adc06e680 2024-09-13T21:47:35.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:35 smithi088 ceph-mon[86843]: pgmap v113: 65 pgs: 2 peering, 18 active+undersized, 19 active+undersized+degraded, 26 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T21:47:35.478 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:35 smithi088 ceph-mon[86843]: Health check failed: Degraded data redundancy: 73/360 objects degraded (20.278%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T21:47:35.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.489+0000 7f6ae6ffd700 1 -- 172.21.15.88:0/1128759267 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6af002cca0 con 0x7f6adc06e680 2024-09-13T21:47:35.490 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:47:35.490 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (4m) 31s ago 14m 25.3M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:47:35.490 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (15m) 31s ago 15m 8568k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:47:35.490 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (14m) 2m ago 14m 7918k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (2m) 31s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (2m) 2m ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (4m) 31s ago 14m 82.1M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (9m) 31s ago 9m 119M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (9m) 31s ago 9m 16.6M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (9m) 2m ago 9m 17.3M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (9m) 2m ago 9m 122M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (6m) 31s ago 16m 500M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (5m) 2m ago 13m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (3m) 31s ago 16m 51.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (2m) 2m ago 13m 34.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:47:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (5m) 31s ago 15m 15.5M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:47:35.492 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (5m) 2m ago 14m 17.2M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:47:35.492 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (106s) 31s ago 13m 87.9M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:47:35.492 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (72s) 31s ago 12m 96.2M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 1899bd970e44 2024-09-13T21:47:35.492 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (36s) 31s ago 12m 11.9M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 c38a8f2ec340 2024-09-13T21:47:35.492 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 starting - - - 2240M 2024-09-13T21:47:35.492 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (11m) 2m ago 11m 255M 2240M 18.2.0 dc2bc1663786 0f4393e327d3 2024-09-13T21:47:35.492 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (10m) 2m ago 10m 229M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:47:35.492 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (4m) 31s ago 14m 80.6M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:47:35.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.491+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6adc06e680 msgr2=0x7f6adc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.491+0000 7f6af810a700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6adc06e680 0x7f6adc070b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6aec004630 tx=0x7f6aec00b3c0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.491+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 msgr2=0x7f6af01963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.491+0000 7f6af810a700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 0x7f6af01963e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000bda0 tx=0x7f6ae000bdd0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.491+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 shutdown_connections 2024-09-13T21:47:35.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.491+0000 7f6af810a700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6adc06e680 0x7f6adc070b30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.491+0000 7f6af810a700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6af00ff3c0 0x7f6af0195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.491+0000 7f6af810a700 1 --2- 172.21.15.88:0/1128759267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6af00ffd60 0x7f6af01963e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.491+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 >> 172.21.15.88:0/1128759267 conn(0x7f6af00fac80 msgr2=0x7f6af00fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:35.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.492+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 shutdown_connections 2024-09-13T21:47:35.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.492+0000 7f6af810a700 1 -- 172.21.15.88:0/1128759267 wait complete. 2024-09-13T21:47:35.551 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:35 smithi116 ceph-mon[65231]: pgmap v113: 65 pgs: 2 peering, 18 active+undersized, 19 active+undersized+degraded, 26 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T21:47:35.551 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:35 smithi116 ceph-mon[65231]: Health check failed: Degraded data redundancy: 73/360 objects degraded (20.278%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T21:47:35.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.632+0000 7f3459f5d700 1 -- 172.21.15.88:0/3457566831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ff3c0 msgr2=0x7f34540ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.632+0000 7f3459f5d700 1 --2- 172.21.15.88:0/3457566831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ff3c0 0x7f34540ff790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3444009910 tx=0x7f3444009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:35.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.633+0000 7f3459f5d700 1 -- 172.21.15.88:0/3457566831 shutdown_connections 2024-09-13T21:47:35.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.633+0000 7f3459f5d700 1 --2- 172.21.15.88:0/3457566831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34540ffd60 0x7f3454103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.633+0000 7f3459f5d700 1 --2- 172.21.15.88:0/3457566831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ff3c0 0x7f34540ff790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.633+0000 7f3459f5d700 1 -- 172.21.15.88:0/3457566831 >> 172.21.15.88:0/3457566831 conn(0x7f34540fac80 msgr2=0x7f34540fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:35.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.633+0000 7f3459f5d700 1 -- 172.21.15.88:0/3457566831 shutdown_connections 2024-09-13T21:47:35.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.633+0000 7f3459f5d700 1 -- 172.21.15.88:0/3457566831 wait complete. 2024-09-13T21:47:35.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.633+0000 7f3459f5d700 1 Processor -- start 2024-09-13T21:47:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3459f5d700 1 -- start start 2024-09-13T21:47:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3459f5d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34540ff3c0 0x7f3454199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3459f5d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ffd60 0x7f3454199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3459f5d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345419a630 con 0x7f34540ffd60 2024-09-13T21:47:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3459f5d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3454193ae0 con 0x7f34540ff3c0 2024-09-13T21:47:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3452ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ffd60 0x7f3454199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:35.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3452ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ffd60 0x7f3454199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41032/0 (socket says 172.21.15.88:41032) 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3452ffd700 1 -- 172.21.15.88:0/1702013470 learned_addr learned my addr 172.21.15.88:0/1702013470 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f34537fe700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34540ff3c0 0x7f3454199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3452ffd700 1 -- 172.21.15.88:0/1702013470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34540ff3c0 msgr2=0x7f3454199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3452ffd700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34540ff3c0 0x7f3454199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.634+0000 7f3452ffd700 1 -- 172.21.15.88:0/1702013470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34440095f0 con 0x7f34540ffd60 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.635+0000 7f3452ffd700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ffd60 0x7f3454199fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f344800e8f0 tx=0x7f344800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.635+0000 7f3450ff9700 1 -- 172.21.15.88:0/1702013470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3448009790 con 0x7f34540ffd60 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.635+0000 7f3450ff9700 1 -- 172.21.15.88:0/1702013470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f344800c810 con 0x7f34540ffd60 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.635+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3454193dc0 con 0x7f34540ffd60 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.635+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3454194310 con 0x7f34540ffd60 2024-09-13T21:47:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.635+0000 7f3450ff9700 1 -- 172.21.15.88:0/1702013470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3448005580 con 0x7f34540ffd60 2024-09-13T21:47:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.636+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3440005320 con 0x7f34540ffd60 2024-09-13T21:47:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.637+0000 7f3450ff9700 1 -- 172.21.15.88:0/1702013470 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3448004a00 con 0x7f34540ffd60 2024-09-13T21:47:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.637+0000 7f3450ff9700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f343c070890 0x7f343c072d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.637+0000 7f3450ff9700 1 -- 172.21.15.88:0/1702013470 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3448014070 con 0x7f34540ffd60 2024-09-13T21:47:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.638+0000 7f34537fe700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f343c070890 0x7f343c072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:35.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.638+0000 7f34537fe700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f343c070890 0x7f343c072d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f344400b760 tx=0x7f3444005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:35.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.643+0000 7f3450ff9700 1 -- 172.21.15.88:0/1702013470 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f344805b430 con 0x7f34540ffd60 2024-09-13T21:47:35.846 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:35 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[74749]: 2024-09-13T21:47:35.686+0000 7f951dd47640 -1 Falling back to public interface 2024-09-13T21:47:35.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.988+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3440006200 con 0x7f34540ffd60 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.988+0000 7f3450ff9700 1 -- 172.21.15.88:0/1702013470 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f344805afc0 con 0x7f34540ffd60 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-13T21:47:35.990 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 3 2024-09-13T21:47:35.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:47:35.991 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:47:35.991 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:47:35.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:47:35.991 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:47:35.991 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-09-13T21:47:35.991 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 7 2024-09-13T21:47:35.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:47:35.991 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:47:35.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.990+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f343c070890 msgr2=0x7f343c072d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.990+0000 7f3459f5d700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f343c070890 0x7f343c072d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f344400b760 tx=0x7f3444005a90 comp rx=0 tx=0).stop 2024-09-13T21:47:35.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.990+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ffd60 msgr2=0x7f3454199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:35.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.990+0000 7f3459f5d700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ffd60 0x7f3454199fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f344800e8f0 tx=0x7f344800ec00 comp rx=0 tx=0).stop 2024-09-13T21:47:35.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.990+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 shutdown_connections 2024-09-13T21:47:35.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.990+0000 7f3459f5d700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f343c070890 0x7f343c072d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.990+0000 7f3459f5d700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34540ff3c0 0x7f3454199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.990+0000 7f3459f5d700 1 --2- 172.21.15.88:0/1702013470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34540ffd60 0x7f3454199fa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:35.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.990+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 >> 172.21.15.88:0/1702013470 conn(0x7f34540fac80 msgr2=0x7f34540fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:35.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.991+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 shutdown_connections 2024-09-13T21:47:35.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:35.991+0000 7f3459f5d700 1 -- 172.21.15.88:0/1702013470 wait complete. 2024-09-13T21:47:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.099+0000 7ff4ccb19700 1 -- 172.21.15.88:0/2181115755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ffc60 msgr2=0x7ff4c810a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.099+0000 7ff4ccb19700 1 --2- 172.21.15.88:0/2181115755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ffc60 0x7ff4c810a6d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009910 tx=0x7ff4bc009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.099+0000 7ff4ccb19700 1 -- 172.21.15.88:0/2181115755 shutdown_connections 2024-09-13T21:47:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.099+0000 7ff4ccb19700 1 --2- 172.21.15.88:0/2181115755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ffc60 0x7ff4c810a6d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.099+0000 7ff4ccb19700 1 --2- 172.21.15.88:0/2181115755 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4c80ff350 0x7ff4c80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.099+0000 7ff4ccb19700 1 -- 172.21.15.88:0/2181115755 >> 172.21.15.88:0/2181115755 conn(0x7ff4c80748b0 msgr2=0x7ff4c8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.099+0000 7ff4ccb19700 1 -- 172.21.15.88:0/2181115755 shutdown_connections 2024-09-13T21:47:36.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.099+0000 7ff4ccb19700 1 -- 172.21.15.88:0/2181115755 wait complete. 2024-09-13T21:47:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.099+0000 7ff4ccb19700 1 Processor -- start 2024-09-13T21:47:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4ccb19700 1 -- start start 2024-09-13T21:47:36.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4ccb19700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ff350 0x7ff4c8195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4ccb19700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4c80ffc60 0x7ff4c81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4ccb19700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8196a80 con 0x7ff4c80ff350 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4ccb19700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c819a810 con 0x7ff4c80ffc60 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4c659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ff350 0x7ff4c8195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4c659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ff350 0x7ff4c8195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41056/0 (socket says 172.21.15.88:41056) 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4c659c700 1 -- 172.21.15.88:0/1099943069 learned_addr learned my addr 172.21.15.88:0/1099943069 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4c5d9b700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4c80ffc60 0x7ff4c81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4c659c700 1 -- 172.21.15.88:0/1099943069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4c80ffc60 msgr2=0x7ff4c81963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4c659c700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4c80ffc60 0x7ff4c81963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4c659c700 1 -- 172.21.15.88:0/1099943069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc0095f0 con 0x7ff4c80ff350 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4c659c700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ff350 0x7ff4c8195e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800d8d0 tx=0x7ff4b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.100+0000 7ff4b77fe700 1 -- 172.21.15.88:0/1099943069 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b8009940 con 0x7ff4c80ff350 2024-09-13T21:47:36.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.101+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c819aaf0 con 0x7ff4c80ff350 2024-09-13T21:47:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.101+0000 7ff4b77fe700 1 -- 172.21.15.88:0/1099943069 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4b8010460 con 0x7ff4c80ff350 2024-09-13T21:47:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.101+0000 7ff4b77fe700 1 -- 172.21.15.88:0/1099943069 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b800f5f0 con 0x7ff4c80ff350 2024-09-13T21:47:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.101+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c819b040 con 0x7ff4c80ff350 2024-09-13T21:47:36.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.102+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c8107dd0 con 0x7ff4c80ff350 2024-09-13T21:47:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.102+0000 7ff4b77fe700 1 -- 172.21.15.88:0/1099943069 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff4b8009aa0 con 0x7ff4c80ff350 2024-09-13T21:47:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.102+0000 7ff4b77fe700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff4b006e680 0x7ff4b0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.102+0000 7ff4b77fe700 1 -- 172.21.15.88:0/1099943069 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff4b808e780 con 0x7ff4c80ff350 2024-09-13T21:47:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.103+0000 7ff4c5d9b700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff4b006e680 0x7ff4b0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:36.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.103+0000 7ff4c5d9b700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff4b006e680 0x7ff4b0070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc005b40 tx=0x7ff4bc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:36.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.107+0000 7ff4b77fe700 1 -- 172.21.15.88:0/1099943069 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff4b8057820 con 0x7ff4c80ff350 2024-09-13T21:47:36.263 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:36 smithi088 ceph-mon[86843]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:36.263 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:36 smithi088 ceph-mon[86843]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:36.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:36 smithi088 ceph-mon[86843]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T21:47:36.264 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:36 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1702013470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:36.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:36 smithi116 ceph-mon[65231]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:36.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:36 smithi116 ceph-mon[65231]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:36.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:36 smithi116 ceph-mon[65231]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T21:47:36.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:36 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1702013470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:36.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.366+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff4c804f2a0 con 0x7ff4c80ff350 2024-09-13T21:47:36.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.367+0000 7ff4b77fe700 1 -- 172.21.15.88:0/1099943069 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1923 (secure 0 0 0) 0x7ff4b80207a0 con 0x7ff4c80ff350 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:e20 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 20 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:47:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:47:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:47:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:36.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff4b006e680 msgr2=0x7ff4b0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff4b006e680 0x7ff4b0070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc005b40 tx=0x7ff4bc01a040 comp rx=0 tx=0).stop 2024-09-13T21:47:36.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ff350 msgr2=0x7ff4c8195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ff350 0x7ff4c8195e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800d8d0 tx=0x7ff4b800dc90 comp rx=0 tx=0).stop 2024-09-13T21:47:36.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 shutdown_connections 2024-09-13T21:47:36.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff4b006e680 0x7ff4b0070b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4c80ff350 0x7ff4c8195e60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 --2- 172.21.15.88:0/1099943069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4c80ffc60 0x7ff4c81963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 >> 172.21.15.88:0/1099943069 conn(0x7ff4c80748b0 msgr2=0x7ff4c8104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:36.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 shutdown_connections 2024-09-13T21:47:36.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.369+0000 7ff4ccb19700 1 -- 172.21.15.88:0/1099943069 wait complete. 2024-09-13T21:47:36.373 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:47:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.474+0000 7fae191c4700 1 -- 172.21.15.88:0/3590725596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 msgr2=0x7fae14103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.474+0000 7fae191c4700 1 --2- 172.21.15.88:0/3590725596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 0x7fae14103d30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009910 tx=0x7fadfc009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.474+0000 7fae191c4700 1 -- 172.21.15.88:0/3590725596 shutdown_connections 2024-09-13T21:47:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.474+0000 7fae191c4700 1 --2- 172.21.15.88:0/3590725596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 0x7fae14103d30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.474+0000 7fae191c4700 1 --2- 172.21.15.88:0/3590725596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae140ff3c0 0x7fae140ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.474+0000 7fae191c4700 1 -- 172.21.15.88:0/3590725596 >> 172.21.15.88:0/3590725596 conn(0x7fae140fac80 msgr2=0x7fae140fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.474+0000 7fae191c4700 1 -- 172.21.15.88:0/3590725596 shutdown_connections 2024-09-13T21:47:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.474+0000 7fae191c4700 1 -- 172.21.15.88:0/3590725596 wait complete. 2024-09-13T21:47:36.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.474+0000 7fae191c4700 1 Processor -- start 2024-09-13T21:47:36.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae191c4700 1 -- start start 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae191c4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae140ff3c0 0x7fae14195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae191c4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 0x7fae141963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae191c4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae14196ab0 con 0x7fae140ffd60 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae191c4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1419a840 con 0x7fae140ff3c0 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 0x7fae141963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 0x7fae141963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41064/0 (socket says 172.21.15.88:41064) 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae0a59c700 1 -- 172.21.15.88:0/3988116425 learned_addr learned my addr 172.21.15.88:0/3988116425 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae12d9d700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae140ff3c0 0x7fae14195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae0a59c700 1 -- 172.21.15.88:0/3988116425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae140ff3c0 msgr2=0x7fae14195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae0a59c700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae140ff3c0 0x7fae14195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae0a59c700 1 -- 172.21.15.88:0/3988116425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0095f0 con 0x7fae140ffd60 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.475+0000 7fae0a59c700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 0x7fae141963d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0092e0 tx=0x7fadfc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.476+0000 7fae10d99700 1 -- 172.21.15.88:0/3988116425 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadfc01d070 con 0x7fae140ffd60 2024-09-13T21:47:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.476+0000 7fae10d99700 1 -- 172.21.15.88:0/3988116425 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadfc005dc0 con 0x7fae140ffd60 2024-09-13T21:47:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.476+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1419aac0 con 0x7fae140ffd60 2024-09-13T21:47:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.476+0000 7fae10d99700 1 -- 172.21.15.88:0/3988116425 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadfc017400 con 0x7fae140ffd60 2024-09-13T21:47:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.476+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1419afb0 con 0x7fae140ffd60 2024-09-13T21:47:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.477+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae14108740 con 0x7fae140ffd60 2024-09-13T21:47:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.477+0000 7fae10d99700 1 -- 172.21.15.88:0/3988116425 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fadfc00f6f0 con 0x7fae140ffd60 2024-09-13T21:47:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.477+0000 7fae10d99700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fae0006e680 0x7fae00070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.478+0000 7fae10d99700 1 -- 172.21.15.88:0/3988116425 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fadfc08fb50 con 0x7fae140ffd60 2024-09-13T21:47:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.478+0000 7fae12d9d700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fae0006e680 0x7fae00070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.478+0000 7fae12d9d700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fae0006e680 0x7fae00070b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae04005950 tx=0x7fae0400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.482+0000 7fae10d99700 1 -- 172.21.15.88:0/3988116425 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fadfc058bf0 con 0x7fae140ffd60 2024-09-13T21:47:36.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.702+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae1402cca0 con 0x7fae0006e680 2024-09-13T21:47:36.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.704+0000 7fae10d99700 1 -- 172.21.15.88:0/3988116425 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fae1402cca0 con 0x7fae0006e680 2024-09-13T21:47:36.705 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:47:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:47:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:47:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:47:36.705 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:47:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:47:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-13T21:47:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-13T21:47:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:47:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "9/23 daemons upgraded", 2024-09-13T21:47:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:47:36.706 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:47:36.706 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:47:36.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fae0006e680 msgr2=0x7fae00070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fae0006e680 0x7fae00070b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae04005950 tx=0x7fae0400b410 comp rx=0 tx=0).stop 2024-09-13T21:47:36.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 msgr2=0x7fae141963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 0x7fae141963d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0092e0 tx=0x7fadfc00bd70 comp rx=0 tx=0).stop 2024-09-13T21:47:36.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 shutdown_connections 2024-09-13T21:47:36.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fae0006e680 0x7fae00070b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae140ff3c0 0x7fae14195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 --2- 172.21.15.88:0/3988116425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae140ffd60 0x7fae141963d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 >> 172.21.15.88:0/3988116425 conn(0x7fae140fac80 msgr2=0x7fae140690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:36.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 shutdown_connections 2024-09-13T21:47:36.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.706+0000 7fae191c4700 1 -- 172.21.15.88:0/3988116425 wait complete. 2024-09-13T21:47:36.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.825+0000 7fb2b8184700 1 -- 172.21.15.88:0/1213348952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 msgr2=0x7fb2b0104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.825+0000 7fb2b8184700 1 --2- 172.21.15.88:0/1213348952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 0x7fb2b0104500 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009910 tx=0x7fb2a0009c20 comp rx=0 tx=0).stop 2024-09-13T21:47:36.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.826+0000 7fb2b8184700 1 -- 172.21.15.88:0/1213348952 shutdown_connections 2024-09-13T21:47:36.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.826+0000 7fb2b8184700 1 --2- 172.21.15.88:0/1213348952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b00ffbd0 0x7fb2b0100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.826+0000 7fb2b8184700 1 --2- 172.21.15.88:0/1213348952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 0x7fb2b0104500 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.826+0000 7fb2b8184700 1 -- 172.21.15.88:0/1213348952 >> 172.21.15.88:0/1213348952 conn(0x7fb2b0075130 msgr2=0x7fb2b0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:36.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.826+0000 7fb2b8184700 1 -- 172.21.15.88:0/1213348952 shutdown_connections 2024-09-13T21:47:36.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.826+0000 7fb2b8184700 1 -- 172.21.15.88:0/1213348952 wait complete. 2024-09-13T21:47:36.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.826+0000 7fb2b8184700 1 Processor -- start 2024-09-13T21:47:36.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b8184700 1 -- start start 2024-09-13T21:47:36.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b8184700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b00ffbd0 0x7fb2b0196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:36.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b8184700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 0x7fb2b01971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:36.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b8184700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b01977f0 con 0x7fb2b0104130 2024-09-13T21:47:36.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b8184700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0197960 con 0x7fb2b00ffbd0 2024-09-13T21:47:36.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b571f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 0x7fb2b01971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b571f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 0x7fb2b01971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41090/0 (socket says 172.21.15.88:41090) 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b571f700 1 -- 172.21.15.88:0/673345882 learned_addr learned my addr 172.21.15.88:0/673345882 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b5f20700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b00ffbd0 0x7fb2b0196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b571f700 1 -- 172.21.15.88:0/673345882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b00ffbd0 msgr2=0x7fb2b0196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b571f700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b00ffbd0 0x7fb2b0196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b571f700 1 -- 172.21.15.88:0/673345882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a00095f0 con 0x7fb2b0104130 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b571f700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 0x7fb2b01971d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00d8d0 tx=0x7fb2ac00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2a6ffd700 1 -- 172.21.15.88:0/673345882 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2ac0098a0 con 0x7fb2b0104130 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2a6ffd700 1 -- 172.21.15.88:0/673345882 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2ac010460 con 0x7fb2b0104130 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.827+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b019fd00 con 0x7fb2b0104130 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.828+0000 7fb2a6ffd700 1 -- 172.21.15.88:0/673345882 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2ac00f5f0 con 0x7fb2b0104130 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.828+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b01a01f0 con 0x7fb2b0104130 2024-09-13T21:47:36.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.828+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b01076a0 con 0x7fb2b0104130 2024-09-13T21:47:36.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.829+0000 7fb2a6ffd700 1 -- 172.21.15.88:0/673345882 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb2ac009a00 con 0x7fb2b0104130 2024-09-13T21:47:36.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.829+0000 7fb2a6ffd700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb29c06e680 0x7fb29c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:36.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.830+0000 7fb2b5f20700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb29c06e680 0x7fb29c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:36.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.830+0000 7fb2a6ffd700 1 -- 172.21.15.88:0/673345882 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fb2ac08e610 con 0x7fb2b0104130 2024-09-13T21:47:36.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.830+0000 7fb2b5f20700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb29c06e680 0x7fb29c070b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0006010 tx=0x7fb2a001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:36.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:36.834+0000 7fb2a6ffd700 1 -- 172.21.15.88:0/673345882 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb2ac0576b0 con 0x7fb2b0104130 2024-09-13T21:47:37.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.131+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb2b002cc30 con 0x7fb2b0104130 2024-09-13T21:47:37.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.132+0000 7fb2a6ffd700 1 -- 172.21.15.88:0/673345882 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1518 (secure 0 0 0) 0x7fb2ac05ad70 con 0x7fb2b0104130 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 73/360 objects degraded (20.278%), 19 pgs degraded 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout: osd.3 (root=default,host=smithi116) is down 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 73/360 objects degraded (20.278%), 19 pgs degraded 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-13T21:47:37.134 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-13T21:47:37.135 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb29c06e680 msgr2=0x7fb29c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb29c06e680 0x7fb29c070b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0006010 tx=0x7fb2a001a040 comp rx=0 tx=0).stop 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 msgr2=0x7fb2b01971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 0x7fb2b01971d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00d8d0 tx=0x7fb2ac00dbe0 comp rx=0 tx=0).stop 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 shutdown_connections 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb29c06e680 0x7fb29c070b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b00ffbd0 0x7fb2b0196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 --2- 172.21.15.88:0/673345882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2b0104130 0x7fb2b01971d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 >> 172.21.15.88:0/673345882 conn(0x7fb2b0075130 msgr2=0x7fb2b00fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 shutdown_connections 2024-09-13T21:47:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:47:37.135+0000 7fb2b8184700 1 -- 172.21.15.88:0/673345882 wait complete. 2024-09-13T21:47:37.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:37 smithi088 ceph-mon[86843]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:37 smithi088 ceph-mon[86843]: pgmap v116: 65 pgs: 2 peering, 18 active+undersized, 19 active+undersized+degraded, 26 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T21:47:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:37 smithi088 ceph-mon[86843]: osdmap e72: 6 total, 5 up, 6 in 2024-09-13T21:47:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:37 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1099943069' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:47:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:37 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/673345882' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:47:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:37 smithi116 ceph-mon[65231]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:37 smithi116 ceph-mon[65231]: pgmap v116: 65 pgs: 2 peering, 18 active+undersized, 19 active+undersized+degraded, 26 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T21:47:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:37 smithi116 ceph-mon[65231]: osdmap e72: 6 total, 5 up, 6 in 2024-09-13T21:47:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:37 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1099943069' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:47:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:37 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/673345882' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:47:38.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:38 smithi088 ceph-mon[86843]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:38.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:38 smithi088 ceph-mon[86843]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T21:47:38.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:38.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:38.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:38 smithi116 ceph-mon[65231]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:38.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:38 smithi116 ceph-mon[65231]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T21:47:38.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:38.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:39.266 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:39 smithi116 ceph-mon[65231]: pgmap v119: 65 pgs: 1 remapped+peering, 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%); 1.4 MiB/s, 347 objects/s recovering 2024-09-13T21:47:39.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:39 smithi088 ceph-mon[86843]: pgmap v119: 65 pgs: 1 remapped+peering, 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%); 1.4 MiB/s, 347 objects/s recovering 2024-09-13T21:47:41.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[74749]: 2024-09-13T21:47:41.288+0000 7f951dd47640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-13T21:47:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: pgmap v120: 65 pgs: 1 remapped+peering, 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%); 992 KiB/s, 235 objects/s recovering 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:41.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: pgmap v120: 65 pgs: 1 remapped+peering, 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%); 992 KiB/s, 235 objects/s recovering 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:41.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:41.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:41 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:47:42.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:41 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[74749]: 2024-09-13T21:47:41.756+0000 7f951dd47640 -1 osd.3 65 log_to_monitors true 2024-09-13T21:47:42.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:42 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:47:42.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:42 smithi116 ceph-mon[65231]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-13T21:47:42.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:42 smithi116 ceph-mon[65231]: from='osd.3 [v2:172.21.15.116:6800/1887786959,v1:172.21.15.116:6801/1887786959]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:47:42.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:42 smithi116 ceph-mon[65231]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:47:42.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:42 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:47:42.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:42 smithi088 ceph-mon[86843]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-13T21:47:42.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:42 smithi088 ceph-mon[86843]: from='osd.3 [v2:172.21.15.116:6800/1887786959,v1:172.21.15.116:6801/1887786959]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:47:42.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:42 smithi088 ceph-mon[86843]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:47:43.346 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:47:43 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[74749]: 2024-09-13T21:47:43.048+0000 7f9511ad9640 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:47:43.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:43 smithi116 ceph-mon[65231]: pgmap v121: 65 pgs: 1 remapped+peering, 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%); 850 KiB/s, 201 objects/s recovering 2024-09-13T21:47:43.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:43 smithi116 ceph-mon[65231]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T21:47:43.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:43 smithi116 ceph-mon[65231]: from='osd.3 [v2:172.21.15.116:6800/1887786959,v1:172.21.15.116:6801/1887786959]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:47:43.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:43 smithi116 ceph-mon[65231]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T21:47:43.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:43 smithi116 ceph-mon[65231]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:47:43.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:43 smithi116 ceph-mon[65231]: from='osd.3 ' entity='osd.3' 2024-09-13T21:47:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:43 smithi088 ceph-mon[86843]: pgmap v121: 65 pgs: 1 remapped+peering, 6 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%); 850 KiB/s, 201 objects/s recovering 2024-09-13T21:47:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:43 smithi088 ceph-mon[86843]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T21:47:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:43 smithi088 ceph-mon[86843]: from='osd.3 [v2:172.21.15.116:6800/1887786959,v1:172.21.15.116:6801/1887786959]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:47:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:43 smithi088 ceph-mon[86843]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T21:47:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:43 smithi088 ceph-mon[86843]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:47:43.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:43 smithi088 ceph-mon[86843]: from='osd.3 ' entity='osd.3' 2024-09-13T21:47:44.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:44 smithi116 ceph-mon[65231]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:47:44.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:44 smithi116 ceph-mon[65231]: osd.3 [v2:172.21.15.116:6800/1887786959,v1:172.21.15.116:6801/1887786959] boot 2024-09-13T21:47:44.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:44 smithi116 ceph-mon[65231]: osdmap e75: 6 total, 6 up, 6 in 2024-09-13T21:47:44.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:44 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:47:44.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:44 smithi116 ceph-mon[65231]: Health check update: Degraded data redundancy: 69/360 objects degraded (19.167%), 18 pgs degraded (PG_DEGRADED) 2024-09-13T21:47:44.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:44 smithi116 ceph-mon[65231]: osdmap e76: 6 total, 6 up, 6 in 2024-09-13T21:47:44.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:44 smithi088 ceph-mon[86843]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:47:44.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:44 smithi088 ceph-mon[86843]: osd.3 [v2:172.21.15.116:6800/1887786959,v1:172.21.15.116:6801/1887786959] boot 2024-09-13T21:47:44.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:44 smithi088 ceph-mon[86843]: osdmap e75: 6 total, 6 up, 6 in 2024-09-13T21:47:44.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:44 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:47:44.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:44 smithi088 ceph-mon[86843]: Health check update: Degraded data redundancy: 69/360 objects degraded (19.167%), 18 pgs degraded (PG_DEGRADED) 2024-09-13T21:47:44.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:44 smithi088 ceph-mon[86843]: osdmap e76: 6 total, 6 up, 6 in 2024-09-13T21:47:45.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:45 smithi088 ceph-mon[86843]: pgmap v124: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%) 2024-09-13T21:47:45.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:45 smithi088 ceph-mon[86843]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T21:47:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:45 smithi116 ceph-mon[65231]: pgmap v124: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%) 2024-09-13T21:47:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:45 smithi116 ceph-mon[65231]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T21:47:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:47 smithi116 ceph-mon[65231]: pgmap v127: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%) 2024-09-13T21:47:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:47 smithi116 ceph-mon[65231]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T21:47:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:47.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:47.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:47 smithi088 ceph-mon[86843]: pgmap v127: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 18 active+undersized+degraded, 23 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/360 objects degraded (19.167%); 12/360 objects misplaced (3.333%) 2024-09-13T21:47:47.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:47 smithi088 ceph-mon[86843]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T21:47:47.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:47.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:48 smithi116 ceph-mon[65231]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T21:47:48.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:48 smithi088 ceph-mon[86843]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T21:47:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:49 smithi116 ceph-mon[65231]: pgmap v130: 65 pgs: 1 peering, 1 active+recovering+undersized+remapped, 63 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s, 278 objects/s recovering 2024-09-13T21:47:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:49 smithi116 ceph-mon[65231]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 69/360 objects degraded (19.167%), 18 pgs degraded) 2024-09-13T21:47:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:49 smithi116 ceph-mon[65231]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T21:47:49.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:49 smithi088 ceph-mon[86843]: pgmap v130: 65 pgs: 1 peering, 1 active+recovering+undersized+remapped, 63 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s, 278 objects/s recovering 2024-09-13T21:47:49.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:49 smithi088 ceph-mon[86843]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 69/360 objects degraded (19.167%), 18 pgs degraded) 2024-09-13T21:47:49.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:49 smithi088 ceph-mon[86843]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T21:47:50.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:50 smithi116 ceph-mon[65231]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T21:47:50.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:50 smithi088 ceph-mon[86843]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T21:47:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:51 smithi116 ceph-mon[65231]: pgmap v133: 65 pgs: 1 peering, 1 active+recovering+undersized+remapped, 63 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s, 278 objects/s recovering 2024-09-13T21:47:51.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:51 smithi088 ceph-mon[86843]: pgmap v133: 65 pgs: 1 peering, 1 active+recovering+undersized+remapped, 63 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s, 278 objects/s recovering 2024-09-13T21:47:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:53 smithi116 ceph-mon[65231]: pgmap v134: 65 pgs: 1 peering, 1 active+recovering+undersized+remapped, 63 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s, 190 objects/s recovering 2024-09-13T21:47:53.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:53 smithi088 ceph-mon[86843]: pgmap v134: 65 pgs: 1 peering, 1 active+recovering+undersized+remapped, 63 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s, 190 objects/s recovering 2024-09-13T21:47:55.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:55 smithi088 ceph-mon[86843]: pgmap v135: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s, 49 objects/s recovering 2024-09-13T21:47:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:55 smithi116 ceph-mon[65231]: pgmap v135: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s, 49 objects/s recovering 2024-09-13T21:47:56.540 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:47:56.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:47:57.593 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:57 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:47:57.593 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:57 smithi116 ceph-mon[65231]: Upgrade: osd.4 is safe to restart 2024-09-13T21:47:57.593 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:57 smithi116 ceph-mon[65231]: pgmap v136: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 41 objects/s recovering 2024-09-13T21:47:57.593 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:57.594 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:47:57.594 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:57 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:57.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:57 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:47:57.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:57 smithi088 ceph-mon[86843]: Upgrade: osd.4 is safe to restart 2024-09-13T21:47:57.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:57 smithi088 ceph-mon[86843]: pgmap v136: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 41 objects/s recovering 2024-09-13T21:47:57.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:47:57.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:47:57.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:57 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:58.566 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:58 smithi116 ceph-mon[65231]: Upgrade: Updating osd.4 2024-09-13T21:47:58.566 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:58 smithi116 ceph-mon[65231]: Deploying daemon osd.4 on smithi116 2024-09-13T21:47:58.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:58 smithi088 ceph-mon[86843]: Upgrade: Updating osd.4 2024-09-13T21:47:58.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:58 smithi088 ceph-mon[86843]: Deploying daemon osd.4 on smithi116 2024-09-13T21:47:59.447 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:47:59 smithi116 ceph-mon[65231]: pgmap v137: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 33 objects/s recovering 2024-09-13T21:47:59.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:47:59 smithi088 ceph-mon[86843]: pgmap v137: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 33 objects/s recovering 2024-09-13T21:48:00.454 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:00 smithi116 ceph-mon[65231]: pgmap v138: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 30 objects/s recovering 2024-09-13T21:48:00.454 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:00 smithi116 systemd[1]: Stopping Ceph osd.4 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:48:00.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:00 smithi088 ceph-mon[86843]: pgmap v138: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 30 objects/s recovering 2024-09-13T21:48:00.846 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:00 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[44051]: 2024-09-13T21:48:00.451+0000 7f7dd520d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:48:00.846 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:00 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[44051]: 2024-09-13T21:48:00.451+0000 7f7dd520d700 -1 osd.4 81 *** Got signal Terminated *** 2024-09-13T21:48:00.846 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:00 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[44051]: 2024-09-13T21:48:00.451+0000 7f7dd520d700 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:48:01.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:01 smithi088 ceph-mon[86843]: osd.4 marked itself down and dead 2024-09-13T21:48:01.844 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:01 smithi116 ceph-mon[65231]: osd.4 marked itself down and dead 2024-09-13T21:48:02.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:01 smithi116 podman[79223]: 2024-09-13 21:48:01.843094806 +0000 UTC m=+1.500884546 container died 0f4393e327d39190265d688975bc11b6ebf23205213eaae044b868adf34d2ddd (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T21:48:02.504 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:02 smithi116 podman[79223]: 2024-09-13 21:48:02.243806772 +0000 UTC m=+1.901596557 container cleanup 0f4393e327d39190265d688975bc11b6ebf23205213eaae044b868adf34d2ddd (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=HEAD, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T21:48:02.504 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:02 smithi116 bash[79223]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4 2024-09-13T21:48:02.504 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:02 smithi116 ceph-mon[65231]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:48:02.504 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:02 smithi116 ceph-mon[65231]: osdmap e82: 6 total, 5 up, 6 in 2024-09-13T21:48:02.504 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:02 smithi116 ceph-mon[65231]: pgmap v140: 65 pgs: 5 stale+active+clean, 60 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 33 objects/s recovering 2024-09-13T21:48:02.504 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:02.505 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:02.505 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:02.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:02 smithi088 ceph-mon[86843]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:48:02.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:02 smithi088 ceph-mon[86843]: osdmap e82: 6 total, 5 up, 6 in 2024-09-13T21:48:02.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:02 smithi088 ceph-mon[86843]: pgmap v140: 65 pgs: 5 stale+active+clean, 60 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 33 objects/s recovering 2024-09-13T21:48:02.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:02.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:02.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:02.846 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:02 smithi116 podman[79239]: 2024-09-13 21:48:02.503317387 +0000 UTC m=+0.654492027 container remove 0f4393e327d39190265d688975bc11b6ebf23205213eaae044b868adf34d2ddd (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-13T21:48:03.124 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:02 smithi116 podman[79328]: 2024-09-13 21:48:02.760198729 +0000 UTC m=+0.015929971 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:03.124 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:02 smithi116 podman[79328]: 2024-09-13 21:48:02.862622079 +0000 UTC m=+0.118353350 container create c7624c73564204f86d5a8a80afdf7d121f5fd22709398b54e58fea6af3a0bddb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T21:48:03.124 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:03 smithi116 podman[79328]: 2024-09-13 21:48:03.12367936 +0000 UTC m=+0.379410590 container init c7624c73564204f86d5a8a80afdf7d121f5fd22709398b54e58fea6af3a0bddb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T21:48:03.374 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:03 smithi116 podman[79328]: 2024-09-13 21:48:03.127234267 +0000 UTC m=+0.382965497 container start c7624c73564204f86d5a8a80afdf7d121f5fd22709398b54e58fea6af3a0bddb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T21:48:03.375 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:03 smithi116 podman[79328]: 2024-09-13 21:48:03.206923824 +0000 UTC m=+0.462655071 container attach c7624c73564204f86d5a8a80afdf7d121f5fd22709398b54e58fea6af3a0bddb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:48:03.375 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:03 smithi116 podman[79328]: 2024-09-13 21:48:03.308100875 +0000 UTC m=+0.563832115 container died c7624c73564204f86d5a8a80afdf7d121f5fd22709398b54e58fea6af3a0bddb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-ecab7be) 2024-09-13T21:48:03.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:03 smithi088 ceph-mon[86843]: osdmap e83: 6 total, 5 up, 6 in 2024-09-13T21:48:03.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:03 smithi116 ceph-mon[65231]: osdmap e83: 6 total, 5 up, 6 in 2024-09-13T21:48:04.329 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:03 smithi116 podman[79351]: 2024-09-13 21:48:03.885154158 +0000 UTC m=+0.567649592 container remove c7624c73564204f86d5a8a80afdf7d121f5fd22709398b54e58fea6af3a0bddb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:48:04.330 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:03 smithi116 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T21:48:04.330 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:03 smithi116 systemd[1]: Stopped Ceph osd.4 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:48:04.330 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:03 smithi116 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 969ms CPU time. 2024-09-13T21:48:04.330 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 systemd[1]: Starting Ceph osd.4 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:48:04.581 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:04 smithi116 ceph-mon[65231]: pgmap v142: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5/360 objects degraded (1.389%) 2024-09-13T21:48:04.581 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 podman[79447]: 2024-09-13 21:48:04.231032737 +0000 UTC m=+0.015759319 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:04.582 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 podman[79447]: 2024-09-13 21:48:04.344745188 +0000 UTC m=+0.129471764 container create c94c6cbbef472c5b26f3c617c96c84cff5de7f76115ddef548f69accf15de24c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T21:48:04.582 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 podman[79447]: 2024-09-13 21:48:04.58081687 +0000 UTC m=+0.365543443 container init c94c6cbbef472c5b26f3c617c96c84cff5de7f76115ddef548f69accf15de24c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:48:04.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:04 smithi088 ceph-mon[86843]: pgmap v142: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5/360 objects degraded (1.389%) 2024-09-13T21:48:04.846 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 podman[79447]: 2024-09-13 21:48:04.584483646 +0000 UTC m=+0.369210219 container start c94c6cbbef472c5b26f3c617c96c84cff5de7f76115ddef548f69accf15de24c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be) 2024-09-13T21:48:04.847 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 podman[79447]: 2024-09-13 21:48:04.680791133 +0000 UTC m=+0.465517715 container attach c94c6cbbef472c5b26f3c617c96c84cff5de7f76115ddef548f69accf15de24c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T21:48:04.847 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate[79462]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:04.847 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 bash[79447]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:04.847 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate[79462]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:04.847 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:04 smithi116 bash[79447]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:05.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:05 smithi088 ceph-mon[86843]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-13T21:48:05.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:05 smithi088 ceph-mon[86843]: Health check failed: Degraded data redundancy: 5/360 objects degraded (1.389%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:05.738 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate[79462]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T21:48:05.738 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 bash[79447]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T21:48:05.738 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate[79462]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T21:48:05.738 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 bash[79447]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T21:48:05.739 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:05 smithi116 ceph-mon[65231]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-13T21:48:05.739 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:05 smithi116 ceph-mon[65231]: Health check failed: Degraded data redundancy: 5/360 objects degraded (1.389%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:06.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate[79462]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 bash[79447]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate[79462]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 bash[79447]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate[79462]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 bash[79447]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate[79462]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 bash[79447]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate[79462]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 bash[79447]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T21:48:06.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:05 smithi116 podman[79447]: 2024-09-13 21:48:05.765750965 +0000 UTC m=+1.550477547 container died c94c6cbbef472c5b26f3c617c96c84cff5de7f76115ddef548f69accf15de24c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:48:06.460 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:06 smithi116 ceph-mon[65231]: pgmap v143: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5/360 objects degraded (1.389%) 2024-09-13T21:48:06.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:06 smithi088 ceph-mon[86843]: pgmap v143: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5/360 objects degraded (1.389%) 2024-09-13T21:48:06.789 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:06 smithi116 podman[79603]: 2024-09-13 21:48:06.459291958 +0000 UTC m=+0.686800649 container remove c94c6cbbef472c5b26f3c617c96c84cff5de7f76115ddef548f69accf15de24c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T21:48:06.789 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:06 smithi116 podman[79661]: 2024-09-13 21:48:06.566860191 +0000 UTC m=+0.015740116 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:06.789 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:06 smithi116 podman[79661]: 2024-09-13 21:48:06.68519417 +0000 UTC m=+0.134074085 container create 482f725f147b6512894a2706fda526330fe912f7bb16919ad1869151ef3bc4b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T21:48:07.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:06 smithi116 podman[79661]: 2024-09-13 21:48:06.904027086 +0000 UTC m=+0.352907000 container init 482f725f147b6512894a2706fda526330fe912f7bb16919ad1869151ef3bc4b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:48:07.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:06 smithi116 podman[79661]: 2024-09-13 21:48:06.907427226 +0000 UTC m=+0.356307141 container start 482f725f147b6512894a2706fda526330fe912f7bb16919ad1869151ef3bc4b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T21:48:07.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:06 smithi116 ceph-osd[79679]: -- 172.21.15.116:0/4115210938 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ed063941e0 con 0x55ed05541c00 2024-09-13T21:48:07.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:07 smithi116 bash[79661]: 482f725f147b6512894a2706fda526330fe912f7bb16919ad1869151ef3bc4b7 2024-09-13T21:48:07.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:07 smithi116 systemd[1]: Started Ceph osd.4 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:48:07.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.250+0000 7f5d32f9f700 1 -- 172.21.15.88:0/1892854177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c068540 msgr2=0x7f5d2c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.250+0000 7f5d32f9f700 1 --2- 172.21.15.88:0/1892854177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c068540 0x7f5d2c0689b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009910 tx=0x7f5d1c009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:07.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.250+0000 7f5d32f9f700 1 -- 172.21.15.88:0/1892854177 shutdown_connections 2024-09-13T21:48:07.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.250+0000 7f5d32f9f700 1 --2- 172.21.15.88:0/1892854177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c068540 0x7f5d2c0689b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.250+0000 7f5d32f9f700 1 --2- 172.21.15.88:0/1892854177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d2c1061b0 0x7f5d2c106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.251+0000 7f5d32f9f700 1 -- 172.21.15.88:0/1892854177 >> 172.21.15.88:0/1892854177 conn(0x7f5d2c074fa0 msgr2=0x7f5d2c0753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:07.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.251+0000 7f5d32f9f700 1 -- 172.21.15.88:0/1892854177 shutdown_connections 2024-09-13T21:48:07.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.251+0000 7f5d32f9f700 1 -- 172.21.15.88:0/1892854177 wait complete. 2024-09-13T21:48:07.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.251+0000 7f5d32f9f700 1 Processor -- start 2024-09-13T21:48:07.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.251+0000 7f5d32f9f700 1 -- start start 2024-09-13T21:48:07.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d32f9f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d2c068540 0x7f5d2c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:07.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d32f9f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c1061b0 0x7f5d2c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d32f9f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c19c520 con 0x7f5d2c1061b0 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d32f9f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c1959d0 con 0x7f5d2c068540 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d3179c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c1061b0 0x7f5d2c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d3179c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c1061b0 0x7f5d2c19be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58264/0 (socket says 172.21.15.88:58264) 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d3179c700 1 -- 172.21.15.88:0/4179474819 learned_addr learned my addr 172.21.15.88:0/4179474819 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d31f9d700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d2c068540 0x7f5d2c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d3179c700 1 -- 172.21.15.88:0/4179474819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d2c068540 msgr2=0x7f5d2c19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d3179c700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d2c068540 0x7f5d2c19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d3179c700 1 -- 172.21.15.88:0/4179474819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0095f0 con 0x7f5d2c1061b0 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d3179c700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c1061b0 0x7f5d2c19be90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c006010 tx=0x7f5d1c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:07.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d22ffd700 1 -- 172.21.15.88:0/4179474819 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d1c01d070 con 0x7f5d2c1061b0 2024-09-13T21:48:07.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d22ffd700 1 -- 172.21.15.88:0/4179474819 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d1c005dc0 con 0x7f5d2c1061b0 2024-09-13T21:48:07.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d22ffd700 1 -- 172.21.15.88:0/4179474819 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d1c017400 con 0x7f5d2c1061b0 2024-09-13T21:48:07.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.252+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c195c50 con 0x7f5d2c1061b0 2024-09-13T21:48:07.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.253+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c196080 con 0x7f5d2c1061b0 2024-09-13T21:48:07.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.253+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c062380 con 0x7f5d2c1061b0 2024-09-13T21:48:07.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.254+0000 7f5d22ffd700 1 -- 172.21.15.88:0/4179474819 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5d1c003a60 con 0x7f5d2c1061b0 2024-09-13T21:48:07.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.254+0000 7f5d22ffd700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5d1806e680 0x7f5d18070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:07.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.255+0000 7f5d22ffd700 1 -- 172.21.15.88:0/4179474819 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f5d1c08fa50 con 0x7f5d2c1061b0 2024-09-13T21:48:07.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.255+0000 7f5d31f9d700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5d1806e680 0x7f5d18070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:07.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.255+0000 7f5d31f9d700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5d1806e680 0x7f5d18070b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007c60 tx=0x7f5d280073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:07.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.259+0000 7f5d22ffd700 1 -- 172.21.15.88:0/4179474819 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5d1c05c780 con 0x7f5d2c1061b0 2024-09-13T21:48:07.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.491+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d2c1964b0 con 0x7f5d1806e680 2024-09-13T21:48:07.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.492+0000 7f5d22ffd700 1 -- 172.21.15.88:0/4179474819 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5d2c1964b0 con 0x7f5d1806e680 2024-09-13T21:48:07.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5d1806e680 msgr2=0x7f5d18070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5d1806e680 0x7f5d18070b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007c60 tx=0x7f5d280073d0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c1061b0 msgr2=0x7f5d2c19be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c1061b0 0x7f5d2c19be90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c006010 tx=0x7f5d1c00bd70 comp rx=0 tx=0).stop 2024-09-13T21:48:07.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 shutdown_connections 2024-09-13T21:48:07.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5d1806e680 0x7f5d18070b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d2c068540 0x7f5d2c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 --2- 172.21.15.88:0/4179474819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d2c1061b0 0x7f5d2c19be90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 >> 172.21.15.88:0/4179474819 conn(0x7f5d2c074fa0 msgr2=0x7f5d2c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:07.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 shutdown_connections 2024-09-13T21:48:07.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.494+0000 7f5d32f9f700 1 -- 172.21.15.88:0/4179474819 wait complete. 2024-09-13T21:48:07.506 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:48:07.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.601+0000 7f140c818700 1 -- 172.21.15.88:0/354549747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 msgr2=0x7f1408104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.601+0000 7f140c818700 1 --2- 172.21.15.88:0/354549747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 0x7f1408104e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009910 tx=0x7f13f0009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:07.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.601+0000 7f140c818700 1 -- 172.21.15.88:0/354549747 shutdown_connections 2024-09-13T21:48:07.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.601+0000 7f140c818700 1 --2- 172.21.15.88:0/354549747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 0x7f1408104e50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.601+0000 7f140c818700 1 --2- 172.21.15.88:0/354549747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14081004e0 0x7f14081008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.601+0000 7f140c818700 1 -- 172.21.15.88:0/354549747 >> 172.21.15.88:0/354549747 conn(0x7f14080fbda0 msgr2=0x7f14080fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:07.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.601+0000 7f140c818700 1 -- 172.21.15.88:0/354549747 shutdown_connections 2024-09-13T21:48:07.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.601+0000 7f140c818700 1 -- 172.21.15.88:0/354549747 wait complete. 2024-09-13T21:48:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f140c818700 1 Processor -- start 2024-09-13T21:48:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f140c818700 1 -- start start 2024-09-13T21:48:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f140c818700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14081004e0 0x7f1408195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f140c818700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 0x7f1408196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f140c818700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1408196b30 con 0x7f1408100e80 2024-09-13T21:48:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f140c818700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140819a8c0 con 0x7f14081004e0 2024-09-13T21:48:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f13fffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 0x7f1408196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f13fffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 0x7f1408196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58282/0 (socket says 172.21.15.88:58282) 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f13fffff700 1 -- 172.21.15.88:0/2277400386 learned_addr learned my addr 172.21.15.88:0/2277400386 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f140659c700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14081004e0 0x7f1408195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f13fffff700 1 -- 172.21.15.88:0/2277400386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14081004e0 msgr2=0x7f1408195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f13fffff700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14081004e0 0x7f1408195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f13fffff700 1 -- 172.21.15.88:0/2277400386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f00095f0 con 0x7f1408100e80 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.602+0000 7f13fffff700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 0x7f1408196450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f13f00092e0 tx=0x7f13f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.603+0000 7f13ff7fe700 1 -- 172.21.15.88:0/2277400386 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f001d070 con 0x7f1408100e80 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.603+0000 7f13ff7fe700 1 -- 172.21.15.88:0/2277400386 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13f000f460 con 0x7f1408100e80 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.603+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140819ab40 con 0x7f1408100e80 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.603+0000 7f13ff7fe700 1 -- 172.21.15.88:0/2277400386 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f00175f0 con 0x7f1408100e80 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.603+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140819b030 con 0x7f1408100e80 2024-09-13T21:48:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.604+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1408108850 con 0x7f1408100e80 2024-09-13T21:48:07.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.604+0000 7f13ff7fe700 1 -- 172.21.15.88:0/2277400386 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f13f000f5d0 con 0x7f1408100e80 2024-09-13T21:48:07.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.605+0000 7f13ff7fe700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f13f406e680 0x7f13f4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:07.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.605+0000 7f13ff7fe700 1 -- 172.21.15.88:0/2277400386 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f13f008fae0 con 0x7f1408100e80 2024-09-13T21:48:07.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.605+0000 7f140659c700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f13f406e680 0x7f13f4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:07.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.605+0000 7f140659c700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f13f406e680 0x7f13f4070b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005fd0 tx=0x7f13f800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.609+0000 7f13ff7fe700 1 -- 172.21.15.88:0/2277400386 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f13f0058ce0 con 0x7f1408100e80 2024-09-13T21:48:07.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.832+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f140802cca0 con 0x7f13f406e680 2024-09-13T21:48:07.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.834+0000 7f13ff7fe700 1 -- 172.21.15.88:0/2277400386 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f140802cca0 con 0x7f13f406e680 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f13f406e680 msgr2=0x7f13f4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f13f406e680 0x7f13f4070b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005fd0 tx=0x7f13f800a560 comp rx=0 tx=0).stop 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 msgr2=0x7f1408196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 0x7f1408196450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f13f00092e0 tx=0x7f13f000be20 comp rx=0 tx=0).stop 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 shutdown_connections 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f13f406e680 0x7f13f4070b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14081004e0 0x7f1408195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 --2- 172.21.15.88:0/2277400386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1408100e80 0x7f1408196450 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 >> 172.21.15.88:0/2277400386 conn(0x7f14080fbda0 msgr2=0x7f14080fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 shutdown_connections 2024-09-13T21:48:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.836+0000 7f140c818700 1 -- 172.21.15.88:0/2277400386 wait complete. 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 -- 172.21.15.88:0/3158358753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 msgr2=0x7ff18010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 --2- 172.21.15.88:0/3158358753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 0x7ff18010a230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff174009910 tx=0x7ff174009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 -- 172.21.15.88:0/3158358753 shutdown_connections 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 --2- 172.21.15.88:0/3158358753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 0x7ff18010a230 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 --2- 172.21.15.88:0/3158358753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff180101420 0x7ff1801017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 -- 172.21.15.88:0/3158358753 >> 172.21.15.88:0/3158358753 conn(0x7ff1800fac80 msgr2=0x7ff1800fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 -- 172.21.15.88:0/3158358753 shutdown_connections 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 -- 172.21.15.88:0/3158358753 wait complete. 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 Processor -- start 2024-09-13T21:48:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.941+0000 7ff186410700 1 -- start start 2024-09-13T21:48:07.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff186410700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff180101420 0x7ff1800ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:07.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff186410700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 0x7ff1800ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:07.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff186410700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1800ffb00 con 0x7ff180101d30 2024-09-13T21:48:07.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff186410700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1800ffc40 con 0x7ff180101420 2024-09-13T21:48:07.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff17f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 0x7ff1800ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff17f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 0x7ff1800ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58292/0 (socket says 172.21.15.88:58292) 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff17f7fe700 1 -- 172.21.15.88:0/1314292516 learned_addr learned my addr 172.21.15.88:0/1314292516 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff17ffff700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff180101420 0x7ff1800ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff17f7fe700 1 -- 172.21.15.88:0/1314292516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff180101420 msgr2=0x7ff1800ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff17f7fe700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff180101420 0x7ff1800ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff17f7fe700 1 -- 172.21.15.88:0/1314292516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740095f0 con 0x7ff180101d30 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.942+0000 7ff17f7fe700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 0x7ff1800ff5c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff174006010 tx=0x7ff17400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.943+0000 7ff17d7fa700 1 -- 172.21.15.88:0/1314292516 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff17401d070 con 0x7ff180101d30 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.943+0000 7ff17d7fa700 1 -- 172.21.15.88:0/1314292516 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff17400f460 con 0x7ff180101d30 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.943+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1800ffec0 con 0x7ff180101d30 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.943+0000 7ff17d7fa700 1 -- 172.21.15.88:0/1314292516 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff174017630 con 0x7ff180101d30 2024-09-13T21:48:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.943+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1801a2360 con 0x7ff180101d30 2024-09-13T21:48:07.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.944+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1801078a0 con 0x7ff180101d30 2024-09-13T21:48:07.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.944+0000 7ff17d7fa700 1 -- 172.21.15.88:0/1314292516 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff17400f5d0 con 0x7ff180101d30 2024-09-13T21:48:07.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.945+0000 7ff17d7fa700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff16806e680 0x7ff168070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:07.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.945+0000 7ff17d7fa700 1 -- 172.21.15.88:0/1314292516 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6359+0+0 (secure 0 0 0) 0x7ff17408faa0 con 0x7ff180101d30 2024-09-13T21:48:07.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.945+0000 7ff17ffff700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff16806e680 0x7ff168070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:07.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.945+0000 7ff17ffff700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff16806e680 0x7ff168070b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff170005950 tx=0x7ff1700058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:07.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:07.949+0000 7ff17d7fa700 1 -- 172.21.15.88:0/1314292516 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff174058ca0 con 0x7ff180101d30 2024-09-13T21:48:08.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.160+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff180061190 con 0x7ff16806e680 2024-09-13T21:48:08.163 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:08.163 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:08.163 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:08 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:08.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.170+0000 7ff17d7fa700 1 -- 172.21.15.88:0/1314292516 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff180061190 con 0x7ff16806e680 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (5m) 64s ago 15m 25.3M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (15m) 64s ago 15m 8568k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (14m) 31s ago 14m 8094k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (2m) 64s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (2m) 31s ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (4m) 64s ago 15m 82.1M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (9m) 64s ago 9m 119M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (10m) 64s ago 10m 16.6M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (9m) 31s ago 9m 18.2M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (9m) 31s ago 9m 122M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:48:08.172 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (6m) 64s ago 16m 500M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (6m) 31s ago 14m 442M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (3m) 64s ago 17m 51.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (3m) 31s ago 14m 39.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (5m) 64s ago 15m 15.5M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (5m) 31s ago 14m 17.2M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (2m) 64s ago 13m 87.9M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (104s) 64s ago 13m 96.2M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 1899bd970e44 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (69s) 64s ago 12m 11.9M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 c38a8f2ec340 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (34s) 31s ago 12m 11.6M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7b16f89f6086 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 starting - - - 2240M 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (11m) 31s ago 11m 227M 2240M 18.2.0 dc2bc1663786 338e7f76ed37 2024-09-13T21:48:08.173 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (5m) 64s ago 15m 80.6M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:48:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.172+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff16806e680 msgr2=0x7ff168070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.172+0000 7ff186410700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff16806e680 0x7ff168070b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff170005950 tx=0x7ff1700058e0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.172+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 msgr2=0x7ff1800ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.172+0000 7ff186410700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 0x7ff1800ff5c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff174006010 tx=0x7ff17400be20 comp rx=0 tx=0).stop 2024-09-13T21:48:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.173+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 shutdown_connections 2024-09-13T21:48:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.173+0000 7ff186410700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff16806e680 0x7ff168070b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.173+0000 7ff186410700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff180101420 0x7ff1800ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.173+0000 7ff186410700 1 --2- 172.21.15.88:0/1314292516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff180101d30 0x7ff1800ff5c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.173+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 >> 172.21.15.88:0/1314292516 conn(0x7ff1800fac80 msgr2=0x7ff1801049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.173+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 shutdown_connections 2024-09-13T21:48:08.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.173+0000 7ff186410700 1 -- 172.21.15.88:0/1314292516 wait complete. 2024-09-13T21:48:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.277+0000 7fc3b9270700 1 -- 172.21.15.88:0/823019184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b40687a0 msgr2=0x7fc3b4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.277+0000 7fc3b9270700 1 --2- 172.21.15.88:0/823019184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b40687a0 0x7fc3b4068b70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009910 tx=0x7fc3a4009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.277+0000 7fc3b9270700 1 -- 172.21.15.88:0/823019184 shutdown_connections 2024-09-13T21:48:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.277+0000 7fc3b9270700 1 --2- 172.21.15.88:0/823019184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b4069140 0x7fc3b4104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.277+0000 7fc3b9270700 1 --2- 172.21.15.88:0/823019184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b40687a0 0x7fc3b4068b70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.277+0000 7fc3b9270700 1 -- 172.21.15.88:0/823019184 >> 172.21.15.88:0/823019184 conn(0x7fc3b4075130 msgr2=0x7fc3b4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.277+0000 7fc3b9270700 1 -- 172.21.15.88:0/823019184 shutdown_connections 2024-09-13T21:48:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.277+0000 7fc3b9270700 1 -- 172.21.15.88:0/823019184 wait complete. 2024-09-13T21:48:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.277+0000 7fc3b9270700 1 Processor -- start 2024-09-13T21:48:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b9270700 1 -- start start 2024-09-13T21:48:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b9270700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b40687a0 0x7fc3b4195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b9270700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b4069140 0x7fc3b4196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b9270700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4196b00 con 0x7fc3b4069140 2024-09-13T21:48:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b9270700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b419a890 con 0x7fc3b40687a0 2024-09-13T21:48:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b27fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b4069140 0x7fc3b4196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b27fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b4069140 0x7fc3b4196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58308/0 (socket says 172.21.15.88:58308) 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b27fc700 1 -- 172.21.15.88:0/1881505230 learned_addr learned my addr 172.21.15.88:0/1881505230 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b2ffd700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b40687a0 0x7fc3b4195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b27fc700 1 -- 172.21.15.88:0/1881505230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b40687a0 msgr2=0x7fc3b4195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b27fc700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b40687a0 0x7fc3b4195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b27fc700 1 -- 172.21.15.88:0/1881505230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40095f0 con 0x7fc3b4069140 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.278+0000 7fc3b27fc700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b4069140 0x7fc3b4196420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800e8f0 tx=0x7fc3a800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.279+0000 7fc39bfff700 1 -- 172.21.15.88:0/1881505230 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3a8009790 con 0x7fc3b4069140 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.279+0000 7fc39bfff700 1 -- 172.21.15.88:0/1881505230 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3a800c810 con 0x7fc3b4069140 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.279+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b419ab70 con 0x7fc3b4069140 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.279+0000 7fc39bfff700 1 -- 172.21.15.88:0/1881505230 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3a8005580 con 0x7fc3b4069140 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.279+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b419b0c0 con 0x7fc3b4069140 2024-09-13T21:48:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.280+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b4108770 con 0x7fc3b4069140 2024-09-13T21:48:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.280+0000 7fc39bfff700 1 -- 172.21.15.88:0/1881505230 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc3a800c980 con 0x7fc3b4069140 2024-09-13T21:48:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.281+0000 7fc39bfff700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc39c06e680 0x7fc39c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.281+0000 7fc39bfff700 1 -- 172.21.15.88:0/1881505230 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fc3a8014070 con 0x7fc3b4069140 2024-09-13T21:48:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.281+0000 7fc3b2ffd700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc39c06e680 0x7fc39c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.281+0000 7fc3b2ffd700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc39c06e680 0x7fc39c070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40059d0 tx=0x7fc3a4005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.285+0000 7fc39bfff700 1 -- 172.21.15.88:0/1881505230 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc3a8057ab0 con 0x7fc3b4069140 2024-09-13T21:48:08.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:08.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:08.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:08 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:08.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.574+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3b404f2a0 con 0x7fc3b4069140 2024-09-13T21:48:08.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.575+0000 7fc39bfff700 1 -- 172.21.15.88:0/1881505230 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fc3a805b170 con 0x7fc3b4069140 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:48:08.577 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:48:08.578 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:48:08.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:48:08.578 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:48:08.578 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-09-13T21:48:08.578 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 8 2024-09-13T21:48:08.578 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:48:08.578 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:48:08.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc39c06e680 msgr2=0x7fc39c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc39c06e680 0x7fc39c070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40059d0 tx=0x7fc3a4005940 comp rx=0 tx=0).stop 2024-09-13T21:48:08.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b4069140 msgr2=0x7fc3b4196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b4069140 0x7fc3b4196420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800e8f0 tx=0x7fc3a800ec00 comp rx=0 tx=0).stop 2024-09-13T21:48:08.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 shutdown_connections 2024-09-13T21:48:08.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fc39c06e680 0x7fc39c070b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b40687a0 0x7fc3b4195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 --2- 172.21.15.88:0/1881505230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b4069140 0x7fc3b4196420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 >> 172.21.15.88:0/1881505230 conn(0x7fc3b4075130 msgr2=0x7fc3b40fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:08.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 shutdown_connections 2024-09-13T21:48:08.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.577+0000 7fc3b9270700 1 -- 172.21.15.88:0/1881505230 wait complete. 2024-09-13T21:48:08.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.682+0000 7fe9ee76a700 1 -- 172.21.15.88:0/823240922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 msgr2=0x7fe9e8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.682+0000 7fe9ee76a700 1 --2- 172.21.15.88:0/823240922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 0x7fe9e8103d30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009910 tx=0x7fe9d0009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.682+0000 7fe9ee76a700 1 -- 172.21.15.88:0/823240922 shutdown_connections 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.682+0000 7fe9ee76a700 1 --2- 172.21.15.88:0/823240922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 0x7fe9e8103d30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.682+0000 7fe9ee76a700 1 --2- 172.21.15.88:0/823240922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80ff3c0 0x7fe9e80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.682+0000 7fe9ee76a700 1 -- 172.21.15.88:0/823240922 >> 172.21.15.88:0/823240922 conn(0x7fe9e80fac60 msgr2=0x7fe9e80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.682+0000 7fe9ee76a700 1 -- 172.21.15.88:0/823240922 shutdown_connections 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.682+0000 7fe9ee76a700 1 -- 172.21.15.88:0/823240922 wait complete. 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9ee76a700 1 Processor -- start 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9ee76a700 1 -- start start 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9ee76a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80ff3c0 0x7fe9e8100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9ee76a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 0x7fe9e8101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9ee76a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8101850 con 0x7fe9e80ffd60 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9ee76a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8101990 con 0x7fe9e80ff3c0 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9dffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 0x7fe9e8101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9dffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 0x7fe9e8101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58322/0 (socket says 172.21.15.88:58322) 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9dffff700 1 -- 172.21.15.88:0/3962387048 learned_addr learned my addr 172.21.15.88:0/3962387048 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9e7fff700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80ff3c0 0x7fe9e8100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9dffff700 1 -- 172.21.15.88:0/3962387048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80ff3c0 msgr2=0x7fe9e8100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9dffff700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80ff3c0 0x7fe9e8100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9dffff700 1 -- 172.21.15.88:0/3962387048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d00095f0 con 0x7fe9e80ffd60 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.683+0000 7fe9dffff700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 0x7fe9e8101310 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00092e0 tx=0x7fe9d000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.684+0000 7fe9e5ffb700 1 -- 172.21.15.88:0/3962387048 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d001d070 con 0x7fe9e80ffd60 2024-09-13T21:48:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.684+0000 7fe9e5ffb700 1 -- 172.21.15.88:0/3962387048 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9d0005dc0 con 0x7fe9e80ffd60 2024-09-13T21:48:08.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.684+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e8101c10 con 0x7fe9e80ffd60 2024-09-13T21:48:08.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.684+0000 7fe9e5ffb700 1 -- 172.21.15.88:0/3962387048 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d0017400 con 0x7fe9e80ffd60 2024-09-13T21:48:08.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.684+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e81a23f0 con 0x7fe9e80ffd60 2024-09-13T21:48:08.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.685+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e8108640 con 0x7fe9e80ffd60 2024-09-13T21:48:08.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.685+0000 7fe9e5ffb700 1 -- 172.21.15.88:0/3962387048 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe9d000f6f0 con 0x7fe9e80ffd60 2024-09-13T21:48:08.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.686+0000 7fe9e5ffb700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe9d406e680 0x7fe9d4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:08.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.686+0000 7fe9e7fff700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe9d406e680 0x7fe9d4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:08.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.686+0000 7fe9e5ffb700 1 -- 172.21.15.88:0/3962387048 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fe9d008f9a0 con 0x7fe9e80ffd60 2024-09-13T21:48:08.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.686+0000 7fe9e7fff700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe9d406e680 0x7fe9d4070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8004630 tx=0x7fe9d800b3c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:08.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.690+0000 7fe9e5ffb700 1 -- 172.21.15.88:0/3962387048 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe9d0058ba0 con 0x7fe9e80ffd60 2024-09-13T21:48:08.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.935+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe9e804f2a0 con 0x7fe9e80ffd60 2024-09-13T21:48:08.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.935+0000 7fe9e5ffb700 1 -- 172.21.15.88:0/3962387048 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1923 (secure 0 0 0) 0x7fe9d005c260 con 0x7fe9e80ffd60 2024-09-13T21:48:08.937 INFO:teuthology.orchestra.run.smithi088.stdout:e20 2024-09-13T21:48:08.937 INFO:teuthology.orchestra.run.smithi088.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:48:08.937 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:48:08.937 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:48:08.937 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:48:08.937 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 20 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:48:08.938 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:48:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:48:08.940 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:48:08.940 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:08.940 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:08.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:48:08.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:48:08.940 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:48:08.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:48:08.940 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:08.940 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:08.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.937+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe9d406e680 msgr2=0x7fe9d4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.937+0000 7fe9ee76a700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe9d406e680 0x7fe9d4070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8004630 tx=0x7fe9d800b3c0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.937+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 msgr2=0x7fe9e8101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:08.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.937+0000 7fe9ee76a700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 0x7fe9e8101310 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00092e0 tx=0x7fe9d000bd70 comp rx=0 tx=0).stop 2024-09-13T21:48:08.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.938+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 shutdown_connections 2024-09-13T21:48:08.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.938+0000 7fe9ee76a700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe9d406e680 0x7fe9d4070b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.938+0000 7fe9ee76a700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80ff3c0 0x7fe9e8100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.938+0000 7fe9ee76a700 1 --2- 172.21.15.88:0/3962387048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e80ffd60 0x7fe9e8101310 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:08.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.938+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 >> 172.21.15.88:0/3962387048 conn(0x7fe9e80fac60 msgr2=0x7fe9e8069680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:08.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.938+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 shutdown_connections 2024-09-13T21:48:08.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:08.938+0000 7fe9ee76a700 1 -- 172.21.15.88:0/3962387048 wait complete. 2024-09-13T21:48:08.942 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:48:09.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 -- 172.21.15.88:0/4108557501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 msgr2=0x7ffbdc1016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:09.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 --2- 172.21.15.88:0/4108557501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 0x7ffbdc1016c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009910 tx=0x7ffbd8009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:09.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 -- 172.21.15.88:0/4108557501 shutdown_connections 2024-09-13T21:48:09.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 --2- 172.21.15.88:0/4108557501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbdc101c90 0x7ffbdc10a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 --2- 172.21.15.88:0/4108557501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 0x7ffbdc1016c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 -- 172.21.15.88:0/4108557501 >> 172.21.15.88:0/4108557501 conn(0x7ffbdc0fac80 msgr2=0x7ffbdc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:09.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 -- 172.21.15.88:0/4108557501 shutdown_connections 2024-09-13T21:48:09.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 -- 172.21.15.88:0/4108557501 wait complete. 2024-09-13T21:48:09.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 Processor -- start 2024-09-13T21:48:09.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.043+0000 7ffbe422d700 1 -- start start 2024-09-13T21:48:09.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe422d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 0x7ffbdc195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:09.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe422d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbdc101c90 0x7ffbdc1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe422d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc196ac0 con 0x7ffbdc1012f0 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe422d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc19a800 con 0x7ffbdc101c90 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe1fc9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 0x7ffbdc195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe1fc9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 0x7ffbdc195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58348/0 (socket says 172.21.15.88:58348) 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe1fc9700 1 -- 172.21.15.88:0/595935869 learned_addr learned my addr 172.21.15.88:0/595935869 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe17c8700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbdc101c90 0x7ffbdc1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe1fc9700 1 -- 172.21.15.88:0/595935869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbdc101c90 msgr2=0x7ffbdc1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe1fc9700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbdc101c90 0x7ffbdc1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe1fc9700 1 -- 172.21.15.88:0/595935869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80095f0 con 0x7ffbdc1012f0 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe1fc9700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 0x7ffbdc195ea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c010 tx=0x7ffbd800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:09.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbd2ffd700 1 -- 172.21.15.88:0/595935869 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd801d070 con 0x7ffbdc1012f0 2024-09-13T21:48:09.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc19aa80 con 0x7ffbdc1012f0 2024-09-13T21:48:09.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbd2ffd700 1 -- 172.21.15.88:0/595935869 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffbd80052a0 con 0x7ffbdc1012f0 2024-09-13T21:48:09.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbd2ffd700 1 -- 172.21.15.88:0/595935869 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd8022470 con 0x7ffbdc1012f0 2024-09-13T21:48:09.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.044+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc19af70 con 0x7ffbdc1012f0 2024-09-13T21:48:09.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.045+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc1079d0 con 0x7ffbdc1012f0 2024-09-13T21:48:09.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.046+0000 7ffbd2ffd700 1 -- 172.21.15.88:0/595935869 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ffbd800f770 con 0x7ffbdc1012f0 2024-09-13T21:48:09.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.046+0000 7ffbd2ffd700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ffbc806e680 0x7ffbc8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:09.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.046+0000 7ffbd2ffd700 1 -- 172.21.15.88:0/595935869 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6359+0+0 (secure 0 0 0) 0x7ffbd808fad0 con 0x7ffbdc1012f0 2024-09-13T21:48:09.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.046+0000 7ffbe17c8700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ffbc806e680 0x7ffbc8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:09.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.047+0000 7ffbe17c8700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ffbc806e680 0x7ffbc8070b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc197470 tx=0x7ffbcc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:09.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.051+0000 7ffbd2ffd700 1 -- 172.21.15.88:0/595935869 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ffbd8058c50 con 0x7ffbdc1012f0 2024-09-13T21:48:09.061 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:08 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:48:08.790+0000 7fb839622640 -1 Falling back to public interface 2024-09-13T21:48:09.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:09 smithi088 ceph-mon[86843]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:09 smithi088 ceph-mon[86843]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:09 smithi088 ceph-mon[86843]: pgmap v144: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:09 smithi088 ceph-mon[86843]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:09 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1881505230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:09.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:09 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3962387048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:48:09.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.280+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbdc19b250 con 0x7ffbc806e680 2024-09-13T21:48:09.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.281+0000 7ffbd2ffd700 1 -- 172.21.15.88:0/595935869 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ffbdc19b250 con 0x7ffbc806e680 2024-09-13T21:48:09.282 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:48:09.282 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "10/23 daemons upgraded", 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:48:09.283 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ffbc806e680 msgr2=0x7ffbc8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ffbc806e680 0x7ffbc8070b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc197470 tx=0x7ffbcc009260 comp rx=0 tx=0).stop 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 msgr2=0x7ffbdc195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 0x7ffbdc195ea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c010 tx=0x7ffbd800b5b0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 shutdown_connections 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ffbc806e680 0x7ffbc8070b30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbdc1012f0 0x7ffbdc195ea0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 --2- 172.21.15.88:0/595935869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbdc101c90 0x7ffbdc1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 >> 172.21.15.88:0/595935869 conn(0x7ffbdc0fac80 msgr2=0x7ffbdc104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 shutdown_connections 2024-09-13T21:48:09.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.283+0000 7ffbe422d700 1 -- 172.21.15.88:0/595935869 wait complete. 2024-09-13T21:48:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:09 smithi116 ceph-mon[65231]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:09 smithi116 ceph-mon[65231]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:09 smithi116 ceph-mon[65231]: pgmap v144: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:09 smithi116 ceph-mon[65231]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:09 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1881505230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:09 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3962387048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:48:09.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.387+0000 7f809515a700 1 -- 172.21.15.88:0/1143435053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80901004e0 msgr2=0x7f80901008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:09.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.387+0000 7f809515a700 1 --2- 172.21.15.88:0/1143435053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80901004e0 0x7f80901008b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8080009910 tx=0x7f8080009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:09.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.387+0000 7f809515a700 1 -- 172.21.15.88:0/1143435053 shutdown_connections 2024-09-13T21:48:09.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.387+0000 7f809515a700 1 --2- 172.21.15.88:0/1143435053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8090100e80 0x7f8090104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.387+0000 7f809515a700 1 --2- 172.21.15.88:0/1143435053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80901004e0 0x7f80901008b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.387+0000 7f809515a700 1 -- 172.21.15.88:0/1143435053 >> 172.21.15.88:0/1143435053 conn(0x7f80900fbda0 msgr2=0x7f80900fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:09.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.387+0000 7f809515a700 1 -- 172.21.15.88:0/1143435053 shutdown_connections 2024-09-13T21:48:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.387+0000 7f809515a700 1 -- 172.21.15.88:0/1143435053 wait complete. 2024-09-13T21:48:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.388+0000 7f809515a700 1 Processor -- start 2024-09-13T21:48:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.388+0000 7f809515a700 1 -- start start 2024-09-13T21:48:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f809515a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80901004e0 0x7f8090195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f809515a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090100e80 0x7f8090196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f809515a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8090196b10 con 0x7f8090100e80 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f809515a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809019a8a0 con 0x7f80901004e0 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f808e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090100e80 0x7f8090196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f808e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090100e80 0x7f8090196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58360/0 (socket says 172.21.15.88:58360) 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f808e59c700 1 -- 172.21.15.88:0/257589058 learned_addr learned my addr 172.21.15.88:0/257589058 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f808ed9d700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80901004e0 0x7f8090195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f808e59c700 1 -- 172.21.15.88:0/257589058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80901004e0 msgr2=0x7f8090195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f808e59c700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80901004e0 0x7f8090195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f808e59c700 1 -- 172.21.15.88:0/257589058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800095f0 con 0x7f8090100e80 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f808e59c700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090100e80 0x7f8090196430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f808400d900 tx=0x7f808400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f8077fff700 1 -- 172.21.15.88:0/257589058 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8084009900 con 0x7f8090100e80 2024-09-13T21:48:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809019ab80 con 0x7f8090100e80 2024-09-13T21:48:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f8077fff700 1 -- 172.21.15.88:0/257589058 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8084010460 con 0x7f8090100e80 2024-09-13T21:48:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f8077fff700 1 -- 172.21.15.88:0/257589058 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f808400f5f0 con 0x7f8090100e80 2024-09-13T21:48:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.389+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809019b0d0 con 0x7f8090100e80 2024-09-13T21:48:09.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.390+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80901087f0 con 0x7f8090100e80 2024-09-13T21:48:09.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.391+0000 7f8077fff700 1 -- 172.21.15.88:0/257589058 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f80840105d0 con 0x7f8090100e80 2024-09-13T21:48:09.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.391+0000 7f8077fff700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f807806e680 0x7f8078070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:09.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.391+0000 7f8077fff700 1 -- 172.21.15.88:0/257589058 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f808408e260 con 0x7f8090100e80 2024-09-13T21:48:09.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.391+0000 7f808ed9d700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f807806e680 0x7f8078070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:09.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.392+0000 7f808ed9d700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f807806e680 0x7f8078070b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8080006010 tx=0x7f808001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:09.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.396+0000 7f8077fff700 1 -- 172.21.15.88:0/257589058 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f80840573e0 con 0x7f8090100e80 2024-09-13T21:48:09.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.679+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f809019b2f0 con 0x7f8090100e80 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.679+0000 7f8077fff700 1 -- 172.21.15.88:0/257589058 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1352 (secure 0 0 0) 0x7f808405aaa0 con 0x7f8090100e80 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 62/360 objects degraded (17.222%), 16 pgs degraded 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stdout: osd.4 (root=default,host=smithi116) is down 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 62/360 objects degraded (17.222%), 16 pgs degraded 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.4 is active+undersized+degraded, acting [1,3] 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-13T21:48:09.681 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-13T21:48:09.682 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1f is active+undersized+degraded, acting [2,3] 2024-09-13T21:48:09.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f807806e680 msgr2=0x7f8078070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:09.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f807806e680 0x7f8078070b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8080006010 tx=0x7f808001a040 comp rx=0 tx=0).stop 2024-09-13T21:48:09.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090100e80 msgr2=0x7f8090196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:09.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090100e80 0x7f8090196430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f808400d900 tx=0x7f808400dc10 comp rx=0 tx=0).stop 2024-09-13T21:48:09.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 shutdown_connections 2024-09-13T21:48:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f807806e680 0x7f8078070b30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80901004e0 0x7f8090195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 --2- 172.21.15.88:0/257589058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8090100e80 0x7f8090196430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 >> 172.21.15.88:0/257589058 conn(0x7f80900fbda0 msgr2=0x7f80900fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.681+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 shutdown_connections 2024-09-13T21:48:09.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:09.682+0000 7f809515a700 1 -- 172.21.15.88:0/257589058 wait complete. 2024-09-13T21:48:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:10 smithi116 ceph-mon[65231]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-13T21:48:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:10 smithi116 ceph-mon[65231]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:10 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/257589058' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:48:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:10 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:10.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:10 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:10.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:10 smithi088 ceph-mon[86843]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-13T21:48:10.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:10 smithi088 ceph-mon[86843]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:10 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/257589058' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:48:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:10 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:10.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:10 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:11.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:11 smithi116 ceph-mon[65231]: pgmap v145: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:11.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:11 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:11.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:11 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:11 smithi088 ceph-mon[86843]: pgmap v145: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:11 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:11 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:13.322 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:13 smithi116 ceph-mon[65231]: pgmap v146: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:13.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:13 smithi088 ceph-mon[86843]: pgmap v146: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:14.690 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:48:14.400+0000 7fb839622640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:48:14.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:48:14.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-13T21:48:14.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: pgmap v147: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:14.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:14 smithi088 ceph-mon[86843]: Health check update: Degraded data redundancy: 62/360 objects degraded (17.222%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:15.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:48:14.822+0000 7fb839622640 -1 osd.4 81 log_to_monitors true 2024-09-13T21:48:15.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:15.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:15.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:15.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:48:15.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:15.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:15.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:15.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:15.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:15.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:48:15.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:48:15.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-13T21:48:15.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: pgmap v147: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:15.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:14 smithi116 ceph-mon[65231]: Health check update: Degraded data redundancy: 62/360 objects degraded (17.222%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:15.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:15 smithi088 ceph-mon[86843]: from='osd.4 [v2:172.21.15.116:6808/2950503107,v1:172.21.15.116:6809/2950503107]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:48:15.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:15 smithi088 ceph-mon[86843]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:48:16.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:15 smithi116 ceph-mon[65231]: from='osd.4 [v2:172.21.15.116:6808/2950503107,v1:172.21.15.116:6809/2950503107]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:48:16.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:15 smithi116 ceph-mon[65231]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:48:16.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:48:15 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:48:15.731+0000 7fb8313bc640 -1 osd.4 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:48:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:16 smithi088 ceph-mon[86843]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T21:48:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:16 smithi088 ceph-mon[86843]: osdmap e84: 6 total, 5 up, 6 in 2024-09-13T21:48:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:16 smithi088 ceph-mon[86843]: from='osd.4 [v2:172.21.15.116:6808/2950503107,v1:172.21.15.116:6809/2950503107]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:48:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:16 smithi088 ceph-mon[86843]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:48:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:16 smithi088 ceph-mon[86843]: pgmap v149: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:16 smithi116 ceph-mon[65231]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T21:48:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:16 smithi116 ceph-mon[65231]: osdmap e84: 6 total, 5 up, 6 in 2024-09-13T21:48:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:16 smithi116 ceph-mon[65231]: from='osd.4 [v2:172.21.15.116:6808/2950503107,v1:172.21.15.116:6809/2950503107]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:48:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:16 smithi116 ceph-mon[65231]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:48:17.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:16 smithi116 ceph-mon[65231]: pgmap v149: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2024-09-13T21:48:17.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:17 smithi088 ceph-mon[86843]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:48:17.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:17 smithi088 ceph-mon[86843]: osd.4 [v2:172.21.15.116:6808/2950503107,v1:172.21.15.116:6809/2950503107] boot 2024-09-13T21:48:17.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:17 smithi088 ceph-mon[86843]: osdmap e85: 6 total, 6 up, 6 in 2024-09-13T21:48:17.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:48:17.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:17.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:17 smithi116 ceph-mon[65231]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:48:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:17 smithi116 ceph-mon[65231]: osd.4 [v2:172.21.15.116:6808/2950503107,v1:172.21.15.116:6809/2950503107] boot 2024-09-13T21:48:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:17 smithi116 ceph-mon[65231]: osdmap e85: 6 total, 6 up, 6 in 2024-09-13T21:48:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:48:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:18.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:18 smithi088 ceph-mon[86843]: osdmap e86: 6 total, 6 up, 6 in 2024-09-13T21:48:18.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:18 smithi088 ceph-mon[86843]: pgmap v152: 65 pgs: 23 peering, 2 active+undersized, 3 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T21:48:19.095 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:18 smithi116 ceph-mon[65231]: osdmap e86: 6 total, 6 up, 6 in 2024-09-13T21:48:19.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:18 smithi116 ceph-mon[65231]: pgmap v152: 65 pgs: 23 peering, 2 active+undersized, 3 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T21:48:19.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:19 smithi088 ceph-mon[86843]: Health check update: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:20.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:19 smithi116 ceph-mon[65231]: Health check update: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:20.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:20 smithi088 ceph-mon[86843]: pgmap v153: 65 pgs: 23 peering, 2 active+undersized, 3 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T21:48:21.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:20 smithi116 ceph-mon[65231]: pgmap v153: 65 pgs: 23 peering, 2 active+undersized, 3 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T21:48:22.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:22 smithi116 ceph-mon[65231]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded) 2024-09-13T21:48:22.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:22 smithi088 ceph-mon[86843]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded) 2024-09-13T21:48:23.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:23 smithi116 ceph-mon[65231]: pgmap v154: 65 pgs: 23 peering, 42 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:23.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:23 smithi088 ceph-mon[86843]: pgmap v154: 65 pgs: 23 peering, 42 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:25.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:25 smithi088 ceph-mon[86843]: pgmap v155: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:25 smithi116 ceph-mon[65231]: pgmap v155: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:27.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:27 smithi116 ceph-mon[65231]: pgmap v156: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:27.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:27 smithi088 ceph-mon[86843]: pgmap v156: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:29.454 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:29 smithi116 ceph-mon[65231]: pgmap v157: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:29.454 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:29 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:48:29.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:29 smithi088 ceph-mon[86843]: pgmap v157: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:29.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:29 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:48:30.562 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:30 smithi116 ceph-mon[65231]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:48:30.562 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:30 smithi116 ceph-mon[65231]: Upgrade: osd.5 is safe to restart 2024-09-13T21:48:30.562 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:30.562 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:48:30.562 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:30.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:30 smithi088 ceph-mon[86843]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:48:30.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:30 smithi088 ceph-mon[86843]: Upgrade: osd.5 is safe to restart 2024-09-13T21:48:30.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:30.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:48:30.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:31.527 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:31 smithi116 ceph-mon[65231]: pgmap v158: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:31.527 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:31 smithi116 ceph-mon[65231]: Upgrade: Updating osd.5 2024-09-13T21:48:31.527 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:31 smithi116 ceph-mon[65231]: Deploying daemon osd.5 on smithi116 2024-09-13T21:48:31.633 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:31 smithi088 ceph-mon[86843]: pgmap v158: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:31.634 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:31 smithi088 ceph-mon[86843]: Upgrade: Updating osd.5 2024-09-13T21:48:31.634 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:31 smithi088 ceph-mon[86843]: Deploying daemon osd.5 on smithi116 2024-09-13T21:48:33.340 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:33 smithi116 systemd[1]: Stopping Ceph osd.5 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:48:33.340 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:33 smithi116 ceph-mon[65231]: pgmap v159: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:33.341 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:33.341 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:33.341 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:33.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:33 smithi088 ceph-mon[86843]: pgmap v159: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:33.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:33 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[48690]: 2024-09-13T21:48:33.338+0000 7f117f428700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:48:33.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:33 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[48690]: 2024-09-13T21:48:33.338+0000 7f117f428700 -1 osd.5 86 *** Got signal Terminated *** 2024-09-13T21:48:33.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:33 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[48690]: 2024-09-13T21:48:33.338+0000 7f117f428700 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:48:34.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:34 smithi088 ceph-mon[86843]: osd.5 marked itself down and dead 2024-09-13T21:48:34.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:34 smithi116 ceph-mon[65231]: osd.5 marked itself down and dead 2024-09-13T21:48:34.874 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:34 smithi116 podman[84119]: 2024-09-13 21:48:34.615471513 +0000 UTC m=+1.397201501 container died 338e7f76ed37d15a05756c10749fe2adc7fda277fe6028a7b83b58f8a67c49fd (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-13T21:48:35.153 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:34 smithi116 podman[84119]: 2024-09-13 21:48:34.971884457 +0000 UTC m=+1.753614435 container cleanup 338e7f76ed37d15a05756c10749fe2adc7fda277fe6028a7b83b58f8a67c49fd (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-13T21:48:35.153 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:34 smithi116 bash[84119]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5 2024-09-13T21:48:35.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:35 smithi088 ceph-mon[86843]: pgmap v160: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:35.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:35 smithi088 ceph-mon[86843]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:48:35.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:35 smithi088 ceph-mon[86843]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T21:48:35.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:35 smithi088 ceph-mon[86843]: osdmap e87: 6 total, 5 up, 6 in 2024-09-13T21:48:35.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:35 smithi116 podman[84135]: 2024-09-13 21:48:35.290101607 +0000 UTC m=+0.670261502 container remove 338e7f76ed37d15a05756c10749fe2adc7fda277fe6028a7b83b58f8a67c49fd (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T21:48:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:35 smithi116 ceph-mon[65231]: pgmap v160: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:35 smithi116 ceph-mon[65231]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:48:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:35 smithi116 ceph-mon[65231]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T21:48:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:35 smithi116 ceph-mon[65231]: osdmap e87: 6 total, 5 up, 6 in 2024-09-13T21:48:35.911 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:35 smithi116 podman[84226]: 2024-09-13 21:48:35.540028567 +0000 UTC m=+0.015537357 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:35.911 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:35 smithi116 podman[84226]: 2024-09-13 21:48:35.657804784 +0000 UTC m=+0.133313616 container create 35082c1644304f8be08f162b99800386f14c01b666e1ad789a10085ba9bc0557 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T21:48:35.911 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:35 smithi116 podman[84226]: 2024-09-13 21:48:35.910270208 +0000 UTC m=+0.385778998 container init 35082c1644304f8be08f162b99800386f14c01b666e1ad789a10085ba9bc0557 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T21:48:36.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:36 smithi116 ceph-mon[65231]: osdmap e88: 6 total, 5 up, 6 in 2024-09-13T21:48:36.346 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:35 smithi116 podman[84226]: 2024-09-13 21:48:35.913668944 +0000 UTC m=+0.389177743 container start 35082c1644304f8be08f162b99800386f14c01b666e1ad789a10085ba9bc0557 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-13T21:48:36.347 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:36 smithi116 podman[84226]: 2024-09-13 21:48:36.010254832 +0000 UTC m=+0.485763649 container attach 35082c1644304f8be08f162b99800386f14c01b666e1ad789a10085ba9bc0557 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T21:48:36.347 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:36 smithi116 podman[84226]: 2024-09-13 21:48:36.103676686 +0000 UTC m=+0.579185477 container died 35082c1644304f8be08f162b99800386f14c01b666e1ad789a10085ba9bc0557 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-ecab7be) 2024-09-13T21:48:36.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:36 smithi088 ceph-mon[86843]: osdmap e88: 6 total, 5 up, 6 in 2024-09-13T21:48:37.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:36 smithi116 podman[84249]: 2024-09-13 21:48:36.705518451 +0000 UTC m=+0.596163028 container remove 35082c1644304f8be08f162b99800386f14c01b666e1ad789a10085ba9bc0557 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T21:48:37.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:36 smithi116 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T21:48:37.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:36 smithi116 systemd[1]: Stopped Ceph osd.5 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:48:37.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:36 smithi116 systemd[1]: ceph-67511300-7217-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 1.713s CPU time. 2024-09-13T21:48:37.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:36 smithi116 systemd[1]: Starting Ceph osd.5 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:48:37.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:37 smithi088 ceph-mon[86843]: pgmap v163: 65 pgs: 3 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 50 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T21:48:37.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:37 smithi088 ceph-mon[86843]: Health check failed: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:37.393 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:37 smithi116 ceph-mon[65231]: pgmap v163: 65 pgs: 3 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 50 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T21:48:37.393 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:37 smithi116 ceph-mon[65231]: Health check failed: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:37.393 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:37 smithi116 podman[84347]: 2024-09-13 21:48:37.035879338 +0000 UTC m=+0.016158294 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:37.394 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:37 smithi116 podman[84347]: 2024-09-13 21:48:37.156964872 +0000 UTC m=+0.137243817 container create 1681dd968ddfacc651db3cea2dde494b9f5dd6575dcfb7f09928151da621a964 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T21:48:37.394 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:37 smithi116 podman[84347]: 2024-09-13 21:48:37.392846705 +0000 UTC m=+0.373125648 container init 1681dd968ddfacc651db3cea2dde494b9f5dd6575dcfb7f09928151da621a964 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T21:48:37.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:37 smithi116 podman[84347]: 2024-09-13 21:48:37.396123467 +0000 UTC m=+0.376402412 container start 1681dd968ddfacc651db3cea2dde494b9f5dd6575dcfb7f09928151da621a964 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T21:48:37.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:37 smithi116 podman[84347]: 2024-09-13 21:48:37.501082495 +0000 UTC m=+0.481361455 container attach 1681dd968ddfacc651db3cea2dde494b9f5dd6575dcfb7f09928151da621a964 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T21:48:37.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:37 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate[84363]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:37.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:37 smithi116 bash[84347]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:37.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:37 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate[84363]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:37.847 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:37 smithi116 bash[84347]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:38.543 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate[84363]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T21:48:38.543 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 bash[84347]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T21:48:38.543 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate[84363]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T21:48:38.543 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 bash[84347]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T21:48:38.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate[84363]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T21:48:38.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 bash[84347]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T21:48:38.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate[84363]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T21:48:38.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 bash[84347]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T21:48:38.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate[84363]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T21:48:38.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 bash[84347]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T21:48:38.847 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate[84363]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T21:48:38.847 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 bash[84347]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T21:48:38.847 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate[84363]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T21:48:38.847 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 bash[84347]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T21:48:38.847 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:38 smithi116 podman[84347]: 2024-09-13 21:48:38.570943199 +0000 UTC m=+1.551222150 container died 1681dd968ddfacc651db3cea2dde494b9f5dd6575dcfb7f09928151da621a964 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T21:48:39.302 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:39 smithi116 ceph-mon[65231]: pgmap v164: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:39.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:39 smithi088 ceph-mon[86843]: pgmap v164: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:39.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:39 smithi116 podman[84504]: 2024-09-13 21:48:39.305482942 +0000 UTC m=+0.723802639 container remove 1681dd968ddfacc651db3cea2dde494b9f5dd6575dcfb7f09928151da621a964 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:48:39.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:39 smithi116 podman[84561]: 2024-09-13 21:48:39.505897339 +0000 UTC m=+0.104201040 container create 7bde2a23d60abd6591fffa9eca016cfe67c8269a9070f69abf7032a0dfd4ed71 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, ceph=True) 2024-09-13T21:48:39.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:39 smithi116 podman[84561]: 2024-09-13 21:48:39.417682693 +0000 UTC m=+0.015986408 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 -- 172.21.15.88:0/4083693336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ffc60 msgr2=0x7fd94010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 --2- 172.21.15.88:0/4083693336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ffc60 0x7fd94010a6d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd930009910 tx=0x7fd930009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 -- 172.21.15.88:0/4083693336 shutdown_connections 2024-09-13T21:48:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 --2- 172.21.15.88:0/4083693336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ffc60 0x7fd94010a6d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 --2- 172.21.15.88:0/4083693336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9400ff350 0x7fd9400ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 -- 172.21.15.88:0/4083693336 >> 172.21.15.88:0/4083693336 conn(0x7fd9400748b0 msgr2=0x7fd940074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 -- 172.21.15.88:0/4083693336 shutdown_connections 2024-09-13T21:48:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 -- 172.21.15.88:0/4083693336 wait complete. 2024-09-13T21:48:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 Processor -- start 2024-09-13T21:48:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.799+0000 7fd947380700 1 -- start start 2024-09-13T21:48:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd947380700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ff350 0x7fd940100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd947380700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9400ffc60 0x7fd940100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd947380700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd940100fb0 con 0x7fd9400ff350 2024-09-13T21:48:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd947380700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9401010f0 con 0x7fd9400ffc60 2024-09-13T21:48:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd94511c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ff350 0x7fd940100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd94511c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ff350 0x7fd940100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55556/0 (socket says 172.21.15.88:55556) 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd94511c700 1 -- 172.21.15.88:0/3874715329 learned_addr learned my addr 172.21.15.88:0/3874715329 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd94491b700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9400ffc60 0x7fd940100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd94511c700 1 -- 172.21.15.88:0/3874715329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9400ffc60 msgr2=0x7fd940100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd94511c700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9400ffc60 0x7fd940100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd94511c700 1 -- 172.21.15.88:0/3874715329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c009520 con 0x7fd9400ff350 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd94491b700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9400ffc60 0x7fd940100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd94511c700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ff350 0x7fd940100530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00eab0 tx=0x7fd93c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.800+0000 7fd9367fc700 1 -- 172.21.15.88:0/3874715329 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93c00cc60 con 0x7fd9400ff350 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.801+0000 7fd9367fc700 1 -- 172.21.15.88:0/3874715329 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd93c0044e0 con 0x7fd9400ff350 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.801+0000 7fd9367fc700 1 -- 172.21.15.88:0/3874715329 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93c005250 con 0x7fd9400ff350 2024-09-13T21:48:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.801+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9300095f0 con 0x7fd9400ff350 2024-09-13T21:48:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.801+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9401a2290 con 0x7fd9400ff350 2024-09-13T21:48:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.802+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd940107dd0 con 0x7fd9400ff350 2024-09-13T21:48:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.802+0000 7fd9367fc700 1 -- 172.21.15.88:0/3874715329 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd93c004930 con 0x7fd9400ff350 2024-09-13T21:48:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.803+0000 7fd9367fc700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd92c06e680 0x7fd92c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.803+0000 7fd9367fc700 1 -- 172.21.15.88:0/3874715329 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fd93c014070 con 0x7fd9400ff350 2024-09-13T21:48:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.803+0000 7fd94491b700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd92c06e680 0x7fd92c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.803+0000 7fd94491b700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd92c06e680 0x7fd92c070b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd930009fd0 tx=0x7fd930005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:39.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:39.807+0000 7fd9367fc700 1 -- 172.21.15.88:0/3874715329 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd93c0578c0 con 0x7fd9400ff350 2024-09-13T21:48:40.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.034+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd94002cc80 con 0x7fd92c06e680 2024-09-13T21:48:40.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.035+0000 7fd9367fc700 1 -- 172.21.15.88:0/3874715329 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd94002cc80 con 0x7fd92c06e680 2024-09-13T21:48:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd92c06e680 msgr2=0x7fd92c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd92c06e680 0x7fd92c070b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd930009fd0 tx=0x7fd930005fb0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ff350 msgr2=0x7fd940100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ff350 0x7fd940100530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00eab0 tx=0x7fd93c00ee70 comp rx=0 tx=0).stop 2024-09-13T21:48:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 shutdown_connections 2024-09-13T21:48:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd92c06e680 0x7fd92c070b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9400ff350 0x7fd940100530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 --2- 172.21.15.88:0/3874715329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9400ffc60 0x7fd940100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 >> 172.21.15.88:0/3874715329 conn(0x7fd9400748b0 msgr2=0x7fd940104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:40.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 shutdown_connections 2024-09-13T21:48:40.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.037+0000 7fd947380700 1 -- 172.21.15.88:0/3874715329 wait complete. 2024-09-13T21:48:40.050 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:48:40.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:39 smithi116 podman[84561]: 2024-09-13 21:48:39.733366121 +0000 UTC m=+0.331669821 container init 7bde2a23d60abd6591fffa9eca016cfe67c8269a9070f69abf7032a0dfd4ed71 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T21:48:40.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:39 smithi116 podman[84561]: 2024-09-13 21:48:39.7371179 +0000 UTC m=+0.335421600 container start 7bde2a23d60abd6591fffa9eca016cfe67c8269a9070f69abf7032a0dfd4ed71 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-13T21:48:40.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:39 smithi116 ceph-osd[84579]: -- 172.21.15.116:0/2672559282 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa434a61e0 con 0x55fa43438000 2024-09-13T21:48:40.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:39 smithi116 bash[84561]: 7bde2a23d60abd6591fffa9eca016cfe67c8269a9070f69abf7032a0dfd4ed71 2024-09-13T21:48:40.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:39 smithi116 systemd[1]: Started Ceph osd.5 for 67511300-7217-11ef-bceb-c7b262605968. 2024-09-13T21:48:40.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.143+0000 7f2b9d606700 1 -- 172.21.15.88:0/2204248152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b98100720 msgr2=0x7f2b98103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.143+0000 7f2b9d606700 1 --2- 172.21.15.88:0/2204248152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b98100720 0x7f2b98103c70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009910 tx=0x7f2b80009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:40.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.143+0000 7f2b9d606700 1 -- 172.21.15.88:0/2204248152 shutdown_connections 2024-09-13T21:48:40.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.143+0000 7f2b9d606700 1 --2- 172.21.15.88:0/2204248152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b98100720 0x7f2b98103c70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.143+0000 7f2b9d606700 1 --2- 172.21.15.88:0/2204248152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b980ffd80 0x7f2b98100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.143+0000 7f2b9d606700 1 -- 172.21.15.88:0/2204248152 >> 172.21.15.88:0/2204248152 conn(0x7f2b98075010 msgr2=0x7f2b98075410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:40.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.143+0000 7f2b9d606700 1 -- 172.21.15.88:0/2204248152 shutdown_connections 2024-09-13T21:48:40.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.143+0000 7f2b9d606700 1 -- 172.21.15.88:0/2204248152 wait complete. 2024-09-13T21:48:40.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.143+0000 7f2b9d606700 1 Processor -- start 2024-09-13T21:48:40.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b9d606700 1 -- start start 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b9d606700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b980ffd80 0x7f2b98196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b9d606700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b98100720 0x7f2b98197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b9d606700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981976a0 con 0x7f2b980ffd80 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b9d606700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98197810 con 0x7f2b98100720 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b96ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b980ffd80 0x7f2b98196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b96ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b980ffd80 0x7f2b98196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41040/0 (socket says 172.21.15.88:41040) 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b96ffd700 1 -- 172.21.15.88:0/3866607280 learned_addr learned my addr 172.21.15.88:0/3866607280 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b967fc700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b98100720 0x7f2b98197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.144+0000 7f2b96ffd700 1 -- 172.21.15.88:0/3866607280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b98100720 msgr2=0x7f2b98197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.145+0000 7f2b96ffd700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b98100720 0x7f2b98197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.145+0000 7f2b96ffd700 1 -- 172.21.15.88:0/3866607280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800095f0 con 0x7f2b980ffd80 2024-09-13T21:48:40.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.145+0000 7f2b96ffd700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b980ffd80 0x7f2b98196b40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800d900 tx=0x7f2b8800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:40.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.145+0000 7f2b8ffff700 1 -- 172.21.15.88:0/3866607280 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b880041f0 con 0x7f2b980ffd80 2024-09-13T21:48:40.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.145+0000 7f2b8ffff700 1 -- 172.21.15.88:0/3866607280 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b88004cf0 con 0x7f2b980ffd80 2024-09-13T21:48:40.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.145+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9819fbb0 con 0x7f2b980ffd80 2024-09-13T21:48:40.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.145+0000 7f2b8ffff700 1 -- 172.21.15.88:0/3866607280 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b8800b750 con 0x7f2b980ffd80 2024-09-13T21:48:40.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.145+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b981a0070 con 0x7f2b980ffd80 2024-09-13T21:48:40.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.146+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b98107530 con 0x7f2b980ffd80 2024-09-13T21:48:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.147+0000 7f2b8ffff700 1 -- 172.21.15.88:0/3866607280 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2b88004750 con 0x7f2b980ffd80 2024-09-13T21:48:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.147+0000 7f2b8ffff700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2b8406e680 0x7f2b84070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.148+0000 7f2b8ffff700 1 -- 172.21.15.88:0/3866607280 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f2b8808e4d0 con 0x7f2b980ffd80 2024-09-13T21:48:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.148+0000 7f2b967fc700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2b8406e680 0x7f2b84070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.148+0000 7f2b967fc700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2b8406e680 0x7f2b84070b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009fd0 tx=0x7f2b8001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:40.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.152+0000 7f2b8ffff700 1 -- 172.21.15.88:0/3866607280 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2b880576d0 con 0x7f2b980ffd80 2024-09-13T21:48:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.374+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b9802cd10 con 0x7f2b8406e680 2024-09-13T21:48:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.375+0000 7f2b8ffff700 1 -- 172.21.15.88:0/3866607280 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2b9802cd10 con 0x7f2b8406e680 2024-09-13T21:48:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.377+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2b8406e680 msgr2=0x7f2b84070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.377+0000 7f2b9d606700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2b8406e680 0x7f2b84070b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009fd0 tx=0x7f2b8001a040 comp rx=0 tx=0).stop 2024-09-13T21:48:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.377+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b980ffd80 msgr2=0x7f2b98196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.377+0000 7f2b9d606700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b980ffd80 0x7f2b98196b40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800d900 tx=0x7f2b8800dc10 comp rx=0 tx=0).stop 2024-09-13T21:48:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.377+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 shutdown_connections 2024-09-13T21:48:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.377+0000 7f2b9d606700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2b8406e680 0x7f2b84070b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.377+0000 7f2b9d606700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b980ffd80 0x7f2b98196b40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.377+0000 7f2b9d606700 1 --2- 172.21.15.88:0/3866607280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b98100720 0x7f2b98197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.377+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 >> 172.21.15.88:0/3866607280 conn(0x7f2b98075010 msgr2=0x7f2b980fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:40.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.378+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 shutdown_connections 2024-09-13T21:48:40.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.378+0000 7f2b9d606700 1 -- 172.21.15.88:0/3866607280 wait complete. 2024-09-13T21:48:40.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.481+0000 7feb86ee1700 1 -- 172.21.15.88:0/4177028338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 msgr2=0x7feb80100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.481+0000 7feb86ee1700 1 --2- 172.21.15.88:0/4177028338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 0x7feb80100830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb7400b0a0 tx=0x7feb7400b3b0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.481+0000 7feb86ee1700 1 -- 172.21.15.88:0/4177028338 shutdown_connections 2024-09-13T21:48:40.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.481+0000 7feb86ee1700 1 --2- 172.21.15.88:0/4177028338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb80100d70 0x7feb801094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.481+0000 7feb86ee1700 1 --2- 172.21.15.88:0/4177028338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 0x7feb80100830 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.481+0000 7feb86ee1700 1 -- 172.21.15.88:0/4177028338 >> 172.21.15.88:0/4177028338 conn(0x7feb800748b0 msgr2=0x7feb80074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:40.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.481+0000 7feb86ee1700 1 -- 172.21.15.88:0/4177028338 shutdown_connections 2024-09-13T21:48:40.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.481+0000 7feb86ee1700 1 -- 172.21.15.88:0/4177028338 wait complete. 2024-09-13T21:48:40.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb86ee1700 1 Processor -- start 2024-09-13T21:48:40.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb86ee1700 1 -- start start 2024-09-13T21:48:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb86ee1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 0x7feb80196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb86ee1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb80100d70 0x7feb801971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb86ee1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80197740 con 0x7feb80100460 2024-09-13T21:48:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb86ee1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80197880 con 0x7feb80100d70 2024-09-13T21:48:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb84c7d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 0x7feb80196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb84c7d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 0x7feb80196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41056/0 (socket says 172.21.15.88:41056) 2024-09-13T21:48:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb84c7d700 1 -- 172.21.15.88:0/134408858 learned_addr learned my addr 172.21.15.88:0/134408858 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb7ffff700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb80100d70 0x7feb801971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb84c7d700 1 -- 172.21.15.88:0/134408858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb80100d70 msgr2=0x7feb801971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb84c7d700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb80100d70 0x7feb801971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.482+0000 7feb84c7d700 1 -- 172.21.15.88:0/134408858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74009d00 con 0x7feb80100460 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.483+0000 7feb84c7d700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 0x7feb80196c70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7feb74000f80 tx=0x7feb7400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.483+0000 7feb7dffb700 1 -- 172.21.15.88:0/134408858 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb7400e040 con 0x7feb80100460 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.483+0000 7feb7dffb700 1 -- 172.21.15.88:0/134408858 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb74003de0 con 0x7feb80100460 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.483+0000 7feb7dffb700 1 -- 172.21.15.88:0/134408858 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb7401d7d0 con 0x7feb80100460 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.483+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8019fce0 con 0x7feb80100460 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.483+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb801a0090 con 0x7feb80100460 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.484+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb80106bd0 con 0x7feb80100460 2024-09-13T21:48:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.485+0000 7feb7dffb700 1 -- 172.21.15.88:0/134408858 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7feb74004040 con 0x7feb80100460 2024-09-13T21:48:40.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.485+0000 7feb7dffb700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feb7006e680 0x7feb70070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:40.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.485+0000 7feb7dffb700 1 -- 172.21.15.88:0/134408858 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6359+0+0 (secure 0 0 0) 0x7feb7408feb0 con 0x7feb80100460 2024-09-13T21:48:40.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.485+0000 7feb7ffff700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feb7006e680 0x7feb70070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:40.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.486+0000 7feb7ffff700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feb7006e680 0x7feb70070b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb800ffc00 tx=0x7feb6c00a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:40.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.489+0000 7feb7dffb700 1 -- 172.21.15.88:0/134408858 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feb740590b0 con 0x7feb80100460 2024-09-13T21:48:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.697+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb8002cca0 con 0x7feb7006e680 2024-09-13T21:48:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.706+0000 7feb7dffb700 1 -- 172.21.15.88:0/134408858 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7feb8002cca0 con 0x7feb7006e680 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (5m) 96s ago 16m 25.3M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (16m) 96s ago 16m 8568k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (15m) 30s ago 15m 8396k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (3m) 96s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (3m) 30s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (5m) 96s ago 15m 82.1M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (10m) 96s ago 10m 119M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (10m) 96s ago 10m 16.6M - 18.2.0 dc2bc1663786 c1d4880cd481 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (10m) 30s ago 10m 18.5M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (10m) 30s ago 10m 121M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:48:40.709 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (7m) 96s ago 17m 500M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (6m) 30s ago 15m 442M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (4m) 96s ago 17m 51.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (3m) 30s ago 14m 40.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (6m) 96s ago 16m 15.5M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (6m) 30s ago 15m 17.4M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (2m) 96s ago 14m 87.9M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (2m) 96s ago 13m 96.2M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 1899bd970e44 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (102s) 96s ago 13m 11.9M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 c38a8f2ec340 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (67s) 30s ago 12m 161M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7b16f89f6086 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (34s) 30s ago 12m 12.1M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 482f725f147b 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 starting - - - 2240M 2024-09-13T21:48:40.710 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (6m) 96s ago 15m 80.6M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:48:40.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feb7006e680 msgr2=0x7feb70070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feb7006e680 0x7feb70070b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb800ffc00 tx=0x7feb6c00a380 comp rx=0 tx=0).stop 2024-09-13T21:48:40.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 msgr2=0x7feb80196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 0x7feb80196c70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7feb74000f80 tx=0x7feb7400cd20 comp rx=0 tx=0).stop 2024-09-13T21:48:40.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 shutdown_connections 2024-09-13T21:48:40.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feb7006e680 0x7feb70070b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80100460 0x7feb80196c70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 --2- 172.21.15.88:0/134408858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb80100d70 0x7feb801971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 >> 172.21.15.88:0/134408858 conn(0x7feb800748b0 msgr2=0x7feb80103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:40.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 shutdown_connections 2024-09-13T21:48:40.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.708+0000 7feb86ee1700 1 -- 172.21.15.88:0/134408858 wait complete. 2024-09-13T21:48:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.811+0000 7fd0bd56b700 1 -- 172.21.15.88:0/3442431374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 msgr2=0x7fd0b810a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.811+0000 7fd0bd56b700 1 --2- 172.21.15.88:0/3442431374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 0x7fd0b810a230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009910 tx=0x7fd0a0009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.811+0000 7fd0bd56b700 1 -- 172.21.15.88:0/3442431374 shutdown_connections 2024-09-13T21:48:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.811+0000 7fd0bd56b700 1 --2- 172.21.15.88:0/3442431374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 0x7fd0b810a230 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.811+0000 7fd0bd56b700 1 --2- 172.21.15.88:0/3442431374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd0b8101420 0x7fd0b81017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.811+0000 7fd0bd56b700 1 -- 172.21.15.88:0/3442431374 >> 172.21.15.88:0/3442431374 conn(0x7fd0b80fac80 msgr2=0x7fd0b80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.811+0000 7fd0bd56b700 1 -- 172.21.15.88:0/3442431374 shutdown_connections 2024-09-13T21:48:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.811+0000 7fd0bd56b700 1 -- 172.21.15.88:0/3442431374 wait complete. 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0bd56b700 1 Processor -- start 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0bd56b700 1 -- start start 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0bd56b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd0b8101420 0x7fd0b8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0bd56b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 0x7fd0b8196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0bd56b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b8196c10 con 0x7fd0b8101d30 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0bd56b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b819a9a0 con 0x7fd0b8101420 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0affff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 0x7fd0b8196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0affff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 0x7fd0b8196530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41070/0 (socket says 172.21.15.88:41070) 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0b6ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd0b8101420 0x7fd0b8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.812+0000 7fd0affff700 1 -- 172.21.15.88:0/4239884956 learned_addr learned my addr 172.21.15.88:0/4239884956 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0b6ffd700 1 -- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 msgr2=0x7fd0b8196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0b6ffd700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 0x7fd0b8196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0b6ffd700 1 -- 172.21.15.88:0/4239884956 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00095f0 con 0x7fd0b8101420 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0affff700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 0x7fd0b8196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0b6ffd700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd0b8101420 0x7fd0b8195ff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800b3d0 tx=0x7fd0a800b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0b4ff9700 1 -- 172.21.15.88:0/4239884956 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0a8011800 con 0x7fd0b8101420 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0b4ff9700 1 -- 172.21.15.88:0/4239884956 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0a800be90 con 0x7fd0b8101420 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b819ac80 con 0x7fd0b8101420 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0b4ff9700 1 -- 172.21.15.88:0/4239884956 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0a8010e70 con 0x7fd0b8101420 2024-09-13T21:48:40.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.813+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b819b1d0 con 0x7fd0b8101420 2024-09-13T21:48:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.814+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b81078a0 con 0x7fd0b8101420 2024-09-13T21:48:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.815+0000 7fd0b4ff9700 1 -- 172.21.15.88:0/4239884956 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd0a801a400 con 0x7fd0b8101420 2024-09-13T21:48:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.815+0000 7fd0b4ff9700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd0a406e680 0x7fd0a4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.815+0000 7fd0affff700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd0a406e680 0x7fd0a4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.815+0000 7fd0b4ff9700 1 -- 172.21.15.88:0/4239884956 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fd0a808e180 con 0x7fd0b8101420 2024-09-13T21:48:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.816+0000 7fd0affff700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd0a406e680 0x7fd0a4070b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0005850 tx=0x7fd0a001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:40.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:40.821+0000 7fd0b4ff9700 1 -- 172.21.15.88:0/4239884956 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd0a8057260 con 0x7fd0b8101420 2024-09-13T21:48:41.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:40 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:41.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:40 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:41.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:40 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:41.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:40 smithi116 ceph-mon[65231]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:41.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:40 smithi116 ceph-mon[65231]: pgmap v165: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:41.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.103+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0b819b450 con 0x7fd0b8101420 2024-09-13T21:48:41.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:40 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:41.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:40 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:41.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:40 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:41.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:40 smithi088 ceph-mon[86843]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:41.105 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:40 smithi088 ceph-mon[86843]: pgmap v165: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:41.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.103+0000 7fd0b4ff9700 1 -- 172.21.15.88:0/4239884956 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+708 (secure 0 0 0) 0x7fd0a805a920 con 0x7fd0b8101420 2024-09-13T21:48:41.106 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:48:41.106 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:48:41.106 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:48:41.106 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:48:41.106 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:48:41.106 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 9 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:48:41.107 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd0a406e680 msgr2=0x7fd0a4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd0a406e680 0x7fd0a4070b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0005850 tx=0x7fd0a001a040 comp rx=0 tx=0).stop 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd0b8101420 msgr2=0x7fd0b8195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd0b8101420 0x7fd0b8195ff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800b3d0 tx=0x7fd0a800b6e0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 shutdown_connections 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd0a406e680 0x7fd0a4070b30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd0b8101420 0x7fd0b8195ff0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 --2- 172.21.15.88:0/4239884956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0b8101d30 0x7fd0b8196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 >> 172.21.15.88:0/4239884956 conn(0x7fd0b80fac80 msgr2=0x7fd0b81049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 shutdown_connections 2024-09-13T21:48:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.107+0000 7fd0bd56b700 1 -- 172.21.15.88:0/4239884956 wait complete. 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.210+0000 7fa35d762700 1 -- 172.21.15.88:0/2973648724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa358100e80 msgr2=0x7fa358104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.210+0000 7fa35d762700 1 --2- 172.21.15.88:0/2973648724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa358100e80 0x7fa358104e50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa348009910 tx=0x7fa348009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.210+0000 7fa35d762700 1 -- 172.21.15.88:0/2973648724 shutdown_connections 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.210+0000 7fa35d762700 1 --2- 172.21.15.88:0/2973648724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa358100e80 0x7fa358104e50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.210+0000 7fa35d762700 1 --2- 172.21.15.88:0/2973648724 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3581004e0 0x7fa3581008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.210+0000 7fa35d762700 1 -- 172.21.15.88:0/2973648724 >> 172.21.15.88:0/2973648724 conn(0x7fa3580fbda0 msgr2=0x7fa3580fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.210+0000 7fa35d762700 1 -- 172.21.15.88:0/2973648724 shutdown_connections 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.210+0000 7fa35d762700 1 -- 172.21.15.88:0/2973648724 wait complete. 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.211+0000 7fa35d762700 1 Processor -- start 2024-09-13T21:48:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.211+0000 7fa35d762700 1 -- start start 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.211+0000 7fa35d762700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3581004e0 0x7fa358196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.211+0000 7fa35d762700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa358100e80 0x7fa358196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.211+0000 7fa35d762700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa358196c20 con 0x7fa3581004e0 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.211+0000 7fa35d762700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35819a9b0 con 0x7fa358100e80 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.211+0000 7fa356ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3581004e0 0x7fa358196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.211+0000 7fa356ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3581004e0 0x7fa358196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41084/0 (socket says 172.21.15.88:41084) 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.211+0000 7fa356ffd700 1 -- 172.21.15.88:0/1940535332 learned_addr learned my addr 172.21.15.88:0/1940535332 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa3567fc700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa358100e80 0x7fa358196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa356ffd700 1 -- 172.21.15.88:0/1940535332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa358100e80 msgr2=0x7fa358196540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa356ffd700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa358100e80 0x7fa358196540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa356ffd700 1 -- 172.21.15.88:0/1940535332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3480095f0 con 0x7fa3581004e0 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa3567fc700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa358100e80 0x7fa358196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:48:41.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa356ffd700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3581004e0 0x7fa358196000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00b4b0 tx=0x7fa34c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa33ffff700 1 -- 172.21.15.88:0/1940535332 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa34c011800 con 0x7fa3581004e0 2024-09-13T21:48:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa33ffff700 1 -- 172.21.15.88:0/1940535332 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa34c011e20 con 0x7fa3581004e0 2024-09-13T21:48:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35819ac90 con 0x7fa3581004e0 2024-09-13T21:48:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa33ffff700 1 -- 172.21.15.88:0/1940535332 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa34c00f2e0 con 0x7fa3581004e0 2024-09-13T21:48:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.212+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35819b1e0 con 0x7fa3581004e0 2024-09-13T21:48:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.213+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa358108780 con 0x7fa3581004e0 2024-09-13T21:48:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.214+0000 7fa33ffff700 1 -- 172.21.15.88:0/1940535332 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa34c010380 con 0x7fa3581004e0 2024-09-13T21:48:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.214+0000 7fa33ffff700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa34006e680 0x7fa340070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.214+0000 7fa3567fc700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa34006e680 0x7fa340070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.214+0000 7fa33ffff700 1 -- 172.21.15.88:0/1940535332 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fa34c08e290 con 0x7fa3581004e0 2024-09-13T21:48:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.215+0000 7fa3567fc700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa34006e680 0x7fa340070b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa358197620 tx=0x7fa34801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:41.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.219+0000 7fa33ffff700 1 -- 172.21.15.88:0/1940535332 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa34c057410 con 0x7fa3581004e0 2024-09-13T21:48:41.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.467+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa35819b460 con 0x7fa3581004e0 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.467+0000 7fa33ffff700 1 -- 172.21.15.88:0/1940535332 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1923 (secure 0 0 0) 0x7fa34c05aad0 con 0x7fa3581004e0 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout:e20 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 20 2024-09-13T21:48:41.470 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:43:58.996472+0000 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 47 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:48:41.471 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=14480,1=24277} 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.88:6828/3000160721,v1:172.21.15.88:6829/3000160721] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.116:6824/3165930293,v1:172.21.15.116:6825/3165930293] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:41.472 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:48:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:48:41.473 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:48:41.473 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:48:41.473 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1678889304,v1:172.21.15.88:6827/1678889304] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:41.473 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:41.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa34006e680 msgr2=0x7fa340070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa34006e680 0x7fa340070b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa358197620 tx=0x7fa34801a040 comp rx=0 tx=0).stop 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3581004e0 msgr2=0x7fa358196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3581004e0 0x7fa358196000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00b4b0 tx=0x7fa34c00b870 comp rx=0 tx=0).stop 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 shutdown_connections 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa34006e680 0x7fa340070b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3581004e0 0x7fa358196000 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 --2- 172.21.15.88:0/1940535332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa358100e80 0x7fa358196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 >> 172.21.15.88:0/1940535332 conn(0x7fa3580fbda0 msgr2=0x7fa3580fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 shutdown_connections 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.469+0000 7fa35d762700 1 -- 172.21.15.88:0/1940535332 wait complete. 2024-09-13T21:48:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:48:41.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.574+0000 7f4ee3131700 1 -- 172.21.15.88:0/2451622658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 msgr2=0x7f4edc0ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.574+0000 7f4ee3131700 1 --2- 172.21.15.88:0/2451622658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 0x7f4edc0ff780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009910 tx=0x7f4ed0009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:41.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.574+0000 7f4ee3131700 1 -- 172.21.15.88:0/2451622658 shutdown_connections 2024-09-13T21:48:41.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.574+0000 7f4ee3131700 1 --2- 172.21.15.88:0/2451622658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4edc0ffd50 0x7f4edc103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.574+0000 7f4ee3131700 1 --2- 172.21.15.88:0/2451622658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 0x7f4edc0ff780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.574+0000 7f4ee3131700 1 -- 172.21.15.88:0/2451622658 >> 172.21.15.88:0/2451622658 conn(0x7f4edc0fac90 msgr2=0x7f4edc0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:41.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.574+0000 7f4ee3131700 1 -- 172.21.15.88:0/2451622658 shutdown_connections 2024-09-13T21:48:41.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.575+0000 7f4ee3131700 1 -- 172.21.15.88:0/2451622658 wait complete. 2024-09-13T21:48:41.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.575+0000 7f4ee3131700 1 Processor -- start 2024-09-13T21:48:41.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.575+0000 7f4ee3131700 1 -- start start 2024-09-13T21:48:41.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.575+0000 7f4ee3131700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 0x7f4edc196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:41.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.575+0000 7f4ee3131700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4edc0ffd50 0x7f4edc197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.575+0000 7f4ee3131700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1978a0 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.575+0000 7f4ee3131700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc197a10 con 0x7f4edc0ffd50 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ee0ecd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 0x7f4edc196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ee0ecd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 0x7f4edc196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41104/0 (socket says 172.21.15.88:41104) 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ee0ecd700 1 -- 172.21.15.88:0/3957126318 learned_addr learned my addr 172.21.15.88:0/3957126318 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4edbfff700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4edc0ffd50 0x7f4edc197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ee0ecd700 1 -- 172.21.15.88:0/3957126318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4edc0ffd50 msgr2=0x7f4edc197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ee0ecd700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4edc0ffd50 0x7f4edc197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ee0ecd700 1 -- 172.21.15.88:0/3957126318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00095f0 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4edbfff700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4edc0ffd50 0x7f4edc197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ee0ecd700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 0x7f4edc196d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0005f50 tx=0x7f4ed000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ed9ffb700 1 -- 172.21.15.88:0/3957126318 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ed001d070 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ed9ffb700 1 -- 172.21.15.88:0/3957126318 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ed000b610 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc19fdb0 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.576+0000 7f4ed9ffb700 1 -- 172.21.15.88:0/3957126318 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ed0022470 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.577+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc1a0220 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.577+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc1076c0 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.578+0000 7f4ed9ffb700 1 -- 172.21.15.88:0/3957126318 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4ed000fca0 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.578+0000 7f4ed9ffb700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4ecc06e680 0x7f4ecc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:41.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.578+0000 7f4ed9ffb700 1 -- 172.21.15.88:0/3957126318 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f4ed008fa60 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.578+0000 7f4edbfff700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4ecc06e680 0x7f4ecc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:41.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.579+0000 7f4edbfff700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4ecc06e680 0x7f4ecc070b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0696c0 tx=0x7f4ec8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:41.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.583+0000 7f4ed9ffb700 1 -- 172.21.15.88:0/3957126318 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4ed0058c60 con 0x7f4edc0ff3b0 2024-09-13T21:48:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.810+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4edc0694a0 con 0x7f4ecc06e680 2024-09-13T21:48:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.812+0000 7f4ed9ffb700 1 -- 172.21.15.88:0/3957126318 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4edc0694a0 con 0x7f4ecc06e680 2024-09-13T21:48:41.814 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:48:41.814 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:48:41.814 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "11/23 daemons upgraded", 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:48:41.815 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:48:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4ecc06e680 msgr2=0x7f4ecc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4ecc06e680 0x7f4ecc070b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0696c0 tx=0x7f4ec8009260 comp rx=0 tx=0).stop 2024-09-13T21:48:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 msgr2=0x7f4edc196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 0x7f4edc196d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0005f50 tx=0x7f4ed000f740 comp rx=0 tx=0).stop 2024-09-13T21:48:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 shutdown_connections 2024-09-13T21:48:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4ecc06e680 0x7f4ecc070b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4edc0ff3b0 0x7f4edc196d40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 --2- 172.21.15.88:0/3957126318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4edc0ffd50 0x7f4edc197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 >> 172.21.15.88:0/3957126318 conn(0x7f4edc0fac90 msgr2=0x7f4edc0fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:41.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 shutdown_connections 2024-09-13T21:48:41.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.814+0000 7f4ee3131700 1 -- 172.21.15.88:0/3957126318 wait complete. 2024-09-13T21:48:41.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:41 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:48:41.609+0000 7f78610de640 -1 Falling back to public interface 2024-09-13T21:48:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.919+0000 7f2853e56700 1 -- 172.21.15.88:0/3773522421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 msgr2=0x7f284c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.919+0000 7f2853e56700 1 --2- 172.21.15.88:0/3773522421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 0x7f284c104e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2840009910 tx=0x7f2840009c20 comp rx=0 tx=0).stop 2024-09-13T21:48:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.919+0000 7f2853e56700 1 -- 172.21.15.88:0/3773522421 shutdown_connections 2024-09-13T21:48:41.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.919+0000 7f2853e56700 1 --2- 172.21.15.88:0/3773522421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 0x7f284c104e50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.919+0000 7f2853e56700 1 --2- 172.21.15.88:0/3773522421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f284c1004e0 0x7f284c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.919+0000 7f2853e56700 1 -- 172.21.15.88:0/3773522421 >> 172.21.15.88:0/3773522421 conn(0x7f284c0fbda0 msgr2=0x7f284c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.919+0000 7f2853e56700 1 -- 172.21.15.88:0/3773522421 shutdown_connections 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.919+0000 7f2853e56700 1 -- 172.21.15.88:0/3773522421 wait complete. 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f2853e56700 1 Processor -- start 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f2853e56700 1 -- start start 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f2853e56700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f284c1004e0 0x7f284c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f2853e56700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 0x7f284c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f2853e56700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c196b50 con 0x7f284c100e80 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f2853e56700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c19a8e0 con 0x7f284c1004e0 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f28513f1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 0x7f284c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f28513f1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 0x7f284c196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41124/0 (socket says 172.21.15.88:41124) 2024-09-13T21:48:41.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f28513f1700 1 -- 172.21.15.88:0/3141920735 learned_addr learned my addr 172.21.15.88:0/3141920735 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.920+0000 7f2851bf2700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f284c1004e0 0x7f284c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.921+0000 7f28513f1700 1 -- 172.21.15.88:0/3141920735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f284c1004e0 msgr2=0x7f284c195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.921+0000 7f28513f1700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f284c1004e0 0x7f284c195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.921+0000 7f28513f1700 1 -- 172.21.15.88:0/3141920735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28400095f0 con 0x7f284c100e80 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.921+0000 7f28513f1700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 0x7f284c196470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28400092e0 tx=0x7f284000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.921+0000 7f284affd700 1 -- 172.21.15.88:0/3141920735 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f284001d070 con 0x7f284c100e80 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.921+0000 7f284affd700 1 -- 172.21.15.88:0/3141920735 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f284000f460 con 0x7f284c100e80 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.921+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c19ab60 con 0x7f284c100e80 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.921+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c19b050 con 0x7f284c100e80 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.921+0000 7f284affd700 1 -- 172.21.15.88:0/3141920735 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f284002b610 con 0x7f284c100e80 2024-09-13T21:48:41.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.922+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c108850 con 0x7f284c100e80 2024-09-13T21:48:41.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.922+0000 7f284affd700 1 -- 172.21.15.88:0/3141920735 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f284000f5d0 con 0x7f284c100e80 2024-09-13T21:48:41.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.923+0000 7f284affd700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f283406e680 0x7f2834070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:41.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.923+0000 7f284affd700 1 -- 172.21.15.88:0/3141920735 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f284008fb40 con 0x7f284c100e80 2024-09-13T21:48:41.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.923+0000 7f2851bf2700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f283406e680 0x7f2834070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:41.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.923+0000 7f2851bf2700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f283406e680 0x7f2834070b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28440060b0 tx=0x7f284400c040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:41.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:41.927+0000 7f284affd700 1 -- 172.21.15.88:0/3141920735 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2840058cc0 con 0x7f284c100e80 2024-09-13T21:48:42.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.218+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f284c04f2a0 con 0x7f284c100e80 2024-09-13T21:48:42.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:41 smithi088 ceph-mon[86843]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:42.220 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:41 smithi088 ceph-mon[86843]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:42.221 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:41 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/4239884956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:42.221 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:41 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1940535332' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:48:42.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.219+0000 7f284affd700 1 -- 172.21.15.88:0/3141920735 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1480 (secure 0 0 0) 0x7f284005c380 con 0x7f284c100e80 2024-09-13T21:48:42.221 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 54/360 objects degraded (15.000%), 14 pgs degraded 2024-09-13T21:48:42.221 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:48:42.221 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:48:42.221 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T21:48:42.221 INFO:teuthology.orchestra.run.smithi088.stdout: osd.5 (root=default,host=smithi116) is down 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/360 objects degraded (15.000%), 14 pgs degraded 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-09-13T21:48:42.222 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-13T21:48:42.223 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-13T21:48:42.223 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1b is active+undersized+degraded, acting [1,3] 2024-09-13T21:48:42.223 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-13T21:48:42.223 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-13T21:48:42.223 INFO:teuthology.orchestra.run.smithi088.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-13T21:48:42.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f283406e680 msgr2=0x7f2834070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:42.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f283406e680 0x7f2834070b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28440060b0 tx=0x7f284400c040 comp rx=0 tx=0).stop 2024-09-13T21:48:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 msgr2=0x7f284c196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 0x7f284c196470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28400092e0 tx=0x7f284000bd70 comp rx=0 tx=0).stop 2024-09-13T21:48:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 shutdown_connections 2024-09-13T21:48:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f283406e680 0x7f2834070b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f284c1004e0 0x7f284c195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 --2- 172.21.15.88:0/3141920735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f284c100e80 0x7f284c196470 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 >> 172.21.15.88:0/3141920735 conn(0x7f284c0fbda0 msgr2=0x7f284c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 shutdown_connections 2024-09-13T21:48:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:48:42.221+0000 7f2853e56700 1 -- 172.21.15.88:0/3141920735 wait complete. 2024-09-13T21:48:42.281 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:41 smithi116 ceph-mon[65231]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:42.281 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:41 smithi116 ceph-mon[65231]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:42.281 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:41 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/4239884956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:42.281 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:41 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1940535332' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:48:43.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:42 smithi088 ceph-mon[86843]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:43.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:42 smithi088 ceph-mon[86843]: pgmap v166: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:43.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:42 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3141920735' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:48:43.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:42 smithi116 ceph-mon[65231]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:43.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:42 smithi116 ceph-mon[65231]: pgmap v166: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:43.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:42 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3141920735' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:48:44.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:43 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:44.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:43 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:44.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:43 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:44.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:43 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:44.248 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:43 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:44.248 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:43 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:44.248 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:43 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:44.248 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:43 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:45.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:44 smithi088 ceph-mon[86843]: pgmap v167: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:45.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:44 smithi088 ceph-mon[86843]: Health check update: Degraded data redundancy: 54/360 objects degraded (15.000%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:45.286 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:44 smithi116 ceph-mon[65231]: pgmap v167: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:45.286 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:44 smithi116 ceph-mon[65231]: Health check update: Degraded data redundancy: 54/360 objects degraded (15.000%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: pgmap v168: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:48:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T21:48:47.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T21:48:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T21:48:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T21:48:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T21:48:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T21:48:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T21:48:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T21:48:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.485 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:47.527 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:48:47.125+0000 7f78610de640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: pgmap v168: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:47.528 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T21:48:47.529 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T21:48:47.530 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T21:48:47.530 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T21:48:47.530 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:47.530 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:47.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:47 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:48:47.525+0000 7f78610de640 -1 osd.5 86 log_to_monitors true 2024-09-13T21:48:48.224 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:47 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088[86838]: 2024-09-13T21:48:47.898+0000 7f9b33a25640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:48:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all osd 2024-09-13T21:48:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T21:48:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: from='osd.5 [v2:172.21.15.116:6816/3220971973,v1:172.21.15.116:6817/3220971973]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:48:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:48:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T21:48:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T21:48:48.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T21:48:48.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: from='osd.5 [v2:172.21.15.116:6816/3220971973,v1:172.21.15.116:6817/3220971973]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:48:48.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: osdmap e89: 6 total, 5 up, 6 in 2024-09-13T21:48:48.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:48:48.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T21:48:48.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:48:48.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:48:48.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T21:48:48.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: osdmap e90: 6 total, 5 up, 6 in 2024-09-13T21:48:48.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:48 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-13T21:48:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all osd 2024-09-13T21:48:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T21:48:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: from='osd.5 [v2:172.21.15.116:6816/3220971973,v1:172.21.15.116:6817/3220971973]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:48:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:48:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: from='osd.5 [v2:172.21.15.116:6816/3220971973,v1:172.21.15.116:6817/3220971973]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: osdmap e89: 6 total, 5 up, 6 in 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: osdmap e90: 6 total, 5 up, 6 in 2024-09-13T21:48:48.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-13T21:48:49.096 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:48:48 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:48:48.703+0000 7f7854e70640 -1 osd.5 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:48:49.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:49 smithi088 ceph-mon[86843]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-13T21:48:49.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:49 smithi088 ceph-mon[86843]: pgmap v171: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:49 smithi088 ceph-mon[86843]: from='osd.5 ' entity='osd.5' 2024-09-13T21:48:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:49 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6828/882006655,v1:172.21.15.88:6829/882006655] up:boot 2024-09-13T21:48:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:49 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.116:6824/1529923452,v1:172.21.15.116:6825/1529923452] up:boot 2024-09-13T21:48:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:49 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:48:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:48:49.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:48:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:49 smithi116 ceph-mon[65231]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-13T21:48:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:49 smithi116 ceph-mon[65231]: pgmap v171: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:49 smithi116 ceph-mon[65231]: from='osd.5 ' entity='osd.5' 2024-09-13T21:48:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:49 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6828/882006655,v1:172.21.15.88:6829/882006655] up:boot 2024-09-13T21:48:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:49 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.116:6824/1529923452,v1:172.21.15.116:6825/1529923452] up:boot 2024-09-13T21:48:49.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:49 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:48:49.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:48:49.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:48:50.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:50 smithi116 ceph-mon[65231]: Upgrade: Updating mds.cephfs.smithi088.yszliw 2024-09-13T21:48:50.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:50 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:50.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:50 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.yszliw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:48:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:50 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:50 smithi116 ceph-mon[65231]: Deploying daemon mds.cephfs.smithi088.yszliw on smithi088 2024-09-13T21:48:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:50 smithi116 ceph-mon[65231]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:48:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:50 smithi116 ceph-mon[65231]: osd.5 [v2:172.21.15.116:6816/3220971973,v1:172.21.15.116:6817/3220971973] boot 2024-09-13T21:48:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:50 smithi116 ceph-mon[65231]: osdmap e91: 6 total, 6 up, 6 in 2024-09-13T21:48:50.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:50 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:48:50.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:50 smithi088 ceph-mon[86843]: Upgrade: Updating mds.cephfs.smithi088.yszliw 2024-09-13T21:48:50.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:50 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:50.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:50 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.yszliw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:48:50.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:50 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:50.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:50 smithi088 ceph-mon[86843]: Deploying daemon mds.cephfs.smithi088.yszliw on smithi088 2024-09-13T21:48:50.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:50 smithi088 ceph-mon[86843]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:48:50.694 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:50 smithi088 ceph-mon[86843]: osd.5 [v2:172.21.15.116:6816/3220971973,v1:172.21.15.116:6817/3220971973] boot 2024-09-13T21:48:50.695 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:50 smithi088 ceph-mon[86843]: osdmap e91: 6 total, 6 up, 6 in 2024-09-13T21:48:50.695 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:50 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:48:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:51 smithi116 ceph-mon[65231]: pgmap v173: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:51 smithi116 ceph-mon[65231]: osdmap e92: 6 total, 6 up, 6 in 2024-09-13T21:48:51.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:51 smithi088 ceph-mon[86843]: pgmap v173: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2024-09-13T21:48:51.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:51 smithi088 ceph-mon[86843]: osdmap e92: 6 total, 6 up, 6 in 2024-09-13T21:48:52.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:52 smithi088 ceph-mon[86843]: osdmap e93: 6 total, 6 up, 6 in 2024-09-13T21:48:52.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:52 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-13T21:48:52.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:52 smithi116 ceph-mon[65231]: osdmap e93: 6 total, 6 up, 6 in 2024-09-13T21:48:52.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:52 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-13T21:48:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:53 smithi116 ceph-mon[65231]: pgmap v176: 65 pgs: 2 activating, 14 active+undersized, 12 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/360 objects degraded (13.889%) 2024-09-13T21:48:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:53 smithi116 ceph-mon[65231]: Health check update: Degraded data redundancy: 50/360 objects degraded (13.889%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:48:53.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:53 smithi088 ceph-mon[86843]: pgmap v176: 65 pgs: 2 activating, 14 active+undersized, 12 active+undersized+degraded, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/360 objects degraded (13.889%) 2024-09-13T21:48:53.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:53 smithi088 ceph-mon[86843]: Health check update: Degraded data redundancy: 50/360 objects degraded (13.889%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:48:54.623 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:54 smithi088 ceph-mon[86843]: pgmap v177: 65 pgs: 2 activating, 63 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:54.623 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:54 smithi088 ceph-mon[86843]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/360 objects degraded (13.889%), 12 pgs degraded) 2024-09-13T21:48:54.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:54 smithi116 ceph-mon[65231]: pgmap v177: 65 pgs: 2 activating, 63 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:54.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:54 smithi116 ceph-mon[65231]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/360 objects degraded (13.889%), 12 pgs degraded) 2024-09-13T21:48:56.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:56 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:boot 2024-09-13T21:48:56.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:56 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:48:56.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:48:56.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:56.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:56.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:56 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:56.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:56 smithi088 ceph-mon[86843]: pgmap v178: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:56.760 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:56 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:boot 2024-09-13T21:48:56.760 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:56 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:48:56.760 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:48:56.760 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:56.760 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:48:56.761 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:56 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:56.761 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:56 smithi116 ceph-mon[65231]: pgmap v178: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:59.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:48:59 smithi088 ceph-mon[86843]: pgmap v179: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:48:59.495 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:48:59 smithi116 ceph-mon[65231]: pgmap v179: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:01.544 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:01 smithi088 ceph-mon[86843]: pgmap v180: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:01.545 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:01 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:01.545 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:01 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:01.545 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:01 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:01.545 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:01 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:01 smithi116 ceph-mon[65231]: pgmap v180: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:01 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:01 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:01 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:01 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:03.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:03.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:03.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:03 smithi088 ceph-mon[86843]: pgmap v181: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:03.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:03 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:03 smithi116 ceph-mon[65231]: pgmap v181: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:03 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: pgmap v182: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:05.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:05.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: pgmap v182: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:05.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:05.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:05.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:05.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:05.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:05.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:06 smithi088 ceph-mon[86843]: Upgrade: Updating mds.cephfs.smithi088.vqfqko 2024-09-13T21:49:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:06 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:06 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.vqfqko", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:49:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:06 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:06 smithi088 ceph-mon[86843]: Deploying daemon mds.cephfs.smithi088.vqfqko on smithi088 2024-09-13T21:49:07.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:06 smithi088 ceph-mon[86843]: pgmap v183: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:07.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:06 smithi116 ceph-mon[65231]: Upgrade: Updating mds.cephfs.smithi088.vqfqko 2024-09-13T21:49:07.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:06 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:07.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:06 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi088.vqfqko", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:49:07.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:06 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:07.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:06 smithi116 ceph-mon[65231]: Deploying daemon mds.cephfs.smithi088.vqfqko on smithi088 2024-09-13T21:49:07.347 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:06 smithi116 ceph-mon[65231]: pgmap v183: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:09 smithi116 ceph-mon[65231]: osdmap e94: 6 total, 6 up, 6 in 2024-09-13T21:49:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:09 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-13T21:49:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:09 smithi116 ceph-mon[65231]: pgmap v185: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:09.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:09 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:49:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:09 smithi088 ceph-mon[86843]: osdmap e94: 6 total, 6 up, 6 in 2024-09-13T21:49:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:09 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-13T21:49:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:09 smithi088 ceph-mon[86843]: pgmap v185: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:09.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:09 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:49:11.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:11 smithi088 ceph-mon[86843]: pgmap v186: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:11 smithi116 ceph-mon[65231]: pgmap v186: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:12.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.341+0000 7f371b39b700 1 -- 172.21.15.88:0/3453396581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 msgr2=0x7f37140ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:12.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.341+0000 7f371b39b700 1 --2- 172.21.15.88:0/3453396581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 0x7f37140ff790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f370c009910 tx=0x7f370c009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:12.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.341+0000 7f371b39b700 1 -- 172.21.15.88:0/3453396581 shutdown_connections 2024-09-13T21:49:12.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.341+0000 7f371b39b700 1 --2- 172.21.15.88:0/3453396581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37140ffd60 0x7f3714103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.341+0000 7f371b39b700 1 --2- 172.21.15.88:0/3453396581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 0x7f37140ff790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.341+0000 7f371b39b700 1 -- 172.21.15.88:0/3453396581 >> 172.21.15.88:0/3453396581 conn(0x7f37140fac80 msgr2=0x7f37140fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:12.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.341+0000 7f371b39b700 1 -- 172.21.15.88:0/3453396581 shutdown_connections 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.341+0000 7f371b39b700 1 -- 172.21.15.88:0/3453396581 wait complete. 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.342+0000 7f371b39b700 1 Processor -- start 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.342+0000 7f371b39b700 1 -- start start 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.342+0000 7f371b39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 0x7f3714196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.342+0000 7f371b39b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37140ffd60 0x7f3714197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.342+0000 7f371b39b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714197830 con 0x7f37140ff3c0 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.342+0000 7f371b39b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37141979a0 con 0x7f37140ffd60 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f3719137700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 0x7f3714196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f3719137700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 0x7f3714196cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55826/0 (socket says 172.21.15.88:55826) 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f3719137700 1 -- 172.21.15.88:0/2023085546 learned_addr learned my addr 172.21.15.88:0/2023085546 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f3718936700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37140ffd60 0x7f3714197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:12.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f3719137700 1 -- 172.21.15.88:0/2023085546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37140ffd60 msgr2=0x7f3714197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:12.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f3719137700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37140ffd60 0x7f3714197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f3719137700 1 -- 172.21.15.88:0/2023085546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0095f0 con 0x7f37140ff3c0 2024-09-13T21:49:12.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f3719137700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 0x7f3714196cd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f370c006010 tx=0x7f370c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:12.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f37127fc700 1 -- 172.21.15.88:0/2023085546 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f370c01d070 con 0x7f37140ff3c0 2024-09-13T21:49:12.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f37127fc700 1 -- 172.21.15.88:0/2023085546 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f370c005dc0 con 0x7f37140ff3c0 2024-09-13T21:49:12.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f37127fc700 1 -- 172.21.15.88:0/2023085546 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f370c017400 con 0x7f37140ff3c0 2024-09-13T21:49:12.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371419fd40 con 0x7f37140ff3c0 2024-09-13T21:49:12.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.343+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37141a01b0 con 0x7f37140ff3c0 2024-09-13T21:49:12.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.345+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37141076d0 con 0x7f37140ff3c0 2024-09-13T21:49:12.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.345+0000 7f37127fc700 1 -- 172.21.15.88:0/2023085546 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f370c003a60 con 0x7f37140ff3c0 2024-09-13T21:49:12.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.345+0000 7f37127fc700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36fc06e680 0x7f36fc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:12.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.346+0000 7f3718936700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36fc06e680 0x7f36fc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:12.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.346+0000 7f37127fc700 1 -- 172.21.15.88:0/2023085546 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f370c08fad0 con 0x7f37140ff3c0 2024-09-13T21:49:12.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.346+0000 7f3718936700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36fc06e680 0x7f36fc070b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37140696a0 tx=0x7f370800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:12.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.350+0000 7f37127fc700 1 -- 172.21.15.88:0/2023085546 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f370c058c20 con 0x7f37140ff3c0 2024-09-13T21:49:12.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.583+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3714061190 con 0x7f36fc06e680 2024-09-13T21:49:12.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.584+0000 7f37127fc700 1 -- 172.21.15.88:0/2023085546 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3714061190 con 0x7f36fc06e680 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36fc06e680 msgr2=0x7f36fc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36fc06e680 0x7f36fc070b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37140696a0 tx=0x7f370800b410 comp rx=0 tx=0).stop 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 msgr2=0x7f3714196cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 0x7f3714196cd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f370c006010 tx=0x7f370c00bd70 comp rx=0 tx=0).stop 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 shutdown_connections 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f36fc06e680 0x7f36fc070b30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37140ff3c0 0x7f3714196cd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 --2- 172.21.15.88:0/2023085546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37140ffd60 0x7f3714197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 >> 172.21.15.88:0/2023085546 conn(0x7f37140fac80 msgr2=0x7f37140fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 shutdown_connections 2024-09-13T21:49:12.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.586+0000 7f371b39b700 1 -- 172.21.15.88:0/2023085546 wait complete. 2024-09-13T21:49:12.598 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:49:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.694+0000 7fd68fa6f700 1 -- 172.21.15.88:0/4138410697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6880ffbd0 msgr2=0x7fd688100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.694+0000 7fd68fa6f700 1 --2- 172.21.15.88:0/4138410697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6880ffbd0 0x7fd688100040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd684009910 tx=0x7fd684009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.694+0000 7fd68fa6f700 1 -- 172.21.15.88:0/4138410697 shutdown_connections 2024-09-13T21:49:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.694+0000 7fd68fa6f700 1 --2- 172.21.15.88:0/4138410697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6880ffbd0 0x7fd688100040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.694+0000 7fd68fa6f700 1 --2- 172.21.15.88:0/4138410697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd688104130 0x7fd688104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.694+0000 7fd68fa6f700 1 -- 172.21.15.88:0/4138410697 >> 172.21.15.88:0/4138410697 conn(0x7fd688075130 msgr2=0x7fd688075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.694+0000 7fd68fa6f700 1 -- 172.21.15.88:0/4138410697 shutdown_connections 2024-09-13T21:49:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.694+0000 7fd68fa6f700 1 -- 172.21.15.88:0/4138410697 wait complete. 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68fa6f700 1 Processor -- start 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68fa6f700 1 -- start start 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68fa6f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6880ffbd0 0x7fd688195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68fa6f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd688104130 0x7fd688196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68fa6f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd688196a40 con 0x7fd688104130 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68fa6f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68819a7d0 con 0x7fd6880ffbd0 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68d00a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd688104130 0x7fd688196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68d00a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd688104130 0x7fd688196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55848/0 (socket says 172.21.15.88:55848) 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68d00a700 1 -- 172.21.15.88:0/3850051147 learned_addr learned my addr 172.21.15.88:0/3850051147 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68d80b700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6880ffbd0 0x7fd688195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68d00a700 1 -- 172.21.15.88:0/3850051147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6880ffbd0 msgr2=0x7fd688195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68d00a700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6880ffbd0 0x7fd688195e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68d00a700 1 -- 172.21.15.88:0/3850051147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6840095f0 con 0x7fd688104130 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.695+0000 7fd68d80b700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6880ffbd0 0x7fd688195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.696+0000 7fd68d00a700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd688104130 0x7fd688196360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd68400bd70 tx=0x7fd68400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.696+0000 7fd67affd700 1 -- 172.21.15.88:0/3850051147 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd68401d070 con 0x7fd688104130 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.696+0000 7fd67affd700 1 -- 172.21.15.88:0/3850051147 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd68400f460 con 0x7fd688104130 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.696+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68819aa50 con 0x7fd688104130 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.696+0000 7fd67affd700 1 -- 172.21.15.88:0/3850051147 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd684017630 con 0x7fd688104130 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.696+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68819af40 con 0x7fd688104130 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.697+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6881086a0 con 0x7fd688104130 2024-09-13T21:49:12.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.697+0000 7fd67affd700 1 -- 172.21.15.88:0/3850051147 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd684003a60 con 0x7fd688104130 2024-09-13T21:49:12.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.698+0000 7fd67affd700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd67406e680 0x7fd674070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:12.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.698+0000 7fd67affd700 1 -- 172.21.15.88:0/3850051147 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd68408fd40 con 0x7fd688104130 2024-09-13T21:49:12.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.698+0000 7fd68d80b700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd67406e680 0x7fd674070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:12.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.698+0000 7fd68d80b700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd67406e680 0x7fd674070b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd67c005950 tx=0x7fd67c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:12.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.702+0000 7fd67affd700 1 -- 172.21.15.88:0/3850051147 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd684058e30 con 0x7fd688104130 2024-09-13T21:49:12.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.949+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd68819b220 con 0x7fd67406e680 2024-09-13T21:49:12.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.950+0000 7fd67affd700 1 -- 172.21.15.88:0/3850051147 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd68819b220 con 0x7fd67406e680 2024-09-13T21:49:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd67406e680 msgr2=0x7fd674070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd67406e680 0x7fd674070b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd67c005950 tx=0x7fd67c0058e0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd688104130 msgr2=0x7fd688196360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd688104130 0x7fd688196360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd68400bd70 tx=0x7fd68400be50 comp rx=0 tx=0).stop 2024-09-13T21:49:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 shutdown_connections 2024-09-13T21:49:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd67406e680 0x7fd674070b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6880ffbd0 0x7fd688195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 --2- 172.21.15.88:0/3850051147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd688104130 0x7fd688196360 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:12.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 >> 172.21.15.88:0/3850051147 conn(0x7fd688075130 msgr2=0x7fd6880fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:12.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 shutdown_connections 2024-09-13T21:49:12.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:12.952+0000 7fd68fa6f700 1 -- 172.21.15.88:0/3850051147 wait complete. 2024-09-13T21:49:13.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.058+0000 7f2923020700 1 -- 172.21.15.88:0/123137211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c1004e0 msgr2=0x7f291c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.058+0000 7f2923020700 1 --2- 172.21.15.88:0/123137211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c1004e0 0x7f291c1008b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2910009910 tx=0x7f2910009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:13.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.058+0000 7f2923020700 1 -- 172.21.15.88:0/123137211 shutdown_connections 2024-09-13T21:49:13.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.058+0000 7f2923020700 1 --2- 172.21.15.88:0/123137211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f291c100e80 0x7f291c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.058+0000 7f2923020700 1 --2- 172.21.15.88:0/123137211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c1004e0 0x7f291c1008b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.058+0000 7f2923020700 1 -- 172.21.15.88:0/123137211 >> 172.21.15.88:0/123137211 conn(0x7f291c0fbda0 msgr2=0x7f291c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:13.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.058+0000 7f2923020700 1 -- 172.21.15.88:0/123137211 shutdown_connections 2024-09-13T21:49:13.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.058+0000 7f2923020700 1 -- 172.21.15.88:0/123137211 wait complete. 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f2923020700 1 Processor -- start 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f2923020700 1 -- start start 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f2923020700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f291c1004e0 0x7f291c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f2923020700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c100e80 0x7f291c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f2923020700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c073ad0 con 0x7f291c100e80 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f2923020700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c073c10 con 0x7f291c1004e0 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f291bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c100e80 0x7f291c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f291bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c100e80 0x7f291c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55872/0 (socket says 172.21.15.88:55872) 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f291bfff700 1 -- 172.21.15.88:0/411038885 learned_addr learned my addr 172.21.15.88:0/411038885 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f2920dbc700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f291c1004e0 0x7f291c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:13.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f291bfff700 1 -- 172.21.15.88:0/411038885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f291c1004e0 msgr2=0x7f291c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.059+0000 7f291bfff700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f291c1004e0 0x7f291c073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.060+0000 7f291bfff700 1 -- 172.21.15.88:0/411038885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100095f0 con 0x7f291c100e80 2024-09-13T21:49:13.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.060+0000 7f291bfff700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c100e80 0x7f291c073590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f290800d900 tx=0x7f290800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:13.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.060+0000 7f2919ffb700 1 -- 172.21.15.88:0/411038885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2908009900 con 0x7f291c100e80 2024-09-13T21:49:13.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.060+0000 7f2919ffb700 1 -- 172.21.15.88:0/411038885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2908010460 con 0x7f291c100e80 2024-09-13T21:49:13.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.060+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c1a20c0 con 0x7f291c100e80 2024-09-13T21:49:13.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.060+0000 7f2919ffb700 1 -- 172.21.15.88:0/411038885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f290800f5f0 con 0x7f291c100e80 2024-09-13T21:49:13.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.060+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c1a24d0 con 0x7f291c100e80 2024-09-13T21:49:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.061+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c1087f0 con 0x7f291c100e80 2024-09-13T21:49:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.061+0000 7f2919ffb700 1 -- 172.21.15.88:0/411038885 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f29080105d0 con 0x7f291c100e80 2024-09-13T21:49:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.062+0000 7f2919ffb700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f290c06e680 0x7f290c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.062+0000 7f2919ffb700 1 -- 172.21.15.88:0/411038885 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f290808e3b0 con 0x7f291c100e80 2024-09-13T21:49:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.062+0000 7f2920dbc700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f290c06e680 0x7f290c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:13.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.062+0000 7f2920dbc700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f290c06e680 0x7f290c070b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f291000b5c0 tx=0x7f291001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:13.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.067+0000 7f2919ffb700 1 -- 172.21.15.88:0/411038885 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f29080573e0 con 0x7f291c100e80 2024-09-13T21:49:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.311+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f291c061190 con 0x7f290c06e680 2024-09-13T21:49:13.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.321+0000 7f2919ffb700 1 -- 172.21.15.88:0/411038885 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f291c061190 con 0x7f290c06e680 2024-09-13T21:49:13.322 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:49:13.322 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (6m) 13s ago 16m 25.4M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (16m) 13s ago 16m 9000k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (15m) 30s ago 15m 8656k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (3m) 13s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (3m) 30s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (5m) 13s ago 16m 81.8M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (11m) 13s ago 11m 11.3M - 18.2.0 dc2bc1663786 a0d329e4d147 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (18s) 13s ago 11m 12.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 3442dd68906e 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (10m) 30s ago 10m 18.7M - 18.2.0 dc2bc1663786 f6bb7f1e0b52 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (11m) 30s ago 11m 122M - 18.2.0 dc2bc1663786 dc5975623d49 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (7m) 13s ago 17m 505M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:49:13.323 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (7m) 30s ago 15m 442M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (4m) 13s ago 18m 56.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (4m) 30s ago 15m 40.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (6m) 13s ago 16m 15.7M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (6m) 30s ago 15m 17.2M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (3m) 13s ago 14m 160M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (2m) 13s ago 14m 140M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 1899bd970e44 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (2m) 13s ago 13m 138M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 c38a8f2ec340 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (99s) 30s ago 13m 162M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7b16f89f6086 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (66s) 30s ago 12m 94.6M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 482f725f147b 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (33s) 30s ago 12m 11.7M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7bde2a23d60a 2024-09-13T21:49:13.324 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (6m) 13s ago 16m 82.8M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:49:13.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f290c06e680 msgr2=0x7f290c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f290c06e680 0x7f290c070b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f291000b5c0 tx=0x7f291001a040 comp rx=0 tx=0).stop 2024-09-13T21:49:13.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c100e80 msgr2=0x7f291c073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c100e80 0x7f291c073590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f290800d900 tx=0x7f290800dc10 comp rx=0 tx=0).stop 2024-09-13T21:49:13.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 shutdown_connections 2024-09-13T21:49:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f290c06e680 0x7f290c070b30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f291c1004e0 0x7f291c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 --2- 172.21.15.88:0/411038885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f291c100e80 0x7f291c073590 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 >> 172.21.15.88:0/411038885 conn(0x7f291c0fbda0 msgr2=0x7f291c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 shutdown_connections 2024-09-13T21:49:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.323+0000 7f2923020700 1 -- 172.21.15.88:0/411038885 wait complete. 2024-09-13T21:49:13.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.429+0000 7f43fd77b700 1 -- 172.21.15.88:0/146356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 msgr2=0x7f43f810a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.429+0000 7f43fd77b700 1 --2- 172.21.15.88:0/146356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 0x7f43f810a6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009910 tx=0x7f43e0009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.429+0000 7f43fd77b700 1 -- 172.21.15.88:0/146356 shutdown_connections 2024-09-13T21:49:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.429+0000 7f43fd77b700 1 --2- 172.21.15.88:0/146356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 0x7f43f810a6d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.429+0000 7f43fd77b700 1 --2- 172.21.15.88:0/146356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43f80ff350 0x7f43f80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.429+0000 7f43fd77b700 1 -- 172.21.15.88:0/146356 >> 172.21.15.88:0/146356 conn(0x7f43f80748b0 msgr2=0x7f43f8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.429+0000 7f43fd77b700 1 -- 172.21.15.88:0/146356 shutdown_connections 2024-09-13T21:49:13.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.429+0000 7f43fd77b700 1 -- 172.21.15.88:0/146356 wait complete. 2024-09-13T21:49:13.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43fd77b700 1 Processor -- start 2024-09-13T21:49:13.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43fd77b700 1 -- start start 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43fd77b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43f80ff350 0x7f43f8195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43fd77b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 0x7f43f81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43fd77b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8196a80 con 0x7f43f80ffc60 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43fd77b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f819a810 con 0x7f43f80ff350 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43f67fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 0x7f43f81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43f67fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 0x7f43f81963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55888/0 (socket says 172.21.15.88:55888) 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43f67fc700 1 -- 172.21.15.88:0/3327882381 learned_addr learned my addr 172.21.15.88:0/3327882381 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.430+0000 7f43f6ffd700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43f80ff350 0x7f43f8195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43f67fc700 1 -- 172.21.15.88:0/3327882381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43f80ff350 msgr2=0x7f43f8195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43f67fc700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43f80ff350 0x7f43f8195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43f67fc700 1 -- 172.21.15.88:0/3327882381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00095f0 con 0x7f43f80ffc60 2024-09-13T21:49:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43f6ffd700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43f80ff350 0x7f43f8195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:49:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43f67fc700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 0x7f43f81963a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43e0006010 tx=0x7f43e000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43effff700 1 -- 172.21.15.88:0/3327882381 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e001d070 con 0x7f43f80ffc60 2024-09-13T21:49:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43effff700 1 -- 172.21.15.88:0/3327882381 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43e000f460 con 0x7f43f80ffc60 2024-09-13T21:49:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f819aa90 con 0x7f43f80ffc60 2024-09-13T21:49:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43effff700 1 -- 172.21.15.88:0/3327882381 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e0017630 con 0x7f43f80ffc60 2024-09-13T21:49:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.431+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f819af80 con 0x7f43f80ffc60 2024-09-13T21:49:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.432+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f8107dd0 con 0x7f43f80ffc60 2024-09-13T21:49:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.433+0000 7f43effff700 1 -- 172.21.15.88:0/3327882381 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f43e000f5d0 con 0x7f43f80ffc60 2024-09-13T21:49:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.433+0000 7f43effff700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f43e406e680 0x7f43e4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.433+0000 7f43effff700 1 -- 172.21.15.88:0/3327882381 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f43e008fbd0 con 0x7f43f80ffc60 2024-09-13T21:49:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.433+0000 7f43f6ffd700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f43e406e680 0x7f43e4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.434+0000 7f43f6ffd700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f43e406e680 0x7f43e4070b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009dd0 tx=0x7f43f0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:13.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.437+0000 7f43effff700 1 -- 172.21.15.88:0/3327882381 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f43e0058ca0 con 0x7f43f80ffc60 2024-09-13T21:49:13.461 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:13 smithi088 ceph-mon[86843]: pgmap v187: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:13 smithi116 ceph-mon[65231]: pgmap v187: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:13.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.744+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f43f804f2a0 con 0x7f43f80ffc60 2024-09-13T21:49:13.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.745+0000 7f43effff700 1 -- 172.21.15.88:0/3327882381 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f43e005c360 con 0x7f43f80ffc60 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:49:13.747 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-13T21:49:13.748 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:49:13.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:49:13.748 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:49:13.748 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-13T21:49:13.748 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 11 2024-09-13T21:49:13.748 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:49:13.748 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:49:13.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.748+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f43e406e680 msgr2=0x7f43e4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.748+0000 7f43fd77b700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f43e406e680 0x7f43e4070b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009dd0 tx=0x7f43f0009040 comp rx=0 tx=0).stop 2024-09-13T21:49:13.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.748+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 msgr2=0x7f43f81963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.748+0000 7f43fd77b700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 0x7f43f81963a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43e0006010 tx=0x7f43e000be20 comp rx=0 tx=0).stop 2024-09-13T21:49:13.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.748+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 shutdown_connections 2024-09-13T21:49:13.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.748+0000 7f43fd77b700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f43e406e680 0x7f43e4070b30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.748+0000 7f43fd77b700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43f80ff350 0x7f43f8195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.748+0000 7f43fd77b700 1 --2- 172.21.15.88:0/3327882381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80ffc60 0x7f43f81963a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.748+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 >> 172.21.15.88:0/3327882381 conn(0x7f43f80748b0 msgr2=0x7f43f8104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:13.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.749+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 shutdown_connections 2024-09-13T21:49:13.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.749+0000 7f43fd77b700 1 -- 172.21.15.88:0/3327882381 wait complete. 2024-09-13T21:49:13.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.868+0000 7f1fb9e51700 1 -- 172.21.15.88:0/348183139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 msgr2=0x7f1fb40ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.868+0000 7f1fb9e51700 1 --2- 172.21.15.88:0/348183139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 0x7f1fb40ff790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009910 tx=0x7f1fa4009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:13.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.868+0000 7f1fb9e51700 1 -- 172.21.15.88:0/348183139 shutdown_connections 2024-09-13T21:49:13.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.868+0000 7f1fb9e51700 1 --2- 172.21.15.88:0/348183139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.868+0000 7f1fb9e51700 1 --2- 172.21.15.88:0/348183139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 0x7f1fb40ff790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.868+0000 7f1fb9e51700 1 -- 172.21.15.88:0/348183139 >> 172.21.15.88:0/348183139 conn(0x7f1fb40fac80 msgr2=0x7f1fb40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:13.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.869+0000 7f1fb9e51700 1 -- 172.21.15.88:0/348183139 shutdown_connections 2024-09-13T21:49:13.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.869+0000 7f1fb9e51700 1 -- 172.21.15.88:0/348183139 wait complete. 2024-09-13T21:49:13.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.869+0000 7f1fb9e51700 1 Processor -- start 2024-09-13T21:49:13.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.869+0000 7f1fb9e51700 1 -- start start 2024-09-13T21:49:13.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb9e51700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 0x7f1fb4194ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:13.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb9e51700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4195020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:13.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb9e51700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4195560 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb9e51700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41956d0 con 0x7f1fb40ffd60 2024-09-13T21:49:13.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 0x7f1fb4194ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:13.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 0x7f1fb4194ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55922/0 (socket says 172.21.15.88:55922) 2024-09-13T21:49:13.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb37fe700 1 -- 172.21.15.88:0/3040326605 learned_addr learned my addr 172.21.15.88:0/3040326605 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:13.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb2ffd700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4195020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:13.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb37fe700 1 -- 172.21.15.88:0/3040326605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40ffd60 msgr2=0x7f1fb4195020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:13.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb37fe700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4195020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:13.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb37fe700 1 -- 172.21.15.88:0/3040326605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa40095f0 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.870+0000 7f1fb37fe700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 0x7f1fb4194ae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400b5c0 tx=0x7f1fa400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:13.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.871+0000 7f1fb0ff9700 1 -- 172.21.15.88:0/3040326605 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa401d070 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.871+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb4195950 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.871+0000 7f1fb0ff9700 1 -- 172.21.15.88:0/3040326605 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fa4005e00 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.871+0000 7f1fb0ff9700 1 -- 172.21.15.88:0/3040326605 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa4017400 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.871+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb41a23d0 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.872+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb41076d0 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.872+0000 7f1fb0ff9700 1 -- 172.21.15.88:0/3040326605 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1fa4017670 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.873+0000 7f1fb0ff9700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1f9c06e680 0x7f1f9c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:13.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.873+0000 7f1fb0ff9700 1 -- 172.21.15.88:0/3040326605 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f1fa408f940 con 0x7f1fb40ff3c0 2024-09-13T21:49:13.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.873+0000 7f1fb2ffd700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1f9c06e680 0x7f1f9c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:13.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.873+0000 7f1fb2ffd700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1f9c06e680 0x7f1f9c070b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4069730 tx=0x7f1fa800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:13.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:13.877+0000 7f1fb0ff9700 1 -- 172.21.15.88:0/3040326605 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1fa405c5c0 con 0x7f1fb40ff3c0 2024-09-13T21:49:14.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.152+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1fb404f2a0 con 0x7f1fb40ff3c0 2024-09-13T21:49:14.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.152+0000 7f1fb0ff9700 1 -- 172.21.15.88:0/3040326605 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1731 (secure 0 0 0) 0x7f1fa405c150 con 0x7f1fb40ff3c0 2024-09-13T21:49:14.154 INFO:teuthology.orchestra.run.smithi088.stdout:e25 2024-09-13T21:49:14.154 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-13T21:49:08:006978+0000 2024-09-13T21:49:14.154 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:49:14.154 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 21 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:48:47.898810+0000 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:49:14.155 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 90 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:up {} 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:failed 0,1 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:49:14.156 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.116:6826/79599615,v1:172.21.15.116:6827/79599615] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:49:14.157 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.116:6824/1529923452,v1:172.21.15.116:6825/1529923452] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:14.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1f9c06e680 msgr2=0x7f1f9c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1f9c06e680 0x7f1f9c070b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4069730 tx=0x7f1fa800b410 comp rx=0 tx=0).stop 2024-09-13T21:49:14.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 msgr2=0x7f1fb4194ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 0x7f1fb4194ae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400b5c0 tx=0x7f1fa400bd70 comp rx=0 tx=0).stop 2024-09-13T21:49:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 shutdown_connections 2024-09-13T21:49:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f1f9c06e680 0x7f1f9c070b30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fb40ff3c0 0x7f1fb4194ae0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 --2- 172.21.15.88:0/3040326605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4195020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 >> 172.21.15.88:0/3040326605 conn(0x7f1fb40fac80 msgr2=0x7f1fb40fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 shutdown_connections 2024-09-13T21:49:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.156+0000 7f1fb9e51700 1 -- 172.21.15.88:0/3040326605 wait complete. 2024-09-13T21:49:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 25 2024-09-13T21:49:14.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.275+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/1709727830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 msgr2=0x7f5f081008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.275+0000 7f5f0c8ee700 1 --2- 172.21.15.88:0/1709727830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 0x7f5f081008b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009910 tx=0x7f5ef8009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:14.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.275+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/1709727830 shutdown_connections 2024-09-13T21:49:14.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.275+0000 7f5f0c8ee700 1 --2- 172.21.15.88:0/1709727830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f08100e80 0x7f5f08104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.275+0000 7f5f0c8ee700 1 --2- 172.21.15.88:0/1709727830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 0x7f5f081008b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.275+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/1709727830 >> 172.21.15.88:0/1709727830 conn(0x7f5f080fbda0 msgr2=0x7f5f080fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:14.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.275+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/1709727830 shutdown_connections 2024-09-13T21:49:14.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.275+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/1709727830 wait complete. 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5f0c8ee700 1 Processor -- start 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5f0c8ee700 1 -- start start 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5f0c8ee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 0x7f5f08195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5f0c8ee700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f08100e80 0x7f5f08196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5f0c8ee700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08196a80 con 0x7f5f081004e0 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5f0c8ee700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08196bc0 con 0x7f5f08100e80 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5f0659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 0x7f5f08195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5f0659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 0x7f5f08195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55926/0 (socket says 172.21.15.88:55926) 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5f0659c700 1 -- 172.21.15.88:0/589463843 learned_addr learned my addr 172.21.15.88:0/589463843 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.276+0000 7f5efffff700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f08100e80 0x7f5f08196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:14.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.277+0000 7f5f0659c700 1 -- 172.21.15.88:0/589463843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f08100e80 msgr2=0x7f5f08196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.277+0000 7f5f0659c700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f08100e80 0x7f5f08196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.277+0000 7f5f0659c700 1 -- 172.21.15.88:0/589463843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef80095f0 con 0x7f5f081004e0 2024-09-13T21:49:14.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.277+0000 7f5f0659c700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 0x7f5f08195ef0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8006010 tx=0x7f5ef800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:14.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.277+0000 7f5eff7fe700 1 -- 172.21.15.88:0/589463843 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef801d070 con 0x7f5f081004e0 2024-09-13T21:49:14.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.277+0000 7f5eff7fe700 1 -- 172.21.15.88:0/589463843 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ef800f460 con 0x7f5f081004e0 2024-09-13T21:49:14.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.277+0000 7f5eff7fe700 1 -- 172.21.15.88:0/589463843 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef8017630 con 0x7f5f081004e0 2024-09-13T21:49:14.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.277+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0819a9b0 con 0x7f5f081004e0 2024-09-13T21:49:14.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.277+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0819aea0 con 0x7f5f081004e0 2024-09-13T21:49:14.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.278+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f081087f0 con 0x7f5f081004e0 2024-09-13T21:49:14.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.279+0000 7f5eff7fe700 1 -- 172.21.15.88:0/589463843 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5ef800f5d0 con 0x7f5f081004e0 2024-09-13T21:49:14.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.279+0000 7f5eff7fe700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ef406e680 0x7f5ef4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:14.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.279+0000 7f5eff7fe700 1 -- 172.21.15.88:0/589463843 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f5ef808fb80 con 0x7f5f081004e0 2024-09-13T21:49:14.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.279+0000 7f5efffff700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ef406e680 0x7f5ef4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:14.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.280+0000 7f5efffff700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ef406e680 0x7f5ef4070b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f08197510 tx=0x7f5ef000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:14.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.284+0000 7f5eff7fe700 1 -- 172.21.15.88:0/589463843 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5ef8058cd0 con 0x7f5f081004e0 2024-09-13T21:49:14.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:14 smithi088 ceph-mon[86843]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:14.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:14 smithi088 ceph-mon[86843]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:14.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:14 smithi088 ceph-mon[86843]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:14.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:14 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3327882381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:14.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:14.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:14.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:14 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:14.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:14 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3040326605' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:49:14.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.514+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f0819b110 con 0x7f5ef406e680 2024-09-13T21:49:14.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.515+0000 7f5eff7fe700 1 -- 172.21.15.88:0/589463843 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5f0819b110 con 0x7f5ef406e680 2024-09-13T21:49:14.517 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:49:14.518 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:49:14.518 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:49:14.518 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:49:14.518 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:49:14.518 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:49:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-13T21:49:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: "osd", 2024-09-13T21:49:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-13T21:49:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:49:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "13/23 daemons upgraded", 2024-09-13T21:49:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T21:49:14.520 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:49:14.520 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:49:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ef406e680 msgr2=0x7f5ef4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ef406e680 0x7f5ef4070b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f08197510 tx=0x7f5ef000a380 comp rx=0 tx=0).stop 2024-09-13T21:49:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 msgr2=0x7f5f08195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 0x7f5f08195ef0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8006010 tx=0x7f5ef800bd70 comp rx=0 tx=0).stop 2024-09-13T21:49:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 shutdown_connections 2024-09-13T21:49:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ef406e680 0x7f5ef4070b30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f081004e0 0x7f5f08195ef0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 --2- 172.21.15.88:0/589463843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f08100e80 0x7f5f08196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 >> 172.21.15.88:0/589463843 conn(0x7f5f080fbda0 msgr2=0x7f5f080fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:14.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 shutdown_connections 2024-09-13T21:49:14.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.518+0000 7f5f0c8ee700 1 -- 172.21.15.88:0/589463843 wait complete. 2024-09-13T21:49:14.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:14 smithi116 ceph-mon[65231]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:14.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:14 smithi116 ceph-mon[65231]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:14.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:14 smithi116 ceph-mon[65231]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:14.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:14 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3327882381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:14.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:14.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:14.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:14 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:14.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:14 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3040326605' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:49:14.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.624+0000 7f821af83700 1 -- 172.21.15.88:0/797495759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 msgr2=0x7f8214100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.624+0000 7f821af83700 1 --2- 172.21.15.88:0/797495759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 0x7f8214100040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f820400b0a0 tx=0x7f820400b3b0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.624+0000 7f821af83700 1 -- 172.21.15.88:0/797495759 shutdown_connections 2024-09-13T21:49:14.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.624+0000 7f821af83700 1 --2- 172.21.15.88:0/797495759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 0x7f8214100040 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.624+0000 7f821af83700 1 --2- 172.21.15.88:0/797495759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8214104130 0x7f8214104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.624+0000 7f821af83700 1 -- 172.21.15.88:0/797495759 >> 172.21.15.88:0/797495759 conn(0x7f8214075130 msgr2=0x7f8214075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:14.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.624+0000 7f821af83700 1 -- 172.21.15.88:0/797495759 shutdown_connections 2024-09-13T21:49:14.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.624+0000 7f821af83700 1 -- 172.21.15.88:0/797495759 wait complete. 2024-09-13T21:49:14.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.625+0000 7f821af83700 1 Processor -- start 2024-09-13T21:49:14.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.625+0000 7f821af83700 1 -- start start 2024-09-13T21:49:14.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.625+0000 7f821af83700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 0x7f8214196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:14.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.625+0000 7f821af83700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8214104130 0x7f82141971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:14.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.625+0000 7f821af83700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82141977e0 con 0x7f82140ffbd0 2024-09-13T21:49:14.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.625+0000 7f821af83700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8214197920 con 0x7f8214104130 2024-09-13T21:49:14.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8218d1f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 0x7f8214196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:14.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8218d1f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 0x7f8214196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55950/0 (socket says 172.21.15.88:55950) 2024-09-13T21:49:14.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8218d1f700 1 -- 172.21.15.88:0/2470338400 learned_addr learned my addr 172.21.15.88:0/2470338400 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:14.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8213fff700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8214104130 0x7f82141971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:14.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8218d1f700 1 -- 172.21.15.88:0/2470338400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8214104130 msgr2=0x7f82141971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8218d1f700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8214104130 0x7f82141971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8218d1f700 1 -- 172.21.15.88:0/2470338400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204009d00 con 0x7f82140ffbd0 2024-09-13T21:49:14.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8218d1f700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 0x7f8214196c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c8a0 tx=0x7f820c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8211ffb700 1 -- 172.21.15.88:0/2470338400 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f820c0078e0 con 0x7f82140ffbd0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f8211ffb700 1 -- 172.21.15.88:0/2470338400 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f820c00f450 con 0x7f82140ffbd0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.626+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821419fcf0 con 0x7f82140ffbd0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.627+0000 7f8211ffb700 1 -- 172.21.15.88:0/2470338400 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f820c00e5e0 con 0x7f82140ffbd0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.627+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82141a01b0 con 0x7f82140ffbd0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.628+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821404f2a0 con 0x7f82140ffbd0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.628+0000 7f8211ffb700 1 -- 172.21.15.88:0/2470338400 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f820c00e740 con 0x7f82140ffbd0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.628+0000 7f8211ffb700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f820006e680 0x7f8200070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.628+0000 7f8211ffb700 1 -- 172.21.15.88:0/2470338400 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f820c08e700 con 0x7f82140ffbd0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.628+0000 7f8213fff700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f820006e680 0x7f8200070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.629+0000 7f8213fff700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f820006e680 0x7f8200070b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8204000f80 tx=0x7f8204006000 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:14.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.633+0000 7f8211ffb700 1 -- 172.21.15.88:0/2470338400 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f820c0577d0 con 0x7f82140ffbd0 2024-09-13T21:49:14.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.945+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8214068b30 con 0x7f82140ffbd0 2024-09-13T21:49:14.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.946+0000 7f8211ffb700 1 -- 172.21.15.88:0/2470338400 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f820c05ae90 con 0x7f82140ffbd0 2024-09-13T21:49:14.948 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-13T21:49:14.948 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-13T21:49:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs is degraded 2024-09-13T21:49:14.948 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:49:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:49:14.948 INFO:teuthology.orchestra.run.smithi088.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-13T21:49:14.948 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-13T21:49:14.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.948+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f820006e680 msgr2=0x7f8200070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.948+0000 7f821af83700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f820006e680 0x7f8200070b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8204000f80 tx=0x7f8204006000 comp rx=0 tx=0).stop 2024-09-13T21:49:14.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.948+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 msgr2=0x7f8214196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:14.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.948+0000 7f821af83700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 0x7f8214196c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c8a0 tx=0x7f820c00cbb0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.948+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 shutdown_connections 2024-09-13T21:49:14.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.948+0000 7f821af83700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f820006e680 0x7f8200070b30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.948+0000 7f821af83700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82140ffbd0 0x7f8214196c80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.948+0000 7f821af83700 1 --2- 172.21.15.88:0/2470338400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8214104130 0x7f82141971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:14.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.948+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 >> 172.21.15.88:0/2470338400 conn(0x7f8214075130 msgr2=0x7f82140fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:14.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.949+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 shutdown_connections 2024-09-13T21:49:14.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:14.949+0000 7f821af83700 1 -- 172.21.15.88:0/2470338400 wait complete. 2024-09-13T21:49:15.362 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:15 smithi116 ceph-mon[65231]: pgmap v188: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:15.362 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:15 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:boot 2024-09-13T21:49:15.362 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:15 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:49:15.362 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:15 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:49:15.362 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:15 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2470338400' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:49:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:15 smithi088 ceph-mon[86843]: pgmap v188: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:15 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:boot 2024-09-13T21:49:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:15 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:49:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:15 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:49:15.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:15 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2470338400' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:49:16.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:16 smithi088 ceph-mon[86843]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:16.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:16 smithi116 ceph-mon[65231]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:17.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:17 smithi088 ceph-mon[86843]: pgmap v189: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:17.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:17 smithi116 ceph-mon[65231]: pgmap v189: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:19.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:19 smithi088 ceph-mon[86843]: pgmap v190: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:19.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:19 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:19.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:19 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:19 smithi116 ceph-mon[65231]: pgmap v190: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:19 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:19 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:20.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:20 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:20.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:20 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:20.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:20 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:20.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:20 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:21.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:21 smithi088 ceph-mon[86843]: pgmap v191: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:21 smithi116 ceph-mon[65231]: pgmap v191: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:23.275 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: pgmap v192: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:23.275 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:23.275 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:23.275 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:23.275 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:23.275 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:23.275 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:23.275 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:23.276 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:23.276 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:23.276 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:23 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:23.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: pgmap v192: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:23.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:23 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:25.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:24 smithi088 ceph-mon[86843]: Upgrade: Updating mds.cephfs.smithi116.rwfayz 2024-09-13T21:49:25.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:24 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:25.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:24 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.rwfayz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:49:25.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:24 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:25.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:24 smithi088 ceph-mon[86843]: Deploying daemon mds.cephfs.smithi116.rwfayz on smithi116 2024-09-13T21:49:25.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:24 smithi088 ceph-mon[86843]: pgmap v193: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:25.249 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:24 smithi116 ceph-mon[65231]: Upgrade: Updating mds.cephfs.smithi116.rwfayz 2024-09-13T21:49:25.249 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:24 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:25.249 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:24 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.rwfayz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:49:25.249 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:24 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:25.249 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:24 smithi116 ceph-mon[65231]: Deploying daemon mds.cephfs.smithi116.rwfayz on smithi116 2024-09-13T21:49:25.249 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:24 smithi116 ceph-mon[65231]: pgmap v193: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:27.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:26 smithi088 ceph-mon[86843]: osdmap e95: 6 total, 6 up, 6 in 2024-09-13T21:49:27.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:26 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-13T21:49:27.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:26 smithi088 ceph-mon[86843]: pgmap v195: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:26 smithi116 ceph-mon[65231]: osdmap e95: 6 total, 6 up, 6 in 2024-09-13T21:49:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:26 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-13T21:49:27.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:26 smithi116 ceph-mon[65231]: pgmap v195: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:29.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:29 smithi088 ceph-mon[86843]: pgmap v196: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:29.565 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:29 smithi116 ceph-mon[65231]: pgmap v196: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:30.941 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:30.942 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:30.942 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:30.942 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:30 smithi116 ceph-mon[65231]: pgmap v197: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:30.942 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:30 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.116:6824/387213237,v1:172.21.15.116:6825/387213237] up:boot 2024-09-13T21:49:30.942 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:30 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:49:30.942 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:30 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:49:30.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:30.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:30.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:30.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:30 smithi088 ceph-mon[86843]: pgmap v197: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:30.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:30 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.116:6824/387213237,v1:172.21.15.116:6825/387213237] up:boot 2024-09-13T21:49:30.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:30 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:49:30.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:30 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:49:32.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:32.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:33.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:33 smithi088 ceph-mon[86843]: pgmap v198: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:33.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:33 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:33.544 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:33 smithi116 ceph-mon[65231]: pgmap v198: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:33.544 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:33.544 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:33.544 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:33.544 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:33 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:35.470 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:35 smithi116 ceph-mon[65231]: pgmap v199: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:35.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:35 smithi088 ceph-mon[86843]: pgmap v199: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:37.261 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: pgmap v200: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:37.262 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:37 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:37.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: pgmap v200: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:37.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:37 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:38.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:38 smithi116 ceph-mon[65231]: Upgrade: Updating mds.cephfs.smithi116.mjrkvg 2024-09-13T21:49:38.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:38.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.mjrkvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:49:38.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:38 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:38.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:38 smithi116 ceph-mon[65231]: Deploying daemon mds.cephfs.smithi116.mjrkvg on smithi116 2024-09-13T21:49:38.847 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:38 smithi116 ceph-mon[65231]: pgmap v201: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:38.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:38 smithi088 ceph-mon[86843]: Upgrade: Updating mds.cephfs.smithi116.mjrkvg 2024-09-13T21:49:38.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:38.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi116.mjrkvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:49:38.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:38 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:38.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:38 smithi088 ceph-mon[86843]: Deploying daemon mds.cephfs.smithi116.mjrkvg on smithi116 2024-09-13T21:49:38.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:38 smithi088 ceph-mon[86843]: pgmap v201: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:40.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:40 smithi088 ceph-mon[86843]: osdmap e96: 6 total, 6 up, 6 in 2024-09-13T21:49:40.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:40 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-13T21:49:40.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:40 smithi088 ceph-mon[86843]: pgmap v203: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:41.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:40 smithi116 ceph-mon[65231]: osdmap e96: 6 total, 6 up, 6 in 2024-09-13T21:49:41.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:40 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-13T21:49:41.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:40 smithi116 ceph-mon[65231]: pgmap v203: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:43.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:43 smithi088 ceph-mon[86843]: pgmap v204: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:43.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:43 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:49:43.574 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:43 smithi116 ceph-mon[65231]: pgmap v204: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:43.574 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:43 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:49:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.073+0000 7f3190472700 1 -- 172.21.15.88:0/2490288344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 msgr2=0x7f31881008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.073+0000 7f3190472700 1 --2- 172.21.15.88:0/2490288344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 0x7f31881008b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3184009910 tx=0x7f3184009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.073+0000 7f3190472700 1 -- 172.21.15.88:0/2490288344 shutdown_connections 2024-09-13T21:49:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.073+0000 7f3190472700 1 --2- 172.21.15.88:0/2490288344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3188100e80 0x7f3188104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.073+0000 7f3190472700 1 --2- 172.21.15.88:0/2490288344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 0x7f31881008b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.073+0000 7f3190472700 1 -- 172.21.15.88:0/2490288344 >> 172.21.15.88:0/2490288344 conn(0x7f31880fbda0 msgr2=0x7f31880fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.073+0000 7f3190472700 1 -- 172.21.15.88:0/2490288344 shutdown_connections 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.073+0000 7f3190472700 1 -- 172.21.15.88:0/2490288344 wait complete. 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f3190472700 1 Processor -- start 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f3190472700 1 -- start start 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f3190472700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 0x7f3188195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f3190472700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3188100e80 0x7f3188196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f3190472700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3188196b10 con 0x7f31881004e0 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f3190472700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318819a830 con 0x7f3188100e80 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f318e20e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 0x7f3188195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f318e20e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 0x7f3188195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52424/0 (socket says 172.21.15.88:52424) 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f318e20e700 1 -- 172.21.15.88:0/4231836689 learned_addr learned my addr 172.21.15.88:0/4231836689 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.074+0000 7f318da0d700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3188100e80 0x7f3188196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.075+0000 7f318e20e700 1 -- 172.21.15.88:0/4231836689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3188100e80 msgr2=0x7f3188196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.075+0000 7f318e20e700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3188100e80 0x7f3188196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.075+0000 7f318e20e700 1 -- 172.21.15.88:0/4231836689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840095f0 con 0x7f31881004e0 2024-09-13T21:49:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.075+0000 7f318e20e700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 0x7f3188195ef0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3184005f50 tx=0x7f318400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.075+0000 7f317f7fe700 1 -- 172.21.15.88:0/4231836689 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318401d070 con 0x7f31881004e0 2024-09-13T21:49:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.075+0000 7f317f7fe700 1 -- 172.21.15.88:0/4231836689 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f318400b610 con 0x7f31881004e0 2024-09-13T21:49:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.075+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318819aab0 con 0x7f31881004e0 2024-09-13T21:49:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.075+0000 7f317f7fe700 1 -- 172.21.15.88:0/4231836689 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3184022470 con 0x7f31881004e0 2024-09-13T21:49:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.075+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318819afa0 con 0x7f31881004e0 2024-09-13T21:49:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.076+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31881087f0 con 0x7f31881004e0 2024-09-13T21:49:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.077+0000 7f317f7fe700 1 -- 172.21.15.88:0/4231836689 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3184003780 con 0x7f31881004e0 2024-09-13T21:49:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.077+0000 7f317f7fe700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f317406e680 0x7f3174070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.077+0000 7f317f7fe700 1 -- 172.21.15.88:0/4231836689 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f318408fb10 con 0x7f31881004e0 2024-09-13T21:49:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.077+0000 7f318da0d700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f317406e680 0x7f3174070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.078+0000 7f318da0d700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f317406e680 0x7f3174070b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31881974a0 tx=0x7f3178009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.082+0000 7f317f7fe700 1 -- 172.21.15.88:0/4231836689 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3184058be0 con 0x7f31881004e0 2024-09-13T21:49:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.309+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f318819b280 con 0x7f317406e680 2024-09-13T21:49:45.311 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:45 smithi088 ceph-mon[86843]: pgmap v205: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:45.311 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:45 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:45.311 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:45 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:45.311 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:45 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:45.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.310+0000 7f317f7fe700 1 -- 172.21.15.88:0/4231836689 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f318819b280 con 0x7f317406e680 2024-09-13T21:49:45.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.312+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f317406e680 msgr2=0x7f3174070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.312+0000 7f3190472700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f317406e680 0x7f3174070b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31881974a0 tx=0x7f3178009260 comp rx=0 tx=0).stop 2024-09-13T21:49:45.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.312+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 msgr2=0x7f3188195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.312+0000 7f3190472700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 0x7f3188195ef0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3184005f50 tx=0x7f318400f690 comp rx=0 tx=0).stop 2024-09-13T21:49:45.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.312+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 shutdown_connections 2024-09-13T21:49:45.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.312+0000 7f3190472700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f317406e680 0x7f3174070b30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.312+0000 7f3190472700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31881004e0 0x7f3188195ef0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.312+0000 7f3190472700 1 --2- 172.21.15.88:0/4231836689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3188100e80 0x7f3188196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.312+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 >> 172.21.15.88:0/4231836689 conn(0x7f31880fbda0 msgr2=0x7f31880fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:45.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.313+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 shutdown_connections 2024-09-13T21:49:45.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.313+0000 7f3190472700 1 -- 172.21.15.88:0/4231836689 wait complete. 2024-09-13T21:49:45.324 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:49:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.417+0000 7fea63786700 1 -- 172.21.15.88:0/383906668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c0ffbd0 msgr2=0x7fea5c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.417+0000 7fea63786700 1 --2- 172.21.15.88:0/383906668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c0ffbd0 0x7fea5c100040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fea58009910 tx=0x7fea58009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.417+0000 7fea63786700 1 -- 172.21.15.88:0/383906668 shutdown_connections 2024-09-13T21:49:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.417+0000 7fea63786700 1 --2- 172.21.15.88:0/383906668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c0ffbd0 0x7fea5c100040 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.417+0000 7fea63786700 1 --2- 172.21.15.88:0/383906668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea5c104130 0x7fea5c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.417+0000 7fea63786700 1 -- 172.21.15.88:0/383906668 >> 172.21.15.88:0/383906668 conn(0x7fea5c075130 msgr2=0x7fea5c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:45.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.417+0000 7fea63786700 1 -- 172.21.15.88:0/383906668 shutdown_connections 2024-09-13T21:49:45.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.417+0000 7fea63786700 1 -- 172.21.15.88:0/383906668 wait complete. 2024-09-13T21:49:45.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea63786700 1 Processor -- start 2024-09-13T21:49:45.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea63786700 1 -- start start 2024-09-13T21:49:45.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea63786700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea5c0ffbd0 0x7fea5c100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:45.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea63786700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c104130 0x7fea5c101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:45.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea63786700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c1018b0 con 0x7fea5c104130 2024-09-13T21:49:45.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea63786700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c1019f0 con 0x7fea5c0ffbd0 2024-09-13T21:49:45.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea60d21700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c104130 0x7fea5c101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea60d21700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c104130 0x7fea5c101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52446/0 (socket says 172.21.15.88:52446) 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea60d21700 1 -- 172.21.15.88:0/2267208028 learned_addr learned my addr 172.21.15.88:0/2267208028 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea61522700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea5c0ffbd0 0x7fea5c100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea60d21700 1 -- 172.21.15.88:0/2267208028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea5c0ffbd0 msgr2=0x7fea5c100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea60d21700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea5c0ffbd0 0x7fea5c100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.418+0000 7fea60d21700 1 -- 172.21.15.88:0/2267208028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea580095f0 con 0x7fea5c104130 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.419+0000 7fea60d21700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c104130 0x7fea5c101370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fea5800b7d0 tx=0x7fea5800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.419+0000 7fea527fc700 1 -- 172.21.15.88:0/2267208028 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea5801d070 con 0x7fea5c104130 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.419+0000 7fea527fc700 1 -- 172.21.15.88:0/2267208028 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea580052a0 con 0x7fea5c104130 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.419+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c101c70 con 0x7fea5c104130 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.419+0000 7fea527fc700 1 -- 172.21.15.88:0/2267208028 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea58022470 con 0x7fea5c104130 2024-09-13T21:49:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.419+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c1a2350 con 0x7fea5c104130 2024-09-13T21:49:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.420+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c1086a0 con 0x7fea5c104130 2024-09-13T21:49:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.420+0000 7fea527fc700 1 -- 172.21.15.88:0/2267208028 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fea5800f850 con 0x7fea5c104130 2024-09-13T21:49:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.421+0000 7fea527fc700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fea4806e680 0x7fea48070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.421+0000 7fea527fc700 1 -- 172.21.15.88:0/2267208028 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fea5808fb50 con 0x7fea5c104130 2024-09-13T21:49:45.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.421+0000 7fea61522700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fea4806e680 0x7fea48070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:45.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.421+0000 7fea61522700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fea4806e680 0x7fea48070b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009c60 tx=0x7fea4c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:45.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.425+0000 7fea527fc700 1 -- 172.21.15.88:0/2267208028 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fea58058ca0 con 0x7fea5c104130 2024-09-13T21:49:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:45 smithi116 ceph-mon[65231]: pgmap v205: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:45 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:45 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:45 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:45.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.645+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea5c061190 con 0x7fea4806e680 2024-09-13T21:49:45.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.646+0000 7fea527fc700 1 -- 172.21.15.88:0/2267208028 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fea5c061190 con 0x7fea4806e680 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fea4806e680 msgr2=0x7fea48070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fea4806e680 0x7fea48070b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009c60 tx=0x7fea4c009260 comp rx=0 tx=0).stop 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c104130 msgr2=0x7fea5c101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c104130 0x7fea5c101370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fea5800b7d0 tx=0x7fea5800bf90 comp rx=0 tx=0).stop 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 shutdown_connections 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fea4806e680 0x7fea48070b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea5c0ffbd0 0x7fea5c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 --2- 172.21.15.88:0/2267208028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea5c104130 0x7fea5c101370 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 >> 172.21.15.88:0/2267208028 conn(0x7fea5c075130 msgr2=0x7fea5c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 shutdown_connections 2024-09-13T21:49:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.648+0000 7fea63786700 1 -- 172.21.15.88:0/2267208028 wait complete. 2024-09-13T21:49:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.755+0000 7fd4cf313700 1 -- 172.21.15.88:0/1049310981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c8104130 msgr2=0x7fd4c8104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.755+0000 7fd4cf313700 1 --2- 172.21.15.88:0/1049310981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c8104130 0x7fd4c8104500 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009910 tx=0x7fd4b8009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.755+0000 7fd4cf313700 1 -- 172.21.15.88:0/1049310981 shutdown_connections 2024-09-13T21:49:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.755+0000 7fd4cf313700 1 --2- 172.21.15.88:0/1049310981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4c80ffbd0 0x7fd4c8100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.755+0000 7fd4cf313700 1 --2- 172.21.15.88:0/1049310981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c8104130 0x7fd4c8104500 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.755+0000 7fd4cf313700 1 -- 172.21.15.88:0/1049310981 >> 172.21.15.88:0/1049310981 conn(0x7fd4c8075130 msgr2=0x7fd4c8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.755+0000 7fd4cf313700 1 -- 172.21.15.88:0/1049310981 shutdown_connections 2024-09-13T21:49:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.755+0000 7fd4cf313700 1 -- 172.21.15.88:0/1049310981 wait complete. 2024-09-13T21:49:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cf313700 1 Processor -- start 2024-09-13T21:49:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cf313700 1 -- start start 2024-09-13T21:49:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cf313700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80ffbd0 0x7fd4c8195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cf313700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4c8104130 0x7fd4c8196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cf313700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8196a50 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cf313700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c819a7e0 con 0x7fd4c8104130 2024-09-13T21:49:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cd0af700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80ffbd0 0x7fd4c8195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cd0af700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80ffbd0 0x7fd4c8195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52474/0 (socket says 172.21.15.88:52474) 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cd0af700 1 -- 172.21.15.88:0/2845927302 learned_addr learned my addr 172.21.15.88:0/2845927302 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cc8ae700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4c8104130 0x7fd4c8196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cd0af700 1 -- 172.21.15.88:0/2845927302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4c8104130 msgr2=0x7fd4c8196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cd0af700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4c8104130 0x7fd4c8196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.756+0000 7fd4cd0af700 1 -- 172.21.15.88:0/2845927302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b80095f0 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.757+0000 7fd4cd0af700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80ffbd0 0x7fd4c8195e30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800bd70 tx=0x7fd4b800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.757+0000 7fd4be7fc700 1 -- 172.21.15.88:0/2845927302 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b801d070 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.757+0000 7fd4be7fc700 1 -- 172.21.15.88:0/2845927302 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4b8005dc0 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.757+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c819aa60 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.757+0000 7fd4be7fc700 1 -- 172.21.15.88:0/2845927302 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b8017400 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.757+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c819af50 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.758+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c804f2a0 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.758+0000 7fd4be7fc700 1 -- 172.21.15.88:0/2845927302 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd4b800f460 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.759+0000 7fd4be7fc700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd4b406e680 0x7fd4b4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:45.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.759+0000 7fd4be7fc700 1 -- 172.21.15.88:0/2845927302 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd4b808fac0 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.759+0000 7fd4cc8ae700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd4b406e680 0x7fd4b4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:45.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.759+0000 7fd4cc8ae700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd4b406e680 0x7fd4b4070b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8197450 tx=0x7fd4c40073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:45.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.763+0000 7fd4be7fc700 1 -- 172.21.15.88:0/2845927302 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd4b8058cd0 con 0x7fd4c80ffbd0 2024-09-13T21:49:45.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.974+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4c819b330 con 0x7fd4b406e680 2024-09-13T21:49:45.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.983+0000 7fd4be7fc700 1 -- 172.21.15.88:0/2845927302 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fd4c819b330 con 0x7fd4b406e680 2024-09-13T21:49:45.985 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:49:45.985 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (6m) 27s ago 17m 25.4M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:49:45.985 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (17m) 27s ago 17m 9026k - 18.2.0 dc2bc1663786 7f94a5a3cc71 2024-09-13T21:49:45.985 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (16m) 13s ago 16m 8744k - 18.2.0 dc2bc1663786 f6e4b591b885 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (4m) 27s ago 17m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (4m) 13s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (6m) 27s ago 16m 81.9M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (32s) 27s ago 11m 13.2M - 19.1.1-324-gecab7be5 0652ff2b5d78 d3dc51440d57 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (51s) 27s ago 11m 13.2M - 19.1.1-324-gecab7be5 0652ff2b5d78 3442dd68906e 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 starting - - - - 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (16s) 13s ago 11m 12.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 4e008a15cad8 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (8m) 27s ago 18m 505M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (7m) 13s ago 16m 443M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (5m) 27s ago 18m 58.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:49:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (4m) 13s ago 16m 42.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:49:45.987 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (7m) 27s ago 17m 15.4M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:49:45.987 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (7m) 13s ago 16m 17.3M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:49:45.987 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (3m) 27s ago 15m 160M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:49:45.987 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (3m) 27s ago 14m 140M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 1899bd970e44 2024-09-13T21:49:45.987 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (2m) 27s ago 14m 138M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 c38a8f2ec340 2024-09-13T21:49:45.987 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (2m) 13s ago 13m 164M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7b16f89f6086 2024-09-13T21:49:45.987 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (99s) 13s ago 13m 96.0M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 482f725f147b 2024-09-13T21:49:45.987 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (66s) 13s ago 13m 95.1M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7bde2a23d60a 2024-09-13T21:49:45.987 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (7m) 27s ago 16m 82.9M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:49:45.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.985+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd4b406e680 msgr2=0x7fd4b4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.985+0000 7fd4cf313700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd4b406e680 0x7fd4b4070b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8197450 tx=0x7fd4c40073d0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.985+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80ffbd0 msgr2=0x7fd4c8195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:45.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.985+0000 7fd4cf313700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80ffbd0 0x7fd4c8195e30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800bd70 tx=0x7fd4b800bda0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.986+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 shutdown_connections 2024-09-13T21:49:45.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.986+0000 7fd4cf313700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd4b406e680 0x7fd4b4070b30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.986+0000 7fd4cf313700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c80ffbd0 0x7fd4c8195e30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.986+0000 7fd4cf313700 1 --2- 172.21.15.88:0/2845927302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4c8104130 0x7fd4c8196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:45.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.986+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 >> 172.21.15.88:0/2845927302 conn(0x7fd4c8075130 msgr2=0x7fd4c80685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:45.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.986+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 shutdown_connections 2024-09-13T21:49:45.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:45.986+0000 7fd4cf313700 1 -- 172.21.15.88:0/2845927302 wait complete. 2024-09-13T21:49:46.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.088+0000 7fb6671e2700 1 -- 172.21.15.88:0/2417540185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 msgr2=0x7fb6601008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.088+0000 7fb6671e2700 1 --2- 172.21.15.88:0/2417540185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 0x7fb6601008b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb65800b0a0 tx=0x7fb65800b3b0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.088+0000 7fb6671e2700 1 -- 172.21.15.88:0/2417540185 shutdown_connections 2024-09-13T21:49:46.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.088+0000 7fb6671e2700 1 --2- 172.21.15.88:0/2417540185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb660100e80 0x7fb660104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.088+0000 7fb6671e2700 1 --2- 172.21.15.88:0/2417540185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 0x7fb6601008b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.088+0000 7fb6671e2700 1 -- 172.21.15.88:0/2417540185 >> 172.21.15.88:0/2417540185 conn(0x7fb6600fbda0 msgr2=0x7fb6600fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:46.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.088+0000 7fb6671e2700 1 -- 172.21.15.88:0/2417540185 shutdown_connections 2024-09-13T21:49:46.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.088+0000 7fb6671e2700 1 -- 172.21.15.88:0/2417540185 wait complete. 2024-09-13T21:49:46.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.089+0000 7fb6671e2700 1 Processor -- start 2024-09-13T21:49:46.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.089+0000 7fb6671e2700 1 -- start start 2024-09-13T21:49:46.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.089+0000 7fb6671e2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 0x7fb660195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:46.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.089+0000 7fb6671e2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb660100e80 0x7fb660196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:46.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.089+0000 7fb6671e2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb660196b10 con 0x7fb6601004e0 2024-09-13T21:49:46.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.089+0000 7fb6671e2700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66019a8a0 con 0x7fb660100e80 2024-09-13T21:49:46.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb664f7e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 0x7fb660195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:46.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb664f7e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 0x7fb660195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52490/0 (socket says 172.21.15.88:52490) 2024-09-13T21:49:46.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb664f7e700 1 -- 172.21.15.88:0/1922329846 learned_addr learned my addr 172.21.15.88:0/1922329846 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:46.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb65ffff700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb660100e80 0x7fb660196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:46.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb664f7e700 1 -- 172.21.15.88:0/1922329846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb660100e80 msgr2=0x7fb660196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb664f7e700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb660100e80 0x7fb660196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb664f7e700 1 -- 172.21.15.88:0/1922329846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb658009d00 con 0x7fb6601004e0 2024-09-13T21:49:46.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb65ffff700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb660100e80 0x7fb660196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:49:46.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb664f7e700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 0x7fb660195ef0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb658000f80 tx=0x7fb65800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:46.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb65dffb700 1 -- 172.21.15.88:0/1922329846 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb65800e040 con 0x7fb6601004e0 2024-09-13T21:49:46.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb65dffb700 1 -- 172.21.15.88:0/1922329846 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb658003de0 con 0x7fb6601004e0 2024-09-13T21:49:46.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66019ab20 con 0x7fb6601004e0 2024-09-13T21:49:46.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb65dffb700 1 -- 172.21.15.88:0/1922329846 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb65801d790 con 0x7fb6601004e0 2024-09-13T21:49:46.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.090+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66019b010 con 0x7fb6601004e0 2024-09-13T21:49:46.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.091+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6601087f0 con 0x7fb6601004e0 2024-09-13T21:49:46.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.092+0000 7fb65dffb700 1 -- 172.21.15.88:0/1922329846 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb658004040 con 0x7fb6601004e0 2024-09-13T21:49:46.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.092+0000 7fb65dffb700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb64006e680 0x7fb640070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:46.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.092+0000 7fb65dffb700 1 -- 172.21.15.88:0/1922329846 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb65808ff70 con 0x7fb6601004e0 2024-09-13T21:49:46.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.092+0000 7fb65ffff700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb64006e680 0x7fb640070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:46.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.093+0000 7fb65ffff700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb64006e680 0x7fb640070b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb648005950 tx=0x7fb6480058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:46.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.097+0000 7fb65dffb700 1 -- 172.21.15.88:0/1922329846 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb6580c51b0 con 0x7fb6601004e0 2024-09-13T21:49:46.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.386+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb6601081d0 con 0x7fb6601004e0 2024-09-13T21:49:46.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.387+0000 7fb65dffb700 1 -- 172.21.15.88:0/1922329846 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb658059040 con 0x7fb6601004e0 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:49:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:49:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:49:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:49:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T21:49:46.390 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:49:46.390 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:49:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb64006e680 msgr2=0x7fb640070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb64006e680 0x7fb640070b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb648005950 tx=0x7fb6480058e0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 msgr2=0x7fb660195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 0x7fb660195ef0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb658000f80 tx=0x7fb65800cdd0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 shutdown_connections 2024-09-13T21:49:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb64006e680 0x7fb640070b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6601004e0 0x7fb660195ef0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 --2- 172.21.15.88:0/1922329846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb660100e80 0x7fb660196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 >> 172.21.15.88:0/1922329846 conn(0x7fb6600fbda0 msgr2=0x7fb6600fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 shutdown_connections 2024-09-13T21:49:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.389+0000 7fb6671e2700 1 -- 172.21.15.88:0/1922329846 wait complete. 2024-09-13T21:49:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.494+0000 7faaffca8700 1 -- 172.21.15.88:0/1856232692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100d70 msgr2=0x7faaf81094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.494+0000 7faaffca8700 1 --2- 172.21.15.88:0/1856232692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100d70 0x7faaf81094d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009940 tx=0x7faaf4009c50 comp rx=0 tx=0).stop 2024-09-13T21:49:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.494+0000 7faaffca8700 1 -- 172.21.15.88:0/1856232692 shutdown_connections 2024-09-13T21:49:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.494+0000 7faaffca8700 1 --2- 172.21.15.88:0/1856232692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100d70 0x7faaf81094d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.494+0000 7faaffca8700 1 --2- 172.21.15.88:0/1856232692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8100460 0x7faaf8100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.494+0000 7faaffca8700 1 -- 172.21.15.88:0/1856232692 >> 172.21.15.88:0/1856232692 conn(0x7faaf80748b0 msgr2=0x7faaf8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.494+0000 7faaffca8700 1 -- 172.21.15.88:0/1856232692 shutdown_connections 2024-09-13T21:49:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.494+0000 7faaffca8700 1 -- 172.21.15.88:0/1856232692 wait complete. 2024-09-13T21:49:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faaffca8700 1 Processor -- start 2024-09-13T21:49:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faaffca8700 1 -- start start 2024-09-13T21:49:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faaffca8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100460 0x7faaf8196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faaffca8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8100d70 0x7faaf81970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faaffca8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf81976d0 con 0x7faaf8100460 2024-09-13T21:49:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faaffca8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf8197840 con 0x7faaf8100d70 2024-09-13T21:49:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faafda44700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100460 0x7faaf8196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faafda44700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100460 0x7faaf8196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52516/0 (socket says 172.21.15.88:52516) 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faafda44700 1 -- 172.21.15.88:0/1185429353 learned_addr learned my addr 172.21.15.88:0/1185429353 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.495+0000 7faafd243700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8100d70 0x7faaf81970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.496+0000 7faafda44700 1 -- 172.21.15.88:0/1185429353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8100d70 msgr2=0x7faaf81970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.496+0000 7faafda44700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8100d70 0x7faaf81970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.496+0000 7faafda44700 1 -- 172.21.15.88:0/1185429353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40095f0 con 0x7faaf8100460 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.496+0000 7faafda44700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100460 0x7faaf8196b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faae800e920 tx=0x7faae800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.496+0000 7faaeeffd700 1 -- 172.21.15.88:0/1185429353 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae800c9d0 con 0x7faaf8100460 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.496+0000 7faaeeffd700 1 -- 172.21.15.88:0/1185429353 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faae8010430 con 0x7faaf8100460 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.496+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf819fbe0 con 0x7faaf8100460 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.496+0000 7faaeeffd700 1 -- 172.21.15.88:0/1185429353 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae8018630 con 0x7faaf8100460 2024-09-13T21:49:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.496+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf81a00d0 con 0x7faaf8100460 2024-09-13T21:49:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.497+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf8106bd0 con 0x7faaf8100460 2024-09-13T21:49:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.498+0000 7faaeeffd700 1 -- 172.21.15.88:0/1185429353 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7faae80105a0 con 0x7faaf8100460 2024-09-13T21:49:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.498+0000 7faaeeffd700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faae406e680 0x7faae4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.498+0000 7faaeeffd700 1 -- 172.21.15.88:0/1185429353 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7faae8014070 con 0x7faaf8100460 2024-09-13T21:49:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.498+0000 7faafd243700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faae406e680 0x7faae4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.499+0000 7faafd243700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faae406e680 0x7faae4070b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faaf80ffc20 tx=0x7faaf400b5e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.502+0000 7faaeeffd700 1 -- 172.21.15.88:0/1185429353 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faae80541b0 con 0x7faaf8100460 2024-09-13T21:49:46.526 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:46 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.116:6826/102910693,v1:172.21.15.116:6827/102910693] up:boot 2024-09-13T21:49:46.526 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:46 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:49:46.526 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:46 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:49:46.526 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:46 smithi116 ceph-mon[65231]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:46.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:46 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.116:6826/102910693,v1:172.21.15.116:6827/102910693] up:boot 2024-09-13T21:49:46.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:46 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:49:46.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:46 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:49:46.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:46 smithi088 ceph-mon[86843]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:46.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.748+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faaf81065b0 con 0x7faaf8100460 2024-09-13T21:49:46.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.748+0000 7faaeeffd700 1 -- 172.21.15.88:0/1185429353 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1910 (secure 0 0 0) 0x7faae8057b40 con 0x7faaf8100460 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout:e30 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-13T21:49:45:263480+0000 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 21 2024-09-13T21:49:46.750 INFO:teuthology.orchestra.run.smithi088.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:48:47.898810+0000 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 90 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:49:46.751 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:up {} 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:failed 0,1 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:49:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:49:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:49:46.753 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:49:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:49:46.753 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:49:46.753 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{-1:34402} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:49:46.753 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{-1:44323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.116:6824/387213237,v1:172.21.15.116:6825/387213237] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:49:46.753 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.116:6826/102910693,v1:172.21.15.116:6827/102910693] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:49:46.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faae406e680 msgr2=0x7faae4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faae406e680 0x7faae4070b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faaf80ffc20 tx=0x7faaf400b5e0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100460 msgr2=0x7faaf8196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100460 0x7faaf8196b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faae800e920 tx=0x7faae800ec30 comp rx=0 tx=0).stop 2024-09-13T21:49:46.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 shutdown_connections 2024-09-13T21:49:46.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7faae406e680 0x7faae4070b30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf8100460 0x7faaf8196b70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 --2- 172.21.15.88:0/1185429353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8100d70 0x7faaf81970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 >> 172.21.15.88:0/1185429353 conn(0x7faaf80748b0 msgr2=0x7faaf8103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:46.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 shutdown_connections 2024-09-13T21:49:46.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.750+0000 7faaffca8700 1 -- 172.21.15.88:0/1185429353 wait complete. 2024-09-13T21:49:46.755 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 30 2024-09-13T21:49:46.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.856+0000 7fcc3212d700 1 -- 172.21.15.88:0/3724521594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ff3c0 msgr2=0x7fcc2c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.856+0000 7fcc3212d700 1 --2- 172.21.15.88:0/3724521594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ff3c0 0x7fcc2c0ff790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00b0a0 tx=0x7fcc1c00b3b0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.856+0000 7fcc3212d700 1 -- 172.21.15.88:0/3724521594 shutdown_connections 2024-09-13T21:49:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.856+0000 7fcc3212d700 1 --2- 172.21.15.88:0/3724521594 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc2c0ffd60 0x7fcc2c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.856+0000 7fcc3212d700 1 --2- 172.21.15.88:0/3724521594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ff3c0 0x7fcc2c0ff790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.856+0000 7fcc3212d700 1 -- 172.21.15.88:0/3724521594 >> 172.21.15.88:0/3724521594 conn(0x7fcc2c0fac80 msgr2=0x7fcc2c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.856+0000 7fcc3212d700 1 -- 172.21.15.88:0/3724521594 shutdown_connections 2024-09-13T21:49:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.856+0000 7fcc3212d700 1 -- 172.21.15.88:0/3724521594 wait complete. 2024-09-13T21:49:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.856+0000 7fcc3212d700 1 Processor -- start 2024-09-13T21:49:46.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc3212d700 1 -- start start 2024-09-13T21:49:46.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc3212d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc2c0ff3c0 0x7fcc2c194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:46.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc3212d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ffd60 0x7fcc2c1952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:46.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc3212d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c1959a0 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc3212d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c199730 con 0x7fcc2c0ff3c0 2024-09-13T21:49:46.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc2affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ffd60 0x7fcc2c1952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:46.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc2affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ffd60 0x7fcc2c1952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52538/0 (socket says 172.21.15.88:52538) 2024-09-13T21:49:46.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc2affd700 1 -- 172.21.15.88:0/2221158328 learned_addr learned my addr 172.21.15.88:0/2221158328 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:46.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc2b7fe700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc2c0ff3c0 0x7fcc2c194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc2affd700 1 -- 172.21.15.88:0/2221158328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc2c0ff3c0 msgr2=0x7fcc2c194d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc2affd700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc2c0ff3c0 0x7fcc2c194d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc2affd700 1 -- 172.21.15.88:0/2221158328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c009d00 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc2affd700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ffd60 0x7fcc2c1952c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400e8f0 tx=0x7fcc1400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc28ff9700 1 -- 172.21.15.88:0/2221158328 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc14009790 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.857+0000 7fcc28ff9700 1 -- 172.21.15.88:0/2221158328 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc1400c810 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.858+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c199a10 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.858+0000 7fcc28ff9700 1 -- 172.21.15.88:0/2221158328 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc14005580 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.858+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c199f60 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.858+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c1076d0 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.859+0000 7fcc28ff9700 1 -- 172.21.15.88:0/2221158328 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcc1400c980 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.859+0000 7fcc28ff9700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fcc1806e680 0x7fcc18070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:46.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.860+0000 7fcc28ff9700 1 -- 172.21.15.88:0/2221158328 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fcc14014070 con 0x7fcc2c0ffd60 2024-09-13T21:49:46.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.860+0000 7fcc2b7fe700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fcc1806e680 0x7fcc18070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:46.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.860+0000 7fcc2b7fe700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fcc1806e680 0x7fcc18070b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c000f80 tx=0x7fcc1c0060c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:46.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:46.864+0000 7fcc28ff9700 1 -- 172.21.15.88:0/2221158328 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcc14057ab0 con 0x7fcc2c0ffd60 2024-09-13T21:49:47.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.083+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc2c19a1e0 con 0x7fcc1806e680 2024-09-13T21:49:47.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.085+0000 7fcc28ff9700 1 -- 172.21.15.88:0/2221158328 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcc2c19a1e0 con 0x7fcc1806e680 2024-09-13T21:49:47.086 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:49:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "mon", 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr", 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "osd", 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "crash" 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "15/23 daemons upgraded", 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:49:47.087 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:49:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fcc1806e680 msgr2=0x7fcc18070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fcc1806e680 0x7fcc18070b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c000f80 tx=0x7fcc1c0060c0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ffd60 msgr2=0x7fcc2c1952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ffd60 0x7fcc2c1952c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400e8f0 tx=0x7fcc1400ec00 comp rx=0 tx=0).stop 2024-09-13T21:49:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 shutdown_connections 2024-09-13T21:49:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fcc1806e680 0x7fcc18070b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc2c0ff3c0 0x7fcc2c194d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 --2- 172.21.15.88:0/2221158328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc2c0ffd60 0x7fcc2c1952c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 >> 172.21.15.88:0/2221158328 conn(0x7fcc2c0fac80 msgr2=0x7fcc2c0fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:47.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 shutdown_connections 2024-09-13T21:49:47.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.087+0000 7fcc3212d700 1 -- 172.21.15.88:0/2221158328 wait complete. 2024-09-13T21:49:47.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.193+0000 7f8a46b40700 1 -- 172.21.15.88:0/2304169826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 msgr2=0x7f8a401008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.193+0000 7f8a46b40700 1 --2- 172.21.15.88:0/2304169826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 0x7f8a401008b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009910 tx=0x7f8a38009c20 comp rx=0 tx=0).stop 2024-09-13T21:49:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.193+0000 7f8a46b40700 1 -- 172.21.15.88:0/2304169826 shutdown_connections 2024-09-13T21:49:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.193+0000 7f8a46b40700 1 --2- 172.21.15.88:0/2304169826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a40100e80 0x7f8a40104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.193+0000 7f8a46b40700 1 --2- 172.21.15.88:0/2304169826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 0x7f8a401008b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.193+0000 7f8a46b40700 1 -- 172.21.15.88:0/2304169826 >> 172.21.15.88:0/2304169826 conn(0x7f8a400fbda0 msgr2=0x7f8a400fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.193+0000 7f8a46b40700 1 -- 172.21.15.88:0/2304169826 shutdown_connections 2024-09-13T21:49:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.193+0000 7f8a46b40700 1 -- 172.21.15.88:0/2304169826 wait complete. 2024-09-13T21:49:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a46b40700 1 Processor -- start 2024-09-13T21:49:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a46b40700 1 -- start start 2024-09-13T21:49:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a46b40700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 0x7f8a40073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a46b40700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a40100e80 0x7f8a40073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a46b40700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40073ad0 con 0x7f8a401004e0 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a46b40700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40073c10 con 0x7f8a40100e80 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a448dc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 0x7f8a40073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a448dc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 0x7f8a40073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52554/0 (socket says 172.21.15.88:52554) 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a448dc700 1 -- 172.21.15.88:0/2696365447 learned_addr learned my addr 172.21.15.88:0/2696365447 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a3ffff700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a40100e80 0x7f8a40073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a448dc700 1 -- 172.21.15.88:0/2696365447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a40100e80 msgr2=0x7f8a40073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a448dc700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a40100e80 0x7f8a40073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a448dc700 1 -- 172.21.15.88:0/2696365447 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380095f0 con 0x7f8a401004e0 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.194+0000 7f8a448dc700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 0x7f8a40073050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8a380092e0 tx=0x7f8a3800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.195+0000 7f8a3dffb700 1 -- 172.21.15.88:0/2696365447 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3801d070 con 0x7f8a401004e0 2024-09-13T21:49:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.195+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a40073e90 con 0x7f8a401004e0 2024-09-13T21:49:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.195+0000 7f8a3dffb700 1 -- 172.21.15.88:0/2696365447 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a38005e00 con 0x7f8a401004e0 2024-09-13T21:49:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.195+0000 7f8a3dffb700 1 -- 172.21.15.88:0/2696365447 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a38017400 con 0x7f8a401004e0 2024-09-13T21:49:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.195+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a401a23f0 con 0x7f8a401004e0 2024-09-13T21:49:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.196+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a401087f0 con 0x7f8a401004e0 2024-09-13T21:49:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.196+0000 7f8a3dffb700 1 -- 172.21.15.88:0/2696365447 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8a3800f6f0 con 0x7f8a401004e0 2024-09-13T21:49:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.197+0000 7f8a3dffb700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f8a2c06e680 0x7f8a2c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.197+0000 7f8a3ffff700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f8a2c06e680 0x7f8a2c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.197+0000 7f8a3dffb700 1 -- 172.21.15.88:0/2696365447 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f8a3808fbd0 con 0x7f8a401004e0 2024-09-13T21:49:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.197+0000 7f8a3ffff700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f8a2c06e680 0x7f8a2c070b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009550 tx=0x7f8a300091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:47.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.201+0000 7f8a3dffb700 1 -- 172.21.15.88:0/2696365447 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8a38058ca0 con 0x7f8a401004e0 2024-09-13T21:49:47.481 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:47 smithi116 ceph-mon[65231]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:47.481 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:47 smithi116 ceph-mon[65231]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:47.481 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:47 smithi116 ceph-mon[65231]: pgmap v206: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:47.481 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:47 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1922329846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:47.481 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:47 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1185429353' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:49:47.481 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:47.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:47 smithi088 ceph-mon[86843]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:47.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:47 smithi088 ceph-mon[86843]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:47.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:47 smithi088 ceph-mon[86843]: pgmap v206: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:47.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:47 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1922329846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:47 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1185429353' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:49:47.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:47.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.493+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8a400745b0 con 0x7f8a401004e0 2024-09-13T21:49:47.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.493+0000 7f8a3dffb700 1 -- 172.21.15.88:0/2696365447 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f8a3805c360 con 0x7f8a401004e0 2024-09-13T21:49:47.494 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-13T21:49:47.495 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-13T21:49:47.495 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs is degraded 2024-09-13T21:49:47.495 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:49:47.495 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:49:47.495 INFO:teuthology.orchestra.run.smithi088.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-13T21:49:47.495 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-13T21:49:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f8a2c06e680 msgr2=0x7f8a2c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f8a2c06e680 0x7f8a2c070b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009550 tx=0x7f8a300091b0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 msgr2=0x7f8a40073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 0x7f8a40073050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8a380092e0 tx=0x7f8a3800bd70 comp rx=0 tx=0).stop 2024-09-13T21:49:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 shutdown_connections 2024-09-13T21:49:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f8a2c06e680 0x7f8a2c070b30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a401004e0 0x7f8a40073050 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 --2- 172.21.15.88:0/2696365447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a40100e80 0x7f8a40073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 >> 172.21.15.88:0/2696365447 conn(0x7f8a400fbda0 msgr2=0x7f8a400fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:47.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 shutdown_connections 2024-09-13T21:49:47.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:49:47.495+0000 7f8a46b40700 1 -- 172.21.15.88:0/2696365447 wait complete. 2024-09-13T21:49:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:48 smithi116 ceph-mon[65231]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:48 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2696365447' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:49:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:48.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:48 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:48.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:48 smithi088 ceph-mon[86843]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:48.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:48 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2696365447' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:49:48.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:48.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:48 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:49 smithi116 ceph-mon[65231]: pgmap v207: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:49 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:49.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:49 smithi088 ceph-mon[86843]: pgmap v207: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:49.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:49.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:49 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:51 smithi116 ceph-mon[65231]: pgmap v208: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:51.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:51 smithi088 ceph-mon[86843]: pgmap v208: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: pgmap v209: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:53.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:49:53.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.vqfqko"}]': finished 2024-09-13T21:49:53.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:49:53.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.yszliw"}]': finished 2024-09-13T21:49:53.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:49:53.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi116.mjrkvg"}]': finished 2024-09-13T21:49:53.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:49:53.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi116.rwfayz"}]': finished 2024-09-13T21:49:53.598 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:53 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T21:49:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: pgmap v209: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:53.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.vqfqko"}]: dispatch 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.vqfqko"}]': finished 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.yszliw"}]: dispatch 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi088.yszliw"}]': finished 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi116.mjrkvg"}]: dispatch 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi116.mjrkvg"}]': finished 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi116.rwfayz"}]: dispatch 2024-09-13T21:49:53.734 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi116.rwfayz"}]': finished 2024-09-13T21:49:53.735 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:53 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all mds 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: Standby daemon mds.cephfs.smithi088.yszliw assigned to filesystem cephfs as rank 0 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: Standby daemon mds.cephfs.smithi088.vqfqko assigned to filesystem cephfs as rank 1 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:replay,1=cephfs.smithi088.vqfqko=up:replay} 2 up:standby 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:54.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:54.484 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:54 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all mds 2024-09-13T21:49:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T21:49:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T21:49:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: Standby daemon mds.cephfs.smithi088.yszliw assigned to filesystem cephfs as rank 0 2024-09-13T21:49:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: Standby daemon mds.cephfs.smithi088.vqfqko assigned to filesystem cephfs as rank 1 2024-09-13T21:49:54.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:49:54.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-13T21:49:54.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:replay,1=cephfs.smithi088.vqfqko=up:replay} 2 up:standby 2024-09-13T21:49:54.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:54.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:54.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:54.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:54.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:54 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:55 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all rgw 2024-09-13T21:49:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:55 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T21:49:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:55 smithi116 ceph-mon[65231]: pgmap v210: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:49:55.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:55 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:55.677 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:55 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all rgw 2024-09-13T21:49:55.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:55 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T21:49:55.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:55 smithi088 ceph-mon[86843]: pgmap v210: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:55.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:49:55.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi088", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:49:55.678 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:55 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:56.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:56 smithi116 ceph-mon[65231]: Upgrade: Updating ceph-exporter.smithi088 (1/2) 2024-09-13T21:49:56.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:56 smithi116 ceph-mon[65231]: Deploying daemon ceph-exporter.smithi088 on smithi088 2024-09-13T21:49:56.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:56 smithi088 ceph-mon[86843]: Upgrade: Updating ceph-exporter.smithi088 (1/2) 2024-09-13T21:49:56.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:56 smithi088 ceph-mon[86843]: Deploying daemon ceph-exporter.smithi088 on smithi088 2024-09-13T21:49:57.585 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:57 smithi088 ceph-mon[86843]: pgmap v211: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 0 op/s 2024-09-13T21:49:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:57 smithi116 ceph-mon[65231]: pgmap v211: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 0 op/s 2024-09-13T21:49:58.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:49:58 smithi116 ceph-mon[65231]: pgmap v212: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-13T21:49:58.643 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:49:58 smithi088 ceph-mon[86843]: pgmap v212: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-13T21:50:00.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:resolve 2024-09-13T21:50:00.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:resolve,1=cephfs.smithi088.vqfqko=up:replay} 2 up:standby 2024-09-13T21:50:00.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:00.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:00.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-13T21:50:00.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-13T21:50:00.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: fs cephfs is degraded 2024-09-13T21:50:00.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:50:00.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:50:00.597 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:00 smithi116 ceph-mon[65231]: pgmap v213: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:resolve 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:resolve,1=cephfs.smithi088.vqfqko=up:replay} 2 up:standby 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: fs cephfs is degraded 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:50:00.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:00 smithi088 ceph-mon[86843]: pgmap v213: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-13T21:50:01.799 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:01 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:resolve 2024-09-13T21:50:01.800 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:01 smithi116 ceph-mon[65231]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:resolve,1=cephfs.smithi088.vqfqko=up:resolve} 2 up:standby 2024-09-13T21:50:01.800 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:01 smithi116 ceph-mon[65231]: Upgrade: Updating ceph-exporter.smithi116 (2/2) 2024-09-13T21:50:01.800 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:01 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:01.800 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:01 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:50:01.800 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:01 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:01.800 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:01 smithi116 ceph-mon[65231]: Deploying daemon ceph-exporter.smithi116 on smithi116 2024-09-13T21:50:01.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:01 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:resolve 2024-09-13T21:50:01.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:01 smithi088 ceph-mon[86843]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:resolve,1=cephfs.smithi088.vqfqko=up:resolve} 2 up:standby 2024-09-13T21:50:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:01 smithi088 ceph-mon[86843]: Upgrade: Updating ceph-exporter.smithi116 (2/2) 2024-09-13T21:50:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:01 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:01 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi116", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T21:50:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:01 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:01.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:01 smithi088 ceph-mon[86843]: Deploying daemon ceph-exporter.smithi116 on smithi116 2024-09-13T21:50:02.748 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: reconnect by client.14512 v1:192.168.0.1:0/3173709186 after 0 2024-09-13T21:50:02.748 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: reconnect by client.14512 v1:192.168.0.1:0/3173709186 after 0 2024-09-13T21:50:02.749 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: reconnect by client.14518 v1:172.21.15.116:0/3148794409 after 0.000999981 2024-09-13T21:50:02.749 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: reconnect by client.14518 v1:172.21.15.116:0/3148794409 after 0.000999981 2024-09-13T21:50:02.749 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:reconnect 2024-09-13T21:50:02.749 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:reconnect 2024-09-13T21:50:02.749 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:reconnect,1=cephfs.smithi088.vqfqko=up:reconnect} 2 up:standby 2024-09-13T21:50:02.749 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:02.749 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:02.749 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:02 smithi116 ceph-mon[65231]: pgmap v214: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-13T21:50:02.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: reconnect by client.14512 v1:192.168.0.1:0/3173709186 after 0 2024-09-13T21:50:02.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: reconnect by client.14512 v1:192.168.0.1:0/3173709186 after 0 2024-09-13T21:50:02.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: reconnect by client.14518 v1:172.21.15.116:0/3148794409 after 0.000999981 2024-09-13T21:50:02.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: reconnect by client.14518 v1:172.21.15.116:0/3148794409 after 0.000999981 2024-09-13T21:50:02.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:reconnect 2024-09-13T21:50:02.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:reconnect 2024-09-13T21:50:02.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:reconnect,1=cephfs.smithi088.vqfqko=up:reconnect} 2 up:standby 2024-09-13T21:50:02.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:02.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:02.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:02 smithi088 ceph-mon[86843]: pgmap v214: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-13T21:50:03.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:03 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:rejoin 2024-09-13T21:50:03.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:03 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:rejoin 2024-09-13T21:50:03.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:03 smithi088 ceph-mon[86843]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:rejoin,1=cephfs.smithi088.vqfqko=up:rejoin} 2 up:standby 2024-09-13T21:50:03.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:03 smithi088 ceph-mon[86843]: daemon mds.cephfs.smithi088.yszliw is now active in filesystem cephfs as rank 0 2024-09-13T21:50:03.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:03 smithi088 ceph-mon[86843]: daemon mds.cephfs.smithi088.vqfqko is now active in filesystem cephfs as rank 1 2024-09-13T21:50:04.067 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:03 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:rejoin 2024-09-13T21:50:04.067 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:03 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:rejoin 2024-09-13T21:50:04.067 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:03 smithi116 ceph-mon[65231]: fsmap cephfs:2/2 {0=cephfs.smithi088.yszliw=up:rejoin,1=cephfs.smithi088.vqfqko=up:rejoin} 2 up:standby 2024-09-13T21:50:04.067 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:03 smithi116 ceph-mon[65231]: daemon mds.cephfs.smithi088.yszliw is now active in filesystem cephfs as rank 0 2024-09-13T21:50:04.067 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:03 smithi116 ceph-mon[65231]: daemon mds.cephfs.smithi088.vqfqko is now active in filesystem cephfs as rank 1 2024-09-13T21:50:04.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:04 smithi116 ceph-mon[65231]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:50:04.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:04 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:active 2024-09-13T21:50:04.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:04 smithi116 ceph-mon[65231]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:active 2024-09-13T21:50:04.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:04 smithi116 ceph-mon[65231]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi088.vqfqko=up:active} 2 up:standby 2024-09-13T21:50:04.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:04 smithi116 ceph-mon[65231]: pgmap v215: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T21:50:04.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:04 smithi088 ceph-mon[86843]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:50:04.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:04 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] up:active 2024-09-13T21:50:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:04 smithi088 ceph-mon[86843]: mds.? [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] up:active 2024-09-13T21:50:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:04 smithi088 ceph-mon[86843]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi088.vqfqko=up:active} 2 up:standby 2024-09-13T21:50:04.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:04 smithi088 ceph-mon[86843]: pgmap v215: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T21:50:05.943 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:05.943 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:05.943 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:05 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:05.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:05.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:05.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:05 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:06.920 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:06 smithi088 ceph-mon[86843]: pgmap v216: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T21:50:07.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:06 smithi116 ceph-mon[65231]: pgmap v216: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T21:50:07.997 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:07 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:07.997 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:07 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:07.997 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:07 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:07.998 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:07 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:08.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:07 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:08.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:07 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:07 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:08.233 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:07 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:09.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:08 smithi116 ceph-mon[65231]: pgmap v217: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-13T21:50:09.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:08 smithi088 ceph-mon[86843]: pgmap v217: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-13T21:50:11.472 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:11 smithi088 ceph-mon[86843]: pgmap v218: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-13T21:50:11.472 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:11 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:11.472 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:11 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:11 smithi116 ceph-mon[65231]: pgmap v218: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-13T21:50:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:11 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:11 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:12.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:12 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:12.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:12 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:12.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:12 smithi088 ceph-mon[86843]: pgmap v219: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-13T21:50:12.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:12 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:12.906 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:12 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:13.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:12 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:13.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:12 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:13.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:12 smithi116 ceph-mon[65231]: pgmap v219: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-13T21:50:13.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:12 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:13.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:12 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:15.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:15 smithi088 ceph-mon[86843]: pgmap v220: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-13T21:50:15.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:15 smithi116 ceph-mon[65231]: pgmap v220: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-13T21:50:16.832 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:16.832 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:16.832 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:16.832 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:50:16.832 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:16.832 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:16.832 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.832 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.833 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.833 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.833 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.833 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T21:50:16.833 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T21:50:16.833 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:16 smithi116 ceph-mon[65231]: pgmap v221: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-13T21:50:16.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T21:50:16.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T21:50:16.984 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:16 smithi088 ceph-mon[86843]: pgmap v221: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-13T21:50:17.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.603+0000 7f300314c700 1 -- 172.21.15.88:0/4073632964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 msgr2=0x7f2ffc0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:17.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.603+0000 7f300314c700 1 --2- 172.21.15.88:0/4073632964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 0x7f2ffc0ff790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009910 tx=0x7f2ff4009c20 comp rx=0 tx=0).stop 2024-09-13T21:50:17.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.603+0000 7f300314c700 1 -- 172.21.15.88:0/4073632964 shutdown_connections 2024-09-13T21:50:17.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.603+0000 7f300314c700 1 --2- 172.21.15.88:0/4073632964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc0ffd60 0x7f2ffc103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:17.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.603+0000 7f300314c700 1 --2- 172.21.15.88:0/4073632964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 0x7f2ffc0ff790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:17.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.603+0000 7f300314c700 1 -- 172.21.15.88:0/4073632964 >> 172.21.15.88:0/4073632964 conn(0x7f2ffc0fac80 msgr2=0x7f2ffc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:17.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f300314c700 1 -- 172.21.15.88:0/4073632964 shutdown_connections 2024-09-13T21:50:17.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f300314c700 1 -- 172.21.15.88:0/4073632964 wait complete. 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f300314c700 1 Processor -- start 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f300314c700 1 -- start start 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f300314c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 0x7f2ffc198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f300314c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc0ffd60 0x7f2ffc1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f300314c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc198c80 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f300314c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc19ca10 con 0x7f2ffc0ffd60 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f3000ee8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 0x7f2ffc198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f3000ee8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 0x7f2ffc198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45092/0 (socket says 172.21.15.88:45092) 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.604+0000 7f3000ee8700 1 -- 172.21.15.88:0/4248347446 learned_addr learned my addr 172.21.15.88:0/4248347446 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f2ffbfff700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc0ffd60 0x7f2ffc1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:17.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f3000ee8700 1 -- 172.21.15.88:0/4248347446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc0ffd60 msgr2=0x7f2ffc1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:17.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f3000ee8700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc0ffd60 0x7f2ffc1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:17.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f3000ee8700 1 -- 172.21.15.88:0/4248347446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff40095f0 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f3000ee8700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 0x7f2ffc198060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400f690 tx=0x7f2ff400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:17.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f2ff9ffb700 1 -- 172.21.15.88:0/4248347446 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff401d070 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f2ff9ffb700 1 -- 172.21.15.88:0/4248347446 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ff40050d0 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc19cc90 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f2ff9ffb700 1 -- 172.21.15.88:0/4248347446 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff4022470 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.605+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ffc19d180 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.606+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ffc04f2a0 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.607+0000 7f2ff9ffb700 1 -- 172.21.15.88:0/4248347446 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2ff4003780 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.607+0000 7f2ff9ffb700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fe806e680 0x7f2fe8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:17.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.607+0000 7f2ffbfff700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fe806e680 0x7f2fe8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:17.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.607+0000 7f2ff9ffb700 1 -- 172.21.15.88:0/4248347446 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f2ff408fad0 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.608+0000 7f2ffbfff700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fe806e680 0x7f2fe8070b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc199680 tx=0x7f2fec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:17.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.612+0000 7f2ff9ffb700 1 -- 172.21.15.88:0/4248347446 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2ff4058cd0 con 0x7f2ffc0ff3c0 2024-09-13T21:50:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.840+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ffc19d520 con 0x7f2fe806e680 2024-09-13T21:50:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.841+0000 7f2ff9ffb700 1 -- 172.21.15.88:0/4248347446 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f2ffc19d520 con 0x7f2fe806e680 2024-09-13T21:50:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.843+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fe806e680 msgr2=0x7f2fe8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.843+0000 7f300314c700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fe806e680 0x7f2fe8070b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc199680 tx=0x7f2fec00b040 comp rx=0 tx=0).stop 2024-09-13T21:50:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.843+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 msgr2=0x7f2ffc198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.843+0000 7f300314c700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 0x7f2ffc198060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400f690 tx=0x7f2ff400f6c0 comp rx=0 tx=0).stop 2024-09-13T21:50:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.843+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 shutdown_connections 2024-09-13T21:50:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.843+0000 7f300314c700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f2fe806e680 0x7f2fe8070b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.843+0000 7f300314c700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ffc0ff3c0 0x7f2ffc198060 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.843+0000 7f300314c700 1 --2- 172.21.15.88:0/4248347446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc0ffd60 0x7f2ffc1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.843+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 >> 172.21.15.88:0/4248347446 conn(0x7f2ffc0fac80 msgr2=0x7f2ffc102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.844+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 shutdown_connections 2024-09-13T21:50:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:17.844+0000 7f300314c700 1 -- 172.21.15.88:0/4248347446 wait complete. 2024-09-13T21:50:17.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T21:50:17.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi088.vqfqko=up:active} 2 up:standby 2024-09-13T21:50:17.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T21:50:17.857 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi088"}]: dispatch 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi088"}]': finished 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi116"}]: dispatch 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi116"}]': finished 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all iscsi 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all nfs 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:17.858 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: Upgrade: Setting container_image for all nvmeof 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: Upgrade: Finalizing container_image settings 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:17.859 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T21:50:17.860 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T21:50:17.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T21:50:17.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T21:50:17.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T21:50:17.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T21:50:17.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T21:50:17.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T21:50:17.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:17.861 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: Upgrade: Complete! 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:50:17.862 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:17.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:17.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:17.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:50:17.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:17.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:17.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:17.863 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T21:50:18.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: fsmap cephfs:2 {0=cephfs.smithi088.yszliw=up:active,1=cephfs.smithi088.vqfqko=up:active} 2 up:standby 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi088"}]: dispatch 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi088"}]': finished 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi116"}]: dispatch 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi116"}]': finished 2024-09-13T21:50:18.097 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all iscsi 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all nfs 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: Upgrade: Setting container_image for all nvmeof 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.098 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: Upgrade: Finalizing container_image settings 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T21:50:18.099 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T21:50:18.100 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:18.101 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: Upgrade: Complete! 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:18.102 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:18.103 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:50:18.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T21:50:18.873 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:50:18.982 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:18 smithi088 ceph-mon[86843]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:18.983 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:18 smithi088 ceph-mon[86843]: pgmap v222: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7.1 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-13T21:50:19.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:18 smithi116 ceph-mon[65231]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:19.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:18 smithi116 ceph-mon[65231]: pgmap v222: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7.1 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-13T21:50:20.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 -- 172.21.15.88:0/3789548834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100d70 msgr2=0x7fafc01094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:20.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 --2- 172.21.15.88:0/3789548834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100d70 0x7fafc01094d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009910 tx=0x7fafa8009c20 comp rx=0 tx=0).stop 2024-09-13T21:50:20.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 -- 172.21.15.88:0/3789548834 shutdown_connections 2024-09-13T21:50:20.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 --2- 172.21.15.88:0/3789548834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100d70 0x7fafc01094d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:20.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 --2- 172.21.15.88:0/3789548834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0100460 0x7fafc0100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:20.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 -- 172.21.15.88:0/3789548834 >> 172.21.15.88:0/3789548834 conn(0x7fafc00748b0 msgr2=0x7fafc0074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:20.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 -- 172.21.15.88:0/3789548834 shutdown_connections 2024-09-13T21:50:20.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 -- 172.21.15.88:0/3789548834 wait complete. 2024-09-13T21:50:20.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 Processor -- start 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.484+0000 7fafc5e5a700 1 -- start start 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafc5e5a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100460 0x7fafc0196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafc5e5a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0100d70 0x7fafc0197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafc5e5a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc0197790 con 0x7fafc0100460 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafc5e5a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc0197900 con 0x7fafc0100d70 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100460 0x7fafc0196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100460 0x7fafc0196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37842/0 (socket says 172.21.15.88:37842) 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbf7fe700 1 -- 172.21.15.88:0/2908342816 learned_addr learned my addr 172.21.15.88:0/2908342816 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbf7fe700 1 -- 172.21.15.88:0/2908342816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0100d70 msgr2=0x7fafc0197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:20.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafb7fff700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0100d70 0x7fafc0197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:20.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbf7fe700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0100d70 0x7fafc0197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:20.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbf7fe700 1 -- 172.21.15.88:0/2908342816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa80095f0 con 0x7fafc0100460 2024-09-13T21:50:20.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbf7fe700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100460 0x7fafc0196cc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fafb000c930 tx=0x7fafb000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:20.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbd7fa700 1 -- 172.21.15.88:0/2908342816 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafb0007ad0 con 0x7fafc0100460 2024-09-13T21:50:20.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbd7fa700 1 -- 172.21.15.88:0/2908342816 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafb0007c30 con 0x7fafc0100460 2024-09-13T21:50:20.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc019fd30 con 0x7fafc0100460 2024-09-13T21:50:20.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.485+0000 7fafbd7fa700 1 -- 172.21.15.88:0/2908342816 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafb0018610 con 0x7fafc0100460 2024-09-13T21:50:20.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.486+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc01a01a0 con 0x7fafc0100460 2024-09-13T21:50:20.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.486+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc0106bd0 con 0x7fafc0100460 2024-09-13T21:50:20.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.487+0000 7fafbd7fa700 1 -- 172.21.15.88:0/2908342816 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fafb000f450 con 0x7fafc0100460 2024-09-13T21:50:20.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.487+0000 7fafbd7fa700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fafac06e680 0x7fafac070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:20.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.488+0000 7fafbd7fa700 1 -- 172.21.15.88:0/2908342816 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fafb008e900 con 0x7fafc0100460 2024-09-13T21:50:20.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.488+0000 7fafb7fff700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fafac06e680 0x7fafac070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:20.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.488+0000 7fafb7fff700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fafac06e680 0x7fafac070b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafa8006010 tx=0x7fafa800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:20.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.492+0000 7fafbd7fa700 1 -- 172.21.15.88:0/2908342816 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fafb00579d0 con 0x7fafc0100460 2024-09-13T21:50:20.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.701+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fafc0061190 con 0x7fafac06e680 2024-09-13T21:50:20.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.710+0000 7fafbd7fa700 1 -- 172.21.15.88:0/2908342816 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fafc0061190 con 0x7fafac06e680 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (7m) 9s ago 17m 25.4M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (21s) 9s ago 17m 8108k - 19.1.1-324-gecab7be5 0652ff2b5d78 838eb7d87adb 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (16s) 13s ago 16m 7314k - 19.1.1-324-gecab7be5 0652ff2b5d78 ac32292bf6c5 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (4m) 9s ago 17m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (4m) 13s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (7m) 9s ago 17m 82.5M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (67s) 9s ago 12m 70.9M - 19.1.1-324-gecab7be5 0652ff2b5d78 d3dc51440d57 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (85s) 9s ago 12m 62.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 3442dd68906e 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (36s) 13s ago 12m 14.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 bbad0a8133da 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (51s) 13s ago 12m 14.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 4e008a15cad8 2024-09-13T21:50:20.712 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (8m) 9s ago 19m 507M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (8m) 13s ago 16m 443M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (5m) 9s ago 19m 61.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (5m) 13s ago 16m 46.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (8m) 9s ago 17m 15.3M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (7m) 13s ago 16m 16.8M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (4m) 9s ago 15m 165M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (3m) 9s ago 15m 146M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 1899bd970e44 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (3m) 9s ago 14m 138M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 c38a8f2ec340 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (2m) 13s ago 14m 146M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7b16f89f6086 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (2m) 13s ago 14m 101M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 482f725f147b 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (101s) 13s ago 13m 102M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7bde2a23d60a 2024-09-13T21:50:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (7m) 9s ago 17m 82.9M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:50:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fafac06e680 msgr2=0x7fafac070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fafac06e680 0x7fafac070b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafa8006010 tx=0x7fafa800b540 comp rx=0 tx=0).stop 2024-09-13T21:50:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100460 msgr2=0x7fafc0196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100460 0x7fafc0196cc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fafb000c930 tx=0x7fafb000ccf0 comp rx=0 tx=0).stop 2024-09-13T21:50:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 shutdown_connections 2024-09-13T21:50:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fafac06e680 0x7fafac070b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc0100460 0x7fafc0196cc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 --2- 172.21.15.88:0/2908342816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0100d70 0x7fafc0197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 >> 172.21.15.88:0/2908342816 conn(0x7fafc00748b0 msgr2=0x7fafc0103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 shutdown_connections 2024-09-13T21:50:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:20.712+0000 7fafc5e5a700 1 -- 172.21.15.88:0/2908342816 wait complete. 2024-09-13T21:50:21.437 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:21 smithi088 ceph-mon[86843]: pgmap v223: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:21.457 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade status' 2024-09-13T21:50:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:21 smithi116 ceph-mon[65231]: pgmap v223: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:21.656 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:50:22.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:22 smithi088 ceph-mon[86843]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:22.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:22 smithi116 ceph-mon[65231]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:23.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.474+0000 7f77f1711700 1 -- 172.21.15.88:0/2689474450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec1004e0 msgr2=0x7f77ec1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:23.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.475+0000 7f77f1711700 1 --2- 172.21.15.88:0/2689474450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec1004e0 0x7f77ec1008b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009910 tx=0x7f77dc009c20 comp rx=0 tx=0).stop 2024-09-13T21:50:23.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.475+0000 7f77f1711700 1 -- 172.21.15.88:0/2689474450 shutdown_connections 2024-09-13T21:50:23.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.475+0000 7f77f1711700 1 --2- 172.21.15.88:0/2689474450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77ec100e80 0x7f77ec104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:23.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.475+0000 7f77f1711700 1 --2- 172.21.15.88:0/2689474450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec1004e0 0x7f77ec1008b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:23.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.475+0000 7f77f1711700 1 -- 172.21.15.88:0/2689474450 >> 172.21.15.88:0/2689474450 conn(0x7f77ec0fbda0 msgr2=0x7f77ec0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:23.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.475+0000 7f77f1711700 1 -- 172.21.15.88:0/2689474450 shutdown_connections 2024-09-13T21:50:23.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.475+0000 7f77f1711700 1 -- 172.21.15.88:0/2689474450 wait complete. 2024-09-13T21:50:23.480 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:23 smithi088 ceph-mon[86843]: pgmap v224: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:23.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.475+0000 7f77f1711700 1 Processor -- start 2024-09-13T21:50:23.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.475+0000 7f77f1711700 1 -- start start 2024-09-13T21:50:23.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77f1711700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77ec1004e0 0x7f77ec198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:23.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77f1711700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec100e80 0x7f77ec198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:23.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77f1711700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec19e7d0 con 0x7f77ec100e80 2024-09-13T21:50:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77f1711700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec19e940 con 0x7f77ec1004e0 2024-09-13T21:50:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77ea7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec100e80 0x7f77ec198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77ea7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec100e80 0x7f77ec198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37866/0 (socket says 172.21.15.88:37866) 2024-09-13T21:50:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77ea7fc700 1 -- 172.21.15.88:0/1608648380 learned_addr learned my addr 172.21.15.88:0/1608648380 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:50:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77eaffd700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77ec1004e0 0x7f77ec198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77ea7fc700 1 -- 172.21.15.88:0/1608648380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77ec1004e0 msgr2=0x7f77ec198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77ea7fc700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77ec1004e0 0x7f77ec198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77ea7fc700 1 -- 172.21.15.88:0/1608648380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc0095f0 con 0x7f77ec100e80 2024-09-13T21:50:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77ea7fc700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec100e80 0x7f77ec198fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77e000d900 tx=0x7f77e000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.476+0000 7f77d3fff700 1 -- 172.21.15.88:0/1608648380 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e0009900 con 0x7f77ec100e80 2024-09-13T21:50:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.477+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ec19ec20 con 0x7f77ec100e80 2024-09-13T21:50:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.477+0000 7f77d3fff700 1 -- 172.21.15.88:0/1608648380 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77e0010460 con 0x7f77ec100e80 2024-09-13T21:50:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.477+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ec19f170 con 0x7f77ec100e80 2024-09-13T21:50:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.477+0000 7f77d3fff700 1 -- 172.21.15.88:0/1608648380 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e000f5f0 con 0x7f77ec100e80 2024-09-13T21:50:23.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.478+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ec04f2a0 con 0x7f77ec100e80 2024-09-13T21:50:23.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.478+0000 7f77d3fff700 1 -- 172.21.15.88:0/1608648380 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f77e00105d0 con 0x7f77ec100e80 2024-09-13T21:50:23.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.479+0000 7f77d3fff700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77d406e680 0x7f77d4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:23.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.479+0000 7f77d3fff700 1 -- 172.21.15.88:0/1608648380 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f77e008e1d0 con 0x7f77ec100e80 2024-09-13T21:50:23.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.479+0000 7f77eaffd700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77d406e680 0x7f77d4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:23.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.479+0000 7f77eaffd700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77d406e680 0x7f77d4070b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f77dc006010 tx=0x7f77dc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:23.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.483+0000 7f77d3fff700 1 -- 172.21.15.88:0/1608648380 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f77e0057320 con 0x7f77ec100e80 2024-09-13T21:50:23.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:23 smithi116 ceph-mon[65231]: pgmap v224: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:23.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.703+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77ec19f4a0 con 0x7f77d406e680 2024-09-13T21:50:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.705+0000 7f77d3fff700 1 -- 172.21.15.88:0/1608648380 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f77ec19f4a0 con 0x7f77d406e680 2024-09-13T21:50:23.707 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:50:23.707 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": null, 2024-09-13T21:50:23.707 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": false, 2024-09-13T21:50:23.707 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "", 2024-09-13T21:50:23.707 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-09-13T21:50:23.708 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": null, 2024-09-13T21:50:23.708 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-09-13T21:50:23.708 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-09-13T21:50:23.708 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:50:23.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77d406e680 msgr2=0x7f77d4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:23.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77d406e680 0x7f77d4070b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f77dc006010 tx=0x7f77dc01a040 comp rx=0 tx=0).stop 2024-09-13T21:50:23.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec100e80 msgr2=0x7f77ec198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:23.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec100e80 0x7f77ec198fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77e000d900 tx=0x7f77e000dc10 comp rx=0 tx=0).stop 2024-09-13T21:50:23.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 shutdown_connections 2024-09-13T21:50:23.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f77d406e680 0x7f77d4070b30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:23.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f77ec1004e0 0x7f77ec198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:23.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 --2- 172.21.15.88:0/1608648380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77ec100e80 0x7f77ec198fa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 >> 172.21.15.88:0/1608648380 conn(0x7f77ec0fbda0 msgr2=0x7f77ec0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 shutdown_connections 2024-09-13T21:50:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:23.707+0000 7f77f1711700 1 -- 172.21.15.88:0/1608648380 wait complete. 2024-09-13T21:50:24.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph health detail' 2024-09-13T21:50:24.706 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:50:25.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:25 smithi088 ceph-mon[86843]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:25.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:25 smithi088 ceph-mon[86843]: pgmap v225: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:25 smithi116 ceph-mon[65231]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:25 smithi116 ceph-mon[65231]: pgmap v225: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:26.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.369+0000 7f6c57587700 1 -- 172.21.15.88:0/307460682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 msgr2=0x7f6c50104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:26.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.369+0000 7f6c57587700 1 --2- 172.21.15.88:0/307460682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 0x7f6c50104500 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009910 tx=0x7f6c4c009c20 comp rx=0 tx=0).stop 2024-09-13T21:50:26.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 -- 172.21.15.88:0/307460682 shutdown_connections 2024-09-13T21:50:26.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 --2- 172.21.15.88:0/307460682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c500ffbd0 0x7f6c50100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:26.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 --2- 172.21.15.88:0/307460682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 0x7f6c50104500 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 -- 172.21.15.88:0/307460682 >> 172.21.15.88:0/307460682 conn(0x7f6c50075130 msgr2=0x7f6c50075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 -- 172.21.15.88:0/307460682 shutdown_connections 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 -- 172.21.15.88:0/307460682 wait complete. 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 Processor -- start 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 -- start start 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c500ffbd0 0x7f6c50195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 0x7f6c50196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c50196a70 con 0x7f6c50104130 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.370+0000 7f6c57587700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5019a800 con 0x7f6c500ffbd0 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c54b22700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 0x7f6c50196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c54b22700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 0x7f6c50196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37874/0 (socket says 172.21.15.88:37874) 2024-09-13T21:50:26.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c54b22700 1 -- 172.21.15.88:0/1351270220 learned_addr learned my addr 172.21.15.88:0/1351270220 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:50:26.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c55323700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c500ffbd0 0x7f6c50195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:26.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c54b22700 1 -- 172.21.15.88:0/1351270220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c500ffbd0 msgr2=0x7f6c50195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:26.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c54b22700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c500ffbd0 0x7f6c50195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:26.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c54b22700 1 -- 172.21.15.88:0/1351270220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c0095f0 con 0x7f6c50104130 2024-09-13T21:50:26.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c54b22700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 0x7f6c50196390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000c8a0 tx=0x7f6c4000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:26.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c467fc700 1 -- 172.21.15.88:0/1351270220 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c400078e0 con 0x7f6c50104130 2024-09-13T21:50:26.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5019aae0 con 0x7f6c50104130 2024-09-13T21:50:26.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c467fc700 1 -- 172.21.15.88:0/1351270220 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c4000f450 con 0x7f6c50104130 2024-09-13T21:50:26.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c467fc700 1 -- 172.21.15.88:0/1351270220 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c4000e5e0 con 0x7f6c50104130 2024-09-13T21:50:26.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.371+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5019b030 con 0x7f6c50104130 2024-09-13T21:50:26.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.372+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c501086a0 con 0x7f6c50104130 2024-09-13T21:50:26.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.373+0000 7f6c467fc700 1 -- 172.21.15.88:0/1351270220 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6c4000f5c0 con 0x7f6c50104130 2024-09-13T21:50:26.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.373+0000 7f6c467fc700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6c3c06e680 0x7f6c3c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:26.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.373+0000 7f6c467fc700 1 -- 172.21.15.88:0/1351270220 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f6c4008e760 con 0x7f6c50104130 2024-09-13T21:50:26.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.373+0000 7f6c55323700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6c3c06e680 0x7f6c3c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:26.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.374+0000 7f6c55323700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6c3c06e680 0x7f6c3c070b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c000c00 tx=0x7f6c4c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.378+0000 7f6c467fc700 1 -- 172.21.15.88:0/1351270220 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6c40057830 con 0x7f6c50104130 2024-09-13T21:50:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.661+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6c5019b2b0 con 0x7f6c50104130 2024-09-13T21:50:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.661+0000 7f6c467fc700 1 -- 172.21.15.88:0/1351270220 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6c4005aef0 con 0x7f6c50104130 2024-09-13T21:50:26.664 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T21:50:26.664 INFO:teuthology.orchestra.run.smithi088.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T21:50:26.664 INFO:teuthology.orchestra.run.smithi088.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T21:50:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6c3c06e680 msgr2=0x7f6c3c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6c3c06e680 0x7f6c3c070b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c000c00 tx=0x7f6c4c01a040 comp rx=0 tx=0).stop 2024-09-13T21:50:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 msgr2=0x7f6c50196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 0x7f6c50196390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000c8a0 tx=0x7f6c4000cbb0 comp rx=0 tx=0).stop 2024-09-13T21:50:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 shutdown_connections 2024-09-13T21:50:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f6c3c06e680 0x7f6c3c070b30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c500ffbd0 0x7f6c50195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 --2- 172.21.15.88:0/1351270220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c50104130 0x7f6c50196390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 >> 172.21.15.88:0/1351270220 conn(0x7f6c50075130 msgr2=0x7f6c500fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 shutdown_connections 2024-09-13T21:50:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:26.664+0000 7f6c57587700 1 -- 172.21.15.88:0/1351270220 wait complete. 2024-09-13T21:50:27.320 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T21:50:27.519 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:50:27.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:27 smithi116 ceph-mon[65231]: pgmap v226: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:27.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:27 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1351270220' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:50:27.639 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:27 smithi088 ceph-mon[86843]: pgmap v226: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:27.640 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:27 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1351270220' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:50:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 -- 172.21.15.88:0/1577514350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 msgr2=0x7fd34c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 --2- 172.21.15.88:0/1577514350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 0x7fd34c0ff790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009910 tx=0x7fd33c009c20 comp rx=0 tx=0).stop 2024-09-13T21:50:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 -- 172.21.15.88:0/1577514350 shutdown_connections 2024-09-13T21:50:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 --2- 172.21.15.88:0/1577514350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd34c0ffd60 0x7fd34c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 --2- 172.21.15.88:0/1577514350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 0x7fd34c0ff790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 -- 172.21.15.88:0/1577514350 >> 172.21.15.88:0/1577514350 conn(0x7fd34c0fac80 msgr2=0x7fd34c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 -- 172.21.15.88:0/1577514350 shutdown_connections 2024-09-13T21:50:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 -- 172.21.15.88:0/1577514350 wait complete. 2024-09-13T21:50:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 Processor -- start 2024-09-13T21:50:29.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.077+0000 7fd35242e700 1 -- start start 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd35242e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 0x7fd34c195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd35242e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd34c0ffd60 0x7fd34c196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd35242e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c196a90 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd35242e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c196bd0 con 0x7fd34c0ffd60 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd34bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 0x7fd34c195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd34bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 0x7fd34c195f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37892/0 (socket says 172.21.15.88:37892) 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd34bfff700 1 -- 172.21.15.88:0/2502691364 learned_addr learned my addr 172.21.15.88:0/2502691364 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd34b7fe700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd34c0ffd60 0x7fd34c196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd34bfff700 1 -- 172.21.15.88:0/2502691364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd34c0ffd60 msgr2=0x7fd34c196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd34bfff700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd34c0ffd60 0x7fd34c196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd34bfff700 1 -- 172.21.15.88:0/2502691364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0095f0 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd34b7fe700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd34c0ffd60 0x7fd34c196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd34bfff700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 0x7fd34c195f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd33c006010 tx=0x7fd33c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.078+0000 7fd3497fa700 1 -- 172.21.15.88:0/2502691364 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33c01d070 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.079+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c19a9c0 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.079+0000 7fd3497fa700 1 -- 172.21.15.88:0/2502691364 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd33c004fb0 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.079+0000 7fd3497fa700 1 -- 172.21.15.88:0/2502691364 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33c022ea0 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.079+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c19aeb0 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.080+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c04f2a0 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.080+0000 7fd3497fa700 1 -- 172.21.15.88:0/2502691364 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd33c004af0 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.081+0000 7fd3497fa700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd33406e680 0x7fd334070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.081+0000 7fd34b7fe700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd33406e680 0x7fd334070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.081+0000 7fd3497fa700 1 -- 172.21.15.88:0/2502691364 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd33c08fc90 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.081+0000 7fd34b7fe700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd33406e680 0x7fd334070b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd340005fd0 tx=0x7fd340005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:29.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.085+0000 7fd3497fa700 1 -- 172.21.15.88:0/2502691364 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd33c058f30 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.377+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd34c19b190 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.378+0000 7fd3497fa700 1 -- 172.21.15.88:0/2502691364 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fd33c027290 con 0x7fd34c0ff3c0 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:50:29.380 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:50:29.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:50:29.381 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:50:29.381 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:50:29.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:50:29.381 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:50:29.381 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T21:50:29.381 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:50:29.381 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:50:29.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.380+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd33406e680 msgr2=0x7fd334070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:29.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.380+0000 7fd35242e700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd33406e680 0x7fd334070b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd340005fd0 tx=0x7fd340005e30 comp rx=0 tx=0).stop 2024-09-13T21:50:29.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.380+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 msgr2=0x7fd34c195f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:29.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.380+0000 7fd35242e700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 0x7fd34c195f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd33c006010 tx=0x7fd33c00be20 comp rx=0 tx=0).stop 2024-09-13T21:50:29.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.381+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 shutdown_connections 2024-09-13T21:50:29.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.381+0000 7fd35242e700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd33406e680 0x7fd334070b30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:29.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.381+0000 7fd35242e700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd34c0ff3c0 0x7fd34c195f00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:29.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.381+0000 7fd35242e700 1 --2- 172.21.15.88:0/2502691364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd34c0ffd60 0x7fd34c196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:29.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.381+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 >> 172.21.15.88:0/2502691364 conn(0x7fd34c0fac80 msgr2=0x7fd34c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:29.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.381+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 shutdown_connections 2024-09-13T21:50:29.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:50:29.381+0000 7fd35242e700 1 -- 172.21.15.88:0/2502691364 wait complete. 2024-09-13T21:50:29.495 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:29 smithi088 ceph-mon[86843]: pgmap v227: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:29 smithi116 ceph-mon[65231]: pgmap v227: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:30.051 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T21:50:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:50:30.398 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:30 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2502691364' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:30.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:30 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2502691364' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:31.571 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:31 smithi088 ceph-mon[86843]: pgmap v228: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:31 smithi116 ceph-mon[65231]: pgmap v228: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:31.941 INFO:teuthology.orchestra.run.smithi088.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T21:50:32.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:32.653 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:32.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'sleep 60' 2024-09-13T21:50:32.874 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:50:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:33 smithi116 ceph-mon[65231]: pgmap v229: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:33.660 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:33 smithi088 ceph-mon[86843]: pgmap v229: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:35.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:35 smithi116 ceph-mon[65231]: pgmap v230: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:35.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:35 smithi088 ceph-mon[86843]: pgmap v230: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:37 smithi116 ceph-mon[65231]: pgmap v231: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:37.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:37 smithi088 ceph-mon[86843]: pgmap v231: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:39.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:39 smithi116 ceph-mon[65231]: pgmap v232: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:39.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:39 smithi088 ceph-mon[86843]: pgmap v232: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:41 smithi116 ceph-mon[65231]: pgmap v233: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:41.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:41 smithi088 ceph-mon[86843]: pgmap v233: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:43.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:43 smithi088 ceph-mon[86843]: pgmap v234: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:43 smithi116 ceph-mon[65231]: pgmap v234: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:45.432 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:45 smithi088 ceph-mon[86843]: pgmap v235: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:45 smithi116 ceph-mon[65231]: pgmap v235: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:47 smithi116 ceph-mon[65231]: pgmap v236: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:47.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:47 smithi088 ceph-mon[86843]: pgmap v236: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:47.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:49 smithi116 ceph-mon[65231]: pgmap v237: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:49.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:49 smithi088 ceph-mon[86843]: pgmap v237: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:51 smithi116 ceph-mon[65231]: pgmap v238: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:51.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:51 smithi088 ceph-mon[86843]: pgmap v238: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:53 smithi116 ceph-mon[65231]: pgmap v239: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:53.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:53 smithi088 ceph-mon[86843]: pgmap v239: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:55.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:55 smithi088 ceph-mon[86843]: pgmap v240: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:55 smithi116 ceph-mon[65231]: pgmap v240: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:57 smithi116 ceph-mon[65231]: pgmap v241: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:57.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:57 smithi088 ceph-mon[86843]: pgmap v241: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:50:59 smithi116 ceph-mon[65231]: pgmap v242: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:59.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:50:59 smithi088 ceph-mon[86843]: pgmap v242: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:01 smithi116 ceph-mon[65231]: pgmap v243: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:01.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:01 smithi088 ceph-mon[86843]: pgmap v243: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:02.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:02.634 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:03 smithi116 ceph-mon[65231]: pgmap v244: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:03.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:03 smithi088 ceph-mon[86843]: pgmap v244: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:05 smithi116 ceph-mon[65231]: pgmap v245: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:05.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:05 smithi088 ceph-mon[86843]: pgmap v245: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:07.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:07 smithi116 ceph-mon[65231]: pgmap v246: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:07.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:07 smithi088 ceph-mon[86843]: pgmap v246: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:09.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:09 smithi116 ceph-mon[65231]: pgmap v247: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:09.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:09 smithi088 ceph-mon[86843]: pgmap v247: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:11 smithi116 ceph-mon[65231]: pgmap v248: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:11.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:11 smithi088 ceph-mon[86843]: pgmap v248: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:13 smithi116 ceph-mon[65231]: pgmap v249: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:13.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:13 smithi088 ceph-mon[86843]: pgmap v249: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:15.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:15 smithi116 ceph-mon[65231]: pgmap v250: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:15.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:15 smithi088 ceph-mon[86843]: pgmap v250: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:17 smithi116 ceph-mon[65231]: pgmap v251: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:17.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:17 smithi088 ceph-mon[86843]: pgmap v251: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:17.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:17.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:18.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:18.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:18.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:51:18.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:18.733 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:51:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:19 smithi116 ceph-mon[65231]: pgmap v252: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:19.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:19 smithi088 ceph-mon[86843]: pgmap v252: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:21.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:21 smithi088 ceph-mon[86843]: pgmap v253: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:21.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:21 smithi116 ceph-mon[65231]: pgmap v253: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:23.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:23 smithi116 ceph-mon[65231]: pgmap v254: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:23.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:23 smithi088 ceph-mon[86843]: pgmap v254: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:25.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:25 smithi116 ceph-mon[65231]: pgmap v255: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:25.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:25 smithi088 ceph-mon[86843]: pgmap v255: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:27.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:27 smithi116 ceph-mon[65231]: pgmap v256: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:27.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:27 smithi088 ceph-mon[86843]: pgmap v256: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:29.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:29 smithi116 ceph-mon[65231]: pgmap v257: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:29.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:29 smithi088 ceph-mon[86843]: pgmap v257: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:31 smithi116 ceph-mon[65231]: pgmap v258: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:31.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:31 smithi088 ceph-mon[86843]: pgmap v258: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:32.634 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:32.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:33.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:33 smithi088 ceph-mon[86843]: pgmap v259: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:33.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:33 smithi116 ceph-mon[65231]: pgmap v259: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:34.695 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:34 smithi088 ceph-mon[86843]: pgmap v260: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:34.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:34 smithi116 ceph-mon[65231]: pgmap v260: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:35.106 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T21:51:35.315 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:51:36.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.932+0000 7f85892b9700 1 -- 172.21.15.88:0/306478271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 msgr2=0x7f8584104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:36.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.932+0000 7f85892b9700 1 --2- 172.21.15.88:0/306478271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 0x7f8584104e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f856c009910 tx=0x7f856c009c20 comp rx=0 tx=0).stop 2024-09-13T21:51:36.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.932+0000 7f85892b9700 1 -- 172.21.15.88:0/306478271 shutdown_connections 2024-09-13T21:51:36.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.932+0000 7f85892b9700 1 --2- 172.21.15.88:0/306478271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 0x7f8584104e30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:36.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.932+0000 7f85892b9700 1 --2- 172.21.15.88:0/306478271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85841004c0 0x7f8584100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:36.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.932+0000 7f85892b9700 1 -- 172.21.15.88:0/306478271 >> 172.21.15.88:0/306478271 conn(0x7f85840fbd80 msgr2=0x7f85840fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:36.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.932+0000 7f85892b9700 1 -- 172.21.15.88:0/306478271 shutdown_connections 2024-09-13T21:51:36.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.932+0000 7f85892b9700 1 -- 172.21.15.88:0/306478271 wait complete. 2024-09-13T21:51:36.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.933+0000 7f85892b9700 1 Processor -- start 2024-09-13T21:51:36.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.933+0000 7f85892b9700 1 -- start start 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f85892b9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85841004c0 0x7f8584195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f85892b9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 0x7f8584196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f85892b9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8584196b10 con 0x7f8584100e60 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f85892b9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858419a8a0 con 0x7f85841004c0 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f857a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 0x7f8584196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f857a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 0x7f8584196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57996/0 (socket says 172.21.15.88:57996) 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f857a7fc700 1 -- 172.21.15.88:0/2418618921 learned_addr learned my addr 172.21.15.88:0/2418618921 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f8582ffd700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85841004c0 0x7f8584195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f857a7fc700 1 -- 172.21.15.88:0/2418618921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85841004c0 msgr2=0x7f8584195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f857a7fc700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85841004c0 0x7f8584195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f857a7fc700 1 -- 172.21.15.88:0/2418618921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0095f0 con 0x7f8584100e60 2024-09-13T21:51:36.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f857a7fc700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 0x7f8584196430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f856c0059d0 tx=0x7f856c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:36.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f8580ff9700 1 -- 172.21.15.88:0/2418618921 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f856c01d070 con 0x7f8584100e60 2024-09-13T21:51:36.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f8580ff9700 1 -- 172.21.15.88:0/2418618921 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f856c00b610 con 0x7f8584100e60 2024-09-13T21:51:36.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858419ab20 con 0x7f8584100e60 2024-09-13T21:51:36.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f8580ff9700 1 -- 172.21.15.88:0/2418618921 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f856c022470 con 0x7f8584100e60 2024-09-13T21:51:36.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.934+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858419b010 con 0x7f8584100e60 2024-09-13T21:51:36.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.935+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8584108830 con 0x7f8584100e60 2024-09-13T21:51:36.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.936+0000 7f8580ff9700 1 -- 172.21.15.88:0/2418618921 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f856c00fc70 con 0x7f8584100e60 2024-09-13T21:51:36.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.936+0000 7f8580ff9700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f857006e680 0x7f8570070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:36.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.936+0000 7f8580ff9700 1 -- 172.21.15.88:0/2418618921 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f856c08fbc0 con 0x7f8584100e60 2024-09-13T21:51:36.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.936+0000 7f8582ffd700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f857006e680 0x7f8570070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:36.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.937+0000 7f8582ffd700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f857006e680 0x7f8570070b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8574009380 tx=0x7f857400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:36.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:36.941+0000 7f8580ff9700 1 -- 172.21.15.88:0/2418618921 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f856c058c90 con 0x7f8584100e60 2024-09-13T21:51:37.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.154+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 --> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f858402cca0 con 0x7f857006e680 2024-09-13T21:51:37.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.163+0000 7f8580ff9700 1 -- 172.21.15.88:0/2418618921 <== mgr.34104 v2:172.21.15.88:6800/995153863 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f858402cca0 con 0x7f857006e680 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.smithi088 smithi088 *:9093,9094 running (8m) 85s ago 18m 25.4M - 0.25.0 c8568f914cd2 641dd8a30c15 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi088 smithi088 running (98s) 85s ago 19m 8108k - 19.1.1-324-gecab7be5 0652ff2b5d78 838eb7d87adb 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-exporter.smithi116 smithi116 running (92s) 90s ago 18m 7314k - 19.1.1-324-gecab7be5 0652ff2b5d78 ac32292bf6c5 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi088 smithi088 running (6m) 85s ago 19m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 61edf14f09f6 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:crash.smithi116 smithi116 running (6m) 90s ago 18m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 0f737cdac94b 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.smithi088 smithi088 *:3000 running (8m) 85s ago 18m 82.5M - 9.4.12 2bacad6d85d8 093b7cb715ee 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.vqfqko smithi088 running (2m) 85s ago 13m 70.9M - 19.1.1-324-gecab7be5 0652ff2b5d78 d3dc51440d57 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi088.yszliw smithi088 running (2m) 85s ago 13m 62.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 3442dd68906e 2024-09-13T21:51:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.mjrkvg smithi116 running (112s) 90s ago 13m 14.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 bbad0a8133da 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:mds.cephfs.smithi116.rwfayz smithi116 running (2m) 90s ago 13m 14.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 4e008a15cad8 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi088.scyrwy smithi088 *:8443,9283,8765 running (10m) 85s ago 20m 507M - 19.1.1-324-gecab7be5 0652ff2b5d78 71e697ebd30a 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.smithi116.bqnvtn smithi116 *:8443,9283,8765 running (9m) 90s ago 17m 443M - 19.1.1-324-gecab7be5 0652ff2b5d78 b738028fc643 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi088 smithi088 running (7m) 85s ago 20m 61.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7959cd284dbb 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:mon.smithi116 smithi116 running (6m) 90s ago 17m 46.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 27f0dd428044 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi088 smithi088 *:9100 running (9m) 85s ago 19m 15.3M - 1.5.0 0da6a335fe13 88542c2c8dfc 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.smithi116 smithi116 *:9100 running (9m) 90s ago 18m 16.8M - 1.5.0 0da6a335fe13 f1ae63721abd 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (5m) 85s ago 17m 165M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 4c58e1e63038 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (5m) 85s ago 16m 146M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 1899bd970e44 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (4m) 85s ago 16m 138M 1216M 19.1.1-324-gecab7be5 0652ff2b5d78 c38a8f2ec340 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi116 running (4m) 90s ago 15m 146M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7b16f89f6086 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi116 running (3m) 90s ago 15m 101M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 482f725f147b 2024-09-13T21:51:37.166 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi116 running (2m) 90s ago 14m 102M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 7bde2a23d60a 2024-09-13T21:51:37.167 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.smithi088 smithi088 *:9095 running (8m) 85s ago 18m 82.9M - 2.43.0 a07b618ecd1d b05b998d2041 2024-09-13T21:51:37.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.165+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f857006e680 msgr2=0x7f8570070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:37.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.165+0000 7f85892b9700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f857006e680 0x7f8570070b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8574009380 tx=0x7f857400b040 comp rx=0 tx=0).stop 2024-09-13T21:51:37.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.165+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 msgr2=0x7f8584196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:37.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.165+0000 7f85892b9700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 0x7f8584196430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f856c0059d0 tx=0x7f856c00f740 comp rx=0 tx=0).stop 2024-09-13T21:51:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.165+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 shutdown_connections 2024-09-13T21:51:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.165+0000 7f85892b9700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f857006e680 0x7f8570070b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.165+0000 7f85892b9700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85841004c0 0x7f8584195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.165+0000 7f85892b9700 1 --2- 172.21.15.88:0/2418618921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8584100e60 0x7f8584196430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.165+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 >> 172.21.15.88:0/2418618921 conn(0x7f85840fbd80 msgr2=0x7f85840fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.166+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 shutdown_connections 2024-09-13T21:51:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:37.166+0000 7f85892b9700 1 -- 172.21.15.88:0/2418618921 wait complete. 2024-09-13T21:51:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:37 smithi116 ceph-mon[65231]: pgmap v261: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:37.653 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:37 smithi088 ceph-mon[86843]: pgmap v261: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:37.881 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T21:51:38.096 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:51:38.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:38 smithi088 ceph-mon[86843]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:38.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:38 smithi116 ceph-mon[65231]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:39.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:39 smithi116 ceph-mon[65231]: pgmap v262: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:39.626 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:39 smithi088 ceph-mon[86843]: pgmap v262: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.868+0000 7f56df77d700 1 -- 172.21.15.88:0/3843169309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 msgr2=0x7f56d8104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.868+0000 7f56df77d700 1 --2- 172.21.15.88:0/3843169309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 0x7f56d8104e50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009910 tx=0x7f56d4009c20 comp rx=0 tx=0).stop 2024-09-13T21:51:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.868+0000 7f56df77d700 1 -- 172.21.15.88:0/3843169309 shutdown_connections 2024-09-13T21:51:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.868+0000 7f56df77d700 1 --2- 172.21.15.88:0/3843169309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 0x7f56d8104e50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.868+0000 7f56df77d700 1 --2- 172.21.15.88:0/3843169309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d81004e0 0x7f56d81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.868+0000 7f56df77d700 1 -- 172.21.15.88:0/3843169309 >> 172.21.15.88:0/3843169309 conn(0x7f56d80fbda0 msgr2=0x7f56d80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:39.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.868+0000 7f56df77d700 1 -- 172.21.15.88:0/3843169309 shutdown_connections 2024-09-13T21:51:39.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.868+0000 7f56df77d700 1 -- 172.21.15.88:0/3843169309 wait complete. 2024-09-13T21:51:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.869+0000 7f56df77d700 1 Processor -- start 2024-09-13T21:51:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.869+0000 7f56df77d700 1 -- start start 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.869+0000 7f56df77d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d81004e0 0x7f56d8195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.869+0000 7f56df77d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 0x7f56d8196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.869+0000 7f56df77d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8196b50 con 0x7f56d8100e80 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.869+0000 7f56df77d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d819a8e0 con 0x7f56d81004e0 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56dcd18700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 0x7f56d8196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56dcd18700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 0x7f56d8196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58022/0 (socket says 172.21.15.88:58022) 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56dcd18700 1 -- 172.21.15.88:0/1428827543 learned_addr learned my addr 172.21.15.88:0/1428827543 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56dd519700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d81004e0 0x7f56d8195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56dcd18700 1 -- 172.21.15.88:0/1428827543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d81004e0 msgr2=0x7f56d8195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56dcd18700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d81004e0 0x7f56d8195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56dcd18700 1 -- 172.21.15.88:0/1428827543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d40095f0 con 0x7f56d8100e80 2024-09-13T21:51:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56dd519700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d81004e0 0x7f56d8195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:51:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56dcd18700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 0x7f56d8196470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f56d400bd70 tx=0x7f56d400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1428827543 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d401d070 con 0x7f56d8100e80 2024-09-13T21:51:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d819ab60 con 0x7f56d8100e80 2024-09-13T21:51:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1428827543 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56d4005dc0 con 0x7f56d8100e80 2024-09-13T21:51:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1428827543 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d4017400 con 0x7f56d8100e80 2024-09-13T21:51:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.870+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d819b050 con 0x7f56d8100e80 2024-09-13T21:51:39.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.871+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d8108850 con 0x7f56d8100e80 2024-09-13T21:51:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.872+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1428827543 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f56d400f7f0 con 0x7f56d8100e80 2024-09-13T21:51:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.872+0000 7f56ce7fc700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f56c406e680 0x7f56c4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.872+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1428827543 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f56d408fc60 con 0x7f56d8100e80 2024-09-13T21:51:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.872+0000 7f56dd519700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f56c406e680 0x7f56c4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.873+0000 7f56dd519700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f56c406e680 0x7f56c4070b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005fd0 tx=0x7f56c8005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:39.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:39.877+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1428827543 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f56d4058d30 con 0x7f56d8100e80 2024-09-13T21:51:40.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.166+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f56d8108230 con 0x7f56d8100e80 2024-09-13T21:51:40.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.166+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1428827543 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f56d405c3f0 con 0x7f56d8100e80 2024-09-13T21:51:40.168 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T21:51:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-09-13T21:51:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:51:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:51:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-09-13T21:51:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:51:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T21:51:40.169 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T21:51:40.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f56c406e680 msgr2=0x7f56c4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:40.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f56c406e680 0x7f56c4070b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005fd0 tx=0x7f56c8005ee0 comp rx=0 tx=0).stop 2024-09-13T21:51:40.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 msgr2=0x7f56d8196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:40.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 0x7f56d8196470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f56d400bd70 tx=0x7f56d400be50 comp rx=0 tx=0).stop 2024-09-13T21:51:40.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 shutdown_connections 2024-09-13T21:51:40.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f56c406e680 0x7f56c4070b30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:40.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d81004e0 0x7f56d8195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:40.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 --2- 172.21.15.88:0/1428827543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8100e80 0x7f56d8196470 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:40.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 >> 172.21.15.88:0/1428827543 conn(0x7f56d80fbda0 msgr2=0x7f56d80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:40.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 shutdown_connections 2024-09-13T21:51:40.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:40.169+0000 7f56df77d700 1 -- 172.21.15.88:0/1428827543 wait complete. 2024-09-13T21:51:40.481 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:40 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1428827543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:40.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:40 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1428827543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:40.821 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T21:51:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:51:41.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:41 smithi116 ceph-mon[65231]: pgmap v263: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:41.420 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:41 smithi088 ceph-mon[86843]: pgmap v263: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:42.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.651+0000 7f80badec700 1 -- 172.21.15.88:0/140239528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100460 msgr2=0x7f80b4100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.651+0000 7f80badec700 1 --2- 172.21.15.88:0/140239528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100460 0x7f80b4100830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009910 tx=0x7f80a8009c20 comp rx=0 tx=0).stop 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.651+0000 7f80badec700 1 -- 172.21.15.88:0/140239528 shutdown_connections 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.651+0000 7f80badec700 1 --2- 172.21.15.88:0/140239528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80b4100d70 0x7f80b41094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.651+0000 7f80badec700 1 --2- 172.21.15.88:0/140239528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100460 0x7f80b4100830 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.651+0000 7f80badec700 1 -- 172.21.15.88:0/140239528 >> 172.21.15.88:0/140239528 conn(0x7f80b40748b0 msgr2=0x7f80b4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.651+0000 7f80badec700 1 -- 172.21.15.88:0/140239528 shutdown_connections 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.651+0000 7f80badec700 1 -- 172.21.15.88:0/140239528 wait complete. 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80badec700 1 Processor -- start 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80badec700 1 -- start start 2024-09-13T21:51:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80badec700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80b4100460 0x7f80b4195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80badec700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100d70 0x7f80b4196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80badec700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4196b30 con 0x7f80b4100d70 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80badec700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b419a8c0 con 0x7f80b4100460 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80b3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100d70 0x7f80b4196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80b3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100d70 0x7f80b4196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35976/0 (socket says 172.21.15.88:35976) 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80b3fff700 1 -- 172.21.15.88:0/649430235 learned_addr learned my addr 172.21.15.88:0/649430235 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.652+0000 7f80b8b88700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80b4100460 0x7f80b4195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.653+0000 7f80b3fff700 1 -- 172.21.15.88:0/649430235 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80b4100460 msgr2=0x7f80b4195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.653+0000 7f80b3fff700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80b4100460 0x7f80b4195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.653+0000 7f80b3fff700 1 -- 172.21.15.88:0/649430235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a80095f0 con 0x7f80b4100d70 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.653+0000 7f80b3fff700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100d70 0x7f80b4196450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80a000d8d0 tx=0x7f80a000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.653+0000 7f80b1ffb700 1 -- 172.21.15.88:0/649430235 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80a00098a0 con 0x7f80b4100d70 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.653+0000 7f80b1ffb700 1 -- 172.21.15.88:0/649430235 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80a0010460 con 0x7f80b4100d70 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.653+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b419aba0 con 0x7f80b4100d70 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.653+0000 7f80b1ffb700 1 -- 172.21.15.88:0/649430235 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80a000f5f0 con 0x7f80b4100d70 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.653+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b419b0f0 con 0x7f80b4100d70 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.654+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b4107e40 con 0x7f80b4100d70 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.654+0000 7f80b1ffb700 1 -- 172.21.15.88:0/649430235 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f80a0009a00 con 0x7f80b4100d70 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.655+0000 7f80b1ffb700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f80a406e680 0x7f80a4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.655+0000 7f80b1ffb700 1 -- 172.21.15.88:0/649430235 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f80a008e680 con 0x7f80b4100d70 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.655+0000 7f80b8b88700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f80a406e680 0x7f80a4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.655+0000 7f80b8b88700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f80a406e680 0x7f80a4070b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80a8006010 tx=0x7f80a801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.659+0000 7f80b1ffb700 1 -- 172.21.15.88:0/649430235 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f80a00576f0 con 0x7f80b4100d70 2024-09-13T21:51:42.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.946+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80b419b310 con 0x7f80b4100d70 2024-09-13T21:51:42.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.947+0000 7f80b1ffb700 1 -- 172.21.15.88:0/649430235 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f80a005adb0 con 0x7f80b4100d70 2024-09-13T21:51:42.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f80a406e680 msgr2=0x7f80a4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f80a406e680 0x7f80a4070b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80a8006010 tx=0x7f80a801a040 comp rx=0 tx=0).stop 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100d70 msgr2=0x7f80b4196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100d70 0x7f80b4196450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80a000d8d0 tx=0x7f80a000dbe0 comp rx=0 tx=0).stop 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 shutdown_connections 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f80a406e680 0x7f80a4070b30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80b4100460 0x7f80b4195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 --2- 172.21.15.88:0/649430235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b4100d70 0x7f80b4196450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 >> 172.21.15.88:0/649430235 conn(0x7f80b40748b0 msgr2=0x7f80b40fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 shutdown_connections 2024-09-13T21:51:42.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:42.949+0000 7f80badec700 1 -- 172.21.15.88:0/649430235 wait complete. 2024-09-13T21:51:42.961 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-09-13T21:51:43.580 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:43 smithi088 ceph-mon[86843]: pgmap v264: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:43.580 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:43 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/649430235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:43 smithi116 ceph-mon[65231]: pgmap v264: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:43 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/649430235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:43.602 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T21:51:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:51:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.406+0000 7fe57c359700 1 -- 172.21.15.88:0/2723101947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe574100e80 msgr2=0x7fe574104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.406+0000 7fe57c359700 1 --2- 172.21.15.88:0/2723101947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe574100e80 0x7fe574104e50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe564009910 tx=0x7fe564009c20 comp rx=0 tx=0).stop 2024-09-13T21:51:45.408 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:45 smithi088 ceph-mon[86843]: pgmap v265: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.406+0000 7fe57c359700 1 -- 172.21.15.88:0/2723101947 shutdown_connections 2024-09-13T21:51:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.406+0000 7fe57c359700 1 --2- 172.21.15.88:0/2723101947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe574100e80 0x7fe574104e50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.406+0000 7fe57c359700 1 --2- 172.21.15.88:0/2723101947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5741004e0 0x7fe5741008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.406+0000 7fe57c359700 1 -- 172.21.15.88:0/2723101947 >> 172.21.15.88:0/2723101947 conn(0x7fe5740fbda0 msgr2=0x7fe5740fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.406+0000 7fe57c359700 1 -- 172.21.15.88:0/2723101947 shutdown_connections 2024-09-13T21:51:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.406+0000 7fe57c359700 1 -- 172.21.15.88:0/2723101947 wait complete. 2024-09-13T21:51:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.406+0000 7fe57c359700 1 Processor -- start 2024-09-13T21:51:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57c359700 1 -- start start 2024-09-13T21:51:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57c359700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5741004e0 0x7fe574195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57c359700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe574100e80 0x7fe574196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57c359700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe574196b30 con 0x7fe5741004e0 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57c359700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57419a8c0 con 0x7fe574100e80 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57a0f5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5741004e0 0x7fe574195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57a0f5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5741004e0 0x7fe574195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35994/0 (socket says 172.21.15.88:35994) 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57a0f5700 1 -- 172.21.15.88:0/4269229099 learned_addr learned my addr 172.21.15.88:0/4269229099 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe5798f4700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe574100e80 0x7fe574196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57a0f5700 1 -- 172.21.15.88:0/4269229099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe574100e80 msgr2=0x7fe574196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57a0f5700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe574100e80 0x7fe574196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57a0f5700 1 -- 172.21.15.88:0/4269229099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5640095f0 con 0x7fe5741004e0 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe5798f4700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe574100e80 0x7fe574196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:51:45.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe57a0f5700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5741004e0 0x7fe574195f10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe57000c8a0 tx=0x7fe57000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.407+0000 7fe56b7fe700 1 -- 172.21.15.88:0/4269229099 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57000cea0 con 0x7fe5741004e0 2024-09-13T21:51:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.408+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57419aba0 con 0x7fe5741004e0 2024-09-13T21:51:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.408+0000 7fe56b7fe700 1 -- 172.21.15.88:0/4269229099 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe570004830 con 0x7fe5741004e0 2024-09-13T21:51:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.408+0000 7fe56b7fe700 1 -- 172.21.15.88:0/4269229099 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5700055b0 con 0x7fe5741004e0 2024-09-13T21:51:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.408+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57419b0f0 con 0x7fe5741004e0 2024-09-13T21:51:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.409+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe574108850 con 0x7fe5741004e0 2024-09-13T21:51:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.409+0000 7fe56b7fe700 1 -- 172.21.15.88:0/4269229099 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe570007ad0 con 0x7fe5741004e0 2024-09-13T21:51:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.410+0000 7fe56b7fe700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe56006e680 0x7fe560070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.410+0000 7fe5798f4700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe56006e680 0x7fe560070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.410+0000 7fe56b7fe700 1 -- 172.21.15.88:0/4269229099 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fe57008e4b0 con 0x7fe5741004e0 2024-09-13T21:51:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.410+0000 7fe5798f4700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe56006e680 0x7fe560070b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe56400b5c0 tx=0x7fe564005480 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.414+0000 7fe56b7fe700 1 -- 172.21.15.88:0/4269229099 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe570057580 con 0x7fe5741004e0 2024-09-13T21:51:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:45 smithi116 ceph-mon[65231]: pgmap v265: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:45.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.704+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe574197370 con 0x7fe5741004e0 2024-09-13T21:51:45.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.705+0000 7fe56b7fe700 1 -- 172.21.15.88:0/4269229099 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fe57005ac40 con 0x7fe5741004e0 2024-09-13T21:51:45.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.707+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe56006e680 msgr2=0x7fe560070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.707+0000 7fe57c359700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe56006e680 0x7fe560070b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe56400b5c0 tx=0x7fe564005480 comp rx=0 tx=0).stop 2024-09-13T21:51:45.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.707+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5741004e0 msgr2=0x7fe574195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.707+0000 7fe57c359700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5741004e0 0x7fe574195f10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe57000c8a0 tx=0x7fe57000cc60 comp rx=0 tx=0).stop 2024-09-13T21:51:45.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.707+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 shutdown_connections 2024-09-13T21:51:45.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.707+0000 7fe57c359700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fe56006e680 0x7fe560070b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.707+0000 7fe57c359700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5741004e0 0x7fe574195f10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.707+0000 7fe57c359700 1 --2- 172.21.15.88:0/4269229099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe574100e80 0x7fe574196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.707+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 >> 172.21.15.88:0/4269229099 conn(0x7fe5740fbda0 msgr2=0x7fe5740fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:45.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.708+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 shutdown_connections 2024-09-13T21:51:45.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:45.708+0000 7fe57c359700 1 -- 172.21.15.88:0/4269229099 wait complete. 2024-09-13T21:51:45.719 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)" 2024-09-13T21:51:46.394 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:46 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/4269229099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:46.414 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:46 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/4269229099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:46.416 DEBUG:teuthology.parallel:result is None 2024-09-13T21:51:46.417 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:51:46.430 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:51:46.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 67511300-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T21:51:46.638 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:51:47.437 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:47 smithi088 ceph-mon[86843]: pgmap v266: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:47.437 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:47 smithi116 ceph-mon[65231]: pgmap v266: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:47.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:48.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.209+0000 7f916cad2700 1 -- 172.21.15.88:0/4134257895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101420 msgr2=0x7f91681017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:48.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.209+0000 7f916cad2700 1 --2- 172.21.15.88:0/4134257895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101420 0x7f91681017f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9158009910 tx=0x7f9158009c20 comp rx=0 tx=0).stop 2024-09-13T21:51:48.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.209+0000 7f916cad2700 1 -- 172.21.15.88:0/4134257895 shutdown_connections 2024-09-13T21:51:48.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.209+0000 7f916cad2700 1 --2- 172.21.15.88:0/4134257895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9168101d30 0x7f916810a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:48.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.209+0000 7f916cad2700 1 --2- 172.21.15.88:0/4134257895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101420 0x7f91681017f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:48.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.209+0000 7f916cad2700 1 -- 172.21.15.88:0/4134257895 >> 172.21.15.88:0/4134257895 conn(0x7f91680fac80 msgr2=0x7f91680fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:48.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.209+0000 7f916cad2700 1 -- 172.21.15.88:0/4134257895 shutdown_connections 2024-09-13T21:51:48.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.209+0000 7f916cad2700 1 -- 172.21.15.88:0/4134257895 wait complete. 2024-09-13T21:51:48.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f916cad2700 1 Processor -- start 2024-09-13T21:51:48.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f916cad2700 1 -- start start 2024-09-13T21:51:48.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f916cad2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9168101420 0x7f9168195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:48.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f916cad2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101d30 0x7f9168196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:48.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f916cad2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9168196c10 con 0x7f9168101d30 2024-09-13T21:51:48.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f916cad2700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916819a9a0 con 0x7f9168101420 2024-09-13T21:51:48.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f9165d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101d30 0x7f9168196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:48.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f9165d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101d30 0x7f9168196530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36010/0 (socket says 172.21.15.88:36010) 2024-09-13T21:51:48.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f9165d9b700 1 -- 172.21.15.88:0/4016434938 learned_addr learned my addr 172.21.15.88:0/4016434938 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:51:48.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f916659c700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9168101420 0x7f9168195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:48.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f9165d9b700 1 -- 172.21.15.88:0/4016434938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9168101420 msgr2=0x7f9168195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:48.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f9165d9b700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9168101420 0x7f9168195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:48.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f9165d9b700 1 -- 172.21.15.88:0/4016434938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91580095f0 con 0x7f9168101d30 2024-09-13T21:51:48.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.210+0000 7f9165d9b700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101d30 0x7f9168196530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f915c00b4b0 tx=0x7f915c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:48.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.211+0000 7f91577fe700 1 -- 172.21.15.88:0/4016434938 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f915c011800 con 0x7f9168101d30 2024-09-13T21:51:48.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.211+0000 7f91577fe700 1 -- 172.21.15.88:0/4016434938 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f915c011e20 con 0x7f9168101d30 2024-09-13T21:51:48.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.211+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916819ac80 con 0x7f9168101d30 2024-09-13T21:51:48.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.211+0000 7f91577fe700 1 -- 172.21.15.88:0/4016434938 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f915c00f2e0 con 0x7f9168101d30 2024-09-13T21:51:48.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.211+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916819b1d0 con 0x7f9168101d30 2024-09-13T21:51:48.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.212+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91681078e0 con 0x7f9168101d30 2024-09-13T21:51:48.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.212+0000 7f91577fe700 1 -- 172.21.15.88:0/4016434938 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f915c010380 con 0x7f9168101d30 2024-09-13T21:51:48.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.213+0000 7f91577fe700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f915006e680 0x7f9150070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:48.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.213+0000 7f91577fe700 1 -- 172.21.15.88:0/4016434938 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f915c08e3a0 con 0x7f9168101d30 2024-09-13T21:51:48.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.213+0000 7f916659c700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f915006e680 0x7f9150070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:48.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.213+0000 7f916659c700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f915006e680 0x7f9150070b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9158006010 tx=0x7f915801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:48.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.217+0000 7f91577fe700 1 -- 172.21.15.88:0/4016434938 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f915c0573d0 con 0x7f9168101d30 2024-09-13T21:51:48.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.464+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f916804f2a0 con 0x7f9168101d30 2024-09-13T21:51:48.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.465+0000 7f91577fe700 1 -- 172.21.15.88:0/4016434938 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1988 (secure 0 0 0) 0x7f915c05aa90 con 0x7f9168101d30 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:e38 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:btime 2024-09-13T21:50:16:653616+0000 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:legacy client fscid: 1 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:fs_name cephfs 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 38 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:51:48.467 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T21:38:02.176962+0000 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:modified 2024-09-13T21:50:15.771417+0000 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:tableserver 0 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:root 0 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:session_timeout 60 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:session_autoclose 300 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:max_file_size 1099511627776 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:max_xattr_size 65536 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:required_client_features {} 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure 0 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:last_failure_osd_epoch 90 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T21:51:48.468 INFO:teuthology.orchestra.run.smithi088.stdout:max_mds 2 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:in 0,1 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:up {0=34382,1=34402} 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:failed 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:damaged 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:stopped 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:data_pools [3] 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:metadata_pool 2 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:inline_data enabled 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:balancer 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:bal_rank_mask -1 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:standby_count_wanted 1 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:qdb_cluster leader: 34382 members: 34402,34382 2024-09-13T21:51:48.469 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.yszliw{0:34382} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.88:6826/1507815842,v1:172.21.15.88:6827/1507815842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:51:48.470 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi088.vqfqko{1:34402} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.88:6828/2098233498,v1:172.21.15.88:6829/2098233498] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:51:48.470 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:51:48.470 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:51:48.470 INFO:teuthology.orchestra.run.smithi088.stdout:Standby daemons: 2024-09-13T21:51:48.470 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:51:48.470 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.rwfayz{-1:44323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.116:6824/387213237,v1:172.21.15.116:6825/387213237] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:51:48.470 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.cephfs.smithi116.mjrkvg{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.116:6826/102910693,v1:172.21.15.116:6827/102910693] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f915006e680 msgr2=0x7f9150070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f915006e680 0x7f9150070b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9158006010 tx=0x7f915801a040 comp rx=0 tx=0).stop 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101d30 msgr2=0x7f9168196530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101d30 0x7f9168196530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f915c00b4b0 tx=0x7f915c00b870 comp rx=0 tx=0).stop 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 shutdown_connections 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f915006e680 0x7f9150070b30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9168101420 0x7f9168195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 --2- 172.21.15.88:0/4016434938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9168101d30 0x7f9168196530 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 >> 172.21.15.88:0/4016434938 conn(0x7f91680fac80 msgr2=0x7f9168104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:48.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 shutdown_connections 2024-09-13T21:51:48.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:48.468+0000 7f916cad2700 1 -- 172.21.15.88:0/4016434938 wait complete. 2024-09-13T21:51:48.472 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 38 2024-09-13T21:51:49.260 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T21:51:49.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T21:51:49.479 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:51:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:49 smithi116 ceph-mon[65231]: pgmap v267: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:49 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/4016434938' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:51:49.599 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:49 smithi088 ceph-mon[86843]: pgmap v267: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:49.599 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:49 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/4016434938' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:51:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.121+0000 7fd6f7f62700 1 -- 172.21.15.88:0/1603755869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f01014a0 msgr2=0x7fd6f0101870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.121+0000 7fd6f7f62700 1 --2- 172.21.15.88:0/1603755869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f01014a0 0x7fd6f0101870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009910 tx=0x7fd6ec009c20 comp rx=0 tx=0).stop 2024-09-13T21:51:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 -- 172.21.15.88:0/1603755869 shutdown_connections 2024-09-13T21:51:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 --2- 172.21.15.88:0/1603755869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6f0101db0 0x7fd6f010a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 --2- 172.21.15.88:0/1603755869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f01014a0 0x7fd6f0101870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 -- 172.21.15.88:0/1603755869 >> 172.21.15.88:0/1603755869 conn(0x7fd6f00fac80 msgr2=0x7fd6f00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:51.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 -- 172.21.15.88:0/1603755869 shutdown_connections 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 -- 172.21.15.88:0/1603755869 wait complete. 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 Processor -- start 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 -- start start 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6f01014a0 0x7fd6f00ff100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f0101db0 0x7fd6f00ff640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00ffb80 con 0x7fd6f0101db0 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.122+0000 7fd6f7f62700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00ffcc0 con 0x7fd6f01014a0 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6f54fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f0101db0 0x7fd6f00ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6f54fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f0101db0 0x7fd6f00ff640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48578/0 (socket says 172.21.15.88:48578) 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6f54fd700 1 -- 172.21.15.88:0/3450383146 learned_addr learned my addr 172.21.15.88:0/3450383146 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6f54fd700 1 -- 172.21.15.88:0/3450383146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6f01014a0 msgr2=0x7fd6f00ff100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6f54fd700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6f01014a0 0x7fd6f00ff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:51.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6f54fd700 1 -- 172.21.15.88:0/3450383146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0095f0 con 0x7fd6f0101db0 2024-09-13T21:51:51.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6f54fd700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f0101db0 0x7fd6f00ff640 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000c8a0 tx=0x7fd6e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:51.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6e6ffd700 1 -- 172.21.15.88:0/3450383146 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e000cea0 con 0x7fd6f0101db0 2024-09-13T21:51:51.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6e6ffd700 1 -- 172.21.15.88:0/3450383146 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6e0004830 con 0x7fd6f0101db0 2024-09-13T21:51:51.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f01a2030 con 0x7fd6f0101db0 2024-09-13T21:51:51.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6e6ffd700 1 -- 172.21.15.88:0/3450383146 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e00055b0 con 0x7fd6f0101db0 2024-09-13T21:51:51.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.123+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f01a23e0 con 0x7fd6f0101db0 2024-09-13T21:51:51.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.124+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f0107980 con 0x7fd6f0101db0 2024-09-13T21:51:51.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.125+0000 7fd6e6ffd700 1 -- 172.21.15.88:0/3450383146 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd6e00049a0 con 0x7fd6f0101db0 2024-09-13T21:51:51.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.125+0000 7fd6e6ffd700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd6dc06e680 0x7fd6dc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:51.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.125+0000 7fd6e6ffd700 1 -- 172.21.15.88:0/3450383146 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd6e008e360 con 0x7fd6f0101db0 2024-09-13T21:51:51.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.125+0000 7fd6f5cfe700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd6dc06e680 0x7fd6dc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:51.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.126+0000 7fd6f5cfe700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd6dc06e680 0x7fd6dc070b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00b5c0 tx=0x7fd6ec005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:51.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.130+0000 7fd6e6ffd700 1 -- 172.21.15.88:0/3450383146 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd6e0057410 con 0x7fd6f0101db0 2024-09-13T21:51:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.377+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6f004f2a0 con 0x7fd6f0101db0 2024-09-13T21:51:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.378+0000 7fd6e6ffd700 1 -- 172.21.15.88:0/3450383146 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5272 (secure 0 0 0) 0x7fd6e0004c50 con 0x7fd6f0101db0 2024-09-13T21:51:51.380 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:51:51.380 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"btime":"2024-09-13T21:50:16:653616+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44327,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6827/102910693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":102910693},{"type":"v1","addr":"172.21.15.116:6827","nonce":102910693}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:50:15.771417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":0,"incarnation":32,"state":"up:active","state_seq":20,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34402":{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":1,"incarnation":32,"state":"up:active","state_seq":16,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34382,"qdb_cluster":[34402,34382]},"id":1}]} 2024-09-13T21:51:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd6dc06e680 msgr2=0x7fd6dc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd6dc06e680 0x7fd6dc070b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00b5c0 tx=0x7fd6ec005960 comp rx=0 tx=0).stop 2024-09-13T21:51:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f0101db0 msgr2=0x7fd6f00ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f0101db0 0x7fd6f00ff640 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000c8a0 tx=0x7fd6e000cc60 comp rx=0 tx=0).stop 2024-09-13T21:51:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 shutdown_connections 2024-09-13T21:51:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd6dc06e680 0x7fd6dc070b30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6f01014a0 0x7fd6f00ff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 --2- 172.21.15.88:0/3450383146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6f0101db0 0x7fd6f00ff640 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:51.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 >> 172.21.15.88:0/3450383146 conn(0x7fd6f00fac80 msgr2=0x7fd6f0104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:51.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.380+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 shutdown_connections 2024-09-13T21:51:51.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:51.381+0000 7fd6f7f62700 1 -- 172.21.15.88:0/3450383146 wait complete. 2024-09-13T21:51:51.383 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 38 2024-09-13T21:51:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:51 smithi116 ceph-mon[65231]: pgmap v268: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:51.685 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:51 smithi088 ceph-mon[86843]: pgmap v268: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:52.122 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 2, 'flags': 18} 2024-09-13T21:51:52.122 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-13T21:51:52.327 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:51:52.447 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:52 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3450383146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:51:52.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:52 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3450383146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:51:53.590 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:53 smithi088 ceph-mon[86843]: pgmap v269: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:53 smithi116 ceph-mon[65231]: pgmap v269: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:53.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 -- 172.21.15.88:0/1154711860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e081004e0 msgr2=0x7f4e081008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:53.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 --2- 172.21.15.88:0/1154711860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e081004e0 0x7f4e081008b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000b0a0 tx=0x7f4e0000b3b0 comp rx=0 tx=0).stop 2024-09-13T21:51:53.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 -- 172.21.15.88:0/1154711860 shutdown_connections 2024-09-13T21:51:53.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 --2- 172.21.15.88:0/1154711860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e08100e80 0x7f4e08104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:53.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 --2- 172.21.15.88:0/1154711860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e081004e0 0x7f4e081008b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:53.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 -- 172.21.15.88:0/1154711860 >> 172.21.15.88:0/1154711860 conn(0x7f4e080fbda0 msgr2=0x7f4e080fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:53.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 -- 172.21.15.88:0/1154711860 shutdown_connections 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 -- 172.21.15.88:0/1154711860 wait complete. 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 Processor -- start 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.980+0000 7f4e10518700 1 -- start start 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e10518700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e081004e0 0x7f4e08195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e10518700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e08100e80 0x7f4e08196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e10518700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08196b10 con 0x7f4e08100e80 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e10518700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0819a8a0 con 0x7f4e081004e0 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e0dab3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e08100e80 0x7f4e08196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e0dab3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e08100e80 0x7f4e08196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48592/0 (socket says 172.21.15.88:48592) 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e0dab3700 1 -- 172.21.15.88:0/3722219287 learned_addr learned my addr 172.21.15.88:0/3722219287 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e0e2b4700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e081004e0 0x7f4e08195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e0dab3700 1 -- 172.21.15.88:0/3722219287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e081004e0 msgr2=0x7f4e08195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e0dab3700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e081004e0 0x7f4e08195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e0dab3700 1 -- 172.21.15.88:0/3722219287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00009d00 con 0x7f4e08100e80 2024-09-13T21:51:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e0dab3700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e08100e80 0x7f4e08196430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4df800c8f0 tx=0x7f4df800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4dff7fe700 1 -- 172.21.15.88:0/3722219287 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4df80078a0 con 0x7f4e08100e80 2024-09-13T21:51:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4dff7fe700 1 -- 172.21.15.88:0/3722219287 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4df800f450 con 0x7f4e08100e80 2024-09-13T21:51:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0819ab80 con 0x7f4e08100e80 2024-09-13T21:51:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4dff7fe700 1 -- 172.21.15.88:0/3722219287 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4df8018610 con 0x7f4e08100e80 2024-09-13T21:51:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.981+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0819b0d0 con 0x7f4e08100e80 2024-09-13T21:51:53.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.982+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e081087f0 con 0x7f4e08100e80 2024-09-13T21:51:53.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.983+0000 7f4dff7fe700 1 -- 172.21.15.88:0/3722219287 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4df800f5c0 con 0x7f4e08100e80 2024-09-13T21:51:53.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.983+0000 7f4dff7fe700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4df406e680 0x7f4df4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:53.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.983+0000 7f4dff7fe700 1 -- 172.21.15.88:0/3722219287 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f4df808e610 con 0x7f4e08100e80 2024-09-13T21:51:53.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.983+0000 7f4e0e2b4700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4df406e680 0x7f4df4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:53.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.984+0000 7f4e0e2b4700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4df406e680 0x7f4df4070b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e00000f80 tx=0x7f4e000060c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:53.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:53.988+0000 7f4dff7fe700 1 -- 172.21.15.88:0/3722219287 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4df8057760 con 0x7f4e08100e80 2024-09-13T21:51:54.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.232+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f4e081972f0 con 0x7f4e08100e80 2024-09-13T21:51:54.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.233+0000 7f4dff7fe700 1 -- 172.21.15.88:0/3722219287 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v38) v1 ==== 107+0+4915 (secure 0 0 0) 0x7f4df805ae20 con 0x7f4e08100e80 2024-09-13T21:51:54.235 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:51:54.235 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1678889304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1678889304},{"type":"v1","addr":"172.21.15.88:6827","nonce":1678889304}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:39:53.156668+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi088.vqfqko","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6829/3000160721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3000160721},{"type":"v1","addr":"172.21.15.88:6829","nonce":3000160721}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi116.rwfayz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6825/3165930293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3165930293},{"type":"v1","addr":"172.21.15.116:6825","nonce":3165930293}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:51:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4df406e680 msgr2=0x7f4df4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4df406e680 0x7f4df4070b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e00000f80 tx=0x7f4e000060c0 comp rx=0 tx=0).stop 2024-09-13T21:51:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e08100e80 msgr2=0x7f4e08196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e08100e80 0x7f4e08196430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4df800c8f0 tx=0x7f4df800cc00 comp rx=0 tx=0).stop 2024-09-13T21:51:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 shutdown_connections 2024-09-13T21:51:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4df406e680 0x7f4df4070b30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e081004e0 0x7f4e08195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 --2- 172.21.15.88:0/3722219287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e08100e80 0x7f4e08196430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 >> 172.21.15.88:0/3722219287 conn(0x7f4e080fbda0 msgr2=0x7f4e080fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 shutdown_connections 2024-09-13T21:51:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:54.235+0000 7f4e10518700 1 -- 172.21.15.88:0/3722219287 wait complete. 2024-09-13T21:51:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 17 2024-09-13T21:51:54.591 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:54 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3722219287' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T21:51:54.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:54 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3722219287' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T21:51:54.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-13T21:51:55.083 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:51:55.469 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:55 smithi088 ceph-mon[86843]: pgmap v270: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:55 smithi116 ceph-mon[65231]: pgmap v270: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:56.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.794+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2802572025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ff3c0 msgr2=0x7f7b540ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.794+0000 7f7b5b50d700 1 --2- 172.21.15.88:0/2802572025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ff3c0 0x7f7b540ff790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b50009910 tx=0x7f7b50009c20 comp rx=0 tx=0).stop 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.794+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2802572025 shutdown_connections 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.794+0000 7f7b5b50d700 1 --2- 172.21.15.88:0/2802572025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b540ffd60 0x7f7b54103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.794+0000 7f7b5b50d700 1 --2- 172.21.15.88:0/2802572025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ff3c0 0x7f7b540ff790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.794+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2802572025 >> 172.21.15.88:0/2802572025 conn(0x7f7b540fac60 msgr2=0x7f7b540fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.794+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2802572025 shutdown_connections 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.794+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2802572025 wait complete. 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b5b50d700 1 Processor -- start 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b5b50d700 1 -- start start 2024-09-13T21:51:56.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b5b50d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b540ff3c0 0x7f7b54193b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b5b50d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ffd60 0x7f7b54194060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b5b50d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54195ba0 con 0x7f7b540ffd60 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b5b50d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54195ce0 con 0x7f7b540ff3c0 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b58aa8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ffd60 0x7f7b54194060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b58aa8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ffd60 0x7f7b54194060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48598/0 (socket says 172.21.15.88:48598) 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b58aa8700 1 -- 172.21.15.88:0/2891451892 learned_addr learned my addr 172.21.15.88:0/2891451892 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b592a9700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b540ff3c0 0x7f7b54193b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b58aa8700 1 -- 172.21.15.88:0/2891451892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b540ff3c0 msgr2=0x7f7b54193b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b58aa8700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b540ff3c0 0x7f7b54193b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.795+0000 7f7b58aa8700 1 -- 172.21.15.88:0/2891451892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b500095f0 con 0x7f7b540ffd60 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.796+0000 7f7b58aa8700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ffd60 0x7f7b54194060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400d900 tx=0x7f7b4400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.796+0000 7f7b4a7fc700 1 -- 172.21.15.88:0/2891451892 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b44009900 con 0x7f7b540ffd60 2024-09-13T21:51:56.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.796+0000 7f7b4a7fc700 1 -- 172.21.15.88:0/2891451892 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b44010460 con 0x7f7b540ffd60 2024-09-13T21:51:56.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.796+0000 7f7b4a7fc700 1 -- 172.21.15.88:0/2891451892 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b4400f5f0 con 0x7f7b540ffd60 2024-09-13T21:51:56.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.796+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b54194740 con 0x7f7b540ffd60 2024-09-13T21:51:56.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.796+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b541a6870 con 0x7f7b540ffd60 2024-09-13T21:51:56.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.797+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5404f2a0 con 0x7f7b540ffd60 2024-09-13T21:51:56.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.798+0000 7f7b4a7fc700 1 -- 172.21.15.88:0/2891451892 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7b440105d0 con 0x7f7b540ffd60 2024-09-13T21:51:56.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.798+0000 7f7b4a7fc700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7b4006e680 0x7f7b40070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:56.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.798+0000 7f7b592a9700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7b4006e680 0x7f7b40070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:56.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.798+0000 7f7b4a7fc700 1 -- 172.21.15.88:0/2891451892 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f7b4408e370 con 0x7f7b540ffd60 2024-09-13T21:51:56.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.799+0000 7f7b592a9700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7b4006e680 0x7f7b40070b30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000b5c0 tx=0x7f7b5001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:56.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:56.803+0000 7f7b4a7fc700 1 -- 172.21.15.88:0/2891451892 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7b440573e0 con 0x7f7b540ffd60 2024-09-13T21:51:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.047+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f7b54194fb0 con 0x7f7b540ffd60 2024-09-13T21:51:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.048+0000 7f7b4a7fc700 1 -- 172.21.15.88:0/2891451892 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v38) v1 ==== 107+0+4916 (secure 0 0 0) 0x7f7b4405aaa0 con 0x7f7b540ffd60 2024-09-13T21:51:57.050 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:51:57.050 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1678889304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1678889304},{"type":"v1","addr":"172.21.15.88:6827","nonce":1678889304}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:41:09.804224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi088.vqfqko","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6829/3000160721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3000160721},{"type":"v1","addr":"172.21.15.88:6829","nonce":3000160721}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi116.rwfayz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6825/3165930293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3165930293},{"type":"v1","addr":"172.21.15.116:6825","nonce":3165930293}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7b4006e680 msgr2=0x7f7b40070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7b4006e680 0x7f7b40070b30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000b5c0 tx=0x7f7b5001a040 comp rx=0 tx=0).stop 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ffd60 msgr2=0x7f7b54194060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ffd60 0x7f7b54194060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400d900 tx=0x7f7b4400dc10 comp rx=0 tx=0).stop 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 shutdown_connections 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f7b4006e680 0x7f7b40070b30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b540ff3c0 0x7f7b54193b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 --2- 172.21.15.88:0/2891451892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b540ffd60 0x7f7b54194060 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 >> 172.21.15.88:0/2891451892 conn(0x7f7b540fac60 msgr2=0x7f7b54102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:57.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 shutdown_connections 2024-09-13T21:51:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:57.050+0000 7f7b5b50d700 1 -- 172.21.15.88:0/2891451892 wait complete. 2024-09-13T21:51:57.053 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2024-09-13T21:51:57.422 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:57 smithi088 ceph-mon[86843]: pgmap v271: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:57.423 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:57 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2891451892' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T21:51:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:57 smithi116 ceph-mon[65231]: pgmap v271: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:57 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2891451892' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T21:51:57.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-13T21:51:58.037 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:51:59.443 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:51:59 smithi088 ceph-mon[86843]: pgmap v272: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:59.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:51:59 smithi116 ceph-mon[65231]: pgmap v272: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:51:59.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.684+0000 7f31a7fe9700 1 -- 172.21.15.88:0/3761720018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 msgr2=0x7f31a0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.684+0000 7f31a7fe9700 1 --2- 172.21.15.88:0/3761720018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 0x7f31a0103d30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3190009910 tx=0x7f3190009c20 comp rx=0 tx=0).stop 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.684+0000 7f31a7fe9700 1 -- 172.21.15.88:0/3761720018 shutdown_connections 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.684+0000 7f31a7fe9700 1 --2- 172.21.15.88:0/3761720018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 0x7f31a0103d30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.684+0000 7f31a7fe9700 1 --2- 172.21.15.88:0/3761720018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a00ff3c0 0x7f31a00ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.684+0000 7f31a7fe9700 1 -- 172.21.15.88:0/3761720018 >> 172.21.15.88:0/3761720018 conn(0x7f31a00fac80 msgr2=0x7f31a00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.685+0000 7f31a7fe9700 1 -- 172.21.15.88:0/3761720018 shutdown_connections 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.685+0000 7f31a7fe9700 1 -- 172.21.15.88:0/3761720018 wait complete. 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.685+0000 7f31a7fe9700 1 Processor -- start 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.685+0000 7f31a7fe9700 1 -- start start 2024-09-13T21:51:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.685+0000 7f31a7fe9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a00ff3c0 0x7f31a0100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.685+0000 7f31a7fe9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 0x7f31a0101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.685+0000 7f31a7fe9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a0101850 con 0x7f31a00ffd60 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.685+0000 7f31a7fe9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a0101990 con 0x7f31a00ff3c0 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a5584700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 0x7f31a0101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a5584700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 0x7f31a0101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48620/0 (socket says 172.21.15.88:48620) 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a5584700 1 -- 172.21.15.88:0/254930010 learned_addr learned my addr 172.21.15.88:0/254930010 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a5d85700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a00ff3c0 0x7f31a0100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a5584700 1 -- 172.21.15.88:0/254930010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a00ff3c0 msgr2=0x7f31a0100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a5584700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a00ff3c0 0x7f31a0100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a5584700 1 -- 172.21.15.88:0/254930010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900095f0 con 0x7f31a00ffd60 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a5d85700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a00ff3c0 0x7f31a0100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:51:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a5584700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 0x7f31a0101310 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f31900092e0 tx=0x7f319000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f3196ffd700 1 -- 172.21.15.88:0/254930010 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f319001d070 con 0x7f31a00ffd60 2024-09-13T21:51:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f3196ffd700 1 -- 172.21.15.88:0/254930010 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3190005dc0 con 0x7f31a00ffd60 2024-09-13T21:51:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a0101c10 con 0x7f31a00ffd60 2024-09-13T21:51:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f3196ffd700 1 -- 172.21.15.88:0/254930010 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3190017400 con 0x7f31a00ffd60 2024-09-13T21:51:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.686+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a01a2380 con 0x7f31a00ffd60 2024-09-13T21:51:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.687+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a004f2a0 con 0x7f31a00ffd60 2024-09-13T21:51:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.688+0000 7f3196ffd700 1 -- 172.21.15.88:0/254930010 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f319000f460 con 0x7f31a00ffd60 2024-09-13T21:51:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.688+0000 7f3196ffd700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f318c06e680 0x7f318c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.688+0000 7f31a5d85700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f318c06e680 0x7f318c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.688+0000 7f3196ffd700 1 -- 172.21.15.88:0/254930010 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f319008fbf0 con 0x7f31a00ffd60 2024-09-13T21:51:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.689+0000 7f31a5d85700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f318c06e680 0x7f318c070b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f319c005950 tx=0x7f319c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:59.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.693+0000 7f3196ffd700 1 -- 172.21.15.88:0/254930010 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3190058cc0 con 0x7f31a00ffd60 2024-09-13T21:51:59.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.935+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f31a01a2660 con 0x7f31a00ffd60 2024-09-13T21:51:59.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.936+0000 7f3196ffd700 1 -- 172.21.15.88:0/254930010 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v38) v1 ==== 107+0+4915 (secure 0 0 0) 0x7f319005c380 con 0x7f31a00ffd60 2024-09-13T21:51:59.938 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:51:59.938 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1678889304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1678889304},{"type":"v1","addr":"172.21.15.88:6827","nonce":1678889304}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:43:48.061421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi088.vqfqko","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6829/3000160721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3000160721},{"type":"v1","addr":"172.21.15.88:6829","nonce":3000160721}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi116.rwfayz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6825/3165930293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3165930293},{"type":"v1","addr":"172.21.15.116:6825","nonce":3165930293}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:51:59.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.938+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f318c06e680 msgr2=0x7f318c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:59.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.938+0000 7f31a7fe9700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f318c06e680 0x7f318c070b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f319c005950 tx=0x7f319c0058e0 comp rx=0 tx=0).stop 2024-09-13T21:51:59.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.938+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 msgr2=0x7f31a0101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:59.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.938+0000 7f31a7fe9700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 0x7f31a0101310 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f31900092e0 tx=0x7f319000be20 comp rx=0 tx=0).stop 2024-09-13T21:51:59.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.938+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 shutdown_connections 2024-09-13T21:51:59.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.938+0000 7f31a7fe9700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f318c06e680 0x7f318c070b30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:59.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.938+0000 7f31a7fe9700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a00ff3c0 0x7f31a0100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:59.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.938+0000 7f31a7fe9700 1 --2- 172.21.15.88:0/254930010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31a00ffd60 0x7f31a0101310 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:59.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.938+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 >> 172.21.15.88:0/254930010 conn(0x7f31a00fac80 msgr2=0x7f31a0068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:59.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.939+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 shutdown_connections 2024-09-13T21:51:59.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:51:59.939+0000 7f31a7fe9700 1 -- 172.21.15.88:0/254930010 wait complete. 2024-09-13T21:51:59.941 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 19 2024-09-13T21:52:00.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:00 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/254930010' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T21:52:00.604 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:00 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/254930010' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T21:52:00.626 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-13T21:52:00.827 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:01.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:01 smithi116 ceph-mon[65231]: pgmap v273: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:01.645 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:01 smithi088 ceph-mon[86843]: pgmap v273: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:02.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.457+0000 7fa762026700 1 -- 172.21.15.88:0/3071284812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 msgr2=0x7fa75c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:02.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.457+0000 7fa762026700 1 --2- 172.21.15.88:0/3071284812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 0x7fa75c104e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa750009910 tx=0x7fa750009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:02.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.457+0000 7fa762026700 1 -- 172.21.15.88:0/3071284812 shutdown_connections 2024-09-13T21:52:02.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.457+0000 7fa762026700 1 --2- 172.21.15.88:0/3071284812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 0x7fa75c104e50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:02.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.457+0000 7fa762026700 1 --2- 172.21.15.88:0/3071284812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa75c1004e0 0x7fa75c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:02.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.457+0000 7fa762026700 1 -- 172.21.15.88:0/3071284812 >> 172.21.15.88:0/3071284812 conn(0x7fa75c0fbda0 msgr2=0x7fa75c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:02.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.458+0000 7fa762026700 1 -- 172.21.15.88:0/3071284812 shutdown_connections 2024-09-13T21:52:02.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.458+0000 7fa762026700 1 -- 172.21.15.88:0/3071284812 wait complete. 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.458+0000 7fa762026700 1 Processor -- start 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.458+0000 7fa762026700 1 -- start start 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.458+0000 7fa762026700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa75c1004e0 0x7fa75c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.458+0000 7fa762026700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 0x7fa75c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.458+0000 7fa762026700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c196aa0 con 0x7fa75c100e80 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.458+0000 7fa762026700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c196be0 con 0x7fa75c1004e0 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa75affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 0x7fa75c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa75affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 0x7fa75c196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44182/0 (socket says 172.21.15.88:44182) 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa75affd700 1 -- 172.21.15.88:0/1363082611 learned_addr learned my addr 172.21.15.88:0/1363082611 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa75affd700 1 -- 172.21.15.88:0/1363082611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa75c1004e0 msgr2=0x7fa75c195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa75affd700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa75c1004e0 0x7fa75c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa75affd700 1 -- 172.21.15.88:0/1363082611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7500095f0 con 0x7fa75c100e80 2024-09-13T21:52:02.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa75affd700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 0x7fa75c196450 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa75000bda0 tx=0x7fa75000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa758ff9700 1 -- 172.21.15.88:0/1363082611 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75001d070 con 0x7fa75c100e80 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa758ff9700 1 -- 172.21.15.88:0/1363082611 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa750004fb0 con 0x7fa75c100e80 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c19a9d0 con 0x7fa75c100e80 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa758ff9700 1 -- 172.21.15.88:0/1363082611 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75000f460 con 0x7fa75c100e80 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.459+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c19aec0 con 0x7fa75c100e80 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.460+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c108850 con 0x7fa75c100e80 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.461+0000 7fa758ff9700 1 -- 172.21.15.88:0/1363082611 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa750022800 con 0x7fa75c100e80 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.461+0000 7fa758ff9700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa74406e680 0x7fa744070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.461+0000 7fa758ff9700 1 -- 172.21.15.88:0/1363082611 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fa75008fc10 con 0x7fa75c100e80 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.461+0000 7fa75b7fe700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa74406e680 0x7fa744070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:02.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.462+0000 7fa75b7fe700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa74406e680 0x7fa744070b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa74c005fd0 tx=0x7fa74c005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:02.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.466+0000 7fa758ff9700 1 -- 172.21.15.88:0/1363082611 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa750058e10 con 0x7fa75c100e80 2024-09-13T21:52:02.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:02 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:02.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:02 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:02.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.714+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fa75c108230 con 0x7fa75c100e80 2024-09-13T21:52:02.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.715+0000 7fa758ff9700 1 -- 172.21.15.88:0/1363082611 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v38) v1 ==== 107+0+4914 (secure 0 0 0) 0x7fa750027090 con 0x7fa75c100e80 2024-09-13T21:52:02.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:02.717 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1678889304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1678889304},{"type":"v1","addr":"172.21.15.88:6827","nonce":1678889304}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:43:58.996472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi088.vqfqko","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6829/3000160721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":3000160721},{"type":"v1","addr":"172.21.15.88:6829","nonce":3000160721}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi116.rwfayz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6825/3165930293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3165930293},{"type":"v1","addr":"172.21.15.116:6825","nonce":3165930293}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa74406e680 msgr2=0x7fa744070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa74406e680 0x7fa744070b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa74c005fd0 tx=0x7fa74c005d00 comp rx=0 tx=0).stop 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 msgr2=0x7fa75c196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 0x7fa75c196450 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa75000bda0 tx=0x7fa75000be80 comp rx=0 tx=0).stop 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 shutdown_connections 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fa74406e680 0x7fa744070b30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa75c1004e0 0x7fa75c195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 --2- 172.21.15.88:0/1363082611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa75c100e80 0x7fa75c196450 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 >> 172.21.15.88:0/1363082611 conn(0x7fa75c0fbda0 msgr2=0x7fa75c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 shutdown_connections 2024-09-13T21:52:02.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:02.717+0000 7fa762026700 1 -- 172.21.15.88:0/1363082611 wait complete. 2024-09-13T21:52:02.720 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2024-09-13T21:52:03.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-13T21:52:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:03 smithi116 ceph-mon[65231]: pgmap v274: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:03.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:03 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1363082611' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T21:52:03.597 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:03.662 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:03 smithi088 ceph-mon[86843]: pgmap v274: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:03.662 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:03 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1363082611' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T21:52:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.422+0000 7f5987ac5700 1 -- 172.21.15.88:0/1407200911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980106320 msgr2=0x7f59801066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.422+0000 7f5987ac5700 1 --2- 172.21.15.88:0/1407200911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980106320 0x7f59801066f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f597c009910 tx=0x7f597c009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.422+0000 7f5987ac5700 1 -- 172.21.15.88:0/1407200911 shutdown_connections 2024-09-13T21:52:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.422+0000 7f5987ac5700 1 --2- 172.21.15.88:0/1407200911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980068540 0x7f59800689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.422+0000 7f5987ac5700 1 --2- 172.21.15.88:0/1407200911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980106320 0x7f59801066f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.422+0000 7f5987ac5700 1 -- 172.21.15.88:0/1407200911 >> 172.21.15.88:0/1407200911 conn(0x7f5980075130 msgr2=0x7f5980075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:05.425 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:05 smithi088 ceph-mon[86843]: pgmap v275: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.422+0000 7f5987ac5700 1 -- 172.21.15.88:0/1407200911 shutdown_connections 2024-09-13T21:52:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.422+0000 7f5987ac5700 1 -- 172.21.15.88:0/1407200911 wait complete. 2024-09-13T21:52:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5987ac5700 1 Processor -- start 2024-09-13T21:52:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5987ac5700 1 -- start start 2024-09-13T21:52:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5987ac5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980068540 0x7f59800ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:05.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5987ac5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980106320 0x7f59801001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5987ac5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980100720 con 0x7f5980068540 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5987ac5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980100860 con 0x7f5980106320 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5985861700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980068540 0x7f59800ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5985861700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980068540 0x7f59800ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44198/0 (socket says 172.21.15.88:44198) 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5985861700 1 -- 172.21.15.88:0/414992757 learned_addr learned my addr 172.21.15.88:0/414992757 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5985060700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980106320 0x7f59801001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5985861700 1 -- 172.21.15.88:0/414992757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980106320 msgr2=0x7f59801001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5985861700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980106320 0x7f59801001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.423+0000 7f5985861700 1 -- 172.21.15.88:0/414992757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0095f0 con 0x7f5980068540 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.424+0000 7f5985861700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980068540 0x7f59800ffca0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f597c006010 tx=0x7f597c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.424+0000 7f5976ffd700 1 -- 172.21.15.88:0/414992757 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f597c01d070 con 0x7f5980068540 2024-09-13T21:52:05.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.424+0000 7f5976ffd700 1 -- 172.21.15.88:0/414992757 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f597c00f460 con 0x7f5980068540 2024-09-13T21:52:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.424+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5980100ae0 con 0x7f5980068540 2024-09-13T21:52:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.424+0000 7f5976ffd700 1 -- 172.21.15.88:0/414992757 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f597c017610 con 0x7f5980068540 2024-09-13T21:52:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.424+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59801a2440 con 0x7f5980068540 2024-09-13T21:52:05.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.425+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5980108770 con 0x7f5980068540 2024-09-13T21:52:05.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.426+0000 7f5976ffd700 1 -- 172.21.15.88:0/414992757 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f597c00f5d0 con 0x7f5980068540 2024-09-13T21:52:05.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.426+0000 7f5976ffd700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f596c06e680 0x7f596c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:05.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.426+0000 7f5976ffd700 1 -- 172.21.15.88:0/414992757 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f597c08fcc0 con 0x7f5980068540 2024-09-13T21:52:05.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.426+0000 7f5985060700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f596c06e680 0x7f596c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:05.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.426+0000 7f5985060700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f596c06e680 0x7f596c070b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5980101490 tx=0x7f5970009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:05.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.431+0000 7f5976ffd700 1 -- 172.21.15.88:0/414992757 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f597c058d90 con 0x7f5980068540 2024-09-13T21:52:05.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:05 smithi116 ceph-mon[65231]: pgmap v275: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:05.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.677+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f598002cc30 con 0x7f5980068540 2024-09-13T21:52:05.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.677+0000 7f5976ffd700 1 -- 172.21.15.88:0/414992757 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v38) v1 ==== 107+0+3332 (secure 0 0 0) 0x7f597c05c450 con 0x7f5980068540 2024-09-13T21:52:05.679 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:05.679 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":21,"btime":"2024-09-13T21:48:47:899028+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1678889304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1678889304},{"type":"v1","addr":"172.21.15.88:6827","nonce":1678889304}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:05.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.679+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f596c06e680 msgr2=0x7f596c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:05.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.679+0000 7f5987ac5700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f596c06e680 0x7f596c070b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5980101490 tx=0x7f5970009190 comp rx=0 tx=0).stop 2024-09-13T21:52:05.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.679+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980068540 msgr2=0x7f59800ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:05.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.679+0000 7f5987ac5700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980068540 0x7f59800ffca0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f597c006010 tx=0x7f597c00bd70 comp rx=0 tx=0).stop 2024-09-13T21:52:05.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.680+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 shutdown_connections 2024-09-13T21:52:05.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.680+0000 7f5987ac5700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f596c06e680 0x7f596c070b30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:05.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.680+0000 7f5987ac5700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5980068540 0x7f59800ffca0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:05.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.680+0000 7f5987ac5700 1 --2- 172.21.15.88:0/414992757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980106320 0x7f59801001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:05.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.680+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 >> 172.21.15.88:0/414992757 conn(0x7f5980075130 msgr2=0x7f59800febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:05.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.680+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 shutdown_connections 2024-09-13T21:52:05.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:05.680+0000 7f5987ac5700 1 -- 172.21.15.88:0/414992757 wait complete. 2024-09-13T21:52:05.682 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 21 2024-09-13T21:52:06.430 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:06.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-13T21:52:06.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:06 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/414992757' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T21:52:06.629 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:06.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:06 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/414992757' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T21:52:07.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:07 smithi088 ceph-mon[86843]: pgmap v276: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:07.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:07 smithi116 ceph-mon[65231]: pgmap v276: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:08.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.352+0000 7f4c62300700 1 -- 172.21.15.88:0/2866880775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ffd60 msgr2=0x7f4c5c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:08.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.352+0000 7f4c62300700 1 --2- 172.21.15.88:0/2866880775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ffd60 0x7f4c5c103d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009910 tx=0x7f4c50009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:08.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.352+0000 7f4c62300700 1 -- 172.21.15.88:0/2866880775 shutdown_connections 2024-09-13T21:52:08.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.352+0000 7f4c62300700 1 --2- 172.21.15.88:0/2866880775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ffd60 0x7f4c5c103d30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:08.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.352+0000 7f4c62300700 1 --2- 172.21.15.88:0/2866880775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c5c0ff3c0 0x7f4c5c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:08.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.352+0000 7f4c62300700 1 -- 172.21.15.88:0/2866880775 >> 172.21.15.88:0/2866880775 conn(0x7f4c5c0fac60 msgr2=0x7f4c5c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:08.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.353+0000 7f4c62300700 1 -- 172.21.15.88:0/2866880775 shutdown_connections 2024-09-13T21:52:08.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.353+0000 7f4c62300700 1 -- 172.21.15.88:0/2866880775 wait complete. 2024-09-13T21:52:08.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.353+0000 7f4c62300700 1 Processor -- start 2024-09-13T21:52:08.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.353+0000 7f4c62300700 1 -- start start 2024-09-13T21:52:08.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c62300700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ff3c0 0x7f4c5c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:08.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c62300700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c5c0ffd60 0x7f4c5c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:08.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c62300700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c197810 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c62300700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c197950 con 0x7f4c5c0ffd60 2024-09-13T21:52:08.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c5bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ff3c0 0x7f4c5c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:08.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c5bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ff3c0 0x7f4c5c196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44214/0 (socket says 172.21.15.88:44214) 2024-09-13T21:52:08.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c5bfff700 1 -- 172.21.15.88:0/3142308119 learned_addr learned my addr 172.21.15.88:0/3142308119 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:08.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c5b7fe700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c5c0ffd60 0x7f4c5c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:08.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c5bfff700 1 -- 172.21.15.88:0/3142308119 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c5c0ffd60 msgr2=0x7f4c5c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:08.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c5bfff700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c5c0ffd60 0x7f4c5c197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:08.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c5bfff700 1 -- 172.21.15.88:0/3142308119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500095f0 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.354+0000 7f4c5b7fe700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c5c0ffd60 0x7f4c5c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:52:08.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.355+0000 7f4c5bfff700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ff3c0 0x7f4c5c196d00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00d8d0 tx=0x7f4c4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:08.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.355+0000 7f4c597fa700 1 -- 172.21.15.88:0/3142308119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c4c009940 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.355+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c19fd70 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.355+0000 7f4c597fa700 1 -- 172.21.15.88:0/3142308119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c4c010460 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.355+0000 7f4c597fa700 1 -- 172.21.15.88:0/3142308119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c4c00f5f0 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.355+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c1a01e0 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.356+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c107730 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.357+0000 7f4c597fa700 1 -- 172.21.15.88:0/3142308119 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4c4c00f870 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.357+0000 7f4c597fa700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4c4406e680 0x7f4c44070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:08.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.358+0000 7f4c597fa700 1 -- 172.21.15.88:0/3142308119 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f4c4c08e780 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.358+0000 7f4c5b7fe700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4c4406e680 0x7f4c44070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:08.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.358+0000 7f4c5b7fe700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4c4406e680 0x7f4c44070b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c069630 tx=0x7f4c5001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:08.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.362+0000 7f4c597fa700 1 -- 172.21.15.88:0/3142308119 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4c4c0578c0 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.607+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f4c5c069480 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.608+0000 7f4c597fa700 1 -- 172.21.15.88:0/3142308119 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v38) v1 ==== 107+0+4890 (secure 0 0 0) 0x7f4c4c05af80 con 0x7f4c5c0ff3c0 2024-09-13T21:52:08.609 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:08.610 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"btime":"2024-09-13T21:48:48:900451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1678889304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1678889304},{"type":"v1","addr":"172.21.15.88:6827","nonce":1678889304}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34376,"name":"cephfs.smithi088.vqfqko","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/882006655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":882006655},{"type":"v1","addr":"172.21.15.88:6829","nonce":882006655}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44293,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/1529923452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1529923452},{"type":"v1","addr":"172.21.15.116:6825","nonce":1529923452}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4c4406e680 msgr2=0x7f4c44070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4c4406e680 0x7f4c44070b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c069630 tx=0x7f4c5001a040 comp rx=0 tx=0).stop 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ff3c0 msgr2=0x7f4c5c196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ff3c0 0x7f4c5c196d00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00d8d0 tx=0x7f4c4c00dc90 comp rx=0 tx=0).stop 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 shutdown_connections 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f4c4406e680 0x7f4c44070b30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c5c0ff3c0 0x7f4c5c196d00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 --2- 172.21.15.88:0/3142308119 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c5c0ffd60 0x7f4c5c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 >> 172.21.15.88:0/3142308119 conn(0x7f4c5c0fac60 msgr2=0x7f4c5c0fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 shutdown_connections 2024-09-13T21:52:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:08.610+0000 7f4c62300700 1 -- 172.21.15.88:0/3142308119 wait complete. 2024-09-13T21:52:08.613 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 22 2024-09-13T21:52:09.322 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:09.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-13T21:52:09.523 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:09.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:09 smithi116 ceph-mon[65231]: pgmap v277: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:09.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:09 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3142308119' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T21:52:09.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:09 smithi088 ceph-mon[86843]: pgmap v277: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:09.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:09 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3142308119' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T21:52:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.150+0000 7fb427296700 1 -- 172.21.15.88:0/3241991368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb420100df0 msgr2=0x7fb420109550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.150+0000 7fb427296700 1 --2- 172.21.15.88:0/3241991368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb420100df0 0x7fb420109550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009940 tx=0x7fb41c009c50 comp rx=0 tx=0).stop 2024-09-13T21:52:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.150+0000 7fb427296700 1 -- 172.21.15.88:0/3241991368 shutdown_connections 2024-09-13T21:52:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.150+0000 7fb427296700 1 --2- 172.21.15.88:0/3241991368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb420100df0 0x7fb420109550 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.150+0000 7fb427296700 1 --2- 172.21.15.88:0/3241991368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4201004e0 0x7fb4201008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.151+0000 7fb427296700 1 -- 172.21.15.88:0/3241991368 >> 172.21.15.88:0/3241991368 conn(0x7fb420074930 msgr2=0x7fb420074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.151+0000 7fb427296700 1 -- 172.21.15.88:0/3241991368 shutdown_connections 2024-09-13T21:52:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.151+0000 7fb427296700 1 -- 172.21.15.88:0/3241991368 wait complete. 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.151+0000 7fb427296700 1 Processor -- start 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.151+0000 7fb427296700 1 -- start start 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb427296700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4201004e0 0x7fb420196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb427296700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb420100df0 0x7fb4201971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb427296700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb420197750 con 0x7fb4201004e0 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb427296700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb420197890 con 0x7fb420100df0 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb425032700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4201004e0 0x7fb420196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb425032700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4201004e0 0x7fb420196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37044/0 (socket says 172.21.15.88:37044) 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb425032700 1 -- 172.21.15.88:0/2111018650 learned_addr learned my addr 172.21.15.88:0/2111018650 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb424831700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb420100df0 0x7fb4201971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb425032700 1 -- 172.21.15.88:0/2111018650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb420100df0 msgr2=0x7fb4201971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb425032700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb420100df0 0x7fb4201971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb425032700 1 -- 172.21.15.88:0/2111018650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c0095f0 con 0x7fb4201004e0 2024-09-13T21:52:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb425032700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4201004e0 0x7fb420196c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c930 tx=0x7fb41400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb4127fc700 1 -- 172.21.15.88:0/2111018650 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb414007ad0 con 0x7fb4201004e0 2024-09-13T21:52:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb4127fc700 1 -- 172.21.15.88:0/2111018650 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb414007c30 con 0x7fb4201004e0 2024-09-13T21:52:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42019fcf0 con 0x7fb4201004e0 2024-09-13T21:52:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb4127fc700 1 -- 172.21.15.88:0/2111018650 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb414018610 con 0x7fb4201004e0 2024-09-13T21:52:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.152+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4201a0100 con 0x7fb4201004e0 2024-09-13T21:52:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.153+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb420106c50 con 0x7fb4201004e0 2024-09-13T21:52:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.154+0000 7fb4127fc700 1 -- 172.21.15.88:0/2111018650 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb41400f450 con 0x7fb4201004e0 2024-09-13T21:52:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.154+0000 7fb4127fc700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb40c06e680 0x7fb40c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.154+0000 7fb4127fc700 1 -- 172.21.15.88:0/2111018650 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb41408e950 con 0x7fb4201004e0 2024-09-13T21:52:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.154+0000 7fb424831700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb40c06e680 0x7fb40c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:11.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.155+0000 7fb424831700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb40c06e680 0x7fb40c070b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009910 tx=0x7fb41c005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.159+0000 7fb4127fc700 1 -- 172.21.15.88:0/2111018650 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb414057a20 con 0x7fb4201004e0 2024-09-13T21:52:11.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.408+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fb420106630 con 0x7fb4201004e0 2024-09-13T21:52:11.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.408+0000 7fb4127fc700 1 -- 172.21.15.88:0/2111018650 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v38) v1 ==== 107+0+4111 (secure 0 0 0) 0x7fb41405b0e0 con 0x7fb4201004e0 2024-09-13T21:52:11.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:11.411 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"btime":"2024-09-13T21:48:51:709015+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34376,"name":"cephfs.smithi088.vqfqko","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/882006655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":882006655},{"type":"v1","addr":"172.21.15.88:6829","nonce":882006655}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44293,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/1529923452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1529923452},{"type":"v1","addr":"172.21.15.116:6825","nonce":1529923452}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb40c06e680 msgr2=0x7fb40c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb40c06e680 0x7fb40c070b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009910 tx=0x7fb41c005ab0 comp rx=0 tx=0).stop 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4201004e0 msgr2=0x7fb420196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4201004e0 0x7fb420196c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c930 tx=0x7fb41400ccf0 comp rx=0 tx=0).stop 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 shutdown_connections 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fb40c06e680 0x7fb40c070b30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4201004e0 0x7fb420196c80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 --2- 172.21.15.88:0/2111018650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb420100df0 0x7fb4201971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 >> 172.21.15.88:0/2111018650 conn(0x7fb420074930 msgr2=0x7fb420103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 shutdown_connections 2024-09-13T21:52:11.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:11.410+0000 7fb427296700 1 -- 172.21.15.88:0/2111018650 wait complete. 2024-09-13T21:52:11.414 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 23 2024-09-13T21:52:11.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:11 smithi116 ceph-mon[65231]: pgmap v278: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:11.723 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:11 smithi088 ceph-mon[86843]: pgmap v278: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:12.035 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:12.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-13T21:52:12.246 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:12.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:12 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2111018650' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T21:52:12.616 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:12 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2111018650' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T21:52:13.530 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:13 smithi088 ceph-mon[86843]: pgmap v279: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:13.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:13 smithi116 ceph-mon[65231]: pgmap v279: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.808+0000 7f3bbadc0700 1 -- 172.21.15.88:0/3533481446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101d30 msgr2=0x7f3bb410a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.808+0000 7f3bbadc0700 1 --2- 172.21.15.88:0/3533481446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101d30 0x7f3bb410a230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0009910 tx=0x7f3ba0009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.808+0000 7f3bbadc0700 1 -- 172.21.15.88:0/3533481446 shutdown_connections 2024-09-13T21:52:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.808+0000 7f3bbadc0700 1 --2- 172.21.15.88:0/3533481446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101d30 0x7f3bb410a230 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.808+0000 7f3bbadc0700 1 --2- 172.21.15.88:0/3533481446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb4101420 0x7f3bb41017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.808+0000 7f3bbadc0700 1 -- 172.21.15.88:0/3533481446 >> 172.21.15.88:0/3533481446 conn(0x7f3bb40fac80 msgr2=0x7f3bb40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.808+0000 7f3bbadc0700 1 -- 172.21.15.88:0/3533481446 shutdown_connections 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.808+0000 7f3bbadc0700 1 -- 172.21.15.88:0/3533481446 wait complete. 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.808+0000 7f3bbadc0700 1 Processor -- start 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bbadc0700 1 -- start start 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bbadc0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101420 0x7f3bb4195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bbadc0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb4101d30 0x7f3bb4196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bbadc0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4196c10 con 0x7f3bb4101420 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bbadc0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb419a9a0 con 0x7f3bb4101d30 2024-09-13T21:52:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bb8b5c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101420 0x7f3bb4195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bb8b5c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101420 0x7f3bb4195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37062/0 (socket says 172.21.15.88:37062) 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bb8b5c700 1 -- 172.21.15.88:0/2450111499 learned_addr learned my addr 172.21.15.88:0/2450111499 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bb3fff700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb4101d30 0x7f3bb4196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bb8b5c700 1 -- 172.21.15.88:0/2450111499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb4101d30 msgr2=0x7f3bb4196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bb8b5c700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb4101d30 0x7f3bb4196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bb8b5c700 1 -- 172.21.15.88:0/2450111499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba00095f0 con 0x7f3bb4101420 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bb8b5c700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101420 0x7f3bb4195ff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b4b0 tx=0x7f3ba800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.809+0000 7f3bb1ffb700 1 -- 172.21.15.88:0/2450111499 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba8011800 con 0x7f3bb4101420 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.810+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb419ac80 con 0x7f3bb4101420 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.810+0000 7f3bb1ffb700 1 -- 172.21.15.88:0/2450111499 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ba8011e20 con 0x7f3bb4101420 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.810+0000 7f3bb1ffb700 1 -- 172.21.15.88:0/2450111499 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba800f2e0 con 0x7f3bb4101420 2024-09-13T21:52:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.810+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb419b1d0 con 0x7f3bb4101420 2024-09-13T21:52:13.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.811+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb41078a0 con 0x7f3bb4101420 2024-09-13T21:52:13.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.811+0000 7f3bb1ffb700 1 -- 172.21.15.88:0/2450111499 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3ba8010380 con 0x7f3bb4101420 2024-09-13T21:52:13.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.811+0000 7f3bb1ffb700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ba406e680 0x7f3ba4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:13.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.812+0000 7f3bb1ffb700 1 -- 172.21.15.88:0/2450111499 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f3ba808e300 con 0x7f3bb4101420 2024-09-13T21:52:13.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.812+0000 7f3bb3fff700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ba406e680 0x7f3ba4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:13.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.812+0000 7f3bb3fff700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ba406e680 0x7f3ba4070b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00059d0 tx=0x7f3ba001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:13.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:13.816+0000 7f3bb1ffb700 1 -- 172.21.15.88:0/2450111499 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3ba80573d0 con 0x7f3bb4101420 2024-09-13T21:52:14.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.063+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f3bb404f2a0 con 0x7f3bb4101420 2024-09-13T21:52:14.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.064+0000 7f3bb1ffb700 1 -- 172.21.15.88:0/2450111499 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v38) v1 ==== 107+0+4958 (secure 0 0 0) 0x7f3ba805aa90 con 0x7f3bb4101420 2024-09-13T21:52:14.065 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:14.065 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"btime":"2024-09-13T21:48:55:359899+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34376,"name":"cephfs.smithi088.vqfqko","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/882006655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":882006655},{"type":"v1","addr":"172.21.15.88:6829","nonce":882006655}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44293,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/1529923452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1529923452},{"type":"v1","addr":"172.21.15.116:6825","nonce":1529923452}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:14.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ba406e680 msgr2=0x7f3ba4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:14.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ba406e680 0x7f3ba4070b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00059d0 tx=0x7f3ba001a040 comp rx=0 tx=0).stop 2024-09-13T21:52:14.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101420 msgr2=0x7f3bb4195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:14.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101420 0x7f3bb4195ff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b4b0 tx=0x7f3ba800b870 comp rx=0 tx=0).stop 2024-09-13T21:52:14.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 shutdown_connections 2024-09-13T21:52:14.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f3ba406e680 0x7f3ba4070b30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:14.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb4101420 0x7f3bb4195ff0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:14.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 --2- 172.21.15.88:0/2450111499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb4101d30 0x7f3bb4196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:14.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 >> 172.21.15.88:0/2450111499 conn(0x7f3bb40fac80 msgr2=0x7f3bb41049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:14.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 shutdown_connections 2024-09-13T21:52:14.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:14.066+0000 7f3bbadc0700 1 -- 172.21.15.88:0/2450111499 wait complete. 2024-09-13T21:52:14.069 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 24 2024-09-13T21:52:14.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:14 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2450111499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T21:52:14.728 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:14 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2450111499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T21:52:14.749 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:14.749 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-13T21:52:14.948 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:15.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:15 smithi116 ceph-mon[65231]: pgmap v280: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:15.732 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:15 smithi088 ceph-mon[86843]: pgmap v280: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.639+0000 7f0593c14700 1 -- 172.21.15.88:0/4219741050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ffc60 msgr2=0x7f058c10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.639+0000 7f0593c14700 1 --2- 172.21.15.88:0/4219741050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ffc60 0x7f058c10a6d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f057c009910 tx=0x7f057c009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.639+0000 7f0593c14700 1 -- 172.21.15.88:0/4219741050 shutdown_connections 2024-09-13T21:52:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.639+0000 7f0593c14700 1 --2- 172.21.15.88:0/4219741050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ffc60 0x7f058c10a6d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.639+0000 7f0593c14700 1 --2- 172.21.15.88:0/4219741050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f058c0ff350 0x7f058c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.639+0000 7f0593c14700 1 -- 172.21.15.88:0/4219741050 >> 172.21.15.88:0/4219741050 conn(0x7f058c0748b0 msgr2=0x7f058c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.639+0000 7f0593c14700 1 -- 172.21.15.88:0/4219741050 shutdown_connections 2024-09-13T21:52:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.639+0000 7f0593c14700 1 -- 172.21.15.88:0/4219741050 wait complete. 2024-09-13T21:52:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f0593c14700 1 Processor -- start 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f0593c14700 1 -- start start 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f0593c14700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ff350 0x7f058c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f0593c14700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f058c0ffc60 0x7f058c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f0593c14700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c198ca0 con 0x7f058c0ff350 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f0593c14700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c19ca30 con 0x7f058c0ffc60 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f05919b0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ff350 0x7f058c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f05919b0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ff350 0x7f058c198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37092/0 (socket says 172.21.15.88:37092) 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f05919b0700 1 -- 172.21.15.88:0/158603633 learned_addr learned my addr 172.21.15.88:0/158603633 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f05911af700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f058c0ffc60 0x7f058c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f05919b0700 1 -- 172.21.15.88:0/158603633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f058c0ffc60 msgr2=0x7f058c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.640+0000 7f05919b0700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f058c0ffc60 0x7f058c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.641+0000 7f05919b0700 1 -- 172.21.15.88:0/158603633 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0095f0 con 0x7f058c0ff350 2024-09-13T21:52:16.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.641+0000 7f05919b0700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ff350 0x7f058c198080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f058800d900 tx=0x7f058800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:16.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.641+0000 7f0582ffd700 1 -- 172.21.15.88:0/158603633 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05880041f0 con 0x7f058c0ff350 2024-09-13T21:52:16.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.641+0000 7f0582ffd700 1 -- 172.21.15.88:0/158603633 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0588004350 con 0x7f058c0ff350 2024-09-13T21:52:16.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.641+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c19cd10 con 0x7f058c0ff350 2024-09-13T21:52:16.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.641+0000 7f0582ffd700 1 -- 172.21.15.88:0/158603633 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0588003cf0 con 0x7f058c0ff350 2024-09-13T21:52:16.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.641+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c19d230 con 0x7f058c0ff350 2024-09-13T21:52:16.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.642+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c10a230 con 0x7f058c0ff350 2024-09-13T21:52:16.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.642+0000 7f0582ffd700 1 -- 172.21.15.88:0/158603633 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0588009730 con 0x7f058c0ff350 2024-09-13T21:52:16.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.643+0000 7f0582ffd700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f057806e680 0x7f0578070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:16.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.643+0000 7f0582ffd700 1 -- 172.21.15.88:0/158603633 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f058808e510 con 0x7f058c0ff350 2024-09-13T21:52:16.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.643+0000 7f05911af700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f057806e680 0x7f0578070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:16.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.643+0000 7f05911af700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f057806e680 0x7f0578070b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f057c00b5c0 tx=0x7f057c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:16.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.647+0000 7f0582ffd700 1 -- 172.21.15.88:0/158603633 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0588057660 con 0x7f058c0ff350 2024-09-13T21:52:16.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.891+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f058c04f2a0 con 0x7f058c0ff350 2024-09-13T21:52:16.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.891+0000 7f0582ffd700 1 -- 172.21.15.88:0/158603633 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v38) v1 ==== 107+0+4182 (secure 0 0 0) 0x7f058805ad20 con 0x7f058c0ff350 2024-09-13T21:52:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:16.893 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":25,"btime":"2024-09-13T21:49:08:006978+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44293,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/1529923452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1529923452},{"type":"v1","addr":"172.21.15.116:6825","nonce":1529923452}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:16.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f057806e680 msgr2=0x7f0578070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:16.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f057806e680 0x7f0578070b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f057c00b5c0 tx=0x7f057c01a040 comp rx=0 tx=0).stop 2024-09-13T21:52:16.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ff350 msgr2=0x7f058c198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:16.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ff350 0x7f058c198080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f058800d900 tx=0x7f058800dc10 comp rx=0 tx=0).stop 2024-09-13T21:52:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 shutdown_connections 2024-09-13T21:52:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f057806e680 0x7f0578070b30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f058c0ff350 0x7f058c198080 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 --2- 172.21.15.88:0/158603633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f058c0ffc60 0x7f058c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 >> 172.21.15.88:0/158603633 conn(0x7f058c0748b0 msgr2=0x7f058c100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 shutdown_connections 2024-09-13T21:52:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:16.894+0000 7f0593c14700 1 -- 172.21.15.88:0/158603633 wait complete. 2024-09-13T21:52:16.896 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 25 2024-09-13T21:52:17.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:17 smithi088 ceph-mon[86843]: pgmap v281: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:17.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:17 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/158603633' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T21:52:17.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:17 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:17.535 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:17.535 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-13T21:52:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:17 smithi116 ceph-mon[65231]: pgmap v281: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:17 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/158603633' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T21:52:17.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:17 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:17.743 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:18.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:18.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:52:18.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:52:18.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:18.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:18.483 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:18 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:52:18.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:18.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:52:18.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:52:18.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:18.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:18.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:18 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' 2024-09-13T21:52:19.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.439+0000 7f72ef7d6700 1 -- 172.21.15.88:0/3128244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 msgr2=0x7f72e81008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:19.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.439+0000 7f72ef7d6700 1 --2- 172.21.15.88:0/3128244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 0x7f72e81008b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009910 tx=0x7f72e4009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:19.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.440+0000 7f72ef7d6700 1 -- 172.21.15.88:0/3128244 shutdown_connections 2024-09-13T21:52:19.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.440+0000 7f72ef7d6700 1 --2- 172.21.15.88:0/3128244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72e8100e80 0x7f72e8104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.440+0000 7f72ef7d6700 1 --2- 172.21.15.88:0/3128244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 0x7f72e81008b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.440+0000 7f72ef7d6700 1 -- 172.21.15.88:0/3128244 >> 172.21.15.88:0/3128244 conn(0x7f72e80fbda0 msgr2=0x7f72e80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:19.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.440+0000 7f72ef7d6700 1 -- 172.21.15.88:0/3128244 shutdown_connections 2024-09-13T21:52:19.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.440+0000 7f72ef7d6700 1 -- 172.21.15.88:0/3128244 wait complete. 2024-09-13T21:52:19.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.440+0000 7f72ef7d6700 1 Processor -- start 2024-09-13T21:52:19.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.440+0000 7f72ef7d6700 1 -- start start 2024-09-13T21:52:19.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ef7d6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 0x7f72e8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:19.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ef7d6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72e8100e80 0x7f72e8196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:19.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ef7d6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8196b10 con 0x7f72e81004e0 2024-09-13T21:52:19.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ef7d6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e819a8a0 con 0x7f72e8100e80 2024-09-13T21:52:19.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ed572700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 0x7f72e8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:19.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ed572700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 0x7f72e8195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37116/0 (socket says 172.21.15.88:37116) 2024-09-13T21:52:19.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ed572700 1 -- 172.21.15.88:0/557210713 learned_addr learned my addr 172.21.15.88:0/557210713 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:19.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ecd71700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72e8100e80 0x7f72e8196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:19.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ed572700 1 -- 172.21.15.88:0/557210713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72e8100e80 msgr2=0x7f72e8196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:19.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ed572700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72e8100e80 0x7f72e8196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ed572700 1 -- 172.21.15.88:0/557210713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e40095f0 con 0x7f72e81004e0 2024-09-13T21:52:19.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ed572700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 0x7f72e8195ef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006010 tx=0x7f72e400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:19.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72de7fc700 1 -- 172.21.15.88:0/557210713 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e401d070 con 0x7f72e81004e0 2024-09-13T21:52:19.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72de7fc700 1 -- 172.21.15.88:0/557210713 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72e4005dc0 con 0x7f72e81004e0 2024-09-13T21:52:19.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e819ab20 con 0x7f72e81004e0 2024-09-13T21:52:19.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72de7fc700 1 -- 172.21.15.88:0/557210713 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e4017400 con 0x7f72e81004e0 2024-09-13T21:52:19.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.441+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e819b010 con 0x7f72e81004e0 2024-09-13T21:52:19.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.442+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e81087f0 con 0x7f72e81004e0 2024-09-13T21:52:19.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.443+0000 7f72de7fc700 1 -- 172.21.15.88:0/557210713 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f72e4003a60 con 0x7f72e81004e0 2024-09-13T21:52:19.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.443+0000 7f72de7fc700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f72d406e680 0x7f72d4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:19.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.443+0000 7f72de7fc700 1 -- 172.21.15.88:0/557210713 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f72e408fc50 con 0x7f72e81004e0 2024-09-13T21:52:19.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.443+0000 7f72ecd71700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f72d406e680 0x7f72d4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:19.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.444+0000 7f72ecd71700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f72d406e680 0x7f72d4070b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72e8197510 tx=0x7f72d800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:19.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.448+0000 7f72de7fc700 1 -- 172.21.15.88:0/557210713 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f72e4058c80 con 0x7f72e81004e0 2024-09-13T21:52:19.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:19 smithi088 ceph-mon[86843]: pgmap v282: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:19.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:19 smithi116 ceph-mon[65231]: pgmap v282: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:19.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.693+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f72e804f2a0 con 0x7f72e81004e0 2024-09-13T21:52:19.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.694+0000 7f72de7fc700 1 -- 172.21.15.88:0/557210713 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v38) v1 ==== 107+0+5029 (secure 0 0 0) 0x7f72e405c340 con 0x7f72e81004e0 2024-09-13T21:52:19.697 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:19.697 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"btime":"2024-09-13T21:49:14:197916+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44293,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/1529923452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1529923452},{"type":"v1","addr":"172.21.15.116:6825","nonce":1529923452}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f72d406e680 msgr2=0x7f72d4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f72d406e680 0x7f72d4070b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72e8197510 tx=0x7f72d800b410 comp rx=0 tx=0).stop 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 msgr2=0x7f72e8195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 0x7f72e8195ef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006010 tx=0x7f72e400bd70 comp rx=0 tx=0).stop 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 shutdown_connections 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f72d406e680 0x7f72d4070b30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72e81004e0 0x7f72e8195ef0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 --2- 172.21.15.88:0/557210713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72e8100e80 0x7f72e8196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 >> 172.21.15.88:0/557210713 conn(0x7f72e80fbda0 msgr2=0x7f72e80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 shutdown_connections 2024-09-13T21:52:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:19.696+0000 7f72ef7d6700 1 -- 172.21.15.88:0/557210713 wait complete. 2024-09-13T21:52:19.699 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 26 2024-09-13T21:52:20.331 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:20.331 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-13T21:52:20.535 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:20.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:20 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/557210713' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T21:52:20.656 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:20 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/557210713' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T21:52:21.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:21 smithi088 ceph-mon[86843]: pgmap v283: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:21.662 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:21 smithi116 ceph-mon[65231]: pgmap v283: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:22.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.129+0000 7feefde2b700 1 -- 172.21.15.88:0/4013423130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 msgr2=0x7feef8104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:22.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.129+0000 7feefde2b700 1 --2- 172.21.15.88:0/4013423130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 0x7feef8104ea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feeec009910 tx=0x7feeec009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:22.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.129+0000 7feefde2b700 1 -- 172.21.15.88:0/4013423130 shutdown_connections 2024-09-13T21:52:22.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.129+0000 7feefde2b700 1 --2- 172.21.15.88:0/4013423130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 0x7feef8104ea0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:22.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.129+0000 7feefde2b700 1 --2- 172.21.15.88:0/4013423130 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8100530 0x7feef8100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:22.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.129+0000 7feefde2b700 1 -- 172.21.15.88:0/4013423130 >> 172.21.15.88:0/4013423130 conn(0x7feef80fbe10 msgr2=0x7feef80fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:22.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.129+0000 7feefde2b700 1 -- 172.21.15.88:0/4013423130 shutdown_connections 2024-09-13T21:52:22.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.129+0000 7feefde2b700 1 -- 172.21.15.88:0/4013423130 wait complete. 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.130+0000 7feefde2b700 1 Processor -- start 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.130+0000 7feefde2b700 1 -- start start 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.130+0000 7feefde2b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8100530 0x7feef8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.130+0000 7feefde2b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 0x7feef8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.130+0000 7feefde2b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8073ad0 con 0x7feef8100ed0 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.130+0000 7feefde2b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8073c10 con 0x7feef8100530 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.130+0000 7feef6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 0x7feef8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 0x7feef8073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40734/0 (socket says 172.21.15.88:40734) 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef6ffd700 1 -- 172.21.15.88:0/1964021745 learned_addr learned my addr 172.21.15.88:0/1964021745 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef77fe700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8100530 0x7feef8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef6ffd700 1 -- 172.21.15.88:0/1964021745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8100530 msgr2=0x7feef8073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:22.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef6ffd700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8100530 0x7feef8073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:22.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef6ffd700 1 -- 172.21.15.88:0/1964021745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0095f0 con 0x7feef8100ed0 2024-09-13T21:52:22.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef6ffd700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 0x7feef8073590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feeec0092e0 tx=0x7feeec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:22.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef4ff9700 1 -- 172.21.15.88:0/1964021745 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeec01d070 con 0x7feef8100ed0 2024-09-13T21:52:22.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef4ff9700 1 -- 172.21.15.88:0/1964021745 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feeec005dc0 con 0x7feef8100ed0 2024-09-13T21:52:22.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef8073e90 con 0x7feef8100ed0 2024-09-13T21:52:22.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feef4ff9700 1 -- 172.21.15.88:0/1964021745 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeec017400 con 0x7feef8100ed0 2024-09-13T21:52:22.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.131+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef81a23f0 con 0x7feef8100ed0 2024-09-13T21:52:22.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.132+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef81088a0 con 0x7feef8100ed0 2024-09-13T21:52:22.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.133+0000 7feef4ff9700 1 -- 172.21.15.88:0/1964021745 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7feeec00f6f0 con 0x7feef8100ed0 2024-09-13T21:52:22.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.133+0000 7feef4ff9700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feee006e680 0x7feee0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:22.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.134+0000 7feef4ff9700 1 -- 172.21.15.88:0/1964021745 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7feeec08fd80 con 0x7feef8100ed0 2024-09-13T21:52:22.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.134+0000 7feef77fe700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feee006e680 0x7feee0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:22.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.134+0000 7feef77fe700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feee006e680 0x7feee0070b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feee8005950 tx=0x7feee800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:22.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.137+0000 7feef4ff9700 1 -- 172.21.15.88:0/1964021745 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feeec058e30 con 0x7feef8100ed0 2024-09-13T21:52:22.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.406+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7feef804f2a0 con 0x7feef8100ed0 2024-09-13T21:52:22.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.407+0000 7feef4ff9700 1 -- 172.21.15.88:0/1964021745 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v38) v1 ==== 107+0+4247 (secure 0 0 0) 0x7feeec05c4f0 con 0x7feef8100ed0 2024-09-13T21:52:22.409 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:22.409 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"btime":"2024-09-13T21:49:25:894626+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feee006e680 msgr2=0x7feee0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feee006e680 0x7feee0070b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feee8005950 tx=0x7feee800b410 comp rx=0 tx=0).stop 2024-09-13T21:52:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 msgr2=0x7feef8073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 0x7feef8073590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feeec0092e0 tx=0x7feeec00bd70 comp rx=0 tx=0).stop 2024-09-13T21:52:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 shutdown_connections 2024-09-13T21:52:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7feee006e680 0x7feee0070b30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8100530 0x7feef8073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 --2- 172.21.15.88:0/1964021745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feef8100ed0 0x7feef8073590 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 >> 172.21.15.88:0/1964021745 conn(0x7feef80fbe10 msgr2=0x7feef80fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 shutdown_connections 2024-09-13T21:52:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:22.409+0000 7feefde2b700 1 -- 172.21.15.88:0/1964021745 wait complete. 2024-09-13T21:52:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 27 2024-09-13T21:52:23.027 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:23.028 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-13T21:52:23.228 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:23.600 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:23 smithi088 ceph-mon[86843]: pgmap v284: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:23.600 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:23 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1964021745' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T21:52:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:23 smithi116 ceph-mon[65231]: pgmap v284: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:23.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:23 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1964021745' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T21:52:24.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:24 smithi088 ceph-mon[86843]: pgmap v285: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:24.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.784+0000 7f5ede006700 1 -- 172.21.15.88:0/1763839498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed80ffbd0 msgr2=0x7f5ed8100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:24.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.784+0000 7f5ede006700 1 --2- 172.21.15.88:0/1763839498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed80ffbd0 0x7f5ed8100040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009910 tx=0x7f5ecc009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:24.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.784+0000 7f5ede006700 1 -- 172.21.15.88:0/1763839498 shutdown_connections 2024-09-13T21:52:24.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.784+0000 7f5ede006700 1 --2- 172.21.15.88:0/1763839498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed80ffbd0 0x7f5ed8100040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:24.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.784+0000 7f5ede006700 1 --2- 172.21.15.88:0/1763839498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ed8104130 0x7f5ed8104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:24.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.784+0000 7f5ede006700 1 -- 172.21.15.88:0/1763839498 >> 172.21.15.88:0/1763839498 conn(0x7f5ed8075130 msgr2=0x7f5ed8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:24.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.784+0000 7f5ede006700 1 -- 172.21.15.88:0/1763839498 shutdown_connections 2024-09-13T21:52:24.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.784+0000 7f5ede006700 1 -- 172.21.15.88:0/1763839498 wait complete. 2024-09-13T21:52:24.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.785+0000 7f5ede006700 1 Processor -- start 2024-09-13T21:52:24.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.785+0000 7f5ede006700 1 -- start start 2024-09-13T21:52:24.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.785+0000 7f5ede006700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ed80ffbd0 0x7f5ed8195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:24.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.785+0000 7f5ede006700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed8104130 0x7f5ed8196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.785+0000 7f5ede006700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8196a70 con 0x7f5ed8104130 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.785+0000 7f5ede006700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed819a800 con 0x7f5ed80ffbd0 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed8104130 0x7f5ed8196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed8104130 0x7f5ed8196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40750/0 (socket says 172.21.15.88:40750) 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed6ffd700 1 -- 172.21.15.88:0/2424908586 learned_addr learned my addr 172.21.15.88:0/2424908586 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed77fe700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ed80ffbd0 0x7f5ed8195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed6ffd700 1 -- 172.21.15.88:0/2424908586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ed80ffbd0 msgr2=0x7f5ed8195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed6ffd700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ed80ffbd0 0x7f5ed8195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed6ffd700 1 -- 172.21.15.88:0/2424908586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc0095f0 con 0x7f5ed8104130 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed6ffd700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed8104130 0x7f5ed8196390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00bd70 tx=0x7f5ecc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed4ff9700 1 -- 172.21.15.88:0/2424908586 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ecc01d070 con 0x7f5ed8104130 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed819aa80 con 0x7f5ed8104130 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed4ff9700 1 -- 172.21.15.88:0/2424908586 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ecc005dc0 con 0x7f5ed8104130 2024-09-13T21:52:24.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ed4ff9700 1 -- 172.21.15.88:0/2424908586 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ecc017400 con 0x7f5ed8104130 2024-09-13T21:52:24.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.786+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed819af70 con 0x7f5ed8104130 2024-09-13T21:52:24.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.787+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed81086a0 con 0x7f5ed8104130 2024-09-13T21:52:24.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.788+0000 7f5ed4ff9700 1 -- 172.21.15.88:0/2424908586 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5ecc00f460 con 0x7f5ed8104130 2024-09-13T21:52:24.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.788+0000 7f5ed4ff9700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ec006e680 0x7f5ec0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:24.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.788+0000 7f5ed4ff9700 1 -- 172.21.15.88:0/2424908586 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f5ecc08fbb0 con 0x7f5ed8104130 2024-09-13T21:52:24.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.788+0000 7f5ed77fe700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ec006e680 0x7f5ec0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:24.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.789+0000 7f5ed77fe700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ec006e680 0x7f5ec0070b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8005950 tx=0x7f5ec800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:24.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:24.793+0000 7f5ed4ff9700 1 -- 172.21.15.88:0/2424908586 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5ecc096080 con 0x7f5ed8104130 2024-09-13T21:52:24.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:24 smithi116 ceph-mon[65231]: pgmap v285: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:25.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.036+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f5ed802cc30 con 0x7f5ed8104130 2024-09-13T21:52:25.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.037+0000 7f5ed4ff9700 1 -- 172.21.15.88:0/2424908586 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v38) v1 ==== 107+0+5094 (secure 0 0 0) 0x7f5ecc058d40 con 0x7f5ed8104130 2024-09-13T21:52:25.039 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:25.039 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":28,"btime":"2024-09-13T21:49:30:199861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.116:6827/79599615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":79599615},{"type":"v1","addr":"172.21.15.116:6827","nonce":79599615}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:25.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ec006e680 msgr2=0x7f5ec0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:25.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ec006e680 0x7f5ec0070b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8005950 tx=0x7f5ec800b410 comp rx=0 tx=0).stop 2024-09-13T21:52:25.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed8104130 msgr2=0x7f5ed8196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:25.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed8104130 0x7f5ed8196390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00bd70 tx=0x7f5ecc00bda0 comp rx=0 tx=0).stop 2024-09-13T21:52:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 shutdown_connections 2024-09-13T21:52:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5ec006e680 0x7f5ec0070b30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ed80ffbd0 0x7f5ed8195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 --2- 172.21.15.88:0/2424908586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed8104130 0x7f5ed8196390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 >> 172.21.15.88:0/2424908586 conn(0x7f5ed8075130 msgr2=0x7f5ed80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 shutdown_connections 2024-09-13T21:52:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:25.040+0000 7f5ede006700 1 -- 172.21.15.88:0/2424908586 wait complete. 2024-09-13T21:52:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 28 2024-09-13T21:52:25.669 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:25 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2424908586' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T21:52:25.691 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:25.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-13T21:52:25.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:25 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2424908586' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T21:52:25.893 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:26.717 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:26 smithi088 ceph-mon[86843]: pgmap v286: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:26.740 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:26 smithi116 ceph-mon[65231]: pgmap v286: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:27.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.525+0000 7ff64230f700 1 -- 172.21.15.88:0/706756974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c104130 msgr2=0x7ff63c104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.525+0000 7ff64230f700 1 --2- 172.21.15.88:0/706756974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c104130 0x7ff63c104500 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009910 tx=0x7ff62c009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.525+0000 7ff64230f700 1 -- 172.21.15.88:0/706756974 shutdown_connections 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.525+0000 7ff64230f700 1 --2- 172.21.15.88:0/706756974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff63c0ffbd0 0x7ff63c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.525+0000 7ff64230f700 1 --2- 172.21.15.88:0/706756974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c104130 0x7ff63c104500 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.525+0000 7ff64230f700 1 -- 172.21.15.88:0/706756974 >> 172.21.15.88:0/706756974 conn(0x7ff63c075130 msgr2=0x7ff63c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.525+0000 7ff64230f700 1 -- 172.21.15.88:0/706756974 shutdown_connections 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.525+0000 7ff64230f700 1 -- 172.21.15.88:0/706756974 wait complete. 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff64230f700 1 Processor -- start 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff64230f700 1 -- start start 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff64230f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c0ffbd0 0x7ff63c195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff64230f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff63c104130 0x7ff63c196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:27.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff64230f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c196b70 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff64230f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c19a900 con 0x7ff63c104130 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff63bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c0ffbd0 0x7ff63c195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff63bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c0ffbd0 0x7ff63c195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40758/0 (socket says 172.21.15.88:40758) 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff63bfff700 1 -- 172.21.15.88:0/493894468 learned_addr learned my addr 172.21.15.88:0/493894468 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.526+0000 7ff63b7fe700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff63c104130 0x7ff63c196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff63bfff700 1 -- 172.21.15.88:0/493894468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff63c104130 msgr2=0x7ff63c196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff63bfff700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff63c104130 0x7ff63c196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff63bfff700 1 -- 172.21.15.88:0/493894468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0095f0 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff63b7fe700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff63c104130 0x7ff63c196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff63bfff700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c0ffbd0 0x7ff63c195f50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff62c006010 tx=0x7ff62c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff6397fa700 1 -- 172.21.15.88:0/493894468 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62c01d070 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff6397fa700 1 -- 172.21.15.88:0/493894468 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff62c004fb0 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c19ab80 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff6397fa700 1 -- 172.21.15.88:0/493894468 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62c00f480 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.527+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c19b070 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.528+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c1088a0 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.529+0000 7ff6397fa700 1 -- 172.21.15.88:0/493894468 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff62c022890 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.529+0000 7ff6397fa700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff62406e680 0x7ff624070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:27.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.529+0000 7ff6397fa700 1 -- 172.21.15.88:0/493894468 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7ff62c08fd90 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.529+0000 7ff63b7fe700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff62406e680 0x7ff624070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:27.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.530+0000 7ff63b7fe700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff62406e680 0x7ff624070b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff63c197570 tx=0x7ff630008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:27.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.534+0000 7ff6397fa700 1 -- 172.21.15.88:0/493894468 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff62c058f10 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.779+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7ff63c04f2a0 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.780+0000 7ff6397fa700 1 -- 172.21.15.88:0/493894468 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v38) v1 ==== 107+0+4318 (secure 0 0 0) 0x7ff62c027090 con 0x7ff63c0ffbd0 2024-09-13T21:52:27.781 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:27.781 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"btime":"2024-09-13T21:49:39:698689+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff62406e680 msgr2=0x7ff624070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff62406e680 0x7ff624070b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff63c197570 tx=0x7ff630008040 comp rx=0 tx=0).stop 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c0ffbd0 msgr2=0x7ff63c195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c0ffbd0 0x7ff63c195f50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff62c006010 tx=0x7ff62c00be20 comp rx=0 tx=0).stop 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 shutdown_connections 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff62406e680 0x7ff624070b30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c0ffbd0 0x7ff63c195f50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 --2- 172.21.15.88:0/493894468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff63c104130 0x7ff63c196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 >> 172.21.15.88:0/493894468 conn(0x7ff63c075130 msgr2=0x7ff63c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 shutdown_connections 2024-09-13T21:52:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:27.782+0000 7ff64230f700 1 -- 172.21.15.88:0/493894468 wait complete. 2024-09-13T21:52:27.785 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 29 2024-09-13T21:52:28.093 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:27 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/493894468' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T21:52:28.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:27 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/493894468' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T21:52:28.413 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:28.413 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-13T21:52:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:29.096 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:28 smithi088 ceph-mon[86843]: pgmap v287: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:29.096 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:28 smithi116 ceph-mon[65231]: pgmap v287: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:30.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.198+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/939031315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 msgr2=0x7f5ac0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:30.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.198+0000 7f5ac5e9a700 1 --2- 172.21.15.88:0/939031315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 0x7f5ac0103d30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009910 tx=0x7f5ab4009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:30.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.198+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/939031315 shutdown_connections 2024-09-13T21:52:30.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.198+0000 7f5ac5e9a700 1 --2- 172.21.15.88:0/939031315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 0x7f5ac0103d30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.198+0000 7f5ac5e9a700 1 --2- 172.21.15.88:0/939031315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ac00ff3c0 0x7f5ac00ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.198+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/939031315 >> 172.21.15.88:0/939031315 conn(0x7f5ac00fac80 msgr2=0x7f5ac00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.198+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/939031315 shutdown_connections 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.198+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/939031315 wait complete. 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.198+0000 7f5ac5e9a700 1 Processor -- start 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5ac5e9a700 1 -- start start 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5ac5e9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ac00ff3c0 0x7f5ac0100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5ac5e9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 0x7f5ac0101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5ac5e9a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0101850 con 0x7f5ac00ffd60 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5ac5e9a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0101990 con 0x7f5ac00ff3c0 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5abeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 0x7f5ac0101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5abeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 0x7f5ac0101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50654/0 (socket says 172.21.15.88:50654) 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5abeffd700 1 -- 172.21.15.88:0/1740728981 learned_addr learned my addr 172.21.15.88:0/1740728981 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5abeffd700 1 -- 172.21.15.88:0/1740728981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ac00ff3c0 msgr2=0x7f5ac0100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5abf7fe700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ac00ff3c0 0x7f5ac0100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5abeffd700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ac00ff3c0 0x7f5ac0100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5abeffd700 1 -- 172.21.15.88:0/1740728981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40095f0 con 0x7f5ac00ffd60 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5abf7fe700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ac00ff3c0 0x7f5ac0100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.199+0000 7f5abeffd700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 0x7f5ac0101310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400bda0 tx=0x7f5ab400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.200+0000 7f5abcff9700 1 -- 172.21.15.88:0/1740728981 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ab401d070 con 0x7f5ac00ffd60 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.200+0000 7f5abcff9700 1 -- 172.21.15.88:0/1740728981 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ab4004fb0 con 0x7f5ac00ffd60 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.200+0000 7f5abcff9700 1 -- 172.21.15.88:0/1740728981 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ab400f460 con 0x7f5ac00ffd60 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.200+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac0101c10 con 0x7f5ac00ffd60 2024-09-13T21:52:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.200+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac01a2340 con 0x7f5ac00ffd60 2024-09-13T21:52:30.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.201+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac0108740 con 0x7f5ac00ffd60 2024-09-13T21:52:30.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.201+0000 7f5abcff9700 1 -- 172.21.15.88:0/1740728981 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5ab4022800 con 0x7f5ac00ffd60 2024-09-13T21:52:30.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.202+0000 7f5abcff9700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5aa806e680 0x7f5aa8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:30.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.202+0000 7f5abcff9700 1 -- 172.21.15.88:0/1740728981 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f5ab408fc10 con 0x7f5ac00ffd60 2024-09-13T21:52:30.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.202+0000 7f5abf7fe700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5aa806e680 0x7f5aa8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:30.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.202+0000 7f5abf7fe700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5aa806e680 0x7f5aa8070b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0005fd0 tx=0x7f5ab0005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:30.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.206+0000 7f5abcff9700 1 -- 172.21.15.88:0/1740728981 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5ab4058e10 con 0x7f5ac00ffd60 2024-09-13T21:52:30.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.454+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f5ac0108120 con 0x7f5ac00ffd60 2024-09-13T21:52:30.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.454+0000 7f5abcff9700 1 -- 172.21.15.88:0/1740728981 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v38) v1 ==== 107+0+5165 (secure 0 0 0) 0x7f5ab4027090 con 0x7f5ac00ffd60 2024-09-13T21:52:30.456 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:30.456 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":30,"btime":"2024-09-13T21:49:45:263480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44327,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6827/102910693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":102910693},{"type":"v1","addr":"172.21.15.116:6827","nonce":102910693}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:48:47.898810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:30.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5aa806e680 msgr2=0x7f5aa8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:30.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5aa806e680 0x7f5aa8070b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0005fd0 tx=0x7f5ab0005e20 comp rx=0 tx=0).stop 2024-09-13T21:52:30.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 msgr2=0x7f5ac0101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 0x7f5ac0101310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400bda0 tx=0x7f5ab400be80 comp rx=0 tx=0).stop 2024-09-13T21:52:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 shutdown_connections 2024-09-13T21:52:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f5aa806e680 0x7f5aa8070b30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ac00ff3c0 0x7f5ac0100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 --2- 172.21.15.88:0/1740728981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00ffd60 0x7f5ac0101310 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 >> 172.21.15.88:0/1740728981 conn(0x7f5ac00fac80 msgr2=0x7f5ac00690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 shutdown_connections 2024-09-13T21:52:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:30.457+0000 7f5ac5e9a700 1 -- 172.21.15.88:0/1740728981 wait complete. 2024-09-13T21:52:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 30 2024-09-13T21:52:31.154 DEBUG:tasks.fs:max_mds not reduced in epoch 30 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-13T21:52:31.154 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-13T21:52:31.356 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:31.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:31 smithi088 ceph-mon[86843]: pgmap v288: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:31.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:31 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1740728981' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T21:52:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:31 smithi116 ceph-mon[65231]: pgmap v288: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:31.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:31 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1740728981' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T21:52:32.430 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:32 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:32.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:32 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 -- 172.21.15.88:0/3046783317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 msgr2=0x7f44ec103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 --2- 172.21.15.88:0/3046783317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 0x7f44ec103d30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009910 tx=0x7f44e8009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 -- 172.21.15.88:0/3046783317 shutdown_connections 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 --2- 172.21.15.88:0/3046783317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 0x7f44ec103d30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 --2- 172.21.15.88:0/3046783317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ec0ff3c0 0x7f44ec0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 -- 172.21.15.88:0/3046783317 >> 172.21.15.88:0/3046783317 conn(0x7f44ec0fac80 msgr2=0x7f44ec0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 -- 172.21.15.88:0/3046783317 shutdown_connections 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 -- 172.21.15.88:0/3046783317 wait complete. 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 Processor -- start 2024-09-13T21:52:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.959+0000 7f44f3931700 1 -- start start 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f3931700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ec0ff3c0 0x7f44ec195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f3931700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 0x7f44ec196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f3931700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec196ae0 con 0x7f44ec0ffd60 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f3931700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec19a870 con 0x7f44ec0ff3c0 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f0ecc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 0x7f44ec196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f0ecc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 0x7f44ec196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50676/0 (socket says 172.21.15.88:50676) 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f0ecc700 1 -- 172.21.15.88:0/3507745092 learned_addr learned my addr 172.21.15.88:0/3507745092 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f16cd700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ec0ff3c0 0x7f44ec195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f0ecc700 1 -- 172.21.15.88:0/3507745092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ec0ff3c0 msgr2=0x7f44ec195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f0ecc700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ec0ff3c0 0x7f44ec195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f0ecc700 1 -- 172.21.15.88:0/3507745092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e80095f0 con 0x7f44ec0ffd60 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f0ecc700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 0x7f44ec196400 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44e80092e0 tx=0x7f44e800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44e27fc700 1 -- 172.21.15.88:0/3507745092 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44e801d070 con 0x7f44ec0ffd60 2024-09-13T21:52:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44e27fc700 1 -- 172.21.15.88:0/3507745092 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44e800f460 con 0x7f44ec0ffd60 2024-09-13T21:52:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec19aaf0 con 0x7f44ec0ffd60 2024-09-13T21:52:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44e27fc700 1 -- 172.21.15.88:0/3507745092 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44e80175f0 con 0x7f44ec0ffd60 2024-09-13T21:52:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.960+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec19afe0 con 0x7f44ec0ffd60 2024-09-13T21:52:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.961+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ec04f2a0 con 0x7f44ec0ffd60 2024-09-13T21:52:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.962+0000 7f44e27fc700 1 -- 172.21.15.88:0/3507745092 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f44e800f5d0 con 0x7f44ec0ffd60 2024-09-13T21:52:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.962+0000 7f44e27fc700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f44d806e680 0x7f44d8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.963+0000 7f44e27fc700 1 -- 172.21.15.88:0/3507745092 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f44e808fd30 con 0x7f44ec0ffd60 2024-09-13T21:52:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.963+0000 7f44f16cd700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f44d806e680 0x7f44d8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:32.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.963+0000 7f44f16cd700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f44d806e680 0x7f44d8070b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44dc005fd0 tx=0x7f44dc00a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:32.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:32.967+0000 7f44e27fc700 1 -- 172.21.15.88:0/3507745092 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f44e8058da0 con 0x7f44ec0ffd60 2024-09-13T21:52:33.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.215+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f44ec197220 con 0x7f44ec0ffd60 2024-09-13T21:52:33.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.216+0000 7f44e27fc700 1 -- 172.21.15.88:0/3507745092 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v38) v1 ==== 107+0+5164 (secure 0 0 0) 0x7f44e805c460 con 0x7f44ec0ffd60 2024-09-13T21:52:33.217 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:33.217 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":31,"btime":"2024-09-13T21:49:53:473230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44327,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6827/102910693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":102910693},{"type":"v1","addr":"172.21.15.116:6827","nonce":102910693}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:49:52.476286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f44d806e680 msgr2=0x7f44d8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f44d806e680 0x7f44d8070b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44dc005fd0 tx=0x7f44dc00a560 comp rx=0 tx=0).stop 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 msgr2=0x7f44ec196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 0x7f44ec196400 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44e80092e0 tx=0x7f44e800be20 comp rx=0 tx=0).stop 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 shutdown_connections 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f44d806e680 0x7f44d8070b30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ec0ff3c0 0x7f44ec195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 --2- 172.21.15.88:0/3507745092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44ec0ffd60 0x7f44ec196400 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 >> 172.21.15.88:0/3507745092 conn(0x7f44ec0fac80 msgr2=0x7f44ec0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 shutdown_connections 2024-09-13T21:52:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:33.218+0000 7f44f3931700 1 -- 172.21.15.88:0/3507745092 wait complete. 2024-09-13T21:52:33.221 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 31 2024-09-13T21:52:33.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:33 smithi088 ceph-mon[86843]: pgmap v289: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:33.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:33 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3507745092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T21:52:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:33 smithi116 ceph-mon[65231]: pgmap v289: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:33.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:33 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3507745092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T21:52:33.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-13T21:52:34.085 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:35.364 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:35 smithi088 ceph-mon[86843]: pgmap v290: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:35.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:35 smithi116 ceph-mon[65231]: pgmap v290: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:35.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.894+0000 7f19db1d1700 1 -- 172.21.15.88:0/137209803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 msgr2=0x7f19d41094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:35.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.894+0000 7f19db1d1700 1 --2- 172.21.15.88:0/137209803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 0x7f19d41094d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009910 tx=0x7f19c4009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:35.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.894+0000 7f19db1d1700 1 -- 172.21.15.88:0/137209803 shutdown_connections 2024-09-13T21:52:35.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.894+0000 7f19db1d1700 1 --2- 172.21.15.88:0/137209803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 0x7f19d41094d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:35.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.894+0000 7f19db1d1700 1 --2- 172.21.15.88:0/137209803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19d4100460 0x7f19d4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:35.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.894+0000 7f19db1d1700 1 -- 172.21.15.88:0/137209803 >> 172.21.15.88:0/137209803 conn(0x7f19d40748b0 msgr2=0x7f19d4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:35.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.894+0000 7f19db1d1700 1 -- 172.21.15.88:0/137209803 shutdown_connections 2024-09-13T21:52:35.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.894+0000 7f19db1d1700 1 -- 172.21.15.88:0/137209803 wait complete. 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19db1d1700 1 Processor -- start 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19db1d1700 1 -- start start 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19db1d1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19d4100460 0x7f19d4196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19db1d1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 0x7f19d4197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19db1d1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d41977a0 con 0x7f19d4100d70 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19db1d1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4197910 con 0x7f19d4100460 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19cbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 0x7f19d4197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19cbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 0x7f19d4197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50700/0 (socket says 172.21.15.88:50700) 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19cbfff700 1 -- 172.21.15.88:0/1917534099 learned_addr learned my addr 172.21.15.88:0/1917534099 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19d8f6d700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19d4100460 0x7f19d4196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19cbfff700 1 -- 172.21.15.88:0/1917534099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19d4100460 msgr2=0x7f19d4196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19cbfff700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19d4100460 0x7f19d4196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19cbfff700 1 -- 172.21.15.88:0/1917534099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40095f0 con 0x7f19d4100d70 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19cbfff700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 0x7f19d4197180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f19c4006010 tx=0x7f19c400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.895+0000 7f19c9ffb700 1 -- 172.21.15.88:0/1917534099 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c401d070 con 0x7f19d4100d70 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.896+0000 7f19c9ffb700 1 -- 172.21.15.88:0/1917534099 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19c4004fb0 con 0x7f19d4100d70 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.896+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d419fcb0 con 0x7f19d4100d70 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.896+0000 7f19c9ffb700 1 -- 172.21.15.88:0/1917534099 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c4022ea0 con 0x7f19d4100d70 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.896+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d41a0120 con 0x7f19d4100d70 2024-09-13T21:52:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.897+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d4106bd0 con 0x7f19d4100d70 2024-09-13T21:52:35.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.897+0000 7f19c9ffb700 1 -- 172.21.15.88:0/1917534099 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f19c4022470 con 0x7f19d4100d70 2024-09-13T21:52:35.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.898+0000 7f19c9ffb700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f19bc06e680 0x7f19bc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:35.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.898+0000 7f19c9ffb700 1 -- 172.21.15.88:0/1917534099 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f19c408fbc0 con 0x7f19d4100d70 2024-09-13T21:52:35.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.898+0000 7f19d8f6d700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f19bc06e680 0x7f19bc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:35.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.898+0000 7f19d8f6d700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f19bc06e680 0x7f19bc070b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19d00060b0 tx=0x7f19d0007b80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:35.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:35.902+0000 7f19c9ffb700 1 -- 172.21.15.88:0/1917534099 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f19c4058ee0 con 0x7f19d4100d70 2024-09-13T21:52:36.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.147+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f19d404f2a0 con 0x7f19d4100d70 2024-09-13T21:52:36.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.148+0000 7f19c9ffb700 1 -- 172.21.15.88:0/1917534099 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v38) v1 ==== 107+0+5255 (secure 0 0 0) 0x7f19c4027090 con 0x7f19d4100d70 2024-09-13T21:52:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:36.149 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":32,"btime":"2024-09-13T21:49:53:477122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44327,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6827/102910693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":102910693},{"type":"v1","addr":"172.21.15.116:6827","nonce":102910693}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:49:53.477112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34402":{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":1,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:36.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f19bc06e680 msgr2=0x7f19bc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f19bc06e680 0x7f19bc070b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19d00060b0 tx=0x7f19d0007b80 comp rx=0 tx=0).stop 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 msgr2=0x7f19d4197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 0x7f19d4197180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f19c4006010 tx=0x7f19c400be20 comp rx=0 tx=0).stop 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 shutdown_connections 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f19bc06e680 0x7f19bc070b30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19d4100460 0x7f19d4196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 --2- 172.21.15.88:0/1917534099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4100d70 0x7f19d4197180 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 >> 172.21.15.88:0/1917534099 conn(0x7f19d40748b0 msgr2=0x7f19d4103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 shutdown_connections 2024-09-13T21:52:36.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:36.150+0000 7f19db1d1700 1 -- 172.21.15.88:0/1917534099 wait complete. 2024-09-13T21:52:36.153 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 32 2024-09-13T21:52:36.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:36 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1917534099' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T21:52:36.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:36 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1917534099' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T21:52:36.846 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-13T21:52:37.049 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:37.441 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:37 smithi088 ceph-mon[86843]: pgmap v291: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:37.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:37 smithi116 ceph-mon[65231]: pgmap v291: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:38.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.717+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/3589155368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 msgr2=0x7fd7e40ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.717+0000 7fd7eb0d9700 1 --2- 172.21.15.88:0/3589155368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 0x7fd7e40ff790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009910 tx=0x7fd7d8009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/3589155368 shutdown_connections 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 --2- 172.21.15.88:0/3589155368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40ffd60 0x7fd7e4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 --2- 172.21.15.88:0/3589155368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 0x7fd7e40ff790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/3589155368 >> 172.21.15.88:0/3589155368 conn(0x7fd7e40fac60 msgr2=0x7fd7e40fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/3589155368 shutdown_connections 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/3589155368 wait complete. 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 Processor -- start 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 -- start start 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 0x7fd7e4194e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40ffd60 0x7fd7e4195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4195a20 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7eb0d9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41997b0 con 0x7fd7e40ffd60 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.718+0000 7fd7e8e75700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 0x7fd7e4194e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e8e75700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 0x7fd7e4194e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50712/0 (socket says 172.21.15.88:50712) 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e8e75700 1 -- 172.21.15.88:0/4201413880 learned_addr learned my addr 172.21.15.88:0/4201413880 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e3fff700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40ffd60 0x7fd7e4195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e8e75700 1 -- 172.21.15.88:0/4201413880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40ffd60 msgr2=0x7fd7e4195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e8e75700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40ffd60 0x7fd7e4195340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e8e75700 1 -- 172.21.15.88:0/4201413880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d80095f0 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e3fff700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40ffd60 0x7fd7e4195340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:52:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e8e75700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 0x7fd7e4194e00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80092e0 tx=0x7fd7d800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e1ffb700 1 -- 172.21.15.88:0/4201413880 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7d801d070 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e4199a30 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e1ffb700 1 -- 172.21.15.88:0/4201413880 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7d8005e00 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7e1ffb700 1 -- 172.21.15.88:0/4201413880 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7d8017400 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.719+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e4199f20 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.720+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e41076d0 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.721+0000 7fd7e1ffb700 1 -- 172.21.15.88:0/4201413880 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd7d800f460 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.721+0000 7fd7e1ffb700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd7d406e680 0x7fd7d4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:38.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.721+0000 7fd7e1ffb700 1 -- 172.21.15.88:0/4201413880 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd7d808fc60 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.721+0000 7fd7e3fff700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd7d406e680 0x7fd7d4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:38.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.722+0000 7fd7e3fff700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd7d406e680 0x7fd7d4070b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0005950 tx=0x7fd7d00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:38.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.726+0000 7fd7e1ffb700 1 -- 172.21.15.88:0/4201413880 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd7d8058d30 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.967+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fd7e41070b0 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.968+0000 7fd7e1ffb700 1 -- 172.21.15.88:0/4201413880 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v38) v1 ==== 107+0+5257 (secure 0 0 0) 0x7fd7d805c3f0 con 0x7fd7e40ff3c0 2024-09-13T21:52:38.970 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:38.970 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":33,"btime":"2024-09-13T21:49:59:338715+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44327,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6827/102910693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":102910693},{"type":"v1","addr":"172.21.15.116:6827","nonce":102910693}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:49:59.299314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":0,"incarnation":32,"state":"up:resolve","state_seq":17,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34402":{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":1,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:38.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.971+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd7d406e680 msgr2=0x7fd7d4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:38.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.971+0000 7fd7eb0d9700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd7d406e680 0x7fd7d4070b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0005950 tx=0x7fd7d00058e0 comp rx=0 tx=0).stop 2024-09-13T21:52:38.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.971+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 msgr2=0x7fd7e4194e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:38.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.971+0000 7fd7eb0d9700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 0x7fd7e4194e00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80092e0 tx=0x7fd7d800be20 comp rx=0 tx=0).stop 2024-09-13T21:52:38.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.971+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 shutdown_connections 2024-09-13T21:52:38.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.971+0000 7fd7eb0d9700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7fd7d406e680 0x7fd7d4070b30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:38.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.971+0000 7fd7eb0d9700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e40ff3c0 0x7fd7e4194e00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:38.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.971+0000 7fd7eb0d9700 1 --2- 172.21.15.88:0/4201413880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7e40ffd60 0x7fd7e4195340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.971+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 >> 172.21.15.88:0/4201413880 conn(0x7fd7e40fac60 msgr2=0x7fd7e40fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.972+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 shutdown_connections 2024-09-13T21:52:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:38.972+0000 7fd7eb0d9700 1 -- 172.21.15.88:0/4201413880 wait complete. 2024-09-13T21:52:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 33 2024-09-13T21:52:39.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:39 smithi116 ceph-mon[65231]: pgmap v292: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:39.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:39 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/4201413880' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T21:52:39.611 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:39 smithi088 ceph-mon[86843]: pgmap v292: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:39.611 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:39 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/4201413880' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T21:52:39.635 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-13T21:52:39.835 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.473+0000 7f21e3dba700 1 -- 172.21.15.88:0/3413821632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc104130 msgr2=0x7f21dc104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.473+0000 7f21e3dba700 1 --2- 172.21.15.88:0/3413821632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc104130 0x7f21dc104500 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009910 tx=0x7f21cc009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.473+0000 7f21e3dba700 1 -- 172.21.15.88:0/3413821632 shutdown_connections 2024-09-13T21:52:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.473+0000 7f21e3dba700 1 --2- 172.21.15.88:0/3413821632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21dc0ffbd0 0x7f21dc100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.473+0000 7f21e3dba700 1 --2- 172.21.15.88:0/3413821632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc104130 0x7f21dc104500 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.473+0000 7f21e3dba700 1 -- 172.21.15.88:0/3413821632 >> 172.21.15.88:0/3413821632 conn(0x7f21dc075130 msgr2=0x7f21dc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.473+0000 7f21e3dba700 1 -- 172.21.15.88:0/3413821632 shutdown_connections 2024-09-13T21:52:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.473+0000 7f21e3dba700 1 -- 172.21.15.88:0/3413821632 wait complete. 2024-09-13T21:52:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.474+0000 7f21e3dba700 1 Processor -- start 2024-09-13T21:52:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.474+0000 7f21e3dba700 1 -- start start 2024-09-13T21:52:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.474+0000 7f21e3dba700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc0ffbd0 0x7f21dc194e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.474+0000 7f21e3dba700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21dc104130 0x7f21dc195380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.474+0000 7f21e3dba700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc195a60 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.474+0000 7f21e3dba700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc1997f0 con 0x7f21dc104130 2024-09-13T21:52:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.474+0000 7f21e1b56700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc0ffbd0 0x7f21dc194e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.474+0000 7f21e1b56700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc0ffbd0 0x7f21dc194e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57380/0 (socket says 172.21.15.88:57380) 2024-09-13T21:52:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.474+0000 7f21e1b56700 1 -- 172.21.15.88:0/3404319167 learned_addr learned my addr 172.21.15.88:0/3404319167 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21e1355700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21dc104130 0x7f21dc195380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21e1b56700 1 -- 172.21.15.88:0/3404319167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21dc104130 msgr2=0x7f21dc195380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21e1b56700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21dc104130 0x7f21dc195380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21e1b56700 1 -- 172.21.15.88:0/3404319167 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc0095f0 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21e1b56700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc0ffbd0 0x7f21dc194e40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f21cc006010 tx=0x7f21cc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21d2ffd700 1 -- 172.21.15.88:0/3404319167 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21cc01d070 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21d2ffd700 1 -- 172.21.15.88:0/3404319167 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21cc004fb0 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc199a70 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21d2ffd700 1 -- 172.21.15.88:0/3404319167 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21cc00f480 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.475+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21dc199f60 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.476+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc1076a0 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.477+0000 7f21d2ffd700 1 -- 172.21.15.88:0/3404319167 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f21cc022890 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.477+0000 7f21d2ffd700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f21c806e680 0x7f21c8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.477+0000 7f21d2ffd700 1 -- 172.21.15.88:0/3404319167 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f21cc08fe00 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.477+0000 7f21e1355700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f21c806e680 0x7f21c8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.478+0000 7f21e1355700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f21c806e680 0x7f21c8070b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21d8006fd0 tx=0x7f21d8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:41.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:41 smithi088 ceph-mon[86843]: pgmap v293: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.482+0000 7f21d2ffd700 1 -- 172.21.15.88:0/3404319167 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f21cc058f80 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:41 smithi116 ceph-mon[65231]: pgmap v293: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:41.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.728+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f21dc04f2a0 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.729+0000 7f21d2ffd700 1 -- 172.21.15.88:0/3404319167 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v38) v1 ==== 107+0+5259 (secure 0 0 0) 0x7f21cc063030 con 0x7f21dc0ffbd0 2024-09-13T21:52:41.730 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:41.730 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":34,"btime":"2024-09-13T21:50:00:595583+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44327,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6827/102910693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":102910693},{"type":"v1","addr":"172.21.15.116:6827","nonce":102910693}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:49:59.726420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":0,"incarnation":32,"state":"up:resolve","state_seq":17,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34402":{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":1,"incarnation":32,"state":"up:resolve","state_seq":13,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.731+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f21c806e680 msgr2=0x7f21c8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.731+0000 7f21e3dba700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f21c806e680 0x7f21c8070b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21d8006fd0 tx=0x7f21d8008040 comp rx=0 tx=0).stop 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.731+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc0ffbd0 msgr2=0x7f21dc194e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.731+0000 7f21e3dba700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc0ffbd0 0x7f21dc194e40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f21cc006010 tx=0x7f21cc00be20 comp rx=0 tx=0).stop 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.731+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 shutdown_connections 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.731+0000 7f21e3dba700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f21c806e680 0x7f21c8070b30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.731+0000 7f21e3dba700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21dc0ffbd0 0x7f21dc194e40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.731+0000 7f21e3dba700 1 --2- 172.21.15.88:0/3404319167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21dc104130 0x7f21dc195380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.731+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 >> 172.21.15.88:0/3404319167 conn(0x7f21dc075130 msgr2=0x7f21dc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:41.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.732+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 shutdown_connections 2024-09-13T21:52:41.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:41.732+0000 7f21e3dba700 1 -- 172.21.15.88:0/3404319167 wait complete. 2024-09-13T21:52:41.734 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 34 2024-09-13T21:52:42.443 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:42 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/3404319167' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T21:52:42.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-13T21:52:42.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:42 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/3404319167' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T21:52:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:43.476 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:43 smithi088 ceph-mon[86843]: pgmap v294: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:43.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:43 smithi116 ceph-mon[65231]: pgmap v294: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:44.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.313+0000 7f675f7db700 1 -- 172.21.15.88:0/3571513137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 msgr2=0x7f6758104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.313+0000 7f675f7db700 1 --2- 172.21.15.88:0/3571513137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 0x7f6758104e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6754009910 tx=0x7f6754009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.313+0000 7f675f7db700 1 -- 172.21.15.88:0/3571513137 shutdown_connections 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.313+0000 7f675f7db700 1 --2- 172.21.15.88:0/3571513137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 0x7f6758104e30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.313+0000 7f675f7db700 1 --2- 172.21.15.88:0/3571513137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67581004c0 0x7f6758100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.313+0000 7f675f7db700 1 -- 172.21.15.88:0/3571513137 >> 172.21.15.88:0/3571513137 conn(0x7f67580fbd80 msgr2=0x7f67580fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.313+0000 7f675f7db700 1 -- 172.21.15.88:0/3571513137 shutdown_connections 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.313+0000 7f675f7db700 1 -- 172.21.15.88:0/3571513137 wait complete. 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.314+0000 7f675f7db700 1 Processor -- start 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.314+0000 7f675f7db700 1 -- start start 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.314+0000 7f675f7db700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67581004c0 0x7f6758195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.314+0000 7f675f7db700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 0x7f6758196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:44.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.314+0000 7f675f7db700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6758196b10 con 0x7f6758100e60 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.314+0000 7f675f7db700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675819a8a0 con 0x7f67581004c0 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.314+0000 7f675cd76700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 0x7f6758196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.314+0000 7f675cd76700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 0x7f6758196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57410/0 (socket says 172.21.15.88:57410) 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.314+0000 7f675cd76700 1 -- 172.21.15.88:0/2829184277 learned_addr learned my addr 172.21.15.88:0/2829184277 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f675d577700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67581004c0 0x7f6758195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f675cd76700 1 -- 172.21.15.88:0/2829184277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67581004c0 msgr2=0x7f6758195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f675cd76700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67581004c0 0x7f6758195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f675cd76700 1 -- 172.21.15.88:0/2829184277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540095f0 con 0x7f6758100e60 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f675cd76700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 0x7f6758196430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f67540092e0 tx=0x7f675400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f674e7fc700 1 -- 172.21.15.88:0/2829184277 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f675401d070 con 0x7f6758100e60 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f674e7fc700 1 -- 172.21.15.88:0/2829184277 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6754005dc0 con 0x7f6758100e60 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675819ab20 con 0x7f6758100e60 2024-09-13T21:52:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f674e7fc700 1 -- 172.21.15.88:0/2829184277 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6754017400 con 0x7f6758100e60 2024-09-13T21:52:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.315+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675819b010 con 0x7f6758100e60 2024-09-13T21:52:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.316+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6758108830 con 0x7f6758100e60 2024-09-13T21:52:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.317+0000 7f674e7fc700 1 -- 172.21.15.88:0/2829184277 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f675400f6f0 con 0x7f6758100e60 2024-09-13T21:52:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.317+0000 7f674e7fc700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f674406e680 0x7f6744070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.317+0000 7f674e7fc700 1 -- 172.21.15.88:0/2829184277 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f675408fb20 con 0x7f6758100e60 2024-09-13T21:52:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.317+0000 7f675d577700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f674406e680 0x7f6744070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.318+0000 7f675d577700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f674406e680 0x7f6744070b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6748005950 tx=0x7f674800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.322+0000 7f674e7fc700 1 -- 172.21.15.88:0/2829184277 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6754058bf0 con 0x7f6758100e60 2024-09-13T21:52:44.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.563+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f675804f2a0 con 0x7f6758100e60 2024-09-13T21:52:44.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.564+0000 7f674e7fc700 1 -- 172.21.15.88:0/2829184277 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v38) v1 ==== 107+0+5263 (secure 0 0 0) 0x7f675405c2b0 con 0x7f6758100e60 2024-09-13T21:52:44.565 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:44.566 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"btime":"2024-09-13T21:50:01:600213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44327,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6827/102910693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":102910693},{"type":"v1","addr":"172.21.15.116:6827","nonce":102910693}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:50:00.649394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":18,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34402":{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":1,"incarnation":32,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:44.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f674406e680 msgr2=0x7f6744070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f674406e680 0x7f6744070b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6748005950 tx=0x7f674800b410 comp rx=0 tx=0).stop 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 msgr2=0x7f6758196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 0x7f6758196430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f67540092e0 tx=0x7f675400bd70 comp rx=0 tx=0).stop 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 shutdown_connections 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f674406e680 0x7f6744070b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67581004c0 0x7f6758195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 --2- 172.21.15.88:0/2829184277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6758100e60 0x7f6758196430 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 >> 172.21.15.88:0/2829184277 conn(0x7f67580fbd80 msgr2=0x7f67580fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 shutdown_connections 2024-09-13T21:52:44.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:44.566+0000 7f675f7db700 1 -- 172.21.15.88:0/2829184277 wait complete. 2024-09-13T21:52:44.569 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 35 2024-09-13T21:52:45.180 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-13T21:52:45.381 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:45 smithi116 ceph-mon[65231]: pgmap v295: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:45.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:45 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2829184277' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T21:52:45.627 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:45 smithi088 ceph-mon[86843]: pgmap v295: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:45.627 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:45 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2829184277' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T21:52:47.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.019+0000 7f7130c26700 1 -- 172.21.15.88:0/924768576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c100e80 msgr2=0x7f712c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.019+0000 7f7130c26700 1 --2- 172.21.15.88:0/924768576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c100e80 0x7f712c104e50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7114009910 tx=0x7f7114009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.019+0000 7f7130c26700 1 -- 172.21.15.88:0/924768576 shutdown_connections 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.019+0000 7f7130c26700 1 --2- 172.21.15.88:0/924768576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c100e80 0x7f712c104e50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.019+0000 7f7130c26700 1 --2- 172.21.15.88:0/924768576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f712c1004e0 0x7f712c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.019+0000 7f7130c26700 1 -- 172.21.15.88:0/924768576 >> 172.21.15.88:0/924768576 conn(0x7f712c0fbda0 msgr2=0x7f712c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.019+0000 7f7130c26700 1 -- 172.21.15.88:0/924768576 shutdown_connections 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.019+0000 7f7130c26700 1 -- 172.21.15.88:0/924768576 wait complete. 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f7130c26700 1 Processor -- start 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f7130c26700 1 -- start start 2024-09-13T21:52:47.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f7130c26700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c1004e0 0x7f712c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f7130c26700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f712c100e80 0x7f712c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f7130c26700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c196b50 con 0x7f712c1004e0 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f7130c26700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c19a8e0 con 0x7f712c100e80 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f712a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c1004e0 0x7f712c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f712a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c1004e0 0x7f712c195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57430/0 (socket says 172.21.15.88:57430) 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f712a59c700 1 -- 172.21.15.88:0/2150603705 learned_addr learned my addr 172.21.15.88:0/2150603705 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.020+0000 7f7121d9b700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f712c100e80 0x7f712c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.021+0000 7f712a59c700 1 -- 172.21.15.88:0/2150603705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f712c100e80 msgr2=0x7f712c196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.021+0000 7f712a59c700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f712c100e80 0x7f712c196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.021+0000 7f712a59c700 1 -- 172.21.15.88:0/2150603705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71140095f0 con 0x7f712c1004e0 2024-09-13T21:52:47.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.021+0000 7f712a59c700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c1004e0 0x7f712c195f30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f711c00d8d0 tx=0x7f711c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:47.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.021+0000 7f7123fff700 1 -- 172.21.15.88:0/2150603705 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711c0098a0 con 0x7f712c1004e0 2024-09-13T21:52:47.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.021+0000 7f7123fff700 1 -- 172.21.15.88:0/2150603705 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f711c010460 con 0x7f712c1004e0 2024-09-13T21:52:47.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.021+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c19abc0 con 0x7f712c1004e0 2024-09-13T21:52:47.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.021+0000 7f7123fff700 1 -- 172.21.15.88:0/2150603705 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711c00f5f0 con 0x7f712c1004e0 2024-09-13T21:52:47.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.021+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c19b0e0 con 0x7f712c1004e0 2024-09-13T21:52:47.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.022+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c108850 con 0x7f712c1004e0 2024-09-13T21:52:47.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.023+0000 7f7123fff700 1 -- 172.21.15.88:0/2150603705 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f711c009a00 con 0x7f712c1004e0 2024-09-13T21:52:47.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.023+0000 7f7123fff700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f711806e680 0x7f7118070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:47.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.023+0000 7f7123fff700 1 -- 172.21.15.88:0/2150603705 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f711c08e620 con 0x7f712c1004e0 2024-09-13T21:52:47.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.023+0000 7f7121d9b700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f711806e680 0x7f7118070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:47.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.023+0000 7f7121d9b700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f711806e680 0x7f7118070b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7114006010 tx=0x7f711401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:47.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.027+0000 7f7123fff700 1 -- 172.21.15.88:0/2150603705 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f711c0576f0 con 0x7f712c1004e0 2024-09-13T21:52:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.275+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f712c04f2a0 con 0x7f712c1004e0 2024-09-13T21:52:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.275+0000 7f7123fff700 1 -- 172.21.15.88:0/2150603705 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v38) v1 ==== 107+0+5257 (secure 0 0 0) 0x7f711c05adb0 con 0x7f712c1004e0 2024-09-13T21:52:47.277 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:47.277 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":36,"btime":"2024-09-13T21:50:02:606963+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44327,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6827/102910693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":102910693},{"type":"v1","addr":"172.21.15.116:6827","nonce":102910693}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:50:01.608867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34402":{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":1,"incarnation":32,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:52:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f711806e680 msgr2=0x7f7118070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f711806e680 0x7f7118070b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7114006010 tx=0x7f711401a040 comp rx=0 tx=0).stop 2024-09-13T21:52:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c1004e0 msgr2=0x7f712c195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c1004e0 0x7f712c195f30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f711c00d8d0 tx=0x7f711c00dbe0 comp rx=0 tx=0).stop 2024-09-13T21:52:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 shutdown_connections 2024-09-13T21:52:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f711806e680 0x7f7118070b30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f712c1004e0 0x7f712c195f30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 --2- 172.21.15.88:0/2150603705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f712c100e80 0x7f712c196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 >> 172.21.15.88:0/2150603705 conn(0x7f712c0fbda0 msgr2=0x7f712c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 shutdown_connections 2024-09-13T21:52:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:47.278+0000 7f7130c26700 1 -- 172.21.15.88:0/2150603705 wait complete. 2024-09-13T21:52:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 36 2024-09-13T21:52:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:47 smithi116 ceph-mon[65231]: pgmap v296: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:47 smithi116 ceph-mon[65231]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:47.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:47 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2150603705' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T21:52:47.630 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:47 smithi088 ceph-mon[86843]: pgmap v296: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:47.630 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:47 smithi088 ceph-mon[86843]: from='mgr.34104 172.21.15.88:0/1001363181' entity='mgr.smithi088.scyrwy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:47.630 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:47 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2150603705' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T21:52:47.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-13T21:52:48.150 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:49.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:49 smithi116 ceph-mon[65231]: pgmap v297: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:49.606 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:49 smithi088 ceph-mon[86843]: pgmap v297: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.860+0000 7f22941f8700 1 -- 172.21.15.88:0/2493440984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 msgr2=0x7f228c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.860+0000 7f22941f8700 1 --2- 172.21.15.88:0/2493440984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 0x7f228c103d30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2288009910 tx=0x7f2288009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.860+0000 7f22941f8700 1 -- 172.21.15.88:0/2493440984 shutdown_connections 2024-09-13T21:52:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.860+0000 7f22941f8700 1 --2- 172.21.15.88:0/2493440984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 0x7f228c103d30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.860+0000 7f22941f8700 1 --2- 172.21.15.88:0/2493440984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f228c0ff3c0 0x7f228c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.860+0000 7f22941f8700 1 -- 172.21.15.88:0/2493440984 >> 172.21.15.88:0/2493440984 conn(0x7f228c0fac80 msgr2=0x7f228c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.861+0000 7f22941f8700 1 -- 172.21.15.88:0/2493440984 shutdown_connections 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.861+0000 7f22941f8700 1 -- 172.21.15.88:0/2493440984 wait complete. 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.861+0000 7f22941f8700 1 Processor -- start 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.861+0000 7f22941f8700 1 -- start start 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.861+0000 7f22941f8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f228c0ff3c0 0x7f228c196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.861+0000 7f22941f8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 0x7f228c1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.861+0000 7f22941f8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c1978e0 con 0x7f228c0ffd60 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.861+0000 7f22941f8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c197a20 con 0x7f228c0ff3c0 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2291793700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 0x7f228c1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2291793700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 0x7f228c1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57452/0 (socket says 172.21.15.88:57452) 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2291793700 1 -- 172.21.15.88:0/1242126117 learned_addr learned my addr 172.21.15.88:0/1242126117 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2291f94700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f228c0ff3c0 0x7f228c196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2291793700 1 -- 172.21.15.88:0/1242126117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f228c0ff3c0 msgr2=0x7f228c196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2291793700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f228c0ff3c0 0x7f228c196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2291793700 1 -- 172.21.15.88:0/1242126117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880095f0 con 0x7f228c0ffd60 2024-09-13T21:52:49.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2291793700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 0x7f228c1972c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22880092e0 tx=0x7f228800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:49.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2282ffd700 1 -- 172.21.15.88:0/1242126117 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228801d070 con 0x7f228c0ffd60 2024-09-13T21:52:49.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2282ffd700 1 -- 172.21.15.88:0/1242126117 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2288005dc0 con 0x7f228c0ffd60 2024-09-13T21:52:49.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c19fdf0 con 0x7f228c0ffd60 2024-09-13T21:52:49.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f2282ffd700 1 -- 172.21.15.88:0/1242126117 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2288017400 con 0x7f228c0ffd60 2024-09-13T21:52:49.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.862+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c1a0200 con 0x7f228c0ffd60 2024-09-13T21:52:49.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.863+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c107730 con 0x7f228c0ffd60 2024-09-13T21:52:49.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.864+0000 7f2282ffd700 1 -- 172.21.15.88:0/1242126117 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f228800f460 con 0x7f228c0ffd60 2024-09-13T21:52:49.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.864+0000 7f2282ffd700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f227806e680 0x7f2278070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.864+0000 7f2282ffd700 1 -- 172.21.15.88:0/1242126117 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f228808fb70 con 0x7f228c0ffd60 2024-09-13T21:52:49.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.865+0000 7f2291f94700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f227806e680 0x7f2278070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.865+0000 7f2291f94700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f227806e680 0x7f2278070b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f227c005fd0 tx=0x7f227c005f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:49.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:49.869+0000 7f2282ffd700 1 -- 172.21.15.88:0/1242126117 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2288058cc0 con 0x7f228c0ffd60 2024-09-13T21:52:50.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.115+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f228c04f2a0 con 0x7f228c0ffd60 2024-09-13T21:52:50.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.116+0000 7f2282ffd700 1 -- 172.21.15.88:0/1242126117 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v38) v1 ==== 107+0+5272 (secure 0 0 0) 0x7f228805c380 con 0x7f228c0ffd60 2024-09-13T21:52:50.118 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T21:52:50.118 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"btime":"2024-09-13T21:50:03:616161+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44323,"name":"cephfs.smithi116.rwfayz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6825/387213237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":387213237},{"type":"v1","addr":"172.21.15.116:6825","nonce":387213237}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44327,"name":"cephfs.smithi116.mjrkvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6827/102910693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":102910693},{"type":"v1","addr":"172.21.15.116:6827","nonce":102910693}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:38:02.176962+0000","modified":"2024-09-13T21:50:03.616157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34382,"mds_1":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi088.yszliw","rank":0,"incarnation":32,"state":"up:active","state_seq":20,"addr":"172.21.15.88:6827/1507815842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1507815842},{"type":"v1","addr":"172.21.15.88:6827","nonce":1507815842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34402":{"gid":34402,"name":"cephfs.smithi088.vqfqko","rank":1,"incarnation":32,"state":"up:active","state_seq":16,"addr":"172.21.15.88:6829/2098233498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2098233498},{"type":"v1","addr":"172.21.15.88:6829","nonce":2098233498}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34382,"qdb_cluster":[34382,34402]},"id":1}]} 2024-09-13T21:52:50.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f227806e680 msgr2=0x7f2278070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f227806e680 0x7f2278070b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f227c005fd0 tx=0x7f227c005f60 comp rx=0 tx=0).stop 2024-09-13T21:52:50.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 msgr2=0x7f228c1972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 0x7f228c1972c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22880092e0 tx=0x7f228800be20 comp rx=0 tx=0).stop 2024-09-13T21:52:50.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 shutdown_connections 2024-09-13T21:52:50.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f227806e680 0x7f2278070b30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f228c0ff3c0 0x7f228c196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 --2- 172.21.15.88:0/1242126117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f228c0ffd60 0x7f228c1972c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 >> 172.21.15.88:0/1242126117 conn(0x7f228c0fac80 msgr2=0x7f228c0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:50.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 shutdown_connections 2024-09-13T21:52:50.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:50.119+0000 7f22941f8700 1 -- 172.21.15.88:0/1242126117 wait complete. 2024-09-13T21:52:50.121 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 37 2024-09-13T21:52:50.446 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:50 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1242126117' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T21:52:50.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:50 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1242126117' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T21:52:50.809 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T21:52:50.822 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T21:52:50.822 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:52:50.822 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T21:52:50.843 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T21:52:50.844 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T21:52:50.902 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T21:52:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:51.517 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:51 smithi088 ceph-mon[86843]: pgmap v298: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:51.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:51 smithi116 ceph-mon[65231]: pgmap v298: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:52.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.780+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/3472688667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc106320 msgr2=0x7ff6cc1066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.780+0000 7ff6d0f3f700 1 --2- 172.21.15.88:0/3472688667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc106320 0x7ff6cc1066f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009910 tx=0x7ff6bc009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.780+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/3472688667 shutdown_connections 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.780+0000 7ff6d0f3f700 1 --2- 172.21.15.88:0/3472688667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6cc068540 0x7ff6cc0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.780+0000 7ff6d0f3f700 1 --2- 172.21.15.88:0/3472688667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc106320 0x7ff6cc1066f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.780+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/3472688667 >> 172.21.15.88:0/3472688667 conn(0x7ff6cc075130 msgr2=0x7ff6cc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.780+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/3472688667 shutdown_connections 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.780+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/3472688667 wait complete. 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.781+0000 7ff6d0f3f700 1 Processor -- start 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.781+0000 7ff6d0f3f700 1 -- start start 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.781+0000 7ff6d0f3f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc068540 0x7ff6cc195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.781+0000 7ff6d0f3f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6cc106320 0x7ff6cc1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.781+0000 7ff6d0f3f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc196a90 con 0x7ff6cc068540 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.781+0000 7ff6d0f3f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc19a820 con 0x7ff6cc106320 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.781+0000 7ff6ca59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc068540 0x7ff6cc195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.781+0000 7ff6ca59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc068540 0x7ff6cc195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46198/0 (socket says 172.21.15.88:46198) 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.781+0000 7ff6ca59c700 1 -- 172.21.15.88:0/1814107183 learned_addr learned my addr 172.21.15.88:0/1814107183 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6c9d9b700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6cc106320 0x7ff6cc1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6ca59c700 1 -- 172.21.15.88:0/1814107183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6cc106320 msgr2=0x7ff6cc1963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6ca59c700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6cc106320 0x7ff6cc1963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6ca59c700 1 -- 172.21.15.88:0/1814107183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc0095f0 con 0x7ff6cc068540 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6ca59c700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc068540 0x7ff6cc195e70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000c00 tx=0x7ff6bc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6bb7fe700 1 -- 172.21.15.88:0/1814107183 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6bc01d070 con 0x7ff6cc068540 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6bb7fe700 1 -- 172.21.15.88:0/1814107183 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6bc00f460 con 0x7ff6cc068540 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc19aaa0 con 0x7ff6cc068540 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6bb7fe700 1 -- 172.21.15.88:0/1814107183 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6bc017630 con 0x7ff6cc068540 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.782+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc19af90 con 0x7ff6cc068540 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.783+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc108790 con 0x7ff6cc068540 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.784+0000 7ff6bb7fe700 1 -- 172.21.15.88:0/1814107183 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff6bc00f5d0 con 0x7ff6cc068540 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.784+0000 7ff6bb7fe700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff6b406e680 0x7ff6b4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.784+0000 7ff6bb7fe700 1 -- 172.21.15.88:0/1814107183 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7ff6bc08fcb0 con 0x7ff6cc068540 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.784+0000 7ff6c9d9b700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff6b406e680 0x7ff6b4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.785+0000 7ff6c9d9b700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff6b406e680 0x7ff6b4070b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc197490 tx=0x7ff6c000a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:52.789+0000 7ff6bb7fe700 1 -- 172.21.15.88:0/1814107183 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff6bc058d80 con 0x7ff6cc068540 2024-09-13T21:52:53.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.010+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff6cc04f2a0 con 0x7ff6cc068540 2024-09-13T21:52:53.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.010+0000 7ff6bb7fe700 1 -- 172.21.15.88:0/1814107183 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v96) v1 ==== 81+0+2047 (secure 0 0 0) 0x7ff6bc05c440 con 0x7ff6cc068540 2024-09-13T21:52:53.012 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6829/3000160721 2024-09-14T21:48:47.898795+0000 2024-09-13T21:52:53.012 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6828/3000160721 2024-09-14T21:48:47.898795+0000 2024-09-13T21:52:53.012 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:6825/3165930293 2024-09-14T21:48:47.898806+0000 2024-09-13T21:52:53.012 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:6824/3165930293 2024-09-14T21:48:47.898806+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/310029485 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/672735579 2024-09-14T21:33:10.015143+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3497040883 2024-09-14T21:32:04.517540+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6827/2645824326 2024-09-14T21:38:17.478814+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/250890518 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/2948283226 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/3264582111 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1989360438 2024-09-14T21:33:10.015143+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3319424547 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/363302410 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/916622427 2024-09-14T21:40:57.724859+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6826/2645824326 2024-09-14T21:38:17.478814+0000 2024-09-13T21:52:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3898470340 2024-09-14T21:40:57.724859+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:6829/622892853 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3401436245 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/4191098453 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1136159910 2024-09-14T21:32:04.517540+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/310029485 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2418246833 2024-09-14T21:32:04.517540+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/3173991627 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/980797152 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1962190543 2024-09-14T21:40:57.724859+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:6828/622892853 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:53.014 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/3709144279 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:53.015 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/4216662499 2024-09-14T21:40:57.724859+0000 2024-09-13T21:52:53.015 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/181892943 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:53.015 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1718413431 2024-09-14T21:33:10.015143+0000 2024-09-13T21:52:53.015 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2782574984 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:53.015 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/424399264 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff6b406e680 msgr2=0x7ff6b4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff6b406e680 0x7ff6b4070b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc197490 tx=0x7ff6c000a300 comp rx=0 tx=0).stop 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc068540 msgr2=0x7ff6cc195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc068540 0x7ff6cc195e70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000c00 tx=0x7ff6bc00bd70 comp rx=0 tx=0).stop 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 shutdown_connections 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7ff6b406e680 0x7ff6b4070b30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6cc068540 0x7ff6cc195e70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 --2- 172.21.15.88:0/1814107183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6cc106320 0x7ff6cc1963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 >> 172.21.15.88:0/1814107183 conn(0x7ff6cc075130 msgr2=0x7ff6cc0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 shutdown_connections 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:53.013+0000 7ff6d0f3f700 1 -- 172.21.15.88:0/1814107183 wait complete. 2024-09-13T21:52:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:listed 35 entries 2024-09-13T21:52:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:53 smithi116 ceph-mon[65231]: pgmap v299: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:53.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:53 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/1814107183' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T21:52:53.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:53 smithi088 ceph-mon[86843]: pgmap v299: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:53.644 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:53 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/1814107183' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T21:52:53.665 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T21:52:53.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:53.666 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T21:52:53.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:52:53.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:53.694 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T21:52:53.773 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:52:53.774 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T21:52:53.794 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T21:52:53.794 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T21:52:53.853 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 67511300-7217-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T21:52:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/mon.smithi088/config 2024-09-13T21:52:55.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:55 smithi088 ceph-mon[86843]: pgmap v300: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:55.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:55 smithi116 ceph-mon[65231]: pgmap v300: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:55.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.730+0000 7f929aff5700 1 -- 172.21.15.88:0/1577504196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 msgr2=0x7f9294104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:55.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.730+0000 7f929aff5700 1 --2- 172.21.15.88:0/1577504196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 0x7f9294104e50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9284009910 tx=0x7f9284009c20 comp rx=0 tx=0).stop 2024-09-13T21:52:55.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.730+0000 7f929aff5700 1 -- 172.21.15.88:0/1577504196 shutdown_connections 2024-09-13T21:52:55.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.730+0000 7f929aff5700 1 --2- 172.21.15.88:0/1577504196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 0x7f9294104e50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:55.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.730+0000 7f929aff5700 1 --2- 172.21.15.88:0/1577504196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92941004e0 0x7f92941008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:55.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.730+0000 7f929aff5700 1 -- 172.21.15.88:0/1577504196 >> 172.21.15.88:0/1577504196 conn(0x7f92940fbda0 msgr2=0x7f92940fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.730+0000 7f929aff5700 1 -- 172.21.15.88:0/1577504196 shutdown_connections 2024-09-13T21:52:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.730+0000 7f929aff5700 1 -- 172.21.15.88:0/1577504196 wait complete. 2024-09-13T21:52:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.730+0000 7f929aff5700 1 Processor -- start 2024-09-13T21:52:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f929aff5700 1 -- start start 2024-09-13T21:52:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f929aff5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92941004e0 0x7f9294196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f929aff5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 0x7f9294196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f929aff5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9294196c20 con 0x7f9294100e80 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f929aff5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929419a9b0 con 0x7f92941004e0 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f928bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 0x7f9294196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f928bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 0x7f9294196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46220/0 (socket says 172.21.15.88:46220) 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f928bfff700 1 -- 172.21.15.88:0/2085074141 learned_addr learned my addr 172.21.15.88:0/2085074141 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f9298d91700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92941004e0 0x7f9294196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f928bfff700 1 -- 172.21.15.88:0/2085074141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92941004e0 msgr2=0x7f9294196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f928bfff700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92941004e0 0x7f9294196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f928bfff700 1 -- 172.21.15.88:0/2085074141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840095f0 con 0x7f9294100e80 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f928bfff700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 0x7f9294196540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92840092e0 tx=0x7f928400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f9289ffb700 1 -- 172.21.15.88:0/2085074141 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928401d070 con 0x7f9294100e80 2024-09-13T21:52:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f9289ffb700 1 -- 172.21.15.88:0/2085074141 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f928400f460 con 0x7f9294100e80 2024-09-13T21:52:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929419ac30 con 0x7f9294100e80 2024-09-13T21:52:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.731+0000 7f9289ffb700 1 -- 172.21.15.88:0/2085074141 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92840175f0 con 0x7f9294100e80 2024-09-13T21:52:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.732+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929419b120 con 0x7f9294100e80 2024-09-13T21:52:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.733+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92941087a0 con 0x7f9294100e80 2024-09-13T21:52:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.733+0000 7f9289ffb700 1 -- 172.21.15.88:0/2085074141 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f928400f5d0 con 0x7f9294100e80 2024-09-13T21:52:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.734+0000 7f9289ffb700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f927c06e680 0x7f927c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:55.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.734+0000 7f9289ffb700 1 -- 172.21.15.88:0/2085074141 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f928408fb90 con 0x7f9294100e80 2024-09-13T21:52:55.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.734+0000 7f9298d91700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f927c06e680 0x7f927c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:55.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.734+0000 7f9298d91700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f927c06e680 0x7f927c070b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9290006fd0 tx=0x7f9290008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:55.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.738+0000 7f9289ffb700 1 -- 172.21.15.88:0/2085074141 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9284058ce0 con 0x7f9294100e80 2024-09-13T21:52:55.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.954+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f929402cc30 con 0x7f9294100e80 2024-09-13T21:52:55.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.954+0000 7f9289ffb700 1 -- 172.21.15.88:0/2085074141 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v96) v1 ==== 81+0+2047 (secure 0 0 0) 0x7f928405c3a0 con 0x7f9294100e80 2024-09-13T21:52:55.956 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6829/3000160721 2024-09-14T21:48:47.898795+0000 2024-09-13T21:52:55.956 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6828/3000160721 2024-09-14T21:48:47.898795+0000 2024-09-13T21:52:55.956 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:6825/3165930293 2024-09-14T21:48:47.898806+0000 2024-09-13T21:52:55.956 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:6824/3165930293 2024-09-14T21:48:47.898806+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/310029485 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/672735579 2024-09-14T21:33:10.015143+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3497040883 2024-09-14T21:32:04.517540+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6827/2645824326 2024-09-14T21:38:17.478814+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/250890518 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/2948283226 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/3264582111 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1989360438 2024-09-14T21:33:10.015143+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3319424547 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/363302410 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/916622427 2024-09-14T21:40:57.724859+0000 2024-09-13T21:52:55.957 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6826/2645824326 2024-09-14T21:38:17.478814+0000 2024-09-13T21:52:55.958 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/2 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:55.958 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3898470340 2024-09-14T21:40:57.724859+0000 2024-09-13T21:52:55.958 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:6829/622892853 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:55.958 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/3401436245 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:55.958 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/4191098453 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:55.958 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6800/2 2024-09-14T21:31:31.464307+0000 2024-09-13T21:52:55.958 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1136159910 2024-09-14T21:32:04.517540+0000 2024-09-13T21:52:55.959 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:6801/310029485 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:55.959 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2418246833 2024-09-14T21:32:04.517540+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/3173991627 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/980797152 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1962190543 2024-09-14T21:40:57.724859+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:6828/622892853 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.116:0/3709144279 2024-09-14T21:41:41.955901+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/4216662499 2024-09-14T21:40:57.724859+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/181892943 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/1718413431 2024-09-14T21:33:10.015143+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/2782574984 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:55.960 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88:0/424399264 2024-09-14T21:44:32.064085+0000 2024-09-13T21:52:55.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f927c06e680 msgr2=0x7f927c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:55.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f927c06e680 0x7f927c070b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9290006fd0 tx=0x7f9290008040 comp rx=0 tx=0).stop 2024-09-13T21:52:55.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 msgr2=0x7f9294196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:55.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 0x7f9294196540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92840092e0 tx=0x7f928400be20 comp rx=0 tx=0).stop 2024-09-13T21:52:55.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 shutdown_connections 2024-09-13T21:52:55.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:6800/995153863,v1:172.21.15.88:6801/995153863] conn(0x7f927c06e680 0x7f927c070b30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:55.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92941004e0 0x7f9294196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:55.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 --2- 172.21.15.88:0/2085074141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9294100e80 0x7f9294196540 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:55.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 >> 172.21.15.88:0/2085074141 conn(0x7f92940fbda0 msgr2=0x7f92940fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:55.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.956+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 shutdown_connections 2024-09-13T21:52:55.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T21:52:55.957+0000 7f929aff5700 1 -- 172.21.15.88:0/2085074141 wait complete. 2024-09-13T21:52:55.962 INFO:teuthology.orchestra.run.smithi088.stderr:listed 35 entries 2024-09-13T21:52:56.559 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:56 smithi088 ceph-mon[86843]: from='client.? 172.21.15.88:0/2085074141' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T21:52:56.580 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T21:52:56.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:56.580 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T21:52:56.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:56 smithi116 ceph-mon[65231]: from='client.? 172.21.15.88:0/2085074141' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T21:52:56.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-09-13T21:52:56.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:56.615 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T21:52:56.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:56.708 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-09-13T21:52:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T21:52:56.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:56.726 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T21:52:56.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:56.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-09-13T21:52:56.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:56.903 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-09-13T21:52:56.924 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T21:52:56.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:56.925 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T21:52:56.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:52:56.996 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-09-13T21:52:57.100 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T21:52:57.111 INFO:tasks.cephadm:Teardown begin 2024-09-13T21:52:57.112 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:52:57.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:52:57.169 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T21:52:57.169 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T21:52:57.195 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T21:52:57.225 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T21:52:57.225 INFO:tasks.cephadm.mon.smithi088:Stopping mon.smithi088... 2024-09-13T21:52:57.225 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088 2024-09-13T21:52:57.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:57 smithi088 systemd[1]: Stopping Ceph mon.smithi088 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:52:57.482 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:57 smithi088 ceph-mon[86843]: pgmap v301: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:57.596 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:57 smithi116 ceph-mon[65231]: pgmap v301: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:52:57.959 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088[86838]: 2024-09-13T21:52:57.529+0000 7f9b39230640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi088 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:52:57.960 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:57 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088[86838]: 2024-09-13T21:52:57.529+0000 7f9b39230640 -1 mon.smithi088@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T21:52:57.960 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:57 smithi088 podman[134118]: 2024-09-13 21:52:57.724296864 +0000 UTC m=+0.301225834 container died 7959cd284dbb586c275222a666c14b05d6645875b35b21d231661f229be72d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:52:58.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:58 smithi088 podman[134118]: 2024-09-13 21:52:58.097314066 +0000 UTC m=+0.674243035 container cleanup 7959cd284dbb586c275222a666c14b05d6645875b35b21d231661f229be72d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS) 2024-09-13T21:52:58.232 INFO:journalctl@ceph.mon.smithi088.smithi088.stdout:Sep 13 21:52:58 smithi088 bash[134118]: ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi088 2024-09-13T21:52:58.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi088.service' 2024-09-13T21:52:58.579 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T21:52:58.579 INFO:tasks.cephadm.mon.smithi088:Stopped mon.smithi088 2024-09-13T21:52:58.579 INFO:tasks.cephadm.mon.smithi116:Stopping mon.smithi116... 2024-09-13T21:52:58.580 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi116 2024-09-13T21:52:59.000 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:58 smithi116 systemd[1]: Stopping Ceph mon.smithi116 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:52:59.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:59 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116[65227]: 2024-09-13T21:52:58.998+0000 7fbd1efe0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi116 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:52:59.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:59 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116[65227]: 2024-09-13T21:52:58.998+0000 7fbd1efe0640 -1 mon.smithi116@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T21:52:59.346 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:59 smithi116 podman[100823]: 2024-09-13 21:52:59.193409482 +0000 UTC m=+0.407927847 container died 27f0dd428044baf862e10577cea2eab9afae6882ff2c0190c81c8dc8cc0c3270 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T21:52:59.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:59 smithi116 podman[100823]: 2024-09-13 21:52:59.691033121 +0000 UTC m=+0.905551485 container cleanup 27f0dd428044baf862e10577cea2eab9afae6882ff2c0190c81c8dc8cc0c3270 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:52:59.846 INFO:journalctl@ceph.mon.smithi116.smithi116.stdout:Sep 13 21:52:59 smithi116 bash[100823]: ceph-67511300-7217-11ef-bceb-c7b262605968-mon-smithi116 2024-09-13T21:53:00.168 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@mon.smithi116.service' 2024-09-13T21:53:00.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T21:53:00.215 INFO:tasks.cephadm.mon.smithi116:Stopped mon.smithi116 2024-09-13T21:53:00.215 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T21:53:00.215 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-67511300-7217-11ef-bceb-c7b262605968@osd.0 2024-09-13T21:53:00.552 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:00 smithi088 systemd[1]: Stopping Ceph osd.0 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:53:00.982 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:00 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[98501]: 2024-09-13T21:53:00.550+0000 7f3694a1f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:53:00.982 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:00 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[98501]: 2024-09-13T21:53:00.550+0000 7f3694a1f640 -1 osd.0 96 *** Got signal Terminated *** 2024-09-13T21:53:00.982 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:00 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0[98501]: 2024-09-13T21:53:00.550+0000 7f3694a1f640 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:53:06.304 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:06 smithi088 podman[134250]: 2024-09-13 21:53:06.014052352 +0000 UTC m=+5.603444160 container died 4c58e1e6303866f38ba3af84f91ad010e3efc2c2f2926edbfda3d69b629b319b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be) 2024-09-13T21:53:06.732 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:06 smithi088 podman[134250]: 2024-09-13 21:53:06.393150741 +0000 UTC m=+5.982542548 container cleanup 4c58e1e6303866f38ba3af84f91ad010e3efc2c2f2926edbfda3d69b629b319b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-13T21:53:06.732 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:06 smithi088 bash[134250]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0 2024-09-13T21:53:06.732 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:06 smithi088 podman[134278]: 2024-09-13 21:53:06.55293871 +0000 UTC m=+0.535630837 container remove 4c58e1e6303866f38ba3af84f91ad010e3efc2c2f2926edbfda3d69b629b319b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T21:53:07.216 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:06 smithi088 podman[134365]: 2024-09-13 21:53:06.86054494 +0000 UTC m=+0.016106265 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:53:07.216 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:06 smithi088 podman[134365]: 2024-09-13 21:53:06.962647655 +0000 UTC m=+0.118208973 container create 1909c9c3c8e95432630c692d0cf45ed7582c8d3a8820fc5bdc59c9885f5ac41d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T21:53:07.216 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:07 smithi088 podman[134365]: 2024-09-13 21:53:07.21527523 +0000 UTC m=+0.370836540 container init 1909c9c3c8e95432630c692d0cf45ed7582c8d3a8820fc5bdc59c9885f5ac41d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be) 2024-09-13T21:53:07.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:07 smithi088 podman[134365]: 2024-09-13 21:53:07.219086075 +0000 UTC m=+0.374647389 container start 1909c9c3c8e95432630c692d0cf45ed7582c8d3a8820fc5bdc59c9885f5ac41d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-13T21:53:07.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:07 smithi088 podman[134365]: 2024-09-13 21:53:07.298511344 +0000 UTC m=+0.454072675 container attach 1909c9c3c8e95432630c692d0cf45ed7582c8d3a8820fc5bdc59c9885f5ac41d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-13T21:53:07.483 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:07 smithi088 podman[134365]: 2024-09-13 21:53:07.414659861 +0000 UTC m=+0.570221190 container died 1909c9c3c8e95432630c692d0cf45ed7582c8d3a8820fc5bdc59c9885f5ac41d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T21:53:07.980 INFO:journalctl@ceph.osd.0.smithi088.stdout:Sep 13 21:53:07 smithi088 podman[134388]: 2024-09-13 21:53:07.977177754 +0000 UTC m=+0.556459638 container remove 1909c9c3c8e95432630c692d0cf45ed7582c8d3a8820fc5bdc59c9885f5ac41d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T21:53:07.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T21:53:08.036 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T21:53:08.036 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T21:53:08.037 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T21:53:08.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-67511300-7217-11ef-bceb-c7b262605968@osd.1 2024-09-13T21:53:08.381 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:08 smithi088 systemd[1]: Stopping Ceph osd.1 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:53:08.732 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:08 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[104030]: 2024-09-13T21:53:08.380+0000 7f9c81d76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:53:08.732 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:08 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[104030]: 2024-09-13T21:53:08.380+0000 7f9c81d76640 -1 osd.1 96 *** Got signal Terminated *** 2024-09-13T21:53:08.732 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:08 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1[104030]: 2024-09-13T21:53:08.380+0000 7f9c81d76640 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:53:14.032 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:13 smithi088 podman[134467]: 2024-09-13 21:53:13.778740959 +0000 UTC m=+5.515024652 container died 1899bd970e44329f96f8d2ae0b27f8715f22ce7e7219ea534b32c30d17eef456 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T21:53:14.399 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:14 smithi088 podman[134467]: 2024-09-13 21:53:14.121800421 +0000 UTC m=+5.858084114 container cleanup 1899bd970e44329f96f8d2ae0b27f8715f22ce7e7219ea534b32c30d17eef456 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T21:53:14.399 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:14 smithi088 bash[134467]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1 2024-09-13T21:53:14.732 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:14 smithi088 podman[134482]: 2024-09-13 21:53:14.398249448 +0000 UTC m=+0.620267132 container remove 1899bd970e44329f96f8d2ae0b27f8715f22ce7e7219ea534b32c30d17eef456 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:53:15.019 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:14 smithi088 podman[134571]: 2024-09-13 21:53:14.66498301 +0000 UTC m=+0.016244725 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:53:15.019 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:14 smithi088 podman[134571]: 2024-09-13 21:53:14.782497308 +0000 UTC m=+0.133759008 container create dff723412e7df229f6d25fca17c3aad8d9b3c38c929d3b0f54459bfe4843d6d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:53:15.019 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:15 smithi088 podman[134571]: 2024-09-13 21:53:15.01838341 +0000 UTC m=+0.369645110 container init dff723412e7df229f6d25fca17c3aad8d9b3c38c929d3b0f54459bfe4843d6d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T21:53:15.476 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:15 smithi088 podman[134571]: 2024-09-13 21:53:15.022240541 +0000 UTC m=+0.373502245 container start dff723412e7df229f6d25fca17c3aad8d9b3c38c929d3b0f54459bfe4843d6d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T21:53:15.477 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:15 smithi088 podman[134571]: 2024-09-13 21:53:15.110311496 +0000 UTC m=+0.461573213 container attach dff723412e7df229f6d25fca17c3aad8d9b3c38c929d3b0f54459bfe4843d6d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T21:53:15.477 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 13 21:53:15 smithi088 podman[134571]: 2024-09-13 21:53:15.214293843 +0000 UTC m=+0.565555559 container died dff723412e7df229f6d25fca17c3aad8d9b3c38c929d3b0f54459bfe4843d6d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T21:53:15.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T21:53:15.984 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T21:53:15.984 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T21:53:15.984 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T21:53:15.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-67511300-7217-11ef-bceb-c7b262605968@osd.2 2024-09-13T21:53:16.232 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:16 smithi088 systemd[1]: Stopping Ceph osd.2 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:53:16.732 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:16 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[109880]: 2024-09-13T21:53:16.358+0000 7f4963006640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:53:16.732 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:16 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[109880]: 2024-09-13T21:53:16.358+0000 7f4963006640 -1 osd.2 96 *** Got signal Terminated *** 2024-09-13T21:53:16.732 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:16 smithi088 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2[109880]: 2024-09-13T21:53:16.358+0000 7f4963006640 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:53:22.062 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:21 smithi088 podman[134687]: 2024-09-13 21:53:21.778092828 +0000 UTC m=+5.538283870 container died c38a8f2ec340ce8d1c79a6db33ae2b16c6c211aa0fd4fcbdf635eb29d89fe0b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-ecab7be, GIT_CLEAN=True) 2024-09-13T21:53:22.478 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:22 smithi088 podman[134687]: 2024-09-13 21:53:22.158819936 +0000 UTC m=+5.919010967 container cleanup c38a8f2ec340ce8d1c79a6db33ae2b16c6c211aa0fd4fcbdf635eb29d89fe0b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T21:53:22.478 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:22 smithi088 bash[134687]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2 2024-09-13T21:53:22.732 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:22 smithi088 podman[134702]: 2024-09-13 21:53:22.477208983 +0000 UTC m=+0.689905384 container remove c38a8f2ec340ce8d1c79a6db33ae2b16c6c211aa0fd4fcbdf635eb29d89fe0b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T21:53:23.131 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:22 smithi088 podman[134793]: 2024-09-13 21:53:22.730520443 +0000 UTC m=+0.015781213 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:53:23.131 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:22 smithi088 podman[134793]: 2024-09-13 21:53:22.853099256 +0000 UTC m=+0.138360023 container create 0a674f55cea9298818c890d61a399d1b83c2cc8bc26b4b10d0633a21d90d9782 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:53:23.131 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:23 smithi088 podman[134793]: 2024-09-13 21:53:23.05577345 +0000 UTC m=+0.341034213 container init 0a674f55cea9298818c890d61a399d1b83c2cc8bc26b4b10d0633a21d90d9782 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T21:53:23.132 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:23 smithi088 podman[134793]: 2024-09-13 21:53:23.059055432 +0000 UTC m=+0.344316205 container start 0a674f55cea9298818c890d61a399d1b83c2cc8bc26b4b10d0633a21d90d9782 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:53:23.132 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:23 smithi088 podman[134793]: 2024-09-13 21:53:23.130569145 +0000 UTC m=+0.415829910 container attach 0a674f55cea9298818c890d61a399d1b83c2cc8bc26b4b10d0633a21d90d9782 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=) 2024-09-13T21:53:23.482 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:23 smithi088 podman[134793]: 2024-09-13 21:53:23.243837481 +0000 UTC m=+0.529098246 container died 0a674f55cea9298818c890d61a399d1b83c2cc8bc26b4b10d0633a21d90d9782 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T21:53:23.776 INFO:journalctl@ceph.osd.2.smithi088.stdout:Sep 13 21:53:23 smithi088 podman[134816]: 2024-09-13 21:53:23.759499927 +0000 UTC m=+0.508512575 container remove 0a674f55cea9298818c890d61a399d1b83c2cc8bc26b4b10d0633a21d90d9782 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:53:23.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T21:53:23.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T21:53:23.820 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T21:53:23.820 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T21:53:23.820 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-67511300-7217-11ef-bceb-c7b262605968@osd.3 2024-09-13T21:53:24.346 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:23 smithi116 systemd[1]: Stopping Ceph osd.3 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:53:24.846 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:24 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[74749]: 2024-09-13T21:53:24.386+0000 7f951acdf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:53:24.846 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:24 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[74749]: 2024-09-13T21:53:24.386+0000 7f951acdf640 -1 osd.3 96 *** Got signal Terminated *** 2024-09-13T21:53:24.846 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:24 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[74749]: 2024-09-13T21:53:24.386+0000 7f951acdf640 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:53:27.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:26 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:26.799+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:28.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:27 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:27.820+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:29.096 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:28 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3[74749]: 2024-09-13T21:53:28.939+0000 7f95132dc640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:04.497420+0000 front 2024-09-13T21:53:04.497433+0000 (oldest deadline 2024-09-13T21:53:28.597360+0000) 2024-09-13T21:53:29.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:28 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:28.829+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:29.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:29 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:29.346+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:30.038 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:29 smithi116 podman[100957]: 2024-09-13 21:53:29.724862312 +0000 UTC m=+5.706445893 container died 7b16f89f60866ea33a34032635dca78253c4a8401619be0168d133f1179447a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T21:53:30.038 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:29 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:29.869+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:30.317 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:30 smithi116 podman[100957]: 2024-09-13 21:53:30.245186093 +0000 UTC m=+6.226769713 container cleanup 7b16f89f60866ea33a34032635dca78253c4a8401619be0168d133f1179447a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T21:53:30.317 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:30 smithi116 bash[100957]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3 2024-09-13T21:53:30.596 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:30 smithi116 podman[100975]: 2024-09-13 21:53:30.463194517 +0000 UTC m=+0.739674481 container remove 7b16f89f60866ea33a34032635dca78253c4a8401619be0168d133f1179447a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T21:53:30.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:30 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:30.315+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:31.108 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:30 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:30.848+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:31.109 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:30 smithi116 podman[101063]: 2024-09-13 21:53:30.764200471 +0000 UTC m=+0.016172428 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:53:31.109 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:30 smithi116 podman[101063]: 2024-09-13 21:53:30.864058152 +0000 UTC m=+0.116030096 container create 5acef832c725a25753d58fb8bcf7523d48ad3b25092f8e8182f23053671b440b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T21:53:31.109 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:31 smithi116 podman[101063]: 2024-09-13 21:53:31.10808986 +0000 UTC m=+0.360061804 container init 5acef832c725a25753d58fb8bcf7523d48ad3b25092f8e8182f23053671b440b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T21:53:31.382 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:31 smithi116 podman[101063]: 2024-09-13 21:53:31.111855212 +0000 UTC m=+0.363827164 container start 5acef832c725a25753d58fb8bcf7523d48ad3b25092f8e8182f23053671b440b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:53:31.382 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:31 smithi116 podman[101063]: 2024-09-13 21:53:31.216639338 +0000 UTC m=+0.468611310 container attach 5acef832c725a25753d58fb8bcf7523d48ad3b25092f8e8182f23053671b440b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:53:31.382 INFO:journalctl@ceph.osd.3.smithi116.stdout:Sep 13 21:53:31 smithi116 podman[101063]: 2024-09-13 21:53:31.303507028 +0000 UTC m=+0.555478985 container died 5acef832c725a25753d58fb8bcf7523d48ad3b25092f8e8182f23053671b440b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T21:53:31.382 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:31 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:31.302+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:31.921 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:31 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:31.864+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:31.937 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T21:53:31.976 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T21:53:31.976 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T21:53:31.976 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T21:53:31.976 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-67511300-7217-11ef-bceb-c7b262605968@osd.4 2024-09-13T21:53:32.263 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:32 smithi116 systemd[1]: Stopping Ceph osd.4 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:53:32.264 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:32.262+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:32.596 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:32.366+0000 7fb8365ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:53:32.596 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:32.366+0000 7fb8365ba640 -1 osd.4 96 *** Got signal Terminated *** 2024-09-13T21:53:32.596 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:32.366+0000 7fb8365ba640 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:53:33.097 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:32 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:32.852+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:33.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:33 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:33.298+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:34.096 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:33 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:33.820+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:34.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:34 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:34.321+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:35.280 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:34 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:34.851+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:35.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:35 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:35.279+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:36.268 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:35 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:35.871+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:36.268 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:35 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:35.871+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:11.660936+0000 front 2024-09-13T21:53:11.660917+0000 (oldest deadline 2024-09-13T21:53:35.160713+0000) 2024-09-13T21:53:36.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:36 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:36.267+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:36.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:36 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:36.267+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:09.661877+0000 front 2024-09-13T21:53:09.661863+0000 (oldest deadline 2024-09-13T21:53:35.462044+0000) 2024-09-13T21:53:37.316 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:36 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:36.887+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:01.660188+0000 front 2024-09-13T21:53:01.660101+0000 (oldest deadline 2024-09-13T21:53:26.360107+0000) 2024-09-13T21:53:37.316 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:36 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4[79675]: 2024-09-13T21:53:36.887+0000 7fb832bbf640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:11.660936+0000 front 2024-09-13T21:53:11.660917+0000 (oldest deadline 2024-09-13T21:53:35.160713+0000) 2024-09-13T21:53:37.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:37 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:37.315+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:37.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:37 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:37.315+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:09.661877+0000 front 2024-09-13T21:53:09.661863+0000 (oldest deadline 2024-09-13T21:53:35.462044+0000) 2024-09-13T21:53:38.017 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:37 smithi116 podman[101175]: 2024-09-13 21:53:37.730359534 +0000 UTC m=+5.499973721 container died 482f725f147b6512894a2706fda526330fe912f7bb16919ad1869151ef3bc4b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T21:53:38.346 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:38 smithi116 podman[101175]: 2024-09-13 21:53:38.224047853 +0000 UTC m=+5.993662047 container cleanup 482f725f147b6512894a2706fda526330fe912f7bb16919ad1869151ef3bc4b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T21:53:38.346 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:38 smithi116 bash[101175]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4 2024-09-13T21:53:38.846 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:38 smithi116 podman[101191]: 2024-09-13 21:53:38.508648982 +0000 UTC m=+0.775046860 container remove 482f725f147b6512894a2706fda526330fe912f7bb16919ad1869151ef3bc4b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-ecab7be) 2024-09-13T21:53:38.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:38 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:38.354+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:38.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:38 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:38.354+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:09.661877+0000 front 2024-09-13T21:53:09.661863+0000 (oldest deadline 2024-09-13T21:53:35.462044+0000) 2024-09-13T21:53:39.099 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:38 smithi116 podman[101282]: 2024-09-13 21:53:38.751075456 +0000 UTC m=+0.015491011 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:53:39.100 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:38 smithi116 podman[101282]: 2024-09-13 21:53:38.884872069 +0000 UTC m=+0.149287673 container create 9324ccaafd1e911ff62a5ac8c8f451f1b255e57078d6d683dab1bb49c149f726 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T21:53:39.100 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:39 smithi116 podman[101282]: 2024-09-13 21:53:39.095616418 +0000 UTC m=+0.360031974 container init 9324ccaafd1e911ff62a5ac8c8f451f1b255e57078d6d683dab1bb49c149f726 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:53:39.100 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:39 smithi116 podman[101282]: 2024-09-13 21:53:39.099059394 +0000 UTC m=+0.363474954 container start 9324ccaafd1e911ff62a5ac8c8f451f1b255e57078d6d683dab1bb49c149f726 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T21:53:39.596 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:39 smithi116 podman[101282]: 2024-09-13 21:53:39.195633305 +0000 UTC m=+0.460048877 container attach 9324ccaafd1e911ff62a5ac8c8f451f1b255e57078d6d683dab1bb49c149f726 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T21:53:39.596 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 13 21:53:39 smithi116 podman[101282]: 2024-09-13 21:53:39.286520157 +0000 UTC m=+0.550935716 container died 9324ccaafd1e911ff62a5ac8c8f451f1b255e57078d6d683dab1bb49c149f726 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux ) 2024-09-13T21:53:39.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:39 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:39.329+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:39.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:39 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:39.329+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:09.661877+0000 front 2024-09-13T21:53:09.661863+0000 (oldest deadline 2024-09-13T21:53:35.462044+0000) 2024-09-13T21:53:39.923 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T21:53:39.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T21:53:39.961 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T21:53:39.962 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T21:53:39.962 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-67511300-7217-11ef-bceb-c7b262605968@osd.5 2024-09-13T21:53:40.311 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:40 smithi116 systemd[1]: Stopping Ceph osd.5 for 67511300-7217-11ef-bceb-c7b262605968... 2024-09-13T21:53:40.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:40 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:40.309+0000 7f785e076640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:53:40.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:40 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:40.309+0000 7f785e076640 -1 osd.5 96 *** Got signal Terminated *** 2024-09-13T21:53:40.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:40 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:40.309+0000 7f785e076640 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:53:40.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:40 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:40.332+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:40.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:40 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:40.332+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:09.661877+0000 front 2024-09-13T21:53:09.661863+0000 (oldest deadline 2024-09-13T21:53:35.462044+0000) 2024-09-13T21:53:41.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:41 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:41.348+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:41.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:41 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:41.348+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:09.661877+0000 front 2024-09-13T21:53:09.661863+0000 (oldest deadline 2024-09-13T21:53:35.462044+0000) 2024-09-13T21:53:42.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:42 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:42.325+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:42.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:42 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:42.325+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:09.661877+0000 front 2024-09-13T21:53:09.661863+0000 (oldest deadline 2024-09-13T21:53:35.462044+0000) 2024-09-13T21:53:43.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:43 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:43.361+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:43.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:43 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:43.361+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:09.661877+0000 front 2024-09-13T21:53:09.661863+0000 (oldest deadline 2024-09-13T21:53:35.462044+0000) 2024-09-13T21:53:43.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:43 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:43.361+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-09-13T21:53:17.762910+0000 front 2024-09-13T21:53:17.762895+0000 (oldest deadline 2024-09-13T21:53:43.062842+0000) 2024-09-13T21:53:44.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:44 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:44.316+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-09-13T21:53:05.060967+0000 front 2024-09-13T21:53:05.060844+0000 (oldest deadline 2024-09-13T21:53:28.560899+0000) 2024-09-13T21:53:44.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:44 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:44.316+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-09-13T21:53:09.661877+0000 front 2024-09-13T21:53:09.661863+0000 (oldest deadline 2024-09-13T21:53:35.462044+0000) 2024-09-13T21:53:44.596 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:44 smithi116 ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5[84575]: 2024-09-13T21:53:44.316+0000 7f7856673640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-09-13T21:53:17.762910+0000 front 2024-09-13T21:53:17.762895+0000 (oldest deadline 2024-09-13T21:53:43.062842+0000) 2024-09-13T21:53:45.929 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:45 smithi116 podman[101385]: 2024-09-13 21:53:45.648880364 +0000 UTC m=+5.467770927 container died 7bde2a23d60abd6591fffa9eca016cfe67c8269a9070f69abf7032a0dfd4ed71 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:53:46.346 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:46 smithi116 podman[101385]: 2024-09-13 21:53:46.110511469 +0000 UTC m=+5.929402033 container cleanup 7bde2a23d60abd6591fffa9eca016cfe67c8269a9070f69abf7032a0dfd4ed71 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T21:53:46.346 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:46 smithi116 bash[101385]: ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5 2024-09-13T21:53:46.846 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:46 smithi116 podman[101401]: 2024-09-13 21:53:46.470162331 +0000 UTC m=+0.813391621 container remove 7bde2a23d60abd6591fffa9eca016cfe67c8269a9070f69abf7032a0dfd4ed71 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T21:53:47.165 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:46 smithi116 podman[101490]: 2024-09-13 21:53:46.777761915 +0000 UTC m=+0.015550546 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:53:47.165 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:46 smithi116 podman[101490]: 2024-09-13 21:53:46.879076435 +0000 UTC m=+0.116865066 container create a4bac9f206d086f300556801bac574ca109da4de90da99dd5741f46d248f2f54 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T21:53:47.166 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:47 smithi116 podman[101490]: 2024-09-13 21:53:47.081560534 +0000 UTC m=+0.319349165 container init a4bac9f206d086f300556801bac574ca109da4de90da99dd5741f46d248f2f54 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T21:53:47.166 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:47 smithi116 podman[101490]: 2024-09-13 21:53:47.085034555 +0000 UTC m=+0.322823179 container start a4bac9f206d086f300556801bac574ca109da4de90da99dd5741f46d248f2f54 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-13T21:53:47.166 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:47 smithi116 podman[101490]: 2024-09-13 21:53:47.164857571 +0000 UTC m=+0.402646210 container attach a4bac9f206d086f300556801bac574ca109da4de90da99dd5741f46d248f2f54 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-13T21:53:47.544 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 21:53:47 smithi116 podman[101490]: 2024-09-13 21:53:47.271569374 +0000 UTC m=+0.509358013 container died a4bac9f206d086f300556801bac574ca109da4de90da99dd5741f46d248f2f54 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-67511300-7217-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:53:47.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-67511300-7217-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T21:53:47.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T21:53:47.951 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T21:53:47.952 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 67511300-7217-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T21:53:48.106 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting cluster with fsid: 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:54:13.487 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 67511300-7217-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T21:54:13.642 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:54:26.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:54:26.572 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:54:26.600 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T21:54:26.602 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904186/remote/smithi088/crash 2024-09-13T21:54:26.602 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/crash -- . 2024-09-13T21:54:26.641 INFO:teuthology.orchestra.run.smithi088.stderr:tar: /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T21:54:26.642 INFO:teuthology.orchestra.run.smithi088.stderr:tar: Error is not recoverable: exiting now 2024-09-13T21:54:26.643 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904186/remote/smithi116/crash 2024-09-13T21:54:26.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/crash -- . 2024-09-13T21:54:26.668 INFO:teuthology.orchestra.run.smithi116.stderr:tar: /var/lib/ceph/67511300-7217-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T21:54:26.668 INFO:teuthology.orchestra.run.smithi116.stderr:tar: Error is not recoverable: exiting now 2024-09-13T21:54:26.669 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T21:54:26.669 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T21:54:26.727 INFO:teuthology.orchestra.run.smithi088.stdout:2024-09-13T21:50:00.000173+0000 mon.smithi088 (mon.0) 730 : cluster [WRN] fs cephfs is degraded 2024-09-13T21:54:26.727 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-13T21:54:26.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[SEC\]' /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T21:54:26.802 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]' /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T21:54:26.874 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[WRN\]' /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T21:54:26.946 INFO:teuthology.orchestra.run.smithi088.stdout:2024-09-13T21:50:00.000173+0000 mon.smithi088 (mon.0) 730 : cluster [WRN] fs cephfs is degraded 2024-09-13T21:54:26.947 INFO:tasks.cephadm:Compressing logs... 2024-09-13T21:54:26.947 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T21:54:26.990 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T21:54:27.014 INFO:teuthology.orchestra.run.smithi088.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-13T21:54:27.014 INFO:teuthology.orchestra.run.smithi088.stderr:: No such file or directory 2024-09-13T21:54:27.015 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mon.smithi088.log 2024-09-13T21:54:27.015 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-13T21:54:27.015 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mon.smithi088.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T21:54:27.015 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T21:54:27.015 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.1.log: /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.yszliw.log 2024-09-13T21:54:27.016 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T21:54:27.024 INFO:teuthology.orchestra.run.smithi116.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T21:54:27.024 INFO:teuthology.orchestra.run.smithi116.stderr:: No such file or directory 2024-09-13T21:54:27.024 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mon.smithi116.log 2024-09-13T21:54:27.024 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-13T21:54:27.024 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mon.smithi116.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T21:54:27.025 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi116.mjrkvg.log 2024-09-13T21:54:27.025 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T21:54:27.025 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi116.mjrkvg.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi116.rwfayz.log 2024-09-13T21:54:27.025 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi116.log 2024-09-13T21:54:27.025 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi116.rwfayz.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-13T21:54:27.025 INFO:teuthology.orchestra.run.smithi116.stderr: 85.9% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T21:54:27.026 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi116.log: 94.1% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi116.log.gz 2024-09-13T21:54:27.026 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi116.bqnvtn.log 2024-09-13T21:54:27.026 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log 2024-09-13T21:54:27.026 INFO:teuthology.orchestra.run.smithi116.stderr: 94.0% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi116.mjrkvg.log.gz 2024-09-13T21:54:27.026 INFO:teuthology.orchestra.run.smithi116.stderr: 91.6% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T21:54:27.026 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi116.bqnvtn.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-13T21:54:27.027 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T21:54:27.029 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.3.log: 88.1% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T21:54:27.029 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T21:54:27.031 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.yszliw.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi088.scyrwy.log 2024-09-13T21:54:27.031 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.cephadm.log: /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi088.scyrwy.log: 85.9% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T21:54:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-13T21:54:27.032 INFO:teuthology.orchestra.run.smithi088.stderr: 91.4% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T21:54:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log 2024-09-13T21:54:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.vqfqko.log 2024-09-13T21:54:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log: 88.1% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T21:54:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi088.log 2024-09-13T21:54:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.vqfqko.log: 91.6% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T21:54:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T21:54:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi088.log: 94.0% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi088.log.gz 2024-09-13T21:54:27.033 INFO:teuthology.orchestra.run.smithi116.stderr: 91.5% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T21:54:27.055 INFO:teuthology.orchestra.run.smithi116.stderr: 89.0% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi116.bqnvtn.log.gz 2024-09-13T21:54:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/cephadm.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T21:54:27.397 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi088.scyrwy.log.gz 2024-09-13T21:54:27.419 INFO:teuthology.orchestra.run.smithi116.stderr: 92.5% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mon.smithi116.log.gz 2024-09-13T21:54:27.875 INFO:teuthology.orchestra.run.smithi088.stderr: 90.6% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mon.smithi088.log.gz 2024-09-13T21:54:31.031 INFO:teuthology.orchestra.run.smithi116.stderr: 93.5% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-13T21:54:31.699 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-13T21:54:32.269 INFO:teuthology.orchestra.run.smithi088.stderr: 95.3% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.yszliw.log.gz 2024-09-13T21:54:32.421 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-13T21:54:32.430 INFO:teuthology.orchestra.run.smithi116.stderr: 93.5% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-13T21:54:32.858 INFO:teuthology.orchestra.run.smithi116.stderr: 93.6% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-13T21:54:34.028 INFO:teuthology.orchestra.run.smithi088.stderr: 93.1% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-13T21:55:11.226 INFO:teuthology.orchestra.run.smithi088.stderr: 93.1% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi088.vqfqko.log.gz 2024-09-13T21:55:11.227 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-09-13T21:55:11.227 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m44.225s 2024-09-13T21:55:11.227 INFO:teuthology.orchestra.run.smithi088.stderr:user 1m5.603s 2024-09-13T21:55:11.228 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m2.156s 2024-09-13T21:55:12.045 INFO:teuthology.orchestra.run.smithi116.stderr: 93.0% -- replaced with /var/log/ceph/67511300-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi116.rwfayz.log.gz 2024-09-13T21:55:12.046 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-13T21:55:12.046 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m45.042s 2024-09-13T21:55:12.046 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m58.663s 2024-09-13T21:55:12.046 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m2.010s 2024-09-13T21:55:12.047 INFO:tasks.cephadm:Archiving logs... 2024-09-13T21:55:12.048 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904186/remote/smithi088/log 2024-09-13T21:55:12.049 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T21:55:21.775 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904186/remote/smithi116/log 2024-09-13T21:55:21.776 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T21:55:31.059 INFO:tasks.cephadm:Removing cluster... 2024-09-13T21:55:31.060 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 67511300-7217-11ef-bceb-c7b262605968 --force 2024-09-13T21:55:31.211 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting cluster with fsid: 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:55:31.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 67511300-7217-11ef-bceb-c7b262605968 --force 2024-09-13T21:55:31.829 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 67511300-7217-11ef-bceb-c7b262605968 2024-09-13T21:55:32.170 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T21:55:32.171 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T21:55:32.188 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T21:55:32.204 INFO:tasks.cephadm:Teardown complete 2024-09-13T21:55:32.204 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T21:55:32.216 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T21:55:32.216 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T21:55:32.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T21:55:32.330 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T21:55:32.341 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T21:55:32.341 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T21:55:32.344 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T21:55:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-09-13T21:55:32.358 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-13T21:55:32.360 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T21:55:32.360 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-09-13T21:55:32.360 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 -249us[ -244us] +/- 45ms 2024-09-13T21:55:32.360 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 +657us[ +661us] +/- 58ms 2024-09-13T21:55:32.360 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -326us[ -320us] +/- 64ms 2024-09-13T21:55:32.360 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:32.362 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T21:55:32.362 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-13T21:55:32.362 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 65 -250us[ -250us] +/- 44ms 2024-09-13T21:55:32.362 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 +680us[ +680us] +/- 58ms 2024-09-13T21:55:32.363 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 -297us[ -297us] +/- 64ms 2024-09-13T21:55:32.363 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:32.363 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T21:55:32.375 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T21:55:32.375 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T21:55:32.415 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T21:55:32.498 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T21:55:32.573 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T21:55:32.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:55:32.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T21:55:32.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:55:32.635 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T21:55:32.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T21:55:32.690 INFO:teuthology.task.internal:Duration was 1849.434008 seconds 2024-09-13T21:55:32.691 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T21:55:32.740 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T21:55:32.740 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T21:55:32.743 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T21:55:32.780 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T21:55:32.781 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T21:55:33.136 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T21:55:33.136 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T21:55:33.137 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T21:55:33.157 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-09-13T21:55:33.157 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T21:55:33.205 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T21:55:33.206 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T21:55:33.208 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T21:55:33.272 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T21:55:33.272 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T21:55:33.274 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T21:55:33.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T21:55:33.955 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T21:55:33.956 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T21:55:33.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T21:55:34.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T21:55:34.019 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T21:55:34.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T21:55:34.044 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-09-13T21:55:34.071 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-09-13T21:55:34.085 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T21:55:34.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:55:34.113 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T21:55:34.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:55:34.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T21:55:34.152 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T21:55:34.153 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904186/remote/smithi088 2024-09-13T21:55:34.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T21:55:34.203 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904186/remote/smithi116 2024-09-13T21:55:34.203 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T21:55:34.242 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T21:55:34.242 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T21:55:34.245 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T21:55:34.290 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T21:55:34.303 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T21:55:34.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T21:55:34.337 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T21:55:34.337 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T21:55:34.339 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T21:55:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 21:55 /home/ubuntu/cephtest 2024-09-13T21:55:34.354 INFO:teuthology.orchestra.run.smithi116.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 21:55 /home/ubuntu/cephtest 2024-09-13T21:55:34.355 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T21:55:34.387 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T21:55:34.453 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1849.434008359909 failure_reason: '"2024-09-13T21:50:00.000173+0000 mon.smithi088 (mon.0) 730 : cluster [WRN] fs cephfs is degraded" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-09-13T21:55:34.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T21:55:34.529 INFO:teuthology.run:FAIL